2023-07-14T15:26:58.100 INFO:root:teuthology version: 0.0.1.dev145+gaa6a80e 2023-07-14T15:26:58.101 DEBUG:teuthology.run:Teuthology command: teuthology --name rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi --description fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/snapshot}} --verbose --archive /home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337600 --owner scheduled_rishabh@teuthology -- /home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337600/orig.config.yaml 2023-07-14T15:26:58.153 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T15:26:58.273 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337600 branch: wip-rishabh-2023Jul13 description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/snapshot}} email: null first_in_suite: false job_id: '7337600' kernel: client: branch: testing flavor: default kdb: true sha1: a440c79eee0258ae07e4988d8690fe6187b8b7a3 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-rishabh-2023Jul13 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 3fc0089cc1082313a98853d48b892acdc1385b8b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 3fc0089cc1082313a98853d48b892acdc1385b8b kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-2023Jul13 sha1: 3fc0089cc1082313a98853d48b892acdc1385b8b owner: scheduled_rishabh@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 sha1: 3fc0089cc1082313a98853d48b892acdc1385b8b sleep_before_teardown: 0 suite: fs suite_branch: wip-rishabh-2023Jul13 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_3fc0089cc1082313a98853d48b892acdc1385b8b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 3fc0089cc1082313a98853d48b892acdc1385b8b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi037.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= smithi098.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots - tasks.cephfs.test_volumes.TestSubvolumeSnapshots teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: aa6a80e6cc655fff48452a7eca02070e61d074fc timestamp: 2023-07-14_10:26:42 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-07-14T15:26:58.274 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_3fc0089cc1082313a98853d48b892acdc1385b8b/qa; will attempt to use it 2023-07-14T15:26:58.275 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_3fc0089cc1082313a98853d48b892acdc1385b8b/qa/tasks 2023-07-14T15:26:58.275 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-07-14T15:26:58.277 INFO:teuthology.task.internal:Checking packages... 2023-07-14T15:26:58.310 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '3fc0089cc1082313a98853d48b892acdc1385b8b' 2023-07-14T15:26:58.310 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-07-14T15:26:58.311 INFO:teuthology.packaging:ref: None 2023-07-14T15:26:58.311 INFO:teuthology.packaging:tag: None 2023-07-14T15:26:58.311 INFO:teuthology.packaging:branch: wip-rishabh-2023Jul13 2023-07-14T15:26:58.312 INFO:teuthology.packaging:sha1: 3fc0089cc1082313a98853d48b892acdc1385b8b 2023-07-14T15:26:58.312 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-rishabh-2023Jul13 2023-07-14T15:26:58.681 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-4757.g3fc0089c 2023-07-14T15:26:58.682 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-07-14T15:26:58.689 INFO:teuthology.task.internal:no buildpackages task found 2023-07-14T15:26:58.689 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-07-14T15:26:58.711 INFO:teuthology.task.internal:Saving configuration 2023-07-14T15:26:58.730 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-07-14T15:26:58.736 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-14T15:27:06.275 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337600', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 15:19:14.480878', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-14T15:27:06.298 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi098.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337600', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 15:19:14.482805', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-14T15:27:06.298 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-07-14T15:27:06.305 INFO:teuthology.task.internal:roles: ubuntu@smithi037.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-07-14T15:27:06.306 INFO:teuthology.task.internal:roles: ubuntu@smithi098.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-07-14T15:27:06.306 INFO:teuthology.run_tasks:Running task console_log... 2023-07-14T15:27:06.417 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8a53f4d430>, signals=[15]) 2023-07-14T15:27:06.418 INFO:teuthology.run_tasks:Running task internal.connect... 2023-07-14T15:27:06.425 INFO:teuthology.task.internal:Opening connections... 2023-07-14T15:27:06.426 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi037.front.sepia.ceph.com 2023-07-14T15:27:06.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T15:27:06.502 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi098.front.sepia.ceph.com 2023-07-14T15:27:06.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T15:27:06.576 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-07-14T15:27:06.585 DEBUG:teuthology.orchestra.run.smithi037:> uname -m 2023-07-14T15:27:06.614 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2023-07-14T15:27:06.614 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2023-07-14T15:27:06.674 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="Red Hat Enterprise Linux" 2023-07-14T15:27:06.674 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="8.6 (Ootpa)" 2023-07-14T15:27:06.675 INFO:teuthology.orchestra.run.smithi037.stdout:ID="rhel" 2023-07-14T15:27:06.675 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="fedora" 2023-07-14T15:27:06.675 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="8.6" 2023-07-14T15:27:06.675 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el8" 2023-07-14T15:27:06.676 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-14T15:27:06.676 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31" 2023-07-14T15:27:06.676 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-14T15:27:06.676 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://www.redhat.com/" 2023-07-14T15:27:06.676 INFO:teuthology.orchestra.run.smithi037.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-14T15:27:06.676 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-14T15:27:06.676 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:27:06.677 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-14T15:27:06.677 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-14T15:27:06.677 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-14T15:27:06.677 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-14T15:27:06.678 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2023-07-14T15:27:06.694 DEBUG:teuthology.orchestra.run.smithi098:> uname -m 2023-07-14T15:27:06.715 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64 2023-07-14T15:27:06.716 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2023-07-14T15:27:06.775 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="Red Hat Enterprise Linux" 2023-07-14T15:27:06.775 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="8.6 (Ootpa)" 2023-07-14T15:27:06.775 INFO:teuthology.orchestra.run.smithi098.stdout:ID="rhel" 2023-07-14T15:27:06.775 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="fedora" 2023-07-14T15:27:06.775 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="8.6" 2023-07-14T15:27:06.776 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el8" 2023-07-14T15:27:06.776 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-14T15:27:06.776 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2023-07-14T15:27:06.777 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-14T15:27:06.777 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://www.redhat.com/" 2023-07-14T15:27:06.777 INFO:teuthology.orchestra.run.smithi098.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-14T15:27:06.777 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-14T15:27:06.777 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-14T15:27:06.777 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-14T15:27:06.777 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-14T15:27:06.778 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-14T15:27:06.778 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-14T15:27:06.778 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2023-07-14T15:27:06.803 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-07-14T15:27:06.816 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-07-14T15:27:06.847 INFO:teuthology.task.internal:Checking for old test directory... 2023-07-14T15:27:06.847 DEBUG:teuthology.orchestra.run.smithi037:> test '!' -e /home/ubuntu/cephtest 2023-07-14T15:27:06.850 DEBUG:teuthology.orchestra.run.smithi098:> test '!' -e /home/ubuntu/cephtest 2023-07-14T15:27:06.869 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-07-14T15:27:06.887 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-07-14T15:27:06.887 DEBUG:teuthology.orchestra.run.smithi037:> test -z $(ls -A /var/lib/ceph) 2023-07-14T15:27:06.915 DEBUG:teuthology.orchestra.run.smithi098:> test -z $(ls -A /var/lib/ceph) 2023-07-14T15:27:06.949 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-07-14T15:27:07.011 INFO:teuthology.run_tasks:Running task kernel... 2023-07-14T15:27:07.029 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'a440c79eee0258ae07e4988d8690fe6187b8b7a3'} 2023-07-14T15:27:07.030 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-07-14T15:27:07.030 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-07-14T15:27:07.031 DEBUG:teuthology.orchestra.run.smithi037:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-14T15:27:07.031 DEBUG:teuthology.orchestra.run.smithi098:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-14T15:27:07.050 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T15:27:07.051 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-07-14T15:27:07.055 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T15:27:07.056 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-07-14T15:27:07.430 DEBUG:teuthology.task.kernel:sha1 for client.0 is a440c79eee0258ae07e4988d8690fe6187b8b7a3 2023-07-14T15:27:07.430 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "a440c79eee0258ae07e4988d8690fe6187b8b7a3"... 2023-07-14T15:27:07.431 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2023-07-14T15:27:07.444 DEBUG:teuthology.task.kernel:sha1 for client.1 is a440c79eee0258ae07e4988d8690fe6187b8b7a3 2023-07-14T15:27:07.444 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "a440c79eee0258ae07e4988d8690fe6187b8b7a3"... 2023-07-14T15:27:07.445 DEBUG:teuthology.orchestra.run.smithi098:> uname -r 2023-07-14T15:27:07.452 INFO:teuthology.orchestra.run.smithi037.stdout:4.18.0-372.9.1.el8.x86_64 2023-07-14T15:27:07.452 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-372.9.1.el8.x86_64 vs a440c79eee0258ae07e4988d8690fe6187b8b7a3 2023-07-14T15:27:07.452 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-07-14T15:27:07.453 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum upgrade -y linux-firmware 2023-07-14T15:27:07.466 INFO:teuthology.orchestra.run.smithi098.stdout:4.18.0-372.9.1.el8.x86_64 2023-07-14T15:27:07.466 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-372.9.1.el8.x86_64 vs a440c79eee0258ae07e4988d8690fe6187b8b7a3 2023-07-14T15:27:07.466 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-07-14T15:27:07.467 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum upgrade -y linux-firmware 2023-07-14T15:27:08.668 INFO:teuthology.orchestra.run.smithi037.stdout:Updating Subscription Management repositories. 2023-07-14T15:27:08.668 INFO:teuthology.orchestra.run.smithi037.stdout:Unable to read consumer identity 2023-07-14T15:27:08.695 INFO:teuthology.orchestra.run.smithi098.stdout:Updating Subscription Management repositories. 2023-07-14T15:27:08.696 INFO:teuthology.orchestra.run.smithi098.stdout:Unable to read consumer identity 2023-07-14T15:27:10.230 INFO:teuthology.orchestra.run.smithi037.stdout:Copr repo for python3-asyncssh owned by ceph 11 kB/s | 3.5 kB 00:00 2023-07-14T15:27:10.338 INFO:teuthology.orchestra.run.smithi098.stdout:Copr repo for python3-asyncssh owned by ceph 11 kB/s | 3.5 kB 00:00 2023-07-14T15:27:24.271 INFO:teuthology.orchestra.run.smithi098.stdout:Extra Packages for Enterprise Linux 1.1 MB/s | 16 MB 00:13 2023-07-14T15:27:27.763 INFO:teuthology.orchestra.run.smithi098.stdout:lab-extras 410 kB/s | 24 kB 00:00 2023-07-14T15:27:28.539 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2023-07-14T15:27:28.540 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2023-07-14T15:27:28.540 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2023-07-14T15:27:28.654 INFO:teuthology.task.kernel:Downloading kernel a440c79eee0258ae07e4988d8690fe6187b8b7a3 on client.1... 2023-07-14T15:27:28.654 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a440c79eee0258ae07e4988d8690fe6187b8b7a3 2023-07-14T15:27:29.043 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/a440c79eee0258ae07e4988d8690fe6187b8b7a3/centos/8/flavors/default/x86_64/ 2023-07-14T15:27:29.044 DEBUG:teuthology.orchestra.run.smithi098:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc1_ga440c79eee02-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/a440c79eee0258ae07e4988d8690fe6187b8b7a3/centos/8/flavors/default/x86_64/ --input-file=- 2023-07-14T15:27:29.046 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi098.front.sepia.ceph.com to complete... 2023-07-14T15:27:36.787 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 602 kB/s | 16 MB 00:26 2023-07-14T15:27:40.587 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 251 kB/s | 24 kB 00:00 2023-07-14T15:27:41.371 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2023-07-14T15:27:41.372 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2023-07-14T15:27:41.373 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2023-07-14T15:27:41.513 INFO:teuthology.task.kernel:Downloading kernel a440c79eee0258ae07e4988d8690fe6187b8b7a3 on client.0... 2023-07-14T15:27:41.513 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a440c79eee0258ae07e4988d8690fe6187b8b7a3 2023-07-14T15:27:41.950 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/a440c79eee0258ae07e4988d8690fe6187b8b7a3/centos/8/flavors/default/x86_64/ 2023-07-14T15:27:41.951 DEBUG:teuthology.orchestra.run.smithi037:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc1_ga440c79eee02-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/a440c79eee0258ae07e4988d8690fe6187b8b7a3/centos/8/flavors/default/x86_64/ --input-file=- 2023-07-14T15:27:41.954 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi037.front.sepia.ceph.com to complete... 2023-07-14T15:34:34.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14 15:34:34 URL:https://2.chacra.ceph.com/r/kernel/testing/a440c79eee0258ae07e4988d8690fe6187b8b7a3/centos/8/flavors/default/x86_64/kernel-6.5.0_rc1_ga440c79eee02-1.x86_64.rpm [380684764/380684764] -> "/tmp/kernel.x86_64.rpm" [1] 2023-07-14T15:34:34.951 INFO:teuthology.orchestra.run.smithi037.stderr:FINISHED --2023-07-14 15:34:34-- 2023-07-14T15:34:34.951 INFO:teuthology.orchestra.run.smithi037.stderr:Total wall clock time: 6m 53s 2023-07-14T15:34:34.951 INFO:teuthology.orchestra.run.smithi037.stderr:Downloaded: 1 files, 363M in 6m 53s (901 KB/s) 2023-07-14T15:34:34.952 INFO:teuthology.task.kernel:Installing kernel a440c79eee0258ae07e4988d8690fe6187b8b7a3 on client.0... 2023-07-14T15:34:34.952 DEBUG:teuthology.orchestra.run.smithi037:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-07-14T15:34:36.653 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying... ######################################## 2023-07-14T15:34:36.715 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing... ######################################## 2023-07-14T15:34:36.806 INFO:teuthology.orchestra.run.smithi037.stdout:Updating / installing... 2023-07-14T15:34:38.576 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14 15:34:38 URL:https://2.chacra.ceph.com/r/kernel/testing/a440c79eee0258ae07e4988d8690fe6187b8b7a3/centos/8/flavors/default/x86_64/kernel-6.5.0_rc1_ga440c79eee02-1.x86_64.rpm [380684764/380684764] -> "/tmp/kernel.x86_64.rpm" [1] 2023-07-14T15:34:38.576 INFO:teuthology.orchestra.run.smithi098.stderr:FINISHED --2023-07-14 15:34:38-- 2023-07-14T15:34:38.576 INFO:teuthology.orchestra.run.smithi098.stderr:Total wall clock time: 7m 9s 2023-07-14T15:34:38.577 INFO:teuthology.orchestra.run.smithi098.stderr:Downloaded: 1 files, 363M in 7m 9s (867 KB/s) 2023-07-14T15:34:38.578 INFO:teuthology.task.kernel:Installing kernel a440c79eee0258ae07e4988d8690fe6187b8b7a3 on client.1... 2023-07-14T15:34:38.578 DEBUG:teuthology.orchestra.run.smithi098:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-07-14T15:34:40.199 INFO:teuthology.orchestra.run.smithi098.stdout:Verifying... ######################################## 2023-07-14T15:34:40.260 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing... ######################################## 2023-07-14T15:34:40.346 INFO:teuthology.orchestra.run.smithi098.stdout:Updating / installing... 2023-07-14T15:35:17.567 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-6.5.0_rc1_ga440c79eee02-1 ######################################## 2023-07-14T15:35:18.336 INFO:teuthology.orchestra.run.smithi098.stdout:kernel-6.5.0_rc1_ga440c79eee02-1 ######################################## 2023-07-14T15:35:39.169 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi037.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-07-14T15:35:39.170 DEBUG:teuthology.orchestra.run.smithi037:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-07-14T15:35:39.219 INFO:teuthology.orchestra.run.smithi037.stdout:/boot/System.map-6.5.0-rc1-ga440c79eee02 2023-07-14T15:35:39.219 INFO:teuthology.orchestra.run.smithi037.stdout:/boot/config-6.5.0-rc1-ga440c79eee02 2023-07-14T15:35:39.219 INFO:teuthology.orchestra.run.smithi037.stdout:/boot/vmlinuz-6.5.0-rc1-ga440c79eee02 2023-07-14T15:35:39.220 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02 2023-07-14T15:35:39.220 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel 2023-07-14T15:35:39.220 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch 2023-07-14T15:35:39.220 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86 2023-07-14T15:35:39.220 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto 2023-07-14T15:35:39.220 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-07-14T15:35:39.221 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-07-14T15:35:39.221 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-07-14T15:35:39.221 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-07-14T15:35:39.221 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-07-14T15:35:39.221 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-07-14T15:35:39.221 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-07-14T15:35:39.221 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/crc32c-intel.ko 2023-07-14T15:35:39.222 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-07-14T15:35:39.222 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-07-14T15:35:39.222 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-07-14T15:35:39.222 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-07-14T15:35:39.222 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/serpent-avx2.ko 2023-07-14T15:35:39.222 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-07-14T15:35:39.222 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-07-14T15:35:39.222 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-07-14T15:35:39.223 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-07-14T15:35:39.223 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-07-14T15:35:39.223 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-07-14T15:35:39.223 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-07-14T15:35:39.223 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kernel 2023-07-14T15:35:39.223 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kernel/cpu 2023-07-14T15:35:39.223 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kernel/cpu/mce 2023-07-14T15:35:39.223 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-07-14T15:35:39.224 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kvm 2023-07-14T15:35:39.224 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kvm/kvm-amd.ko 2023-07-14T15:35:39.224 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kvm/kvm-intel.ko 2023-07-14T15:35:39.224 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kvm/kvm.ko 2023-07-14T15:35:39.224 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto 2023-07-14T15:35:39.224 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/ansi_cprng.ko 2023-07-14T15:35:39.224 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/anubis.ko 2023-07-14T15:35:39.225 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/arc4.ko 2023-07-14T15:35:39.225 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx 2023-07-14T15:35:39.225 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_memcpy.ko 2023-07-14T15:35:39.225 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_pq.ko 2023-07-14T15:35:39.225 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_raid6_recov.ko 2023-07-14T15:35:39.225 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_tx.ko 2023-07-14T15:35:39.225 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_xor.ko 2023-07-14T15:35:39.226 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/raid6test.ko 2023-07-14T15:35:39.226 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/authenc.ko 2023-07-14T15:35:39.226 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/authencesn.ko 2023-07-14T15:35:39.226 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/blake2b_generic.ko 2023-07-14T15:35:39.226 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/blowfish_common.ko 2023-07-14T15:35:39.226 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/blowfish_generic.ko 2023-07-14T15:35:39.226 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/camellia_generic.ko 2023-07-14T15:35:39.226 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cast5_generic.ko 2023-07-14T15:35:39.227 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cast6_generic.ko 2023-07-14T15:35:39.227 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cast_common.ko 2023-07-14T15:35:39.227 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/ccm.ko 2023-07-14T15:35:39.227 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cmac.ko 2023-07-14T15:35:39.227 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/crc32_generic.ko 2023-07-14T15:35:39.227 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/crypto_engine.ko 2023-07-14T15:35:39.227 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/crypto_user.ko 2023-07-14T15:35:39.228 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cts.ko 2023-07-14T15:35:39.228 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/des_generic.ko 2023-07-14T15:35:39.228 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/dh_generic.ko 2023-07-14T15:35:39.228 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/echainiv.ko 2023-07-14T15:35:39.228 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/essiv.ko 2023-07-14T15:35:39.228 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/fcrypt.ko 2023-07-14T15:35:39.228 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/khazad.ko 2023-07-14T15:35:39.228 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/lz4.ko 2023-07-14T15:35:39.229 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/lz4hc.ko 2023-07-14T15:35:39.229 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/md4.ko 2023-07-14T15:35:39.229 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/michael_mic.ko 2023-07-14T15:35:39.229 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/pcbc.ko 2023-07-14T15:35:39.229 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/pcrypt.ko 2023-07-14T15:35:39.229 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/rmd160.ko 2023-07-14T15:35:39.229 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/seed.ko 2023-07-14T15:35:39.229 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/serpent_generic.ko 2023-07-14T15:35:39.230 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/tcrypt.ko 2023-07-14T15:35:39.230 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/tea.ko 2023-07-14T15:35:39.230 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/twofish_common.ko 2023-07-14T15:35:39.230 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/twofish_generic.ko 2023-07-14T15:35:39.230 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/vmac.ko 2023-07-14T15:35:39.230 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/wp512.ko 2023-07-14T15:35:39.230 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/xcbc.ko 2023-07-14T15:35:39.231 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/xor.ko 2023-07-14T15:35:39.231 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/xxhash_generic.ko 2023-07-14T15:35:39.231 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers 2023-07-14T15:35:39.231 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi 2023-07-14T15:35:39.231 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/acpi_ipmi.ko 2023-07-14T15:35:39.231 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/acpi_pad.ko 2023-07-14T15:35:39.231 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/custom_method.ko 2023-07-14T15:35:39.231 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/ec_sys.ko 2023-07-14T15:35:39.232 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/platform_profile.ko 2023-07-14T15:35:39.232 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/sbs.ko 2023-07-14T15:35:39.232 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/sbshc.ko 2023-07-14T15:35:39.232 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/video.ko 2023-07-14T15:35:39.232 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata 2023-07-14T15:35:39.232 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/acard-ahci.ko 2023-07-14T15:35:39.232 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/ahci_platform.ko 2023-07-14T15:35:39.232 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/ata_generic.ko 2023-07-14T15:35:39.233 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/libahci_platform.ko 2023-07-14T15:35:39.233 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_acpi.ko 2023-07-14T15:35:39.233 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_ali.ko 2023-07-14T15:35:39.233 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_amd.ko 2023-07-14T15:35:39.233 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_artop.ko 2023-07-14T15:35:39.233 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_atiixp.ko 2023-07-14T15:35:39.233 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_atp867x.ko 2023-07-14T15:35:39.234 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_cmd640.ko 2023-07-14T15:35:39.234 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_cmd64x.ko 2023-07-14T15:35:39.234 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_cypress.ko 2023-07-14T15:35:39.234 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_efar.ko 2023-07-14T15:35:39.234 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_hpt366.ko 2023-07-14T15:35:39.234 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_hpt37x.ko 2023-07-14T15:35:39.234 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_hpt3x2n.ko 2023-07-14T15:35:39.235 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_hpt3x3.ko 2023-07-14T15:35:39.235 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_it8213.ko 2023-07-14T15:35:39.235 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_it821x.ko 2023-07-14T15:35:39.235 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_jmicron.ko 2023-07-14T15:35:39.235 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_marvell.ko 2023-07-14T15:35:39.235 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_mpiix.ko 2023-07-14T15:35:39.235 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_netcell.ko 2023-07-14T15:35:39.236 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_ninja32.ko 2023-07-14T15:35:39.236 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_ns87410.ko 2023-07-14T15:35:39.236 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_ns87415.ko 2023-07-14T15:35:39.236 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_oldpiix.ko 2023-07-14T15:35:39.236 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_opti.ko 2023-07-14T15:35:39.236 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_optidma.ko 2023-07-14T15:35:39.236 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_pcmcia.ko 2023-07-14T15:35:39.237 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_pdc2027x.ko 2023-07-14T15:35:39.237 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-07-14T15:35:39.237 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_piccolo.ko 2023-07-14T15:35:39.237 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_rdc.ko 2023-07-14T15:35:39.237 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_sch.ko 2023-07-14T15:35:39.237 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_serverworks.ko 2023-07-14T15:35:39.237 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_sil680.ko 2023-07-14T15:35:39.237 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_sis.ko 2023-07-14T15:35:39.238 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_sl82c105.ko 2023-07-14T15:35:39.238 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_triflex.ko 2023-07-14T15:35:39.238 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_via.ko 2023-07-14T15:35:39.238 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pdc_adma.ko 2023-07-14T15:35:39.238 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_inic162x.ko 2023-07-14T15:35:39.238 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_mv.ko 2023-07-14T15:35:39.238 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_nv.ko 2023-07-14T15:35:39.239 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_promise.ko 2023-07-14T15:35:39.239 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_qstor.ko 2023-07-14T15:35:39.239 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_sil.ko 2023-07-14T15:35:39.239 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_sil24.ko 2023-07-14T15:35:39.239 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_sis.ko 2023-07-14T15:35:39.239 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_svw.ko 2023-07-14T15:35:39.239 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_sx4.ko 2023-07-14T15:35:39.239 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_uli.ko 2023-07-14T15:35:39.240 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_via.ko 2023-07-14T15:35:39.240 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_vsc.ko 2023-07-14T15:35:39.240 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/auxdisplay 2023-07-14T15:35:39.240 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/auxdisplay/ks0108.ko 2023-07-14T15:35:39.240 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/base 2023-07-14T15:35:39.240 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/base/regmap 2023-07-14T15:35:39.240 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/base/regmap/regmap-i2c.ko 2023-07-14T15:35:39.241 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/base/regmap/regmap-mmio.ko 2023-07-14T15:35:39.241 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/bcma 2023-07-14T15:35:39.241 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/bcma/bcma.ko 2023-07-14T15:35:39.241 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block 2023-07-14T15:35:39.241 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/aoe 2023-07-14T15:35:39.241 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/aoe/aoe.ko 2023-07-14T15:35:39.241 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/brd.ko 2023-07-14T15:35:39.242 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/drbd 2023-07-14T15:35:39.242 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/drbd/drbd.ko 2023-07-14T15:35:39.242 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/floppy.ko 2023-07-14T15:35:39.242 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/loop.ko 2023-07-14T15:35:39.242 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/mtip32xx 2023-07-14T15:35:39.242 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-07-14T15:35:39.242 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/nbd.ko 2023-07-14T15:35:39.243 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/null_blk 2023-07-14T15:35:39.243 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/null_blk/null_blk.ko 2023-07-14T15:35:39.243 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/pktcdvd.ko 2023-07-14T15:35:39.243 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/rbd.ko 2023-07-14T15:35:39.243 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/virtio_blk.ko 2023-07-14T15:35:39.243 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/xen-blkback 2023-07-14T15:35:39.243 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-07-14T15:35:39.244 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/xen-blkfront.ko 2023-07-14T15:35:39.244 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/zram 2023-07-14T15:35:39.244 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/zram/zram.ko 2023-07-14T15:35:39.244 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char 2023-07-14T15:35:39.244 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hangcheck-timer.ko 2023-07-14T15:35:39.244 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random 2023-07-14T15:35:39.244 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/amd-rng.ko 2023-07-14T15:35:39.245 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/intel-rng.ko 2023-07-14T15:35:39.245 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-07-14T15:35:39.245 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/via-rng.ko 2023-07-14T15:35:39.245 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/virtio-rng.ko 2023-07-14T15:35:39.245 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi 2023-07-14T15:35:39.245 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-07-14T15:35:39.245 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-07-14T15:35:39.246 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-07-14T15:35:39.246 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_si.ko 2023-07-14T15:35:39.246 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-07-14T15:35:39.246 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-07-14T15:35:39.246 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/lp.ko 2023-07-14T15:35:39.246 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/mwave 2023-07-14T15:35:39.246 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/mwave/mwave.ko 2023-07-14T15:35:39.246 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ppdev.ko 2023-07-14T15:35:39.247 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tlclk.ko 2023-07-14T15:35:39.247 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm 2023-07-14T15:35:39.247 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm.ko 2023-07-14T15:35:39.247 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_atmel.ko 2023-07-14T15:35:39.247 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_infineon.ko 2023-07-14T15:35:39.247 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_nsc.ko 2023-07-14T15:35:39.247 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_tis.ko 2023-07-14T15:35:39.247 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-07-14T15:35:39.248 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/uv_mmtimer.ko 2023-07-14T15:35:39.248 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/virtio_console.ko 2023-07-14T15:35:39.248 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq 2023-07-14T15:35:39.248 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-07-14T15:35:39.248 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-07-14T15:35:39.248 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/p4-clockmod.ko 2023-07-14T15:35:39.248 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-07-14T15:35:39.249 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/powernow-k8.ko 2023-07-14T15:35:39.249 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/speedstep-lib.ko 2023-07-14T15:35:39.249 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto 2023-07-14T15:35:39.249 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/ccp 2023-07-14T15:35:39.249 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-07-14T15:35:39.249 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/ccp/ccp.ko 2023-07-14T15:35:39.249 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel 2023-07-14T15:35:39.249 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat 2023-07-14T15:35:39.250 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat/qat_common 2023-07-14T15:35:39.250 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-07-14T15:35:39.250 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-07-14T15:35:39.250 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-07-14T15:35:39.250 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/padlock-aes.ko 2023-07-14T15:35:39.250 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/padlock-sha.ko 2023-07-14T15:35:39.250 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/virtio 2023-07-14T15:35:39.250 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-07-14T15:35:39.251 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dca 2023-07-14T15:35:39.251 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dca/dca.ko 2023-07-14T15:35:39.251 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/devfreq 2023-07-14T15:35:39.251 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-07-14T15:35:39.251 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma 2023-07-14T15:35:39.251 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma/dw 2023-07-14T15:35:39.251 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma/dw/dw_dmac.ko 2023-07-14T15:35:39.251 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma/ioat 2023-07-14T15:35:39.252 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma/ioat/ioatdma.ko 2023-07-14T15:35:39.252 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac 2023-07-14T15:35:39.252 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/amd64_edac.ko 2023-07-14T15:35:39.252 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/e752x_edac.ko 2023-07-14T15:35:39.252 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/edac_mce_amd.ko 2023-07-14T15:35:39.252 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i3000_edac.ko 2023-07-14T15:35:39.252 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i3200_edac.ko 2023-07-14T15:35:39.253 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i5100_edac.ko 2023-07-14T15:35:39.253 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i5400_edac.ko 2023-07-14T15:35:39.253 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i7300_edac.ko 2023-07-14T15:35:39.253 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i7core_edac.ko 2023-07-14T15:35:39.253 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i82975x_edac.ko 2023-07-14T15:35:39.253 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/ie31200_edac.ko 2023-07-14T15:35:39.253 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/sb_edac.ko 2023-07-14T15:35:39.253 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/x38_edac.ko 2023-07-14T15:35:39.254 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/firmware 2023-07-14T15:35:39.254 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/firmware/edd.ko 2023-07-14T15:35:39.254 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/firmware/iscsi_ibft.ko 2023-07-14T15:35:39.254 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio 2023-07-14T15:35:39.254 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-ich.ko 2023-07-14T15:35:39.254 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-viperboard.ko 2023-07-14T15:35:39.254 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid 2023-07-14T15:35:39.254 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-appleir.ko 2023-07-14T15:35:39.255 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-aureal.ko 2023-07-14T15:35:39.255 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-axff.ko 2023-07-14T15:35:39.255 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-dr.ko 2023-07-14T15:35:39.255 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-elecom.ko 2023-07-14T15:35:39.255 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-elo.ko 2023-07-14T15:35:39.255 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-emsff.ko 2023-07-14T15:35:39.255 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-gaff.ko 2023-07-14T15:35:39.256 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-gt683r.ko 2023-07-14T15:35:39.256 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-gyration.ko 2023-07-14T15:35:39.256 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-holtek-kbd.ko 2023-07-14T15:35:39.256 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-holtek-mouse.ko 2023-07-14T15:35:39.256 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-holtekff.ko 2023-07-14T15:35:39.256 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-hyperv.ko 2023-07-14T15:35:39.256 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-icade.ko 2023-07-14T15:35:39.257 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-keytouch.ko 2023-07-14T15:35:39.257 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-kye.ko 2023-07-14T15:35:39.257 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-lcpower.ko 2023-07-14T15:35:39.257 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-led.ko 2023-07-14T15:35:39.257 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-lenovo.ko 2023-07-14T15:35:39.257 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-logitech-dj.ko 2023-07-14T15:35:39.257 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-07-14T15:35:39.257 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-multitouch.ko 2023-07-14T15:35:39.258 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-ortek.ko 2023-07-14T15:35:39.258 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-penmount.ko 2023-07-14T15:35:39.258 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-petalynx.ko 2023-07-14T15:35:39.258 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-picolcd.ko 2023-07-14T15:35:39.258 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-pl.ko 2023-07-14T15:35:39.258 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-plantronics.ko 2023-07-14T15:35:39.258 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-primax.ko 2023-07-14T15:35:39.258 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-rmi.ko 2023-07-14T15:35:39.259 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-arvo.ko 2023-07-14T15:35:39.259 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-common.ko 2023-07-14T15:35:39.259 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-isku.ko 2023-07-14T15:35:39.259 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-kone.ko 2023-07-14T15:35:39.259 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-07-14T15:35:39.259 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-konepure.ko 2023-07-14T15:35:39.259 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-07-14T15:35:39.259 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-lua.ko 2023-07-14T15:35:39.260 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-pyra.ko 2023-07-14T15:35:39.260 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-ryos.ko 2023-07-14T15:35:39.260 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-savu.ko 2023-07-14T15:35:39.260 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat.ko 2023-07-14T15:35:39.260 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-saitek.ko 2023-07-14T15:35:39.260 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-samsung.ko 2023-07-14T15:35:39.260 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-sensor-hub.ko 2023-07-14T15:35:39.260 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-sjoy.ko 2023-07-14T15:35:39.261 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-sony.ko 2023-07-14T15:35:39.261 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-speedlink.ko 2023-07-14T15:35:39.261 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-steelseries.ko 2023-07-14T15:35:39.261 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-sunplus.ko 2023-07-14T15:35:39.261 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-thrustmaster.ko 2023-07-14T15:35:39.261 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-tivo.ko 2023-07-14T15:35:39.261 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-tmff.ko 2023-07-14T15:35:39.262 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-topseed.ko 2023-07-14T15:35:39.262 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-twinhan.ko 2023-07-14T15:35:39.262 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-uclogic.ko 2023-07-14T15:35:39.262 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-waltop.ko 2023-07-14T15:35:39.262 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-wiimote.ko 2023-07-14T15:35:39.262 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-xinmo.ko 2023-07-14T15:35:39.262 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-zpff.ko 2023-07-14T15:35:39.263 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-zydacron.ko 2023-07-14T15:35:39.263 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/uhid.ko 2023-07-14T15:35:39.263 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/wacom.ko 2023-07-14T15:35:39.263 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hv 2023-07-14T15:35:39.263 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hv/hv_balloon.ko 2023-07-14T15:35:39.263 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hv/hv_utils.ko 2023-07-14T15:35:39.263 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hv/hv_vmbus.ko 2023-07-14T15:35:39.263 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon 2023-07-14T15:35:39.264 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/abituguru.ko 2023-07-14T15:35:39.264 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/abituguru3.ko 2023-07-14T15:35:39.264 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/acpi_power_meter.ko 2023-07-14T15:35:39.264 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ad7414.ko 2023-07-14T15:35:39.264 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ad7418.ko 2023-07-14T15:35:39.264 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adc128d818.ko 2023-07-14T15:35:39.264 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm1025.ko 2023-07-14T15:35:39.265 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm1026.ko 2023-07-14T15:35:39.265 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm1029.ko 2023-07-14T15:35:39.265 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm1031.ko 2023-07-14T15:35:39.265 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm9240.ko 2023-07-14T15:35:39.265 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ads7828.ko 2023-07-14T15:35:39.265 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7410.ko 2023-07-14T15:35:39.265 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7411.ko 2023-07-14T15:35:39.265 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7462.ko 2023-07-14T15:35:39.266 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7470.ko 2023-07-14T15:35:39.266 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7475.ko 2023-07-14T15:35:39.266 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7x10.ko 2023-07-14T15:35:39.266 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/amc6821.ko 2023-07-14T15:35:39.266 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/applesmc.ko 2023-07-14T15:35:39.266 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/asb100.ko 2023-07-14T15:35:39.266 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/asc7621.ko 2023-07-14T15:35:39.267 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/asus_atk0110.ko 2023-07-14T15:35:39.267 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/atxp1.ko 2023-07-14T15:35:39.267 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/coretemp.ko 2023-07-14T15:35:39.267 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-07-14T15:35:39.267 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/dme1737.ko 2023-07-14T15:35:39.267 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ds1621.ko 2023-07-14T15:35:39.268 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ds620.ko 2023-07-14T15:35:39.268 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/emc1403.ko 2023-07-14T15:35:39.268 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/emc6w201.ko 2023-07-14T15:35:39.268 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/f71805f.ko 2023-07-14T15:35:39.268 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/f71882fg.ko 2023-07-14T15:35:39.268 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/f75375s.ko 2023-07-14T15:35:39.268 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/fam15h_power.ko 2023-07-14T15:35:39.269 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/fschmd.ko 2023-07-14T15:35:39.269 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/g760a.ko 2023-07-14T15:35:39.269 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/g762.ko 2023-07-14T15:35:39.269 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/gl518sm.ko 2023-07-14T15:35:39.269 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/gl520sm.ko 2023-07-14T15:35:39.269 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/hwmon-vid.ko 2023-07-14T15:35:39.269 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/i5500_temp.ko 2023-07-14T15:35:39.269 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/i5k_amb.ko 2023-07-14T15:35:39.270 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ibmaem.ko 2023-07-14T15:35:39.270 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ibmpex.ko 2023-07-14T15:35:39.270 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ina209.ko 2023-07-14T15:35:39.270 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ina2xx.ko 2023-07-14T15:35:39.270 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/it87.ko 2023-07-14T15:35:39.270 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/k10temp.ko 2023-07-14T15:35:39.270 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/k8temp.ko 2023-07-14T15:35:39.270 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lineage-pem.ko 2023-07-14T15:35:39.271 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm63.ko 2023-07-14T15:35:39.271 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm73.ko 2023-07-14T15:35:39.271 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm75.ko 2023-07-14T15:35:39.271 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm77.ko 2023-07-14T15:35:39.271 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm78.ko 2023-07-14T15:35:39.271 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm80.ko 2023-07-14T15:35:39.271 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm83.ko 2023-07-14T15:35:39.271 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm85.ko 2023-07-14T15:35:39.272 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm87.ko 2023-07-14T15:35:39.272 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm90.ko 2023-07-14T15:35:39.272 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm92.ko 2023-07-14T15:35:39.272 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm93.ko 2023-07-14T15:35:39.272 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm95234.ko 2023-07-14T15:35:39.272 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm95241.ko 2023-07-14T15:35:39.272 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm95245.ko 2023-07-14T15:35:39.272 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc2945.ko 2023-07-14T15:35:39.273 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4151.ko 2023-07-14T15:35:39.273 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4215.ko 2023-07-14T15:35:39.273 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4222.ko 2023-07-14T15:35:39.273 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4245.ko 2023-07-14T15:35:39.273 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4260.ko 2023-07-14T15:35:39.273 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4261.ko 2023-07-14T15:35:39.273 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max16065.ko 2023-07-14T15:35:39.273 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max1619.ko 2023-07-14T15:35:39.274 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max1668.ko 2023-07-14T15:35:39.274 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max197.ko 2023-07-14T15:35:39.274 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max6639.ko 2023-07-14T15:35:39.274 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max6650.ko 2023-07-14T15:35:39.274 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max6697.ko 2023-07-14T15:35:39.274 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/mcp3021.ko 2023-07-14T15:35:39.274 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/nct6683.ko 2023-07-14T15:35:39.275 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/nct6775-core.ko 2023-07-14T15:35:39.275 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/nct6775.ko 2023-07-14T15:35:39.275 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/nct7802.ko 2023-07-14T15:35:39.275 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pc87360.ko 2023-07-14T15:35:39.275 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pc87427.ko 2023-07-14T15:35:39.275 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pcf8591.ko 2023-07-14T15:35:39.275 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus 2023-07-14T15:35:39.275 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-07-14T15:35:39.276 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-07-14T15:35:39.276 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-07-14T15:35:39.276 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/max16064.ko 2023-07-14T15:35:39.276 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/max34440.ko 2023-07-14T15:35:39.276 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/max8688.ko 2023-07-14T15:35:39.276 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-07-14T15:35:39.276 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-07-14T15:35:39.276 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-07-14T15:35:39.277 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-07-14T15:35:39.277 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-07-14T15:35:39.277 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-07-14T15:35:39.277 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/powr1220.ko 2023-07-14T15:35:39.277 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sch5627.ko 2023-07-14T15:35:39.277 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sch5636.ko 2023-07-14T15:35:39.277 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sch56xx-common.ko 2023-07-14T15:35:39.278 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sht15.ko 2023-07-14T15:35:39.278 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sht21.ko 2023-07-14T15:35:39.278 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/shtc1.ko 2023-07-14T15:35:39.278 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sis5595.ko 2023-07-14T15:35:39.278 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/smsc47b397.ko 2023-07-14T15:35:39.278 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/smsc47m1.ko 2023-07-14T15:35:39.278 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/smsc47m192.ko 2023-07-14T15:35:39.278 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/thmc50.ko 2023-07-14T15:35:39.279 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/tmp102.ko 2023-07-14T15:35:39.279 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/tmp103.ko 2023-07-14T15:35:39.279 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/tmp401.ko 2023-07-14T15:35:39.279 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/tmp421.ko 2023-07-14T15:35:39.279 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/via-cputemp.ko 2023-07-14T15:35:39.279 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/via686a.ko 2023-07-14T15:35:39.279 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/vt1211.ko 2023-07-14T15:35:39.279 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/vt8231.ko 2023-07-14T15:35:39.280 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83627ehf.ko 2023-07-14T15:35:39.280 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83627hf.ko 2023-07-14T15:35:39.280 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83781d.ko 2023-07-14T15:35:39.280 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83791d.ko 2023-07-14T15:35:39.280 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83792d.ko 2023-07-14T15:35:39.280 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83793.ko 2023-07-14T15:35:39.280 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83795.ko 2023-07-14T15:35:39.280 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83l785ts.ko 2023-07-14T15:35:39.281 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83l786ng.ko 2023-07-14T15:35:39.281 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c 2023-07-14T15:35:39.281 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/algos 2023-07-14T15:35:39.281 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-07-14T15:35:39.281 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-07-14T15:35:39.281 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses 2023-07-14T15:35:39.281 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-07-14T15:35:39.281 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-07-14T15:35:39.282 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-07-14T15:35:39.282 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-07-14T15:35:39.282 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-07-14T15:35:39.282 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-07-14T15:35:39.282 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-07-14T15:35:39.282 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-07-14T15:35:39.282 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-i801.ko 2023-07-14T15:35:39.283 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-isch.ko 2023-07-14T15:35:39.283 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-07-14T15:35:39.283 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-07-14T15:35:39.283 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-07-14T15:35:39.283 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-parport.ko 2023-07-14T15:35:39.283 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-07-14T15:35:39.283 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-07-14T15:35:39.283 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-07-14T15:35:39.284 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-07-14T15:35:39.284 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-07-14T15:35:39.284 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-07-14T15:35:39.284 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-via.ko 2023-07-14T15:35:39.284 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-07-14T15:35:39.284 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-07-14T15:35:39.284 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/i2c-dev.ko 2023-07-14T15:35:39.285 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/i2c-mux.ko 2023-07-14T15:35:39.285 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-07-14T15:35:39.285 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/i2c-smbus.ko 2023-07-14T15:35:39.285 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/i2c-stub.ko 2023-07-14T15:35:39.285 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband 2023-07-14T15:35:39.285 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core 2023-07-14T15:35:39.285 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/ib_cm.ko 2023-07-14T15:35:39.286 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/ib_core.ko 2023-07-14T15:35:39.286 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/ib_umad.ko 2023-07-14T15:35:39.286 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-07-14T15:35:39.286 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/iw_cm.ko 2023-07-14T15:35:39.286 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/rdma_cm.ko 2023-07-14T15:35:39.286 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-07-14T15:35:39.286 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw 2023-07-14T15:35:39.286 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/cxgb4 2023-07-14T15:35:39.287 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-07-14T15:35:39.287 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mlx4 2023-07-14T15:35:39.287 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-07-14T15:35:39.287 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mlx5 2023-07-14T15:35:39.287 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-07-14T15:35:39.287 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mthca 2023-07-14T15:35:39.288 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-07-14T15:35:39.288 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp 2023-07-14T15:35:39.288 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/ipoib 2023-07-14T15:35:39.288 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-07-14T15:35:39.288 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/iser 2023-07-14T15:35:39.288 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-07-14T15:35:39.288 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/isert 2023-07-14T15:35:39.289 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-07-14T15:35:39.289 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/srp 2023-07-14T15:35:39.289 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-07-14T15:35:39.289 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/srpt 2023-07-14T15:35:39.289 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-07-14T15:35:39.289 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input 2023-07-14T15:35:39.289 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport 2023-07-14T15:35:39.289 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-07-14T15:35:39.290 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/fm801-gp.ko 2023-07-14T15:35:39.290 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/gameport.ko 2023-07-14T15:35:39.290 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/lightning.ko 2023-07-14T15:35:39.290 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/ns558.ko 2023-07-14T15:35:39.290 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/joydev.ko 2023-07-14T15:35:39.290 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard 2023-07-14T15:35:39.290 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/gpio_keys.ko 2023-07-14T15:35:39.291 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse 2023-07-14T15:35:39.291 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/appletouch.ko 2023-07-14T15:35:39.291 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/bcm5974.ko 2023-07-14T15:35:39.291 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/cyapatp.ko 2023-07-14T15:35:39.291 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/elan_i2c.ko 2023-07-14T15:35:39.291 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/sermouse.ko 2023-07-14T15:35:39.291 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-07-14T15:35:39.292 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/synaptics_usb.ko 2023-07-14T15:35:39.292 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/vsxxxaa.ko 2023-07-14T15:35:39.292 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/rmi4 2023-07-14T15:35:39.292 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/rmi4/rmi_core.ko 2023-07-14T15:35:39.292 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio 2023-07-14T15:35:39.292 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/altera_ps2.ko 2023-07-14T15:35:39.292 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/arc_ps2.ko 2023-07-14T15:35:39.293 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-07-14T15:35:39.293 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/serio_raw.ko 2023-07-14T15:35:39.293 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/sparse-keymap.ko 2023-07-14T15:35:39.293 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/iommu 2023-07-14T15:35:39.293 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/iommu/amd 2023-07-14T15:35:39.293 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/iommu/amd/iommu_v2.ko 2023-07-14T15:35:39.293 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds 2023-07-14T15:35:39.294 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-blinkm.ko 2023-07-14T15:35:39.294 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-lm3530.ko 2023-07-14T15:35:39.294 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-lp3944.ko 2023-07-14T15:35:39.294 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-ss4200.ko 2023-07-14T15:35:39.294 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger 2023-07-14T15:35:39.294 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-07-14T15:35:39.294 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-07-14T15:35:39.294 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-07-14T15:35:39.295 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-07-14T15:35:39.295 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-07-14T15:35:39.295 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-07-14T15:35:39.295 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-07-14T15:35:39.295 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-07-14T15:35:39.295 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md 2023-07-14T15:35:39.295 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/bcache 2023-07-14T15:35:39.295 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/bcache/bcache.ko 2023-07-14T15:35:39.296 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-bio-prison.ko 2023-07-14T15:35:39.296 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-cache-smq.ko 2023-07-14T15:35:39.296 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-cache.ko 2023-07-14T15:35:39.296 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-crypt.ko 2023-07-14T15:35:39.296 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-delay.ko 2023-07-14T15:35:39.296 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-flakey.ko 2023-07-14T15:35:39.296 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-log-userspace.ko 2023-07-14T15:35:39.296 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-multipath.ko 2023-07-14T15:35:39.297 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-queue-length.ko 2023-07-14T15:35:39.297 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-raid.ko 2023-07-14T15:35:39.297 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-round-robin.ko 2023-07-14T15:35:39.297 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-service-time.ko 2023-07-14T15:35:39.297 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-switch.ko 2023-07-14T15:35:39.297 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-thin-pool.ko 2023-07-14T15:35:39.297 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-verity.ko 2023-07-14T15:35:39.298 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/faulty.ko 2023-07-14T15:35:39.298 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/linear.ko 2023-07-14T15:35:39.298 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/multipath.ko 2023-07-14T15:35:39.298 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/persistent-data 2023-07-14T15:35:39.298 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-07-14T15:35:39.298 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/raid0.ko 2023-07-14T15:35:39.298 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/raid1.ko 2023-07-14T15:35:39.298 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/raid10.ko 2023-07-14T15:35:39.299 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/raid456.ko 2023-07-14T15:35:39.299 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message 2023-07-14T15:35:39.299 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion 2023-07-14T15:35:39.299 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptbase.ko 2023-07-14T15:35:39.299 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptctl.ko 2023-07-14T15:35:39.299 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptfc.ko 2023-07-14T15:35:39.299 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptlan.ko 2023-07-14T15:35:39.299 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptsas.ko 2023-07-14T15:35:39.300 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptscsih.ko 2023-07-14T15:35:39.300 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptspi.ko 2023-07-14T15:35:39.300 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd 2023-07-14T15:35:39.300 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/lpc_ich.ko 2023-07-14T15:35:39.300 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/lpc_sch.ko 2023-07-14T15:35:39.300 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/mfd-core.ko 2023-07-14T15:35:39.300 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/sm501.ko 2023-07-14T15:35:39.300 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/viperboard.ko 2023-07-14T15:35:39.301 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/vx855.ko 2023-07-14T15:35:39.301 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/wl1273-core.ko 2023-07-14T15:35:39.301 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc 2023-07-14T15:35:39.301 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/altera-stapl 2023-07-14T15:35:39.301 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-07-14T15:35:39.301 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/apds9802als.ko 2023-07-14T15:35:39.301 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/apds990x.ko 2023-07-14T15:35:39.302 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/bh1770glc.ko 2023-07-14T15:35:39.302 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/cb710 2023-07-14T15:35:39.302 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/cb710/cb710.ko 2023-07-14T15:35:39.302 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom 2023-07-14T15:35:39.302 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom/at24.ko 2023-07-14T15:35:39.302 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom/eeprom.ko 2023-07-14T15:35:39.302 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-07-14T15:35:39.302 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom/max6875.ko 2023-07-14T15:35:39.303 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/enclosure.ko 2023-07-14T15:35:39.303 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/hpilo.ko 2023-07-14T15:35:39.303 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/isl29003.ko 2023-07-14T15:35:39.303 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/isl29020.ko 2023-07-14T15:35:39.303 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/lis3lv02d 2023-07-14T15:35:39.303 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-07-14T15:35:39.303 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-07-14T15:35:39.303 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/mei 2023-07-14T15:35:39.304 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/mei/mei-me.ko 2023-07-14T15:35:39.304 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/mei/mei-txe.ko 2023-07-14T15:35:39.304 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/mei/mei.ko 2023-07-14T15:35:39.304 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/sgi-gru 2023-07-14T15:35:39.304 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/sgi-gru/gru.ko 2023-07-14T15:35:39.304 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/sgi-xp 2023-07-14T15:35:39.304 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/sgi-xp/xp.ko 2023-07-14T15:35:39.305 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/sgi-xp/xpc.ko 2023-07-14T15:35:39.305 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-07-14T15:35:39.305 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/tifm_7xx1.ko 2023-07-14T15:35:39.305 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/tifm_core.ko 2023-07-14T15:35:39.305 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/tsl2550.ko 2023-07-14T15:35:39.305 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/vmw_balloon.ko 2023-07-14T15:35:39.305 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/vmw_vmci 2023-07-14T15:35:39.305 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-07-14T15:35:39.306 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net 2023-07-14T15:35:39.306 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/bonding 2023-07-14T15:35:39.306 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/bonding/bonding.ko 2023-07-14T15:35:39.306 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa 2023-07-14T15:35:39.306 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/b53 2023-07-14T15:35:39.306 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/b53/b53_common.ko 2023-07-14T15:35:39.306 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/bcm-sf2.ko 2023-07-14T15:35:39.306 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/mv88e6060.ko 2023-07-14T15:35:39.307 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/mv88e6xxx 2023-07-14T15:35:39.307 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-07-14T15:35:39.307 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dummy.ko 2023-07-14T15:35:39.307 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/eql.ko 2023-07-14T15:35:39.307 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet 2023-07-14T15:35:39.307 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com 2023-07-14T15:35:39.307 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-07-14T15:35:39.307 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-07-14T15:35:39.308 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-07-14T15:35:39.308 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-07-14T15:35:39.308 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390 2023-07-14T15:35:39.308 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390/8390.ko 2023-07-14T15:35:39.308 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-07-14T15:35:39.308 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-07-14T15:35:39.308 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-07-14T15:35:39.309 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/adaptec 2023-07-14T15:35:39.309 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-07-14T15:35:39.309 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/agere 2023-07-14T15:35:39.309 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/agere/et131x.ko 2023-07-14T15:35:39.309 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/alteon 2023-07-14T15:35:39.309 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-07-14T15:35:39.309 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/altera 2023-07-14T15:35:39.309 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-07-14T15:35:39.310 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/amd 2023-07-14T15:35:39.310 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-07-14T15:35:39.310 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-07-14T15:35:39.310 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-07-14T15:35:39.310 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros 2023-07-14T15:35:39.310 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/alx 2023-07-14T15:35:39.310 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-07-14T15:35:39.310 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atl1c 2023-07-14T15:35:39.311 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-07-14T15:35:39.311 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atl1e 2023-07-14T15:35:39.311 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-07-14T15:35:39.311 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atlx 2023-07-14T15:35:39.311 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-07-14T15:35:39.311 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-07-14T15:35:39.311 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom 2023-07-14T15:35:39.311 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-07-14T15:35:39.312 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-07-14T15:35:39.312 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-07-14T15:35:39.312 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-07-14T15:35:39.312 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-07-14T15:35:39.312 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/genet 2023-07-14T15:35:39.312 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-07-14T15:35:39.312 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-07-14T15:35:39.313 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/brocade 2023-07-14T15:35:39.313 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/brocade/bna 2023-07-14T15:35:39.313 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-07-14T15:35:39.313 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio 2023-07-14T15:35:39.313 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb 2023-07-14T15:35:39.313 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-07-14T15:35:39.313 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-07-14T15:35:39.313 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-07-14T15:35:39.314 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-07-14T15:35:39.314 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-07-14T15:35:39.314 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-07-14T15:35:39.314 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-07-14T15:35:39.314 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-07-14T15:35:39.314 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-07-14T15:35:39.314 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/cisco 2023-07-14T15:35:39.314 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/cisco/enic 2023-07-14T15:35:39.315 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-07-14T15:35:39.315 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec 2023-07-14T15:35:39.315 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip 2023-07-14T15:35:39.315 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-07-14T15:35:39.315 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-07-14T15:35:39.315 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-07-14T15:35:39.316 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-07-14T15:35:39.316 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-07-14T15:35:39.316 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-07-14T15:35:39.316 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dlink 2023-07-14T15:35:39.316 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-07-14T15:35:39.316 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-07-14T15:35:39.316 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dnet.ko 2023-07-14T15:35:39.316 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/emulex 2023-07-14T15:35:39.317 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/emulex/benet 2023-07-14T15:35:39.317 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-07-14T15:35:39.317 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/ethoc.ko 2023-07-14T15:35:39.317 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/fealnx.ko 2023-07-14T15:35:39.317 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel 2023-07-14T15:35:39.317 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e100.ko 2023-07-14T15:35:39.317 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e1000 2023-07-14T15:35:39.318 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-07-14T15:35:39.318 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e1000e 2023-07-14T15:35:39.318 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-07-14T15:35:39.318 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/fm10k 2023-07-14T15:35:39.318 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-07-14T15:35:39.318 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/i40e 2023-07-14T15:35:39.318 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-07-14T15:35:39.318 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/iavf 2023-07-14T15:35:39.319 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-07-14T15:35:39.319 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/igb 2023-07-14T15:35:39.319 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-07-14T15:35:39.319 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/igbvf 2023-07-14T15:35:39.319 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-07-14T15:35:39.319 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/ixgbe 2023-07-14T15:35:39.319 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-07-14T15:35:39.319 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/ixgbevf 2023-07-14T15:35:39.320 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-07-14T15:35:39.320 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/jme.ko 2023-07-14T15:35:39.320 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/marvell 2023-07-14T15:35:39.320 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-07-14T15:35:39.320 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/marvell/skge.ko 2023-07-14T15:35:39.320 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-07-14T15:35:39.320 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox 2023-07-14T15:35:39.321 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx4 2023-07-14T15:35:39.321 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-07-14T15:35:39.321 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-07-14T15:35:39.321 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx5 2023-07-14T15:35:39.321 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-07-14T15:35:39.321 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-07-14T15:35:39.321 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/micrel 2023-07-14T15:35:39.322 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-07-14T15:35:39.322 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/myricom 2023-07-14T15:35:39.322 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/myricom/myri10ge 2023-07-14T15:35:39.322 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-07-14T15:35:39.322 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/natsemi 2023-07-14T15:35:39.322 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-07-14T15:35:39.322 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-07-14T15:35:39.323 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/neterion 2023-07-14T15:35:39.323 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-07-14T15:35:39.323 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/nvidia 2023-07-14T15:35:39.323 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-07-14T15:35:39.323 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/packetengines 2023-07-14T15:35:39.323 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-07-14T15:35:39.323 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-07-14T15:35:39.323 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic 2023-07-14T15:35:39.324 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/netxen 2023-07-14T15:35:39.324 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-07-14T15:35:39.324 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-07-14T15:35:39.324 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-07-14T15:35:39.324 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-07-14T15:35:39.324 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/rdc 2023-07-14T15:35:39.324 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-07-14T15:35:39.325 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek 2023-07-14T15:35:39.325 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-07-14T15:35:39.325 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-07-14T15:35:39.325 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek/atp.ko 2023-07-14T15:35:39.325 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-07-14T15:35:39.325 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/rocker 2023-07-14T15:35:39.325 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-07-14T15:35:39.326 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sfc 2023-07-14T15:35:39.326 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-07-14T15:35:39.326 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/silan 2023-07-14T15:35:39.326 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-07-14T15:35:39.326 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sis 2023-07-14T15:35:39.326 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sis/sis190.ko 2023-07-14T15:35:39.326 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sis/sis900.ko 2023-07-14T15:35:39.327 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc 2023-07-14T15:35:39.327 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-07-14T15:35:39.327 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-07-14T15:35:39.327 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-07-14T15:35:39.327 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-07-14T15:35:39.327 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/stmicro 2023-07-14T15:35:39.327 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/stmicro/stmmac 2023-07-14T15:35:39.327 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-07-14T15:35:39.328 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-07-14T15:35:39.328 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun 2023-07-14T15:35:39.328 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun/cassini.ko 2023-07-14T15:35:39.328 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun/niu.ko 2023-07-14T15:35:39.328 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun/sungem.ko 2023-07-14T15:35:39.328 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-07-14T15:35:39.328 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/tehuti 2023-07-14T15:35:39.329 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-07-14T15:35:39.329 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/ti 2023-07-14T15:35:39.329 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/ti/tlan.ko 2023-07-14T15:35:39.329 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/via 2023-07-14T15:35:39.329 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-07-14T15:35:39.329 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-07-14T15:35:39.329 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/wiznet 2023-07-14T15:35:39.329 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-07-14T15:35:39.330 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-07-14T15:35:39.330 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/xircom 2023-07-14T15:35:39.330 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-07-14T15:35:39.330 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/geneve.ko 2023-07-14T15:35:39.330 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/hyperv 2023-07-14T15:35:39.330 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-07-14T15:35:39.330 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ieee802154 2023-07-14T15:35:39.330 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ieee802154/fakelb.ko 2023-07-14T15:35:39.331 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ifb.ko 2023-07-14T15:35:39.331 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ipvlan 2023-07-14T15:35:39.331 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ipvlan/ipvlan.ko 2023-07-14T15:35:39.331 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/macvlan.ko 2023-07-14T15:35:39.331 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/macvtap.ko 2023-07-14T15:35:39.331 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio 2023-07-14T15:35:39.331 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio.ko 2023-07-14T15:35:39.331 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-07-14T15:35:39.332 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-07-14T15:35:39.332 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio/mdio-regmap.ko 2023-07-14T15:35:39.332 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mii.ko 2023-07-14T15:35:39.332 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/net_failover.ko 2023-07-14T15:35:39.332 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/netconsole.ko 2023-07-14T15:35:39.332 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/nlmon.ko 2023-07-14T15:35:39.332 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/pcs 2023-07-14T15:35:39.333 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/pcs/pcs-lynx.ko 2023-07-14T15:35:39.333 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-07-14T15:35:39.333 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy 2023-07-14T15:35:39.333 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/amd.ko 2023-07-14T15:35:39.333 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-07-14T15:35:39.333 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-07-14T15:35:39.333 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/bcm7xxx.ko 2023-07-14T15:35:39.333 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/bcm87xx.ko 2023-07-14T15:35:39.334 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/broadcom.ko 2023-07-14T15:35:39.334 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/cicada.ko 2023-07-14T15:35:39.334 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/davicom.ko 2023-07-14T15:35:39.334 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/dp83640.ko 2023-07-14T15:35:39.334 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/et1011c.ko 2023-07-14T15:35:39.334 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/icplus.ko 2023-07-14T15:35:39.334 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/lxt.ko 2023-07-14T15:35:39.334 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/marvell.ko 2023-07-14T15:35:39.335 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/micrel.ko 2023-07-14T15:35:39.335 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/national.ko 2023-07-14T15:35:39.335 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/phylink.ko 2023-07-14T15:35:39.335 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/qsemi.ko 2023-07-14T15:35:39.335 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/realtek.ko 2023-07-14T15:35:39.335 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/smsc.ko 2023-07-14T15:35:39.335 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/ste10Xp.ko 2023-07-14T15:35:39.335 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/vitesse.ko 2023-07-14T15:35:39.336 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp 2023-07-14T15:35:39.336 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/bsd_comp.ko 2023-07-14T15:35:39.336 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ppp_async.ko 2023-07-14T15:35:39.336 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ppp_deflate.ko 2023-07-14T15:35:39.336 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ppp_generic.ko 2023-07-14T15:35:39.336 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ppp_mppe.ko 2023-07-14T15:35:39.336 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ppp_synctty.ko 2023-07-14T15:35:39.337 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/pppoe.ko 2023-07-14T15:35:39.337 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/pppox.ko 2023-07-14T15:35:39.337 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/pptp.ko 2023-07-14T15:35:39.337 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/slip 2023-07-14T15:35:39.337 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/slip/slhc.ko 2023-07-14T15:35:39.337 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/slip/slip.ko 2023-07-14T15:35:39.337 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/sungem_phy.ko 2023-07-14T15:35:39.337 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/tap.ko 2023-07-14T15:35:39.338 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team 2023-07-14T15:35:39.338 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team.ko 2023-07-14T15:35:39.338 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_activebackup.ko 2023-07-14T15:35:39.338 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_broadcast.ko 2023-07-14T15:35:39.338 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-07-14T15:35:39.338 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_random.ko 2023-07-14T15:35:39.338 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-07-14T15:35:39.339 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/tun.ko 2023-07-14T15:35:39.339 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/veth.ko 2023-07-14T15:35:39.339 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/virtio_net.ko 2023-07-14T15:35:39.339 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/vmxnet3 2023-07-14T15:35:39.339 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-07-14T15:35:39.339 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/vxlan 2023-07-14T15:35:39.339 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/vxlan/vxlan.ko 2023-07-14T15:35:39.339 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/xen-netback 2023-07-14T15:35:39.340 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/xen-netback/xen-netback.ko 2023-07-14T15:35:39.340 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/xen-netfront.ko 2023-07-14T15:35:39.340 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ntb 2023-07-14T15:35:39.340 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ntb/ntb.ko 2023-07-14T15:35:39.340 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/nvme 2023-07-14T15:35:39.340 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/nvme/host 2023-07-14T15:35:39.340 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/nvme/host/nvme-core.ko 2023-07-14T15:35:39.341 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/nvme/host/nvme.ko 2023-07-14T15:35:39.341 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport 2023-07-14T15:35:39.341 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport/parport.ko 2023-07-14T15:35:39.341 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport/parport_cs.ko 2023-07-14T15:35:39.341 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport/parport_pc.ko 2023-07-14T15:35:39.341 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport/parport_serial.ko 2023-07-14T15:35:39.341 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci 2023-07-14T15:35:39.341 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/hotplug 2023-07-14T15:35:39.342 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-07-14T15:35:39.342 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/pcie 2023-07-14T15:35:39.342 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/pcie/aer_inject.ko 2023-07-14T15:35:39.342 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/xen-pcifront.ko 2023-07-14T15:35:39.342 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pcmcia 2023-07-14T15:35:39.342 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pcmcia/i82092.ko 2023-07-14T15:35:39.342 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pcmcia/pd6729.ko 2023-07-14T15:35:39.342 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pcmcia/yenta_socket.ko 2023-07-14T15:35:39.343 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pinctrl 2023-07-14T15:35:39.343 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pinctrl/intel 2023-07-14T15:35:39.343 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-07-14T15:35:39.343 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform 2023-07-14T15:35:39.343 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86 2023-07-14T15:35:39.343 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/acer-wmi.ko 2023-07-14T15:35:39.343 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/acerhdf.ko 2023-07-14T15:35:39.343 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/apple-gmux.ko 2023-07-14T15:35:39.344 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/asus-laptop.ko 2023-07-14T15:35:39.344 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-07-14T15:35:39.344 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/asus-wmi.ko 2023-07-14T15:35:39.344 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/classmate-laptop.ko 2023-07-14T15:35:39.344 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-07-14T15:35:39.344 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-07-14T15:35:39.344 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-07-14T15:35:39.345 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-07-14T15:35:39.345 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/hdaps.ko 2023-07-14T15:35:39.345 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/intel 2023-07-14T15:35:39.345 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-07-14T15:35:39.345 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/intel_ips.ko 2023-07-14T15:35:39.345 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/msi-wmi.ko 2023-07-14T15:35:39.345 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/mxm-wmi.ko 2023-07-14T15:35:39.345 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-07-14T15:35:39.346 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/samsung-laptop.ko 2023-07-14T15:35:39.346 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/samsung-q10.ko 2023-07-14T15:35:39.346 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/topstar-laptop.ko 2023-07-14T15:35:39.346 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-07-14T15:35:39.346 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/toshiba_haps.ko 2023-07-14T15:35:39.346 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/wmi-bmof.ko 2023-07-14T15:35:39.346 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/wmi.ko 2023-07-14T15:35:39.346 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/powercap 2023-07-14T15:35:39.347 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/powercap/intel_rapl_common.ko 2023-07-14T15:35:39.347 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/powercap/intel_rapl_msr.ko 2023-07-14T15:35:39.347 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps 2023-07-14T15:35:39.347 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/clients 2023-07-14T15:35:39.347 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/clients/pps-gpio.ko 2023-07-14T15:35:39.347 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/clients/pps-ldisc.ko 2023-07-14T15:35:39.347 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/clients/pps_parport.ko 2023-07-14T15:35:39.347 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/pps_core.ko 2023-07-14T15:35:39.348 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ptp 2023-07-14T15:35:39.348 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ptp/ptp.ko 2023-07-14T15:35:39.348 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ptp/ptp_kvm.ko 2023-07-14T15:35:39.348 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc 2023-07-14T15:35:39.348 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-bq32k.ko 2023-07-14T15:35:39.348 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-bq4802.ko 2023-07-14T15:35:39.348 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1286.ko 2023-07-14T15:35:39.349 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1307.ko 2023-07-14T15:35:39.349 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1374.ko 2023-07-14T15:35:39.349 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1511.ko 2023-07-14T15:35:39.349 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1553.ko 2023-07-14T15:35:39.349 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1672.ko 2023-07-14T15:35:39.349 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1742.ko 2023-07-14T15:35:39.349 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds2404.ko 2023-07-14T15:35:39.349 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds3232.ko 2023-07-14T15:35:39.350 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-em3027.ko 2023-07-14T15:35:39.350 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-fm3130.ko 2023-07-14T15:35:39.350 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-isl12022.ko 2023-07-14T15:35:39.350 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-isl1208.ko 2023-07-14T15:35:39.350 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-m41t80.ko 2023-07-14T15:35:39.350 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-m48t35.ko 2023-07-14T15:35:39.350 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-m48t59.ko 2023-07-14T15:35:39.351 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-max6900.ko 2023-07-14T15:35:39.351 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-msm6242.ko 2023-07-14T15:35:39.351 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf2127.ko 2023-07-14T15:35:39.351 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf85063.ko 2023-07-14T15:35:39.351 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf8523.ko 2023-07-14T15:35:39.351 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf8563.ko 2023-07-14T15:35:39.351 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf8583.ko 2023-07-14T15:35:39.351 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rp5c01.ko 2023-07-14T15:35:39.352 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rs5c372.ko 2023-07-14T15:35:39.352 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-07-14T15:35:39.352 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rx8025.ko 2023-07-14T15:35:39.352 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rx8581.ko 2023-07-14T15:35:39.352 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-07-14T15:35:39.352 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-x1205.ko 2023-07-14T15:35:39.352 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi 2023-07-14T15:35:39.352 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/3w-9xxx.ko 2023-07-14T15:35:39.353 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/3w-sas.ko 2023-07-14T15:35:39.353 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/3w-xxxx.ko 2023-07-14T15:35:39.353 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/BusLogic.ko 2023-07-14T15:35:39.353 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/a100u2w.ko 2023-07-14T15:35:39.353 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aacraid 2023-07-14T15:35:39.353 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aacraid/aacraid.ko 2023-07-14T15:35:39.353 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/advansys.ko 2023-07-14T15:35:39.353 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aic7xxx 2023-07-14T15:35:39.354 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-07-14T15:35:39.354 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-07-14T15:35:39.354 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/am53c974.ko 2023-07-14T15:35:39.354 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/arcmsr 2023-07-14T15:35:39.354 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-07-14T15:35:39.354 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/atp870u.ko 2023-07-14T15:35:39.354 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/be2iscsi 2023-07-14T15:35:39.354 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-07-14T15:35:39.355 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bfa 2023-07-14T15:35:39.355 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bfa/bfa.ko 2023-07-14T15:35:39.355 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bnx2fc 2023-07-14T15:35:39.355 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-07-14T15:35:39.355 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bnx2i 2023-07-14T15:35:39.355 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-07-14T15:35:39.356 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/ch.ko 2023-07-14T15:35:39.356 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/csiostor 2023-07-14T15:35:39.356 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/csiostor/csiostor.ko 2023-07-14T15:35:39.356 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi 2023-07-14T15:35:39.356 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/cxgb3i 2023-07-14T15:35:39.356 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-07-14T15:35:39.356 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/cxgb4i 2023-07-14T15:35:39.356 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-07-14T15:35:39.357 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-07-14T15:35:39.357 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/dc395x.ko 2023-07-14T15:35:39.357 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/device_handler 2023-07-14T15:35:39.357 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-07-14T15:35:39.357 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-07-14T15:35:39.357 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-07-14T15:35:39.357 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-07-14T15:35:39.357 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/dmx3191d.ko 2023-07-14T15:35:39.358 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/esas2r 2023-07-14T15:35:39.358 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/esas2r/esas2r.ko 2023-07-14T15:35:39.358 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/esp_scsi.ko 2023-07-14T15:35:39.358 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fcoe 2023-07-14T15:35:39.358 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fcoe/fcoe.ko 2023-07-14T15:35:39.358 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-07-14T15:35:39.358 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fnic 2023-07-14T15:35:39.358 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fnic/fnic.ko 2023-07-14T15:35:39.359 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/hpsa.ko 2023-07-14T15:35:39.359 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/hptiop.ko 2023-07-14T15:35:39.359 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/hv_storvsc.ko 2023-07-14T15:35:39.359 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/initio.ko 2023-07-14T15:35:39.359 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/ipr.ko 2023-07-14T15:35:39.359 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/ips.ko 2023-07-14T15:35:39.359 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/isci 2023-07-14T15:35:39.359 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/isci/isci.ko 2023-07-14T15:35:39.360 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-07-14T15:35:39.360 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/iscsi_tcp.ko 2023-07-14T15:35:39.360 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libfc 2023-07-14T15:35:39.360 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libfc/libfc.ko 2023-07-14T15:35:39.360 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libiscsi.ko 2023-07-14T15:35:39.360 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libiscsi_tcp.ko 2023-07-14T15:35:39.360 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libsas 2023-07-14T15:35:39.360 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libsas/libsas.ko 2023-07-14T15:35:39.361 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/lpfc 2023-07-14T15:35:39.361 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/lpfc/lpfc.ko 2023-07-14T15:35:39.361 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid 2023-07-14T15:35:39.361 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid.ko 2023-07-14T15:35:39.361 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-07-14T15:35:39.361 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-07-14T15:35:39.361 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-07-14T15:35:39.361 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mpt3sas 2023-07-14T15:35:39.362 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-07-14T15:35:39.362 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mvsas 2023-07-14T15:35:39.362 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mvsas/mvsas.ko 2023-07-14T15:35:39.362 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mvumi.ko 2023-07-14T15:35:39.362 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/pm8001 2023-07-14T15:35:39.362 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-07-14T15:35:39.363 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/pmcraid.ko 2023-07-14T15:35:39.363 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla1280.ko 2023-07-14T15:35:39.363 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla2xxx 2023-07-14T15:35:39.363 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-07-14T15:35:39.363 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-07-14T15:35:39.363 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla4xxx 2023-07-14T15:35:39.363 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-07-14T15:35:39.363 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/raid_class.ko 2023-07-14T15:35:39.364 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_debug.ko 2023-07-14T15:35:39.364 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_fc.ko 2023-07-14T15:35:39.364 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-07-14T15:35:39.364 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_sas.ko 2023-07-14T15:35:39.364 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_spi.ko 2023-07-14T15:35:39.364 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_srp.ko 2023-07-14T15:35:39.364 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/ses.ko 2023-07-14T15:35:39.365 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/st.ko 2023-07-14T15:35:39.365 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/stex.ko 2023-07-14T15:35:39.365 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/sym53c8xx_2 2023-07-14T15:35:39.365 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-07-14T15:35:39.365 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/virtio_scsi.ko 2023-07-14T15:35:39.365 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/vmw_pvscsi.ko 2023-07-14T15:35:39.365 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/wd719x.ko 2023-07-14T15:35:39.365 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ssb 2023-07-14T15:35:39.366 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ssb/ssb.ko 2023-07-14T15:35:39.366 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target 2023-07-14T15:35:39.366 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/iscsi 2023-07-14T15:35:39.366 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-07-14T15:35:39.366 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/loopback 2023-07-14T15:35:39.366 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/loopback/tcm_loop.ko 2023-07-14T15:35:39.366 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_file.ko 2023-07-14T15:35:39.366 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_iblock.ko 2023-07-14T15:35:39.367 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_mod.ko 2023-07-14T15:35:39.367 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_pscsi.ko 2023-07-14T15:35:39.367 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_user.ko 2023-07-14T15:35:39.367 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/tcm_fc 2023-07-14T15:35:39.367 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-07-14T15:35:39.367 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal 2023-07-14T15:35:39.367 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel 2023-07-14T15:35:39.368 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal 2023-07-14T15:35:39.368 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-07-14T15:35:39.368 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-07-14T15:35:39.368 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-07-14T15:35:39.368 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-07-14T15:35:39.368 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-07-14T15:35:39.368 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-07-14T15:35:39.368 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-07-14T15:35:39.369 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-07-14T15:35:39.369 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-07-14T15:35:39.369 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-07-14T15:35:39.369 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-07-14T15:35:39.369 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-07-14T15:35:39.369 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-07-14T15:35:39.369 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-07-14T15:35:39.370 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-07-14T15:35:39.370 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty 2023-07-14T15:35:39.370 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/ipwireless 2023-07-14T15:35:39.370 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-07-14T15:35:39.370 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/n_gsm.ko 2023-07-14T15:35:39.370 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/n_hdlc.ko 2023-07-14T15:35:39.370 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/nozomi.ko 2023-07-14T15:35:39.370 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial 2023-07-14T15:35:39.371 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/8250 2023-07-14T15:35:39.371 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-07-14T15:35:39.371 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/arc_uart.ko 2023-07-14T15:35:39.371 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/jsm 2023-07-14T15:35:39.371 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/jsm/jsm.ko 2023-07-14T15:35:39.371 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/synclink_gt.ko 2023-07-14T15:35:39.371 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs 2023-07-14T15:35:39.371 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs/core 2023-07-14T15:35:39.372 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs/core/ufshcd-core.ko 2023-07-14T15:35:39.372 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs/host 2023-07-14T15:35:39.372 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-07-14T15:35:39.372 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio 2023-07-14T15:35:39.372 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio.ko 2023-07-14T15:35:39.372 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio_aec.ko 2023-07-14T15:35:39.372 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio_cif.ko 2023-07-14T15:35:39.372 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio_pci_generic.ko 2023-07-14T15:35:39.373 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio_sercos3.ko 2023-07-14T15:35:39.373 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb 2023-07-14T15:35:39.373 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class 2023-07-14T15:35:39.373 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class/cdc-acm.ko 2023-07-14T15:35:39.373 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class/cdc-wdm.ko 2023-07-14T15:35:39.373 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class/usblp.ko 2023-07-14T15:35:39.373 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class/usbtmc.ko 2023-07-14T15:35:39.374 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/host 2023-07-14T15:35:39.374 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/host/sl811-hcd.ko 2023-07-14T15:35:39.374 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/image 2023-07-14T15:35:39.374 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/image/mdc800.ko 2023-07-14T15:35:39.374 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/image/microtek.ko 2023-07-14T15:35:39.374 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc 2023-07-14T15:35:39.374 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/adutux.ko 2023-07-14T15:35:39.374 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/appledisplay.ko 2023-07-14T15:35:39.375 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/emi26.ko 2023-07-14T15:35:39.375 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/emi62.ko 2023-07-14T15:35:39.375 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/ezusb.ko 2023-07-14T15:35:39.375 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/idmouse.ko 2023-07-14T15:35:39.375 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/iowarrior.ko 2023-07-14T15:35:39.375 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/isight_firmware.ko 2023-07-14T15:35:39.375 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/ldusb.ko 2023-07-14T15:35:39.375 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/legousbtower.ko 2023-07-14T15:35:39.376 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/sisusbvga 2023-07-14T15:35:39.376 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-07-14T15:35:39.376 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/trancevibrator.ko 2023-07-14T15:35:39.376 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/usb3503.ko 2023-07-14T15:35:39.376 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/usblcd.ko 2023-07-14T15:35:39.376 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/usbsevseg.ko 2023-07-14T15:35:39.376 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/uss720.ko 2023-07-14T15:35:39.376 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/yurex.ko 2023-07-14T15:35:39.377 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/phy 2023-07-14T15:35:39.377 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/phy/phy-generic.ko 2023-07-14T15:35:39.377 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial 2023-07-14T15:35:39.377 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/aircable.ko 2023-07-14T15:35:39.377 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ark3116.ko 2023-07-14T15:35:39.377 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/belkin_sa.ko 2023-07-14T15:35:39.377 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ch341.ko 2023-07-14T15:35:39.377 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/cp210x.ko 2023-07-14T15:35:39.378 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/cyberjack.ko 2023-07-14T15:35:39.378 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/cypress_m8.ko 2023-07-14T15:35:39.378 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/digi_acceleport.ko 2023-07-14T15:35:39.378 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/empeg.ko 2023-07-14T15:35:39.378 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ftdi_sio.ko 2023-07-14T15:35:39.378 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/garmin_gps.ko 2023-07-14T15:35:39.378 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/io_edgeport.ko 2023-07-14T15:35:39.378 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/io_ti.ko 2023-07-14T15:35:39.379 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ipaq.ko 2023-07-14T15:35:39.379 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ipw.ko 2023-07-14T15:35:39.379 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ir-usb.ko 2023-07-14T15:35:39.379 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-07-14T15:35:39.379 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/keyspan.ko 2023-07-14T15:35:39.379 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/keyspan_pda.ko 2023-07-14T15:35:39.379 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/kl5kusb105.ko 2023-07-14T15:35:39.379 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/kobil_sct.ko 2023-07-14T15:35:39.380 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/mct_u232.ko 2023-07-14T15:35:39.380 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/mos7720.ko 2023-07-14T15:35:39.380 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/mos7840.ko 2023-07-14T15:35:39.380 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/navman.ko 2023-07-14T15:35:39.380 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/omninet.ko 2023-07-14T15:35:39.380 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/opticon.ko 2023-07-14T15:35:39.380 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/option.ko 2023-07-14T15:35:39.380 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/oti6858.ko 2023-07-14T15:35:39.381 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/pl2303.ko 2023-07-14T15:35:39.381 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/qcaux.ko 2023-07-14T15:35:39.381 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/qcserial.ko 2023-07-14T15:35:39.381 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/quatech2.ko 2023-07-14T15:35:39.381 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/safe_serial.ko 2023-07-14T15:35:39.381 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/sierra.ko 2023-07-14T15:35:39.381 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/spcp8x5.ko 2023-07-14T15:35:39.381 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ssu100.ko 2023-07-14T15:35:39.382 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/symbolserial.ko 2023-07-14T15:35:39.382 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-07-14T15:35:39.382 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-07-14T15:35:39.382 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/usb_debug.ko 2023-07-14T15:35:39.382 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/usb_wwan.ko 2023-07-14T15:35:39.382 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/visor.ko 2023-07-14T15:35:39.382 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/whiteheat.ko 2023-07-14T15:35:39.382 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/xsens_mt.ko 2023-07-14T15:35:39.383 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage 2023-07-14T15:35:39.383 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/uas.ko 2023-07-14T15:35:39.383 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-alauda.ko 2023-07-14T15:35:39.383 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-cypress.ko 2023-07-14T15:35:39.383 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-datafab.ko 2023-07-14T15:35:39.383 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-07-14T15:35:39.383 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-freecom.ko 2023-07-14T15:35:39.383 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-isd200.ko 2023-07-14T15:35:39.384 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-07-14T15:35:39.384 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-karma.ko 2023-07-14T15:35:39.384 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-onetouch.ko 2023-07-14T15:35:39.384 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-realtek.ko 2023-07-14T15:35:39.384 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-sddr09.ko 2023-07-14T15:35:39.384 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-sddr55.ko 2023-07-14T15:35:39.384 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-usbat.ko 2023-07-14T15:35:39.385 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/usb-storage.ko 2023-07-14T15:35:39.385 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/usbip 2023-07-14T15:35:39.385 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/usbip/usbip-core.ko 2023-07-14T15:35:39.385 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/usbip/usbip-host.ko 2023-07-14T15:35:39.385 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-07-14T15:35:39.385 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio 2023-07-14T15:35:39.385 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/pci 2023-07-14T15:35:39.386 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-07-14T15:35:39.386 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/pci/vfio-pci.ko 2023-07-14T15:35:39.386 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/vfio.ko 2023-07-14T15:35:39.386 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-07-14T15:35:39.386 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost 2023-07-14T15:35:39.386 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost/vhost.ko 2023-07-14T15:35:39.386 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost/vhost_iotlb.ko 2023-07-14T15:35:39.386 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost/vhost_net.ko 2023-07-14T15:35:39.387 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost/vhost_scsi.ko 2023-07-14T15:35:39.387 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video 2023-07-14T15:35:39.387 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight 2023-07-14T15:35:39.387 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/apple_bl.ko 2023-07-14T15:35:39.387 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/lcd.ko 2023-07-14T15:35:39.387 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/platform_lcd.ko 2023-07-14T15:35:39.387 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio 2023-07-14T15:35:39.388 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio.ko 2023-07-14T15:35:39.388 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio_balloon.ko 2023-07-14T15:35:39.388 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio_mmio.ko 2023-07-14T15:35:39.388 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio_pci.ko 2023-07-14T15:35:39.388 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-07-14T15:35:39.388 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-07-14T15:35:39.388 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio_ring.ko 2023-07-14T15:35:39.389 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1 2023-07-14T15:35:39.389 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/masters 2023-07-14T15:35:39.389 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/masters/ds2482.ko 2023-07-14T15:35:39.389 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/masters/ds2490.ko 2023-07-14T15:35:39.389 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves 2023-07-14T15:35:39.389 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-07-14T15:35:39.390 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-07-14T15:35:39.390 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-07-14T15:35:39.390 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-07-14T15:35:39.390 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-07-14T15:35:39.390 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-07-14T15:35:39.390 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-07-14T15:35:39.390 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-07-14T15:35:39.390 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-07-14T15:35:39.391 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_smem.ko 2023-07-14T15:35:39.391 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_therm.ko 2023-07-14T15:35:39.391 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/wire.ko 2023-07-14T15:35:39.391 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog 2023-07-14T15:35:39.391 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/alim1535_wdt.ko 2023-07-14T15:35:39.391 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/alim7101_wdt.ko 2023-07-14T15:35:39.391 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/f71808e_wdt.ko 2023-07-14T15:35:39.391 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/hpwdt.ko 2023-07-14T15:35:39.392 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/i6300esb.ko 2023-07-14T15:35:39.392 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-07-14T15:35:39.392 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/iTCO_wdt.ko 2023-07-14T15:35:39.392 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/ib700wdt.ko 2023-07-14T15:35:39.393 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/ibmasr.ko 2023-07-14T15:35:39.393 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-07-14T15:35:39.393 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/it8712f_wdt.ko 2023-07-14T15:35:39.394 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/it87_wdt.ko 2023-07-14T15:35:39.394 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/machzwd.ko 2023-07-14T15:35:39.394 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/nv_tco.ko 2023-07-14T15:35:39.394 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/pcwd_pci.ko 2023-07-14T15:35:39.395 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/pcwd_usb.ko 2023-07-14T15:35:39.395 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-07-14T15:35:39.395 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/sch311x_wdt.ko 2023-07-14T15:35:39.395 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/softdog.ko 2023-07-14T15:35:39.396 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/sp5100_tco.ko 2023-07-14T15:35:39.396 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/via_wdt.ko 2023-07-14T15:35:39.396 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-07-14T15:35:39.396 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/w83877f_wdt.ko 2023-07-14T15:35:39.397 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/w83977f_wdt.ko 2023-07-14T15:35:39.397 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/wdt_pci.ko 2023-07-14T15:35:39.397 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/xen_wdt.ko 2023-07-14T15:35:39.398 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen 2023-07-14T15:35:39.398 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-acpi-processor.ko 2023-07-14T15:35:39.398 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-evtchn.ko 2023-07-14T15:35:39.398 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-gntalloc.ko 2023-07-14T15:35:39.398 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-gntdev.ko 2023-07-14T15:35:39.398 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-pciback 2023-07-14T15:35:39.399 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-07-14T15:35:39.399 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-privcmd.ko 2023-07-14T15:35:39.399 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xenfs 2023-07-14T15:35:39.399 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xenfs/xenfs.ko 2023-07-14T15:35:39.399 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs 2023-07-14T15:35:39.399 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/9p 2023-07-14T15:35:39.399 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/9p/9p.ko 2023-07-14T15:35:39.399 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/affs 2023-07-14T15:35:39.400 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/affs/affs.ko 2023-07-14T15:35:39.400 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/befs 2023-07-14T15:35:39.400 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/befs/befs.ko 2023-07-14T15:35:39.400 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/binfmt_misc.ko 2023-07-14T15:35:39.400 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/btrfs 2023-07-14T15:35:39.400 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/btrfs/btrfs.ko 2023-07-14T15:35:39.401 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/cachefiles 2023-07-14T15:35:39.401 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/cachefiles/cachefiles.ko 2023-07-14T15:35:39.401 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ceph 2023-07-14T15:35:39.401 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ceph/ceph.ko 2023-07-14T15:35:39.401 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/coda 2023-07-14T15:35:39.401 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/coda/coda.ko 2023-07-14T15:35:39.401 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/cramfs 2023-07-14T15:35:39.401 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/cramfs/cramfs.ko 2023-07-14T15:35:39.402 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/dlm 2023-07-14T15:35:39.402 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/dlm/dlm.ko 2023-07-14T15:35:39.402 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ecryptfs 2023-07-14T15:35:39.402 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ecryptfs/ecryptfs.ko 2023-07-14T15:35:39.402 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/f2fs 2023-07-14T15:35:39.402 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/f2fs/f2fs.ko 2023-07-14T15:35:39.402 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fat 2023-07-14T15:35:39.402 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fat/fat.ko 2023-07-14T15:35:39.403 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fat/msdos.ko 2023-07-14T15:35:39.403 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fat/vfat.ko 2023-07-14T15:35:39.403 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fscache 2023-07-14T15:35:39.403 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fscache/fscache.ko 2023-07-14T15:35:39.403 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fuse 2023-07-14T15:35:39.403 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fuse/cuse.ko 2023-07-14T15:35:39.403 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fuse/fuse.ko 2023-07-14T15:35:39.403 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/gfs2 2023-07-14T15:35:39.404 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/gfs2/gfs2.ko 2023-07-14T15:35:39.404 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/hfs 2023-07-14T15:35:39.404 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/hfs/hfs.ko 2023-07-14T15:35:39.404 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/hfsplus 2023-07-14T15:35:39.404 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/hfsplus/hfsplus.ko 2023-07-14T15:35:39.404 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/isofs 2023-07-14T15:35:39.404 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/isofs/isofs.ko 2023-07-14T15:35:39.405 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/jfs 2023-07-14T15:35:39.405 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/jfs/jfs.ko 2023-07-14T15:35:39.405 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/lockd 2023-07-14T15:35:39.405 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/lockd/lockd.ko 2023-07-14T15:35:39.405 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/minix 2023-07-14T15:35:39.405 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/minix/minix.ko 2023-07-14T15:35:39.405 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/netfs 2023-07-14T15:35:39.405 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/netfs/netfs.ko 2023-07-14T15:35:39.406 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs 2023-07-14T15:35:39.406 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/blocklayout 2023-07-14T15:35:39.406 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-07-14T15:35:39.406 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/filelayout 2023-07-14T15:35:39.406 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-07-14T15:35:39.406 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/flexfilelayout 2023-07-14T15:35:39.406 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-07-14T15:35:39.406 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/nfs.ko 2023-07-14T15:35:39.407 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/nfsv3.ko 2023-07-14T15:35:39.407 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/nfsv4.ko 2023-07-14T15:35:39.407 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs_common 2023-07-14T15:35:39.407 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs_common/grace.ko 2023-07-14T15:35:39.407 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs_common/nfs_acl.ko 2023-07-14T15:35:39.407 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfsd 2023-07-14T15:35:39.407 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfsd/nfsd.ko 2023-07-14T15:35:39.407 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nilfs2 2023-07-14T15:35:39.408 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nilfs2/nilfs2.ko 2023-07-14T15:35:39.408 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls 2023-07-14T15:35:39.408 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-celtic.ko 2023-07-14T15:35:39.408 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-centeuro.ko 2023-07-14T15:35:39.408 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-croatian.ko 2023-07-14T15:35:39.408 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-cyrillic.ko 2023-07-14T15:35:39.408 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-gaelic.ko 2023-07-14T15:35:39.409 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-greek.ko 2023-07-14T15:35:39.409 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-iceland.ko 2023-07-14T15:35:39.409 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-inuit.ko 2023-07-14T15:35:39.409 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-roman.ko 2023-07-14T15:35:39.409 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-romanian.ko 2023-07-14T15:35:39.409 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-turkish.ko 2023-07-14T15:35:39.409 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp1250.ko 2023-07-14T15:35:39.409 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp1251.ko 2023-07-14T15:35:39.410 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp1255.ko 2023-07-14T15:35:39.410 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp737.ko 2023-07-14T15:35:39.410 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp775.ko 2023-07-14T15:35:39.410 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp850.ko 2023-07-14T15:35:39.410 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp852.ko 2023-07-14T15:35:39.410 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp855.ko 2023-07-14T15:35:39.410 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp857.ko 2023-07-14T15:35:39.410 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp860.ko 2023-07-14T15:35:39.411 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp861.ko 2023-07-14T15:35:39.411 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp862.ko 2023-07-14T15:35:39.411 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp863.ko 2023-07-14T15:35:39.411 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp864.ko 2023-07-14T15:35:39.411 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp865.ko 2023-07-14T15:35:39.411 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp866.ko 2023-07-14T15:35:39.411 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp869.ko 2023-07-14T15:35:39.411 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp874.ko 2023-07-14T15:35:39.412 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp932.ko 2023-07-14T15:35:39.412 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp936.ko 2023-07-14T15:35:39.412 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp949.ko 2023-07-14T15:35:39.412 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp950.ko 2023-07-14T15:35:39.412 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_euc-jp.ko 2023-07-14T15:35:39.412 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-1.ko 2023-07-14T15:35:39.412 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-13.ko 2023-07-14T15:35:39.413 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-14.ko 2023-07-14T15:35:39.413 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-15.ko 2023-07-14T15:35:39.413 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-2.ko 2023-07-14T15:35:39.413 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-3.ko 2023-07-14T15:35:39.413 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-4.ko 2023-07-14T15:35:39.413 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-5.ko 2023-07-14T15:35:39.413 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-6.ko 2023-07-14T15:35:39.413 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-7.ko 2023-07-14T15:35:39.414 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-9.ko 2023-07-14T15:35:39.414 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_koi8-r.ko 2023-07-14T15:35:39.414 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_koi8-ru.ko 2023-07-14T15:35:39.414 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_koi8-u.ko 2023-07-14T15:35:39.414 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_utf8.ko 2023-07-14T15:35:39.414 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2 2023-07-14T15:35:39.414 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/cluster 2023-07-14T15:35:39.414 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-07-14T15:35:39.415 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/dlm 2023-07-14T15:35:39.415 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-07-14T15:35:39.415 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/dlmfs 2023-07-14T15:35:39.415 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-07-14T15:35:39.415 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/ocfs2.ko 2023-07-14T15:35:39.415 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-07-14T15:35:39.415 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-07-14T15:35:39.415 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-07-14T15:35:39.416 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/overlayfs 2023-07-14T15:35:39.416 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/overlayfs/overlay.ko 2023-07-14T15:35:39.416 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/pstore 2023-07-14T15:35:39.416 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/pstore/ramoops.ko 2023-07-14T15:35:39.416 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/reiserfs 2023-07-14T15:35:39.416 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/reiserfs/reiserfs.ko 2023-07-14T15:35:39.417 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/romfs 2023-07-14T15:35:39.417 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/romfs/romfs.ko 2023-07-14T15:35:39.417 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb 2023-07-14T15:35:39.417 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/client 2023-07-14T15:35:39.417 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/client/cifs.ko 2023-07-14T15:35:39.417 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/common 2023-07-14T15:35:39.417 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/common/cifs_arc4.ko 2023-07-14T15:35:39.417 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/common/cifs_md4.ko 2023-07-14T15:35:39.418 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/squashfs 2023-07-14T15:35:39.418 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/squashfs/squashfs.ko 2023-07-14T15:35:39.418 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/sysv 2023-07-14T15:35:39.418 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/sysv/sysv.ko 2023-07-14T15:35:39.418 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/udf 2023-07-14T15:35:39.418 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/udf/udf.ko 2023-07-14T15:35:39.418 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ufs 2023-07-14T15:35:39.418 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ufs/ufs.ko 2023-07-14T15:35:39.419 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/xfs 2023-07-14T15:35:39.419 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/xfs/xfs.ko 2023-07-14T15:35:39.419 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel 2023-07-14T15:35:39.419 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/rcu 2023-07-14T15:35:39.419 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/rcu/rcutorture.ko 2023-07-14T15:35:39.419 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/torture.ko 2023-07-14T15:35:39.419 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/trace 2023-07-14T15:35:39.419 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-07-14T15:35:39.420 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib 2023-07-14T15:35:39.420 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/asn1_encoder.ko 2023-07-14T15:35:39.420 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crc-itu-t.ko 2023-07-14T15:35:39.420 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crc8.ko 2023-07-14T15:35:39.420 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crypto 2023-07-14T15:35:39.420 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crypto/libarc4.ko 2023-07-14T15:35:39.420 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crypto/libdes.ko 2023-07-14T15:35:39.421 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/libcrc32c.ko 2023-07-14T15:35:39.421 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/lru_cache.ko 2023-07-14T15:35:39.421 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/lz4 2023-07-14T15:35:39.421 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/lz4/lz4_compress.ko 2023-07-14T15:35:39.421 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/lz4/lz4hc_compress.ko 2023-07-14T15:35:39.421 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/math 2023-07-14T15:35:39.421 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/math/cordic.ko 2023-07-14T15:35:39.421 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/raid6 2023-07-14T15:35:39.422 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/raid6/raid6_pq.ko 2023-07-14T15:35:39.422 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/reed_solomon 2023-07-14T15:35:39.422 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/reed_solomon/reed_solomon.ko 2023-07-14T15:35:39.422 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/ts_bm.ko 2023-07-14T15:35:39.422 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/ts_fsm.ko 2023-07-14T15:35:39.422 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/ts_kmp.ko 2023-07-14T15:35:39.423 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/zstd 2023-07-14T15:35:39.423 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/zstd/zstd_compress.ko 2023-07-14T15:35:39.423 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/mm 2023-07-14T15:35:39.423 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/mm/hwpoison-inject.ko 2023-07-14T15:35:39.423 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net 2023-07-14T15:35:39.423 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan 2023-07-14T15:35:39.423 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/6lowpan.ko 2023-07-14T15:35:39.423 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_dest.ko 2023-07-14T15:35:39.424 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_fragment.ko 2023-07-14T15:35:39.424 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_hop.ko 2023-07-14T15:35:39.424 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_ipv6.ko 2023-07-14T15:35:39.424 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_mobility.ko 2023-07-14T15:35:39.424 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_routing.ko 2023-07-14T15:35:39.424 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_udp.ko 2023-07-14T15:35:39.424 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802 2023-07-14T15:35:39.424 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/garp.ko 2023-07-14T15:35:39.425 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/mrp.ko 2023-07-14T15:35:39.425 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/p8022.ko 2023-07-14T15:35:39.425 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/psnap.ko 2023-07-14T15:35:39.425 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/stp.ko 2023-07-14T15:35:39.425 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/8021q 2023-07-14T15:35:39.425 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/8021q/8021q.ko 2023-07-14T15:35:39.425 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p 2023-07-14T15:35:39.425 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p/9pnet.ko 2023-07-14T15:35:39.426 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p/9pnet_fd.ko 2023-07-14T15:35:39.426 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p/9pnet_rdma.ko 2023-07-14T15:35:39.426 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p/9pnet_virtio.ko 2023-07-14T15:35:39.426 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/batman-adv 2023-07-14T15:35:39.426 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/batman-adv/batman-adv.ko 2023-07-14T15:35:39.426 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge 2023-07-14T15:35:39.426 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/br_netfilter.ko 2023-07-14T15:35:39.426 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/bridge.ko 2023-07-14T15:35:39.427 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter 2023-07-14T15:35:39.427 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-07-14T15:35:39.427 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_among.ko 2023-07-14T15:35:39.427 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_arp.ko 2023-07-14T15:35:39.427 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-07-14T15:35:39.427 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-07-14T15:35:39.427 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_ip.ko 2023-07-14T15:35:39.427 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-07-14T15:35:39.428 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_limit.ko 2023-07-14T15:35:39.428 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_log.ko 2023-07-14T15:35:39.428 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_mark.ko 2023-07-14T15:35:39.428 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-07-14T15:35:39.428 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-07-14T15:35:39.428 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-07-14T15:35:39.428 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-07-14T15:35:39.429 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_snat.ko 2023-07-14T15:35:39.429 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_stp.ko 2023-07-14T15:35:39.429 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-07-14T15:35:39.429 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-07-14T15:35:39.429 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-07-14T15:35:39.429 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-07-14T15:35:39.429 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebtables.ko 2023-07-14T15:35:39.429 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-07-14T15:35:39.430 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-07-14T15:35:39.430 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-07-14T15:35:39.430 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ceph 2023-07-14T15:35:39.430 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ceph/libceph.ko 2023-07-14T15:35:39.430 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/core 2023-07-14T15:35:39.430 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/core/failover.ko 2023-07-14T15:35:39.430 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/core/pktgen.ko 2023-07-14T15:35:39.430 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp 2023-07-14T15:35:39.431 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp/dccp.ko 2023-07-14T15:35:39.431 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp/dccp_diag.ko 2023-07-14T15:35:39.431 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp/dccp_ipv4.ko 2023-07-14T15:35:39.431 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp/dccp_ipv6.ko 2023-07-14T15:35:39.431 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dns_resolver 2023-07-14T15:35:39.431 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dns_resolver/dns_resolver.ko 2023-07-14T15:35:39.431 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa 2023-07-14T15:35:39.431 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/dsa_core.ko 2023-07-14T15:35:39.432 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/tag_brcm.ko 2023-07-14T15:35:39.432 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/tag_dsa.ko 2023-07-14T15:35:39.432 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/tag_none.ko 2023-07-14T15:35:39.432 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/tag_trailer.ko 2023-07-14T15:35:39.432 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154 2023-07-14T15:35:39.432 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154/6lowpan 2023-07-14T15:35:39.432 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-07-14T15:35:39.433 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154/ieee802154.ko 2023-07-14T15:35:39.433 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154/ieee802154_socket.ko 2023-07-14T15:35:39.433 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4 2023-07-14T15:35:39.433 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ah4.ko 2023-07-14T15:35:39.433 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/esp4.ko 2023-07-14T15:35:39.433 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/fou.ko 2023-07-14T15:35:39.433 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/gre.ko 2023-07-14T15:35:39.433 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/inet_diag.ko 2023-07-14T15:35:39.434 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ip_gre.ko 2023-07-14T15:35:39.434 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ip_tunnel.ko 2023-07-14T15:35:39.434 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ip_vti.ko 2023-07-14T15:35:39.434 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ipcomp.ko 2023-07-14T15:35:39.434 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ipip.ko 2023-07-14T15:35:39.434 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter 2023-07-14T15:35:39.434 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/arp_tables.ko 2023-07-14T15:35:39.434 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-07-14T15:35:39.435 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-07-14T15:35:39.435 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-07-14T15:35:39.435 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-07-14T15:35:39.435 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-07-14T15:35:39.435 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-07-14T15:35:39.435 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-07-14T15:35:39.435 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-07-14T15:35:39.435 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-07-14T15:35:39.436 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/iptable_security.ko 2023-07-14T15:35:39.436 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-07-14T15:35:39.436 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-07-14T15:35:39.436 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-07-14T15:35:39.436 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-07-14T15:35:39.436 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-07-14T15:35:39.436 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-07-14T15:35:39.436 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-07-14T15:35:39.437 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-07-14T15:35:39.437 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-07-14T15:35:39.437 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-07-14T15:35:39.437 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_bic.ko 2023-07-14T15:35:39.437 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_dctcp.ko 2023-07-14T15:35:39.437 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_diag.ko 2023-07-14T15:35:39.437 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_highspeed.ko 2023-07-14T15:35:39.438 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_htcp.ko 2023-07-14T15:35:39.438 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_hybla.ko 2023-07-14T15:35:39.438 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_illinois.ko 2023-07-14T15:35:39.438 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_lp.ko 2023-07-14T15:35:39.438 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_scalable.ko 2023-07-14T15:35:39.438 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_vegas.ko 2023-07-14T15:35:39.438 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_veno.ko 2023-07-14T15:35:39.438 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_westwood.ko 2023-07-14T15:35:39.439 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_yeah.ko 2023-07-14T15:35:39.439 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tunnel4.ko 2023-07-14T15:35:39.439 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/udp_diag.ko 2023-07-14T15:35:39.439 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/udp_tunnel.ko 2023-07-14T15:35:39.439 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/xfrm4_tunnel.ko 2023-07-14T15:35:39.439 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6 2023-07-14T15:35:39.439 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ah6.ko 2023-07-14T15:35:39.440 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/esp6.ko 2023-07-14T15:35:39.440 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/fou6.ko 2023-07-14T15:35:39.440 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ip6_tunnel.ko 2023-07-14T15:35:39.440 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-07-14T15:35:39.440 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ip6_vti.ko 2023-07-14T15:35:39.440 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ipcomp6.ko 2023-07-14T15:35:39.440 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter 2023-07-14T15:35:39.440 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-07-14T15:35:39.441 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-07-14T15:35:39.441 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-07-14T15:35:39.441 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-07-14T15:35:39.441 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-07-14T15:35:39.441 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-07-14T15:35:39.441 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-07-14T15:35:39.441 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-07-14T15:35:39.441 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-07-14T15:35:39.442 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-07-14T15:35:39.442 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-07-14T15:35:39.442 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-07-14T15:35:39.442 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-07-14T15:35:39.442 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-07-14T15:35:39.442 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-07-14T15:35:39.442 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-07-14T15:35:39.442 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-07-14T15:35:39.443 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-07-14T15:35:39.443 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-07-14T15:35:39.443 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-07-14T15:35:39.443 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-07-14T15:35:39.443 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-07-14T15:35:39.443 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-07-14T15:35:39.443 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-07-14T15:35:39.443 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/sit.ko 2023-07-14T15:35:39.444 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/tunnel6.ko 2023-07-14T15:35:39.444 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/xfrm6_tunnel.ko 2023-07-14T15:35:39.444 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/key 2023-07-14T15:35:39.444 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/key/af_key.ko 2023-07-14T15:35:39.444 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp 2023-07-14T15:35:39.444 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_core.ko 2023-07-14T15:35:39.444 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_debugfs.ko 2023-07-14T15:35:39.445 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_eth.ko 2023-07-14T15:35:39.445 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_ip.ko 2023-07-14T15:35:39.445 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_ip6.ko 2023-07-14T15:35:39.445 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_netlink.ko 2023-07-14T15:35:39.445 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_ppp.ko 2023-07-14T15:35:39.445 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/llc 2023-07-14T15:35:39.445 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/llc/llc.ko 2023-07-14T15:35:39.445 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/mac802154 2023-07-14T15:35:39.446 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/mac802154/mac802154.ko 2023-07-14T15:35:39.446 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/mpls 2023-07-14T15:35:39.446 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/mpls/mpls_gso.ko 2023-07-14T15:35:39.446 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter 2023-07-14T15:35:39.446 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset 2023-07-14T15:35:39.446 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set.ko 2023-07-14T15:35:39.446 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-07-14T15:35:39.446 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-07-14T15:35:39.447 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-07-14T15:35:39.447 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-07-14T15:35:39.447 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-07-14T15:35:39.447 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-07-14T15:35:39.447 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-07-14T15:35:39.447 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-07-14T15:35:39.447 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-07-14T15:35:39.447 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-07-14T15:35:39.448 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-07-14T15:35:39.448 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-07-14T15:35:39.448 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-07-14T15:35:39.448 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-07-14T15:35:39.448 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-07-14T15:35:39.448 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs 2023-07-14T15:35:39.448 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs.ko 2023-07-14T15:35:39.448 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-07-14T15:35:39.449 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-07-14T15:35:39.449 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-07-14T15:35:39.449 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-07-14T15:35:39.449 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-07-14T15:35:39.449 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-07-14T15:35:39.449 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-07-14T15:35:39.449 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-07-14T15:35:39.450 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-07-14T15:35:39.450 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-07-14T15:35:39.450 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-07-14T15:35:39.450 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-07-14T15:35:39.450 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-07-14T15:35:39.450 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conncount.ko 2023-07-14T15:35:39.450 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack.ko 2023-07-14T15:35:39.450 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-07-14T15:35:39.451 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-07-14T15:35:39.451 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-07-14T15:35:39.451 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_h323.ko 2023-07-14T15:35:39.451 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_irc.ko 2023-07-14T15:35:39.451 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-07-14T15:35:39.451 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-07-14T15:35:39.451 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-07-14T15:35:39.451 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_sane.ko 2023-07-14T15:35:39.452 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_sip.ko 2023-07-14T15:35:39.452 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-07-14T15:35:39.452 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-07-14T15:35:39.452 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_dup_netdev.ko 2023-07-14T15:35:39.452 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_flow_table.ko 2023-07-14T15:35:39.452 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_flow_table_inet.ko 2023-07-14T15:35:39.452 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_log_syslog.ko 2023-07-14T15:35:39.452 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat.ko 2023-07-14T15:35:39.453 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_amanda.ko 2023-07-14T15:35:39.453 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_ftp.ko 2023-07-14T15:35:39.453 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_irc.ko 2023-07-14T15:35:39.453 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_sip.ko 2023-07-14T15:35:39.453 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_tftp.ko 2023-07-14T15:35:39.453 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_synproxy_core.ko 2023-07-14T15:35:39.453 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_tables.ko 2023-07-14T15:35:39.454 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink.ko 2023-07-14T15:35:39.454 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink_acct.ko 2023-07-14T15:35:39.454 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink_log.ko 2023-07-14T15:35:39.454 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink_osf.ko 2023-07-14T15:35:39.454 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink_queue.ko 2023-07-14T15:35:39.454 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_chain_nat.ko 2023-07-14T15:35:39.454 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_compat.ko 2023-07-14T15:35:39.454 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_ct.ko 2023-07-14T15:35:39.455 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_dup_netdev.ko 2023-07-14T15:35:39.455 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_fib.ko 2023-07-14T15:35:39.455 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_fwd_netdev.ko 2023-07-14T15:35:39.455 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_hash.ko 2023-07-14T15:35:39.455 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_limit.ko 2023-07-14T15:35:39.455 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_log.ko 2023-07-14T15:35:39.455 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_masq.ko 2023-07-14T15:35:39.455 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_nat.ko 2023-07-14T15:35:39.456 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_numgen.ko 2023-07-14T15:35:39.456 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_queue.ko 2023-07-14T15:35:39.456 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_quota.ko 2023-07-14T15:35:39.456 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_redir.ko 2023-07-14T15:35:39.456 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_reject.ko 2023-07-14T15:35:39.456 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_reject_inet.ko 2023-07-14T15:35:39.456 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_socket.ko 2023-07-14T15:35:39.457 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_tunnel.ko 2023-07-14T15:35:39.457 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_AUDIT.ko 2023-07-14T15:35:39.457 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_CHECKSUM.ko 2023-07-14T15:35:39.457 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_CLASSIFY.ko 2023-07-14T15:35:39.457 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-07-14T15:35:39.457 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_CT.ko 2023-07-14T15:35:39.457 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_DSCP.ko 2023-07-14T15:35:39.457 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_HL.ko 2023-07-14T15:35:39.458 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_HMARK.ko 2023-07-14T15:35:39.458 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_IDLETIMER.ko 2023-07-14T15:35:39.458 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_LED.ko 2023-07-14T15:35:39.458 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_LOG.ko 2023-07-14T15:35:39.458 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_MASQUERADE.ko 2023-07-14T15:35:39.458 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_NETMAP.ko 2023-07-14T15:35:39.458 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_NFLOG.ko 2023-07-14T15:35:39.458 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_NFQUEUE.ko 2023-07-14T15:35:39.459 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_RATEEST.ko 2023-07-14T15:35:39.459 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_REDIRECT.ko 2023-07-14T15:35:39.459 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_SECMARK.ko 2023-07-14T15:35:39.459 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TCPMSS.ko 2023-07-14T15:35:39.459 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-07-14T15:35:39.459 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TEE.ko 2023-07-14T15:35:39.459 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TPROXY.ko 2023-07-14T15:35:39.459 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TRACE.ko 2023-07-14T15:35:39.460 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_addrtype.ko 2023-07-14T15:35:39.460 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_bpf.ko 2023-07-14T15:35:39.460 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_cgroup.ko 2023-07-14T15:35:39.460 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_cluster.ko 2023-07-14T15:35:39.460 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_comment.ko 2023-07-14T15:35:39.460 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_connbytes.ko 2023-07-14T15:35:39.460 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_connlabel.ko 2023-07-14T15:35:39.460 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_connlimit.ko 2023-07-14T15:35:39.461 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_connmark.ko 2023-07-14T15:35:39.461 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_conntrack.ko 2023-07-14T15:35:39.461 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_cpu.ko 2023-07-14T15:35:39.461 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_dccp.ko 2023-07-14T15:35:39.461 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_devgroup.ko 2023-07-14T15:35:39.461 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_dscp.ko 2023-07-14T15:35:39.461 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_ecn.ko 2023-07-14T15:35:39.461 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_esp.ko 2023-07-14T15:35:39.462 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_hashlimit.ko 2023-07-14T15:35:39.462 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_helper.ko 2023-07-14T15:35:39.462 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_hl.ko 2023-07-14T15:35:39.462 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_ipcomp.ko 2023-07-14T15:35:39.462 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_iprange.ko 2023-07-14T15:35:39.462 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_ipvs.ko 2023-07-14T15:35:39.463 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_l2tp.ko 2023-07-14T15:35:39.463 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_length.ko 2023-07-14T15:35:39.463 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_limit.ko 2023-07-14T15:35:39.463 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_mac.ko 2023-07-14T15:35:39.463 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_mark.ko 2023-07-14T15:35:39.463 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_multiport.ko 2023-07-14T15:35:39.463 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_nat.ko 2023-07-14T15:35:39.463 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_nfacct.ko 2023-07-14T15:35:39.464 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_osf.ko 2023-07-14T15:35:39.464 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_owner.ko 2023-07-14T15:35:39.464 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_physdev.ko 2023-07-14T15:35:39.464 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_pkttype.ko 2023-07-14T15:35:39.464 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_policy.ko 2023-07-14T15:35:39.464 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_quota.ko 2023-07-14T15:35:39.464 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_rateest.ko 2023-07-14T15:35:39.464 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_realm.ko 2023-07-14T15:35:39.465 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_recent.ko 2023-07-14T15:35:39.465 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_sctp.ko 2023-07-14T15:35:39.465 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_set.ko 2023-07-14T15:35:39.465 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_socket.ko 2023-07-14T15:35:39.465 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_state.ko 2023-07-14T15:35:39.465 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_statistic.ko 2023-07-14T15:35:39.465 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_string.ko 2023-07-14T15:35:39.465 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_tcpmss.ko 2023-07-14T15:35:39.466 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_time.ko 2023-07-14T15:35:39.466 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_u32.ko 2023-07-14T15:35:39.466 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netlink 2023-07-14T15:35:39.466 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netlink/netlink_diag.ko 2023-07-14T15:35:39.466 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/nsh 2023-07-14T15:35:39.466 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/nsh/nsh.ko 2023-07-14T15:35:39.466 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch 2023-07-14T15:35:39.466 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch/openvswitch.ko 2023-07-14T15:35:39.467 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch/vport-geneve.ko 2023-07-14T15:35:39.467 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch/vport-gre.ko 2023-07-14T15:35:39.467 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch/vport-vxlan.ko 2023-07-14T15:35:39.467 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/packet 2023-07-14T15:35:39.467 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/packet/af_packet_diag.ko 2023-07-14T15:35:39.467 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/rds 2023-07-14T15:35:39.467 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/rds/rds.ko 2023-07-14T15:35:39.467 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/rds/rds_rdma.ko 2023-07-14T15:35:39.468 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/rds/rds_tcp.ko 2023-07-14T15:35:39.468 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched 2023-07-14T15:35:39.468 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_csum.ko 2023-07-14T15:35:39.468 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_gact.ko 2023-07-14T15:35:39.468 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_ipt.ko 2023-07-14T15:35:39.468 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_mirred.ko 2023-07-14T15:35:39.469 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_nat.ko 2023-07-14T15:35:39.469 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_pedit.ko 2023-07-14T15:35:39.469 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_police.ko 2023-07-14T15:35:39.469 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_simple.ko 2023-07-14T15:35:39.469 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_skbedit.ko 2023-07-14T15:35:39.469 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_vlan.ko 2023-07-14T15:35:39.469 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_basic.ko 2023-07-14T15:35:39.469 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_bpf.ko 2023-07-14T15:35:39.470 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_flow.ko 2023-07-14T15:35:39.470 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_fw.ko 2023-07-14T15:35:39.470 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_route.ko 2023-07-14T15:35:39.470 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_u32.ko 2023-07-14T15:35:39.470 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_cmp.ko 2023-07-14T15:35:39.470 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_ipset.ko 2023-07-14T15:35:39.470 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_meta.ko 2023-07-14T15:35:39.470 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_nbyte.ko 2023-07-14T15:35:39.471 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_text.ko 2023-07-14T15:35:39.471 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_u32.ko 2023-07-14T15:35:39.471 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_choke.ko 2023-07-14T15:35:39.471 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_codel.ko 2023-07-14T15:35:39.471 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_drr.ko 2023-07-14T15:35:39.471 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_fq.ko 2023-07-14T15:35:39.471 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_gred.ko 2023-07-14T15:35:39.471 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_hfsc.ko 2023-07-14T15:35:39.472 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_hhf.ko 2023-07-14T15:35:39.472 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_htb.ko 2023-07-14T15:35:39.472 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_ingress.ko 2023-07-14T15:35:39.472 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_mqprio.ko 2023-07-14T15:35:39.472 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_mqprio_lib.ko 2023-07-14T15:35:39.472 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_multiq.ko 2023-07-14T15:35:39.472 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_netem.ko 2023-07-14T15:35:39.473 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_pie.ko 2023-07-14T15:35:39.473 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_plug.ko 2023-07-14T15:35:39.473 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_prio.ko 2023-07-14T15:35:39.473 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_qfq.ko 2023-07-14T15:35:39.473 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_red.ko 2023-07-14T15:35:39.473 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_sfb.ko 2023-07-14T15:35:39.473 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_sfq.ko 2023-07-14T15:35:39.473 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_tbf.ko 2023-07-14T15:35:39.474 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_teql.ko 2023-07-14T15:35:39.474 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sctp 2023-07-14T15:35:39.474 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sctp/sctp.ko 2023-07-14T15:35:39.474 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sctp/sctp_diag.ko 2023-07-14T15:35:39.474 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc 2023-07-14T15:35:39.474 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/auth_gss 2023-07-14T15:35:39.474 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-07-14T15:35:39.474 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-07-14T15:35:39.475 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/sunrpc.ko 2023-07-14T15:35:39.475 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/xprtrdma 2023-07-14T15:35:39.475 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-07-14T15:35:39.475 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/tipc 2023-07-14T15:35:39.475 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/tipc/diag.ko 2023-07-14T15:35:39.475 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/tipc/tipc.ko 2023-07-14T15:35:39.475 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/unix 2023-07-14T15:35:39.475 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/unix/unix_diag.ko 2023-07-14T15:35:39.476 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock 2023-07-14T15:35:39.476 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-07-14T15:35:39.476 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-07-14T15:35:39.476 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vsock.ko 2023-07-14T15:35:39.476 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vsock_diag.ko 2023-07-14T15:35:39.476 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vsock_loopback.ko 2023-07-14T15:35:39.476 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/xfrm 2023-07-14T15:35:39.477 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/xfrm/xfrm_ipcomp.ko 2023-07-14T15:35:39.477 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/security 2023-07-14T15:35:39.477 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/security/keys 2023-07-14T15:35:39.477 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/security/keys/encrypted-keys 2023-07-14T15:35:39.477 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-07-14T15:35:39.477 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/security/keys/trusted-keys 2023-07-14T15:35:39.477 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/security/keys/trusted-keys/trusted.ko 2023-07-14T15:35:39.477 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/virt 2023-07-14T15:35:39.478 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/virt/lib 2023-07-14T15:35:39.478 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/virt/lib/irqbypass.ko 2023-07-14T15:35:39.478 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.alias 2023-07-14T15:35:39.478 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.alias.bin 2023-07-14T15:35:39.478 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.builtin 2023-07-14T15:35:39.478 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.builtin.bin 2023-07-14T15:35:39.478 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.builtin.modinfo 2023-07-14T15:35:39.478 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.dep 2023-07-14T15:35:39.479 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.dep.bin 2023-07-14T15:35:39.479 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.devname 2023-07-14T15:35:39.479 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.order 2023-07-14T15:35:39.479 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.softdep 2023-07-14T15:35:39.479 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.symbols 2023-07-14T15:35:39.479 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.symbols.bin 2023-07-14T15:35:39.480 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc1-ga440c79eee02 2023-07-14T15:35:39.480 DEBUG:teuthology.orchestra.run.smithi037:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-07-14T15:35:39.506 INFO:teuthology.orchestra.run.smithi037.stdout:postinstall scriptlet (using /bin/sh): 2023-07-14T15:35:39.506 INFO:teuthology.orchestra.run.smithi037.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc1-ga440c79eee02 -a -r /boot/System.map-6.5.0-rc1-ga440c79eee02 ]; then 2023-07-14T15:35:39.507 INFO:teuthology.orchestra.run.smithi037.stdout:cp /boot/vmlinuz-6.5.0-rc1-ga440c79eee02 /boot/.vmlinuz-6.5.0-rc1-ga440c79eee02-rpm 2023-07-14T15:35:39.507 INFO:teuthology.orchestra.run.smithi037.stdout:cp /boot/System.map-6.5.0-rc1-ga440c79eee02 /boot/.System.map-6.5.0-rc1-ga440c79eee02-rpm 2023-07-14T15:35:39.507 INFO:teuthology.orchestra.run.smithi037.stdout:rm -f /boot/vmlinuz-6.5.0-rc1-ga440c79eee02 /boot/System.map-6.5.0-rc1-ga440c79eee02 2023-07-14T15:35:39.507 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/installkernel 6.5.0-rc1-ga440c79eee02 /boot/.vmlinuz-6.5.0-rc1-ga440c79eee02-rpm /boot/.System.map-6.5.0-rc1-ga440c79eee02-rpm 2023-07-14T15:35:39.507 INFO:teuthology.orchestra.run.smithi037.stdout:rm -f /boot/.vmlinuz-6.5.0-rc1-ga440c79eee02-rpm /boot/.System.map-6.5.0-rc1-ga440c79eee02-rpm 2023-07-14T15:35:39.507 INFO:teuthology.orchestra.run.smithi037.stdout:fi 2023-07-14T15:35:39.507 INFO:teuthology.orchestra.run.smithi037.stdout:preuninstall scriptlet (using /bin/sh): 2023-07-14T15:35:39.508 INFO:teuthology.orchestra.run.smithi037.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-07-14T15:35:39.508 INFO:teuthology.orchestra.run.smithi037.stdout:new-kernel-pkg --remove 6.5.0-rc1-ga440c79eee02 --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc1-ga440c79eee02.img 2023-07-14T15:35:39.508 INFO:teuthology.orchestra.run.smithi037.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-07-14T15:35:39.508 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-install remove 6.5.0-rc1-ga440c79eee02 2023-07-14T15:35:39.508 INFO:teuthology.orchestra.run.smithi037.stdout:fi 2023-07-14T15:35:39.508 INFO:teuthology.orchestra.run.smithi037.stdout:postuninstall scriptlet (using /bin/sh): 2023-07-14T15:35:39.508 INFO:teuthology.orchestra.run.smithi037.stdout:if [ -x /sbin/update-bootloader ]; then 2023-07-14T15:35:39.509 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/update-bootloader --remove 6.5.0-rc1-ga440c79eee02 2023-07-14T15:35:39.509 INFO:teuthology.orchestra.run.smithi037.stdout:fi 2023-07-14T15:35:39.509 DEBUG:teuthology.orchestra.run.smithi037:> sudo rpm -qi grub2-tools 2023-07-14T15:35:39.587 INFO:teuthology.orchestra.run.smithi037.stdout:Name : grub2-tools 2023-07-14T15:35:39.587 INFO:teuthology.orchestra.run.smithi037.stdout:Epoch : 1 2023-07-14T15:35:39.587 INFO:teuthology.orchestra.run.smithi037.stdout:Version : 2.02 2023-07-14T15:35:39.587 INFO:teuthology.orchestra.run.smithi037.stdout:Release : 123.el8 2023-07-14T15:35:39.587 INFO:teuthology.orchestra.run.smithi037.stdout:Architecture: x86_64 2023-07-14T15:35:39.588 INFO:teuthology.orchestra.run.smithi037.stdout:Install Date: Thu 14 Jul 2022 06:22:19 PM UTC 2023-07-14T15:35:39.588 INFO:teuthology.orchestra.run.smithi037.stdout:Group : System Environment/Base 2023-07-14T15:35:39.588 INFO:teuthology.orchestra.run.smithi037.stdout:Size : 9265450 2023-07-14T15:35:39.588 INFO:teuthology.orchestra.run.smithi037.stdout:License : GPLv3+ 2023-07-14T15:35:39.588 INFO:teuthology.orchestra.run.smithi037.stdout:Signature : RSA/SHA256, Thu 31 Mar 2022 07:24:35 PM UTC, Key ID 199e2f91fd431d51 2023-07-14T15:35:39.588 INFO:teuthology.orchestra.run.smithi037.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2023-07-14T15:35:39.588 INFO:teuthology.orchestra.run.smithi037.stdout:Build Date : Mon 28 Mar 2022 02:12:09 PM UTC 2023-07-14T15:35:39.589 INFO:teuthology.orchestra.run.smithi037.stdout:Build Host : x86-vm-09.build.eng.bos.redhat.com 2023-07-14T15:35:39.589 INFO:teuthology.orchestra.run.smithi037.stdout:Relocations : (not relocatable) 2023-07-14T15:35:39.589 INFO:teuthology.orchestra.run.smithi037.stdout:Packager : Red Hat, Inc. 2023-07-14T15:35:39.589 INFO:teuthology.orchestra.run.smithi037.stdout:Vendor : Red Hat, Inc. 2023-07-14T15:35:39.589 INFO:teuthology.orchestra.run.smithi037.stdout:URL : http://www.gnu.org/software/grub/ 2023-07-14T15:35:39.589 INFO:teuthology.orchestra.run.smithi037.stdout:Summary : Support tools for GRUB. 2023-07-14T15:35:39.589 INFO:teuthology.orchestra.run.smithi037.stdout:Description : 2023-07-14T15:35:39.590 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:35:39.590 INFO:teuthology.orchestra.run.smithi037.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-07-14T15:35:39.590 INFO:teuthology.orchestra.run.smithi037.stdout:customizable bootloader with modular architecture. It supports a rich 2023-07-14T15:35:39.590 INFO:teuthology.orchestra.run.smithi037.stdout:variety of kernel formats, file systems, computer architectures and 2023-07-14T15:35:39.590 INFO:teuthology.orchestra.run.smithi037.stdout:hardware devices. 2023-07-14T15:35:39.590 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:35:39.590 INFO:teuthology.orchestra.run.smithi037.stdout:This subpackage provides tools for support of all platforms. 2023-07-14T15:35:39.591 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-07-14T15:35:39.591 INFO:teuthology.task.kernel:Updating grub on smithi037 to boot 6.5.0-rc1-ga440c79eee02 2023-07-14T15:35:39.592 DEBUG:teuthology.orchestra.run.smithi037:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-07-14T15:35:44.636 INFO:teuthology.orchestra.run.smithi037.stderr:Generating grub configuration file ... 2023-07-14T15:35:44.836 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi098.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-07-14T15:35:44.837 DEBUG:teuthology.orchestra.run.smithi098:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-07-14T15:35:44.926 INFO:teuthology.orchestra.run.smithi098.stdout:/boot/System.map-6.5.0-rc1-ga440c79eee02 2023-07-14T15:35:44.926 INFO:teuthology.orchestra.run.smithi098.stdout:/boot/config-6.5.0-rc1-ga440c79eee02 2023-07-14T15:35:44.926 INFO:teuthology.orchestra.run.smithi098.stdout:/boot/vmlinuz-6.5.0-rc1-ga440c79eee02 2023-07-14T15:35:44.927 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02 2023-07-14T15:35:44.927 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel 2023-07-14T15:35:44.927 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch 2023-07-14T15:35:44.927 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86 2023-07-14T15:35:44.927 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto 2023-07-14T15:35:44.927 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-07-14T15:35:44.927 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-07-14T15:35:44.928 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-07-14T15:35:44.928 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-07-14T15:35:44.928 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-07-14T15:35:44.928 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-07-14T15:35:44.928 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-07-14T15:35:44.928 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/crc32c-intel.ko 2023-07-14T15:35:44.928 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-07-14T15:35:44.929 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-07-14T15:35:44.929 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-07-14T15:35:44.929 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-07-14T15:35:44.929 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/serpent-avx2.ko 2023-07-14T15:35:44.929 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-07-14T15:35:44.929 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-07-14T15:35:44.929 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-07-14T15:35:44.930 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-07-14T15:35:44.930 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-07-14T15:35:44.930 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-07-14T15:35:44.930 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-07-14T15:35:44.930 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kernel 2023-07-14T15:35:44.930 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kernel/cpu 2023-07-14T15:35:44.930 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kernel/cpu/mce 2023-07-14T15:35:44.930 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-07-14T15:35:44.931 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kvm 2023-07-14T15:35:44.931 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kvm/kvm-amd.ko 2023-07-14T15:35:44.931 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kvm/kvm-intel.ko 2023-07-14T15:35:44.931 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kvm/kvm.ko 2023-07-14T15:35:44.931 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto 2023-07-14T15:35:44.931 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/ansi_cprng.ko 2023-07-14T15:35:44.931 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/anubis.ko 2023-07-14T15:35:44.931 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/arc4.ko 2023-07-14T15:35:44.932 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx 2023-07-14T15:35:44.932 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_memcpy.ko 2023-07-14T15:35:44.932 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_pq.ko 2023-07-14T15:35:44.932 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_raid6_recov.ko 2023-07-14T15:35:44.932 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_tx.ko 2023-07-14T15:35:44.932 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_xor.ko 2023-07-14T15:35:44.932 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/raid6test.ko 2023-07-14T15:35:44.932 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/authenc.ko 2023-07-14T15:35:44.933 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/authencesn.ko 2023-07-14T15:35:44.933 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/blake2b_generic.ko 2023-07-14T15:35:44.933 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/blowfish_common.ko 2023-07-14T15:35:44.933 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/blowfish_generic.ko 2023-07-14T15:35:44.933 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/camellia_generic.ko 2023-07-14T15:35:44.933 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cast5_generic.ko 2023-07-14T15:35:44.933 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cast6_generic.ko 2023-07-14T15:35:44.934 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cast_common.ko 2023-07-14T15:35:44.934 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/ccm.ko 2023-07-14T15:35:44.934 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cmac.ko 2023-07-14T15:35:44.934 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/crc32_generic.ko 2023-07-14T15:35:44.934 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/crypto_engine.ko 2023-07-14T15:35:44.934 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/crypto_user.ko 2023-07-14T15:35:44.934 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cts.ko 2023-07-14T15:35:44.934 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/des_generic.ko 2023-07-14T15:35:44.935 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/dh_generic.ko 2023-07-14T15:35:44.935 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/echainiv.ko 2023-07-14T15:35:44.935 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/essiv.ko 2023-07-14T15:35:44.935 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/fcrypt.ko 2023-07-14T15:35:44.935 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/khazad.ko 2023-07-14T15:35:44.935 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/lz4.ko 2023-07-14T15:35:44.935 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/lz4hc.ko 2023-07-14T15:35:44.935 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/md4.ko 2023-07-14T15:35:44.936 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/michael_mic.ko 2023-07-14T15:35:44.936 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/pcbc.ko 2023-07-14T15:35:44.936 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/pcrypt.ko 2023-07-14T15:35:44.936 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/rmd160.ko 2023-07-14T15:35:44.936 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/seed.ko 2023-07-14T15:35:44.936 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/serpent_generic.ko 2023-07-14T15:35:44.936 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/tcrypt.ko 2023-07-14T15:35:44.936 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/tea.ko 2023-07-14T15:35:44.937 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/twofish_common.ko 2023-07-14T15:35:44.937 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/twofish_generic.ko 2023-07-14T15:35:44.937 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/vmac.ko 2023-07-14T15:35:44.937 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/wp512.ko 2023-07-14T15:35:44.937 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/xcbc.ko 2023-07-14T15:35:44.937 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/xor.ko 2023-07-14T15:35:44.937 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/xxhash_generic.ko 2023-07-14T15:35:44.937 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers 2023-07-14T15:35:44.938 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi 2023-07-14T15:35:44.938 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/acpi_ipmi.ko 2023-07-14T15:35:44.938 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/acpi_pad.ko 2023-07-14T15:35:44.938 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/custom_method.ko 2023-07-14T15:35:44.938 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/ec_sys.ko 2023-07-14T15:35:44.938 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/platform_profile.ko 2023-07-14T15:35:44.938 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/sbs.ko 2023-07-14T15:35:44.938 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/sbshc.ko 2023-07-14T15:35:44.939 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/video.ko 2023-07-14T15:35:44.939 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata 2023-07-14T15:35:44.939 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/acard-ahci.ko 2023-07-14T15:35:44.939 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/ahci_platform.ko 2023-07-14T15:35:44.939 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/ata_generic.ko 2023-07-14T15:35:44.939 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/libahci_platform.ko 2023-07-14T15:35:44.939 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_acpi.ko 2023-07-14T15:35:44.939 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_ali.ko 2023-07-14T15:35:44.940 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_amd.ko 2023-07-14T15:35:44.940 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_artop.ko 2023-07-14T15:35:44.940 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_atiixp.ko 2023-07-14T15:35:44.940 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_atp867x.ko 2023-07-14T15:35:44.940 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_cmd640.ko 2023-07-14T15:35:44.940 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_cmd64x.ko 2023-07-14T15:35:44.940 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_cypress.ko 2023-07-14T15:35:44.941 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_efar.ko 2023-07-14T15:35:44.941 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_hpt366.ko 2023-07-14T15:35:44.941 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_hpt37x.ko 2023-07-14T15:35:44.941 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_hpt3x2n.ko 2023-07-14T15:35:44.941 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_hpt3x3.ko 2023-07-14T15:35:44.941 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_it8213.ko 2023-07-14T15:35:44.941 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_it821x.ko 2023-07-14T15:35:44.941 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_jmicron.ko 2023-07-14T15:35:44.942 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_marvell.ko 2023-07-14T15:35:44.942 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_mpiix.ko 2023-07-14T15:35:44.942 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_netcell.ko 2023-07-14T15:35:44.942 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_ninja32.ko 2023-07-14T15:35:44.942 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_ns87410.ko 2023-07-14T15:35:44.942 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_ns87415.ko 2023-07-14T15:35:44.942 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_oldpiix.ko 2023-07-14T15:35:44.942 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_opti.ko 2023-07-14T15:35:44.943 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_optidma.ko 2023-07-14T15:35:44.943 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_pcmcia.ko 2023-07-14T15:35:44.943 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_pdc2027x.ko 2023-07-14T15:35:44.943 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-07-14T15:35:44.943 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_piccolo.ko 2023-07-14T15:35:44.943 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_rdc.ko 2023-07-14T15:35:44.943 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_sch.ko 2023-07-14T15:35:44.943 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_serverworks.ko 2023-07-14T15:35:44.944 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_sil680.ko 2023-07-14T15:35:44.944 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_sis.ko 2023-07-14T15:35:44.944 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_sl82c105.ko 2023-07-14T15:35:44.944 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_triflex.ko 2023-07-14T15:35:44.944 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_via.ko 2023-07-14T15:35:44.944 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pdc_adma.ko 2023-07-14T15:35:44.944 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_inic162x.ko 2023-07-14T15:35:44.945 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_mv.ko 2023-07-14T15:35:44.945 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_nv.ko 2023-07-14T15:35:44.945 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_promise.ko 2023-07-14T15:35:44.945 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_qstor.ko 2023-07-14T15:35:44.945 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_sil.ko 2023-07-14T15:35:44.945 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_sil24.ko 2023-07-14T15:35:44.945 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_sis.ko 2023-07-14T15:35:44.945 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_svw.ko 2023-07-14T15:35:44.946 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_sx4.ko 2023-07-14T15:35:44.946 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_uli.ko 2023-07-14T15:35:44.946 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_via.ko 2023-07-14T15:35:44.946 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_vsc.ko 2023-07-14T15:35:44.946 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/auxdisplay 2023-07-14T15:35:44.946 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/auxdisplay/ks0108.ko 2023-07-14T15:35:44.946 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/base 2023-07-14T15:35:44.946 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/base/regmap 2023-07-14T15:35:44.947 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/base/regmap/regmap-i2c.ko 2023-07-14T15:35:44.947 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/base/regmap/regmap-mmio.ko 2023-07-14T15:35:44.947 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/bcma 2023-07-14T15:35:44.947 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/bcma/bcma.ko 2023-07-14T15:35:44.947 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block 2023-07-14T15:35:44.947 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/aoe 2023-07-14T15:35:44.947 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/aoe/aoe.ko 2023-07-14T15:35:44.947 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/brd.ko 2023-07-14T15:35:44.948 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/drbd 2023-07-14T15:35:44.948 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/drbd/drbd.ko 2023-07-14T15:35:44.948 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/floppy.ko 2023-07-14T15:35:44.948 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/loop.ko 2023-07-14T15:35:44.948 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/mtip32xx 2023-07-14T15:35:44.948 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-07-14T15:35:44.948 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/nbd.ko 2023-07-14T15:35:44.948 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/null_blk 2023-07-14T15:35:44.949 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/null_blk/null_blk.ko 2023-07-14T15:35:44.949 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/pktcdvd.ko 2023-07-14T15:35:44.949 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/rbd.ko 2023-07-14T15:35:44.949 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/virtio_blk.ko 2023-07-14T15:35:44.949 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/xen-blkback 2023-07-14T15:35:44.949 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-07-14T15:35:44.949 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/xen-blkfront.ko 2023-07-14T15:35:44.949 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/zram 2023-07-14T15:35:44.950 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/zram/zram.ko 2023-07-14T15:35:44.950 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char 2023-07-14T15:35:44.950 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hangcheck-timer.ko 2023-07-14T15:35:44.950 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random 2023-07-14T15:35:44.950 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/amd-rng.ko 2023-07-14T15:35:44.950 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/intel-rng.ko 2023-07-14T15:35:44.950 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-07-14T15:35:44.950 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/via-rng.ko 2023-07-14T15:35:44.951 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/virtio-rng.ko 2023-07-14T15:35:44.951 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi 2023-07-14T15:35:44.951 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-07-14T15:35:44.951 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-07-14T15:35:44.951 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-07-14T15:35:44.951 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_si.ko 2023-07-14T15:35:44.951 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-07-14T15:35:44.951 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-07-14T15:35:44.952 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/lp.ko 2023-07-14T15:35:44.952 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/mwave 2023-07-14T15:35:44.952 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/mwave/mwave.ko 2023-07-14T15:35:44.952 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ppdev.ko 2023-07-14T15:35:44.952 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tlclk.ko 2023-07-14T15:35:44.952 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm 2023-07-14T15:35:44.952 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm.ko 2023-07-14T15:35:44.952 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_atmel.ko 2023-07-14T15:35:44.953 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_infineon.ko 2023-07-14T15:35:44.953 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_nsc.ko 2023-07-14T15:35:44.953 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_tis.ko 2023-07-14T15:35:44.953 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-07-14T15:35:44.953 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/uv_mmtimer.ko 2023-07-14T15:35:44.953 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/virtio_console.ko 2023-07-14T15:35:44.953 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq 2023-07-14T15:35:44.954 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-07-14T15:35:44.954 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-07-14T15:35:44.954 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/p4-clockmod.ko 2023-07-14T15:35:44.954 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-07-14T15:35:44.954 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/powernow-k8.ko 2023-07-14T15:35:44.954 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/speedstep-lib.ko 2023-07-14T15:35:44.954 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto 2023-07-14T15:35:44.954 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/ccp 2023-07-14T15:35:44.955 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-07-14T15:35:44.955 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/ccp/ccp.ko 2023-07-14T15:35:44.955 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel 2023-07-14T15:35:44.955 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat 2023-07-14T15:35:44.955 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat/qat_common 2023-07-14T15:35:44.955 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-07-14T15:35:44.955 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-07-14T15:35:44.955 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-07-14T15:35:44.956 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/padlock-aes.ko 2023-07-14T15:35:44.956 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/padlock-sha.ko 2023-07-14T15:35:44.956 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/virtio 2023-07-14T15:35:44.956 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-07-14T15:35:44.956 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dca 2023-07-14T15:35:44.956 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dca/dca.ko 2023-07-14T15:35:44.956 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/devfreq 2023-07-14T15:35:44.956 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-07-14T15:35:44.957 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma 2023-07-14T15:35:44.957 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma/dw 2023-07-14T15:35:44.957 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma/dw/dw_dmac.ko 2023-07-14T15:35:44.957 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma/ioat 2023-07-14T15:35:44.957 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma/ioat/ioatdma.ko 2023-07-14T15:35:44.957 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac 2023-07-14T15:35:44.957 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/amd64_edac.ko 2023-07-14T15:35:44.957 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/e752x_edac.ko 2023-07-14T15:35:44.958 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/edac_mce_amd.ko 2023-07-14T15:35:44.958 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i3000_edac.ko 2023-07-14T15:35:44.958 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i3200_edac.ko 2023-07-14T15:35:44.958 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i5100_edac.ko 2023-07-14T15:35:44.958 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i5400_edac.ko 2023-07-14T15:35:44.958 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i7300_edac.ko 2023-07-14T15:35:44.958 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i7core_edac.ko 2023-07-14T15:35:44.958 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i82975x_edac.ko 2023-07-14T15:35:44.959 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/ie31200_edac.ko 2023-07-14T15:35:44.959 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/sb_edac.ko 2023-07-14T15:35:44.959 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/x38_edac.ko 2023-07-14T15:35:44.959 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/firmware 2023-07-14T15:35:44.959 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/firmware/edd.ko 2023-07-14T15:35:44.959 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/firmware/iscsi_ibft.ko 2023-07-14T15:35:44.959 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio 2023-07-14T15:35:44.959 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-ich.ko 2023-07-14T15:35:44.960 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-viperboard.ko 2023-07-14T15:35:44.960 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid 2023-07-14T15:35:44.960 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-appleir.ko 2023-07-14T15:35:44.960 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-aureal.ko 2023-07-14T15:35:44.960 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-axff.ko 2023-07-14T15:35:44.960 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-dr.ko 2023-07-14T15:35:44.960 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-elecom.ko 2023-07-14T15:35:44.961 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-elo.ko 2023-07-14T15:35:44.961 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-emsff.ko 2023-07-14T15:35:44.961 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-gaff.ko 2023-07-14T15:35:44.961 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-gt683r.ko 2023-07-14T15:35:44.961 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-gyration.ko 2023-07-14T15:35:44.961 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-holtek-kbd.ko 2023-07-14T15:35:44.961 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-holtek-mouse.ko 2023-07-14T15:35:44.961 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-holtekff.ko 2023-07-14T15:35:44.962 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-hyperv.ko 2023-07-14T15:35:44.962 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-icade.ko 2023-07-14T15:35:44.962 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-keytouch.ko 2023-07-14T15:35:44.962 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-kye.ko 2023-07-14T15:35:44.962 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-lcpower.ko 2023-07-14T15:35:44.962 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-led.ko 2023-07-14T15:35:44.962 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-lenovo.ko 2023-07-14T15:35:44.962 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-logitech-dj.ko 2023-07-14T15:35:44.963 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-07-14T15:35:44.963 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-multitouch.ko 2023-07-14T15:35:44.963 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-ortek.ko 2023-07-14T15:35:44.963 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-penmount.ko 2023-07-14T15:35:44.963 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-petalynx.ko 2023-07-14T15:35:44.963 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-picolcd.ko 2023-07-14T15:35:44.963 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-pl.ko 2023-07-14T15:35:44.963 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-plantronics.ko 2023-07-14T15:35:44.964 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-primax.ko 2023-07-14T15:35:44.964 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-rmi.ko 2023-07-14T15:35:44.964 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-arvo.ko 2023-07-14T15:35:44.964 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-common.ko 2023-07-14T15:35:44.964 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-isku.ko 2023-07-14T15:35:44.964 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-kone.ko 2023-07-14T15:35:44.964 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-07-14T15:35:44.964 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-konepure.ko 2023-07-14T15:35:44.965 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-07-14T15:35:44.965 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-lua.ko 2023-07-14T15:35:44.965 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-pyra.ko 2023-07-14T15:35:44.965 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-ryos.ko 2023-07-14T15:35:44.965 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-savu.ko 2023-07-14T15:35:44.965 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat.ko 2023-07-14T15:35:44.965 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-saitek.ko 2023-07-14T15:35:44.965 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-samsung.ko 2023-07-14T15:35:44.966 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-sensor-hub.ko 2023-07-14T15:35:44.966 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-sjoy.ko 2023-07-14T15:35:44.966 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-sony.ko 2023-07-14T15:35:44.966 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-speedlink.ko 2023-07-14T15:35:44.966 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-steelseries.ko 2023-07-14T15:35:44.966 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-sunplus.ko 2023-07-14T15:35:44.966 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-thrustmaster.ko 2023-07-14T15:35:44.966 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-tivo.ko 2023-07-14T15:35:44.967 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-tmff.ko 2023-07-14T15:35:44.967 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-topseed.ko 2023-07-14T15:35:44.967 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-twinhan.ko 2023-07-14T15:35:44.967 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-uclogic.ko 2023-07-14T15:35:44.967 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-waltop.ko 2023-07-14T15:35:44.967 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-wiimote.ko 2023-07-14T15:35:44.967 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-xinmo.ko 2023-07-14T15:35:44.967 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-zpff.ko 2023-07-14T15:35:44.968 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-zydacron.ko 2023-07-14T15:35:44.968 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/uhid.ko 2023-07-14T15:35:44.968 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/wacom.ko 2023-07-14T15:35:44.968 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hv 2023-07-14T15:35:44.968 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hv/hv_balloon.ko 2023-07-14T15:35:44.968 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hv/hv_utils.ko 2023-07-14T15:35:44.968 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hv/hv_vmbus.ko 2023-07-14T15:35:44.968 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon 2023-07-14T15:35:44.969 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/abituguru.ko 2023-07-14T15:35:44.969 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/abituguru3.ko 2023-07-14T15:35:44.969 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/acpi_power_meter.ko 2023-07-14T15:35:44.969 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ad7414.ko 2023-07-14T15:35:44.969 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ad7418.ko 2023-07-14T15:35:44.969 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adc128d818.ko 2023-07-14T15:35:44.969 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm1025.ko 2023-07-14T15:35:44.969 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm1026.ko 2023-07-14T15:35:44.970 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm1029.ko 2023-07-14T15:35:44.970 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm1031.ko 2023-07-14T15:35:44.970 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm9240.ko 2023-07-14T15:35:44.970 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ads7828.ko 2023-07-14T15:35:44.970 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7410.ko 2023-07-14T15:35:44.970 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7411.ko 2023-07-14T15:35:44.970 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7462.ko 2023-07-14T15:35:44.970 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7470.ko 2023-07-14T15:35:44.971 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7475.ko 2023-07-14T15:35:44.971 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7x10.ko 2023-07-14T15:35:44.971 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/amc6821.ko 2023-07-14T15:35:44.971 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/applesmc.ko 2023-07-14T15:35:44.971 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/asb100.ko 2023-07-14T15:35:44.971 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/asc7621.ko 2023-07-14T15:35:44.971 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/asus_atk0110.ko 2023-07-14T15:35:44.972 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/atxp1.ko 2023-07-14T15:35:44.972 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/coretemp.ko 2023-07-14T15:35:44.972 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-07-14T15:35:44.972 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/dme1737.ko 2023-07-14T15:35:44.972 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ds1621.ko 2023-07-14T15:35:44.972 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ds620.ko 2023-07-14T15:35:44.972 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/emc1403.ko 2023-07-14T15:35:44.972 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/emc6w201.ko 2023-07-14T15:35:44.973 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/f71805f.ko 2023-07-14T15:35:44.973 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/f71882fg.ko 2023-07-14T15:35:44.973 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/f75375s.ko 2023-07-14T15:35:44.973 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/fam15h_power.ko 2023-07-14T15:35:44.973 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/fschmd.ko 2023-07-14T15:35:44.973 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/g760a.ko 2023-07-14T15:35:44.973 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/g762.ko 2023-07-14T15:35:44.973 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/gl518sm.ko 2023-07-14T15:35:44.974 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/gl520sm.ko 2023-07-14T15:35:44.974 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/hwmon-vid.ko 2023-07-14T15:35:44.974 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/i5500_temp.ko 2023-07-14T15:35:44.974 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/i5k_amb.ko 2023-07-14T15:35:44.974 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ibmaem.ko 2023-07-14T15:35:44.974 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ibmpex.ko 2023-07-14T15:35:44.974 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ina209.ko 2023-07-14T15:35:44.974 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ina2xx.ko 2023-07-14T15:35:44.975 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/it87.ko 2023-07-14T15:35:44.975 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/k10temp.ko 2023-07-14T15:35:44.975 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/k8temp.ko 2023-07-14T15:35:44.975 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lineage-pem.ko 2023-07-14T15:35:44.975 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm63.ko 2023-07-14T15:35:44.975 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm73.ko 2023-07-14T15:35:44.975 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm75.ko 2023-07-14T15:35:44.975 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm77.ko 2023-07-14T15:35:44.976 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm78.ko 2023-07-14T15:35:44.976 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm80.ko 2023-07-14T15:35:44.976 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm83.ko 2023-07-14T15:35:44.976 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm85.ko 2023-07-14T15:35:44.976 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm87.ko 2023-07-14T15:35:44.976 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm90.ko 2023-07-14T15:35:44.976 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm92.ko 2023-07-14T15:35:44.976 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm93.ko 2023-07-14T15:35:44.977 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm95234.ko 2023-07-14T15:35:44.977 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm95241.ko 2023-07-14T15:35:44.977 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm95245.ko 2023-07-14T15:35:44.977 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc2945.ko 2023-07-14T15:35:44.977 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4151.ko 2023-07-14T15:35:44.977 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4215.ko 2023-07-14T15:35:44.977 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4222.ko 2023-07-14T15:35:44.977 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4245.ko 2023-07-14T15:35:44.978 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4260.ko 2023-07-14T15:35:44.978 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4261.ko 2023-07-14T15:35:44.978 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max16065.ko 2023-07-14T15:35:44.978 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max1619.ko 2023-07-14T15:35:44.978 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max1668.ko 2023-07-14T15:35:44.978 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max197.ko 2023-07-14T15:35:44.978 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max6639.ko 2023-07-14T15:35:44.978 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max6650.ko 2023-07-14T15:35:44.979 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max6697.ko 2023-07-14T15:35:44.979 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/mcp3021.ko 2023-07-14T15:35:44.979 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/nct6683.ko 2023-07-14T15:35:44.979 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/nct6775-core.ko 2023-07-14T15:35:44.979 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/nct6775.ko 2023-07-14T15:35:44.979 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/nct7802.ko 2023-07-14T15:35:44.979 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pc87360.ko 2023-07-14T15:35:44.979 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pc87427.ko 2023-07-14T15:35:44.980 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pcf8591.ko 2023-07-14T15:35:44.980 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus 2023-07-14T15:35:44.980 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-07-14T15:35:44.980 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-07-14T15:35:44.980 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-07-14T15:35:44.980 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/max16064.ko 2023-07-14T15:35:44.980 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/max34440.ko 2023-07-14T15:35:44.981 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/max8688.ko 2023-07-14T15:35:44.981 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-07-14T15:35:44.981 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-07-14T15:35:44.981 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-07-14T15:35:44.981 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-07-14T15:35:44.981 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-07-14T15:35:44.981 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-07-14T15:35:44.981 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/powr1220.ko 2023-07-14T15:35:44.982 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sch5627.ko 2023-07-14T15:35:44.982 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sch5636.ko 2023-07-14T15:35:44.982 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sch56xx-common.ko 2023-07-14T15:35:44.982 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sht15.ko 2023-07-14T15:35:44.982 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sht21.ko 2023-07-14T15:35:44.982 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/shtc1.ko 2023-07-14T15:35:44.982 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sis5595.ko 2023-07-14T15:35:44.982 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/smsc47b397.ko 2023-07-14T15:35:44.983 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/smsc47m1.ko 2023-07-14T15:35:44.983 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/smsc47m192.ko 2023-07-14T15:35:44.983 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/thmc50.ko 2023-07-14T15:35:44.983 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/tmp102.ko 2023-07-14T15:35:44.983 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/tmp103.ko 2023-07-14T15:35:44.983 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/tmp401.ko 2023-07-14T15:35:44.983 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/tmp421.ko 2023-07-14T15:35:44.983 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/via-cputemp.ko 2023-07-14T15:35:44.984 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/via686a.ko 2023-07-14T15:35:44.984 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/vt1211.ko 2023-07-14T15:35:44.984 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/vt8231.ko 2023-07-14T15:35:44.984 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83627ehf.ko 2023-07-14T15:35:44.984 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83627hf.ko 2023-07-14T15:35:44.984 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83781d.ko 2023-07-14T15:35:44.984 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83791d.ko 2023-07-14T15:35:44.984 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83792d.ko 2023-07-14T15:35:44.985 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83793.ko 2023-07-14T15:35:44.985 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83795.ko 2023-07-14T15:35:44.985 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83l785ts.ko 2023-07-14T15:35:44.985 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83l786ng.ko 2023-07-14T15:35:44.985 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c 2023-07-14T15:35:44.985 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/algos 2023-07-14T15:35:44.985 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-07-14T15:35:44.985 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-07-14T15:35:44.986 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses 2023-07-14T15:35:44.986 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-07-14T15:35:44.986 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-07-14T15:35:44.986 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-07-14T15:35:44.986 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-07-14T15:35:44.986 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-07-14T15:35:44.986 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-07-14T15:35:44.986 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-07-14T15:35:44.987 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-07-14T15:35:44.987 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-i801.ko 2023-07-14T15:35:44.987 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-isch.ko 2023-07-14T15:35:44.987 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-07-14T15:35:44.987 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-07-14T15:35:44.987 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-07-14T15:35:44.987 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-parport.ko 2023-07-14T15:35:44.988 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-07-14T15:35:44.988 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-07-14T15:35:44.988 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-07-14T15:35:44.988 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-07-14T15:35:44.988 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-07-14T15:35:44.988 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-07-14T15:35:44.988 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-via.ko 2023-07-14T15:35:44.988 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-07-14T15:35:44.989 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-07-14T15:35:44.989 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/i2c-dev.ko 2023-07-14T15:35:44.989 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/i2c-mux.ko 2023-07-14T15:35:44.989 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-07-14T15:35:44.989 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/i2c-smbus.ko 2023-07-14T15:35:44.989 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/i2c-stub.ko 2023-07-14T15:35:44.989 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband 2023-07-14T15:35:44.990 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core 2023-07-14T15:35:44.990 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/ib_cm.ko 2023-07-14T15:35:44.990 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/ib_core.ko 2023-07-14T15:35:44.990 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/ib_umad.ko 2023-07-14T15:35:44.990 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-07-14T15:35:44.990 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/iw_cm.ko 2023-07-14T15:35:44.990 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/rdma_cm.ko 2023-07-14T15:35:44.990 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-07-14T15:35:44.991 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw 2023-07-14T15:35:44.991 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/cxgb4 2023-07-14T15:35:44.991 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-07-14T15:35:44.991 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mlx4 2023-07-14T15:35:44.991 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-07-14T15:35:44.991 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mlx5 2023-07-14T15:35:44.991 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-07-14T15:35:44.991 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mthca 2023-07-14T15:35:44.992 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-07-14T15:35:44.992 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp 2023-07-14T15:35:44.992 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/ipoib 2023-07-14T15:35:44.992 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-07-14T15:35:44.992 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/iser 2023-07-14T15:35:44.992 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-07-14T15:35:44.992 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/isert 2023-07-14T15:35:44.992 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-07-14T15:35:44.993 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/srp 2023-07-14T15:35:44.993 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-07-14T15:35:44.993 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/srpt 2023-07-14T15:35:44.993 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-07-14T15:35:44.993 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input 2023-07-14T15:35:44.993 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport 2023-07-14T15:35:44.993 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-07-14T15:35:44.993 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/fm801-gp.ko 2023-07-14T15:35:44.994 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/gameport.ko 2023-07-14T15:35:44.994 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/lightning.ko 2023-07-14T15:35:44.994 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/ns558.ko 2023-07-14T15:35:44.994 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/joydev.ko 2023-07-14T15:35:44.994 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard 2023-07-14T15:35:44.994 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/gpio_keys.ko 2023-07-14T15:35:44.994 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse 2023-07-14T15:35:44.994 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/appletouch.ko 2023-07-14T15:35:44.995 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/bcm5974.ko 2023-07-14T15:35:44.995 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/cyapatp.ko 2023-07-14T15:35:44.995 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/elan_i2c.ko 2023-07-14T15:35:44.995 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/sermouse.ko 2023-07-14T15:35:44.995 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-07-14T15:35:44.995 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/synaptics_usb.ko 2023-07-14T15:35:44.995 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/vsxxxaa.ko 2023-07-14T15:35:44.995 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/rmi4 2023-07-14T15:35:44.996 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/rmi4/rmi_core.ko 2023-07-14T15:35:44.996 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio 2023-07-14T15:35:44.996 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/altera_ps2.ko 2023-07-14T15:35:44.996 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/arc_ps2.ko 2023-07-14T15:35:44.996 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-07-14T15:35:44.996 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/serio_raw.ko 2023-07-14T15:35:44.996 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/sparse-keymap.ko 2023-07-14T15:35:44.997 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/iommu 2023-07-14T15:35:44.997 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/iommu/amd 2023-07-14T15:35:44.997 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/iommu/amd/iommu_v2.ko 2023-07-14T15:35:44.997 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds 2023-07-14T15:35:44.997 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-blinkm.ko 2023-07-14T15:35:44.997 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-lm3530.ko 2023-07-14T15:35:44.997 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-lp3944.ko 2023-07-14T15:35:44.997 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-ss4200.ko 2023-07-14T15:35:44.998 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger 2023-07-14T15:35:44.998 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-07-14T15:35:44.998 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-07-14T15:35:44.998 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-07-14T15:35:44.998 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-07-14T15:35:44.998 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-07-14T15:35:44.998 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-07-14T15:35:44.998 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-07-14T15:35:44.999 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-07-14T15:35:44.999 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md 2023-07-14T15:35:44.999 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/bcache 2023-07-14T15:35:44.999 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/bcache/bcache.ko 2023-07-14T15:35:44.999 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-bio-prison.ko 2023-07-14T15:35:44.999 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-cache-smq.ko 2023-07-14T15:35:44.999 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-cache.ko 2023-07-14T15:35:44.999 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-crypt.ko 2023-07-14T15:35:45.000 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-delay.ko 2023-07-14T15:35:45.000 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-flakey.ko 2023-07-14T15:35:45.000 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-log-userspace.ko 2023-07-14T15:35:45.000 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-multipath.ko 2023-07-14T15:35:45.000 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-queue-length.ko 2023-07-14T15:35:45.000 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-raid.ko 2023-07-14T15:35:45.000 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-round-robin.ko 2023-07-14T15:35:45.000 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-service-time.ko 2023-07-14T15:35:45.001 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-switch.ko 2023-07-14T15:35:45.001 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-thin-pool.ko 2023-07-14T15:35:45.001 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-verity.ko 2023-07-14T15:35:45.001 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/faulty.ko 2023-07-14T15:35:45.001 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/linear.ko 2023-07-14T15:35:45.001 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/multipath.ko 2023-07-14T15:35:45.001 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/persistent-data 2023-07-14T15:35:45.001 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-07-14T15:35:45.002 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/raid0.ko 2023-07-14T15:35:45.002 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/raid1.ko 2023-07-14T15:35:45.002 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/raid10.ko 2023-07-14T15:35:45.002 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/raid456.ko 2023-07-14T15:35:45.002 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message 2023-07-14T15:35:45.002 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion 2023-07-14T15:35:45.002 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptbase.ko 2023-07-14T15:35:45.002 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptctl.ko 2023-07-14T15:35:45.003 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptfc.ko 2023-07-14T15:35:45.003 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptlan.ko 2023-07-14T15:35:45.003 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptsas.ko 2023-07-14T15:35:45.003 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptscsih.ko 2023-07-14T15:35:45.003 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptspi.ko 2023-07-14T15:35:45.003 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd 2023-07-14T15:35:45.003 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/lpc_ich.ko 2023-07-14T15:35:45.003 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/lpc_sch.ko 2023-07-14T15:35:45.004 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/mfd-core.ko 2023-07-14T15:35:45.004 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/sm501.ko 2023-07-14T15:35:45.004 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/viperboard.ko 2023-07-14T15:35:45.004 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/vx855.ko 2023-07-14T15:35:45.004 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/wl1273-core.ko 2023-07-14T15:35:45.004 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc 2023-07-14T15:35:45.004 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/altera-stapl 2023-07-14T15:35:45.005 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-07-14T15:35:45.005 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/apds9802als.ko 2023-07-14T15:35:45.005 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/apds990x.ko 2023-07-14T15:35:45.005 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/bh1770glc.ko 2023-07-14T15:35:45.005 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/cb710 2023-07-14T15:35:45.005 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/cb710/cb710.ko 2023-07-14T15:35:45.005 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom 2023-07-14T15:35:45.005 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom/at24.ko 2023-07-14T15:35:45.006 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom/eeprom.ko 2023-07-14T15:35:45.006 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-07-14T15:35:45.006 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom/max6875.ko 2023-07-14T15:35:45.006 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/enclosure.ko 2023-07-14T15:35:45.006 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/hpilo.ko 2023-07-14T15:35:45.006 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/isl29003.ko 2023-07-14T15:35:45.006 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/isl29020.ko 2023-07-14T15:35:45.006 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/lis3lv02d 2023-07-14T15:35:45.007 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-07-14T15:35:45.007 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-07-14T15:35:45.007 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/mei 2023-07-14T15:35:45.007 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/mei/mei-me.ko 2023-07-14T15:35:45.007 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/mei/mei-txe.ko 2023-07-14T15:35:45.007 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/mei/mei.ko 2023-07-14T15:35:45.007 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/sgi-gru 2023-07-14T15:35:45.007 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/sgi-gru/gru.ko 2023-07-14T15:35:45.008 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/sgi-xp 2023-07-14T15:35:45.008 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/sgi-xp/xp.ko 2023-07-14T15:35:45.008 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/sgi-xp/xpc.ko 2023-07-14T15:35:45.008 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-07-14T15:35:45.008 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/tifm_7xx1.ko 2023-07-14T15:35:45.008 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/tifm_core.ko 2023-07-14T15:35:45.008 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/tsl2550.ko 2023-07-14T15:35:45.008 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/vmw_balloon.ko 2023-07-14T15:35:45.009 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/vmw_vmci 2023-07-14T15:35:45.009 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-07-14T15:35:45.009 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net 2023-07-14T15:35:45.009 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/bonding 2023-07-14T15:35:45.009 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/bonding/bonding.ko 2023-07-14T15:35:45.009 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa 2023-07-14T15:35:45.009 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/b53 2023-07-14T15:35:45.009 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/b53/b53_common.ko 2023-07-14T15:35:45.010 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/bcm-sf2.ko 2023-07-14T15:35:45.010 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/mv88e6060.ko 2023-07-14T15:35:45.010 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/mv88e6xxx 2023-07-14T15:35:45.010 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-07-14T15:35:45.010 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dummy.ko 2023-07-14T15:35:45.010 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/eql.ko 2023-07-14T15:35:45.010 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet 2023-07-14T15:35:45.010 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com 2023-07-14T15:35:45.011 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-07-14T15:35:45.011 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-07-14T15:35:45.011 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-07-14T15:35:45.011 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-07-14T15:35:45.011 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390 2023-07-14T15:35:45.011 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390/8390.ko 2023-07-14T15:35:45.011 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-07-14T15:35:45.011 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-07-14T15:35:45.012 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-07-14T15:35:45.012 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/adaptec 2023-07-14T15:35:45.012 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-07-14T15:35:45.012 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/agere 2023-07-14T15:35:45.012 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/agere/et131x.ko 2023-07-14T15:35:45.012 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/alteon 2023-07-14T15:35:45.012 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-07-14T15:35:45.012 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/altera 2023-07-14T15:35:45.013 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-07-14T15:35:45.013 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/amd 2023-07-14T15:35:45.013 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-07-14T15:35:45.013 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-07-14T15:35:45.013 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-07-14T15:35:45.013 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros 2023-07-14T15:35:45.013 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/alx 2023-07-14T15:35:45.013 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-07-14T15:35:45.014 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atl1c 2023-07-14T15:35:45.014 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-07-14T15:35:45.014 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atl1e 2023-07-14T15:35:45.014 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-07-14T15:35:45.014 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atlx 2023-07-14T15:35:45.014 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-07-14T15:35:45.014 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-07-14T15:35:45.014 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom 2023-07-14T15:35:45.015 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-07-14T15:35:45.015 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-07-14T15:35:45.015 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-07-14T15:35:45.015 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-07-14T15:35:45.015 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-07-14T15:35:45.015 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/genet 2023-07-14T15:35:45.015 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-07-14T15:35:45.015 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-07-14T15:35:45.016 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/brocade 2023-07-14T15:35:45.016 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/brocade/bna 2023-07-14T15:35:45.016 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-07-14T15:35:45.016 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio 2023-07-14T15:35:45.016 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb 2023-07-14T15:35:45.016 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-07-14T15:35:45.016 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-07-14T15:35:45.016 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-07-14T15:35:45.017 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-07-14T15:35:45.017 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-07-14T15:35:45.017 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-07-14T15:35:45.017 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-07-14T15:35:45.017 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-07-14T15:35:45.017 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-07-14T15:35:45.017 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/cisco 2023-07-14T15:35:45.018 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/cisco/enic 2023-07-14T15:35:45.018 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-07-14T15:35:45.018 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec 2023-07-14T15:35:45.018 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip 2023-07-14T15:35:45.018 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-07-14T15:35:45.018 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-07-14T15:35:45.018 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-07-14T15:35:45.018 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-07-14T15:35:45.019 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-07-14T15:35:45.019 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-07-14T15:35:45.019 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dlink 2023-07-14T15:35:45.019 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-07-14T15:35:45.019 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-07-14T15:35:45.019 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dnet.ko 2023-07-14T15:35:45.019 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/emulex 2023-07-14T15:35:45.019 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/emulex/benet 2023-07-14T15:35:45.020 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-07-14T15:35:45.020 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/ethoc.ko 2023-07-14T15:35:45.020 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/fealnx.ko 2023-07-14T15:35:45.020 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel 2023-07-14T15:35:45.020 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e100.ko 2023-07-14T15:35:45.020 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e1000 2023-07-14T15:35:45.020 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-07-14T15:35:45.020 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e1000e 2023-07-14T15:35:45.021 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-07-14T15:35:45.021 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/fm10k 2023-07-14T15:35:45.021 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-07-14T15:35:45.021 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/i40e 2023-07-14T15:35:45.021 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-07-14T15:35:45.021 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/iavf 2023-07-14T15:35:45.021 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-07-14T15:35:45.021 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/igb 2023-07-14T15:35:45.022 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-07-14T15:35:45.022 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/igbvf 2023-07-14T15:35:45.022 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-07-14T15:35:45.022 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/ixgbe 2023-07-14T15:35:45.022 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-07-14T15:35:45.022 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/ixgbevf 2023-07-14T15:35:45.022 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-07-14T15:35:45.022 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/jme.ko 2023-07-14T15:35:45.023 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/marvell 2023-07-14T15:35:45.023 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-07-14T15:35:45.023 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/marvell/skge.ko 2023-07-14T15:35:45.023 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-07-14T15:35:45.023 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox 2023-07-14T15:35:45.023 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx4 2023-07-14T15:35:45.023 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-07-14T15:35:45.023 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-07-14T15:35:45.024 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx5 2023-07-14T15:35:45.024 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-07-14T15:35:45.024 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-07-14T15:35:45.024 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/micrel 2023-07-14T15:35:45.024 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-07-14T15:35:45.024 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/myricom 2023-07-14T15:35:45.024 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/myricom/myri10ge 2023-07-14T15:35:45.025 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-07-14T15:35:45.025 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/natsemi 2023-07-14T15:35:45.025 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-07-14T15:35:45.025 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-07-14T15:35:45.025 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/neterion 2023-07-14T15:35:45.025 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-07-14T15:35:45.025 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/nvidia 2023-07-14T15:35:45.025 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-07-14T15:35:45.026 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/packetengines 2023-07-14T15:35:45.026 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-07-14T15:35:45.026 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-07-14T15:35:45.026 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic 2023-07-14T15:35:45.026 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/netxen 2023-07-14T15:35:45.026 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-07-14T15:35:45.026 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-07-14T15:35:45.026 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-07-14T15:35:45.027 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-07-14T15:35:45.027 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/rdc 2023-07-14T15:35:45.027 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-07-14T15:35:45.027 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek 2023-07-14T15:35:45.027 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-07-14T15:35:45.027 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-07-14T15:35:45.027 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek/atp.ko 2023-07-14T15:35:45.027 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-07-14T15:35:45.028 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/rocker 2023-07-14T15:35:45.028 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-07-14T15:35:45.028 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sfc 2023-07-14T15:35:45.028 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-07-14T15:35:45.028 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/silan 2023-07-14T15:35:45.028 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-07-14T15:35:45.028 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sis 2023-07-14T15:35:45.028 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sis/sis190.ko 2023-07-14T15:35:45.029 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sis/sis900.ko 2023-07-14T15:35:45.029 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc 2023-07-14T15:35:45.029 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-07-14T15:35:45.029 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-07-14T15:35:45.029 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-07-14T15:35:45.029 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-07-14T15:35:45.029 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/stmicro 2023-07-14T15:35:45.029 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/stmicro/stmmac 2023-07-14T15:35:45.030 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-07-14T15:35:45.030 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-07-14T15:35:45.030 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun 2023-07-14T15:35:45.030 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun/cassini.ko 2023-07-14T15:35:45.030 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun/niu.ko 2023-07-14T15:35:45.030 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun/sungem.ko 2023-07-14T15:35:45.030 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-07-14T15:35:45.030 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/tehuti 2023-07-14T15:35:45.031 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-07-14T15:35:45.031 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/ti 2023-07-14T15:35:45.031 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/ti/tlan.ko 2023-07-14T15:35:45.031 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/via 2023-07-14T15:35:45.031 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-07-14T15:35:45.031 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-07-14T15:35:45.031 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/wiznet 2023-07-14T15:35:45.031 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-07-14T15:35:45.032 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-07-14T15:35:45.032 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/xircom 2023-07-14T15:35:45.032 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-07-14T15:35:45.032 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/geneve.ko 2023-07-14T15:35:45.032 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/hyperv 2023-07-14T15:35:45.032 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-07-14T15:35:45.032 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ieee802154 2023-07-14T15:35:45.033 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ieee802154/fakelb.ko 2023-07-14T15:35:45.033 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ifb.ko 2023-07-14T15:35:45.033 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ipvlan 2023-07-14T15:35:45.033 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ipvlan/ipvlan.ko 2023-07-14T15:35:45.033 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/macvlan.ko 2023-07-14T15:35:45.033 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/macvtap.ko 2023-07-14T15:35:45.033 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio 2023-07-14T15:35:45.033 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio.ko 2023-07-14T15:35:45.034 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-07-14T15:35:45.034 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-07-14T15:35:45.034 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio/mdio-regmap.ko 2023-07-14T15:35:45.034 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mii.ko 2023-07-14T15:35:45.034 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/net_failover.ko 2023-07-14T15:35:45.034 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/netconsole.ko 2023-07-14T15:35:45.034 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/nlmon.ko 2023-07-14T15:35:45.034 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/pcs 2023-07-14T15:35:45.035 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/pcs/pcs-lynx.ko 2023-07-14T15:35:45.035 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-07-14T15:35:45.035 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy 2023-07-14T15:35:45.035 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/amd.ko 2023-07-14T15:35:45.035 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-07-14T15:35:45.035 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-07-14T15:35:45.035 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/bcm7xxx.ko 2023-07-14T15:35:45.035 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/bcm87xx.ko 2023-07-14T15:35:45.036 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/broadcom.ko 2023-07-14T15:35:45.036 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/cicada.ko 2023-07-14T15:35:45.036 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/davicom.ko 2023-07-14T15:35:45.036 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/dp83640.ko 2023-07-14T15:35:45.036 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/et1011c.ko 2023-07-14T15:35:45.036 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/icplus.ko 2023-07-14T15:35:45.036 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/lxt.ko 2023-07-14T15:35:45.036 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/marvell.ko 2023-07-14T15:35:45.037 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/micrel.ko 2023-07-14T15:35:45.037 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/national.ko 2023-07-14T15:35:45.037 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/phylink.ko 2023-07-14T15:35:45.037 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/qsemi.ko 2023-07-14T15:35:45.037 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/realtek.ko 2023-07-14T15:35:45.037 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/smsc.ko 2023-07-14T15:35:45.037 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/ste10Xp.ko 2023-07-14T15:35:45.037 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/vitesse.ko 2023-07-14T15:35:45.038 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp 2023-07-14T15:35:45.038 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/bsd_comp.ko 2023-07-14T15:35:45.038 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ppp_async.ko 2023-07-14T15:35:45.038 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ppp_deflate.ko 2023-07-14T15:35:45.038 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ppp_generic.ko 2023-07-14T15:35:45.038 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ppp_mppe.ko 2023-07-14T15:35:45.038 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ppp_synctty.ko 2023-07-14T15:35:45.038 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/pppoe.ko 2023-07-14T15:35:45.039 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/pppox.ko 2023-07-14T15:35:45.039 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/pptp.ko 2023-07-14T15:35:45.039 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/slip 2023-07-14T15:35:45.039 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/slip/slhc.ko 2023-07-14T15:35:45.039 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/slip/slip.ko 2023-07-14T15:35:45.039 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/sungem_phy.ko 2023-07-14T15:35:45.039 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/tap.ko 2023-07-14T15:35:45.040 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team 2023-07-14T15:35:45.040 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team.ko 2023-07-14T15:35:45.040 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_activebackup.ko 2023-07-14T15:35:45.040 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_broadcast.ko 2023-07-14T15:35:45.040 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-07-14T15:35:45.040 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_random.ko 2023-07-14T15:35:45.040 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-07-14T15:35:45.040 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/tun.ko 2023-07-14T15:35:45.041 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/veth.ko 2023-07-14T15:35:45.041 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/virtio_net.ko 2023-07-14T15:35:45.041 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/vmxnet3 2023-07-14T15:35:45.041 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-07-14T15:35:45.041 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/vxlan 2023-07-14T15:35:45.041 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/vxlan/vxlan.ko 2023-07-14T15:35:45.041 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/xen-netback 2023-07-14T15:35:45.041 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/xen-netback/xen-netback.ko 2023-07-14T15:35:45.042 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/xen-netfront.ko 2023-07-14T15:35:45.042 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ntb 2023-07-14T15:35:45.042 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ntb/ntb.ko 2023-07-14T15:35:45.042 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/nvme 2023-07-14T15:35:45.042 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/nvme/host 2023-07-14T15:35:45.042 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/nvme/host/nvme-core.ko 2023-07-14T15:35:45.042 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/nvme/host/nvme.ko 2023-07-14T15:35:45.042 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport 2023-07-14T15:35:45.043 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport/parport.ko 2023-07-14T15:35:45.043 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport/parport_cs.ko 2023-07-14T15:35:45.043 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport/parport_pc.ko 2023-07-14T15:35:45.043 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport/parport_serial.ko 2023-07-14T15:35:45.043 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci 2023-07-14T15:35:45.043 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/hotplug 2023-07-14T15:35:45.043 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-07-14T15:35:45.043 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/pcie 2023-07-14T15:35:45.044 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/pcie/aer_inject.ko 2023-07-14T15:35:45.044 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/xen-pcifront.ko 2023-07-14T15:35:45.044 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pcmcia 2023-07-14T15:35:45.044 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pcmcia/i82092.ko 2023-07-14T15:35:45.044 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pcmcia/pd6729.ko 2023-07-14T15:35:45.044 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pcmcia/yenta_socket.ko 2023-07-14T15:35:45.044 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pinctrl 2023-07-14T15:35:45.044 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pinctrl/intel 2023-07-14T15:35:45.045 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-07-14T15:35:45.045 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform 2023-07-14T15:35:45.045 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86 2023-07-14T15:35:45.045 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/acer-wmi.ko 2023-07-14T15:35:45.045 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/acerhdf.ko 2023-07-14T15:35:45.045 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/apple-gmux.ko 2023-07-14T15:35:45.045 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/asus-laptop.ko 2023-07-14T15:35:45.045 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-07-14T15:35:45.046 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/asus-wmi.ko 2023-07-14T15:35:45.046 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/classmate-laptop.ko 2023-07-14T15:35:45.046 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-07-14T15:35:45.046 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-07-14T15:35:45.046 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-07-14T15:35:45.046 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-07-14T15:35:45.046 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/hdaps.ko 2023-07-14T15:35:45.047 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/intel 2023-07-14T15:35:45.047 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-07-14T15:35:45.047 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/intel_ips.ko 2023-07-14T15:35:45.047 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/msi-wmi.ko 2023-07-14T15:35:45.047 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/mxm-wmi.ko 2023-07-14T15:35:45.047 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-07-14T15:35:45.047 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/samsung-laptop.ko 2023-07-14T15:35:45.047 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/samsung-q10.ko 2023-07-14T15:35:45.048 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/topstar-laptop.ko 2023-07-14T15:35:45.048 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-07-14T15:35:45.048 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/toshiba_haps.ko 2023-07-14T15:35:45.048 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/wmi-bmof.ko 2023-07-14T15:35:45.048 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/wmi.ko 2023-07-14T15:35:45.048 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/powercap 2023-07-14T15:35:45.048 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/powercap/intel_rapl_common.ko 2023-07-14T15:35:45.048 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/powercap/intel_rapl_msr.ko 2023-07-14T15:35:45.049 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps 2023-07-14T15:35:45.049 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/clients 2023-07-14T15:35:45.049 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/clients/pps-gpio.ko 2023-07-14T15:35:45.049 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/clients/pps-ldisc.ko 2023-07-14T15:35:45.049 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/clients/pps_parport.ko 2023-07-14T15:35:45.049 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/pps_core.ko 2023-07-14T15:35:45.049 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ptp 2023-07-14T15:35:45.049 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ptp/ptp.ko 2023-07-14T15:35:45.050 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ptp/ptp_kvm.ko 2023-07-14T15:35:45.050 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc 2023-07-14T15:35:45.050 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-bq32k.ko 2023-07-14T15:35:45.050 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-bq4802.ko 2023-07-14T15:35:45.050 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1286.ko 2023-07-14T15:35:45.050 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1307.ko 2023-07-14T15:35:45.050 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1374.ko 2023-07-14T15:35:45.050 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1511.ko 2023-07-14T15:35:45.051 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1553.ko 2023-07-14T15:35:45.051 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1672.ko 2023-07-14T15:35:45.051 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1742.ko 2023-07-14T15:35:45.051 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds2404.ko 2023-07-14T15:35:45.051 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds3232.ko 2023-07-14T15:35:45.051 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-em3027.ko 2023-07-14T15:35:45.051 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-fm3130.ko 2023-07-14T15:35:45.051 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-isl12022.ko 2023-07-14T15:35:45.052 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-isl1208.ko 2023-07-14T15:35:45.052 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-m41t80.ko 2023-07-14T15:35:45.052 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-m48t35.ko 2023-07-14T15:35:45.052 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-m48t59.ko 2023-07-14T15:35:45.052 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-max6900.ko 2023-07-14T15:35:45.052 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-msm6242.ko 2023-07-14T15:35:45.052 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf2127.ko 2023-07-14T15:35:45.052 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf85063.ko 2023-07-14T15:35:45.053 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf8523.ko 2023-07-14T15:35:45.053 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf8563.ko 2023-07-14T15:35:45.053 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf8583.ko 2023-07-14T15:35:45.053 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rp5c01.ko 2023-07-14T15:35:45.053 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rs5c372.ko 2023-07-14T15:35:45.053 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-07-14T15:35:45.053 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rx8025.ko 2023-07-14T15:35:45.053 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rx8581.ko 2023-07-14T15:35:45.054 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-07-14T15:35:45.054 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-x1205.ko 2023-07-14T15:35:45.054 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi 2023-07-14T15:35:45.054 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/3w-9xxx.ko 2023-07-14T15:35:45.054 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/3w-sas.ko 2023-07-14T15:35:45.054 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/3w-xxxx.ko 2023-07-14T15:35:45.054 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/BusLogic.ko 2023-07-14T15:35:45.054 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/a100u2w.ko 2023-07-14T15:35:45.055 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aacraid 2023-07-14T15:35:45.055 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aacraid/aacraid.ko 2023-07-14T15:35:45.055 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/advansys.ko 2023-07-14T15:35:45.055 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aic7xxx 2023-07-14T15:35:45.055 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-07-14T15:35:45.055 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-07-14T15:35:45.055 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/am53c974.ko 2023-07-14T15:35:45.055 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/arcmsr 2023-07-14T15:35:45.056 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-07-14T15:35:45.056 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/atp870u.ko 2023-07-14T15:35:45.056 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/be2iscsi 2023-07-14T15:35:45.056 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-07-14T15:35:45.056 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bfa 2023-07-14T15:35:45.056 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bfa/bfa.ko 2023-07-14T15:35:45.056 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bnx2fc 2023-07-14T15:35:45.057 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-07-14T15:35:45.057 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bnx2i 2023-07-14T15:35:45.057 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-07-14T15:35:45.057 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/ch.ko 2023-07-14T15:35:45.057 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/csiostor 2023-07-14T15:35:45.057 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/csiostor/csiostor.ko 2023-07-14T15:35:45.057 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi 2023-07-14T15:35:45.057 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/cxgb3i 2023-07-14T15:35:45.058 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-07-14T15:35:45.058 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/cxgb4i 2023-07-14T15:35:45.058 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-07-14T15:35:45.058 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-07-14T15:35:45.058 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/dc395x.ko 2023-07-14T15:35:45.058 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/device_handler 2023-07-14T15:35:45.058 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-07-14T15:35:45.058 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-07-14T15:35:45.059 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-07-14T15:35:45.059 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-07-14T15:35:45.059 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/dmx3191d.ko 2023-07-14T15:35:45.059 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/esas2r 2023-07-14T15:35:45.059 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/esas2r/esas2r.ko 2023-07-14T15:35:45.059 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/esp_scsi.ko 2023-07-14T15:35:45.059 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fcoe 2023-07-14T15:35:45.059 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fcoe/fcoe.ko 2023-07-14T15:35:45.060 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-07-14T15:35:45.060 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fnic 2023-07-14T15:35:45.060 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fnic/fnic.ko 2023-07-14T15:35:45.060 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/hpsa.ko 2023-07-14T15:35:45.060 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/hptiop.ko 2023-07-14T15:35:45.060 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/hv_storvsc.ko 2023-07-14T15:35:45.060 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/initio.ko 2023-07-14T15:35:45.060 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/ipr.ko 2023-07-14T15:35:45.061 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/ips.ko 2023-07-14T15:35:45.061 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/isci 2023-07-14T15:35:45.061 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/isci/isci.ko 2023-07-14T15:35:45.061 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-07-14T15:35:45.061 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/iscsi_tcp.ko 2023-07-14T15:35:45.061 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libfc 2023-07-14T15:35:45.061 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libfc/libfc.ko 2023-07-14T15:35:45.061 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libiscsi.ko 2023-07-14T15:35:45.062 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libiscsi_tcp.ko 2023-07-14T15:35:45.062 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libsas 2023-07-14T15:35:45.062 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libsas/libsas.ko 2023-07-14T15:35:45.062 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/lpfc 2023-07-14T15:35:45.062 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/lpfc/lpfc.ko 2023-07-14T15:35:45.062 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid 2023-07-14T15:35:45.062 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid.ko 2023-07-14T15:35:45.062 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-07-14T15:35:45.063 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-07-14T15:35:45.063 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-07-14T15:35:45.063 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mpt3sas 2023-07-14T15:35:45.063 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-07-14T15:35:45.063 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mvsas 2023-07-14T15:35:45.063 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mvsas/mvsas.ko 2023-07-14T15:35:45.063 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mvumi.ko 2023-07-14T15:35:45.063 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/pm8001 2023-07-14T15:35:45.064 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-07-14T15:35:45.064 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/pmcraid.ko 2023-07-14T15:35:45.064 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla1280.ko 2023-07-14T15:35:45.064 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla2xxx 2023-07-14T15:35:45.064 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-07-14T15:35:45.064 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-07-14T15:35:45.064 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla4xxx 2023-07-14T15:35:45.064 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-07-14T15:35:45.065 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/raid_class.ko 2023-07-14T15:35:45.065 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_debug.ko 2023-07-14T15:35:45.065 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_fc.ko 2023-07-14T15:35:45.065 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-07-14T15:35:45.065 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_sas.ko 2023-07-14T15:35:45.065 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_spi.ko 2023-07-14T15:35:45.065 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_srp.ko 2023-07-14T15:35:45.065 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/ses.ko 2023-07-14T15:35:45.066 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/st.ko 2023-07-14T15:35:45.066 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/stex.ko 2023-07-14T15:35:45.066 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/sym53c8xx_2 2023-07-14T15:35:45.066 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-07-14T15:35:45.066 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/virtio_scsi.ko 2023-07-14T15:35:45.066 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/vmw_pvscsi.ko 2023-07-14T15:35:45.066 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/wd719x.ko 2023-07-14T15:35:45.066 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ssb 2023-07-14T15:35:45.067 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ssb/ssb.ko 2023-07-14T15:35:45.067 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target 2023-07-14T15:35:45.067 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/iscsi 2023-07-14T15:35:45.067 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-07-14T15:35:45.067 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/loopback 2023-07-14T15:35:45.067 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/loopback/tcm_loop.ko 2023-07-14T15:35:45.067 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_file.ko 2023-07-14T15:35:45.067 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_iblock.ko 2023-07-14T15:35:45.068 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_mod.ko 2023-07-14T15:35:45.068 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_pscsi.ko 2023-07-14T15:35:45.068 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_user.ko 2023-07-14T15:35:45.068 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/tcm_fc 2023-07-14T15:35:45.068 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-07-14T15:35:45.068 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal 2023-07-14T15:35:45.068 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel 2023-07-14T15:35:45.069 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal 2023-07-14T15:35:45.069 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-07-14T15:35:45.069 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-07-14T15:35:45.069 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-07-14T15:35:45.069 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-07-14T15:35:45.069 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-07-14T15:35:45.069 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-07-14T15:35:45.069 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-07-14T15:35:45.070 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-07-14T15:35:45.070 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-07-14T15:35:45.070 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-07-14T15:35:45.070 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-07-14T15:35:45.070 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-07-14T15:35:45.070 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-07-14T15:35:45.070 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-07-14T15:35:45.070 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-07-14T15:35:45.071 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty 2023-07-14T15:35:45.071 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/ipwireless 2023-07-14T15:35:45.071 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-07-14T15:35:45.071 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/n_gsm.ko 2023-07-14T15:35:45.071 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/n_hdlc.ko 2023-07-14T15:35:45.071 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/nozomi.ko 2023-07-14T15:35:45.071 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial 2023-07-14T15:35:45.071 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/8250 2023-07-14T15:35:45.072 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-07-14T15:35:45.072 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/arc_uart.ko 2023-07-14T15:35:45.072 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/jsm 2023-07-14T15:35:45.072 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/jsm/jsm.ko 2023-07-14T15:35:45.072 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/synclink_gt.ko 2023-07-14T15:35:45.072 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs 2023-07-14T15:35:45.072 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs/core 2023-07-14T15:35:45.072 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs/core/ufshcd-core.ko 2023-07-14T15:35:45.073 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs/host 2023-07-14T15:35:45.073 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-07-14T15:35:45.073 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio 2023-07-14T15:35:45.073 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio.ko 2023-07-14T15:35:45.073 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio_aec.ko 2023-07-14T15:35:45.073 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio_cif.ko 2023-07-14T15:35:45.073 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio_pci_generic.ko 2023-07-14T15:35:45.073 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio_sercos3.ko 2023-07-14T15:35:45.074 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb 2023-07-14T15:35:45.074 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class 2023-07-14T15:35:45.074 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class/cdc-acm.ko 2023-07-14T15:35:45.074 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class/cdc-wdm.ko 2023-07-14T15:35:45.074 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class/usblp.ko 2023-07-14T15:35:45.074 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class/usbtmc.ko 2023-07-14T15:35:45.074 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/host 2023-07-14T15:35:45.074 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/host/sl811-hcd.ko 2023-07-14T15:35:45.075 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/image 2023-07-14T15:35:45.075 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/image/mdc800.ko 2023-07-14T15:35:45.075 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/image/microtek.ko 2023-07-14T15:35:45.075 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc 2023-07-14T15:35:45.075 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/adutux.ko 2023-07-14T15:35:45.075 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/appledisplay.ko 2023-07-14T15:35:45.075 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/emi26.ko 2023-07-14T15:35:45.075 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/emi62.ko 2023-07-14T15:35:45.076 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/ezusb.ko 2023-07-14T15:35:45.076 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/idmouse.ko 2023-07-14T15:35:45.076 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/iowarrior.ko 2023-07-14T15:35:45.076 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/isight_firmware.ko 2023-07-14T15:35:45.076 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/ldusb.ko 2023-07-14T15:35:45.076 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/legousbtower.ko 2023-07-14T15:35:45.076 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/sisusbvga 2023-07-14T15:35:45.076 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-07-14T15:35:45.077 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/trancevibrator.ko 2023-07-14T15:35:45.077 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/usb3503.ko 2023-07-14T15:35:45.077 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/usblcd.ko 2023-07-14T15:35:45.077 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/usbsevseg.ko 2023-07-14T15:35:45.077 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/uss720.ko 2023-07-14T15:35:45.077 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/yurex.ko 2023-07-14T15:35:45.077 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/phy 2023-07-14T15:35:45.078 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/phy/phy-generic.ko 2023-07-14T15:35:45.078 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial 2023-07-14T15:35:45.078 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/aircable.ko 2023-07-14T15:35:45.078 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ark3116.ko 2023-07-14T15:35:45.078 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/belkin_sa.ko 2023-07-14T15:35:45.078 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ch341.ko 2023-07-14T15:35:45.078 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/cp210x.ko 2023-07-14T15:35:45.078 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/cyberjack.ko 2023-07-14T15:35:45.079 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/cypress_m8.ko 2023-07-14T15:35:45.079 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/digi_acceleport.ko 2023-07-14T15:35:45.079 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/empeg.ko 2023-07-14T15:35:45.079 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ftdi_sio.ko 2023-07-14T15:35:45.079 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/garmin_gps.ko 2023-07-14T15:35:45.079 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/io_edgeport.ko 2023-07-14T15:35:45.079 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/io_ti.ko 2023-07-14T15:35:45.079 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ipaq.ko 2023-07-14T15:35:45.080 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ipw.ko 2023-07-14T15:35:45.080 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ir-usb.ko 2023-07-14T15:35:45.080 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-07-14T15:35:45.080 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/keyspan.ko 2023-07-14T15:35:45.080 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/keyspan_pda.ko 2023-07-14T15:35:45.080 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/kl5kusb105.ko 2023-07-14T15:35:45.080 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/kobil_sct.ko 2023-07-14T15:35:45.080 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/mct_u232.ko 2023-07-14T15:35:45.081 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/mos7720.ko 2023-07-14T15:35:45.081 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/mos7840.ko 2023-07-14T15:35:45.081 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/navman.ko 2023-07-14T15:35:45.081 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/omninet.ko 2023-07-14T15:35:45.081 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/opticon.ko 2023-07-14T15:35:45.081 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/option.ko 2023-07-14T15:35:45.081 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/oti6858.ko 2023-07-14T15:35:45.081 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/pl2303.ko 2023-07-14T15:35:45.082 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/qcaux.ko 2023-07-14T15:35:45.082 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/qcserial.ko 2023-07-14T15:35:45.082 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/quatech2.ko 2023-07-14T15:35:45.082 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/safe_serial.ko 2023-07-14T15:35:45.082 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/sierra.ko 2023-07-14T15:35:45.082 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/spcp8x5.ko 2023-07-14T15:35:45.082 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ssu100.ko 2023-07-14T15:35:45.082 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/symbolserial.ko 2023-07-14T15:35:45.083 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-07-14T15:35:45.083 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-07-14T15:35:45.083 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/usb_debug.ko 2023-07-14T15:35:45.083 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/usb_wwan.ko 2023-07-14T15:35:45.083 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/visor.ko 2023-07-14T15:35:45.083 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/whiteheat.ko 2023-07-14T15:35:45.083 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/xsens_mt.ko 2023-07-14T15:35:45.084 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage 2023-07-14T15:35:45.084 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/uas.ko 2023-07-14T15:35:45.084 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-alauda.ko 2023-07-14T15:35:45.084 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-cypress.ko 2023-07-14T15:35:45.084 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-datafab.ko 2023-07-14T15:35:45.084 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-07-14T15:35:45.084 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-freecom.ko 2023-07-14T15:35:45.084 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-isd200.ko 2023-07-14T15:35:45.085 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-07-14T15:35:45.085 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-karma.ko 2023-07-14T15:35:45.085 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-onetouch.ko 2023-07-14T15:35:45.085 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-realtek.ko 2023-07-14T15:35:45.085 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-sddr09.ko 2023-07-14T15:35:45.085 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-sddr55.ko 2023-07-14T15:35:45.085 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-usbat.ko 2023-07-14T15:35:45.085 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/usb-storage.ko 2023-07-14T15:35:45.086 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/usbip 2023-07-14T15:35:45.086 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/usbip/usbip-core.ko 2023-07-14T15:35:45.086 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/usbip/usbip-host.ko 2023-07-14T15:35:45.086 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-07-14T15:35:45.086 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio 2023-07-14T15:35:45.086 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/pci 2023-07-14T15:35:45.086 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-07-14T15:35:45.086 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/pci/vfio-pci.ko 2023-07-14T15:35:45.087 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/vfio.ko 2023-07-14T15:35:45.087 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-07-14T15:35:45.087 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost 2023-07-14T15:35:45.087 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost/vhost.ko 2023-07-14T15:35:45.087 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost/vhost_iotlb.ko 2023-07-14T15:35:45.087 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost/vhost_net.ko 2023-07-14T15:35:45.087 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost/vhost_scsi.ko 2023-07-14T15:35:45.087 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video 2023-07-14T15:35:45.088 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight 2023-07-14T15:35:45.088 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/apple_bl.ko 2023-07-14T15:35:45.088 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/lcd.ko 2023-07-14T15:35:45.088 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/platform_lcd.ko 2023-07-14T15:35:45.088 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio 2023-07-14T15:35:45.088 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio.ko 2023-07-14T15:35:45.088 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio_balloon.ko 2023-07-14T15:35:45.089 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio_mmio.ko 2023-07-14T15:35:45.089 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio_pci.ko 2023-07-14T15:35:45.089 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-07-14T15:35:45.089 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-07-14T15:35:45.089 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio_ring.ko 2023-07-14T15:35:45.089 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1 2023-07-14T15:35:45.089 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/masters 2023-07-14T15:35:45.089 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/masters/ds2482.ko 2023-07-14T15:35:45.090 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/masters/ds2490.ko 2023-07-14T15:35:45.090 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves 2023-07-14T15:35:45.090 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-07-14T15:35:45.090 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-07-14T15:35:45.090 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-07-14T15:35:45.090 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-07-14T15:35:45.090 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-07-14T15:35:45.090 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-07-14T15:35:45.091 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-07-14T15:35:45.091 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-07-14T15:35:45.091 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-07-14T15:35:45.091 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_smem.ko 2023-07-14T15:35:45.091 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_therm.ko 2023-07-14T15:35:45.091 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/wire.ko 2023-07-14T15:35:45.091 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog 2023-07-14T15:35:45.091 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/alim1535_wdt.ko 2023-07-14T15:35:45.092 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/alim7101_wdt.ko 2023-07-14T15:35:45.092 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/f71808e_wdt.ko 2023-07-14T15:35:45.092 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/hpwdt.ko 2023-07-14T15:35:45.092 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/i6300esb.ko 2023-07-14T15:35:45.092 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-07-14T15:35:45.092 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/iTCO_wdt.ko 2023-07-14T15:35:45.092 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/ib700wdt.ko 2023-07-14T15:35:45.092 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/ibmasr.ko 2023-07-14T15:35:45.093 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-07-14T15:35:45.093 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/it8712f_wdt.ko 2023-07-14T15:35:45.093 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/it87_wdt.ko 2023-07-14T15:35:45.093 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/machzwd.ko 2023-07-14T15:35:45.093 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/nv_tco.ko 2023-07-14T15:35:45.093 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/pcwd_pci.ko 2023-07-14T15:35:45.093 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/pcwd_usb.ko 2023-07-14T15:35:45.093 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-07-14T15:35:45.094 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/sch311x_wdt.ko 2023-07-14T15:35:45.094 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/softdog.ko 2023-07-14T15:35:45.094 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/sp5100_tco.ko 2023-07-14T15:35:45.094 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/via_wdt.ko 2023-07-14T15:35:45.094 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-07-14T15:35:45.094 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/w83877f_wdt.ko 2023-07-14T15:35:45.094 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/w83977f_wdt.ko 2023-07-14T15:35:45.094 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/wdt_pci.ko 2023-07-14T15:35:45.095 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/xen_wdt.ko 2023-07-14T15:35:45.095 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen 2023-07-14T15:35:45.095 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-acpi-processor.ko 2023-07-14T15:35:45.095 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-evtchn.ko 2023-07-14T15:35:45.095 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-gntalloc.ko 2023-07-14T15:35:45.095 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-gntdev.ko 2023-07-14T15:35:45.095 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-pciback 2023-07-14T15:35:45.095 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-07-14T15:35:45.096 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-privcmd.ko 2023-07-14T15:35:45.096 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xenfs 2023-07-14T15:35:45.096 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xenfs/xenfs.ko 2023-07-14T15:35:45.096 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs 2023-07-14T15:35:45.096 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/9p 2023-07-14T15:35:45.096 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/9p/9p.ko 2023-07-14T15:35:45.096 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/affs 2023-07-14T15:35:45.096 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/affs/affs.ko 2023-07-14T15:35:45.097 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/befs 2023-07-14T15:35:45.097 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/befs/befs.ko 2023-07-14T15:35:45.097 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/binfmt_misc.ko 2023-07-14T15:35:45.097 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/btrfs 2023-07-14T15:35:45.097 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/btrfs/btrfs.ko 2023-07-14T15:35:45.097 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/cachefiles 2023-07-14T15:35:45.097 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/cachefiles/cachefiles.ko 2023-07-14T15:35:45.097 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ceph 2023-07-14T15:35:45.098 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ceph/ceph.ko 2023-07-14T15:35:45.098 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/coda 2023-07-14T15:35:45.098 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/coda/coda.ko 2023-07-14T15:35:45.098 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/cramfs 2023-07-14T15:35:45.098 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/cramfs/cramfs.ko 2023-07-14T15:35:45.098 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/dlm 2023-07-14T15:35:45.098 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/dlm/dlm.ko 2023-07-14T15:35:45.098 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ecryptfs 2023-07-14T15:35:45.099 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ecryptfs/ecryptfs.ko 2023-07-14T15:35:45.099 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/f2fs 2023-07-14T15:35:45.099 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/f2fs/f2fs.ko 2023-07-14T15:35:45.099 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fat 2023-07-14T15:35:45.099 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fat/fat.ko 2023-07-14T15:35:45.099 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fat/msdos.ko 2023-07-14T15:35:45.099 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fat/vfat.ko 2023-07-14T15:35:45.100 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fscache 2023-07-14T15:35:45.100 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fscache/fscache.ko 2023-07-14T15:35:45.100 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fuse 2023-07-14T15:35:45.100 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fuse/cuse.ko 2023-07-14T15:35:45.100 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fuse/fuse.ko 2023-07-14T15:35:45.100 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/gfs2 2023-07-14T15:35:45.100 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/gfs2/gfs2.ko 2023-07-14T15:35:45.100 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/hfs 2023-07-14T15:35:45.101 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/hfs/hfs.ko 2023-07-14T15:35:45.101 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/hfsplus 2023-07-14T15:35:45.101 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/hfsplus/hfsplus.ko 2023-07-14T15:35:45.101 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/isofs 2023-07-14T15:35:45.101 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/isofs/isofs.ko 2023-07-14T15:35:45.101 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/jfs 2023-07-14T15:35:45.101 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/jfs/jfs.ko 2023-07-14T15:35:45.101 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/lockd 2023-07-14T15:35:45.102 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/lockd/lockd.ko 2023-07-14T15:35:45.102 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/minix 2023-07-14T15:35:45.102 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/minix/minix.ko 2023-07-14T15:35:45.102 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/netfs 2023-07-14T15:35:45.102 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/netfs/netfs.ko 2023-07-14T15:35:45.102 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs 2023-07-14T15:35:45.102 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/blocklayout 2023-07-14T15:35:45.102 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-07-14T15:35:45.103 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/filelayout 2023-07-14T15:35:45.103 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-07-14T15:35:45.103 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/flexfilelayout 2023-07-14T15:35:45.103 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-07-14T15:35:45.103 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/nfs.ko 2023-07-14T15:35:45.103 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/nfsv3.ko 2023-07-14T15:35:45.103 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/nfsv4.ko 2023-07-14T15:35:45.103 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs_common 2023-07-14T15:35:45.104 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs_common/grace.ko 2023-07-14T15:35:45.104 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs_common/nfs_acl.ko 2023-07-14T15:35:45.104 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfsd 2023-07-14T15:35:45.104 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfsd/nfsd.ko 2023-07-14T15:35:45.104 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nilfs2 2023-07-14T15:35:45.104 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nilfs2/nilfs2.ko 2023-07-14T15:35:45.104 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls 2023-07-14T15:35:45.105 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-celtic.ko 2023-07-14T15:35:45.105 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-centeuro.ko 2023-07-14T15:35:45.105 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-croatian.ko 2023-07-14T15:35:45.105 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-cyrillic.ko 2023-07-14T15:35:45.105 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-gaelic.ko 2023-07-14T15:35:45.105 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-greek.ko 2023-07-14T15:35:45.105 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-iceland.ko 2023-07-14T15:35:45.105 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-inuit.ko 2023-07-14T15:35:45.106 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-roman.ko 2023-07-14T15:35:45.106 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-romanian.ko 2023-07-14T15:35:45.106 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-turkish.ko 2023-07-14T15:35:45.106 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp1250.ko 2023-07-14T15:35:45.106 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp1251.ko 2023-07-14T15:35:45.106 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp1255.ko 2023-07-14T15:35:45.106 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp737.ko 2023-07-14T15:35:45.106 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp775.ko 2023-07-14T15:35:45.107 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp850.ko 2023-07-14T15:35:45.107 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp852.ko 2023-07-14T15:35:45.107 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp855.ko 2023-07-14T15:35:45.107 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp857.ko 2023-07-14T15:35:45.107 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp860.ko 2023-07-14T15:35:45.107 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp861.ko 2023-07-14T15:35:45.107 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp862.ko 2023-07-14T15:35:45.107 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp863.ko 2023-07-14T15:35:45.108 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp864.ko 2023-07-14T15:35:45.108 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp865.ko 2023-07-14T15:35:45.108 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp866.ko 2023-07-14T15:35:45.108 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp869.ko 2023-07-14T15:35:45.108 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp874.ko 2023-07-14T15:35:45.108 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp932.ko 2023-07-14T15:35:45.108 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp936.ko 2023-07-14T15:35:45.108 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp949.ko 2023-07-14T15:35:45.109 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp950.ko 2023-07-14T15:35:45.109 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_euc-jp.ko 2023-07-14T15:35:45.109 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-1.ko 2023-07-14T15:35:45.109 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-13.ko 2023-07-14T15:35:45.109 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-14.ko 2023-07-14T15:35:45.109 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-15.ko 2023-07-14T15:35:45.109 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-2.ko 2023-07-14T15:35:45.109 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-3.ko 2023-07-14T15:35:45.110 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-4.ko 2023-07-14T15:35:45.110 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-5.ko 2023-07-14T15:35:45.110 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-6.ko 2023-07-14T15:35:45.110 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-7.ko 2023-07-14T15:35:45.110 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-9.ko 2023-07-14T15:35:45.110 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_koi8-r.ko 2023-07-14T15:35:45.110 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_koi8-ru.ko 2023-07-14T15:35:45.110 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_koi8-u.ko 2023-07-14T15:35:45.111 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_utf8.ko 2023-07-14T15:35:45.111 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2 2023-07-14T15:35:45.111 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/cluster 2023-07-14T15:35:45.111 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-07-14T15:35:45.111 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/dlm 2023-07-14T15:35:45.111 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-07-14T15:35:45.111 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/dlmfs 2023-07-14T15:35:45.111 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-07-14T15:35:45.112 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/ocfs2.ko 2023-07-14T15:35:45.112 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-07-14T15:35:45.112 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-07-14T15:35:45.112 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-07-14T15:35:45.112 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/overlayfs 2023-07-14T15:35:45.112 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/overlayfs/overlay.ko 2023-07-14T15:35:45.112 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/pstore 2023-07-14T15:35:45.112 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/pstore/ramoops.ko 2023-07-14T15:35:45.113 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/reiserfs 2023-07-14T15:35:45.113 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/reiserfs/reiserfs.ko 2023-07-14T15:35:45.113 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/romfs 2023-07-14T15:35:45.113 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/romfs/romfs.ko 2023-07-14T15:35:45.113 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb 2023-07-14T15:35:45.113 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/client 2023-07-14T15:35:45.113 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/client/cifs.ko 2023-07-14T15:35:45.114 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/common 2023-07-14T15:35:45.114 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/common/cifs_arc4.ko 2023-07-14T15:35:45.114 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/common/cifs_md4.ko 2023-07-14T15:35:45.114 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/squashfs 2023-07-14T15:35:45.114 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/squashfs/squashfs.ko 2023-07-14T15:35:45.114 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/sysv 2023-07-14T15:35:45.114 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/sysv/sysv.ko 2023-07-14T15:35:45.114 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/udf 2023-07-14T15:35:45.115 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/udf/udf.ko 2023-07-14T15:35:45.115 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ufs 2023-07-14T15:35:45.115 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ufs/ufs.ko 2023-07-14T15:35:45.115 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/xfs 2023-07-14T15:35:45.115 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/xfs/xfs.ko 2023-07-14T15:35:45.115 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel 2023-07-14T15:35:45.115 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/rcu 2023-07-14T15:35:45.115 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/rcu/rcutorture.ko 2023-07-14T15:35:45.116 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/torture.ko 2023-07-14T15:35:45.116 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/trace 2023-07-14T15:35:45.116 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-07-14T15:35:45.116 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib 2023-07-14T15:35:45.116 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/asn1_encoder.ko 2023-07-14T15:35:45.116 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crc-itu-t.ko 2023-07-14T15:35:45.116 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crc8.ko 2023-07-14T15:35:45.117 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crypto 2023-07-14T15:35:45.117 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crypto/libarc4.ko 2023-07-14T15:35:45.117 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crypto/libdes.ko 2023-07-14T15:35:45.117 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/libcrc32c.ko 2023-07-14T15:35:45.117 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/lru_cache.ko 2023-07-14T15:35:45.117 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/lz4 2023-07-14T15:35:45.117 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/lz4/lz4_compress.ko 2023-07-14T15:35:45.117 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/lz4/lz4hc_compress.ko 2023-07-14T15:35:45.118 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/math 2023-07-14T15:35:45.118 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/math/cordic.ko 2023-07-14T15:35:45.118 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/raid6 2023-07-14T15:35:45.118 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/raid6/raid6_pq.ko 2023-07-14T15:35:45.118 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/reed_solomon 2023-07-14T15:35:45.118 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/reed_solomon/reed_solomon.ko 2023-07-14T15:35:45.118 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/ts_bm.ko 2023-07-14T15:35:45.118 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/ts_fsm.ko 2023-07-14T15:35:45.119 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/ts_kmp.ko 2023-07-14T15:35:45.119 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/zstd 2023-07-14T15:35:45.119 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/zstd/zstd_compress.ko 2023-07-14T15:35:45.119 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/mm 2023-07-14T15:35:45.119 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/mm/hwpoison-inject.ko 2023-07-14T15:35:45.119 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net 2023-07-14T15:35:45.119 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan 2023-07-14T15:35:45.119 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/6lowpan.ko 2023-07-14T15:35:45.120 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_dest.ko 2023-07-14T15:35:45.120 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_fragment.ko 2023-07-14T15:35:45.120 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_hop.ko 2023-07-14T15:35:45.120 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_ipv6.ko 2023-07-14T15:35:45.120 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_mobility.ko 2023-07-14T15:35:45.120 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_routing.ko 2023-07-14T15:35:45.120 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_udp.ko 2023-07-14T15:35:45.120 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802 2023-07-14T15:35:45.121 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/garp.ko 2023-07-14T15:35:45.121 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/mrp.ko 2023-07-14T15:35:45.121 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/p8022.ko 2023-07-14T15:35:45.121 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/psnap.ko 2023-07-14T15:35:45.121 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/stp.ko 2023-07-14T15:35:45.121 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/8021q 2023-07-14T15:35:45.121 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/8021q/8021q.ko 2023-07-14T15:35:45.121 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p 2023-07-14T15:35:45.122 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p/9pnet.ko 2023-07-14T15:35:45.122 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p/9pnet_fd.ko 2023-07-14T15:35:45.122 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p/9pnet_rdma.ko 2023-07-14T15:35:45.122 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p/9pnet_virtio.ko 2023-07-14T15:35:45.122 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/batman-adv 2023-07-14T15:35:45.122 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/batman-adv/batman-adv.ko 2023-07-14T15:35:45.122 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge 2023-07-14T15:35:45.122 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/br_netfilter.ko 2023-07-14T15:35:45.123 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/bridge.ko 2023-07-14T15:35:45.123 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter 2023-07-14T15:35:45.123 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-07-14T15:35:45.123 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_among.ko 2023-07-14T15:35:45.123 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_arp.ko 2023-07-14T15:35:45.123 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-07-14T15:35:45.123 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-07-14T15:35:45.123 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_ip.ko 2023-07-14T15:35:45.124 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-07-14T15:35:45.124 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_limit.ko 2023-07-14T15:35:45.124 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_log.ko 2023-07-14T15:35:45.124 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_mark.ko 2023-07-14T15:35:45.124 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-07-14T15:35:45.124 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-07-14T15:35:45.124 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-07-14T15:35:45.125 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-07-14T15:35:45.125 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_snat.ko 2023-07-14T15:35:45.125 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_stp.ko 2023-07-14T15:35:45.125 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-07-14T15:35:45.125 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-07-14T15:35:45.125 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-07-14T15:35:45.125 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-07-14T15:35:45.125 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebtables.ko 2023-07-14T15:35:45.126 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-07-14T15:35:45.126 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-07-14T15:35:45.126 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-07-14T15:35:45.126 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ceph 2023-07-14T15:35:45.126 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ceph/libceph.ko 2023-07-14T15:35:45.126 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/core 2023-07-14T15:35:45.126 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/core/failover.ko 2023-07-14T15:35:45.126 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/core/pktgen.ko 2023-07-14T15:35:45.127 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp 2023-07-14T15:35:45.127 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp/dccp.ko 2023-07-14T15:35:45.127 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp/dccp_diag.ko 2023-07-14T15:35:45.127 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp/dccp_ipv4.ko 2023-07-14T15:35:45.127 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp/dccp_ipv6.ko 2023-07-14T15:35:45.127 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dns_resolver 2023-07-14T15:35:45.127 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dns_resolver/dns_resolver.ko 2023-07-14T15:35:45.127 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa 2023-07-14T15:35:45.128 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/dsa_core.ko 2023-07-14T15:35:45.128 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/tag_brcm.ko 2023-07-14T15:35:45.128 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/tag_dsa.ko 2023-07-14T15:35:45.128 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/tag_none.ko 2023-07-14T15:35:45.128 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/tag_trailer.ko 2023-07-14T15:35:45.128 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154 2023-07-14T15:35:45.128 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154/6lowpan 2023-07-14T15:35:45.128 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-07-14T15:35:45.129 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154/ieee802154.ko 2023-07-14T15:35:45.129 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154/ieee802154_socket.ko 2023-07-14T15:35:45.129 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4 2023-07-14T15:35:45.129 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ah4.ko 2023-07-14T15:35:45.129 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/esp4.ko 2023-07-14T15:35:45.129 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/fou.ko 2023-07-14T15:35:45.129 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/gre.ko 2023-07-14T15:35:45.129 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/inet_diag.ko 2023-07-14T15:35:45.130 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ip_gre.ko 2023-07-14T15:35:45.130 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ip_tunnel.ko 2023-07-14T15:35:45.130 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ip_vti.ko 2023-07-14T15:35:45.130 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ipcomp.ko 2023-07-14T15:35:45.130 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ipip.ko 2023-07-14T15:35:45.130 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter 2023-07-14T15:35:45.130 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/arp_tables.ko 2023-07-14T15:35:45.130 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-07-14T15:35:45.131 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-07-14T15:35:45.131 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-07-14T15:35:45.131 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-07-14T15:35:45.131 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-07-14T15:35:45.131 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-07-14T15:35:45.131 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-07-14T15:35:45.131 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-07-14T15:35:45.131 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-07-14T15:35:45.132 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/iptable_security.ko 2023-07-14T15:35:45.132 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-07-14T15:35:45.132 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-07-14T15:35:45.132 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-07-14T15:35:45.132 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-07-14T15:35:45.132 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-07-14T15:35:45.132 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-07-14T15:35:45.132 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-07-14T15:35:45.133 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-07-14T15:35:45.133 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-07-14T15:35:45.133 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-07-14T15:35:45.133 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_bic.ko 2023-07-14T15:35:45.133 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_dctcp.ko 2023-07-14T15:35:45.133 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_diag.ko 2023-07-14T15:35:45.133 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_highspeed.ko 2023-07-14T15:35:45.133 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_htcp.ko 2023-07-14T15:35:45.134 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_hybla.ko 2023-07-14T15:35:45.134 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_illinois.ko 2023-07-14T15:35:45.134 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_lp.ko 2023-07-14T15:35:45.134 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_scalable.ko 2023-07-14T15:35:45.134 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_vegas.ko 2023-07-14T15:35:45.134 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_veno.ko 2023-07-14T15:35:45.134 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_westwood.ko 2023-07-14T15:35:45.134 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_yeah.ko 2023-07-14T15:35:45.135 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tunnel4.ko 2023-07-14T15:35:45.135 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/udp_diag.ko 2023-07-14T15:35:45.135 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/udp_tunnel.ko 2023-07-14T15:35:45.135 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/xfrm4_tunnel.ko 2023-07-14T15:35:45.135 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6 2023-07-14T15:35:45.135 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ah6.ko 2023-07-14T15:35:45.135 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/esp6.ko 2023-07-14T15:35:45.135 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/fou6.ko 2023-07-14T15:35:45.136 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ip6_tunnel.ko 2023-07-14T15:35:45.136 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-07-14T15:35:45.136 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ip6_vti.ko 2023-07-14T15:35:45.136 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ipcomp6.ko 2023-07-14T15:35:45.136 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter 2023-07-14T15:35:45.136 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-07-14T15:35:45.136 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-07-14T15:35:45.137 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-07-14T15:35:45.137 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-07-14T15:35:45.137 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-07-14T15:35:45.137 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-07-14T15:35:45.137 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-07-14T15:35:45.137 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-07-14T15:35:45.137 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-07-14T15:35:45.137 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-07-14T15:35:45.138 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-07-14T15:35:45.138 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-07-14T15:35:45.138 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-07-14T15:35:45.138 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-07-14T15:35:45.138 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-07-14T15:35:45.138 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-07-14T15:35:45.138 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-07-14T15:35:45.138 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-07-14T15:35:45.139 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-07-14T15:35:45.139 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-07-14T15:35:45.139 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-07-14T15:35:45.139 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-07-14T15:35:45.139 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-07-14T15:35:45.139 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-07-14T15:35:45.139 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/sit.ko 2023-07-14T15:35:45.139 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/tunnel6.ko 2023-07-14T15:35:45.140 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/xfrm6_tunnel.ko 2023-07-14T15:35:45.140 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/key 2023-07-14T15:35:45.140 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/key/af_key.ko 2023-07-14T15:35:45.140 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp 2023-07-14T15:35:45.140 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_core.ko 2023-07-14T15:35:45.140 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_debugfs.ko 2023-07-14T15:35:45.140 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_eth.ko 2023-07-14T15:35:45.141 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_ip.ko 2023-07-14T15:35:45.141 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_ip6.ko 2023-07-14T15:35:45.141 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_netlink.ko 2023-07-14T15:35:45.141 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_ppp.ko 2023-07-14T15:35:45.141 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/llc 2023-07-14T15:35:45.141 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/llc/llc.ko 2023-07-14T15:35:45.141 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/mac802154 2023-07-14T15:35:45.141 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/mac802154/mac802154.ko 2023-07-14T15:35:45.142 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/mpls 2023-07-14T15:35:45.142 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/mpls/mpls_gso.ko 2023-07-14T15:35:45.142 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter 2023-07-14T15:35:45.142 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset 2023-07-14T15:35:45.142 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set.ko 2023-07-14T15:35:45.142 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-07-14T15:35:45.142 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-07-14T15:35:45.142 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-07-14T15:35:45.143 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-07-14T15:35:45.143 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-07-14T15:35:45.143 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-07-14T15:35:45.143 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-07-14T15:35:45.143 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-07-14T15:35:45.143 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-07-14T15:35:45.143 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-07-14T15:35:45.143 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-07-14T15:35:45.144 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-07-14T15:35:45.144 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-07-14T15:35:45.144 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-07-14T15:35:45.144 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-07-14T15:35:45.144 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs 2023-07-14T15:35:45.144 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs.ko 2023-07-14T15:35:45.144 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-07-14T15:35:45.144 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-07-14T15:35:45.145 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-07-14T15:35:45.145 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-07-14T15:35:45.145 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-07-14T15:35:45.145 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-07-14T15:35:45.145 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-07-14T15:35:45.145 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-07-14T15:35:45.145 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-07-14T15:35:45.145 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-07-14T15:35:45.146 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-07-14T15:35:45.146 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-07-14T15:35:45.146 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-07-14T15:35:45.146 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conncount.ko 2023-07-14T15:35:45.146 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack.ko 2023-07-14T15:35:45.146 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-07-14T15:35:45.146 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-07-14T15:35:45.146 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-07-14T15:35:45.147 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_h323.ko 2023-07-14T15:35:45.147 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_irc.ko 2023-07-14T15:35:45.147 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-07-14T15:35:45.147 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-07-14T15:35:45.147 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-07-14T15:35:45.147 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_sane.ko 2023-07-14T15:35:45.147 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_sip.ko 2023-07-14T15:35:45.147 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-07-14T15:35:45.148 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-07-14T15:35:45.148 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_dup_netdev.ko 2023-07-14T15:35:45.148 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_flow_table.ko 2023-07-14T15:35:45.148 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_flow_table_inet.ko 2023-07-14T15:35:45.148 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_log_syslog.ko 2023-07-14T15:35:45.148 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat.ko 2023-07-14T15:35:45.148 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_amanda.ko 2023-07-14T15:35:45.148 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_ftp.ko 2023-07-14T15:35:45.149 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_irc.ko 2023-07-14T15:35:45.149 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_sip.ko 2023-07-14T15:35:45.149 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_tftp.ko 2023-07-14T15:35:45.149 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_synproxy_core.ko 2023-07-14T15:35:45.149 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_tables.ko 2023-07-14T15:35:45.149 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink.ko 2023-07-14T15:35:45.149 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink_acct.ko 2023-07-14T15:35:45.149 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink_log.ko 2023-07-14T15:35:45.150 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink_osf.ko 2023-07-14T15:35:45.150 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink_queue.ko 2023-07-14T15:35:45.150 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_chain_nat.ko 2023-07-14T15:35:45.150 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_compat.ko 2023-07-14T15:35:45.150 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_ct.ko 2023-07-14T15:35:45.150 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_dup_netdev.ko 2023-07-14T15:35:45.150 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_fib.ko 2023-07-14T15:35:45.150 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_fwd_netdev.ko 2023-07-14T15:35:45.151 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_hash.ko 2023-07-14T15:35:45.151 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_limit.ko 2023-07-14T15:35:45.151 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_log.ko 2023-07-14T15:35:45.151 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_masq.ko 2023-07-14T15:35:45.151 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_nat.ko 2023-07-14T15:35:45.151 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_numgen.ko 2023-07-14T15:35:45.151 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_queue.ko 2023-07-14T15:35:45.151 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_quota.ko 2023-07-14T15:35:45.152 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_redir.ko 2023-07-14T15:35:45.152 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_reject.ko 2023-07-14T15:35:45.152 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_reject_inet.ko 2023-07-14T15:35:45.152 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_socket.ko 2023-07-14T15:35:45.152 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_tunnel.ko 2023-07-14T15:35:45.152 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_AUDIT.ko 2023-07-14T15:35:45.152 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_CHECKSUM.ko 2023-07-14T15:35:45.152 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_CLASSIFY.ko 2023-07-14T15:35:45.153 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-07-14T15:35:45.153 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_CT.ko 2023-07-14T15:35:45.153 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_DSCP.ko 2023-07-14T15:35:45.153 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_HL.ko 2023-07-14T15:35:45.153 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_HMARK.ko 2023-07-14T15:35:45.153 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_IDLETIMER.ko 2023-07-14T15:35:45.153 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_LED.ko 2023-07-14T15:35:45.153 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_LOG.ko 2023-07-14T15:35:45.154 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_MASQUERADE.ko 2023-07-14T15:35:45.154 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_NETMAP.ko 2023-07-14T15:35:45.154 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_NFLOG.ko 2023-07-14T15:35:45.154 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_NFQUEUE.ko 2023-07-14T15:35:45.154 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_RATEEST.ko 2023-07-14T15:35:45.154 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_REDIRECT.ko 2023-07-14T15:35:45.154 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_SECMARK.ko 2023-07-14T15:35:45.154 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TCPMSS.ko 2023-07-14T15:35:45.155 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-07-14T15:35:45.155 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TEE.ko 2023-07-14T15:35:45.155 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TPROXY.ko 2023-07-14T15:35:45.155 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TRACE.ko 2023-07-14T15:35:45.155 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_addrtype.ko 2023-07-14T15:35:45.155 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_bpf.ko 2023-07-14T15:35:45.155 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_cgroup.ko 2023-07-14T15:35:45.156 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_cluster.ko 2023-07-14T15:35:45.156 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_comment.ko 2023-07-14T15:35:45.156 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_connbytes.ko 2023-07-14T15:35:45.156 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_connlabel.ko 2023-07-14T15:35:45.156 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_connlimit.ko 2023-07-14T15:35:45.156 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_connmark.ko 2023-07-14T15:35:45.156 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_conntrack.ko 2023-07-14T15:35:45.156 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_cpu.ko 2023-07-14T15:35:45.157 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_dccp.ko 2023-07-14T15:35:45.157 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_devgroup.ko 2023-07-14T15:35:45.157 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_dscp.ko 2023-07-14T15:35:45.157 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_ecn.ko 2023-07-14T15:35:45.157 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_esp.ko 2023-07-14T15:35:45.157 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_hashlimit.ko 2023-07-14T15:35:45.157 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_helper.ko 2023-07-14T15:35:45.157 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_hl.ko 2023-07-14T15:35:45.158 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_ipcomp.ko 2023-07-14T15:35:45.158 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_iprange.ko 2023-07-14T15:35:45.158 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_ipvs.ko 2023-07-14T15:35:45.158 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_l2tp.ko 2023-07-14T15:35:45.158 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_length.ko 2023-07-14T15:35:45.158 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_limit.ko 2023-07-14T15:35:45.158 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_mac.ko 2023-07-14T15:35:45.159 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_mark.ko 2023-07-14T15:35:45.159 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_multiport.ko 2023-07-14T15:35:45.159 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_nat.ko 2023-07-14T15:35:45.159 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_nfacct.ko 2023-07-14T15:35:45.159 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_osf.ko 2023-07-14T15:35:45.159 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_owner.ko 2023-07-14T15:35:45.159 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_physdev.ko 2023-07-14T15:35:45.159 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_pkttype.ko 2023-07-14T15:35:45.160 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_policy.ko 2023-07-14T15:35:45.160 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_quota.ko 2023-07-14T15:35:45.160 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_rateest.ko 2023-07-14T15:35:45.160 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_realm.ko 2023-07-14T15:35:45.160 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_recent.ko 2023-07-14T15:35:45.160 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_sctp.ko 2023-07-14T15:35:45.160 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_set.ko 2023-07-14T15:35:45.160 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_socket.ko 2023-07-14T15:35:45.161 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_state.ko 2023-07-14T15:35:45.161 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_statistic.ko 2023-07-14T15:35:45.161 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_string.ko 2023-07-14T15:35:45.161 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_tcpmss.ko 2023-07-14T15:35:45.161 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_time.ko 2023-07-14T15:35:45.161 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_u32.ko 2023-07-14T15:35:45.161 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netlink 2023-07-14T15:35:45.161 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netlink/netlink_diag.ko 2023-07-14T15:35:45.162 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/nsh 2023-07-14T15:35:45.162 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/nsh/nsh.ko 2023-07-14T15:35:45.162 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch 2023-07-14T15:35:45.162 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch/openvswitch.ko 2023-07-14T15:35:45.162 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch/vport-geneve.ko 2023-07-14T15:35:45.162 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch/vport-gre.ko 2023-07-14T15:35:45.162 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch/vport-vxlan.ko 2023-07-14T15:35:45.162 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/packet 2023-07-14T15:35:45.163 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/packet/af_packet_diag.ko 2023-07-14T15:35:45.163 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/rds 2023-07-14T15:35:45.163 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/rds/rds.ko 2023-07-14T15:35:45.163 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/rds/rds_rdma.ko 2023-07-14T15:35:45.163 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/rds/rds_tcp.ko 2023-07-14T15:35:45.163 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched 2023-07-14T15:35:45.163 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_csum.ko 2023-07-14T15:35:45.163 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_gact.ko 2023-07-14T15:35:45.164 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_ipt.ko 2023-07-14T15:35:45.164 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_mirred.ko 2023-07-14T15:35:45.164 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_nat.ko 2023-07-14T15:35:45.164 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_pedit.ko 2023-07-14T15:35:45.164 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_police.ko 2023-07-14T15:35:45.164 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_simple.ko 2023-07-14T15:35:45.164 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_skbedit.ko 2023-07-14T15:35:45.165 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_vlan.ko 2023-07-14T15:35:45.165 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_basic.ko 2023-07-14T15:35:45.165 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_bpf.ko 2023-07-14T15:35:45.165 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_flow.ko 2023-07-14T15:35:45.165 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_fw.ko 2023-07-14T15:35:45.165 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_route.ko 2023-07-14T15:35:45.165 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_u32.ko 2023-07-14T15:35:45.165 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_cmp.ko 2023-07-14T15:35:45.166 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_ipset.ko 2023-07-14T15:35:45.166 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_meta.ko 2023-07-14T15:35:45.166 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_nbyte.ko 2023-07-14T15:35:45.166 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_text.ko 2023-07-14T15:35:45.166 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_u32.ko 2023-07-14T15:35:45.166 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_choke.ko 2023-07-14T15:35:45.166 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_codel.ko 2023-07-14T15:35:45.166 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_drr.ko 2023-07-14T15:35:45.167 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_fq.ko 2023-07-14T15:35:45.167 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_gred.ko 2023-07-14T15:35:45.167 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_hfsc.ko 2023-07-14T15:35:45.167 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_hhf.ko 2023-07-14T15:35:45.167 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_htb.ko 2023-07-14T15:35:45.167 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_ingress.ko 2023-07-14T15:35:45.167 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_mqprio.ko 2023-07-14T15:35:45.168 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_mqprio_lib.ko 2023-07-14T15:35:45.168 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_multiq.ko 2023-07-14T15:35:45.168 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_netem.ko 2023-07-14T15:35:45.168 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_pie.ko 2023-07-14T15:35:45.168 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_plug.ko 2023-07-14T15:35:45.168 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_prio.ko 2023-07-14T15:35:45.168 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_qfq.ko 2023-07-14T15:35:45.168 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_red.ko 2023-07-14T15:35:45.169 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_sfb.ko 2023-07-14T15:35:45.169 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_sfq.ko 2023-07-14T15:35:45.169 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_tbf.ko 2023-07-14T15:35:45.169 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_teql.ko 2023-07-14T15:35:45.169 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sctp 2023-07-14T15:35:45.169 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sctp/sctp.ko 2023-07-14T15:35:45.169 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sctp/sctp_diag.ko 2023-07-14T15:35:45.169 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc 2023-07-14T15:35:45.170 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/auth_gss 2023-07-14T15:35:45.170 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-07-14T15:35:45.170 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-07-14T15:35:45.170 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/sunrpc.ko 2023-07-14T15:35:45.170 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/xprtrdma 2023-07-14T15:35:45.170 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-07-14T15:35:45.171 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/tipc 2023-07-14T15:35:45.171 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/tipc/diag.ko 2023-07-14T15:35:45.171 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/tipc/tipc.ko 2023-07-14T15:35:45.171 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/unix 2023-07-14T15:35:45.171 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/unix/unix_diag.ko 2023-07-14T15:35:45.171 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock 2023-07-14T15:35:45.171 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-07-14T15:35:45.171 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-07-14T15:35:45.172 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vsock.ko 2023-07-14T15:35:45.172 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vsock_diag.ko 2023-07-14T15:35:45.172 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vsock_loopback.ko 2023-07-14T15:35:45.172 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/xfrm 2023-07-14T15:35:45.172 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/xfrm/xfrm_ipcomp.ko 2023-07-14T15:35:45.172 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/security 2023-07-14T15:35:45.172 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/security/keys 2023-07-14T15:35:45.173 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/security/keys/encrypted-keys 2023-07-14T15:35:45.173 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-07-14T15:35:45.173 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/security/keys/trusted-keys 2023-07-14T15:35:45.173 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/security/keys/trusted-keys/trusted.ko 2023-07-14T15:35:45.173 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/virt 2023-07-14T15:35:45.173 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/virt/lib 2023-07-14T15:35:45.173 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/virt/lib/irqbypass.ko 2023-07-14T15:35:45.174 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.alias 2023-07-14T15:35:45.174 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.alias.bin 2023-07-14T15:35:45.174 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.builtin 2023-07-14T15:35:45.174 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.builtin.bin 2023-07-14T15:35:45.174 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.builtin.modinfo 2023-07-14T15:35:45.174 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.dep 2023-07-14T15:35:45.174 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.dep.bin 2023-07-14T15:35:45.174 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.devname 2023-07-14T15:35:45.175 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.order 2023-07-14T15:35:45.175 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.softdep 2023-07-14T15:35:45.175 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.symbols 2023-07-14T15:35:45.175 INFO:teuthology.orchestra.run.smithi098.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.symbols.bin 2023-07-14T15:35:45.176 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc1-ga440c79eee02 2023-07-14T15:35:45.176 DEBUG:teuthology.orchestra.run.smithi098:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-07-14T15:35:45.204 INFO:teuthology.orchestra.run.smithi098.stdout:postinstall scriptlet (using /bin/sh): 2023-07-14T15:35:45.204 INFO:teuthology.orchestra.run.smithi098.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc1-ga440c79eee02 -a -r /boot/System.map-6.5.0-rc1-ga440c79eee02 ]; then 2023-07-14T15:35:45.204 INFO:teuthology.orchestra.run.smithi098.stdout:cp /boot/vmlinuz-6.5.0-rc1-ga440c79eee02 /boot/.vmlinuz-6.5.0-rc1-ga440c79eee02-rpm 2023-07-14T15:35:45.204 INFO:teuthology.orchestra.run.smithi098.stdout:cp /boot/System.map-6.5.0-rc1-ga440c79eee02 /boot/.System.map-6.5.0-rc1-ga440c79eee02-rpm 2023-07-14T15:35:45.204 INFO:teuthology.orchestra.run.smithi098.stdout:rm -f /boot/vmlinuz-6.5.0-rc1-ga440c79eee02 /boot/System.map-6.5.0-rc1-ga440c79eee02 2023-07-14T15:35:45.205 INFO:teuthology.orchestra.run.smithi098.stdout:/sbin/installkernel 6.5.0-rc1-ga440c79eee02 /boot/.vmlinuz-6.5.0-rc1-ga440c79eee02-rpm /boot/.System.map-6.5.0-rc1-ga440c79eee02-rpm 2023-07-14T15:35:45.205 INFO:teuthology.orchestra.run.smithi098.stdout:rm -f /boot/.vmlinuz-6.5.0-rc1-ga440c79eee02-rpm /boot/.System.map-6.5.0-rc1-ga440c79eee02-rpm 2023-07-14T15:35:45.205 INFO:teuthology.orchestra.run.smithi098.stdout:fi 2023-07-14T15:35:45.205 INFO:teuthology.orchestra.run.smithi098.stdout:preuninstall scriptlet (using /bin/sh): 2023-07-14T15:35:45.205 INFO:teuthology.orchestra.run.smithi098.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-07-14T15:35:45.205 INFO:teuthology.orchestra.run.smithi098.stdout:new-kernel-pkg --remove 6.5.0-rc1-ga440c79eee02 --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc1-ga440c79eee02.img 2023-07-14T15:35:45.205 INFO:teuthology.orchestra.run.smithi098.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-07-14T15:35:45.206 INFO:teuthology.orchestra.run.smithi098.stdout:kernel-install remove 6.5.0-rc1-ga440c79eee02 2023-07-14T15:35:45.206 INFO:teuthology.orchestra.run.smithi098.stdout:fi 2023-07-14T15:35:45.206 INFO:teuthology.orchestra.run.smithi098.stdout:postuninstall scriptlet (using /bin/sh): 2023-07-14T15:35:45.206 INFO:teuthology.orchestra.run.smithi098.stdout:if [ -x /sbin/update-bootloader ]; then 2023-07-14T15:35:45.206 INFO:teuthology.orchestra.run.smithi098.stdout:/sbin/update-bootloader --remove 6.5.0-rc1-ga440c79eee02 2023-07-14T15:35:45.206 INFO:teuthology.orchestra.run.smithi098.stdout:fi 2023-07-14T15:35:45.207 DEBUG:teuthology.orchestra.run.smithi098:> sudo rpm -qi grub2-tools 2023-07-14T15:35:45.285 INFO:teuthology.orchestra.run.smithi098.stdout:Name : grub2-tools 2023-07-14T15:35:45.285 INFO:teuthology.orchestra.run.smithi098.stdout:Epoch : 1 2023-07-14T15:35:45.286 INFO:teuthology.orchestra.run.smithi098.stdout:Version : 2.02 2023-07-14T15:35:45.286 INFO:teuthology.orchestra.run.smithi098.stdout:Release : 123.el8 2023-07-14T15:35:45.286 INFO:teuthology.orchestra.run.smithi098.stdout:Architecture: x86_64 2023-07-14T15:35:45.286 INFO:teuthology.orchestra.run.smithi098.stdout:Install Date: Thu 14 Jul 2022 06:22:19 PM UTC 2023-07-14T15:35:45.286 INFO:teuthology.orchestra.run.smithi098.stdout:Group : System Environment/Base 2023-07-14T15:35:45.286 INFO:teuthology.orchestra.run.smithi098.stdout:Size : 9265450 2023-07-14T15:35:45.286 INFO:teuthology.orchestra.run.smithi098.stdout:License : GPLv3+ 2023-07-14T15:35:45.287 INFO:teuthology.orchestra.run.smithi098.stdout:Signature : RSA/SHA256, Thu 31 Mar 2022 07:24:35 PM UTC, Key ID 199e2f91fd431d51 2023-07-14T15:35:45.287 INFO:teuthology.orchestra.run.smithi098.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2023-07-14T15:35:45.287 INFO:teuthology.orchestra.run.smithi098.stdout:Build Date : Mon 28 Mar 2022 02:12:09 PM UTC 2023-07-14T15:35:45.287 INFO:teuthology.orchestra.run.smithi098.stdout:Build Host : x86-vm-09.build.eng.bos.redhat.com 2023-07-14T15:35:45.287 INFO:teuthology.orchestra.run.smithi098.stdout:Relocations : (not relocatable) 2023-07-14T15:35:45.287 INFO:teuthology.orchestra.run.smithi098.stdout:Packager : Red Hat, Inc. 2023-07-14T15:35:45.288 INFO:teuthology.orchestra.run.smithi098.stdout:Vendor : Red Hat, Inc. 2023-07-14T15:35:45.288 INFO:teuthology.orchestra.run.smithi098.stdout:URL : http://www.gnu.org/software/grub/ 2023-07-14T15:35:45.288 INFO:teuthology.orchestra.run.smithi098.stdout:Summary : Support tools for GRUB. 2023-07-14T15:35:45.288 INFO:teuthology.orchestra.run.smithi098.stdout:Description : 2023-07-14T15:35:45.288 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-14T15:35:45.288 INFO:teuthology.orchestra.run.smithi098.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-07-14T15:35:45.288 INFO:teuthology.orchestra.run.smithi098.stdout:customizable bootloader with modular architecture. It supports a rich 2023-07-14T15:35:45.289 INFO:teuthology.orchestra.run.smithi098.stdout:variety of kernel formats, file systems, computer architectures and 2023-07-14T15:35:45.289 INFO:teuthology.orchestra.run.smithi098.stdout:hardware devices. 2023-07-14T15:35:45.289 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-14T15:35:45.289 INFO:teuthology.orchestra.run.smithi098.stdout:This subpackage provides tools for support of all platforms. 2023-07-14T15:35:45.290 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-07-14T15:35:45.290 INFO:teuthology.task.kernel:Updating grub on smithi098 to boot 6.5.0-rc1-ga440c79eee02 2023-07-14T15:35:45.290 DEBUG:teuthology.orchestra.run.smithi098:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-07-14T15:35:46.711 INFO:teuthology.orchestra.run.smithi037.stderr:done 2023-07-14T15:35:46.713 DEBUG:teuthology.orchestra.run.smithi037:> mktemp 2023-07-14T15:35:46.730 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.zS3JLaQLTO 2023-07-14T15:35:46.730 DEBUG:teuthology.orchestra.run.smithi037:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.zS3JLaQLTO 2023-07-14T15:35:46.801 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0666 /tmp/tmp.zS3JLaQLTO 2023-07-14T15:35:46.953 DEBUG:teuthology.orchestra.remote:smithi037:/tmp/tmp.zS3JLaQLTO is 6KB 2023-07-14T15:35:46.973 DEBUG:teuthology.orchestra.run.smithi037:> rm -fr /tmp/tmp.zS3JLaQLTO 2023-07-14T15:35:46.989 DEBUG:teuthology.orchestra.run.smithi037:> sudo /bin/ls /boot/loader/entries || true 2023-07-14T15:35:47.054 INFO:teuthology.orchestra.run.smithi037.stdout:5a84457b7b52416e95d47d02e2e4a60f-0-rescue.conf 2023-07-14T15:35:47.054 INFO:teuthology.orchestra.run.smithi037.stdout:5a84457b7b52416e95d47d02e2e4a60f-4.18.0-372.9.1.el8.x86_64.conf 2023-07-14T15:35:47.055 INFO:teuthology.orchestra.run.smithi037.stdout:5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc1-ga440c79eee02.conf 2023-07-14T15:35:47.055 DEBUG:teuthology.orchestra.run.smithi037:> sudo grub2-set-default 5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc1-ga440c79eee02 2023-07-14T15:35:47.221 DEBUG:teuthology.orchestra.run.smithi037:> sudo shutdown -r now 2023-07-14T15:35:47.758 INFO:teuthology.orchestra.run.smithi098.stderr:Generating grub configuration file ... 2023-07-14T15:35:50.062 INFO:teuthology.orchestra.run.smithi098.stderr:done 2023-07-14T15:35:50.064 DEBUG:teuthology.orchestra.run.smithi098:> mktemp 2023-07-14T15:35:50.082 INFO:teuthology.orchestra.run.smithi098.stdout:/tmp/tmp.eQ60EvMoSX 2023-07-14T15:35:50.083 DEBUG:teuthology.orchestra.run.smithi098:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.eQ60EvMoSX 2023-07-14T15:35:50.155 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 0666 /tmp/tmp.eQ60EvMoSX 2023-07-14T15:35:50.310 DEBUG:teuthology.orchestra.remote:smithi098:/tmp/tmp.eQ60EvMoSX is 6KB 2023-07-14T15:35:50.356 DEBUG:teuthology.orchestra.run.smithi098:> rm -fr /tmp/tmp.eQ60EvMoSX 2023-07-14T15:35:50.372 DEBUG:teuthology.orchestra.run.smithi098:> sudo /bin/ls /boot/loader/entries || true 2023-07-14T15:35:50.442 INFO:teuthology.orchestra.run.smithi098.stdout:5a84457b7b52416e95d47d02e2e4a60f-0-rescue.conf 2023-07-14T15:35:50.442 INFO:teuthology.orchestra.run.smithi098.stdout:5a84457b7b52416e95d47d02e2e4a60f-4.18.0-372.9.1.el8.x86_64.conf 2023-07-14T15:35:50.442 INFO:teuthology.orchestra.run.smithi098.stdout:5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc1-ga440c79eee02.conf 2023-07-14T15:35:50.443 DEBUG:teuthology.orchestra.run.smithi098:> sudo grub2-set-default 5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc1-ga440c79eee02 2023-07-14T15:35:50.604 DEBUG:teuthology.orchestra.run.smithi098:> sudo shutdown -r now 2023-07-14T15:36:17.236 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-07-14T15:36:17.237 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-07-14T15:36:17.237 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T15:36:20.608 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-07-14T15:36:20.608 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-07-14T15:36:20.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T15:36:35.696 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-07-14T15:36:44.148 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-07-14T15:36:44.698 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-07-14T15:36:44.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T15:36:53.156 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-07-14T15:36:53.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T15:37:03.088 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-07-14T15:37:15.097 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-07-14T15:37:15.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T15:37:20.471 DEBUG:teuthology.orchestra.run.smithi037:> true 2023-07-14T15:37:20.909 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-07-14T15:37:20.909 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.5.0-rc1-ga440c79eee02"... 2023-07-14T15:37:20.910 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2023-07-14T15:37:20.951 INFO:teuthology.orchestra.run.smithi037.stdout:6.5.0-rc1-ga440c79eee02 2023-07-14T15:37:20.952 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc1-ga440c79eee02 vs 6.5.0-rc1-ga440c79eee02 2023-07-14T15:37:20.952 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-14T15:37:20.952 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-07-14T15:37:21.953 DEBUG:teuthology.parallel:result is None 2023-07-14T15:37:53.159 DEBUG:teuthology.orchestra.remote:timed out 2023-07-14T15:38:05.160 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-07-14T15:38:05.161 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T15:38:10.529 DEBUG:teuthology.orchestra.run.smithi098:> true 2023-07-14T15:38:10.951 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-07-14T15:38:10.952 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.5.0-rc1-ga440c79eee02"... 2023-07-14T15:38:10.952 DEBUG:teuthology.orchestra.run.smithi098:> uname -r 2023-07-14T15:38:10.995 INFO:teuthology.orchestra.run.smithi098.stdout:6.5.0-rc1-ga440c79eee02 2023-07-14T15:38:10.995 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc1-ga440c79eee02 vs 6.5.0-rc1-ga440c79eee02 2023-07-14T15:38:10.995 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-14T15:38:10.996 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-07-14T15:38:11.996 DEBUG:teuthology.parallel:result is None 2023-07-14T15:38:11.997 INFO:teuthology.run_tasks:Running task internal.base... 2023-07-14T15:38:12.004 INFO:teuthology.task.internal:Creating test directory... 2023-07-14T15:38:12.004 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-14T15:38:12.009 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-14T15:38:12.055 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-07-14T15:38:12.066 INFO:teuthology.run_tasks:Running task internal.archive... 2023-07-14T15:38:12.082 INFO:teuthology.task.internal:Creating archive directory... 2023-07-14T15:38:12.083 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-14T15:38:12.087 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-14T15:38:12.192 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-07-14T15:38:12.199 INFO:teuthology.task.internal:Enabling coredump saving... 2023-07-14T15:38:12.199 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-14T15:38:12.204 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-14T15:38:12.334 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-14T15:38:12.341 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-14T15:38:12.370 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-14T15:38:12.373 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-14T15:38:12.376 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-07-14T15:38:12.383 INFO:teuthology.task.internal:Configuring sudo... 2023-07-14T15:38:12.383 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-14T15:38:12.388 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-14T15:38:12.457 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-07-14T15:38:12.466 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-07-14T15:38:12.467 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-14T15:38:12.472 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-14T15:38:12.514 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-14T15:38:16.270 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-14T15:38:16.378 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-14T15:38:16.454 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-14T15:38:16.523 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-14T15:38:16.524 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-14T15:38:16.594 DEBUG:teuthology.orchestra.run.smithi098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-14T15:38:21.584 DEBUG:teuthology.orchestra.run.smithi098:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-14T15:38:21.681 DEBUG:teuthology.orchestra.run.smithi098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-14T15:38:21.755 DEBUG:teuthology.orchestra.run.smithi098:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-14T15:38:21.824 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-14T15:38:21.825 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-14T15:38:21.892 DEBUG:teuthology.orchestra.run.smithi037:> sudo service rsyslog restart 2023-07-14T15:38:21.897 DEBUG:teuthology.orchestra.run.smithi098:> sudo service rsyslog restart 2023-07-14T15:38:22.014 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-14T15:38:22.050 INFO:teuthology.orchestra.run.smithi098.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-14T15:38:22.337 INFO:teuthology.run_tasks:Running task internal.timer... 2023-07-14T15:38:22.346 INFO:teuthology.task.internal:Starting timer... 2023-07-14T15:38:22.347 INFO:teuthology.run_tasks:Running task pcp... 2023-07-14T15:38:22.380 INFO:teuthology.run_tasks:Running task selinux... 2023-07-14T15:38:22.419 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-07-14T15:38:22.419 DEBUG:teuthology.orchestra.run.smithi037:> sudo service auditd rotate 2023-07-14T15:38:22.552 INFO:teuthology.orchestra.run.smithi037.stdout:Rotating logs: 2023-07-14T15:38:22.556 DEBUG:teuthology.orchestra.run.smithi098:> sudo service auditd rotate 2023-07-14T15:38:22.681 INFO:teuthology.orchestra.run.smithi098.stdout:Rotating logs: 2023-07-14T15:38:22.685 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-07-14T15:38:22.685 DEBUG:teuthology.orchestra.run.smithi037:> /usr/sbin/getenforce 2023-07-14T15:38:22.742 INFO:teuthology.orchestra.run.smithi037.stdout:Permissive 2023-07-14T15:38:22.743 DEBUG:teuthology.orchestra.run.smithi098:> /usr/sbin/getenforce 2023-07-14T15:38:22.797 INFO:teuthology.orchestra.run.smithi098.stdout:Permissive 2023-07-14T15:38:22.798 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi037.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi098.front.sepia.ceph.com': 'permissive'} 2023-07-14T15:38:22.798 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-14T15:38:22.873 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T15:38:22.874 DEBUG:teuthology.orchestra.run.smithi098:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-14T15:38:22.944 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T15:38:22.945 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-07-14T15:38:22.946 DEBUG:teuthology.orchestra.run.smithi037:> sudo /usr/sbin/setenforce permissive 2023-07-14T15:38:23.016 DEBUG:teuthology.orchestra.run.smithi098:> sudo /usr/sbin/setenforce permissive 2023-07-14T15:38:23.092 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-07-14T15:38:23.106 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-07-14T15:38:23.113 INFO:teuthology.repo_utils:Fetching main from origin 2023-07-14T15:38:23.247 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-07-14T15:38:23.273 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-07-14T15:38:23.274 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi037.front.sepia.ceph.com,smithi098.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-07-14T15:50:57.566 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi037.front.sepia.ceph.com'), Remote(name='ubuntu@smithi098.front.sepia.ceph.com')] 2023-07-14T15:50:57.567 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-07-14T15:50:57.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T15:50:57.659 DEBUG:teuthology.orchestra.run.smithi037:> true 2023-07-14T15:50:57.775 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-07-14T15:50:57.775 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-07-14T15:50:57.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T15:50:57.865 DEBUG:teuthology.orchestra.run.smithi098:> true 2023-07-14T15:50:57.981 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-07-14T15:50:57.982 INFO:teuthology.run_tasks:Running task clock... 2023-07-14T15:50:57.993 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-07-14T15:50:57.993 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-14T15:50:57.994 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-14T15:50:57.998 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-14T15:50:57.999 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-14T15:50:58.070 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-14T15:50:58.093 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-14T15:50:58.106 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-14T15:50:58.127 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-14T15:50:58.204 INFO:teuthology.orchestra.run.smithi037.stderr:sudo: ntpd: command not found 2023-07-14T15:50:58.217 INFO:teuthology.orchestra.run.smithi098.stderr:sudo: ntpd: command not found 2023-07-14T15:50:58.234 INFO:teuthology.orchestra.run.smithi037.stdout:506 Cannot talk to daemon 2023-07-14T15:50:58.246 INFO:teuthology.orchestra.run.smithi098.stdout:506 Cannot talk to daemon 2023-07-14T15:50:58.269 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-14T15:50:58.281 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-14T15:50:58.303 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-14T15:50:58.315 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-14T15:50:58.393 INFO:teuthology.orchestra.run.smithi037.stderr:bash: ntpq: command not found 2023-07-14T15:50:58.398 INFO:teuthology.orchestra.run.smithi098.stderr:bash: ntpq: command not found 2023-07-14T15:50:58.400 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-14T15:50:58.400 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2023-07-14T15:50:58.400 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T15:50:58.400 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T15:50:58.401 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T15:50:58.401 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T15:50:58.405 INFO:teuthology.orchestra.run.smithi098.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-14T15:50:58.405 INFO:teuthology.orchestra.run.smithi098.stdout:=============================================================================== 2023-07-14T15:50:58.406 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T15:50:58.406 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T15:50:58.406 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T15:50:58.406 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T15:50:58.407 INFO:teuthology.run_tasks:Running task install... 2023-07-14T15:50:58.416 DEBUG:teuthology.task.install:project ceph 2023-07-14T15:50:58.417 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3fc0089cc1082313a98853d48b892acdc1385b8b'}} 2023-07-14T15:50:58.417 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '3fc0089cc1082313a98853d48b892acdc1385b8b'} 2023-07-14T15:50:58.417 INFO:teuthology.task.install:Using flavor: default 2023-07-14T15:50:58.423 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-07-14T15:50:58.424 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-07-14T15:50:58.425 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3fc0089cc1082313a98853d48b892acdc1385b8b', 'tag': None, 'wait_for_package': False} 2023-07-14T15:50:58.425 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3fc0089cc1082313a98853d48b892acdc1385b8b 2023-07-14T15:50:58.428 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3fc0089cc1082313a98853d48b892acdc1385b8b', 'tag': None, 'wait_for_package': False} 2023-07-14T15:50:58.428 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3fc0089cc1082313a98853d48b892acdc1385b8b 2023-07-14T15:51:08.734 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/centos/8/flavors/default/ 2023-07-14T15:51:08.735 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4757.g3fc0089c 2023-07-14T15:51:13.743 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/centos/8/flavors/default/ 2023-07-14T15:51:13.743 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4757.g3fc0089c 2023-07-14T15:51:18.985 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-14T15:51:18.985 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-14T15:51:18.986 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-14T15:51:19.038 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-14T15:51:19.038 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-14T15:51:19.039 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-14T15:51:19.065 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-07-14T15:51:19.065 DEBUG:teuthology.orchestra.run.smithi037:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3fc0089cc1082313a98853d48b892acdc1385b8b/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-14T15:51:19.113 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-07-14T15:51:19.114 DEBUG:teuthology.orchestra.run.smithi098:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3fc0089cc1082313a98853d48b892acdc1385b8b/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-14T15:51:19.179 DEBUG:teuthology.orchestra.run.smithi037:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-14T15:51:19.226 DEBUG:teuthology.orchestra.run.smithi098:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-14T15:51:19.278 DEBUG:teuthology.orchestra.run.smithi037:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-14T15:51:19.320 DEBUG:teuthology.orchestra.run.smithi098:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-14T15:51:19.347 INFO:teuthology.orchestra.run.smithi037.stdout:check_obsoletes = 1 2023-07-14T15:51:19.350 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum clean all 2023-07-14T15:51:19.387 INFO:teuthology.orchestra.run.smithi098.stdout:check_obsoletes = 1 2023-07-14T15:51:19.390 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum clean all 2023-07-14T15:51:19.831 INFO:teuthology.orchestra.run.smithi037.stdout:Updating Subscription Management repositories. 2023-07-14T15:51:19.832 INFO:teuthology.orchestra.run.smithi098.stdout:Updating Subscription Management repositories. 2023-07-14T15:51:20.187 INFO:teuthology.orchestra.run.smithi098.stdout:44 files removed 2023-07-14T15:51:20.201 INFO:teuthology.orchestra.run.smithi037.stdout:44 files removed 2023-07-14T15:51:20.243 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-07-14T15:51:20.257 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-07-14T15:51:20.685 INFO:teuthology.orchestra.run.smithi098.stdout:Updating Subscription Management repositories. 2023-07-14T15:51:20.738 INFO:teuthology.orchestra.run.smithi037.stdout:Updating Subscription Management repositories. 2023-07-14T15:51:21.719 INFO:teuthology.orchestra.run.smithi098.stdout:ceph packages for x86_64 137 kB/s | 81 kB 00:00 2023-07-14T15:51:21.817 INFO:teuthology.orchestra.run.smithi037.stdout:ceph packages for x86_64 128 kB/s | 81 kB 00:00 2023-07-14T15:51:22.321 INFO:teuthology.orchestra.run.smithi098.stdout:ceph noarch packages 17 kB/s | 9.4 kB 00:00 2023-07-14T15:51:22.453 INFO:teuthology.orchestra.run.smithi037.stdout:ceph noarch packages 16 kB/s | 9.4 kB 00:00 2023-07-14T15:51:22.988 INFO:teuthology.orchestra.run.smithi098.stdout:ceph source packages 2.3 kB/s | 1.5 kB 00:00 2023-07-14T15:51:23.129 INFO:teuthology.orchestra.run.smithi037.stdout:ceph source packages 2.3 kB/s | 1.5 kB 00:00 2023-07-14T15:51:23.430 INFO:teuthology.orchestra.run.smithi098.stdout:Copr repo for python3-asyncssh owned by ceph 8.2 kB/s | 3.5 kB 00:00 2023-07-14T15:51:23.514 INFO:teuthology.orchestra.run.smithi037.stdout:Copr repo for python3-asyncssh owned by ceph 9.6 kB/s | 3.5 kB 00:00 2023-07-14T15:51:25.139 INFO:teuthology.orchestra.run.smithi098.stdout:Extra Packages for Enterprise Linux 9.2 MB/s | 16 MB 00:01 2023-07-14T15:51:27.546 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 3.9 MB/s | 16 MB 00:04 2023-07-14T15:51:29.147 INFO:teuthology.orchestra.run.smithi098.stdout:lab-extras 511 kB/s | 24 kB 00:00 2023-07-14T15:51:30.258 INFO:teuthology.orchestra.run.smithi098.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 46 MB/s | 47 MB 00:01 2023-07-14T15:51:31.871 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 379 kB/s | 24 kB 00:00 2023-07-14T15:51:33.057 INFO:teuthology.orchestra.run.smithi037.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 43 MB/s | 47 MB 00:01 2023-07-14T15:51:38.742 INFO:teuthology.orchestra.run.smithi098.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 49 MB/s | 53 MB 00:01 2023-07-14T15:51:42.474 INFO:teuthology.orchestra.run.smithi037.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 48 MB/s | 53 MB 00:01 2023-07-14T15:51:50.147 INFO:teuthology.orchestra.run.smithi098.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-14T15:51:50.148 INFO:teuthology.orchestra.run.smithi098.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-14T15:51:50.162 INFO:teuthology.orchestra.run.smithi098.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-07-14T15:51:50.164 INFO:teuthology.orchestra.run.smithi098.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-07-14T15:51:50.165 INFO:teuthology.orchestra.run.smithi098.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-07-14T15:51:50.166 INFO:teuthology.orchestra.run.smithi098.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-14T15:51:50.168 INFO:teuthology.orchestra.run.smithi098.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-14T15:51:50.172 INFO:teuthology.orchestra.run.smithi098.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-14T15:51:50.173 INFO:teuthology.orchestra.run.smithi098.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-14T15:51:50.311 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2023-07-14T15:51:50.324 INFO:teuthology.orchestra.run.smithi098.stdout:=========================================================================================================================== 2023-07-14T15:51:50.324 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2023-07-14T15:51:50.324 INFO:teuthology.orchestra.run.smithi098.stdout:=========================================================================================================================== 2023-07-14T15:51:50.324 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2023-07-14T15:51:50.325 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-07-14T15:51:50.325 INFO:teuthology.orchestra.run.smithi098.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-07-14T15:51:50.325 INFO:teuthology.orchestra.run.smithi098.stdout: ceph x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 6.4 k 2023-07-14T15:51:50.325 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-base x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 5.4 M 2023-07-14T15:51:50.325 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-fuse x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 848 k 2023-07-14T15:51:50.325 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 165 k 2023-07-14T15:51:50.326 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 1.5 M 2023-07-14T15:51:50.326 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 129 k 2023-07-14T15:51:50.326 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 1.7 M 2023-07-14T15:51:50.326 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 7.4 M 2023-07-14T15:51:50.326 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-rook noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 47 k 2023-07-14T15:51:50.326 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-radosgw x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 13 M 2023-07-14T15:51:50.326 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-test x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 48 M 2023-07-14T15:51:50.327 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-volume noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 258 k 2023-07-14T15:51:50.327 INFO:teuthology.orchestra.run.smithi098.stdout: cephadm noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 166 k 2023-07-14T15:51:50.327 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-mirror x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 258 k 2023-07-14T15:51:50.327 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-top noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 18 k 2023-07-14T15:51:50.327 INFO:teuthology.orchestra.run.smithi098.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-07-14T15:51:50.327 INFO:teuthology.orchestra.run.smithi098.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-07-14T15:51:50.327 INFO:teuthology.orchestra.run.smithi098.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-07-14T15:51:50.327 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs-devel x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 31 k 2023-07-14T15:51:50.328 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs2 x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 771 k 2023-07-14T15:51:50.328 INFO:teuthology.orchestra.run.smithi098.stdout: librados-devel x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 139 k 2023-07-14T15:51:50.328 INFO:teuthology.orchestra.run.smithi098.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-07-14T15:51:50.328 INFO:teuthology.orchestra.run.smithi098.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-07-14T15:51:50.328 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-07-14T15:51:50.328 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-07-14T15:51:50.328 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-07-14T15:51:50.328 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-07-14T15:51:50.329 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cephfs x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 197 k 2023-07-14T15:51:50.329 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rados x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 371 k 2023-07-14T15:51:50.329 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rbd x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 364 k 2023-07-14T15:51:50.329 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rgw x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 107 k 2023-07-14T15:51:50.329 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-fuse x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 94 k 2023-07-14T15:51:50.329 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-mirror x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 3.4 M 2023-07-14T15:51:50.329 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-nbd x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 179 k 2023-07-14T15:51:50.330 INFO:teuthology.orchestra.run.smithi098.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-07-14T15:51:50.330 INFO:teuthology.orchestra.run.smithi098.stdout:Upgrading: 2023-07-14T15:51:50.330 INFO:teuthology.orchestra.run.smithi098.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-07-14T15:51:50.330 INFO:teuthology.orchestra.run.smithi098.stdout: librados2 x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 3.7 M 2023-07-14T15:51:50.330 INFO:teuthology.orchestra.run.smithi098.stdout: librbd1 x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 3.6 M 2023-07-14T15:51:50.330 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2023-07-14T15:51:50.330 INFO:teuthology.orchestra.run.smithi098.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-07-14T15:51:50.330 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-common x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 22 M 2023-07-14T15:51:50.331 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 23 k 2023-07-14T15:51:50.331 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mds x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 2.3 M 2023-07-14T15:51:50.331 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 240 k 2023-07-14T15:51:50.331 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mon x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 4.6 M 2023-07-14T15:51:50.331 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-osd x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 18 M 2023-07-14T15:51:50.331 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 15 k 2023-07-14T15:51:50.331 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-selinux x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 24 k 2023-07-14T15:51:50.331 INFO:teuthology.orchestra.run.smithi098.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-07-14T15:51:50.332 INFO:teuthology.orchestra.run.smithi098.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-14T15:51:50.332 INFO:teuthology.orchestra.run.smithi098.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-07-14T15:51:50.332 INFO:teuthology.orchestra.run.smithi098.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-07-14T15:51:50.332 INFO:teuthology.orchestra.run.smithi098.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-07-14T15:51:50.332 INFO:teuthology.orchestra.run.smithi098.stdout: libcephsqlite x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 137 k 2023-07-14T15:51:50.332 INFO:teuthology.orchestra.run.smithi098.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-07-14T15:51:50.332 INFO:teuthology.orchestra.run.smithi098.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-07-14T15:51:50.333 INFO:teuthology.orchestra.run.smithi098.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-14T15:51:50.333 INFO:teuthology.orchestra.run.smithi098.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-07-14T15:51:50.333 INFO:teuthology.orchestra.run.smithi098.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-07-14T15:51:50.333 INFO:teuthology.orchestra.run.smithi098.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-07-14T15:51:50.333 INFO:teuthology.orchestra.run.smithi098.stdout: libradosstriper1 x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 473 k 2023-07-14T15:51:50.333 INFO:teuthology.orchestra.run.smithi098.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-07-14T15:51:50.333 INFO:teuthology.orchestra.run.smithi098.stdout: librgw2 x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 6.7 M 2023-07-14T15:51:50.333 INFO:teuthology.orchestra.run.smithi098.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-07-14T15:51:50.334 INFO:teuthology.orchestra.run.smithi098.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-07-14T15:51:50.334 INFO:teuthology.orchestra.run.smithi098.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-14T15:51:50.334 INFO:teuthology.orchestra.run.smithi098.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-07-14T15:51:50.334 INFO:teuthology.orchestra.run.smithi098.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-07-14T15:51:50.334 INFO:teuthology.orchestra.run.smithi098.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-07-14T15:51:50.334 INFO:teuthology.orchestra.run.smithi098.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-07-14T15:51:50.334 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-07-14T15:51:50.334 INFO:teuthology.orchestra.run.smithi098.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-07-14T15:51:50.335 INFO:teuthology.orchestra.run.smithi098.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-07-14T15:51:50.335 INFO:teuthology.orchestra.run.smithi098.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-07-14T15:51:50.335 INFO:teuthology.orchestra.run.smithi098.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-14T15:51:50.335 INFO:teuthology.orchestra.run.smithi098.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-07-14T15:51:50.335 INFO:teuthology.orchestra.run.smithi098.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-14T15:51:50.335 INFO:teuthology.orchestra.run.smithi098.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-14T15:51:50.335 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-14T15:51:50.336 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-argparse x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 45 k 2023-07-14T15:51:50.336 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-common x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 119 k 2023-07-14T15:51:50.336 INFO:teuthology.orchestra.run.smithi098.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-14T15:51:50.336 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-07-14T15:51:50.336 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-14T15:51:50.336 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-14T15:51:50.336 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-07-14T15:51:50.336 INFO:teuthology.orchestra.run.smithi098.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-14T15:51:50.337 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-14T15:51:50.337 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-14T15:51:50.337 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-07-14T15:51:50.337 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-07-14T15:51:50.337 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-07-14T15:51:50.337 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-14T15:51:50.337 INFO:teuthology.orchestra.run.smithi098.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-14T15:51:50.337 INFO:teuthology.orchestra.run.smithi098.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-14T15:51:50.338 INFO:teuthology.orchestra.run.smithi098.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-07-14T15:51:50.338 INFO:teuthology.orchestra.run.smithi098.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-07-14T15:51:50.338 INFO:teuthology.orchestra.run.smithi098.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-14T15:51:50.338 INFO:teuthology.orchestra.run.smithi098.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-14T15:51:50.338 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-07-14T15:51:50.338 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-07-14T15:51:50.338 INFO:teuthology.orchestra.run.smithi098.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-07-14T15:51:50.339 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-14T15:51:50.339 INFO:teuthology.orchestra.run.smithi098.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-14T15:51:50.339 INFO:teuthology.orchestra.run.smithi098.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-07-14T15:51:50.339 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-07-14T15:51:50.339 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-07-14T15:51:50.339 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-07-14T15:51:50.339 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-07-14T15:51:50.339 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-07-14T15:51:50.340 INFO:teuthology.orchestra.run.smithi098.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-14T15:51:50.340 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-14T15:51:50.340 INFO:teuthology.orchestra.run.smithi098.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-14T15:51:50.340 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-07-14T15:51:50.340 INFO:teuthology.orchestra.run.smithi098.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-07-14T15:51:50.340 INFO:teuthology.orchestra.run.smithi098.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-14T15:51:50.340 INFO:teuthology.orchestra.run.smithi098.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-14T15:51:50.340 INFO:teuthology.orchestra.run.smithi098.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-14T15:51:50.341 INFO:teuthology.orchestra.run.smithi098.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-14T15:51:50.341 INFO:teuthology.orchestra.run.smithi098.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-14T15:51:50.341 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-14T15:51:50.341 INFO:teuthology.orchestra.run.smithi098.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-14T15:51:50.341 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-14T15:51:50.341 INFO:teuthology.orchestra.run.smithi098.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-07-14T15:51:50.341 INFO:teuthology.orchestra.run.smithi098.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-14T15:51:50.341 INFO:teuthology.orchestra.run.smithi098.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-07-14T15:51:50.342 INFO:teuthology.orchestra.run.smithi098.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-14T15:51:50.342 INFO:teuthology.orchestra.run.smithi098.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-07-14T15:51:50.342 INFO:teuthology.orchestra.run.smithi098.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-07-14T15:51:50.342 INFO:teuthology.orchestra.run.smithi098.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-07-14T15:51:50.342 INFO:teuthology.orchestra.run.smithi098.stdout:Enabling module streams: 2023-07-14T15:51:50.342 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql 10 2023-07-14T15:51:50.342 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-14T15:51:50.343 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2023-07-14T15:51:50.343 INFO:teuthology.orchestra.run.smithi098.stdout:=========================================================================================================================== 2023-07-14T15:51:50.343 INFO:teuthology.orchestra.run.smithi098.stdout:Install 128 Packages 2023-07-14T15:51:50.343 INFO:teuthology.orchestra.run.smithi098.stdout:Upgrade 3 Packages 2023-07-14T15:51:50.343 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-14T15:51:50.344 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 205 M 2023-07-14T15:51:50.344 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2023-07-14T15:51:50.893 INFO:teuthology.orchestra.run.smithi098.stdout:(1/131): ceph-18.0.0-4757.g3fc0089c.el8.x86_64. 23 kB/s | 6.4 kB 00:00 2023-07-14T15:51:51.626 INFO:teuthology.orchestra.run.smithi098.stdout:(2/131): ceph-fuse-18.0.0-4757.g3fc0089c.el8.x8 1.1 MB/s | 848 kB 00:00 2023-07-14T15:51:51.793 INFO:teuthology.orchestra.run.smithi098.stdout:(3/131): ceph-immutable-object-cache-18.0.0-475 992 kB/s | 165 kB 00:00 2023-07-14T15:51:52.785 INFO:teuthology.orchestra.run.smithi098.stdout:(4/131): ceph-base-18.0.0-4757.g3fc0089c.el8.x8 2.5 MB/s | 5.4 MB 00:02 2023-07-14T15:51:53.185 INFO:teuthology.orchestra.run.smithi098.stdout:(5/131): ceph-mgr-18.0.0-4757.g3fc0089c.el8.x86 3.9 MB/s | 1.5 MB 00:00 2023-07-14T15:51:53.336 INFO:teuthology.orchestra.run.smithi098.stdout:(6/131): ceph-mds-18.0.0-4757.g3fc0089c.el8.x86 1.5 MB/s | 2.3 MB 00:01 2023-07-14T15:51:53.911 INFO:teuthology.orchestra.run.smithi098.stdout:(7/131): ceph-mon-18.0.0-4757.g3fc0089c.el8.x86 6.4 MB/s | 4.6 MB 00:00 2023-07-14T15:51:54.669 INFO:teuthology.orchestra.run.smithi098.stdout:(8/131): ceph-common-18.0.0-4757.g3fc0089c.el8. 5.4 MB/s | 22 MB 00:04 2023-07-14T15:51:54.736 INFO:teuthology.orchestra.run.smithi098.stdout:(9/131): ceph-selinux-18.0.0-4757.g3fc0089c.el8 365 kB/s | 24 kB 00:00 2023-07-14T15:51:55.061 INFO:teuthology.orchestra.run.smithi037.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-14T15:51:55.062 INFO:teuthology.orchestra.run.smithi037.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-14T15:51:55.078 INFO:teuthology.orchestra.run.smithi037.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-07-14T15:51:55.079 INFO:teuthology.orchestra.run.smithi037.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-07-14T15:51:55.080 INFO:teuthology.orchestra.run.smithi037.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-07-14T15:51:55.082 INFO:teuthology.orchestra.run.smithi037.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-14T15:51:55.084 INFO:teuthology.orchestra.run.smithi037.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-14T15:51:55.087 INFO:teuthology.orchestra.run.smithi037.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-14T15:51:55.089 INFO:teuthology.orchestra.run.smithi037.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-14T15:51:55.239 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2023-07-14T15:51:55.253 INFO:teuthology.orchestra.run.smithi037.stdout:=========================================================================================================================== 2023-07-14T15:51:55.253 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2023-07-14T15:51:55.253 INFO:teuthology.orchestra.run.smithi037.stdout:=========================================================================================================================== 2023-07-14T15:51:55.253 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2023-07-14T15:51:55.254 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-07-14T15:51:55.254 INFO:teuthology.orchestra.run.smithi037.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-07-14T15:51:55.254 INFO:teuthology.orchestra.run.smithi037.stdout: ceph x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 6.4 k 2023-07-14T15:51:55.254 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 5.4 M 2023-07-14T15:51:55.254 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 848 k 2023-07-14T15:51:55.254 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 165 k 2023-07-14T15:51:55.254 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 1.5 M 2023-07-14T15:51:55.255 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 129 k 2023-07-14T15:51:55.255 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 1.7 M 2023-07-14T15:51:55.255 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 7.4 M 2023-07-14T15:51:55.255 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 47 k 2023-07-14T15:51:55.255 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 13 M 2023-07-14T15:51:55.255 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 48 M 2023-07-14T15:51:55.255 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 258 k 2023-07-14T15:51:55.256 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 166 k 2023-07-14T15:51:55.256 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-mirror x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 258 k 2023-07-14T15:51:55.256 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-top noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 18 k 2023-07-14T15:51:55.256 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-07-14T15:51:55.256 INFO:teuthology.orchestra.run.smithi037.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-07-14T15:51:55.257 INFO:teuthology.orchestra.run.smithi037.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-07-14T15:51:55.257 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 31 k 2023-07-14T15:51:55.257 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2 x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 771 k 2023-07-14T15:51:55.257 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 139 k 2023-07-14T15:51:55.257 INFO:teuthology.orchestra.run.smithi037.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-07-14T15:51:55.257 INFO:teuthology.orchestra.run.smithi037.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-07-14T15:51:55.257 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-07-14T15:51:55.257 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-07-14T15:51:55.258 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-07-14T15:51:55.258 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-07-14T15:51:55.258 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 197 k 2023-07-14T15:51:55.258 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 371 k 2023-07-14T15:51:55.258 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 364 k 2023-07-14T15:51:55.258 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 107 k 2023-07-14T15:51:55.258 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 94 k 2023-07-14T15:51:55.258 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 3.4 M 2023-07-14T15:51:55.259 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 179 k 2023-07-14T15:51:55.259 INFO:teuthology.orchestra.run.smithi037.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-07-14T15:51:55.259 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrading: 2023-07-14T15:51:55.259 INFO:teuthology.orchestra.run.smithi037.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-07-14T15:51:55.259 INFO:teuthology.orchestra.run.smithi037.stdout: librados2 x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 3.7 M 2023-07-14T15:51:55.259 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1 x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 3.6 M 2023-07-14T15:51:55.259 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2023-07-14T15:51:55.260 INFO:teuthology.orchestra.run.smithi037.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-07-14T15:51:55.260 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 22 M 2023-07-14T15:51:55.260 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 23 k 2023-07-14T15:51:55.260 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 2.3 M 2023-07-14T15:51:55.260 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 240 k 2023-07-14T15:51:55.260 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 4.6 M 2023-07-14T15:51:55.261 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 18 M 2023-07-14T15:51:55.261 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 15 k 2023-07-14T15:51:55.261 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 24 k 2023-07-14T15:51:55.261 INFO:teuthology.orchestra.run.smithi037.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-07-14T15:51:55.261 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-14T15:51:55.261 INFO:teuthology.orchestra.run.smithi037.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-07-14T15:51:55.261 INFO:teuthology.orchestra.run.smithi037.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-07-14T15:51:55.261 INFO:teuthology.orchestra.run.smithi037.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-07-14T15:51:55.262 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 137 k 2023-07-14T15:51:55.262 INFO:teuthology.orchestra.run.smithi037.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-07-14T15:51:55.262 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-07-14T15:51:55.262 INFO:teuthology.orchestra.run.smithi037.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-14T15:51:55.262 INFO:teuthology.orchestra.run.smithi037.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-07-14T15:51:55.262 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-07-14T15:51:55.262 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-07-14T15:51:55.263 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1 x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 473 k 2023-07-14T15:51:55.263 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-07-14T15:51:55.263 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2 x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 6.7 M 2023-07-14T15:51:55.263 INFO:teuthology.orchestra.run.smithi037.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-07-14T15:51:55.263 INFO:teuthology.orchestra.run.smithi037.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-07-14T15:51:55.263 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-14T15:51:55.264 INFO:teuthology.orchestra.run.smithi037.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-07-14T15:51:55.264 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-07-14T15:51:55.264 INFO:teuthology.orchestra.run.smithi037.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-07-14T15:51:55.264 INFO:teuthology.orchestra.run.smithi037.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-07-14T15:51:55.264 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-07-14T15:51:55.264 INFO:teuthology.orchestra.run.smithi037.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-07-14T15:51:55.265 INFO:teuthology.orchestra.run.smithi037.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-07-14T15:51:55.265 INFO:teuthology.orchestra.run.smithi037.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-07-14T15:51:55.265 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-14T15:51:55.265 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-07-14T15:51:55.265 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-14T15:51:55.265 INFO:teuthology.orchestra.run.smithi037.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-14T15:51:55.266 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-14T15:51:55.266 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 45 k 2023-07-14T15:51:55.266 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 119 k 2023-07-14T15:51:55.266 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-14T15:51:55.266 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-07-14T15:51:55.266 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-14T15:51:55.267 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-14T15:51:55.267 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-07-14T15:51:55.267 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-14T15:51:55.267 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-14T15:51:55.267 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-14T15:51:55.267 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-07-14T15:51:55.267 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-07-14T15:51:55.268 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-07-14T15:51:55.268 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-14T15:51:55.268 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-14T15:51:55.268 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-14T15:51:55.268 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-07-14T15:51:55.269 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-07-14T15:51:55.269 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-14T15:51:55.269 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-14T15:51:55.269 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-07-14T15:51:55.270 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-07-14T15:51:55.270 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-07-14T15:51:55.270 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-14T15:51:55.270 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-14T15:51:55.271 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-07-14T15:51:55.271 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-07-14T15:51:55.271 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-07-14T15:51:55.271 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-07-14T15:51:55.272 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-07-14T15:51:55.272 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-07-14T15:51:55.272 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-14T15:51:55.273 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-14T15:51:55.273 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-14T15:51:55.273 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-07-14T15:51:55.273 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-07-14T15:51:55.274 INFO:teuthology.orchestra.run.smithi037.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-14T15:51:55.274 INFO:teuthology.orchestra.run.smithi037.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-14T15:51:55.274 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-14T15:51:55.274 INFO:teuthology.orchestra.run.smithi037.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-14T15:51:55.275 INFO:teuthology.orchestra.run.smithi037.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-14T15:51:55.275 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-14T15:51:55.275 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-14T15:51:55.275 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-14T15:51:55.275 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-07-14T15:51:55.275 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-14T15:51:55.276 INFO:teuthology.orchestra.run.smithi037.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-07-14T15:51:55.276 INFO:teuthology.orchestra.run.smithi037.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-14T15:51:55.276 INFO:teuthology.orchestra.run.smithi037.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-07-14T15:51:55.276 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-07-14T15:51:55.276 INFO:teuthology.orchestra.run.smithi037.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-07-14T15:51:55.276 INFO:teuthology.orchestra.run.smithi037.stdout:Enabling module streams: 2023-07-14T15:51:55.277 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql 10 2023-07-14T15:51:55.277 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:51:55.277 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2023-07-14T15:51:55.277 INFO:teuthology.orchestra.run.smithi037.stdout:=========================================================================================================================== 2023-07-14T15:51:55.277 INFO:teuthology.orchestra.run.smithi037.stdout:Install 128 Packages 2023-07-14T15:51:55.277 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrade 3 Packages 2023-07-14T15:51:55.277 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:51:55.278 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 205 M 2023-07-14T15:51:55.278 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2023-07-14T15:51:55.569 INFO:teuthology.orchestra.run.smithi098.stdout:(10/131): ceph-radosgw-18.0.0-4757.g3fc0089c.el 8.1 MB/s | 13 MB 00:01 2023-07-14T15:51:55.670 INFO:teuthology.orchestra.run.smithi098.stdout:(11/131): cephfs-mirror-18.0.0-4757.g3fc0089c.e 2.5 MB/s | 258 kB 00:00 2023-07-14T15:51:55.766 INFO:teuthology.orchestra.run.smithi098.stdout:(12/131): libcephfs-devel-18.0.0-4757.g3fc0089c 339 kB/s | 31 kB 00:00 2023-07-14T15:51:55.987 INFO:teuthology.orchestra.run.smithi037.stdout:(1/131): ceph-18.0.0-4757.g3fc0089c.el8.x86_64. 15 kB/s | 6.4 kB 00:00 2023-07-14T15:51:56.095 INFO:teuthology.orchestra.run.smithi098.stdout:(13/131): libcephfs2-18.0.0-4757.g3fc0089c.el8. 2.3 MB/s | 771 kB 00:00 2023-07-14T15:51:56.204 INFO:teuthology.orchestra.run.smithi098.stdout:(14/131): libcephsqlite-18.0.0-4757.g3fc0089c.e 1.2 MB/s | 137 kB 00:00 2023-07-14T15:51:56.312 INFO:teuthology.orchestra.run.smithi098.stdout:(15/131): librados-devel-18.0.0-4757.g3fc0089c. 1.3 MB/s | 139 kB 00:00 2023-07-14T15:51:56.421 INFO:teuthology.orchestra.run.smithi098.stdout:(16/131): libradosstriper1-18.0.0-4757.g3fc0089 4.3 MB/s | 473 kB 00:00 2023-07-14T15:51:57.049 INFO:teuthology.orchestra.run.smithi037.stdout:(2/131): ceph-fuse-18.0.0-4757.g3fc0089c.el8.x8 799 kB/s | 848 kB 00:01 2023-07-14T15:51:57.284 INFO:teuthology.orchestra.run.smithi037.stdout:(3/131): ceph-immutable-object-cache-18.0.0-475 707 kB/s | 165 kB 00:00 2023-07-14T15:51:57.472 INFO:teuthology.orchestra.run.smithi098.stdout:(17/131): librgw2-18.0.0-4757.g3fc0089c.el8.x86 6.4 MB/s | 6.7 MB 00:01 2023-07-14T15:51:57.605 INFO:teuthology.orchestra.run.smithi098.stdout:(18/131): python3-ceph-argparse-18.0.0-4757.g3f 335 kB/s | 45 kB 00:00 2023-07-14T15:51:57.706 INFO:teuthology.orchestra.run.smithi098.stdout:(19/131): python3-ceph-common-18.0.0-4757.g3fc0 1.2 MB/s | 119 kB 00:00 2023-07-14T15:51:57.806 INFO:teuthology.orchestra.run.smithi098.stdout:(20/131): python3-cephfs-18.0.0-4757.g3fc0089c. 1.9 MB/s | 197 kB 00:00 2023-07-14T15:51:57.973 INFO:teuthology.orchestra.run.smithi098.stdout:(21/131): python3-rados-18.0.0-4757.g3fc0089c.e 2.2 MB/s | 371 kB 00:00 2023-07-14T15:51:58.124 INFO:teuthology.orchestra.run.smithi098.stdout:(22/131): python3-rbd-18.0.0-4757.g3fc0089c.el8 2.4 MB/s | 364 kB 00:00 2023-07-14T15:51:58.232 INFO:teuthology.orchestra.run.smithi098.stdout:(23/131): python3-rgw-18.0.0-4757.g3fc0089c.el8 987 kB/s | 107 kB 00:00 2023-07-14T15:51:58.324 INFO:teuthology.orchestra.run.smithi098.stdout:(24/131): rbd-fuse-18.0.0-4757.g3fc0089c.el8.x8 1.0 MB/s | 94 kB 00:00 2023-07-14T15:51:58.368 INFO:teuthology.orchestra.run.smithi037.stdout:(4/131): ceph-mds-18.0.0-4757.g3fc0089c.el8.x86 2.1 MB/s | 2.3 MB 00:01 2023-07-14T15:51:58.810 INFO:teuthology.orchestra.run.smithi037.stdout:(5/131): ceph-mgr-18.0.0-4757.g3fc0089c.el8.x86 3.5 MB/s | 1.5 MB 00:00 2023-07-14T15:51:59.016 INFO:teuthology.orchestra.run.smithi098.stdout:(25/131): rbd-mirror-18.0.0-4757.g3fc0089c.el8. 5.0 MB/s | 3.4 MB 00:00 2023-07-14T15:51:59.133 INFO:teuthology.orchestra.run.smithi098.stdout:(26/131): rbd-nbd-18.0.0-4757.g3fc0089c.el8.x86 1.5 MB/s | 179 kB 00:00 2023-07-14T15:51:59.234 INFO:teuthology.orchestra.run.smithi098.stdout:(27/131): ceph-grafana-dashboards-18.0.0-4757.g 231 kB/s | 23 kB 00:00 2023-07-14T15:51:59.293 INFO:teuthology.orchestra.run.smithi037.stdout:(6/131): ceph-base-18.0.0-4757.g3fc0089c.el8.x8 1.4 MB/s | 5.4 MB 00:03 2023-07-14T15:51:59.317 INFO:teuthology.orchestra.run.smithi098.stdout:(28/131): ceph-mgr-cephadm-18.0.0-4757.g3fc0089 1.5 MB/s | 129 kB 00:00 2023-07-14T15:51:59.660 INFO:teuthology.orchestra.run.smithi037.stdout:(7/131): ceph-mon-18.0.0-4757.g3fc0089c.el8.x86 5.4 MB/s | 4.6 MB 00:00 2023-07-14T15:51:59.734 INFO:teuthology.orchestra.run.smithi098.stdout:(29/131): ceph-mgr-dashboard-18.0.0-4757.g3fc00 4.1 MB/s | 1.7 MB 00:00 2023-07-14T15:52:03.510 INFO:teuthology.orchestra.run.smithi037.stdout:(8/131): ceph-radosgw-18.0.0-4757.g3fc0089c.el8 3.5 MB/s | 13 MB 00:03 2023-07-14T15:52:03.635 INFO:teuthology.orchestra.run.smithi037.stdout:(9/131): ceph-selinux-18.0.0-4757.g3fc0089c.el8 196 kB/s | 24 kB 00:00 2023-07-14T15:52:03.784 INFO:teuthology.orchestra.run.smithi098.stdout:(30/131): ceph-osd-18.0.0-4757.g3fc0089c.el8.x8 1.7 MB/s | 18 MB 00:10 2023-07-14T15:52:03.942 INFO:teuthology.orchestra.run.smithi098.stdout:(31/131): ceph-mgr-diskprediction-local-18.0.0- 1.8 MB/s | 7.4 MB 00:04 2023-07-14T15:52:04.158 INFO:teuthology.orchestra.run.smithi098.stdout:(32/131): ceph-mgr-rook-18.0.0-4757.g3fc0089c.e 221 kB/s | 47 kB 00:00 2023-07-14T15:52:04.193 INFO:teuthology.orchestra.run.smithi098.stdout:(33/131): ceph-mgr-modules-core-18.0.0-4757.g3f 588 kB/s | 240 kB 00:00 2023-07-14T15:52:04.269 INFO:teuthology.orchestra.run.smithi098.stdout:(34/131): ceph-prometheus-alerts-18.0.0-4757.g3 132 kB/s | 15 kB 00:00 2023-07-14T15:52:04.594 INFO:teuthology.orchestra.run.smithi098.stdout:(35/131): ceph-volume-18.0.0-4757.g3fc0089c.el8 645 kB/s | 258 kB 00:00 2023-07-14T15:52:04.694 INFO:teuthology.orchestra.run.smithi098.stdout:(36/131): cephadm-18.0.0-4757.g3fc0089c.el8.noa 391 kB/s | 166 kB 00:00 2023-07-14T15:52:04.711 INFO:teuthology.orchestra.run.smithi098.stdout:(37/131): cephfs-top-18.0.0-4757.g3fc0089c.el8. 153 kB/s | 18 kB 00:00 2023-07-14T15:52:05.511 INFO:teuthology.orchestra.run.smithi098.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 73 kB/s | 59 kB 00:00 2023-07-14T15:52:05.786 INFO:teuthology.orchestra.run.smithi098.stdout:(39/131): gperftools-libs-2.7-9.el8.x86_64.rpm 280 kB/s | 306 kB 00:01 2023-07-14T15:52:05.812 INFO:teuthology.orchestra.run.smithi098.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 250 kB/s | 75 kB 00:00 2023-07-14T15:52:05.971 INFO:teuthology.orchestra.run.smithi098.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 275 kB/s | 44 kB 00:00 2023-07-14T15:52:06.349 INFO:teuthology.orchestra.run.smithi098.stdout:(42/131): python3-asyncssh-2.7.0-2.el8.noarch.r 847 kB/s | 476 kB 00:00 2023-07-14T15:52:06.388 INFO:teuthology.orchestra.run.smithi098.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 444 kB/s | 185 kB 00:00 2023-07-14T15:52:06.471 INFO:teuthology.orchestra.run.smithi098.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 270 kB/s | 33 kB 00:00 2023-07-14T15:52:06.539 INFO:teuthology.orchestra.run.smithi098.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 108 kB/s | 16 kB 00:00 2023-07-14T15:52:06.614 INFO:teuthology.orchestra.run.smithi098.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.2 MB/s | 173 kB 00:00 2023-07-14T15:52:06.773 INFO:teuthology.orchestra.run.smithi098.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 514 kB/s | 81 kB 00:00 2023-07-14T15:52:06.840 INFO:teuthology.orchestra.run.smithi098.stdout:(48/131): python3-cherrypy-18.4.0-1.el8.noarch. 1.2 MB/s | 384 kB 00:00 2023-07-14T15:52:06.915 INFO:teuthology.orchestra.run.smithi098.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 78 kB/s | 11 kB 00:00 2023-07-14T15:52:06.990 INFO:teuthology.orchestra.run.smithi098.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 117 kB/s | 18 kB 00:00 2023-07-14T15:52:07.541 INFO:teuthology.orchestra.run.smithi098.stdout:(51/131): ceph-test-18.0.0-4757.g3fc0089c.el8.x 3.7 MB/s | 48 MB 00:12 2023-07-14T15:52:07.566 INFO:teuthology.orchestra.run.smithi098.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 85 kB/s | 49 kB 00:00 2023-07-14T15:52:07.625 INFO:teuthology.orchestra.run.smithi098.stdout:(53/131): python3-kubernetes-11.0.0-6.el8.noarc 1.6 MB/s | 1.2 MB 00:00 2023-07-14T15:52:07.717 INFO:teuthology.orchestra.run.smithi098.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 401 kB/s | 60 kB 00:00 2023-07-14T15:52:07.775 INFO:teuthology.orchestra.run.smithi098.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.8 MB/s | 283 kB 00:00 2023-07-14T15:52:07.842 INFO:teuthology.orchestra.run.smithi098.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 125 kB/s | 16 kB 00:00 2023-07-14T15:52:07.901 INFO:teuthology.orchestra.run.smithi098.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 269 kB/s | 34 kB 00:00 2023-07-14T15:52:07.968 INFO:teuthology.orchestra.run.smithi098.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 1.5 MB/s | 196 kB 00:00 2023-07-14T15:52:08.051 INFO:teuthology.orchestra.run.smithi098.stdout:(59/131): python3-rsa-4.8-1.el8.noarch.rpm 410 kB/s | 61 kB 00:00 2023-07-14T15:52:08.102 INFO:teuthology.orchestra.run.smithi098.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 140 kB/s | 19 kB 00:00 2023-07-14T15:52:08.135 INFO:teuthology.orchestra.run.smithi098.stdout:(61/131): python3-more-itertools-7.2.0-3.el8.no 99 kB/s | 59 kB 00:00 2023-07-14T15:52:08.177 INFO:teuthology.orchestra.run.smithi098.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 190 kB/s | 24 kB 00:00 2023-07-14T15:52:08.236 INFO:teuthology.orchestra.run.smithi098.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 218 kB/s | 29 kB 00:00 2023-07-14T15:52:08.269 INFO:teuthology.orchestra.run.smithi098.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 206 kB/s | 27 kB 00:00 2023-07-14T15:52:08.311 INFO:teuthology.orchestra.run.smithi098.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 1.9 MB/s | 255 kB 00:00 2023-07-14T15:52:08.378 INFO:teuthology.orchestra.run.smithi098.stdout:(66/131): python3-webob-1.8.5-1.el8.1.noarch.rp 1.7 MB/s | 251 kB 00:00 2023-07-14T15:52:08.412 INFO:teuthology.orchestra.run.smithi098.stdout:(67/131): python3-websocket-client-0.56.0-5.el8 430 kB/s | 61 kB 00:00 2023-07-14T15:52:08.446 INFO:teuthology.orchestra.run.smithi098.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 637 kB/s | 85 kB 00:00 2023-07-14T15:52:08.471 INFO:teuthology.orchestra.run.smithi098.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-07-14T15:52:08.538 INFO:teuthology.orchestra.run.smithi098.stdout:(70/131): python3-zc-lockfile-2.0-2.el8.noarch. 144 kB/s | 23 kB 00:00 2023-07-14T15:52:08.605 INFO:teuthology.orchestra.run.smithi098.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.6 MB/s | 110 kB 00:00 2023-07-14T15:52:08.639 INFO:teuthology.orchestra.run.smithi098.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.6 MB/s | 54 kB 00:00 2023-07-14T15:52:08.681 INFO:teuthology.orchestra.run.smithi098.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2023-07-14T15:52:08.731 INFO:teuthology.orchestra.run.smithi098.stdout:(74/131): socat-1.7.4.1-1.el8.x86_64.rpm 6.3 MB/s | 323 kB 00:00 2023-07-14T15:52:08.764 INFO:teuthology.orchestra.run.smithi098.stdout:(75/131): python3-markupsafe-0.23-19.el8.x86_64 1.1 MB/s | 39 kB 00:00 2023-07-14T15:52:08.823 INFO:teuthology.orchestra.run.smithi098.stdout:(76/131): bison-3.0.4-10.el8.x86_64.rpm 12 MB/s | 688 kB 00:00 2023-07-14T15:52:08.873 INFO:teuthology.orchestra.run.smithi098.stdout:(77/131): python3-jinja2-2.10.1-3.el8.noarch.rp 10 MB/s | 538 kB 00:00 2023-07-14T15:52:08.915 INFO:teuthology.orchestra.run.smithi098.stdout:(78/131): python3-mako-1.0.6-13.el8.noarch.rpm 3.7 MB/s | 157 kB 00:00 2023-07-14T15:52:08.957 INFO:teuthology.orchestra.run.smithi098.stdout:(79/131): oniguruma-6.8.2-2.el8.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2023-07-14T15:52:09.141 INFO:teuthology.orchestra.run.smithi098.stdout:(80/131): python3-scipy-1.0.0-21.module+el8.5.0 20 MB/s | 14 MB 00:00 2023-07-14T15:52:09.183 INFO:teuthology.orchestra.run.smithi098.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 3.1 MB/s | 713 kB 00:00 2023-07-14T15:52:09.225 INFO:teuthology.orchestra.run.smithi098.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 637 kB/s | 27 kB 00:00 2023-07-14T15:52:09.275 INFO:teuthology.orchestra.run.smithi098.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 6.3 MB/s | 320 kB 00:00 2023-07-14T15:52:09.309 INFO:teuthology.orchestra.run.smithi098.stdout:(84/131): python3-prettytable-0.7.2-14.el8.noar 1.3 MB/s | 44 kB 00:00 2023-07-14T15:52:09.401 INFO:teuthology.orchestra.run.smithi098.stdout:(85/131): python3-babel-2.5.1-7.el8.noarch.rpm 18 MB/s | 4.8 MB 00:00 2023-07-14T15:52:09.451 INFO:teuthology.orchestra.run.smithi098.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 9.0 MB/s | 457 kB 00:00 2023-07-14T15:52:09.493 INFO:teuthology.orchestra.run.smithi098.stdout:(87/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 5.3 MB/s | 225 kB 00:00 2023-07-14T15:52:09.585 INFO:teuthology.orchestra.run.smithi098.stdout:(88/131): python3-numpy-1.14.3-10.el8.x86_64.rp 14 MB/s | 3.7 MB 00:00 2023-07-14T15:52:09.610 INFO:teuthology.orchestra.run.smithi098.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 546 kB/s | 64 kB 00:00 2023-07-14T15:52:09.644 INFO:teuthology.orchestra.run.smithi098.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.1 MB/s | 126 kB 00:00 2023-07-14T15:52:09.669 INFO:teuthology.orchestra.run.smithi098.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 342 kB/s | 20 kB 00:00 2023-07-14T15:52:09.695 INFO:teuthology.orchestra.run.smithi098.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2023-07-14T15:52:09.728 INFO:teuthology.orchestra.run.smithi098.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 12 MB/s | 709 kB 00:00 2023-07-14T15:52:09.770 INFO:teuthology.orchestra.run.smithi098.stdout:(94/131): libpq-13.5-1.el8.x86_64.rpm 4.7 MB/s | 198 kB 00:00 2023-07-14T15:52:09.904 INFO:teuthology.orchestra.run.smithi098.stdout:(95/131): openblas-threads-0.3.15-3.el8.x86_64. 23 MB/s | 4.9 MB 00:00 2023-07-14T15:52:09.946 INFO:teuthology.orchestra.run.smithi098.stdout:(96/131): thrift-0.13.0-2.el8.x86_64.rpm 1.1 MB/s | 1.7 MB 00:01 2023-07-14T15:52:09.979 INFO:teuthology.orchestra.run.smithi098.stdout:(97/131): jq-1.6-3.el8.x86_64.rpm 2.6 MB/s | 202 kB 00:00 2023-07-14T15:52:10.071 INFO:teuthology.orchestra.run.smithi098.stdout:(98/131): librdkafka-0.11.4-3.el8.x86_64.rpm 2.8 MB/s | 354 kB 00:00 2023-07-14T15:52:10.149 INFO:teuthology.orchestra.run.smithi098.stdout:(99/131): openblas-0.3.15-3.el8.x86_64.rpm 12 MB/s | 4.7 MB 00:00 2023-07-14T15:52:10.199 INFO:teuthology.orchestra.run.smithi098.stdout:(100/131): postgresql-contrib-10.21-2.module+el 6.2 MB/s | 808 kB 00:00 2023-07-14T15:52:10.241 INFO:teuthology.orchestra.run.smithi098.stdout:(101/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2023-07-14T15:52:10.291 INFO:teuthology.orchestra.run.smithi098.stdout:(102/131): postgresql-10.21-2.module+el8.6.0+15 11 MB/s | 1.5 MB 00:00 2023-07-14T15:52:10.317 INFO:teuthology.orchestra.run.smithi098.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 2.6 MB/s | 200 kB 00:00 2023-07-14T15:52:10.342 INFO:teuthology.orchestra.run.smithi098.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 848 kB/s | 43 kB 00:00 2023-07-14T15:52:10.376 INFO:teuthology.orchestra.run.smithi098.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 3.7 MB/s | 220 kB 00:00 2023-07-14T15:52:10.401 INFO:teuthology.orchestra.run.smithi098.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 820 kB/s | 48 kB 00:00 2023-07-14T15:52:10.426 INFO:teuthology.orchestra.run.smithi098.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-07-14T15:52:10.451 INFO:teuthology.orchestra.run.smithi098.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 851 kB/s | 43 kB 00:00 2023-07-14T15:52:10.477 INFO:teuthology.orchestra.run.smithi098.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 2.1 MB/s | 109 kB 00:00 2023-07-14T15:52:10.511 INFO:teuthology.orchestra.run.smithi098.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.8 MB/s | 229 kB 00:00 2023-07-14T15:52:10.569 INFO:teuthology.orchestra.run.smithi098.stdout:(111/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 6.0 MB/s | 560 kB 00:00 2023-07-14T15:52:10.586 INFO:teuthology.orchestra.run.smithi098.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 249 kB/s | 19 kB 00:00 2023-07-14T15:52:10.611 INFO:teuthology.orchestra.run.smithi098.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 3.6 MB/s | 155 kB 00:00 2023-07-14T15:52:10.687 INFO:teuthology.orchestra.run.smithi098.stdout:(114/131): postgresql-server-10.21-2.module+el8 7.2 MB/s | 5.1 MB 00:00 2023-07-14T15:52:10.712 INFO:teuthology.orchestra.run.smithi098.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 178 kB/s | 18 kB 00:00 2023-07-14T15:52:10.737 INFO:teuthology.orchestra.run.smithi098.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 3.6 MB/s | 559 kB 00:00 2023-07-14T15:52:10.771 INFO:teuthology.orchestra.run.smithi098.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.9 MB/s | 238 kB 00:00 2023-07-14T15:52:10.804 INFO:teuthology.orchestra.run.smithi098.stdout:(118/131): pcre2-devel-10.32-2.el8.x86_64.rpm 5.0 MB/s | 605 kB 00:00 2023-07-14T15:52:10.830 INFO:teuthology.orchestra.run.smithi098.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.2 MB/s | 72 kB 00:00 2023-07-14T15:52:10.855 INFO:teuthology.orchestra.run.smithi098.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-07-14T15:52:10.880 INFO:teuthology.orchestra.run.smithi098.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.2 MB/s | 60 kB 00:00 2023-07-14T15:52:10.906 INFO:teuthology.orchestra.run.smithi098.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-07-14T15:52:10.931 INFO:teuthology.orchestra.run.smithi098.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-07-14T15:52:10.956 INFO:teuthology.orchestra.run.smithi098.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 768 kB/s | 39 kB 00:00 2023-07-14T15:52:11.007 INFO:teuthology.orchestra.run.smithi098.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 8.4 MB/s | 644 kB 00:00 2023-07-14T15:52:11.059 INFO:teuthology.orchestra.run.smithi098.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 1.6 MB/s | 171 kB 00:00 2023-07-14T15:52:11.091 INFO:teuthology.orchestra.run.smithi098.stdout:(127/131): NetworkManager-initscripts-updown-1. 1.6 MB/s | 138 kB 00:00 2023-07-14T15:52:11.141 INFO:teuthology.orchestra.run.smithi098.stdout:(128/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 5.8 MB/s | 2.3 MB 00:00 2023-07-14T15:52:11.233 INFO:teuthology.orchestra.run.smithi098.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 8.5 MB/s | 798 kB 00:00 2023-07-14T15:52:11.810 INFO:teuthology.orchestra.run.smithi037.stdout:(10/131): ceph-common-18.0.0-4757.g3fc0089c.el8 1.4 MB/s | 22 MB 00:16 2023-07-14T15:52:12.060 INFO:teuthology.orchestra.run.smithi037.stdout:(11/131): cephfs-mirror-18.0.0-4757.g3fc0089c.e 1.0 MB/s | 258 kB 00:00 2023-07-14T15:52:12.169 INFO:teuthology.orchestra.run.smithi037.stdout:(12/131): libcephfs-devel-18.0.0-4757.g3fc0089c 287 kB/s | 31 kB 00:00 2023-07-14T15:52:12.711 INFO:teuthology.orchestra.run.smithi037.stdout:(13/131): libcephfs2-18.0.0-4757.g3fc0089c.el8. 1.4 MB/s | 771 kB 00:00 2023-07-14T15:52:12.861 INFO:teuthology.orchestra.run.smithi037.stdout:(14/131): libcephsqlite-18.0.0-4757.g3fc0089c.e 915 kB/s | 137 kB 00:00 2023-07-14T15:52:13.028 INFO:teuthology.orchestra.run.smithi037.stdout:(15/131): librados-devel-18.0.0-4757.g3fc0089c. 835 kB/s | 139 kB 00:00 2023-07-14T15:52:13.303 INFO:teuthology.orchestra.run.smithi037.stdout:(16/131): libradosstriper1-18.0.0-4757.g3fc0089 1.7 MB/s | 473 kB 00:00 2023-07-14T15:52:14.400 INFO:teuthology.orchestra.run.smithi098.stdout:(130/131): librados2-18.0.0-4757.g3fc0089c.el8. 1.1 MB/s | 3.7 MB 00:03 2023-07-14T15:52:15.783 INFO:teuthology.orchestra.run.smithi098.stdout:(131/131): librbd1-18.0.0-4757.g3fc0089c.el8.x8 776 kB/s | 3.6 MB 00:04 2023-07-14T15:52:15.788 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2023-07-14T15:52:15.788 INFO:teuthology.orchestra.run.smithi098.stdout:Total 8.1 MB/s | 205 MB 00:25 2023-07-14T15:52:17.406 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2023-07-14T15:52:17.539 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2023-07-14T15:52:17.539 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2023-07-14T15:52:19.329 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2023-07-14T15:52:19.334 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2023-07-14T15:52:21.161 INFO:teuthology.orchestra.run.smithi037.stdout:(17/131): ceph-osd-18.0.0-4757.g3fc0089c.el8.x8 830 kB/s | 18 MB 00:21 2023-07-14T15:52:21.253 INFO:teuthology.orchestra.run.smithi037.stdout:(18/131): librgw2-18.0.0-4757.g3fc0089c.el8.x86 868 kB/s | 6.7 MB 00:07 2023-07-14T15:52:21.312 INFO:teuthology.orchestra.run.smithi037.stdout:(19/131): python3-ceph-argparse-18.0.0-4757.g3f 299 kB/s | 45 kB 00:00 2023-07-14T15:52:21.615 INFO:teuthology.orchestra.run.smithi037.stdout:(20/131): python3-ceph-common-18.0.0-4757.g3fc0 329 kB/s | 119 kB 00:00 2023-07-14T15:52:21.687 INFO:teuthology.orchestra.run.smithi037.stdout:(21/131): python3-cephfs-18.0.0-4757.g3fc0089c. 524 kB/s | 197 kB 00:00 2023-07-14T15:52:22.138 INFO:teuthology.orchestra.run.smithi037.stdout:(22/131): python3-rados-18.0.0-4757.g3fc0089c.e 711 kB/s | 371 kB 00:00 2023-07-14T15:52:22.163 INFO:teuthology.orchestra.run.smithi037.stdout:(23/131): python3-rbd-18.0.0-4757.g3fc0089c.el8 768 kB/s | 364 kB 00:00 2023-07-14T15:52:22.313 INFO:teuthology.orchestra.run.smithi037.stdout:(24/131): rbd-fuse-18.0.0-4757.g3fc0089c.el8.x8 629 kB/s | 94 kB 00:00 2023-07-14T15:52:22.347 INFO:teuthology.orchestra.run.smithi037.stdout:(25/131): python3-rgw-18.0.0-4757.g3fc0089c.el8 512 kB/s | 107 kB 00:00 2023-07-14T15:52:22.789 INFO:teuthology.orchestra.run.smithi037.stdout:(26/131): rbd-nbd-18.0.0-4757.g3fc0089c.el8.x86 406 kB/s | 179 kB 00:00 2023-07-14T15:52:23.222 INFO:teuthology.orchestra.run.smithi037.stdout:(27/131): ceph-grafana-dashboards-18.0.0-4757.g 53 kB/s | 23 kB 00:00 2023-07-14T15:52:23.448 INFO:teuthology.orchestra.run.smithi037.stdout:(28/131): ceph-mgr-cephadm-18.0.0-4757.g3fc0089 573 kB/s | 129 kB 00:00 2023-07-14T15:52:24.420 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2023-07-14T15:52:24.614 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-07-14T15:52:24.836 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-07-14T15:52:25.050 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-07-14T15:52:25.215 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-07-14T15:52:25.387 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-07-14T15:52:25.616 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-07-14T15:52:26.082 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-07-14T15:52:26.198 INFO:teuthology.orchestra.run.smithi037.stdout:(29/131): ceph-mgr-dashboard-18.0.0-4757.g3fc00 637 kB/s | 1.7 MB 00:02 2023-07-14T15:52:26.357 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : librados2-2:18.0.0-4757.g3fc0089c.el8.x86_64 6/134 2023-07-14T15:52:26.750 INFO:teuthology.orchestra.run.smithi037.stdout:(30/131): rbd-mirror-18.0.0-4757.g3fc0089c.el8. 796 kB/s | 3.4 MB 00:04 2023-07-14T15:52:26.797 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librados2-2:18.0.0-4757.g3fc0089c.el8.x86_64 6/134 2023-07-14T15:52:26.973 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : librbd1-2:18.0.0-4757.g3fc0089c.el8.x86_64 7/134 2023-07-14T15:52:27.015 INFO:teuthology.orchestra.run.smithi037.stdout:(31/131): ceph-mgr-modules-core-18.0.0-4757.g3f 909 kB/s | 240 kB 00:00 2023-07-14T15:52:27.099 INFO:teuthology.orchestra.run.smithi037.stdout:(32/131): ceph-mgr-rook-18.0.0-4757.g3fc0089c.e 570 kB/s | 47 kB 00:00 2023-07-14T15:52:27.117 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librbd1-2:18.0.0-4757.g3fc0089c.el8.x86_64 7/134 2023-07-14T15:52:27.199 INFO:teuthology.orchestra.run.smithi037.stdout:(33/131): ceph-prometheus-alerts-18.0.0-4757.g3 146 kB/s | 15 kB 00:00 2023-07-14T15:52:27.356 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephfs2-2:18.0.0-4757.g3fc0089c.el8.x86_64 8/134 2023-07-14T15:52:27.457 INFO:teuthology.orchestra.run.smithi037.stdout:(34/131): ceph-volume-18.0.0-4757.g3fc0089c.el8 1.0 MB/s | 258 kB 00:00 2023-07-14T15:52:27.479 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libcephfs2-2:18.0.0-4757.g3fc0089c.el8.x86_64 8/134 2023-07-14T15:52:27.666 INFO:teuthology.orchestra.run.smithi037.stdout:(35/131): cephadm-18.0.0-4757.g3fc0089c.el8.noa 800 kB/s | 166 kB 00:00 2023-07-14T15:52:27.721 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rados-2:18.0.0-4757.g3fc0089c.el8.x86_64 9/134 2023-07-14T15:52:27.766 INFO:teuthology.orchestra.run.smithi037.stdout:(36/131): cephfs-top-18.0.0-4757.g3fc0089c.el8. 180 kB/s | 18 kB 00:00 2023-07-14T15:52:28.014 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-07-14T15:52:28.216 INFO:teuthology.orchestra.run.smithi037.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 681 kB/s | 306 kB 00:00 2023-07-14T15:52:28.253 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-07-14T15:52:28.342 INFO:teuthology.orchestra.run.smithi037.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 471 kB/s | 59 kB 00:00 2023-07-14T15:52:28.455 INFO:teuthology.orchestra.run.smithi037.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 665 kB/s | 75 kB 00:00 2023-07-14T15:52:28.692 INFO:teuthology.orchestra.run.smithi037.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.0 MB/s | 476 kB 00:00 2023-07-14T15:52:28.735 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-07-14T15:52:28.785 INFO:teuthology.orchestra.run.smithi037.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 476 kB/s | 44 kB 00:00 2023-07-14T15:52:28.910 INFO:teuthology.orchestra.run.smithi037.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.4 MB/s | 185 kB 00:00 2023-07-14T15:52:29.010 INFO:teuthology.orchestra.run.smithi037.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 330 kB/s | 33 kB 00:00 2023-07-14T15:52:29.011 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-07-14T15:52:29.111 INFO:teuthology.orchestra.run.smithi037.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 163 kB/s | 16 kB 00:00 2023-07-14T15:52:29.181 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephsqlite-2:18.0.0-4757.g3fc0089c.el8.x86_64 14/134 2023-07-14T15:52:29.211 INFO:teuthology.orchestra.run.smithi037.stdout:(45/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.7 MB/s | 173 kB 00:00 2023-07-14T15:52:29.304 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4757.g3fc0089c.el8.x86_64 14/134 2023-07-14T15:52:29.394 INFO:teuthology.orchestra.run.smithi037.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 2.0 MB/s | 384 kB 00:00 2023-07-14T15:52:29.473 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libradosstriper1-2:18.0.0-4757.g3fc0089c.el8.x86 15/134 2023-07-14T15:52:29.503 INFO:teuthology.orchestra.run.smithi037.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 752 kB/s | 81 kB 00:00 2023-07-14T15:52:29.557 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4757.g3fc0089c.el8.x86 15/134 2023-07-14T15:52:29.603 INFO:teuthology.orchestra.run.smithi037.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 111 kB/s | 11 kB 00:00 2023-07-14T15:52:29.697 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-07-14T15:52:29.704 INFO:teuthology.orchestra.run.smithi037.stdout:(49/131): python3-jaraco-functools-2.0-4.el8.no 176 kB/s | 18 kB 00:00 2023-07-14T15:52:29.885 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-07-14T15:52:30.031 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-07-14T15:52:30.169 INFO:teuthology.orchestra.run.smithi037.stdout:(50/131): python3-kubernetes-11.0.0-6.el8.noarc 2.5 MB/s | 1.2 MB 00:00 2023-07-14T15:52:30.271 INFO:teuthology.orchestra.run.smithi037.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 481 kB/s | 49 kB 00:00 2023-07-14T15:52:30.363 INFO:teuthology.orchestra.run.smithi037.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 643 kB/s | 59 kB 00:00 2023-07-14T15:52:30.463 INFO:teuthology.orchestra.run.smithi037.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 604 kB/s | 60 kB 00:00 2023-07-14T15:52:30.606 INFO:teuthology.orchestra.run.smithi037.stdout:(54/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.9 MB/s | 283 kB 00:00 2023-07-14T15:52:30.714 INFO:teuthology.orchestra.run.smithi037.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 145 kB/s | 16 kB 00:00 2023-07-14T15:52:30.731 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-07-14T15:52:30.814 INFO:teuthology.orchestra.run.smithi037.stdout:(56/131): python3-repoze-lru-0.7-6.el8.noarch.r 337 kB/s | 34 kB 00:00 2023-07-14T15:52:30.923 INFO:teuthology.orchestra.run.smithi037.stdout:(57/131): python3-routes-2.4.1-12.el8.noarch.rp 1.8 MB/s | 196 kB 00:00 2023-07-14T15:52:30.964 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-07-14T15:52:31.048 INFO:teuthology.orchestra.run.smithi037.stdout:(58/131): python3-rsa-4.8-1.el8.noarch.rpm 492 kB/s | 61 kB 00:00 2023-07-14T15:52:31.157 INFO:teuthology.orchestra.run.smithi037.stdout:(59/131): python3-simplegeneric-0.8.1-17.el8.no 173 kB/s | 19 kB 00:00 2023-07-14T15:52:31.265 INFO:teuthology.orchestra.run.smithi037.stdout:(60/131): python3-singledispatch-3.4.0.3-18.el8 221 kB/s | 24 kB 00:00 2023-07-14T15:52:31.374 INFO:teuthology.orchestra.run.smithi037.stdout:(61/131): python3-tempora-1.14.1-5.el8.noarch.r 270 kB/s | 29 kB 00:00 2023-07-14T15:52:31.491 INFO:teuthology.orchestra.run.smithi037.stdout:(62/131): python3-trustme-0.6.0-4.el8.noarch.rp 236 kB/s | 27 kB 00:00 2023-07-14T15:52:31.600 INFO:teuthology.orchestra.run.smithi037.stdout:(63/131): python3-waitress-1.4.3-1.el8.noarch.r 2.3 MB/s | 255 kB 00:00 2023-07-14T15:52:31.644 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-07-14T15:52:31.725 INFO:teuthology.orchestra.run.smithi037.stdout:(64/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.0 MB/s | 251 kB 00:00 2023-07-14T15:52:31.817 INFO:teuthology.orchestra.run.smithi037.stdout:(65/131): python3-websocket-client-0.56.0-5.el8 670 kB/s | 61 kB 00:00 2023-07-14T15:52:31.880 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-07-14T15:52:31.926 INFO:teuthology.orchestra.run.smithi037.stdout:(66/131): python3-webtest-2.0.33-1.el8.noarch.r 787 kB/s | 85 kB 00:00 2023-07-14T15:52:32.026 INFO:teuthology.orchestra.run.smithi037.stdout:(67/131): python3-zc-lockfile-2.0-2.el8.noarch. 230 kB/s | 23 kB 00:00 2023-07-14T15:52:32.535 INFO:teuthology.orchestra.run.smithi037.stdout:(68/131): thrift-0.13.0-2.el8.x86_64.rpm 3.4 MB/s | 1.7 MB 00:00 2023-07-14T15:52:32.560 INFO:teuthology.orchestra.run.smithi037.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.8 MB/s | 70 kB 00:00 2023-07-14T15:52:32.696 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-07-14T15:52:32.969 INFO:teuthology.orchestra.run.smithi037.stdout:(70/131): python3-scipy-1.0.0-21.module+el8.5.0 34 MB/s | 14 MB 00:00 2023-07-14T15:52:33.002 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-07-14T15:52:33.010 INFO:teuthology.orchestra.run.smithi037.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.6 MB/s | 110 kB 00:00 2023-07-14T15:52:33.044 INFO:teuthology.orchestra.run.smithi037.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.6 MB/s | 54 kB 00:00 2023-07-14T15:52:33.086 INFO:teuthology.orchestra.run.smithi037.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2023-07-14T15:52:33.153 INFO:teuthology.orchestra.run.smithi037.stdout:(74/131): socat-1.7.4.1-1.el8.x86_64.rpm 4.8 MB/s | 323 kB 00:00 2023-07-14T15:52:33.195 INFO:teuthology.orchestra.run.smithi037.stdout:(75/131): python3-markupsafe-0.23-19.el8.x86_64 930 kB/s | 39 kB 00:00 2023-07-14T15:52:33.245 INFO:teuthology.orchestra.run.smithi037.stdout:(76/131): bison-3.0.4-10.el8.x86_64.rpm 14 MB/s | 688 kB 00:00 2023-07-14T15:52:33.248 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-07-14T15:52:33.304 INFO:teuthology.orchestra.run.smithi037.stdout:(77/131): python3-jinja2-2.10.1-3.el8.noarch.rp 9.0 MB/s | 538 kB 00:00 2023-07-14T15:52:33.346 INFO:teuthology.orchestra.run.smithi037.stdout:(78/131): python3-mako-1.0.6-13.el8.noarch.rpm 3.7 MB/s | 157 kB 00:00 2023-07-14T15:52:33.430 INFO:teuthology.orchestra.run.smithi037.stdout:(79/131): oniguruma-6.8.2-2.el8.x86_64.rpm 2.2 MB/s | 187 kB 00:00 2023-07-14T15:52:33.480 INFO:teuthology.orchestra.run.smithi037.stdout:(80/131): automake-1.16.1-7.el8.noarch.rpm 14 MB/s | 713 kB 00:00 2023-07-14T15:52:33.520 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-07-14T15:52:33.639 INFO:teuthology.orchestra.run.smithi037.stdout:(81/131): python3-babel-2.5.1-7.el8.noarch.rpm 30 MB/s | 4.8 MB 00:00 2023-07-14T15:52:33.664 INFO:teuthology.orchestra.run.smithi037.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 1.1 MB/s | 27 kB 00:00 2023-07-14T15:52:33.697 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-07-14T15:52:33.706 INFO:teuthology.orchestra.run.smithi037.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-07-14T15:52:33.798 INFO:teuthology.orchestra.run.smithi037.stdout:(84/131): ceph-mgr-diskprediction-local-18.0.0- 998 kB/s | 7.4 MB 00:07 2023-07-14T15:52:33.823 INFO:teuthology.orchestra.run.smithi037.stdout:(85/131): python3-prettytable-0.7.2-14.el8.noar 376 kB/s | 44 kB 00:00 2023-07-14T15:52:33.882 INFO:teuthology.orchestra.run.smithi037.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 8.9 MB/s | 457 kB 00:00 2023-07-14T15:52:33.924 INFO:teuthology.orchestra.run.smithi037.stdout:(87/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 5.3 MB/s | 225 kB 00:00 2023-07-14T15:52:33.940 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-07-14T15:52:33.966 INFO:teuthology.orchestra.run.smithi037.stdout:(88/131): uuid-1.6.2-43.el8.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2023-07-14T15:52:34.033 INFO:teuthology.orchestra.run.smithi037.stdout:(89/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.8 MB/s | 126 kB 00:00 2023-07-14T15:52:34.100 INFO:teuthology.orchestra.run.smithi037.stdout:(90/131): python3-numpy-1.14.3-10.el8.x86_64.rp 12 MB/s | 3.7 MB 00:00 2023-07-14T15:52:34.125 INFO:teuthology.orchestra.run.smithi037.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 218 kB/s | 20 kB 00:00 2023-07-14T15:52:34.158 INFO:teuthology.orchestra.run.smithi037.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.7 MB/s | 103 kB 00:00 2023-07-14T15:52:34.199 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-07-14T15:52:34.201 INFO:teuthology.orchestra.run.smithi037.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 9.2 MB/s | 709 kB 00:00 2023-07-14T15:52:34.242 INFO:teuthology.orchestra.run.smithi037.stdout:(94/131): libpq-13.5-1.el8.x86_64.rpm 4.7 MB/s | 198 kB 00:00 2023-07-14T15:52:34.379 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ceph-common-2:18.0.0-4757.g3fc0089c.el8. 26/134 2023-07-14T15:52:34.425 INFO:teuthology.orchestra.run.smithi037.stdout:(95/131): openblas-threads-0.3.15-3.el8.x86_64. 18 MB/s | 4.9 MB 00:00 2023-07-14T15:52:34.477 INFO:teuthology.orchestra.run.smithi037.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 3.8 MB/s | 202 kB 00:00 2023-07-14T15:52:34.552 INFO:teuthology.orchestra.run.smithi037.stdout:(97/131): openblas-0.3.15-3.el8.x86_64.rpm 15 MB/s | 4.7 MB 00:00 2023-07-14T15:52:34.560 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ceph-argparse-2:18.0.0-4757.g3fc0089c.el 27/134 2023-07-14T15:52:34.586 INFO:teuthology.orchestra.run.smithi037.stdout:(98/131): librdkafka-0.11.4-3.el8.x86_64.rpm 3.2 MB/s | 354 kB 00:00 2023-07-14T15:52:34.653 INFO:teuthology.orchestra.run.smithi037.stdout:(99/131): postgresql-contrib-10.21-2.module+el8 12 MB/s | 808 kB 00:00 2023-07-14T15:52:34.745 INFO:teuthology.orchestra.run.smithi037.stdout:(100/131): postgresql-10.21-2.module+el8.6.0+15 16 MB/s | 1.5 MB 00:00 2023-07-14T15:52:34.778 INFO:teuthology.orchestra.run.smithi037.stdout:(101/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2023-07-14T15:52:34.887 INFO:teuthology.orchestra.run.smithi037.stdout:(102/131): postgresql-server-10.21-2.module+el8 15 MB/s | 5.1 MB 00:00 2023-07-14T15:52:34.912 INFO:teuthology.orchestra.run.smithi037.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 1.5 MB/s | 200 kB 00:00 2023-07-14T15:52:34.929 INFO:teuthology.orchestra.run.smithi037.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 1.0 MB/s | 43 kB 00:00 2023-07-14T15:52:34.954 INFO:teuthology.orchestra.run.smithi037.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 5.1 MB/s | 220 kB 00:00 2023-07-14T15:52:34.971 INFO:teuthology.orchestra.run.smithi037.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 1.1 MB/s | 48 kB 00:00 2023-07-14T15:52:34.997 INFO:teuthology.orchestra.run.smithi037.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 2.0 MB/s | 87 kB 00:00 2023-07-14T15:52:35.013 INFO:teuthology.orchestra.run.smithi037.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 1.0 MB/s | 43 kB 00:00 2023-07-14T15:52:35.030 INFO:teuthology.orchestra.run.smithi037.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 3.2 MB/s | 109 kB 00:00 2023-07-14T15:52:35.056 INFO:teuthology.orchestra.run.smithi037.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 5.3 MB/s | 229 kB 00:00 2023-07-14T15:52:35.089 INFO:teuthology.orchestra.run.smithi037.stdout:(111/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 9.3 MB/s | 560 kB 00:00 2023-07-14T15:52:35.107 INFO:teuthology.orchestra.run.smithi037.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 372 kB/s | 19 kB 00:00 2023-07-14T15:52:35.131 INFO:teuthology.orchestra.run.smithi037.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 3.6 MB/s | 155 kB 00:00 2023-07-14T15:52:35.165 INFO:teuthology.orchestra.run.smithi037.stdout:(114/131): python3-cryptography-3.2.1-5.el8.x86 9.3 MB/s | 559 kB 00:00 2023-07-14T15:52:35.190 INFO:teuthology.orchestra.run.smithi037.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 305 kB/s | 18 kB 00:00 2023-07-14T15:52:35.241 INFO:teuthology.orchestra.run.smithi037.stdout:(116/131): pcre2-devel-10.32-2.el8.x86_64.rpm 7.9 MB/s | 605 kB 00:00 2023-07-14T15:52:35.298 INFO:teuthology.orchestra.run.smithi037.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.2 MB/s | 238 kB 00:00 2023-07-14T15:52:35.341 INFO:teuthology.orchestra.run.smithi037.stdout:(118/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.7 MB/s | 72 kB 00:00 2023-07-14T15:52:35.383 INFO:teuthology.orchestra.run.smithi037.stdout:(119/131): fuse-2.9.7-15.el8.x86_64.rpm 1.9 MB/s | 83 kB 00:00 2023-07-14T15:52:35.442 INFO:teuthology.orchestra.run.smithi037.stdout:(120/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 12 MB/s | 2.3 MB 00:00 2023-07-14T15:52:35.467 INFO:teuthology.orchestra.run.smithi037.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 717 kB/s | 60 kB 00:00 2023-07-14T15:52:35.492 INFO:teuthology.orchestra.run.smithi037.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-07-14T15:52:35.518 INFO:teuthology.orchestra.run.smithi037.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-07-14T15:52:35.551 INFO:teuthology.orchestra.run.smithi037.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 653 kB/s | 39 kB 00:00 2023-07-14T15:52:35.579 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cephfs-2:18.0.0-4757.g3fc0089c.el8.x86_6 28/134 2023-07-14T15:52:35.594 INFO:teuthology.orchestra.run.smithi037.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 8.3 MB/s | 644 kB 00:00 2023-07-14T15:52:35.620 INFO:teuthology.orchestra.run.smithi037.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.5 MB/s | 171 kB 00:00 2023-07-14T15:52:35.644 INFO:teuthology.orchestra.run.smithi037.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.7 MB/s | 138 kB 00:00 2023-07-14T15:52:35.937 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-07-14T15:52:36.246 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-07-14T15:52:36.577 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-07-14T15:52:36.763 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-07-14T15:52:38.855 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-07-14T15:52:39.180 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-07-14T15:52:39.452 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-07-14T15:52:39.710 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-07-14T15:52:39.719 INFO:teuthology.orchestra.run.smithi037.stdout:(128/131): librbd1-18.0.0-4757.g3fc0089c.el8.x8 894 kB/s | 3.6 MB 00:04 2023-07-14T15:52:39.777 INFO:teuthology.orchestra.run.smithi037.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 13 MB/s | 798 kB 00:00 2023-07-14T15:52:39.923 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rbd-2:18.0.0-4757.g3fc0089c.el8.x86_64 36/134 2023-07-14T15:52:39.944 INFO:teuthology.orchestra.run.smithi037.stdout:(130/131): librados2-18.0.0-4757.g3fc0089c.el8. 868 kB/s | 3.7 MB 00:04 2023-07-14T15:52:40.152 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librados-devel-2:18.0.0-4757.g3fc0089c.el8.x86_6 37/134 2023-07-14T15:52:40.343 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-07-14T15:52:40.551 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-07-14T15:52:40.732 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-07-14T15:52:40.885 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-07-14T15:52:41.136 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-07-14T15:52:41.386 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-07-14T15:52:41.853 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-07-14T15:52:42.211 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-07-14T15:52:42.427 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-07-14T15:52:42.708 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-07-14T15:52:42.955 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-07-14T15:52:43.313 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-07-14T15:52:43.614 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-07-14T15:52:43.793 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-07-14T15:52:44.057 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-07-14T15:52:44.255 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-07-14T15:52:44.434 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-07-14T15:52:44.823 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-07-14T15:52:45.108 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-07-14T15:52:45.360 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-07-14T15:52:45.620 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-07-14T15:52:45.804 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-07-14T15:52:45.999 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-07-14T15:52:46.220 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-07-14T15:52:46.311 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-07-14T15:52:46.575 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-07-14T15:52:46.792 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-07-14T15:52:46.936 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-07-14T15:52:47.031 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-07-14T15:52:47.307 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-07-14T15:52:47.480 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-07-14T15:52:47.688 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-07-14T15:52:47.902 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-07-14T15:52:48.227 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-07-14T15:52:48.461 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-07-14T15:52:48.658 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-07-14T15:52:48.815 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-07-14T15:52:49.024 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-07-14T15:52:49.302 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-07-14T15:52:49.509 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-07-14T15:52:49.689 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-07-14T15:52:49.835 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-07-14T15:52:50.067 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-07-14T15:52:50.308 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-07-14T15:52:50.501 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-07-14T15:52:50.818 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-07-14T15:52:51.096 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-07-14T15:52:51.322 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-07-14T15:52:51.554 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-07-14T15:52:52.904 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-07-14T15:52:53.189 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-07-14T15:52:53.483 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-07-14T15:52:53.800 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-07-14T15:52:54.081 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-07-14T15:52:54.321 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-07-14T15:52:54.529 INFO:teuthology.orchestra.run.smithi037.stdout:(131/131): ceph-test-18.0.0-4757.g3fc0089c.el8. 961 kB/s | 48 MB 00:50 2023-07-14T15:52:54.532 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2023-07-14T15:52:54.532 INFO:teuthology.orchestra.run.smithi037.stdout:Total 3.5 MB/s | 205 MB 00:59 2023-07-14T15:52:55.160 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-07-14T15:52:55.360 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librgw2-2:18.0.0-4757.g3fc0089c.el8.x86_64 92/134 2023-07-14T15:52:55.443 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librgw2-2:18.0.0-4757.g3fc0089c.el8.x86_64 92/134 2023-07-14T15:52:55.627 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rgw-2:18.0.0-4757.g3fc0089c.el8.x86_64 93/134 2023-07-14T15:52:56.215 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2023-07-14T15:52:56.361 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2023-07-14T15:52:56.361 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2023-07-14T15:52:58.206 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2023-07-14T15:52:58.211 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2023-07-14T15:53:01.180 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-common-2:18.0.0-4757.g3fc0089c.el8.x86_64 94/134 2023-07-14T15:53:01.393 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-common-2:18.0.0-4757.g3fc0089c.el8.x86_64 94/134 2023-07-14T15:53:02.079 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-common-2:18.0.0-4757.g3fc0089c.el8.x86_64 94/134 2023-07-14T15:53:02.379 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-base-2:18.0.0-4757.g3fc0089c.el8.x86_64 95/134 2023-07-14T15:53:02.547 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-base-2:18.0.0-4757.g3fc0089c.el8.x86_64 95/134 2023-07-14T15:53:02.692 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-selinux-2:18.0.0-4757.g3fc0089c.el8.x86_64 96/134 2023-07-14T15:53:03.334 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2023-07-14T15:53:03.531 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-07-14T15:53:03.711 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-07-14T15:53:03.968 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-07-14T15:53:04.148 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-07-14T15:53:04.299 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-07-14T15:53:04.557 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-07-14T15:53:05.059 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-07-14T15:53:05.323 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librados2-2:18.0.0-4757.g3fc0089c.el8.x86_64 6/134 2023-07-14T15:53:05.796 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-2:18.0.0-4757.g3fc0089c.el8.x86_64 6/134 2023-07-14T15:53:05.973 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librbd1-2:18.0.0-4757.g3fc0089c.el8.x86_64 7/134 2023-07-14T15:53:06.113 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-2:18.0.0-4757.g3fc0089c.el8.x86_64 7/134 2023-07-14T15:53:06.306 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs2-2:18.0.0-4757.g3fc0089c.el8.x86_64 8/134 2023-07-14T15:53:06.414 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephfs2-2:18.0.0-4757.g3fc0089c.el8.x86_64 8/134 2023-07-14T15:53:06.662 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rados-2:18.0.0-4757.g3fc0089c.el8.x86_64 9/134 2023-07-14T15:53:06.936 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-07-14T15:53:07.171 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-07-14T15:53:07.652 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-07-14T15:53:07.945 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-07-14T15:53:08.122 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephsqlite-2:18.0.0-4757.g3fc0089c.el8.x86_64 14/134 2023-07-14T15:53:08.256 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4757.g3fc0089c.el8.x86_64 14/134 2023-07-14T15:53:08.448 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libradosstriper1-2:18.0.0-4757.g3fc0089c.el8.x86 15/134 2023-07-14T15:53:08.541 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4757.g3fc0089c.el8.x86 15/134 2023-07-14T15:53:08.705 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-07-14T15:53:08.879 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-07-14T15:53:09.006 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-07-14T15:53:09.777 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-07-14T15:53:09.981 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-07-14T15:53:10.706 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-07-14T15:53:10.955 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-07-14T15:53:11.823 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-07-14T15:53:12.139 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-07-14T15:53:12.396 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-07-14T15:53:12.655 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-07-14T15:53:12.824 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-07-14T15:53:13.070 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-07-14T15:53:13.312 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-07-14T15:53:13.505 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-common-2:18.0.0-4757.g3fc0089c.el8. 26/134 2023-07-14T15:53:13.653 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-argparse-2:18.0.0-4757.g3fc0089c.el 27/134 2023-07-14T15:53:14.725 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cephfs-2:18.0.0-4757.g3fc0089c.el8.x86_6 28/134 2023-07-14T15:53:15.077 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-07-14T15:53:15.392 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-07-14T15:53:15.694 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-07-14T15:53:15.888 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-07-14T15:53:18.082 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-07-14T15:53:18.432 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-07-14T15:53:18.702 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-07-14T15:53:18.939 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-07-14T15:53:19.156 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rbd-2:18.0.0-4757.g3fc0089c.el8.x86_64 36/134 2023-07-14T15:53:19.335 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librados-devel-2:18.0.0-4757.g3fc0089c.el8.x86_6 37/134 2023-07-14T15:53:19.533 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-07-14T15:53:19.734 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-07-14T15:53:19.966 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-07-14T15:53:20.129 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-07-14T15:53:20.372 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-07-14T15:53:20.616 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-07-14T15:53:21.077 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-07-14T15:53:21.430 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-07-14T15:53:21.704 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-07-14T15:53:21.964 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-07-14T15:53:22.208 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-07-14T15:53:22.538 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-07-14T15:53:22.814 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-07-14T15:53:23.049 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-07-14T15:53:23.328 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-07-14T15:53:23.346 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4757.g3fc0089c.el8.x86_64 96/134 2023-07-14T15:53:23.346 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /sys 2023-07-14T15:53:23.346 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /proc 2023-07-14T15:53:23.346 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /dev 2023-07-14T15:53:23.347 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /run 2023-07-14T15:53:23.347 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /mnt 2023-07-14T15:53:23.347 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /var/tmp 2023-07-14T15:53:23.347 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /home 2023-07-14T15:53:23.347 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /tmp 2023-07-14T15:53:23.347 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /dev 2023-07-14T15:53:23.347 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-14T15:53:23.523 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-07-14T15:53:23.711 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-07-14T15:53:23.723 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-volume-2:18.0.0-4757.g3fc0089c.el8.noarch 97/134 2023-07-14T15:53:24.113 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-07-14T15:53:24.448 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-07-14T15:53:24.756 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-07-14T15:53:25.004 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-07-14T15:53:25.221 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-07-14T15:53:25.400 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-07-14T15:53:25.456 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-volume-2:18.0.0-4757.g3fc0089c.el8.noarch 97/134 2023-07-14T15:53:25.628 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-07-14T15:53:25.642 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-osd-2:18.0.0-4757.g3fc0089c.el8.x86_64 98/134 2023-07-14T15:53:25.725 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-07-14T15:53:25.909 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-osd-2:18.0.0-4757.g3fc0089c.el8.x86_64 98/134 2023-07-14T15:53:26.034 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-07-14T15:53:26.072 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mds-2:18.0.0-4757.g3fc0089c.el8.x86_64 99/134 2023-07-14T15:53:26.236 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-07-14T15:53:26.436 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-07-14T15:53:26.537 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-07-14T15:53:26.605 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mds-2:18.0.0-4757.g3fc0089c.el8.x86_64 99/134 2023-07-14T15:53:26.758 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-07-14T15:53:26.847 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mon-2:18.0.0-4757.g3fc0089c.el8.x86_64 100/134 2023-07-14T15:53:26.888 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mon-2:18.0.0-4757.g3fc0089c.el8.x86_64 100/134 2023-07-14T15:53:26.982 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-07-14T15:53:27.214 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-07-14T15:53:27.450 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-07-14T15:53:27.775 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-07-14T15:53:28.030 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-07-14T15:53:28.226 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-07-14T15:53:28.393 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-07-14T15:53:28.649 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-07-14T15:53:28.873 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-07-14T15:53:29.104 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-07-14T15:53:29.266 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-07-14T15:53:29.486 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-07-14T15:53:29.533 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: cephadm-2:18.0.0-4757.g3fc0089c.el8.noarch 101/134 2023-07-14T15:53:29.703 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephadm-2:18.0.0-4757.g3fc0089c.el8.noarch 101/134 2023-07-14T15:53:29.725 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-07-14T15:53:29.905 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4757.g3fc0089c.e 102/134 2023-07-14T15:53:29.960 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-07-14T15:53:30.109 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4757.g3fc0089c. 103/134 2023-07-14T15:53:30.144 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-07-14T15:53:30.271 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4757.g3fc0089c.el8.noa 104/134 2023-07-14T15:53:30.477 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-07-14T15:53:30.533 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4757.g3fc0089c.el8.noa 104/134 2023-07-14T15:53:30.708 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4757.g3fc0089c.el8.n 105/134 2023-07-14T15:53:30.736 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-07-14T15:53:30.948 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-07-14T15:53:31.231 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-07-14T15:53:31.821 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4757.g3fc0089c.el8.n 105/134 2023-07-14T15:53:31.996 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4757.g3fc 106/134 2023-07-14T15:53:32.126 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4757.g3fc 106/134 2023-07-14T15:53:32.515 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4757.g3fc0089c.el 107/134 2023-07-14T15:53:32.602 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-07-14T15:53:32.699 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-2:18.0.0-4757.g3fc0089c.el8.x86_64 108/134 2023-07-14T15:53:32.764 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4757.g3fc0089c.el8.x86_64 108/134 2023-07-14T15:53:32.875 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-07-14T15:53:32.988 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-rook-2:18.0.0-4757.g3fc0089c.el8.noarch 109/134 2023-07-14T15:53:33.015 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4757.g3fc0089c.el8.noarch 109/134 2023-07-14T15:53:33.445 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-07-14T15:53:33.796 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-07-14T15:53:34.106 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-07-14T15:53:34.352 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-07-14T15:53:34.423 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-2:18.0.0-4757.g3fc0089c.el8.x86_64 110/134 2023-07-14T15:53:34.660 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-radosgw-2:18.0.0-4757.g3fc0089c.el8.x86_64 111/134 2023-07-14T15:53:34.731 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4757.g3fc0089c.el8.x86_64 111/134 2023-07-14T15:53:34.887 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4757.g3fc00 112/134 2023-07-14T15:53:34.972 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4757.g3fc00 112/134 2023-07-14T15:53:35.146 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephfs-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 113/134 2023-07-14T15:53:35.249 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-07-14T15:53:35.435 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librgw2-2:18.0.0-4757.g3fc0089c.el8.x86_64 92/134 2023-07-14T15:53:35.553 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 113/134 2023-07-14T15:53:35.563 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librgw2-2:18.0.0-4757.g3fc0089c.el8.x86_64 92/134 2023-07-14T15:53:35.721 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 114/134 2023-07-14T15:53:35.744 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rgw-2:18.0.0-4757.g3fc0089c.el8.x86_64 93/134 2023-07-14T15:53:40.740 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 114/134 2023-07-14T15:53:40.789 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:18.0.0-4757.g3fc0089c.el8.x86_64 94/134 2023-07-14T15:53:41.036 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-common-2:18.0.0-4757.g3fc0089c.el8.x86_64 94/134 2023-07-14T15:53:41.073 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-test-2:18.0.0-4757.g3fc0089c.el8.x86_64 115/134 2023-07-14T15:53:41.211 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-07-14T15:53:41.464 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-07-14T15:53:41.765 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:18.0.0-4757.g3fc0089c.el8.x86_64 94/134 2023-07-14T15:53:42.074 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-base-2:18.0.0-4757.g3fc0089c.el8.x86_64 95/134 2023-07-14T15:53:42.211 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-base-2:18.0.0-4757.g3fc0089c.el8.x86_64 95/134 2023-07-14T15:53:42.401 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-selinux-2:18.0.0-4757.g3fc0089c.el8.x86_64 96/134 2023-07-14T15:53:42.721 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-07-14T15:53:43.124 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-07-14T15:53:43.294 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-fuse-2:18.0.0-4757.g3fc0089c.el8.x86_64 119/134 2023-07-14T15:53:43.466 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-07-14T15:53:43.683 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephfs-devel-2:18.0.0-4757.g3fc0089c.el8.x86_ 121/134 2023-07-14T15:53:43.837 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-07-14T15:53:47.110 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-14T15:53:47.369 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-14T15:53:47.407 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-14T15:53:47.636 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephfs-top-2:18.0.0-4757.g3fc0089c.el8.noarch 124/134 2023-07-14T15:53:47.828 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-fuse-2:18.0.0-4757.g3fc0089c.el8.x86_64 125/134 2023-07-14T15:53:48.157 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-nbd-2:18.0.0-4757.g3fc0089c.el8.x86_64 126/134 2023-07-14T15:53:48.471 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-07-14T15:53:48.660 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-07-14T15:53:48.682 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-07-14T15:53:48.907 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-07-14T15:53:49.126 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-07-14T15:53:49.235 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-07-14T15:53:49.443 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-07-14T15:53:49.471 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-07-14T15:53:49.471 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-14T15:53:49.716 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-14T15:53:49.716 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-14T15:53:49.982 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-14T15:53:50.201 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-14T15:53:50.479 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-07-14T15:53:50.479 INFO:teuthology.orchestra.run.smithi098.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-07-14T15:53:50.479 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-14T15:53:51.102 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-2:18.0.0-4757.g3fc0089c.el8.x86_64 1/134 2023-07-14T15:53:51.102 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-base-2:18.0.0-4757.g3fc0089c.el8.x86_64 2/134 2023-07-14T15:53:51.102 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-common-2:18.0.0-4757.g3fc0089c.el8.x86_64 3/134 2023-07-14T15:53:51.102 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-fuse-2:18.0.0-4757.g3fc0089c.el8.x86_64 4/134 2023-07-14T15:53:51.102 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4757.g3fc00 5/134 2023-07-14T15:53:51.103 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mds-2:18.0.0-4757.g3fc0089c.el8.x86_64 6/134 2023-07-14T15:53:51.104 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-2:18.0.0-4757.g3fc0089c.el8.x86_64 7/134 2023-07-14T15:53:51.105 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mon-2:18.0.0-4757.g3fc0089c.el8.x86_64 8/134 2023-07-14T15:53:51.105 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-osd-2:18.0.0-4757.g3fc0089c.el8.x86_64 9/134 2023-07-14T15:53:51.105 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-radosgw-2:18.0.0-4757.g3fc0089c.el8.x86_64 10/134 2023-07-14T15:53:51.105 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-selinux-2:18.0.0-4757.g3fc0089c.el8.x86_64 11/134 2023-07-14T15:53:51.105 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-test-2:18.0.0-4757.g3fc0089c.el8.x86_64 12/134 2023-07-14T15:53:51.105 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephfs-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 13/134 2023-07-14T15:53:51.105 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephfs-devel-2:18.0.0-4757.g3fc0089c.el8.x86_ 14/134 2023-07-14T15:53:51.106 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephfs2-2:18.0.0-4757.g3fc0089c.el8.x86_64 15/134 2023-07-14T15:53:51.106 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephsqlite-2:18.0.0-4757.g3fc0089c.el8.x86_64 16/134 2023-07-14T15:53:51.106 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados-devel-2:18.0.0-4757.g3fc0089c.el8.x86_6 17/134 2023-07-14T15:53:51.106 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libradosstriper1-2:18.0.0-4757.g3fc0089c.el8.x86 18/134 2023-07-14T15:53:51.106 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librgw2-2:18.0.0-4757.g3fc0089c.el8.x86_64 19/134 2023-07-14T15:53:51.106 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4757.g3fc0089c.el 20/134 2023-07-14T15:53:51.106 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ceph-common-2:18.0.0-4757.g3fc0089c.el8. 21/134 2023-07-14T15:53:51.107 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cephfs-2:18.0.0-4757.g3fc0089c.el8.x86_6 22/134 2023-07-14T15:53:51.108 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rados-2:18.0.0-4757.g3fc0089c.el8.x86_64 23/134 2023-07-14T15:53:51.108 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rbd-2:18.0.0-4757.g3fc0089c.el8.x86_64 24/134 2023-07-14T15:53:51.108 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rgw-2:18.0.0-4757.g3fc0089c.el8.x86_64 25/134 2023-07-14T15:53:51.108 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-fuse-2:18.0.0-4757.g3fc0089c.el8.x86_64 26/134 2023-07-14T15:53:51.108 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 27/134 2023-07-14T15:53:51.108 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-nbd-2:18.0.0-4757.g3fc0089c.el8.x86_64 28/134 2023-07-14T15:53:51.109 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4757.g3fc0089c. 29/134 2023-07-14T15:53:51.109 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4757.g3fc0089c.el8.noa 30/134 2023-07-14T15:53:51.115 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4757.g3fc0089c.el8.n 31/134 2023-07-14T15:53:51.115 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4757.g3fc 32/134 2023-07-14T15:53:51.116 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4757.g3fc0089c.el 33/134 2023-07-14T15:53:51.116 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4757.g3fc0089c.el8.noarch 34/134 2023-07-14T15:53:51.116 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4757.g3fc0089c.e 35/134 2023-07-14T15:53:51.116 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-volume-2:18.0.0-4757.g3fc0089c.el8.noarch 36/134 2023-07-14T15:53:51.116 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephadm-2:18.0.0-4757.g3fc0089c.el8.noarch 37/134 2023-07-14T15:53:51.116 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephfs-top-2:18.0.0-4757.g3fc0089c.el8.noarch 38/134 2023-07-14T15:53:51.116 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-07-14T15:53:51.117 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-07-14T15:53:51.117 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-07-14T15:53:51.117 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-07-14T15:53:51.117 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-07-14T15:53:51.117 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-07-14T15:53:51.117 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-07-14T15:53:51.117 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-07-14T15:53:51.117 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-07-14T15:53:51.118 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-07-14T15:53:51.118 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-07-14T15:53:51.118 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-07-14T15:53:51.118 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-07-14T15:53:51.118 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-07-14T15:53:51.118 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-07-14T15:53:51.118 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-07-14T15:53:51.119 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-07-14T15:53:51.119 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-07-14T15:53:51.119 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-07-14T15:53:51.119 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-07-14T15:53:51.119 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-07-14T15:53:51.119 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-07-14T15:53:51.119 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-07-14T15:53:51.119 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-07-14T15:53:51.120 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-07-14T15:53:51.120 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-07-14T15:53:51.120 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-07-14T15:53:51.120 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-07-14T15:53:51.120 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-07-14T15:53:51.120 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-07-14T15:53:51.120 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-07-14T15:53:51.121 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-07-14T15:53:51.121 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-07-14T15:53:51.121 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-07-14T15:53:51.121 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-07-14T15:53:51.121 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-07-14T15:53:51.121 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-07-14T15:53:51.121 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-07-14T15:53:51.121 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-07-14T15:53:51.122 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-07-14T15:53:51.122 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-07-14T15:53:51.122 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-07-14T15:53:51.122 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-07-14T15:53:51.122 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-07-14T15:53:51.122 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-07-14T15:53:51.122 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-07-14T15:53:51.122 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-07-14T15:53:51.123 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-07-14T15:53:51.123 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-07-14T15:53:51.123 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-07-14T15:53:51.123 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-07-14T15:53:51.123 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-07-14T15:53:51.123 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-07-14T15:53:51.123 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-07-14T15:53:51.123 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-07-14T15:53:51.124 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-07-14T15:53:51.124 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-07-14T15:53:51.124 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-07-14T15:53:51.124 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-07-14T15:53:51.124 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-07-14T15:53:51.124 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-07-14T15:53:51.124 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-07-14T15:53:51.125 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-07-14T15:53:51.125 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-07-14T15:53:51.125 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-07-14T15:53:51.125 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-07-14T15:53:51.125 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-07-14T15:53:51.125 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-07-14T15:53:51.125 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-07-14T15:53:51.125 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-07-14T15:53:51.126 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-07-14T15:53:51.126 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-07-14T15:53:51.126 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-07-14T15:53:51.126 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-07-14T15:53:51.126 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-07-14T15:53:51.126 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-07-14T15:53:51.126 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-07-14T15:53:51.126 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-07-14T15:53:51.127 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-07-14T15:53:51.127 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-07-14T15:53:51.127 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-07-14T15:53:51.127 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-07-14T15:53:51.127 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-07-14T15:53:51.127 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-07-14T15:53:51.127 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-07-14T15:53:51.127 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-07-14T15:53:51.128 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-07-14T15:53:51.128 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-07-14T15:53:51.128 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-07-14T15:53:51.128 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-07-14T15:53:51.128 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados2-2:18.0.0-4757.g3fc0089c.el8.x86_64 129/134 2023-07-14T15:53:51.128 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-07-14T15:53:51.128 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librbd1-2:18.0.0-4757.g3fc0089c.el8.x86_64 131/134 2023-07-14T15:53:51.129 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-14T15:53:51.129 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-07-14T15:53:53.937 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-14T15:53:53.937 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:02:15 ago on Fri 14 Jul 2023 03:51:38 PM UTC. 2023-07-14T15:53:56.734 INFO:teuthology.orchestra.run.smithi098.stdout:Installed products updated. 2023-07-14T15:53:57.114 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-14T15:53:57.114 INFO:teuthology.orchestra.run.smithi098.stdout:Upgraded: 2023-07-14T15:53:57.115 INFO:teuthology.orchestra.run.smithi098.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-07-14T15:53:57.115 INFO:teuthology.orchestra.run.smithi098.stdout: librados2-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:53:57.115 INFO:teuthology.orchestra.run.smithi098.stdout: librbd1-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:53:57.115 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2023-07-14T15:53:57.115 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-07-14T15:53:57.115 INFO:teuthology.orchestra.run.smithi098.stdout: automake-1.16.1-7.el8.noarch 2023-07-14T15:53:57.115 INFO:teuthology.orchestra.run.smithi098.stdout: bison-3.0.4-10.el8.x86_64 2023-07-14T15:53:57.116 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:53:57.116 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-base-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:53:57.116 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-common-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:53:57.116 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-fuse-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:53:57.116 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-grafana-dashboards-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T15:53:57.116 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-immutable-object-cache-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:53:57.117 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mds-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:53:57.117 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:53:57.117 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-cephadm-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T15:53:57.117 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-dashboard-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T15:53:57.117 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T15:53:57.117 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-modules-core-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T15:53:57.117 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-rook-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T15:53:57.117 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mon-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:53:57.118 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-osd-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:53:57.118 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-prometheus-alerts-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T15:53:57.118 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-radosgw-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:53:57.118 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-selinux-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:53:57.118 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-test-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:53:57.118 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-volume-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T15:53:57.118 INFO:teuthology.orchestra.run.smithi098.stdout: cephadm-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T15:53:57.118 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:53:57.119 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-top-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T15:53:57.119 INFO:teuthology.orchestra.run.smithi098.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-07-14T15:53:57.119 INFO:teuthology.orchestra.run.smithi098.stdout: flex-2.6.1-9.el8.x86_64 2023-07-14T15:53:57.119 INFO:teuthology.orchestra.run.smithi098.stdout: fuse-2.9.7-15.el8.x86_64 2023-07-14T15:53:57.119 INFO:teuthology.orchestra.run.smithi098.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-14T15:53:57.119 INFO:teuthology.orchestra.run.smithi098.stdout: jq-1.6-3.el8.x86_64 2023-07-14T15:53:57.119 INFO:teuthology.orchestra.run.smithi098.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-14T15:53:57.120 INFO:teuthology.orchestra.run.smithi098.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-07-14T15:53:57.120 INFO:teuthology.orchestra.run.smithi098.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-14T15:53:57.120 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs-devel-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:53:57.120 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs2-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:53:57.120 INFO:teuthology.orchestra.run.smithi098.stdout: libcephsqlite-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:53:57.120 INFO:teuthology.orchestra.run.smithi098.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-07-14T15:53:57.120 INFO:teuthology.orchestra.run.smithi098.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-07-14T15:53:57.120 INFO:teuthology.orchestra.run.smithi098.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-14T15:53:57.121 INFO:teuthology.orchestra.run.smithi098.stdout: libpq-13.5-1.el8.x86_64 2023-07-14T15:53:57.121 INFO:teuthology.orchestra.run.smithi098.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-07-14T15:53:57.121 INFO:teuthology.orchestra.run.smithi098.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-07-14T15:53:57.121 INFO:teuthology.orchestra.run.smithi098.stdout: librados-devel-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:53:57.122 INFO:teuthology.orchestra.run.smithi098.stdout: libradosstriper1-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:53:57.122 INFO:teuthology.orchestra.run.smithi098.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-14T15:53:57.122 INFO:teuthology.orchestra.run.smithi098.stdout: librgw2-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:53:57.122 INFO:teuthology.orchestra.run.smithi098.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-07-14T15:53:57.122 INFO:teuthology.orchestra.run.smithi098.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-14T15:53:57.122 INFO:teuthology.orchestra.run.smithi098.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-14T15:53:57.122 INFO:teuthology.orchestra.run.smithi098.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-14T15:53:57.123 INFO:teuthology.orchestra.run.smithi098.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-07-14T15:53:57.123 INFO:teuthology.orchestra.run.smithi098.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-07-14T15:53:57.123 INFO:teuthology.orchestra.run.smithi098.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-14T15:53:57.123 INFO:teuthology.orchestra.run.smithi098.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-14T15:53:57.123 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-0.3.15-3.el8.x86_64 2023-07-14T15:53:57.123 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-07-14T15:53:57.123 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-07-14T15:53:57.123 INFO:teuthology.orchestra.run.smithi098.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-07-14T15:53:57.124 INFO:teuthology.orchestra.run.smithi098.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-07-14T15:53:57.124 INFO:teuthology.orchestra.run.smithi098.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-07-14T15:53:57.124 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-14T15:53:57.124 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-14T15:53:57.124 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-14T15:53:57.124 INFO:teuthology.orchestra.run.smithi098.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-14T15:53:57.124 INFO:teuthology.orchestra.run.smithi098.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-14T15:53:57.124 INFO:teuthology.orchestra.run.smithi098.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-14T15:53:57.125 INFO:teuthology.orchestra.run.smithi098.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-14T15:53:57.125 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-14T15:53:57.125 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-argparse-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:53:57.125 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-common-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:53:57.125 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cephfs-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:53:57.125 INFO:teuthology.orchestra.run.smithi098.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-14T15:53:57.125 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-07-14T15:53:57.126 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-14T15:53:57.126 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-14T15:53:57.126 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-07-14T15:53:57.126 INFO:teuthology.orchestra.run.smithi098.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-14T15:53:57.126 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-14T15:53:57.126 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-14T15:53:57.126 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-14T15:53:57.126 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-14T15:53:57.127 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-14T15:53:57.127 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-14T15:53:57.127 INFO:teuthology.orchestra.run.smithi098.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-14T15:53:57.127 INFO:teuthology.orchestra.run.smithi098.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-14T15:53:57.127 INFO:teuthology.orchestra.run.smithi098.stdout: python3-mako-1.0.6-13.el8.noarch 2023-07-14T15:53:57.127 INFO:teuthology.orchestra.run.smithi098.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-14T15:53:57.127 INFO:teuthology.orchestra.run.smithi098.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-14T15:53:57.127 INFO:teuthology.orchestra.run.smithi098.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-14T15:53:57.128 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-14T15:53:57.128 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-14T15:53:57.128 INFO:teuthology.orchestra.run.smithi098.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-14T15:53:57.128 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-14T15:53:57.128 INFO:teuthology.orchestra.run.smithi098.stdout: python3-portend-2.6-1.el8.noarch 2023-07-14T15:53:57.128 INFO:teuthology.orchestra.run.smithi098.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-14T15:53:57.128 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-14T15:53:57.129 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-14T15:53:57.129 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-14T15:53:57.129 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-14T15:53:57.129 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-14T15:53:57.129 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rados-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:53:57.129 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rbd-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:53:57.129 INFO:teuthology.orchestra.run.smithi098.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-14T15:53:57.129 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-14T15:53:57.130 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rgw-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:53:57.130 INFO:teuthology.orchestra.run.smithi098.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-14T15:53:57.130 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rsa-4.8-1.el8.noarch 2023-07-14T15:53:57.130 INFO:teuthology.orchestra.run.smithi098.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-07-14T15:53:57.130 INFO:teuthology.orchestra.run.smithi098.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-14T15:53:57.130 INFO:teuthology.orchestra.run.smithi098.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-14T15:53:57.130 INFO:teuthology.orchestra.run.smithi098.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-14T15:53:57.130 INFO:teuthology.orchestra.run.smithi098.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-14T15:53:57.131 INFO:teuthology.orchestra.run.smithi098.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-14T15:53:57.131 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-14T15:53:57.131 INFO:teuthology.orchestra.run.smithi098.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-14T15:53:57.131 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-14T15:53:57.132 INFO:teuthology.orchestra.run.smithi098.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-14T15:53:57.132 INFO:teuthology.orchestra.run.smithi098.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-14T15:53:57.132 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-fuse-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:53:57.132 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:53:57.132 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-nbd-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:53:57.132 INFO:teuthology.orchestra.run.smithi098.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-14T15:53:57.132 INFO:teuthology.orchestra.run.smithi098.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-14T15:53:57.133 INFO:teuthology.orchestra.run.smithi098.stdout: uuid-1.6.2-43.el8.x86_64 2023-07-14T15:53:57.133 INFO:teuthology.orchestra.run.smithi098.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-07-14T15:53:57.133 INFO:teuthology.orchestra.run.smithi098.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-14T15:53:57.133 INFO:teuthology.orchestra.run.smithi098.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-07-14T15:53:57.134 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-14T15:53:57.134 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2023-07-14T15:53:57.891 DEBUG:teuthology.parallel:result is None 2023-07-14T15:54:03.690 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4757.g3fc0089c.el8.x86_64 96/134 2023-07-14T15:54:03.691 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /sys 2023-07-14T15:54:03.691 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /proc 2023-07-14T15:54:03.691 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /dev 2023-07-14T15:54:03.691 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /run 2023-07-14T15:54:03.691 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /mnt 2023-07-14T15:54:03.691 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /var/tmp 2023-07-14T15:54:03.691 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /home 2023-07-14T15:54:03.692 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /tmp 2023-07-14T15:54:03.692 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /dev 2023-07-14T15:54:03.692 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:54:04.073 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-volume-2:18.0.0-4757.g3fc0089c.el8.noarch 97/134 2023-07-14T15:54:05.919 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-volume-2:18.0.0-4757.g3fc0089c.el8.noarch 97/134 2023-07-14T15:54:06.104 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-osd-2:18.0.0-4757.g3fc0089c.el8.x86_64 98/134 2023-07-14T15:54:06.388 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-osd-2:18.0.0-4757.g3fc0089c.el8.x86_64 98/134 2023-07-14T15:54:06.572 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mds-2:18.0.0-4757.g3fc0089c.el8.x86_64 99/134 2023-07-14T15:54:07.135 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mds-2:18.0.0-4757.g3fc0089c.el8.x86_64 99/134 2023-07-14T15:54:07.356 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mon-2:18.0.0-4757.g3fc0089c.el8.x86_64 100/134 2023-07-14T15:54:07.399 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mon-2:18.0.0-4757.g3fc0089c.el8.x86_64 100/134 2023-07-14T15:54:10.271 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephadm-2:18.0.0-4757.g3fc0089c.el8.noarch 101/134 2023-07-14T15:54:10.457 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephadm-2:18.0.0-4757.g3fc0089c.el8.noarch 101/134 2023-07-14T15:54:10.655 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4757.g3fc0089c.e 102/134 2023-07-14T15:54:10.870 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4757.g3fc0089c. 103/134 2023-07-14T15:54:11.096 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4757.g3fc0089c.el8.noa 104/134 2023-07-14T15:54:11.369 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4757.g3fc0089c.el8.noa 104/134 2023-07-14T15:54:11.611 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4757.g3fc0089c.el8.n 105/134 2023-07-14T15:54:12.803 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4757.g3fc0089c.el8.n 105/134 2023-07-14T15:54:12.963 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4757.g3fc 106/134 2023-07-14T15:54:13.098 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4757.g3fc 106/134 2023-07-14T15:54:13.522 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4757.g3fc0089c.el 107/134 2023-07-14T15:54:13.745 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-2:18.0.0-4757.g3fc0089c.el8.x86_64 108/134 2023-07-14T15:54:13.813 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4757.g3fc0089c.el8.x86_64 108/134 2023-07-14T15:54:13.988 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-rook-2:18.0.0-4757.g3fc0089c.el8.noarch 109/134 2023-07-14T15:54:14.017 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4757.g3fc0089c.el8.noarch 109/134 2023-07-14T15:54:15.526 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-2:18.0.0-4757.g3fc0089c.el8.x86_64 110/134 2023-07-14T15:54:15.792 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-radosgw-2:18.0.0-4757.g3fc0089c.el8.x86_64 111/134 2023-07-14T15:54:15.860 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4757.g3fc0089c.el8.x86_64 111/134 2023-07-14T15:54:16.021 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4757.g3fc00 112/134 2023-07-14T15:54:16.101 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4757.g3fc00 112/134 2023-07-14T15:54:16.329 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephfs-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 113/134 2023-07-14T15:54:16.764 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 113/134 2023-07-14T15:54:16.921 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 114/134 2023-07-14T15:54:22.322 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 114/134 2023-07-14T15:54:22.648 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-test-2:18.0.0-4757.g3fc0089c.el8.x86_64 115/134 2023-07-14T15:54:22.812 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-07-14T15:54:23.077 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-07-14T15:54:24.357 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-07-14T15:54:24.679 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-07-14T15:54:24.858 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-fuse-2:18.0.0-4757.g3fc0089c.el8.x86_64 119/134 2023-07-14T15:54:25.058 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-07-14T15:54:25.284 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs-devel-2:18.0.0-4757.g3fc0089c.el8.x86_ 121/134 2023-07-14T15:54:25.454 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-07-14T15:54:28.994 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-14T15:54:29.253 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-14T15:54:29.290 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-14T15:54:29.503 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephfs-top-2:18.0.0-4757.g3fc0089c.el8.noarch 124/134 2023-07-14T15:54:29.688 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-fuse-2:18.0.0-4757.g3fc0089c.el8.x86_64 125/134 2023-07-14T15:54:30.050 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-nbd-2:18.0.0-4757.g3fc0089c.el8.x86_64 126/134 2023-07-14T15:54:30.362 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-07-14T15:54:30.552 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-07-14T15:54:30.575 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-07-14T15:54:30.825 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-07-14T15:54:30.985 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-07-14T15:54:31.107 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-07-14T15:54:31.318 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-07-14T15:54:31.348 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-07-14T15:54:31.348 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-14T15:54:31.583 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-14T15:54:31.584 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-14T15:54:31.842 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-14T15:54:32.061 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-14T15:54:32.323 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-07-14T15:54:32.323 INFO:teuthology.orchestra.run.smithi037.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-07-14T15:54:32.323 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:54:32.950 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-2:18.0.0-4757.g3fc0089c.el8.x86_64 1/134 2023-07-14T15:54:32.950 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-base-2:18.0.0-4757.g3fc0089c.el8.x86_64 2/134 2023-07-14T15:54:32.951 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-common-2:18.0.0-4757.g3fc0089c.el8.x86_64 3/134 2023-07-14T15:54:32.951 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-fuse-2:18.0.0-4757.g3fc0089c.el8.x86_64 4/134 2023-07-14T15:54:32.951 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4757.g3fc00 5/134 2023-07-14T15:54:32.951 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mds-2:18.0.0-4757.g3fc0089c.el8.x86_64 6/134 2023-07-14T15:54:32.951 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-2:18.0.0-4757.g3fc0089c.el8.x86_64 7/134 2023-07-14T15:54:32.951 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mon-2:18.0.0-4757.g3fc0089c.el8.x86_64 8/134 2023-07-14T15:54:32.951 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-osd-2:18.0.0-4757.g3fc0089c.el8.x86_64 9/134 2023-07-14T15:54:32.951 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-radosgw-2:18.0.0-4757.g3fc0089c.el8.x86_64 10/134 2023-07-14T15:54:32.952 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-selinux-2:18.0.0-4757.g3fc0089c.el8.x86_64 11/134 2023-07-14T15:54:32.952 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-test-2:18.0.0-4757.g3fc0089c.el8.x86_64 12/134 2023-07-14T15:54:32.952 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephfs-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 13/134 2023-07-14T15:54:32.952 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs-devel-2:18.0.0-4757.g3fc0089c.el8.x86_ 14/134 2023-07-14T15:54:32.952 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs2-2:18.0.0-4757.g3fc0089c.el8.x86_64 15/134 2023-07-14T15:54:32.952 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephsqlite-2:18.0.0-4757.g3fc0089c.el8.x86_64 16/134 2023-07-14T15:54:32.953 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados-devel-2:18.0.0-4757.g3fc0089c.el8.x86_6 17/134 2023-07-14T15:54:32.953 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libradosstriper1-2:18.0.0-4757.g3fc0089c.el8.x86 18/134 2023-07-14T15:54:32.953 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librgw2-2:18.0.0-4757.g3fc0089c.el8.x86_64 19/134 2023-07-14T15:54:32.953 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4757.g3fc0089c.el 20/134 2023-07-14T15:54:32.953 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-common-2:18.0.0-4757.g3fc0089c.el8. 21/134 2023-07-14T15:54:32.953 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cephfs-2:18.0.0-4757.g3fc0089c.el8.x86_6 22/134 2023-07-14T15:54:32.953 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rados-2:18.0.0-4757.g3fc0089c.el8.x86_64 23/134 2023-07-14T15:54:32.960 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rbd-2:18.0.0-4757.g3fc0089c.el8.x86_64 24/134 2023-07-14T15:54:32.961 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rgw-2:18.0.0-4757.g3fc0089c.el8.x86_64 25/134 2023-07-14T15:54:32.961 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-fuse-2:18.0.0-4757.g3fc0089c.el8.x86_64 26/134 2023-07-14T15:54:32.961 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 27/134 2023-07-14T15:54:32.961 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-nbd-2:18.0.0-4757.g3fc0089c.el8.x86_64 28/134 2023-07-14T15:54:32.961 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4757.g3fc0089c. 29/134 2023-07-14T15:54:32.961 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4757.g3fc0089c.el8.noa 30/134 2023-07-14T15:54:32.961 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4757.g3fc0089c.el8.n 31/134 2023-07-14T15:54:32.962 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4757.g3fc 32/134 2023-07-14T15:54:32.962 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4757.g3fc0089c.el 33/134 2023-07-14T15:54:32.962 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4757.g3fc0089c.el8.noarch 34/134 2023-07-14T15:54:32.962 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4757.g3fc0089c.e 35/134 2023-07-14T15:54:32.962 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-volume-2:18.0.0-4757.g3fc0089c.el8.noarch 36/134 2023-07-14T15:54:32.962 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephadm-2:18.0.0-4757.g3fc0089c.el8.noarch 37/134 2023-07-14T15:54:32.962 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephfs-top-2:18.0.0-4757.g3fc0089c.el8.noarch 38/134 2023-07-14T15:54:32.963 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-07-14T15:54:32.963 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-07-14T15:54:32.963 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-07-14T15:54:32.963 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-07-14T15:54:32.963 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-07-14T15:54:32.963 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-07-14T15:54:32.963 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-07-14T15:54:32.964 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-07-14T15:54:32.964 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-07-14T15:54:32.964 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-07-14T15:54:32.964 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-07-14T15:54:32.964 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-07-14T15:54:32.964 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-07-14T15:54:32.964 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-07-14T15:54:32.964 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-07-14T15:54:32.965 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-07-14T15:54:32.965 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-07-14T15:54:32.965 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-07-14T15:54:32.965 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-07-14T15:54:32.965 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-07-14T15:54:32.965 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-07-14T15:54:32.965 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-07-14T15:54:32.966 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-07-14T15:54:32.966 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-07-14T15:54:32.966 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-07-14T15:54:32.966 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-07-14T15:54:32.966 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-07-14T15:54:32.966 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-07-14T15:54:32.966 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-07-14T15:54:32.966 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-07-14T15:54:32.967 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-07-14T15:54:32.967 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-07-14T15:54:32.967 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-07-14T15:54:32.967 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-07-14T15:54:32.967 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-07-14T15:54:32.967 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-07-14T15:54:32.967 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-07-14T15:54:32.967 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-07-14T15:54:32.968 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-07-14T15:54:32.968 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-07-14T15:54:32.968 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-07-14T15:54:32.968 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-07-14T15:54:32.968 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-07-14T15:54:32.968 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-07-14T15:54:32.968 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-07-14T15:54:32.969 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-07-14T15:54:32.969 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-07-14T15:54:32.969 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-07-14T15:54:32.969 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-07-14T15:54:32.969 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-07-14T15:54:32.969 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-07-14T15:54:32.969 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-07-14T15:54:32.969 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-07-14T15:54:32.970 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-07-14T15:54:32.970 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-07-14T15:54:32.970 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-07-14T15:54:32.970 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-07-14T15:54:32.970 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-07-14T15:54:32.970 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-07-14T15:54:32.970 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-07-14T15:54:32.970 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-07-14T15:54:32.971 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-07-14T15:54:32.971 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-07-14T15:54:32.971 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-07-14T15:54:32.971 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-07-14T15:54:32.971 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-07-14T15:54:32.971 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-07-14T15:54:32.971 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-07-14T15:54:32.971 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-07-14T15:54:32.972 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-07-14T15:54:32.972 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-07-14T15:54:32.972 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-07-14T15:54:32.972 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-07-14T15:54:32.972 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-07-14T15:54:32.972 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-07-14T15:54:32.972 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-07-14T15:54:32.972 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-07-14T15:54:32.973 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-07-14T15:54:32.973 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-07-14T15:54:32.973 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-07-14T15:54:32.973 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-07-14T15:54:32.973 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-07-14T15:54:32.973 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-07-14T15:54:32.973 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-07-14T15:54:32.973 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-07-14T15:54:32.974 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-07-14T15:54:32.974 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-07-14T15:54:32.974 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-07-14T15:54:32.974 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-07-14T15:54:32.974 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-07-14T15:54:32.974 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-2:18.0.0-4757.g3fc0089c.el8.x86_64 129/134 2023-07-14T15:54:32.974 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-07-14T15:54:32.974 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-2:18.0.0-4757.g3fc0089c.el8.x86_64 131/134 2023-07-14T15:54:32.975 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-14T15:54:32.975 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-07-14T15:54:35.724 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-14T15:54:35.725 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:02:53 ago on Fri 14 Jul 2023 03:51:42 PM UTC. 2023-07-14T15:54:39.515 INFO:teuthology.orchestra.run.smithi037.stdout:Installed products updated. 2023-07-14T15:54:39.778 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:54:39.778 INFO:teuthology.orchestra.run.smithi037.stdout:Upgraded: 2023-07-14T15:54:39.778 INFO:teuthology.orchestra.run.smithi037.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-07-14T15:54:39.779 INFO:teuthology.orchestra.run.smithi037.stdout: librados2-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:54:39.779 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:54:39.779 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2023-07-14T15:54:39.779 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-07-14T15:54:39.779 INFO:teuthology.orchestra.run.smithi037.stdout: automake-1.16.1-7.el8.noarch 2023-07-14T15:54:39.779 INFO:teuthology.orchestra.run.smithi037.stdout: bison-3.0.4-10.el8.x86_64 2023-07-14T15:54:39.779 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:54:39.780 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:54:39.780 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:54:39.780 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:54:39.780 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T15:54:39.780 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:54:39.780 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:54:39.780 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:54:39.780 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T15:54:39.781 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T15:54:39.781 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T15:54:39.781 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T15:54:39.781 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T15:54:39.781 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:54:39.781 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:54:39.781 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T15:54:39.782 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:54:39.782 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:54:39.782 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:54:39.782 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T15:54:39.782 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T15:54:39.782 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:54:39.782 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-top-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T15:54:39.782 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-07-14T15:54:39.783 INFO:teuthology.orchestra.run.smithi037.stdout: flex-2.6.1-9.el8.x86_64 2023-07-14T15:54:39.783 INFO:teuthology.orchestra.run.smithi037.stdout: fuse-2.9.7-15.el8.x86_64 2023-07-14T15:54:39.783 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-14T15:54:39.783 INFO:teuthology.orchestra.run.smithi037.stdout: jq-1.6-3.el8.x86_64 2023-07-14T15:54:39.783 INFO:teuthology.orchestra.run.smithi037.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-14T15:54:39.783 INFO:teuthology.orchestra.run.smithi037.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-07-14T15:54:39.783 INFO:teuthology.orchestra.run.smithi037.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-14T15:54:39.783 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:54:39.784 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:54:39.784 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:54:39.784 INFO:teuthology.orchestra.run.smithi037.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-07-14T15:54:39.784 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-07-14T15:54:39.784 INFO:teuthology.orchestra.run.smithi037.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-14T15:54:39.784 INFO:teuthology.orchestra.run.smithi037.stdout: libpq-13.5-1.el8.x86_64 2023-07-14T15:54:39.784 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-07-14T15:54:39.785 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-07-14T15:54:39.785 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:54:39.785 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:54:39.785 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-14T15:54:39.785 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:54:39.785 INFO:teuthology.orchestra.run.smithi037.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-07-14T15:54:39.785 INFO:teuthology.orchestra.run.smithi037.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-14T15:54:39.786 INFO:teuthology.orchestra.run.smithi037.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-14T15:54:39.786 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-14T15:54:39.786 INFO:teuthology.orchestra.run.smithi037.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-07-14T15:54:39.786 INFO:teuthology.orchestra.run.smithi037.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-07-14T15:54:39.786 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-14T15:54:39.786 INFO:teuthology.orchestra.run.smithi037.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-14T15:54:39.786 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-0.3.15-3.el8.x86_64 2023-07-14T15:54:39.786 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-07-14T15:54:39.787 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-07-14T15:54:39.787 INFO:teuthology.orchestra.run.smithi037.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-07-14T15:54:39.787 INFO:teuthology.orchestra.run.smithi037.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-07-14T15:54:39.787 INFO:teuthology.orchestra.run.smithi037.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-07-14T15:54:39.787 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-14T15:54:39.787 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-14T15:54:39.787 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-14T15:54:39.788 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-14T15:54:39.788 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-14T15:54:39.788 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-14T15:54:39.788 INFO:teuthology.orchestra.run.smithi037.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-14T15:54:39.788 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-14T15:54:39.788 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:54:39.788 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:54:39.788 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:54:39.789 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-14T15:54:39.789 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-07-14T15:54:39.789 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-14T15:54:39.789 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-14T15:54:39.789 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-07-14T15:54:39.789 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-14T15:54:39.789 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-14T15:54:39.789 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-14T15:54:39.790 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-14T15:54:39.790 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-14T15:54:39.790 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-14T15:54:39.790 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-14T15:54:39.790 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-14T15:54:39.790 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-14T15:54:39.790 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako-1.0.6-13.el8.noarch 2023-07-14T15:54:39.791 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-14T15:54:39.791 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-14T15:54:39.791 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-14T15:54:39.791 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-14T15:54:39.791 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-14T15:54:39.791 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-14T15:54:39.791 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-14T15:54:39.791 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend-2.6-1.el8.noarch 2023-07-14T15:54:39.792 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-14T15:54:39.792 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-14T15:54:39.792 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-14T15:54:39.792 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-14T15:54:39.792 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-14T15:54:39.792 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-14T15:54:39.792 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:54:39.792 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:54:39.793 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-14T15:54:39.793 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-14T15:54:39.793 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:54:39.793 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-14T15:54:39.793 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa-4.8-1.el8.noarch 2023-07-14T15:54:39.793 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-07-14T15:54:39.794 INFO:teuthology.orchestra.run.smithi037.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-14T15:54:39.794 INFO:teuthology.orchestra.run.smithi037.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-14T15:54:39.794 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-14T15:54:39.794 INFO:teuthology.orchestra.run.smithi037.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-14T15:54:39.794 INFO:teuthology.orchestra.run.smithi037.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-14T15:54:39.794 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-14T15:54:39.794 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-14T15:54:39.795 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-14T15:54:39.795 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-14T15:54:39.795 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-14T15:54:39.795 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:54:39.795 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:54:39.795 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T15:54:39.795 INFO:teuthology.orchestra.run.smithi037.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-14T15:54:39.796 INFO:teuthology.orchestra.run.smithi037.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-14T15:54:39.796 INFO:teuthology.orchestra.run.smithi037.stdout: uuid-1.6.2-43.el8.x86_64 2023-07-14T15:54:39.796 INFO:teuthology.orchestra.run.smithi037.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-07-14T15:54:39.796 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-14T15:54:39.797 INFO:teuthology.orchestra.run.smithi037.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-07-14T15:54:39.797 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:54:39.797 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2023-07-14T15:54:40.082 DEBUG:teuthology.parallel:result is None 2023-07-14T15:54:40.083 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3fc0089cc1082313a98853d48b892acdc1385b8b 2023-07-14T15:54:40.367 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-14T15:54:40.422 INFO:teuthology.orchestra.run.smithi037.stdout:18.0.0-4757.g3fc0089c.el8 2023-07-14T15:54:40.422 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4757.g3fc0089c.el8 2023-07-14T15:54:40.423 INFO:teuthology.task.install:The correct ceph version 18.0.0-4757.g3fc0089c is installed. 2023-07-14T15:54:40.423 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3fc0089cc1082313a98853d48b892acdc1385b8b 2023-07-14T15:54:40.732 DEBUG:teuthology.orchestra.run.smithi098:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-14T15:54:40.786 INFO:teuthology.orchestra.run.smithi098.stdout:18.0.0-4757.g3fc0089c.el8 2023-07-14T15:54:40.786 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4757.g3fc0089c.el8 2023-07-14T15:54:40.787 INFO:teuthology.task.install:The correct ceph version 18.0.0-4757.g3fc0089c is installed. 2023-07-14T15:54:40.787 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-07-14T15:54:40.788 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-14T15:54:40.788 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-14T15:54:40.882 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-14T15:54:40.882 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-14T15:54:40.972 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-07-14T15:54:40.973 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-14T15:54:40.973 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/daemon-helper 2023-07-14T15:54:41.043 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-14T15:54:41.153 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-14T15:54:41.154 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/daemon-helper 2023-07-14T15:54:41.222 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-14T15:54:41.330 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-07-14T15:54:41.331 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-14T15:54:41.331 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-14T15:54:41.404 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-14T15:54:41.518 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-14T15:54:41.518 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-14T15:54:41.590 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-14T15:54:41.697 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-07-14T15:54:41.698 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-14T15:54:41.698 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/stdin-killer 2023-07-14T15:54:41.771 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-14T15:54:41.881 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-14T15:54:41.882 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/stdin-killer 2023-07-14T15:54:41.951 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-14T15:54:42.059 INFO:teuthology.run_tasks:Running task ceph... 2023-07-14T15:54:42.135 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-07-14T15:54:42.136 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 777 /var/log/ceph 2023-07-14T15:54:42.140 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 777 /var/log/ceph 2023-07-14T15:54:42.209 INFO:tasks.ceph:Disabling ceph logrotate... 2023-07-14T15:54:42.209 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-14T15:54:42.215 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-14T15:54:42.283 INFO:tasks.ceph:Creating extra log directories... 2023-07-14T15:54:42.284 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-14T15:54:42.288 DEBUG:teuthology.orchestra.run.smithi098:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-14T15:54:42.370 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-07-14T15:54:42.370 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-07-14T15:54:42.370 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-07-14T15:54:42.371 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-14T15:54:42.371 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-14T15:54:42.415 DEBUG:teuthology.orchestra.run.smithi037:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-14T15:54:47.635 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-07-14T15:54:47.706 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-14T15:54:47.706 DEBUG:teuthology.orchestra.run.smithi098:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-14T15:54:47.754 DEBUG:teuthology.orchestra.run.smithi098:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-14T15:54:57.999 DEBUG:teuthology.orchestra.run.smithi098:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-07-14T15:54:58.082 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-07-14T15:54:58.082 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-07-14T15:54:58.083 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337600', 'branch': 'wip-rishabh-2023Jul13', 'description': 'fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/snapshot}}', 'email': None, 'first_in_suite': False, 'job_id': '7337600', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'a440c79eee0258ae07e4988d8690fe6187b8b7a3'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-2023Jul13'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '3fc0089cc1082313a98853d48b892acdc1385b8b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '3fc0089cc1082313a98853d48b892acdc1385b8b'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-2023Jul13', 'sha1': '3fc0089cc1082313a98853d48b892acdc1385b8b'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'sha1': '3fc0089cc1082313a98853d48b892acdc1385b8b', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-rishabh-2023Jul13', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_3fc0089cc1082313a98853d48b892acdc1385b8b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '3fc0089cc1082313a98853d48b892acdc1385b8b', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi037.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac=', 'smithi098.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'a440c79eee0258ae07e4988d8690fe6187b8b7a3'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '3fc0089cc1082313a98853d48b892acdc1385b8b'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots', 'tasks.cephfs.test_volumes.TestSubvolumeSnapshots']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'aa6a80e6cc655fff48452a7eca02070e61d074fc', 'timestamp': '2023-07-14_10:26:42', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-07-14T15:54:58.084 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-14T15:54:58.088 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-14T15:54:58.132 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m0777 -- /var/run/ceph 2023-07-14T15:54:58.176 DEBUG:teuthology.orchestra.run.smithi098:> sudo install -d -m0777 -- /var/run/ceph 2023-07-14T15:54:58.244 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-14T15:54:58.244 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/scratch_devs of=/dev/stdout 2023-07-14T15:54:58.287 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-14T15:54:58.287 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_1 2023-07-14T15:54:58.374 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-14T15:54:58.375 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-14T15:54:58.375 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 450 Links: 1 2023-07-14T15:54:58.375 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-14T15:54:58.375 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2023-07-14T15:54:58.375 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2023-07-14 15:54:32.463340739 +0000 2023-07-14T15:54:58.375 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2023-07-14 15:50:15.540506170 +0000 2023-07-14T15:54:58.375 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2023-07-14 15:50:15.540506170 +0000 2023-07-14T15:54:58.376 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2023-07-14 15:50:15.510506556 +0000 2023-07-14T15:54:58.376 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-14T15:54:58.446 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2023-07-14T15:54:58.446 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2023-07-14T15:54:58.446 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000347801 s, 1.5 MB/s 2023-07-14T15:54:58.449 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-14T15:54:58.495 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_2 2023-07-14T15:54:58.541 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-14T15:54:58.542 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-14T15:54:58.542 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 456 Links: 1 2023-07-14T15:54:58.542 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-14T15:54:58.542 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2023-07-14T15:54:58.542 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2023-07-14 15:54:32.463340739 +0000 2023-07-14T15:54:58.544 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2023-07-14 15:50:16.374495470 +0000 2023-07-14T15:54:58.544 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2023-07-14 15:50:16.374495470 +0000 2023-07-14T15:54:58.544 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2023-07-14 15:50:16.345495842 +0000 2023-07-14T15:54:58.545 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-14T15:54:58.612 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2023-07-14T15:54:58.612 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2023-07-14T15:54:58.613 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000283838 s, 1.8 MB/s 2023-07-14T15:54:58.615 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-14T15:54:58.661 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_3 2023-07-14T15:54:58.747 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-14T15:54:58.748 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-14T15:54:58.748 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 462 Links: 1 2023-07-14T15:54:58.748 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-14T15:54:58.748 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2023-07-14T15:54:58.749 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2023-07-14 15:54:32.463340739 +0000 2023-07-14T15:54:58.749 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2023-07-14 15:50:17.221484602 +0000 2023-07-14T15:54:58.749 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2023-07-14 15:50:17.221484602 +0000 2023-07-14T15:54:58.749 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2023-07-14 15:50:17.195484936 +0000 2023-07-14T15:54:58.749 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-14T15:54:58.857 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2023-07-14T15:54:58.857 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2023-07-14T15:54:58.857 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000322355 s, 1.6 MB/s 2023-07-14T15:54:58.860 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-14T15:54:58.906 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_4 2023-07-14T15:54:58.950 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-14T15:54:58.951 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-14T15:54:58.951 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 468 Links: 1 2023-07-14T15:54:58.951 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-14T15:54:58.951 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2023-07-14T15:54:58.951 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2023-07-14 15:54:32.463340739 +0000 2023-07-14T15:54:58.952 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2023-07-14 15:50:18.059473850 +0000 2023-07-14T15:54:58.952 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2023-07-14 15:50:18.059473850 +0000 2023-07-14T15:54:58.952 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2023-07-14 15:50:18.031474209 +0000 2023-07-14T15:54:58.952 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-14T15:54:59.060 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2023-07-14T15:54:59.061 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2023-07-14T15:54:59.061 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000304758 s, 1.7 MB/s 2023-07-14T15:54:59.063 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-14T15:54:59.111 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-14T15:54:59.112 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-14T15:54:59.112 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/scratch_devs of=/dev/stdout 2023-07-14T15:54:59.159 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-14T15:54:59.160 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_1 2023-07-14T15:54:59.245 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-14T15:54:59.245 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-14T15:54:59.245 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 450 Links: 1 2023-07-14T15:54:59.245 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-14T15:54:59.245 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2023-07-14T15:54:59.246 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2023-07-14 15:53:50.612580169 +0000 2023-07-14T15:54:59.246 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2023-07-14 15:50:04.945033315 +0000 2023-07-14T15:54:59.246 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2023-07-14 15:50:04.945033315 +0000 2023-07-14T15:54:59.246 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2023-07-14 15:50:04.916033670 +0000 2023-07-14T15:54:59.246 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-14T15:54:59.350 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2023-07-14T15:54:59.351 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2023-07-14T15:54:59.351 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000340591 s, 1.5 MB/s 2023-07-14T15:54:59.354 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-14T15:54:59.399 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_2 2023-07-14T15:54:59.482 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-14T15:54:59.482 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-14T15:54:59.483 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 456 Links: 1 2023-07-14T15:54:59.483 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-14T15:54:59.483 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2023-07-14T15:54:59.483 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2023-07-14 15:53:50.612580169 +0000 2023-07-14T15:54:59.483 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2023-07-14 15:50:05.775023154 +0000 2023-07-14T15:54:59.483 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2023-07-14 15:50:05.775023154 +0000 2023-07-14T15:54:59.484 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2023-07-14 15:50:05.746023510 +0000 2023-07-14T15:54:59.484 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-14T15:54:59.585 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2023-07-14T15:54:59.586 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2023-07-14T15:54:59.586 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000300723 s, 1.7 MB/s 2023-07-14T15:54:59.588 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-14T15:54:59.632 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_3 2023-07-14T15:54:59.715 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-14T15:54:59.715 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-14T15:54:59.715 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 462 Links: 1 2023-07-14T15:54:59.715 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-14T15:54:59.715 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2023-07-14T15:54:59.716 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2023-07-14 15:53:50.612580169 +0000 2023-07-14T15:54:59.716 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2023-07-14 15:50:06.616012861 +0000 2023-07-14T15:54:59.716 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2023-07-14 15:50:06.616012861 +0000 2023-07-14T15:54:59.716 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2023-07-14 15:50:06.589013192 +0000 2023-07-14T15:54:59.716 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-14T15:54:59.819 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2023-07-14T15:54:59.819 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2023-07-14T15:54:59.820 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000282148 s, 1.8 MB/s 2023-07-14T15:54:59.822 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-14T15:54:59.867 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_4 2023-07-14T15:54:59.950 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-14T15:54:59.951 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-14T15:54:59.951 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 468 Links: 1 2023-07-14T15:54:59.951 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-14T15:54:59.951 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2023-07-14T15:54:59.952 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2023-07-14 15:53:50.612580169 +0000 2023-07-14T15:54:59.952 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2023-07-14 15:50:07.453002617 +0000 2023-07-14T15:54:59.952 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2023-07-14 15:50:07.453002617 +0000 2023-07-14T15:54:59.952 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2023-07-14 15:50:07.426002948 +0000 2023-07-14T15:54:59.953 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-14T15:55:00.054 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2023-07-14T15:55:00.054 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2023-07-14T15:55:00.054 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000316469 s, 1.6 MB/s 2023-07-14T15:55:00.056 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-14T15:55:00.101 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-14T15:55:00.101 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi037.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi098.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-14T15:55:00.101 INFO:tasks.ceph:Generating config... 2023-07-14T15:55:00.103 INFO:tasks.ceph:[client] client mount timeout = 600 2023-07-14T15:55:00.103 INFO:tasks.ceph:[client] debug client = 20 2023-07-14T15:55:00.103 INFO:tasks.ceph:[client] debug ms = 1 2023-07-14T15:55:00.104 INFO:tasks.ceph:[client] pid file = 2023-07-14T15:55:00.104 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-07-14T15:55:00.104 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-07-14T15:55:00.105 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-07-14T15:55:00.105 INFO:tasks.ceph:[mds] debug mds = 20 2023-07-14T15:55:00.105 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-07-14T15:55:00.105 INFO:tasks.ceph:[mds] debug ms = 1 2023-07-14T15:55:00.105 INFO:tasks.ceph:[mds] mds debug frag = True 2023-07-14T15:55:00.106 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-07-14T15:55:00.106 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-07-14T15:55:00.106 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-07-14T15:55:00.106 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-07-14T15:55:00.106 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-07-14T15:55:00.107 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-07-14T15:55:00.107 INFO:tasks.ceph:[mgr] debug client = 20 2023-07-14T15:55:00.107 INFO:tasks.ceph:[mgr] debug finisher = 20 2023-07-14T15:55:00.107 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-07-14T15:55:00.107 INFO:tasks.ceph:[mgr] debug ms = 1 2023-07-14T15:55:00.108 INFO:tasks.ceph:[mon] debug mon = 20 2023-07-14T15:55:00.108 INFO:tasks.ceph:[mon] debug ms = 1 2023-07-14T15:55:00.108 INFO:tasks.ceph:[mon] debug paxos = 20 2023-07-14T15:55:00.108 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-07-14T15:55:00.108 INFO:tasks.ceph:[osd] bdev async discard = True 2023-07-14T15:55:00.109 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-07-14T15:55:00.109 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-07-14T15:55:00.109 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-07-14T15:55:00.109 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-07-14T15:55:00.110 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-07-14T15:55:00.110 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-07-14T15:55:00.110 INFO:tasks.ceph:[osd] debug ms = 1 2023-07-14T15:55:00.110 INFO:tasks.ceph:[osd] debug osd = 20 2023-07-14T15:55:00.111 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-07-14T15:55:00.111 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-07-14T15:55:00.111 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-07-14T15:55:00.111 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-07-14T15:55:00.111 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-07-14T15:55:00.112 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-07-14T15:55:00.112 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-07-14T15:55:00.112 INFO:tasks.ceph:Setting up mon.a... 2023-07-14T15:55:00.113 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-07-14T15:55:00.226 INFO:teuthology.orchestra.run.smithi037.stdout:creating /etc/ceph/ceph.keyring 2023-07-14T15:55:00.232 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-07-14T15:55:00.336 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-14T15:55:00.404 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.37'), ('mon.b', '172.21.15.98'), ('mon.c', '[v2:172.21.15.98:3301,v1:172.21.15.98:6790]')] 2023-07-14T15:55:00.405 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.37,172.21.15.98,[v2:172.21.15.98:3301,v1:172.21.15.98:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-07-14T15:55:00.406 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-14T15:55:00.406 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-07-14T15:55:00.451 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.37 --add b 172.21.15.98 --addv c '[v2:172.21.15.98:3301,v1:172.21.15.98:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-07-14T15:55:00.583 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-07-14T15:55:00.583 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: generated fsid 9da30401-a779-4e46-aba6-00c2494c6c67 2023-07-14T15:55:00.583 INFO:teuthology.orchestra.run.smithi037.stdout:setting min_mon_release = pacific 2023-07-14T15:55:00.584 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 0 2023-07-14T15:55:00.584 INFO:teuthology.orchestra.run.smithi037.stdout:fsid 9da30401-a779-4e46-aba6-00c2494c6c67 2023-07-14T15:55:00.584 INFO:teuthology.orchestra.run.smithi037.stdout:last_changed 2023-07-14T15:55:00.596081+0000 2023-07-14T15:55:00.584 INFO:teuthology.orchestra.run.smithi037.stdout:created 2023-07-14T15:55:00.596081+0000 2023-07-14T15:55:00.584 INFO:teuthology.orchestra.run.smithi037.stdout:min_mon_release 16 (pacific) 2023-07-14T15:55:00.584 INFO:teuthology.orchestra.run.smithi037.stdout:election_strategy: 1 2023-07-14T15:55:00.584 INFO:teuthology.orchestra.run.smithi037.stdout:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2023-07-14T15:55:00.585 INFO:teuthology.orchestra.run.smithi037.stdout:1: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.b 2023-07-14T15:55:00.585 INFO:teuthology.orchestra.run.smithi037.stdout:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2023-07-14T15:55:00.585 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-07-14T15:55:00.586 DEBUG:teuthology.orchestra.run.smithi037:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-07-14T15:55:00.632 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 9da30401-a779-4e46-aba6-00c2494c6c67... 2023-07-14T15:55:00.633 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-14T15:55:00.678 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-14T15:55:00.799 INFO:teuthology.orchestra.run.smithi098.stdout:[global] 2023-07-14T15:55:00.799 INFO:teuthology.orchestra.run.smithi098.stdout: chdir = "" 2023-07-14T15:55:00.799 INFO:teuthology.orchestra.run.smithi098.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-14T15:55:00.800 INFO:teuthology.orchestra.run.smithi098.stdout: auth supported = cephx 2023-07-14T15:55:00.800 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-14T15:55:00.800 INFO:teuthology.orchestra.run.smithi098.stdout: filestore xattr use omap = true 2023-07-14T15:55:00.801 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-14T15:55:00.801 INFO:teuthology.orchestra.run.smithi098.stdout: mon clock drift allowed = 1.000 2023-07-14T15:55:00.801 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-14T15:55:00.801 INFO:teuthology.orchestra.run.smithi098.stdout: osd crush chooseleaf type = 0 2023-07-14T15:55:00.802 INFO:teuthology.orchestra.run.smithi098.stdout: auth debug = true 2023-07-14T15:55:00.802 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-14T15:55:00.802 INFO:teuthology.orchestra.run.smithi098.stdout: ms die on old message = true 2023-07-14T15:55:00.802 INFO:teuthology.orchestra.run.smithi098.stdout: ms die on bug = true 2023-07-14T15:55:00.803 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-14T15:55:00.803 INFO:teuthology.orchestra.run.smithi098.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-14T15:55:00.803 INFO:teuthology.orchestra.run.smithi098.stdout: mon pg warn max object skew = 0 2023-07-14T15:55:00.803 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-14T15:55:00.804 INFO:teuthology.orchestra.run.smithi098.stdout: # disable pg_autoscaler by default for new pools 2023-07-14T15:55:00.804 INFO:teuthology.orchestra.run.smithi098.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-14T15:55:00.804 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-14T15:55:00.805 INFO:teuthology.orchestra.run.smithi098.stdout: osd pool default size = 2 2023-07-14T15:55:00.805 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-14T15:55:00.805 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd allow primary affinity = true 2023-07-14T15:55:00.805 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd allow pg remap = true 2023-07-14T15:55:00.806 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on legacy crush tunables = false 2023-07-14T15:55:00.806 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on crush straw calc version zero = false 2023-07-14T15:55:00.806 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on no sortbitwise = false 2023-07-14T15:55:00.806 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on osd down out interval zero = false 2023-07-14T15:55:00.806 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on too few osds = false 2023-07-14T15:55:00.807 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-14T15:55:00.807 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-14T15:55:00.807 INFO:teuthology.orchestra.run.smithi098.stdout: mon_allow_pool_size_one = true 2023-07-14T15:55:00.807 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-14T15:55:00.807 INFO:teuthology.orchestra.run.smithi098.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-14T15:55:00.807 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-14T15:55:00.808 INFO:teuthology.orchestra.run.smithi098.stdout: osd default data pool replay window = 5 2023-07-14T15:55:00.808 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-14T15:55:00.808 INFO:teuthology.orchestra.run.smithi098.stdout: mon allow pool delete = true 2023-07-14T15:55:00.808 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-14T15:55:00.808 INFO:teuthology.orchestra.run.smithi098.stdout: mon cluster log file level = debug 2023-07-14T15:55:00.808 INFO:teuthology.orchestra.run.smithi098.stdout: debug asserts on shutdown = true 2023-07-14T15:55:00.809 INFO:teuthology.orchestra.run.smithi098.stdout: mon health detail to clog = false 2023-07-14T15:55:00.809 INFO:teuthology.orchestra.run.smithi098.stdout: mon host = "172.21.15.37,172.21.15.98,[v2:172.21.15.98:3301,v1:172.21.15.98:6790]" 2023-07-14T15:55:00.809 INFO:teuthology.orchestra.run.smithi098.stdout: ms die on skipped message = False 2023-07-14T15:55:00.809 INFO:teuthology.orchestra.run.smithi098.stdout: fsid = 9da30401-a779-4e46-aba6-00c2494c6c67 2023-07-14T15:55:00.809 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-14T15:55:00.810 INFO:teuthology.orchestra.run.smithi098.stdout:[osd] 2023-07-14T15:55:00.810 INFO:teuthology.orchestra.run.smithi098.stdout: osd journal size = 100 2023-07-14T15:55:00.810 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-14T15:55:00.810 INFO:teuthology.orchestra.run.smithi098.stdout: osd scrub load threshold = 5.0 2023-07-14T15:55:00.811 INFO:teuthology.orchestra.run.smithi098.stdout: osd scrub max interval = 600 2023-07-14T15:55:00.811 INFO:teuthology.orchestra.run.smithi098.stdout: osd mclock profile = high_recovery_ops 2023-07-14T15:55:00.811 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-14T15:55:00.811 INFO:teuthology.orchestra.run.smithi098.stdout: osd recover clone overlap = true 2023-07-14T15:55:00.811 INFO:teuthology.orchestra.run.smithi098.stdout: osd recovery max chunk = 1048576 2023-07-14T15:55:00.811 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-14T15:55:00.812 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug shutdown = true 2023-07-14T15:55:00.812 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug op order = true 2023-07-14T15:55:00.812 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug verify stray on activate = true 2023-07-14T15:55:00.812 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-14T15:55:00.812 INFO:teuthology.orchestra.run.smithi098.stdout: osd open classes on start = true 2023-07-14T15:55:00.812 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug pg log writeout = true 2023-07-14T15:55:00.812 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-14T15:55:00.813 INFO:teuthology.orchestra.run.smithi098.stdout: osd deep scrub update digest min age = 30 2023-07-14T15:55:00.813 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-14T15:55:00.813 INFO:teuthology.orchestra.run.smithi098.stdout: osd map max advance = 10 2023-07-14T15:55:00.813 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-14T15:55:00.813 INFO:teuthology.orchestra.run.smithi098.stdout: journal zero on create = true 2023-07-14T15:55:00.813 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-14T15:55:00.813 INFO:teuthology.orchestra.run.smithi098.stdout: filestore ondisk finisher threads = 3 2023-07-14T15:55:00.813 INFO:teuthology.orchestra.run.smithi098.stdout: filestore apply finisher threads = 3 2023-07-14T15:55:00.814 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-14T15:55:00.814 INFO:teuthology.orchestra.run.smithi098.stdout: bdev debug aio = true 2023-07-14T15:55:00.814 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug misdirected ops = true 2023-07-14T15:55:00.814 INFO:teuthology.orchestra.run.smithi098.stdout: bdev async discard = True 2023-07-14T15:55:00.814 INFO:teuthology.orchestra.run.smithi098.stdout: bdev enable discard = True 2023-07-14T15:55:00.814 INFO:teuthology.orchestra.run.smithi098.stdout: bluestore allocator = bitmap 2023-07-14T15:55:00.814 INFO:teuthology.orchestra.run.smithi098.stdout: bluestore block size = 96636764160 2023-07-14T15:55:00.814 INFO:teuthology.orchestra.run.smithi098.stdout: bluestore fsck on mount = True 2023-07-14T15:55:00.815 INFO:teuthology.orchestra.run.smithi098.stdout: debug bluefs = 1/20 2023-07-14T15:55:00.815 INFO:teuthology.orchestra.run.smithi098.stdout: debug bluestore = 1/20 2023-07-14T15:55:00.815 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2023-07-14T15:55:00.815 INFO:teuthology.orchestra.run.smithi098.stdout: debug osd = 20 2023-07-14T15:55:00.815 INFO:teuthology.orchestra.run.smithi098.stdout: debug rocksdb = 4/10 2023-07-14T15:55:00.815 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd backfillfull_ratio = 0.85 2023-07-14T15:55:00.815 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd full ratio = 0.9 2023-07-14T15:55:00.816 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd nearfull ratio = 0.8 2023-07-14T15:55:00.816 INFO:teuthology.orchestra.run.smithi098.stdout: osd failsafe full ratio = 0.95 2023-07-14T15:55:00.816 INFO:teuthology.orchestra.run.smithi098.stdout: osd objectstore = bluestore 2023-07-14T15:55:00.816 INFO:teuthology.orchestra.run.smithi098.stdout: osd op complaint time = 180 2023-07-14T15:55:00.816 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-14T15:55:00.816 INFO:teuthology.orchestra.run.smithi098.stdout:[mgr] 2023-07-14T15:55:00.816 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2023-07-14T15:55:00.816 INFO:teuthology.orchestra.run.smithi098.stdout: debug mgr = 20 2023-07-14T15:55:00.817 INFO:teuthology.orchestra.run.smithi098.stdout: debug mon = 20 2023-07-14T15:55:00.817 INFO:teuthology.orchestra.run.smithi098.stdout: debug auth = 20 2023-07-14T15:55:00.817 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min pgs per osd = 4 2023-07-14T15:55:00.817 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min bytes per osd = 10 2023-07-14T15:55:00.817 INFO:teuthology.orchestra.run.smithi098.stdout: mgr/telemetry/nag = false 2023-07-14T15:55:00.817 INFO:teuthology.orchestra.run.smithi098.stdout: debug client = 20 2023-07-14T15:55:00.817 INFO:teuthology.orchestra.run.smithi098.stdout: debug finisher = 20 2023-07-14T15:55:00.818 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-14T15:55:00.818 INFO:teuthology.orchestra.run.smithi098.stdout:[mon] 2023-07-14T15:55:00.818 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2023-07-14T15:55:00.818 INFO:teuthology.orchestra.run.smithi098.stdout: debug mon = 20 2023-07-14T15:55:00.818 INFO:teuthology.orchestra.run.smithi098.stdout: debug paxos = 20 2023-07-14T15:55:00.818 INFO:teuthology.orchestra.run.smithi098.stdout: debug auth = 20 2023-07-14T15:55:00.818 INFO:teuthology.orchestra.run.smithi098.stdout: mon data avail warn = 5 2023-07-14T15:55:00.818 INFO:teuthology.orchestra.run.smithi098.stdout: mon mgr mkfs grace = 240 2023-07-14T15:55:00.819 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min pgs per osd = 4 2023-07-14T15:55:00.819 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd reporter subtree level = osd 2023-07-14T15:55:00.819 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd prime pg temp = true 2023-07-14T15:55:00.819 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min bytes per osd = 10 2023-07-14T15:55:00.819 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-14T15:55:00.819 INFO:teuthology.orchestra.run.smithi098.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-14T15:55:00.819 INFO:teuthology.orchestra.run.smithi098.stdout: auth mon ticket ttl = 660 # 11m 2023-07-14T15:55:00.819 INFO:teuthology.orchestra.run.smithi098.stdout: auth service ticket ttl = 240 # 4m 2023-07-14T15:55:00.820 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-14T15:55:00.820 INFO:teuthology.orchestra.run.smithi098.stdout: # don't complain about insecure global_id in the test suite 2023-07-14T15:55:00.820 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-14T15:55:00.820 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-14T15:55:00.820 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-14T15:55:00.820 INFO:teuthology.orchestra.run.smithi098.stdout: # 1m isn't quite enough 2023-07-14T15:55:00.820 INFO:teuthology.orchestra.run.smithi098.stdout: mon_down_mkfs_grace = 2m 2023-07-14T15:55:00.821 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-14T15:55:00.821 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_filestore_osds = false 2023-07-14T15:55:00.821 INFO:teuthology.orchestra.run.smithi098.stdout: mon op complaint time = 120 2023-07-14T15:55:00.821 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-07-14T15:55:00.821 INFO:teuthology.orchestra.run.smithi098.stdout:[client] 2023-07-14T15:55:00.821 INFO:teuthology.orchestra.run.smithi098.stdout: rgw cache enabled = true 2023-07-14T15:55:00.821 INFO:teuthology.orchestra.run.smithi098.stdout: rgw enable ops log = true 2023-07-14T15:55:00.821 INFO:teuthology.orchestra.run.smithi098.stdout: rgw enable usage log = true 2023-07-14T15:55:00.822 INFO:teuthology.orchestra.run.smithi098.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-14T15:55:00.822 INFO:teuthology.orchestra.run.smithi098.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-14T15:55:00.822 INFO:teuthology.orchestra.run.smithi098.stdout: client mount timeout = 600 2023-07-14T15:55:00.822 INFO:teuthology.orchestra.run.smithi098.stdout: debug client = 20 2023-07-14T15:55:00.822 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2023-07-14T15:55:00.822 INFO:teuthology.orchestra.run.smithi098.stdout: pid file = "" 2023-07-14T15:55:00.822 INFO:teuthology.orchestra.run.smithi098.stdout: rados mon op timeout = 900 2023-07-14T15:55:00.822 INFO:teuthology.orchestra.run.smithi098.stdout: rados osd op timeout = 900 2023-07-14T15:55:00.823 INFO:teuthology.orchestra.run.smithi098.stdout:[mon.a] 2023-07-14T15:55:00.823 INFO:teuthology.orchestra.run.smithi098.stdout:[mon.b] 2023-07-14T15:55:00.823 INFO:teuthology.orchestra.run.smithi098.stdout:[mon.c] 2023-07-14T15:55:00.823 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.a] 2023-07-14T15:55:00.823 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.c] 2023-07-14T15:55:00.823 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.b] 2023-07-14T15:55:00.823 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.d] 2023-07-14T15:55:00.823 INFO:teuthology.orchestra.run.smithi098.stdout:[mds] 2023-07-14T15:55:00.824 INFO:teuthology.orchestra.run.smithi098.stdout: debug mds = 20 2023-07-14T15:55:00.824 INFO:teuthology.orchestra.run.smithi098.stdout: debug mds balancer = 20 2023-07-14T15:55:00.824 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2023-07-14T15:55:00.824 INFO:teuthology.orchestra.run.smithi098.stdout: mds debug frag = True 2023-07-14T15:55:00.824 INFO:teuthology.orchestra.run.smithi098.stdout: mds debug scatterstat = True 2023-07-14T15:55:00.824 INFO:teuthology.orchestra.run.smithi098.stdout: mds op complaint time = 180 2023-07-14T15:55:00.824 INFO:teuthology.orchestra.run.smithi098.stdout: mds verify scatter = True 2023-07-14T15:55:00.824 INFO:teuthology.orchestra.run.smithi098.stdout: osd op complaint time = 180 2023-07-14T15:55:00.825 INFO:teuthology.orchestra.run.smithi098.stdout: rados mon op timeout = 900 2023-07-14T15:55:00.825 INFO:teuthology.orchestra.run.smithi098.stdout: rados osd op timeout = 900 2023-07-14T15:55:00.825 INFO:teuthology.orchestra.run.smithi037.stdout:[global] 2023-07-14T15:55:00.825 INFO:teuthology.orchestra.run.smithi037.stdout: chdir = "" 2023-07-14T15:55:00.826 INFO:teuthology.orchestra.run.smithi037.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-14T15:55:00.826 INFO:teuthology.orchestra.run.smithi037.stdout: auth supported = cephx 2023-07-14T15:55:00.826 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:55:00.826 INFO:teuthology.orchestra.run.smithi037.stdout: filestore xattr use omap = true 2023-07-14T15:55:00.826 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:55:00.826 INFO:teuthology.orchestra.run.smithi037.stdout: mon clock drift allowed = 1.000 2023-07-14T15:55:00.826 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:55:00.827 INFO:teuthology.orchestra.run.smithi037.stdout: osd crush chooseleaf type = 0 2023-07-14T15:55:00.827 INFO:teuthology.orchestra.run.smithi037.stdout: auth debug = true 2023-07-14T15:55:00.827 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:55:00.827 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on old message = true 2023-07-14T15:55:00.827 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on bug = true 2023-07-14T15:55:00.827 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:55:00.827 INFO:teuthology.orchestra.run.smithi037.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-14T15:55:00.827 INFO:teuthology.orchestra.run.smithi037.stdout: mon pg warn max object skew = 0 2023-07-14T15:55:00.828 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:55:00.828 INFO:teuthology.orchestra.run.smithi037.stdout: # disable pg_autoscaler by default for new pools 2023-07-14T15:55:00.828 INFO:teuthology.orchestra.run.smithi037.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-14T15:55:00.828 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:55:00.828 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default size = 2 2023-07-14T15:55:00.828 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:55:00.828 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow primary affinity = true 2023-07-14T15:55:00.828 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow pg remap = true 2023-07-14T15:55:00.829 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on legacy crush tunables = false 2023-07-14T15:55:00.829 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on crush straw calc version zero = false 2023-07-14T15:55:00.829 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on no sortbitwise = false 2023-07-14T15:55:00.829 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on osd down out interval zero = false 2023-07-14T15:55:00.829 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on too few osds = false 2023-07-14T15:55:00.829 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-14T15:55:00.829 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-14T15:55:00.829 INFO:teuthology.orchestra.run.smithi037.stdout: mon_allow_pool_size_one = true 2023-07-14T15:55:00.830 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:55:00.830 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-14T15:55:00.830 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:55:00.830 INFO:teuthology.orchestra.run.smithi037.stdout: osd default data pool replay window = 5 2023-07-14T15:55:00.830 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:55:00.830 INFO:teuthology.orchestra.run.smithi037.stdout: mon allow pool delete = true 2023-07-14T15:55:00.830 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:55:00.831 INFO:teuthology.orchestra.run.smithi037.stdout: mon cluster log file level = debug 2023-07-14T15:55:00.831 INFO:teuthology.orchestra.run.smithi037.stdout: debug asserts on shutdown = true 2023-07-14T15:55:00.831 INFO:teuthology.orchestra.run.smithi037.stdout: mon health detail to clog = false 2023-07-14T15:55:00.831 INFO:teuthology.orchestra.run.smithi037.stdout: mon host = "172.21.15.37,172.21.15.98,[v2:172.21.15.98:3301,v1:172.21.15.98:6790]" 2023-07-14T15:55:00.831 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on skipped message = False 2023-07-14T15:55:00.831 INFO:teuthology.orchestra.run.smithi037.stdout: fsid = 9da30401-a779-4e46-aba6-00c2494c6c67 2023-07-14T15:55:00.831 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:55:00.831 INFO:teuthology.orchestra.run.smithi037.stdout:[osd] 2023-07-14T15:55:00.832 INFO:teuthology.orchestra.run.smithi037.stdout: osd journal size = 100 2023-07-14T15:55:00.832 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:55:00.832 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub load threshold = 5.0 2023-07-14T15:55:00.832 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub max interval = 600 2023-07-14T15:55:00.832 INFO:teuthology.orchestra.run.smithi037.stdout: osd mclock profile = high_recovery_ops 2023-07-14T15:55:00.832 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:55:00.832 INFO:teuthology.orchestra.run.smithi037.stdout: osd recover clone overlap = true 2023-07-14T15:55:00.832 INFO:teuthology.orchestra.run.smithi037.stdout: osd recovery max chunk = 1048576 2023-07-14T15:55:00.833 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:55:00.833 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug shutdown = true 2023-07-14T15:55:00.833 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug op order = true 2023-07-14T15:55:00.833 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug verify stray on activate = true 2023-07-14T15:55:00.833 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:55:00.834 INFO:teuthology.orchestra.run.smithi037.stdout: osd open classes on start = true 2023-07-14T15:55:00.834 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug pg log writeout = true 2023-07-14T15:55:00.834 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:55:00.834 INFO:teuthology.orchestra.run.smithi037.stdout: osd deep scrub update digest min age = 30 2023-07-14T15:55:00.834 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:55:00.834 INFO:teuthology.orchestra.run.smithi037.stdout: osd map max advance = 10 2023-07-14T15:55:00.834 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:55:00.834 INFO:teuthology.orchestra.run.smithi037.stdout: journal zero on create = true 2023-07-14T15:55:00.835 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:55:00.835 INFO:teuthology.orchestra.run.smithi037.stdout: filestore ondisk finisher threads = 3 2023-07-14T15:55:00.835 INFO:teuthology.orchestra.run.smithi037.stdout: filestore apply finisher threads = 3 2023-07-14T15:55:00.835 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:55:00.835 INFO:teuthology.orchestra.run.smithi037.stdout: bdev debug aio = true 2023-07-14T15:55:00.835 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug misdirected ops = true 2023-07-14T15:55:00.835 INFO:teuthology.orchestra.run.smithi037.stdout: bdev async discard = True 2023-07-14T15:55:00.835 INFO:teuthology.orchestra.run.smithi037.stdout: bdev enable discard = True 2023-07-14T15:55:00.836 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore allocator = bitmap 2023-07-14T15:55:00.836 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore block size = 96636764160 2023-07-14T15:55:00.836 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore fsck on mount = True 2023-07-14T15:55:00.836 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluefs = 1/20 2023-07-14T15:55:00.836 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluestore = 1/20 2023-07-14T15:55:00.836 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-07-14T15:55:00.836 INFO:teuthology.orchestra.run.smithi037.stdout: debug osd = 20 2023-07-14T15:55:00.837 INFO:teuthology.orchestra.run.smithi037.stdout: debug rocksdb = 4/10 2023-07-14T15:55:00.837 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd backfillfull_ratio = 0.85 2023-07-14T15:55:00.837 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd full ratio = 0.9 2023-07-14T15:55:00.837 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd nearfull ratio = 0.8 2023-07-14T15:55:00.837 INFO:teuthology.orchestra.run.smithi037.stdout: osd failsafe full ratio = 0.95 2023-07-14T15:55:00.837 INFO:teuthology.orchestra.run.smithi037.stdout: osd objectstore = bluestore 2023-07-14T15:55:00.837 INFO:teuthology.orchestra.run.smithi037.stdout: osd op complaint time = 180 2023-07-14T15:55:00.837 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:55:00.838 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr] 2023-07-14T15:55:00.838 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-07-14T15:55:00.838 INFO:teuthology.orchestra.run.smithi037.stdout: debug mgr = 20 2023-07-14T15:55:00.838 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2023-07-14T15:55:00.838 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2023-07-14T15:55:00.838 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2023-07-14T15:55:00.838 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2023-07-14T15:55:00.838 INFO:teuthology.orchestra.run.smithi037.stdout: mgr/telemetry/nag = false 2023-07-14T15:55:00.839 INFO:teuthology.orchestra.run.smithi037.stdout: debug client = 20 2023-07-14T15:55:00.839 INFO:teuthology.orchestra.run.smithi037.stdout: debug finisher = 20 2023-07-14T15:55:00.839 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:55:00.839 INFO:teuthology.orchestra.run.smithi037.stdout:[mon] 2023-07-14T15:55:00.839 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-07-14T15:55:00.839 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2023-07-14T15:55:00.839 INFO:teuthology.orchestra.run.smithi037.stdout: debug paxos = 20 2023-07-14T15:55:00.839 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2023-07-14T15:55:00.840 INFO:teuthology.orchestra.run.smithi037.stdout: mon data avail warn = 5 2023-07-14T15:55:00.840 INFO:teuthology.orchestra.run.smithi037.stdout: mon mgr mkfs grace = 240 2023-07-14T15:55:00.840 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2023-07-14T15:55:00.840 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd reporter subtree level = osd 2023-07-14T15:55:00.840 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd prime pg temp = true 2023-07-14T15:55:00.840 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2023-07-14T15:55:00.840 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:55:00.840 INFO:teuthology.orchestra.run.smithi037.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-14T15:55:00.841 INFO:teuthology.orchestra.run.smithi037.stdout: auth mon ticket ttl = 660 # 11m 2023-07-14T15:55:00.841 INFO:teuthology.orchestra.run.smithi037.stdout: auth service ticket ttl = 240 # 4m 2023-07-14T15:55:00.841 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:55:00.841 INFO:teuthology.orchestra.run.smithi037.stdout: # don't complain about insecure global_id in the test suite 2023-07-14T15:55:00.841 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-14T15:55:00.841 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-14T15:55:00.841 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:55:00.841 INFO:teuthology.orchestra.run.smithi037.stdout: # 1m isn't quite enough 2023-07-14T15:55:00.842 INFO:teuthology.orchestra.run.smithi037.stdout: mon_down_mkfs_grace = 2m 2023-07-14T15:55:00.842 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:55:00.842 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_filestore_osds = false 2023-07-14T15:55:00.842 INFO:teuthology.orchestra.run.smithi037.stdout: mon op complaint time = 120 2023-07-14T15:55:00.842 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:55:00.842 INFO:teuthology.orchestra.run.smithi037.stdout:[client] 2023-07-14T15:55:00.842 INFO:teuthology.orchestra.run.smithi037.stdout: rgw cache enabled = true 2023-07-14T15:55:00.843 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable ops log = true 2023-07-14T15:55:00.843 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable usage log = true 2023-07-14T15:55:00.843 INFO:teuthology.orchestra.run.smithi037.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-14T15:55:00.843 INFO:teuthology.orchestra.run.smithi037.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-14T15:55:00.843 INFO:teuthology.orchestra.run.smithi037.stdout: client mount timeout = 600 2023-07-14T15:55:00.843 INFO:teuthology.orchestra.run.smithi037.stdout: debug client = 20 2023-07-14T15:55:00.843 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-07-14T15:55:00.843 INFO:teuthology.orchestra.run.smithi037.stdout: pid file = "" 2023-07-14T15:55:00.844 INFO:teuthology.orchestra.run.smithi037.stdout: rados mon op timeout = 900 2023-07-14T15:55:00.844 INFO:teuthology.orchestra.run.smithi037.stdout: rados osd op timeout = 900 2023-07-14T15:55:00.844 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.a] 2023-07-14T15:55:00.844 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.b] 2023-07-14T15:55:00.844 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.c] 2023-07-14T15:55:00.844 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.a] 2023-07-14T15:55:00.844 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.c] 2023-07-14T15:55:00.844 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.b] 2023-07-14T15:55:00.845 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.d] 2023-07-14T15:55:00.845 INFO:teuthology.orchestra.run.smithi037.stdout:[mds] 2023-07-14T15:55:00.845 INFO:teuthology.orchestra.run.smithi037.stdout: debug mds = 20 2023-07-14T15:55:00.845 INFO:teuthology.orchestra.run.smithi037.stdout: debug mds balancer = 20 2023-07-14T15:55:00.845 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-07-14T15:55:00.845 INFO:teuthology.orchestra.run.smithi037.stdout: mds debug frag = True 2023-07-14T15:55:00.845 INFO:teuthology.orchestra.run.smithi037.stdout: mds debug scatterstat = True 2023-07-14T15:55:00.845 INFO:teuthology.orchestra.run.smithi037.stdout: mds op complaint time = 180 2023-07-14T15:55:00.846 INFO:teuthology.orchestra.run.smithi037.stdout: mds verify scatter = True 2023-07-14T15:55:00.846 INFO:teuthology.orchestra.run.smithi037.stdout: osd op complaint time = 180 2023-07-14T15:55:00.846 INFO:teuthology.orchestra.run.smithi037.stdout: rados mon op timeout = 900 2023-07-14T15:55:00.846 INFO:teuthology.orchestra.run.smithi037.stdout: rados osd op timeout = 900 2023-07-14T15:55:00.847 INFO:tasks.ceph:Creating admin key on mon.a... 2023-07-14T15:55:00.848 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-07-14T15:55:00.965 INFO:tasks.ceph:Copying monmap to all nodes... 2023-07-14T15:55:00.965 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-14T15:55:00.965 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-07-14T15:55:01.010 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-14T15:55:01.010 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-07-14T15:55:01.093 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi037.front.sepia.ceph.com 2023-07-14T15:55:01.093 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-14T15:55:01.093 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-14T15:55:01.093 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-14T15:55:01.236 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-14T15:55:01.236 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-14T15:55:01.320 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi098.front.sepia.ceph.com 2023-07-14T15:55:01.320 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-14T15:55:01.320 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-14T15:55:01.321 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-14T15:55:01.415 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-14T15:55:01.415 DEBUG:teuthology.orchestra.run.smithi098:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-14T15:55:01.497 INFO:tasks.ceph:Setting up mon nodes... 2023-07-14T15:55:01.497 INFO:tasks.ceph:Setting up mgr nodes... 2023-07-14T15:55:01.498 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-07-14T15:55:01.629 INFO:teuthology.orchestra.run.smithi037.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-07-14T15:55:01.636 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-07-14T15:55:01.766 INFO:teuthology.orchestra.run.smithi098.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-07-14T15:55:01.773 INFO:tasks.ceph:Setting up mds nodes... 2023-07-14T15:55:01.773 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-07-14T15:55:01.906 INFO:teuthology.orchestra.run.smithi037.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-07-14T15:55:01.911 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-07-14T15:55:01.982 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-07-14T15:55:02.113 INFO:teuthology.orchestra.run.smithi037.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-07-14T15:55:02.119 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-07-14T15:55:02.189 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-07-14T15:55:02.311 INFO:teuthology.orchestra.run.smithi098.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-07-14T15:55:02.316 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-07-14T15:55:02.383 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-07-14T15:55:02.504 INFO:teuthology.orchestra.run.smithi098.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-07-14T15:55:02.509 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-07-14T15:55:02.576 INFO:tasks.ceph_client:Setting up client nodes... 2023-07-14T15:55:02.577 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-07-14T15:55:02.677 INFO:teuthology.orchestra.run.smithi037.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-07-14T15:55:02.711 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-07-14T15:55:02.812 INFO:teuthology.orchestra.run.smithi037.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-07-14T15:55:02.846 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-07-14T15:55:02.941 INFO:teuthology.orchestra.run.smithi098.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-07-14T15:55:02.973 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-07-14T15:55:03.067 INFO:teuthology.orchestra.run.smithi098.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-07-14T15:55:03.099 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-07-14T15:55:03.099 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi037.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi098.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-14T15:55:03.100 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-07-14T15:55:03.175 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-14T15:55:03.176 INFO:tasks.ceph:role: osd.0 2023-07-14T15:55:03.176 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi037.front.sepia.ceph.com 2023-07-14T15:55:03.176 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-14T15:55:03.257 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-14T15:55:03.257 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-14T15:55:03.258 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-14T15:55:03.258 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-14T15:55:03.258 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-14T15:55:03.258 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2023-07-14T15:55:03.258 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-14T15:55:03.258 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-14T15:55:03.258 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-14T15:55:03.259 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-14T15:55:03.681 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2023-07-14T15:55:03.685 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2023-07-14T15:55:03.686 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-07-14T15:55:03.883 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-07-14T15:55:03.964 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-07-14T15:55:04.036 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-14T15:55:04.037 INFO:tasks.ceph:role: osd.1 2023-07-14T15:55:04.037 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi037.front.sepia.ceph.com 2023-07-14T15:55:04.037 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-14T15:55:04.116 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-14T15:55:04.117 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-14T15:55:04.117 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-14T15:55:04.117 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-14T15:55:04.117 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-14T15:55:04.117 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2023-07-14T15:55:04.118 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-14T15:55:04.118 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-14T15:55:04.118 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-14T15:55:04.118 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-14T15:55:04.521 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2023-07-14T15:55:04.525 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2023-07-14T15:55:04.526 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-07-14T15:55:04.666 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-07-14T15:55:04.745 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-07-14T15:55:04.819 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-14T15:55:04.819 INFO:tasks.ceph:role: osd.2 2023-07-14T15:55:04.820 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi037.front.sepia.ceph.com 2023-07-14T15:55:04.820 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-14T15:55:04.900 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-14T15:55:04.900 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-14T15:55:04.901 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-14T15:55:04.901 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-14T15:55:04.901 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-14T15:55:04.901 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2023-07-14T15:55:04.901 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-14T15:55:04.901 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-14T15:55:04.901 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-14T15:55:04.902 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-14T15:55:05.346 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2023-07-14T15:55:05.350 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2023-07-14T15:55:05.350 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-07-14T15:55:05.542 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-07-14T15:55:05.620 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-07-14T15:55:05.690 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-14T15:55:05.691 INFO:tasks.ceph:role: osd.3 2023-07-14T15:55:05.691 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi037.front.sepia.ceph.com 2023-07-14T15:55:05.691 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-14T15:55:05.769 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-14T15:55:05.770 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-14T15:55:05.770 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-14T15:55:05.770 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-14T15:55:05.770 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-14T15:55:05.770 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2023-07-14T15:55:05.770 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-14T15:55:05.770 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-14T15:55:05.771 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-14T15:55:05.771 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-14T15:55:06.196 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2023-07-14T15:55:06.200 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2023-07-14T15:55:06.200 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-07-14T15:55:06.324 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-07-14T15:55:06.401 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-14T15:55:06.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:06.546+0000 7f01566ec640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-07-14T15:55:06.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:06.546+0000 7f01566ec640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-07-14T15:55:06.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:06.546+0000 7f01566ec640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-14T15:55:06.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:06.546+0000 7f01566ec640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-14T15:55:06.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:06.546+0000 7f01566ec640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-14T15:55:06.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:06.548+0000 7f01566ec640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-07-14T15:55:09.718 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-07-14T15:55:09.791 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-14T15:55:09.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:09.913+0000 7f6ae3361640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-07-14T15:55:09.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:09.913+0000 7f6ae3361640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-07-14T15:55:09.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:09.913+0000 7f6ae3361640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-14T15:55:09.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:09.913+0000 7f6ae3361640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-14T15:55:09.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:09.913+0000 7f6ae3361640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-14T15:55:09.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:09.915+0000 7f6ae3361640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-07-14T15:55:12.832 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-07-14T15:55:12.902 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-14T15:55:13.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:13.025+0000 7f322ac0c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-07-14T15:55:13.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:13.026+0000 7f322ac0c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-07-14T15:55:13.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:13.026+0000 7f322ac0c640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-14T15:55:13.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:13.026+0000 7f322ac0c640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-14T15:55:13.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:13.026+0000 7f322ac0c640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-14T15:55:13.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:13.028+0000 7f322ac0c640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-07-14T15:55:15.940 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-07-14T15:55:16.014 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-14T15:55:16.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:16.150+0000 7f40b9a9e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-07-14T15:55:16.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:16.151+0000 7f40b9a9e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-07-14T15:55:16.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:16.151+0000 7f40b9a9e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-14T15:55:16.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:16.151+0000 7f40b9a9e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-14T15:55:16.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:16.151+0000 7f40b9a9e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-14T15:55:16.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:16.152+0000 7f40b9a9e640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-07-14T15:55:19.088 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-07-14T15:55:19.159 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-07-14T15:55:19.233 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-14T15:55:19.234 INFO:tasks.ceph:role: osd.4 2023-07-14T15:55:19.234 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi098.front.sepia.ceph.com 2023-07-14T15:55:19.234 DEBUG:teuthology.orchestra.run.smithi098:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-14T15:55:19.311 INFO:teuthology.orchestra.run.smithi098.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-14T15:55:19.311 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-14T15:55:19.312 INFO:teuthology.orchestra.run.smithi098.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-14T15:55:19.312 INFO:teuthology.orchestra.run.smithi098.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-14T15:55:19.312 INFO:teuthology.orchestra.run.smithi098.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-14T15:55:19.312 INFO:teuthology.orchestra.run.smithi098.stdout: = sunit=0 swidth=0 blks 2023-07-14T15:55:19.312 INFO:teuthology.orchestra.run.smithi098.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-14T15:55:19.313 INFO:teuthology.orchestra.run.smithi098.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-14T15:55:19.313 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-14T15:55:19.313 INFO:teuthology.orchestra.run.smithi098.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-14T15:55:19.753 INFO:teuthology.orchestra.run.smithi098.stdout:Discarding blocks...Done. 2023-07-14T15:55:19.757 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi098.front.sepia.ceph.com -o noatime 2023-07-14T15:55:19.757 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-07-14T15:55:19.930 DEBUG:teuthology.orchestra.run.smithi098:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-07-14T15:55:20.005 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-07-14T15:55:20.073 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-14T15:55:20.073 INFO:tasks.ceph:role: osd.5 2023-07-14T15:55:20.073 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi098.front.sepia.ceph.com 2023-07-14T15:55:20.074 DEBUG:teuthology.orchestra.run.smithi098:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-14T15:55:20.147 INFO:teuthology.orchestra.run.smithi098.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-14T15:55:20.148 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-14T15:55:20.148 INFO:teuthology.orchestra.run.smithi098.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-14T15:55:20.148 INFO:teuthology.orchestra.run.smithi098.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-14T15:55:20.148 INFO:teuthology.orchestra.run.smithi098.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-14T15:55:20.148 INFO:teuthology.orchestra.run.smithi098.stdout: = sunit=0 swidth=0 blks 2023-07-14T15:55:20.149 INFO:teuthology.orchestra.run.smithi098.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-14T15:55:20.149 INFO:teuthology.orchestra.run.smithi098.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-14T15:55:20.149 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-14T15:55:20.149 INFO:teuthology.orchestra.run.smithi098.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-14T15:55:20.554 INFO:teuthology.orchestra.run.smithi098.stdout:Discarding blocks...Done. 2023-07-14T15:55:20.558 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi098.front.sepia.ceph.com -o noatime 2023-07-14T15:55:20.558 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-07-14T15:55:20.698 DEBUG:teuthology.orchestra.run.smithi098:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-07-14T15:55:20.774 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-07-14T15:55:20.842 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-14T15:55:20.842 INFO:tasks.ceph:role: osd.6 2023-07-14T15:55:20.843 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi098.front.sepia.ceph.com 2023-07-14T15:55:20.843 DEBUG:teuthology.orchestra.run.smithi098:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-14T15:55:20.919 INFO:teuthology.orchestra.run.smithi098.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-14T15:55:20.919 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-14T15:55:20.919 INFO:teuthology.orchestra.run.smithi098.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-14T15:55:20.919 INFO:teuthology.orchestra.run.smithi098.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-14T15:55:20.919 INFO:teuthology.orchestra.run.smithi098.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-14T15:55:20.919 INFO:teuthology.orchestra.run.smithi098.stdout: = sunit=0 swidth=0 blks 2023-07-14T15:55:20.920 INFO:teuthology.orchestra.run.smithi098.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-14T15:55:20.920 INFO:teuthology.orchestra.run.smithi098.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-14T15:55:20.920 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-14T15:55:20.920 INFO:teuthology.orchestra.run.smithi098.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-14T15:55:21.365 INFO:teuthology.orchestra.run.smithi098.stdout:Discarding blocks...Done. 2023-07-14T15:55:21.368 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi098.front.sepia.ceph.com -o noatime 2023-07-14T15:55:21.369 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-07-14T15:55:21.570 DEBUG:teuthology.orchestra.run.smithi098:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-07-14T15:55:21.646 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-07-14T15:55:21.714 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-14T15:55:21.715 INFO:tasks.ceph:role: osd.7 2023-07-14T15:55:21.715 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi098.front.sepia.ceph.com 2023-07-14T15:55:21.715 DEBUG:teuthology.orchestra.run.smithi098:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-14T15:55:21.789 INFO:teuthology.orchestra.run.smithi098.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-14T15:55:21.789 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-14T15:55:21.790 INFO:teuthology.orchestra.run.smithi098.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-14T15:55:21.790 INFO:teuthology.orchestra.run.smithi098.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-14T15:55:21.790 INFO:teuthology.orchestra.run.smithi098.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-14T15:55:21.790 INFO:teuthology.orchestra.run.smithi098.stdout: = sunit=0 swidth=0 blks 2023-07-14T15:55:21.790 INFO:teuthology.orchestra.run.smithi098.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-14T15:55:21.790 INFO:teuthology.orchestra.run.smithi098.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-14T15:55:21.791 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-14T15:55:21.791 INFO:teuthology.orchestra.run.smithi098.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-14T15:55:22.227 INFO:teuthology.orchestra.run.smithi098.stdout:Discarding blocks...Done. 2023-07-14T15:55:22.231 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi098.front.sepia.ceph.com -o noatime 2023-07-14T15:55:22.231 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-07-14T15:55:22.368 DEBUG:teuthology.orchestra.run.smithi098:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-07-14T15:55:22.441 DEBUG:teuthology.orchestra.run.smithi098:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-14T15:55:22.605 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:22.617+0000 7febf0748640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-07-14T15:55:22.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:22.618+0000 7febf0748640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-07-14T15:55:22.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:22.618+0000 7febf0748640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-14T15:55:22.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:22.618+0000 7febf0748640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-14T15:55:22.606 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:22.618+0000 7febf0748640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-14T15:55:22.607 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:22.620+0000 7febf0748640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-07-14T15:55:25.491 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-07-14T15:55:25.561 DEBUG:teuthology.orchestra.run.smithi098:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-14T15:55:25.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:25.677+0000 7f9b8796d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-07-14T15:55:25.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:25.677+0000 7f9b8796d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-07-14T15:55:25.665 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:25.677+0000 7f9b8796d640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-14T15:55:25.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:25.677+0000 7f9b8796d640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-14T15:55:25.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:25.677+0000 7f9b8796d640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-14T15:55:25.666 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:25.679+0000 7f9b8796d640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-07-14T15:55:28.085 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T15:55:28.091 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T15:55:28.544 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-07-14T15:55:28.611 DEBUG:teuthology.orchestra.run.smithi098:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-14T15:55:28.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:28.726+0000 7f8d15a15640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-07-14T15:55:28.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:28.726+0000 7f8d15a15640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-07-14T15:55:28.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:28.726+0000 7f8d15a15640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-14T15:55:28.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:28.726+0000 7f8d15a15640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-14T15:55:28.714 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:28.726+0000 7f8d15a15640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-14T15:55:28.715 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:28.728+0000 7f8d15a15640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-07-14T15:55:31.595 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-07-14T15:55:31.664 DEBUG:teuthology.orchestra.run.smithi098:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-14T15:55:31.768 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:31.780+0000 7febb0d21640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-07-14T15:55:31.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:31.781+0000 7febb0d21640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-07-14T15:55:31.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:31.781+0000 7febb0d21640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-14T15:55:31.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:31.781+0000 7febb0d21640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-14T15:55:31.769 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:31.781+0000 7febb0d21640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-14T15:55:31.770 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:31.782+0000 7febb0d21640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-07-14T15:55:34.650 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-07-14T15:55:34.722 INFO:tasks.ceph:Reading keys from all nodes... 2023-07-14T15:55:34.722 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-14T15:55:34.723 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-07-14T15:55:34.799 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-14T15:55:34.800 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-07-14T15:55:34.910 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-14T15:55:34.911 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-07-14T15:55:35.019 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-14T15:55:35.019 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-07-14T15:55:35.128 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-14T15:55:35.128 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-07-14T15:55:35.237 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-14T15:55:35.237 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-07-14T15:55:35.346 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-14T15:55:35.346 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-07-14T15:55:35.455 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-14T15:55:35.456 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-07-14T15:55:35.530 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-14T15:55:35.531 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-07-14T15:55:35.640 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-14T15:55:35.640 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-07-14T15:55:35.747 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-14T15:55:35.747 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-07-14T15:55:35.853 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-14T15:55:35.854 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-07-14T15:55:35.960 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-14T15:55:35.960 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-07-14T15:55:36.067 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-14T15:55:36.067 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-07-14T15:55:36.173 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-14T15:55:36.174 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-07-14T15:55:36.220 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-14T15:55:36.220 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-07-14T15:55:36.304 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-14T15:55:36.305 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-07-14T15:55:36.347 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-14T15:55:36.347 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-07-14T15:55:36.429 INFO:tasks.ceph:Adding keys to all mons... 2023-07-14T15:55:36.430 DEBUG:teuthology.orchestra.run.smithi037:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-14T15:55:36.434 DEBUG:teuthology.orchestra.run.smithi098:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-14T15:55:36.498 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr.y] 2023-07-14T15:55:36.498 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDVb7FkCOFSJhAAyIE5jprQPjAID/yxt6h/hw== 2023-07-14T15:55:36.498 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.a] 2023-07-14T15:55:36.498 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDVb7FkSxzFNhAAhrnBBg5xGqPBvvevPq4vZA== 2023-07-14T15:55:36.498 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.c] 2023-07-14T15:55:36.499 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDWb7FkbJCQBxAAO/cHg6ZdojgzYGv21flqgQ== 2023-07-14T15:55:36.499 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.0] 2023-07-14T15:55:36.499 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDab7FkNzKhIBAAen9vSEkCJn7EoBVXNfnboA== 2023-07-14T15:55:36.499 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.1] 2023-07-14T15:55:36.499 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDdb7FkTRmBNhAA15XBAQ7LMuahPxyg3bzAQA== 2023-07-14T15:55:36.499 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.2] 2023-07-14T15:55:36.499 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDhb7FkLa6hARAAj31Jgen/BeAnuRrGAbQAmw== 2023-07-14T15:55:36.500 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.3] 2023-07-14T15:55:36.500 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDkb7FkenwSCRAAW0MIsfBqfycPzHB6Pdwl6w== 2023-07-14T15:55:36.500 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr.x] 2023-07-14T15:55:36.500 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDVb7FkfzV7LhAAg+oMjrhI7XaOhlYDUSa9ug== 2023-07-14T15:55:36.500 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.b] 2023-07-14T15:55:36.500 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDWb7FkZalZExAAqIzmfWzer/rftvB+irYM5w== 2023-07-14T15:55:36.500 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.d] 2023-07-14T15:55:36.501 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDWb7FkxQ7WHhAAeMQ+8/ypEagYuBalxTGYew== 2023-07-14T15:55:36.501 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.4] 2023-07-14T15:55:36.501 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDqb7FkjSHhJBAAR61S7ufnwHSiG5gPeEt9mQ== 2023-07-14T15:55:36.501 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.5] 2023-07-14T15:55:36.501 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDtb7Fke+lwKBAAry9Kdgwm+H6t2DdcOJ3g4w== 2023-07-14T15:55:36.501 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.6] 2023-07-14T15:55:36.501 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDwb7FkJDxaKxAAZvh6zl1Yl1+r6Cp4jvpL/w== 2023-07-14T15:55:36.502 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.7] 2023-07-14T15:55:36.502 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDzb7FkY3CbLhAAZ2N8iigUMGTFAXYIcWLk7g== 2023-07-14T15:55:36.502 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2023-07-14T15:55:36.502 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDWb7Fk8l4jKRAAD40aK9YW0bgBjt3LF5EM2Q== 2023-07-14T15:55:36.502 INFO:teuthology.orchestra.run.smithi037.stdout:[client.2] 2023-07-14T15:55:36.503 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDWb7FktFUuMRAA3DeSj/TCt1iOd1L5LjlLNA== 2023-07-14T15:55:36.503 INFO:teuthology.orchestra.run.smithi037.stdout:[client.1] 2023-07-14T15:55:36.503 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDWb7FkGMrgOBAA5c0LB2Z158/t57ZiKLSM/A== 2023-07-14T15:55:36.503 INFO:teuthology.orchestra.run.smithi037.stdout:[client.3] 2023-07-14T15:55:36.503 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDXb7FkmG/QBBAA8xqYve+K8TfT94oNGgVcuA== 2023-07-14T15:55:36.532 INFO:teuthology.orchestra.run.smithi098.stdout:[mgr.y] 2023-07-14T15:55:36.532 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDVb7FkCOFSJhAAyIE5jprQPjAID/yxt6h/hw== 2023-07-14T15:55:36.533 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.a] 2023-07-14T15:55:36.533 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDVb7FkSxzFNhAAhrnBBg5xGqPBvvevPq4vZA== 2023-07-14T15:55:36.533 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.c] 2023-07-14T15:55:36.533 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDWb7FkbJCQBxAAO/cHg6ZdojgzYGv21flqgQ== 2023-07-14T15:55:36.533 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.0] 2023-07-14T15:55:36.533 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDab7FkNzKhIBAAen9vSEkCJn7EoBVXNfnboA== 2023-07-14T15:55:36.533 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.1] 2023-07-14T15:55:36.534 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDdb7FkTRmBNhAA15XBAQ7LMuahPxyg3bzAQA== 2023-07-14T15:55:36.534 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.2] 2023-07-14T15:55:36.534 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDhb7FkLa6hARAAj31Jgen/BeAnuRrGAbQAmw== 2023-07-14T15:55:36.534 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.3] 2023-07-14T15:55:36.534 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDkb7FkenwSCRAAW0MIsfBqfycPzHB6Pdwl6w== 2023-07-14T15:55:36.534 INFO:teuthology.orchestra.run.smithi098.stdout:[mgr.x] 2023-07-14T15:55:36.534 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDVb7FkfzV7LhAAg+oMjrhI7XaOhlYDUSa9ug== 2023-07-14T15:55:36.535 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.b] 2023-07-14T15:55:36.535 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDWb7FkZalZExAAqIzmfWzer/rftvB+irYM5w== 2023-07-14T15:55:36.535 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.d] 2023-07-14T15:55:36.535 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDWb7FkxQ7WHhAAeMQ+8/ypEagYuBalxTGYew== 2023-07-14T15:55:36.535 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.4] 2023-07-14T15:55:36.535 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDqb7FkjSHhJBAAR61S7ufnwHSiG5gPeEt9mQ== 2023-07-14T15:55:36.535 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.5] 2023-07-14T15:55:36.536 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDtb7Fke+lwKBAAry9Kdgwm+H6t2DdcOJ3g4w== 2023-07-14T15:55:36.536 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.6] 2023-07-14T15:55:36.537 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDwb7FkJDxaKxAAZvh6zl1Yl1+r6Cp4jvpL/w== 2023-07-14T15:55:36.537 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.7] 2023-07-14T15:55:36.537 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDzb7FkY3CbLhAAZ2N8iigUMGTFAXYIcWLk7g== 2023-07-14T15:55:36.538 INFO:teuthology.orchestra.run.smithi098.stdout:[client.0] 2023-07-14T15:55:36.538 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDWb7Fk8l4jKRAAD40aK9YW0bgBjt3LF5EM2Q== 2023-07-14T15:55:36.539 INFO:teuthology.orchestra.run.smithi098.stdout:[client.2] 2023-07-14T15:55:36.539 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDWb7FktFUuMRAA3DeSj/TCt1iOd1L5LjlLNA== 2023-07-14T15:55:36.539 INFO:teuthology.orchestra.run.smithi098.stdout:[client.1] 2023-07-14T15:55:36.539 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDWb7FkGMrgOBAA5c0LB2Z158/t57ZiKLSM/A== 2023-07-14T15:55:36.539 INFO:teuthology.orchestra.run.smithi098.stdout:[client.3] 2023-07-14T15:55:36.539 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDXb7FkmG/QBBAA8xqYve+K8TfT94oNGgVcuA== 2023-07-14T15:55:36.541 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-14T15:55:36.549 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-14T15:55:36.686 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-14T15:55:36.692 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-14T15:55:36.802 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-14T15:55:36.807 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-14T15:55:36.917 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-14T15:55:36.921 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-14T15:55:37.027 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-14T15:55:37.031 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-14T15:55:37.138 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-14T15:55:37.143 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-14T15:55:37.250 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-14T15:55:37.254 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-14T15:55:37.361 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-14T15:55:37.365 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-14T15:55:37.471 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-14T15:55:37.476 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-14T15:55:37.586 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-14T15:55:37.591 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-14T15:55:37.702 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-14T15:55:37.707 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-14T15:55:37.814 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-14T15:55:37.818 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-14T15:55:37.925 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-14T15:55:37.929 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-14T15:55:38.036 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-14T15:55:38.040 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-14T15:55:38.148 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-14T15:55:38.153 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-14T15:55:38.262 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-14T15:55:38.267 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-14T15:55:38.376 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-14T15:55:38.381 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-14T15:55:38.490 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-14T15:55:38.495 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-14T15:55:38.605 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-07-14T15:55:38.606 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-07-14T15:55:38.674 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-14T15:55:38.799 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-07-14T15:55:38.869 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-07-14T15:55:38.937 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-14T15:55:39.058 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-07-14T15:55:39.127 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-07-14T15:55:39.195 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-14T15:55:39.317 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-07-14T15:55:39.385 DEBUG:teuthology.orchestra.run.smithi037:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-14T15:55:39.390 DEBUG:teuthology.orchestra.run.smithi098:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-14T15:55:39.432 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-07-14T15:55:39.433 INFO:tasks.ceph.mon.a:Restarting daemon 2023-07-14T15:55:39.433 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-07-14T15:55:39.475 INFO:tasks.ceph.mon.a:Started 2023-07-14T15:55:39.475 INFO:tasks.ceph.mon.b:Restarting daemon 2023-07-14T15:55:39.475 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-07-14T15:55:39.479 INFO:tasks.ceph.mon.b:Started 2023-07-14T15:55:39.480 INFO:tasks.ceph.mon.c:Restarting daemon 2023-07-14T15:55:39.480 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-07-14T15:55:39.484 INFO:tasks.ceph.mon.c:Started 2023-07-14T15:55:39.485 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-07-14T15:55:39.486 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-07-14T15:55:39.486 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-07-14T15:55:39.491 INFO:tasks.ceph.mgr.y:Started 2023-07-14T15:55:39.491 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-07-14T15:55:39.491 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-07-14T15:55:39.495 INFO:tasks.ceph.mgr.x:Started 2023-07-14T15:55:39.496 INFO:tasks.ceph:Setting crush tunables to default 2023-07-14T15:55:39.496 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd crush tunables default 2023-07-14T15:55:39.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.712+0000 7f97aa9ff700 1 Processor -- start 2023-07-14T15:55:39.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.712+0000 7f97aa9ff700 1 -- start start 2023-07-14T15:55:39.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.713+0000 7f97aa9ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f97a415a580 0x7f97a415eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:39.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.713+0000 7f97aa9ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f97a406b320 0x7f97a4070e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:39.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.713+0000 7f97aa9ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97a4066280 con 0x7f97a406d710 2023-07-14T15:55:39.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.713+0000 7f97aa9ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97a40cb7f0 con 0x7f97a415a580 2023-07-14T15:55:39.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.713+0000 7f97aa9ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a40c9920 con 0x7f97a406b320 2023-07-14T15:55:39.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.714+0000 7f97a8f9c700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f97a406d710 0x7f97a40c9d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.37:48700/0 (socket says 172.21.15.37:48700) 2023-07-14T15:55:39.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.714+0000 7f97a8f9c700 1 -- 172.21.15.37:0/1344343936 learned_addr learned my addr 172.21.15.37:0/1344343936 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:55:39.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.714+0000 7f97a37fe700 1 --2- 172.21.15.37:0/1344343936 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f97a406b320 0x7f97a4070e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:39.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.714+0000 7f97a3fff700 1 --2- 172.21.15.37:0/1344343936 >> v2:172.21.15.37:3300/0 conn(0x7f97a415a580 0x7f97a415eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:39.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.714+0000 7f97a37fe700 1 -- 172.21.15.37:0/1344343936 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f97a406b320 msgr2=0x7f97a4070e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-07-14T15:55:39.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.714+0000 7f97a37fe700 1 -- 172.21.15.37:0/1344343936 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f97a406b320 msgr2=0x7f97a4070e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-14T15:55:39.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.714+0000 7f97a37fe700 1 --2- 172.21.15.37:0/1344343936 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f97a406b320 0x7f97a4070e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-14T15:55:39.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.714+0000 7f97a3fff700 1 -- 172.21.15.37:0/1344343936 >> v2:172.21.15.37:3300/0 conn(0x7f97a415a580 msgr2=0x7f97a415eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-14T15:55:39.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.714+0000 7f97a3fff700 1 -- 172.21.15.37:0/1344343936 >> v2:172.21.15.37:3300/0 conn(0x7f97a415a580 msgr2=0x7f97a415eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-14T15:55:39.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.714+0000 7f97a3fff700 1 --2- 172.21.15.37:0/1344343936 >> v2:172.21.15.37:3300/0 conn(0x7f97a415a580 0x7f97a415eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-14T15:55:39.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.714+0000 7f97a37fe700 1 --2- 172.21.15.37:0/1344343936 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f97a406b320 0x7f97a4070e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T15:55:39.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.714+0000 7f97a3fff700 1 --2- 172.21.15.37:0/1344343936 >> v2:172.21.15.37:3300/0 conn(0x7f97a415a580 0x7f97a415eac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T15:55:39.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.916+0000 7f97a3fff700 1 --2- 172.21.15.37:0/1344343936 >> v2:172.21.15.37:3300/0 conn(0x7f97a415a580 0x7f97a415eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:39.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.916+0000 7f97a3fff700 1 -- 172.21.15.37:0/1344343936 >> v2:172.21.15.37:3300/0 conn(0x7f97a415a580 msgr2=0x7f97a415eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-07-14T15:55:39.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.916+0000 7f97a3fff700 1 -- 172.21.15.37:0/1344343936 >> v2:172.21.15.37:3300/0 conn(0x7f97a415a580 msgr2=0x7f97a415eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-14T15:55:39.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.916+0000 7f97a3fff700 1 --2- 172.21.15.37:0/1344343936 >> v2:172.21.15.37:3300/0 conn(0x7f97a415a580 0x7f97a415eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-14T15:55:39.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.916+0000 7f97a37fe700 1 --2- 172.21.15.37:0/1344343936 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f97a406b320 0x7f97a4070e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:39.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.916+0000 7f97a3fff700 1 --2- 172.21.15.37:0/1344343936 >> v2:172.21.15.37:3300/0 conn(0x7f97a415a580 0x7f97a415eac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-14T15:55:39.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.916+0000 7f97a37fe700 1 -- 172.21.15.37:0/1344343936 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f97a406b320 msgr2=0x7f97a4070e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-14T15:55:39.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.916+0000 7f97a37fe700 1 -- 172.21.15.37:0/1344343936 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f97a406b320 msgr2=0x7f97a4070e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-14T15:55:39.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.916+0000 7f97a37fe700 1 --2- 172.21.15.37:0/1344343936 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f97a406b320 0x7f97a4070e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-14T15:55:39.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.916+0000 7f97a37fe700 1 --2- 172.21.15.37:0/1344343936 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f97a406b320 0x7f97a4070e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-14T15:55:39.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.923+0000 7f97a2ffd700 1 -- 172.21.15.37:0/1344343936 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 222673385 0 0) 0x7f97a4066280 con 0x7f97a406d710 2023-07-14T15:55:39.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.924+0000 7f97a2ffd700 1 -- 172.21.15.37:0/1344343936 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f978c0035b0 con 0x7f97a406d710 2023-07-14T15:55:39.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.930+0000 7f97a2ffd700 1 -- 172.21.15.37:0/1344343936 <== mon.1 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3711070546 0 0) 0x7f978c0035b0 con 0x7f97a406d710 2023-07-14T15:55:39.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.930+0000 7f97a2ffd700 1 -- 172.21.15.37:0/1344343936 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f97a406b320 msgr2=0x7f97a4070e90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T15:55:39.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.930+0000 7f97a2ffd700 1 --2- 172.21.15.37:0/1344343936 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f97a406b320 0x7f97a4070e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:39.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.930+0000 7f97a2ffd700 1 -- 172.21.15.37:0/1344343936 >> v2:172.21.15.37:3300/0 conn(0x7f97a415a580 msgr2=0x7f97a415eac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T15:55:39.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.930+0000 7f97a2ffd700 1 --2- 172.21.15.37:0/1344343936 >> v2:172.21.15.37:3300/0 conn(0x7f97a415a580 0x7f97a415eac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:39.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.930+0000 7f97a2ffd700 1 -- 172.21.15.37:0/1344343936 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a415f000 con 0x7f97a406d710 2023-07-14T15:55:39.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.930+0000 7f97a2ffd700 1 -- 172.21.15.37:0/1344343936 <== mon.1 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48633207 0 0) 0x7f979c0019f0 con 0x7f97a406d710 2023-07-14T15:55:39.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.930+0000 7f97a2ffd700 1 -- 172.21.15.37:0/1344343936 >> v1:172.21.15.98:6789/0 conn(0x7f97a406d710 legacy=0x7f97a40c9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:39.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.930+0000 7f97a2ffd700 1 --2- 172.21.15.37:0/1344343936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f978c003a00 0x7f978c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:39.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.930+0000 7f97a2ffd700 1 --2- 172.21.15.37:0/1344343936 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f97a406b320 0x7f978c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:39.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.930+0000 7f97a2ffd700 1 --2- 172.21.15.37:0/1344343936 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f978c004d90 0x7f978c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:39.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.930+0000 7f97a2ffd700 1 -- 172.21.15.37:0/1344343936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a40c9920 con 0x7f978c003a00 2023-07-14T15:55:39.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.930+0000 7f97a2ffd700 1 -- 172.21.15.37:0/1344343936 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f978c00bac0 con 0x7f978c004d90 2023-07-14T15:55:39.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.930+0000 7f97a2ffd700 1 -- 172.21.15.37:0/1344343936 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f978c00bc00 con 0x7f97a406b320 2023-07-14T15:55:39.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.930+0000 7f97a3fff700 1 --2- 172.21.15.37:0/1344343936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f978c003a00 0x7f978c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:39.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.930+0000 7f97a37fe700 1 --2- 172.21.15.37:0/1344343936 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f97a406b320 0x7f978c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:39.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.930+0000 7f97a8f9c700 1 --2- 172.21.15.37:0/1344343936 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f978c004d90 0x7f978c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:39.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.931+0000 7f97a3fff700 1 -- 172.21.15.37:0/1344343936 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f97a406b320 msgr2=0x7f978c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:55:39.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.931+0000 7f97a3fff700 1 --2- 172.21.15.37:0/1344343936 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f97a406b320 0x7f978c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:39.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.931+0000 7f97a3fff700 1 -- 172.21.15.37:0/1344343936 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f978c004d90 msgr2=0x7f978c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:55:39.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.931+0000 7f97a3fff700 1 --2- 172.21.15.37:0/1344343936 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f978c004d90 0x7f978c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:39.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.931+0000 7f97a3fff700 1 -- 172.21.15.37:0/1344343936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f978c0035b0 con 0x7f978c003a00 2023-07-14T15:55:39.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.931+0000 7f97a3fff700 1 --2- 172.21.15.37:0/1344343936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f978c003a00 0x7f978c003e10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f979400e900 tx=0x7f978c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fd0beef840c63aa server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:55:39.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.931+0000 7f97a2ffd700 1 -- 172.21.15.37:0/1344343936 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9794004020 con 0x7f978c003a00 2023-07-14T15:55:39.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.931+0000 7f97a2ffd700 1 -- 172.21.15.37:0/1344343936 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f979400c050 con 0x7f978c003a00 2023-07-14T15:55:39.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.931+0000 7f97a2ffd700 1 -- 172.21.15.37:0/1344343936 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97940043e0 con 0x7f978c003a00 2023-07-14T15:55:39.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.932+0000 7f97aa9ff700 1 -- 172.21.15.37:0/1344343936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f978c003a00 msgr2=0x7f978c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:39.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.932+0000 7f97aa9ff700 1 --2- 172.21.15.37:0/1344343936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f978c003a00 0x7f978c003e10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f979400e900 tx=0x7f978c005880 comp rx=0 tx=0).stop 2023-07-14T15:55:39.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.932+0000 7f97a8f9c700 1 -- 172.21.15.37:0/1344343936 reap_dead start 2023-07-14T15:55:39.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.932+0000 7f97aa9ff700 1 -- 172.21.15.37:0/1344343936 shutdown_connections 2023-07-14T15:55:39.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.932+0000 7f97aa9ff700 1 -- 172.21.15.37:0/1344343936 >> 172.21.15.37:0/1344343936 conn(0x7f97a40cbd50 msgr2=0x7f97a40cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:55:39.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.933+0000 7f97aa9ff700 1 -- 172.21.15.37:0/1344343936 shutdown_connections 2023-07-14T15:55:39.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.933+0000 7f97aa9ff700 1 -- 172.21.15.37:0/1344343936 wait complete. 2023-07-14T15:55:39.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.935+0000 7f97aa9ff700 1 Processor -- start 2023-07-14T15:55:39.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.935+0000 7f97aa9ff700 1 -- start start 2023-07-14T15:55:39.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.936+0000 7f97aa9ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f978c003a00 0x7f97a40c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:39.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.936+0000 7f97aa9ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f97a40c8830 0x7f97a414ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:39.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.936+0000 7f97aa9ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97a4069e70 0x7f97a406a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:39.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.936+0000 7f97aa9ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a414f280 con 0x7f97a4069e70 2023-07-14T15:55:39.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.936+0000 7f97aa9ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a406a820 con 0x7f978c003a00 2023-07-14T15:55:39.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.936+0000 7f97aa9ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a40b37e0 con 0x7f97a40c8830 2023-07-14T15:55:39.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.936+0000 7f97a8f9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97a4069e70 0x7f97a406a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:39.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.936+0000 7f97a37fe700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f97a40c8830 0x7f97a414ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:39.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.936+0000 7f97a8f9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97a4069e70 0x7f97a406a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52042/0 (socket says 172.21.15.37:52042) 2023-07-14T15:55:39.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.936+0000 7f97a8f9c700 1 -- 172.21.15.37:0/2890869285 learned_addr learned my addr 172.21.15.37:0/2890869285 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:55:39.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.937+0000 7f97a3fff700 1 --2- 172.21.15.37:0/2890869285 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f978c003a00 0x7f97a40c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:39.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.937+0000 7f97a37fe700 1 -- 172.21.15.37:0/2890869285 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f978c003a00 msgr2=0x7f97a40c6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:39.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.937+0000 7f97a37fe700 1 --2- 172.21.15.37:0/2890869285 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f978c003a00 0x7f97a40c6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:39.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.937+0000 7f97a37fe700 1 -- 172.21.15.37:0/2890869285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97a4069e70 msgr2=0x7f97a406a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:39.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.937+0000 7f97a37fe700 1 --2- 172.21.15.37:0/2890869285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97a4069e70 0x7f97a406a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:39.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.937+0000 7f97a37fe700 1 -- 172.21.15.37:0/2890869285 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a40b3ac0 con 0x7f97a40c8830 2023-07-14T15:55:39.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.937+0000 7f97a8f9c700 1 --2- 172.21.15.37:0/2890869285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97a4069e70 0x7f97a406a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:55:39.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.937+0000 7f97a37fe700 1 --2- 172.21.15.37:0/2890869285 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f97a40c8830 0x7f97a414ed40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9798009100 tx=0x7f979800eb40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:55:39.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.938+0000 7f97a0ff9700 1 -- 172.21.15.37:0/2890869285 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97980154b0 con 0x7f97a40c8830 2023-07-14T15:55:39.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.938+0000 7f97a0ff9700 1 -- 172.21.15.37:0/2890869285 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f979800c040 con 0x7f97a40c8830 2023-07-14T15:55:39.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.938+0000 7f97aa9ff700 1 -- 172.21.15.37:0/2890869285 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97a40b3da0 con 0x7f97a40c8830 2023-07-14T15:55:39.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.938+0000 7f97a0ff9700 1 -- 172.21.15.37:0/2890869285 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9798015810 con 0x7f97a40c8830 2023-07-14T15:55:39.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.938+0000 7f97aa9ff700 1 -- 172.21.15.37:0/2890869285 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97a40b4360 con 0x7f97a40c8830 2023-07-14T15:55:39.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.939+0000 7f97a0ff9700 1 -- 172.21.15.37:0/2890869285 <== mon.2 v2:172.21.15.98:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9798015c70 con 0x7f97a40c8830 2023-07-14T15:55:39.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.939+0000 7f97a0ff9700 1 -- 172.21.15.37:0/2890869285 <== mon.2 v2:172.21.15.98:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f979801d700 con 0x7f97a40c8830 2023-07-14T15:55:39.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.939+0000 7f97aa9ff700 1 -- 172.21.15.37:0/2890869285 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97a4067840 con 0x7f97a40c8830 2023-07-14T15:55:39.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:39.942+0000 7f97a0ff9700 1 -- 172.21.15.37:0/2890869285 <== mon.2 v2:172.21.15.98:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f9798023060 con 0x7f97a40c8830 2023-07-14T15:55:40.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:40.026+0000 7f97aa9ff700 1 -- 172.21.15.37:0/2890869285 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f97a40b5250 con 0x7f97a40c8830 2023-07-14T15:55:40.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:40.030+0000 7f97a0ff9700 1 -- 172.21.15.37:0/2890869285 <== mon.2 v2:172.21.15.98:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f9798019030 con 0x7f97a40c8830 2023-07-14T15:55:40.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:40.031+0000 7f97aa9ff700 1 -- 172.21.15.37:0/2890869285 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f97a40c8830 msgr2=0x7f97a414ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:40.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:40.031+0000 7f97aa9ff700 1 --2- 172.21.15.37:0/2890869285 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f97a40c8830 0x7f97a414ed40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9798009100 tx=0x7f979800eb40 comp rx=0 tx=0).stop 2023-07-14T15:55:40.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:40.031+0000 7f97aa9ff700 1 -- 172.21.15.37:0/2890869285 shutdown_connections 2023-07-14T15:55:40.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:40.031+0000 7f97aa9ff700 1 --2- 172.21.15.37:0/2890869285 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f978c003a00 0x7f97a40c6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:40.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:40.031+0000 7f97aa9ff700 1 --2- 172.21.15.37:0/2890869285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97a4069e70 0x7f97a406a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:40.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:40.031+0000 7f97aa9ff700 1 --2- 172.21.15.37:0/2890869285 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f97a40c8830 0x7f97a414ed40 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:40.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:40.031+0000 7f97aa9ff700 1 -- 172.21.15.37:0/2890869285 >> 172.21.15.37:0/2890869285 conn(0x7f97a40cbd50 msgr2=0x7f97a40cc330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:55:40.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:40.031+0000 7f97aa9ff700 1 -- 172.21.15.37:0/2890869285 shutdown_connections 2023-07-14T15:55:40.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:40.031+0000 7f97aa9ff700 1 -- 172.21.15.37:0/2890869285 wait complete. 2023-07-14T15:55:40.020 INFO:teuthology.orchestra.run.smithi037.stderr:adjusted tunables profile to default 2023-07-14T15:55:40.036 INFO:tasks.ceph:check_enable_crimson: False 2023-07-14T15:55:40.036 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-07-14T15:55:40.037 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-14T15:55:40.037 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-07-14T15:55:40.064 INFO:tasks.ceph.mgr.x.smithi098.stderr:2023-07-14T15:55:40.077+0000 7fa44c4e4200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T15:55:40.074 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-14T15:55:40.087+0000 7f1d55b07200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T15:55:40.107 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-14T15:55:40.108 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-07-14T15:55:40.147 INFO:tasks.ceph.mgr.x.smithi098.stderr:2023-07-14T15:55:40.160+0000 7fa44c4e4200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T15:55:40.163 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-14T15:55:40.176+0000 7f1d55b07200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T15:55:40.217 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-14T15:55:40.217 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-07-14T15:55:40.241 INFO:tasks.ceph.mgr.x.smithi098.stderr:2023-07-14T15:55:40.254+0000 7fa44c4e4200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T15:55:40.262 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-14T15:55:40.276+0000 7f1d55b07200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T15:55:40.327 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-14T15:55:40.328 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-07-14T15:55:40.337 INFO:tasks.ceph.mgr.x.smithi098.stderr:2023-07-14T15:55:40.350+0000 7fa44c4e4200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T15:55:40.366 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-14T15:55:40.379+0000 7f1d55b07200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T15:55:40.434 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-14T15:55:40.435 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-07-14T15:55:40.502 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-14T15:55:40.503 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-07-14T15:55:40.519 INFO:tasks.ceph.mgr.x.smithi098.stderr:2023-07-14T15:55:40.531+0000 7fa44c4e4200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T15:55:40.553 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-14T15:55:40.567+0000 7f1d55b07200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T15:55:40.586 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-14T15:55:40.586 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-07-14T15:55:40.693 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-14T15:55:40.694 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-07-14T15:55:40.799 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph osd new 0d049535-7b87-4276-8fe5-0f74ba422d5e 0 2023-07-14T15:55:40.966 INFO:tasks.ceph.mgr.x.smithi098.stderr:2023-07-14T15:55:40.979+0000 7fa44c4e4200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T15:55:40.977 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-14T15:55:40.991+0000 7f1d55b07200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T15:55:41.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.042+0000 7f79a8dff700 1 Processor -- start 2023-07-14T15:55:41.030 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.043+0000 7f79a8dff700 1 -- start start 2023-07-14T15:55:41.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.045+0000 7f79a8dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f79a4071730 0x7f79a406f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:41.032 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.045+0000 7f79a8dff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f79a406c0d0 0x7f79a40cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:41.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.045+0000 7f79a8dff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79a4159870 con 0x7f79a40ae000 2023-07-14T15:55:41.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.045+0000 7f79a8dff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a40ae470 con 0x7f79a406c0d0 2023-07-14T15:55:41.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.045+0000 7f79a8dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a40ca790 con 0x7f79a4071730 2023-07-14T15:55:41.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.045+0000 7f79a2d9d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f79a406c0d0 0x7f79a40cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:41.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.045+0000 7f79a259c700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f79a4071730 0x7f79a406f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:41.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.045+0000 7f79a259c700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f79a4071730 0x7f79a406f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3301/0 says I am v2:172.21.15.98:57998/0 (socket says 172.21.15.98:57998) 2023-07-14T15:55:41.033 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.045+0000 7f79a2d9d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f79a406c0d0 0x7f79a40cd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51304/0 (socket says 172.21.15.98:51304) 2023-07-14T15:55:41.034 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.045+0000 7f79a259c700 1 -- 172.21.15.98:0/955097755 learned_addr learned my addr 172.21.15.98:0/955097755 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-07-14T15:55:41.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.045+0000 7f79a2d9d700 1 -- 172.21.15.98:0/955097755 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f79a4071730 msgr2=0x7f79a406f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:55:41.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.045+0000 7f79a2d9d700 1 --2- 172.21.15.98:0/955097755 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f79a4071730 0x7f79a406f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:41.035 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.045+0000 7f79a2d9d700 1 -- 172.21.15.98:0/955097755 >> v1:172.21.15.98:6789/0 conn(0x7f79a40ae000 legacy=0x7f79a406b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:41.036 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.045+0000 7f79a2d9d700 1 -- 172.21.15.98:0/955097755 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a40cc780 con 0x7f79a406c0d0 2023-07-14T15:55:41.036 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.046+0000 7f79a2d9d700 1 --2- 172.21.15.98:0/955097755 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79a406c0d0 0x7f79a40cd220 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f799c009d90 tx=0x7f799c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=420d5d2e6e8cc3a5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:55:41.036 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.046+0000 7f79a1d9b700 1 -- 172.21.15.98:0/955097755 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c00e070 con 0x7f79a406c0d0 2023-07-14T15:55:41.036 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.046+0000 7f79a1d9b700 1 -- 172.21.15.98:0/955097755 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f799c00bb20 con 0x7f79a406c0d0 2023-07-14T15:55:41.037 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.046+0000 7f79a1d9b700 1 -- 172.21.15.98:0/955097755 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c012430 con 0x7f79a406c0d0 2023-07-14T15:55:41.037 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.047+0000 7f79a8dff700 1 -- 172.21.15.98:0/955097755 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79a406c0d0 msgr2=0x7f79a40cd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:41.037 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.047+0000 7f79a8dff700 1 --2- 172.21.15.98:0/955097755 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79a406c0d0 0x7f79a40cd220 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f799c009d90 tx=0x7f799c00b330 comp rx=0 tx=0).stop 2023-07-14T15:55:41.037 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.047+0000 7f79a8dff700 1 -- 172.21.15.98:0/955097755 shutdown_connections 2023-07-14T15:55:41.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.047+0000 7f79a8dff700 1 --2- 172.21.15.98:0/955097755 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79a406c0d0 0x7f79a40cd220 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:41.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.047+0000 7f79a8dff700 1 --2- 172.21.15.98:0/955097755 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f79a4071730 0x7f79a406f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:41.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.047+0000 7f79a8dff700 1 -- 172.21.15.98:0/955097755 >> 172.21.15.98:0/955097755 conn(0x7f79a406aac0 msgr2=0x7f79a40b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:55:41.038 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.047+0000 7f79a8dff700 1 -- 172.21.15.98:0/955097755 shutdown_connections 2023-07-14T15:55:41.039 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.047+0000 7f79a8dff700 1 -- 172.21.15.98:0/955097755 wait complete. 2023-07-14T15:55:41.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.049+0000 7f79a8dff700 1 Processor -- start 2023-07-14T15:55:41.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.049+0000 7f79a8dff700 1 -- start start 2023-07-14T15:55:41.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.050+0000 7f79a8dff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79a406c0d0 0x7f79a4149da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:41.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.050+0000 7f79a8dff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79a4071730 0x7f79a40ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:41.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.050+0000 7f79a8dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f79a40ae000 0x7f79a40acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:41.041 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.050+0000 7f79a8dff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a40c5cf0 con 0x7f79a406c0d0 2023-07-14T15:55:41.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.050+0000 7f79a8dff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a40c5fd0 con 0x7f79a4071730 2023-07-14T15:55:41.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.050+0000 7f79a8dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a40c62b0 con 0x7f79a40ae000 2023-07-14T15:55:41.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.050+0000 7f79a2d9d700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f79a40ae000 0x7f79a40acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:41.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.050+0000 7f799bfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79a4071730 0x7f79a40ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:41.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.050+0000 7f79a259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79a406c0d0 0x7f79a4149da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:41.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.050+0000 7f79a2d9d700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f79a40ae000 0x7f79a40acdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3301/0 says I am v2:172.21.15.98:58006/0 (socket says 172.21.15.98:58006) 2023-07-14T15:55:41.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.050+0000 7f79a2d9d700 1 -- 172.21.15.98:0/1299851791 learned_addr learned my addr 172.21.15.98:0/1299851791 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-07-14T15:55:41.042 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.050+0000 7f799bfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79a4071730 0x7f79a40ac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51316/0 (socket says 172.21.15.98:51316) 2023-07-14T15:55:41.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.050+0000 7f79a2d9d700 1 -- 172.21.15.98:0/1299851791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79a4071730 msgr2=0x7f79a40ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:41.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.050+0000 7f79a2d9d700 1 --2- 172.21.15.98:0/1299851791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79a4071730 0x7f79a40ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:41.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.050+0000 7f79a2d9d700 1 -- 172.21.15.98:0/1299851791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79a406c0d0 msgr2=0x7f79a4149da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:41.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.050+0000 7f79a2d9d700 1 --2- 172.21.15.98:0/1299851791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79a406c0d0 0x7f79a4149da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:41.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.050+0000 7f79a2d9d700 1 -- 172.21.15.98:0/1299851791 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f799c009a70 con 0x7f79a40ae000 2023-07-14T15:55:41.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.050+0000 7f799bfff700 1 --2- 172.21.15.98:0/1299851791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79a4071730 0x7f79a40ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:55:41.043 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.051+0000 7f79a2d9d700 1 --2- 172.21.15.98:0/1299851791 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f79a40ae000 0x7f79a40acdf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f799c014040 tx=0x7f799c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:55:41.044 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.051+0000 7f799affd700 1 -- 172.21.15.98:0/1299851791 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c012430 con 0x7f79a40ae000 2023-07-14T15:55:41.044 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.051+0000 7f799affd700 1 -- 172.21.15.98:0/1299851791 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f799c020070 con 0x7f79a40ae000 2023-07-14T15:55:41.044 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.051+0000 7f79a8dff700 1 -- 172.21.15.98:0/1299851791 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79a40c6590 con 0x7f79a40ae000 2023-07-14T15:55:41.044 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.051+0000 7f799affd700 1 -- 172.21.15.98:0/1299851791 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c003ea0 con 0x7f79a40ae000 2023-07-14T15:55:41.044 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.051+0000 7f79a8dff700 1 -- 172.21.15.98:0/1299851791 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79a414a2e0 con 0x7f79a40ae000 2023-07-14T15:55:41.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.051+0000 7f799affd700 1 -- 172.21.15.98:0/1299851791 <== mon.2 v2:172.21.15.98:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f799c004340 con 0x7f79a40ae000 2023-07-14T15:55:41.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.052+0000 7f799affd700 1 -- 172.21.15.98:0/1299851791 <== mon.2 v2:172.21.15.98:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f799c022070 con 0x7f79a40ae000 2023-07-14T15:55:41.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.052+0000 7f79a8dff700 1 -- 172.21.15.98:0/1299851791 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79a40cb300 con 0x7f79a40ae000 2023-07-14T15:55:41.045 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.055+0000 7f799affd700 1 -- 172.21.15.98:0/1299851791 <== mon.2 v2:172.21.15.98:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f799c02c060 con 0x7f79a40ae000 2023-07-14T15:55:41.067 INFO:tasks.ceph.mgr.x.smithi098.stderr:2023-07-14T15:55:41.079+0000 7fa44c4e4200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T15:55:41.075 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-14T15:55:41.088+0000 7f1d55b07200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T15:55:41.129 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.142+0000 7f79a8dff700 1 -- 172.21.15.98:0/1299851791 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0d049535-7b87-4276-8fe5-0f74ba422d5e", "id": 0} v 0) v1 -- 0x7f79a40ce880 con 0x7f79a40ae000 2023-07-14T15:55:41.137 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.150+0000 7f799affd700 1 -- 172.21.15.98:0/1299851791 <== mon.2 v2:172.21.15.98:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0d049535-7b87-4276-8fe5-0f74ba422d5e", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f799c027480 con 0x7f79a40ae000 2023-07-14T15:55:41.137 INFO:teuthology.orchestra.run.smithi098.stdout:0 2023-07-14T15:55:41.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.151+0000 7f79a8dff700 1 -- 172.21.15.98:0/1299851791 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f79a40ae000 msgr2=0x7f79a40acdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:41.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.151+0000 7f79a8dff700 1 --2- 172.21.15.98:0/1299851791 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f79a40ae000 0x7f79a40acdf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f799c014040 tx=0x7f799c004ad0 comp rx=0 tx=0).stop 2023-07-14T15:55:41.138 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.151+0000 7f79a8dff700 1 -- 172.21.15.98:0/1299851791 shutdown_connections 2023-07-14T15:55:41.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.151+0000 7f79a8dff700 1 --2- 172.21.15.98:0/1299851791 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f79a40ae000 0x7f79a40acdf0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:41.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.151+0000 7f79a8dff700 1 --2- 172.21.15.98:0/1299851791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79a406c0d0 0x7f79a4149da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:41.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.151+0000 7f79a8dff700 1 --2- 172.21.15.98:0/1299851791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79a4071730 0x7f79a40ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:41.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.151+0000 7f79a8dff700 1 -- 172.21.15.98:0/1299851791 >> 172.21.15.98:0/1299851791 conn(0x7f79a406aac0 msgr2=0x7f79a40afd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:55:41.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.151+0000 7f79a8dff700 1 -- 172.21.15.98:0/1299851791 shutdown_connections 2023-07-14T15:55:41.139 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.151+0000 7f79a8dff700 1 -- 172.21.15.98:0/1299851791 wait complete. 2023-07-14T15:55:41.155 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph osd new 79ec948d-ead2-4c2d-923a-dd6eeaac9dbd 1 2023-07-14T15:55:41.229 INFO:tasks.ceph.mgr.x.smithi098.stderr:2023-07-14T15:55:41.243+0000 7fa44c4e4200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T15:55:41.247 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-14T15:55:41.260+0000 7f1d55b07200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T15:55:41.334 INFO:tasks.ceph.mgr.x.smithi098.stderr:2023-07-14T15:55:41.348+0000 7fa44c4e4200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T15:55:41.345 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.358+0000 7f2d74bff700 1 Processor -- start 2023-07-14T15:55:41.345 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.358+0000 7f2d74bff700 1 -- start start 2023-07-14T15:55:41.346 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.360+0000 7f2d74bff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2d7015fee0 0x7f2d7015ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:41.346 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.360+0000 7f2d74bff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f2d700d1140 0x7f2d700b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:41.346 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.360+0000 7f2d74bff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d7015dc50 con 0x7f2d701603b0 2023-07-14T15:55:41.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.360+0000 7f2d74bff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d700b2940 con 0x7f2d7015fee0 2023-07-14T15:55:41.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.360+0000 7f2d74bff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d700b2c20 con 0x7f2d700d1140 2023-07-14T15:55:41.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.360+0000 7f2d6ed9d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f2d700d1140 0x7f2d700b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:41.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.360+0000 7f2d6ed9d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f2d700d1140 0x7f2d700b39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51332/0 (socket says 172.21.15.98:51332) 2023-07-14T15:55:41.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.360+0000 7f2d6ed9d700 1 -- 172.21.15.98:0/3630518232 learned_addr learned my addr 172.21.15.98:0/3630518232 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-07-14T15:55:41.347 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.360+0000 7f2d6e59c700 1 --2- 172.21.15.98:0/3630518232 >> v2:172.21.15.37:3300/0 conn(0x7f2d7015fee0 0x7f2d7015ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:41.349 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.360+0000 7f2d6ed9d700 1 -- 172.21.15.98:0/3630518232 >> v2:172.21.15.37:3300/0 conn(0x7f2d7015fee0 msgr2=0x7f2d7015ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:55:41.349 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.360+0000 7f2d6ed9d700 1 --2- 172.21.15.98:0/3630518232 >> v2:172.21.15.37:3300/0 conn(0x7f2d7015fee0 0x7f2d7015ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:41.349 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.360+0000 7f2d6ed9d700 1 -- 172.21.15.98:0/3630518232 >> v1:172.21.15.98:6789/0 conn(0x7f2d701603b0 legacy=0x7f2d700d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:41.349 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.360+0000 7f2d6ed9d700 1 -- 172.21.15.98:0/3630518232 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d700b2f00 con 0x7f2d700d1140 2023-07-14T15:55:41.349 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.361+0000 7f2d6ed9d700 1 --2- 172.21.15.98:0/3630518232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d700d1140 0x7f2d700b39e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2d7008d250 tx=0x7f2d6800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2105c0777d2b470 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:55:41.350 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.361+0000 7f2d6d59a700 1 -- 172.21.15.98:0/3630518232 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6800e070 con 0x7f2d700d1140 2023-07-14T15:55:41.350 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.361+0000 7f2d6d59a700 1 -- 172.21.15.98:0/3630518232 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d6800b910 con 0x7f2d700d1140 2023-07-14T15:55:41.350 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.361+0000 7f2d6d59a700 1 -- 172.21.15.98:0/3630518232 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6800bcc0 con 0x7f2d700d1140 2023-07-14T15:55:41.350 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.361+0000 7f2d74bff700 1 -- 172.21.15.98:0/3630518232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d700d1140 msgr2=0x7f2d700b39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:41.350 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.361+0000 7f2d74bff700 1 --2- 172.21.15.98:0/3630518232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d700d1140 0x7f2d700b39e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2d7008d250 tx=0x7f2d6800b330 comp rx=0 tx=0).stop 2023-07-14T15:55:41.350 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.362+0000 7f2d74bff700 1 -- 172.21.15.98:0/3630518232 shutdown_connections 2023-07-14T15:55:41.350 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.362+0000 7f2d74bff700 1 --2- 172.21.15.98:0/3630518232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d700d1140 0x7f2d700b39e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:41.351 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.362+0000 7f2d74bff700 1 --2- 172.21.15.98:0/3630518232 >> v2:172.21.15.37:3300/0 conn(0x7f2d7015fee0 0x7f2d7015ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:41.351 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.362+0000 7f2d74bff700 1 -- 172.21.15.98:0/3630518232 >> 172.21.15.98:0/3630518232 conn(0x7f2d7009c1b0 msgr2=0x7f2d700d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:55:41.351 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.362+0000 7f2d74bff700 1 -- 172.21.15.98:0/3630518232 shutdown_connections 2023-07-14T15:55:41.351 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.362+0000 7f2d74bff700 1 -- 172.21.15.98:0/3630518232 wait complete. 2023-07-14T15:55:41.351 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-14T15:55:41.364+0000 7f1d55b07200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T15:55:41.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.363+0000 7f2d74bff700 1 Processor -- start 2023-07-14T15:55:41.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.363+0000 7f2d74bff700 1 -- start start 2023-07-14T15:55:41.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.364+0000 7f2d74bff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2d700d1140 0x7f2d700c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:41.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.364+0000 7f2d74bff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d7015fee0 0x7f2d700b8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:41.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.364+0000 7f2d74bff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d701603b0 0x7f2d700b6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:41.354 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.364+0000 7f2d74bff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d70158ce0 con 0x7f2d701603b0 2023-07-14T15:55:41.355 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.364+0000 7f2d74bff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d700b7690 con 0x7f2d7015fee0 2023-07-14T15:55:41.355 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.364+0000 7f2d74bff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d700b7970 con 0x7f2d700d1140 2023-07-14T15:55:41.355 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.365+0000 7f2d6e59c700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2d700d1140 0x7f2d700c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:41.355 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.365+0000 7f2d6dd9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d7015fee0 0x7f2d700b8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:41.355 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.365+0000 7f2d6e59c700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2d700d1140 0x7f2d700c92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3301/0 says I am v2:172.21.15.98:58014/0 (socket says 172.21.15.98:58014) 2023-07-14T15:55:41.355 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.365+0000 7f2d6e59c700 1 -- 172.21.15.98:0/340347007 learned_addr learned my addr 172.21.15.98:0/340347007 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-07-14T15:55:41.355 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.365+0000 7f2d6ed9d700 1 --2- 172.21.15.98:0/340347007 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d701603b0 0x7f2d700b6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:41.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.365+0000 7f2d6e59c700 1 -- 172.21.15.98:0/340347007 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d7015fee0 msgr2=0x7f2d700b8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:41.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.365+0000 7f2d6e59c700 1 --2- 172.21.15.98:0/340347007 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d7015fee0 0x7f2d700b8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:41.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.365+0000 7f2d6e59c700 1 -- 172.21.15.98:0/340347007 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d701603b0 msgr2=0x7f2d700b6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:41.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.365+0000 7f2d6e59c700 1 --2- 172.21.15.98:0/340347007 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d701603b0 0x7f2d700b6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:41.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.365+0000 7f2d6e59c700 1 -- 172.21.15.98:0/340347007 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d68009b30 con 0x7f2d700d1140 2023-07-14T15:55:41.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.365+0000 7f2d6e59c700 1 --2- 172.21.15.98:0/340347007 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2d700d1140 0x7f2d700c92f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2d6000e9b0 tx=0x7f2d6000ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:55:41.356 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.365+0000 7f2d5effd700 1 -- 172.21.15.98:0/340347007 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d60009710 con 0x7f2d700d1140 2023-07-14T15:55:41.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.366+0000 7f2d5effd700 1 -- 172.21.15.98:0/340347007 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d6000ee50 con 0x7f2d700d1140 2023-07-14T15:55:41.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.366+0000 7f2d5effd700 1 -- 172.21.15.98:0/340347007 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6000ca50 con 0x7f2d700d1140 2023-07-14T15:55:41.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.366+0000 7f2d74bff700 1 -- 172.21.15.98:0/340347007 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d700b7c50 con 0x7f2d700d1140 2023-07-14T15:55:41.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.366+0000 7f2d74bff700 1 -- 172.21.15.98:0/340347007 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d700b8210 con 0x7f2d700d1140 2023-07-14T15:55:41.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.366+0000 7f2d5effd700 1 -- 172.21.15.98:0/340347007 <== mon.2 v2:172.21.15.98:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2d60005a20 con 0x7f2d700d1140 2023-07-14T15:55:41.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.366+0000 7f2d5effd700 1 -- 172.21.15.98:0/340347007 <== mon.2 v2:172.21.15.98:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f2d60013820 con 0x7f2d700d1140 2023-07-14T15:55:41.357 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.367+0000 7f2d74bff700 1 -- 172.21.15.98:0/340347007 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d700b8580 con 0x7f2d700d1140 2023-07-14T15:55:41.358 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.369+0000 7f2d5effd700 1 -- 172.21.15.98:0/340347007 <== mon.2 v2:172.21.15.98:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f2d60021060 con 0x7f2d700d1140 2023-07-14T15:55:41.442 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.456+0000 7f2d74bff700 1 -- 172.21.15.98:0/340347007 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_command({"prefix": "osd new", "uuid": "79ec948d-ead2-4c2d-923a-dd6eeaac9dbd", "id": 1} v 0) v1 -- 0x7f2d700d0880 con 0x7f2d700d1140 2023-07-14T15:55:41.449 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.463+0000 7f2d5effd700 1 -- 172.21.15.98:0/340347007 <== mon.2 v2:172.21.15.98:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "79ec948d-ead2-4c2d-923a-dd6eeaac9dbd", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2d60017070 con 0x7f2d700d1140 2023-07-14T15:55:41.450 INFO:teuthology.orchestra.run.smithi098.stdout:1 2023-07-14T15:55:41.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.465+0000 7f2d74bff700 1 -- 172.21.15.98:0/340347007 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2d700d1140 msgr2=0x7f2d700c92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:41.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.465+0000 7f2d74bff700 1 --2- 172.21.15.98:0/340347007 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2d700d1140 0x7f2d700c92f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2d6000e9b0 tx=0x7f2d6000ecc0 comp rx=0 tx=0).stop 2023-07-14T15:55:41.452 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.465+0000 7f2d74bff700 1 -- 172.21.15.98:0/340347007 shutdown_connections 2023-07-14T15:55:41.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.465+0000 7f2d74bff700 1 --2- 172.21.15.98:0/340347007 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d701603b0 0x7f2d700b6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:41.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.465+0000 7f2d74bff700 1 --2- 172.21.15.98:0/340347007 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2d700d1140 0x7f2d700c92f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:41.453 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.465+0000 7f2d74bff700 1 --2- 172.21.15.98:0/340347007 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d7015fee0 0x7f2d700b8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:41.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.465+0000 7f2d74bff700 1 -- 172.21.15.98:0/340347007 >> 172.21.15.98:0/340347007 conn(0x7f2d7009c1b0 msgr2=0x7f2d700d29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:55:41.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.465+0000 7f2d74bff700 1 -- 172.21.15.98:0/340347007 shutdown_connections 2023-07-14T15:55:41.454 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.465+0000 7f2d74bff700 1 -- 172.21.15.98:0/340347007 wait complete. 2023-07-14T15:55:41.477 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph osd new a1db6690-c160-4366-9c82-2cca17e4bba9 2 2023-07-14T15:55:41.668 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.682+0000 7fcd431ff700 1 Processor -- start 2023-07-14T15:55:41.669 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.682+0000 7fcd431ff700 1 -- start start 2023-07-14T15:55:41.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.683+0000 7fcd431ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcd3c15fee0 0x7fcd3c15ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:41.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.683+0000 7fcd431ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcd3c1603b0 0x7fcd3c0d0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:41.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.683+0000 7fcd431ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd3c0d13d0 con 0x7fcd3c0d0f70 2023-07-14T15:55:41.670 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.683+0000 7fcd431ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd3c15dc50 con 0x7fcd3c1603b0 2023-07-14T15:55:41.671 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.683+0000 7fcd431ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3c0b2940 con 0x7fcd3c15fee0 2023-07-14T15:55:41.671 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.684+0000 7fcd40f9b700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcd3c15fee0 0x7fcd3c15ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:41.671 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.684+0000 7fcd4179c700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fcd3c0d0f70 0x7fcd3c0b39e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:34776/0 (socket says 172.21.15.98:34776) 2023-07-14T15:55:41.671 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.684+0000 7fcd4179c700 1 -- 172.21.15.98:0/2681526869 learned_addr learned my addr 172.21.15.98:0/2681526869 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-07-14T15:55:41.671 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.684+0000 7fcd3bfff700 1 --2- 172.21.15.98:0/2681526869 >> v2:172.21.15.37:3300/0 conn(0x7fcd3c1603b0 0x7fcd3c0d0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:41.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.684+0000 7fcd40f9b700 1 -- 172.21.15.98:0/2681526869 >> v2:172.21.15.37:3300/0 conn(0x7fcd3c1603b0 msgr2=0x7fcd3c0d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:55:41.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.684+0000 7fcd40f9b700 1 --2- 172.21.15.98:0/2681526869 >> v2:172.21.15.37:3300/0 conn(0x7fcd3c1603b0 0x7fcd3c0d0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:41.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.684+0000 7fcd40f9b700 1 -- 172.21.15.98:0/2681526869 >> v1:172.21.15.98:6789/0 conn(0x7fcd3c0d0f70 legacy=0x7fcd3c0b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:41.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.684+0000 7fcd40f9b700 1 -- 172.21.15.98:0/2681526869 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd3c0b2c20 con 0x7fcd3c15fee0 2023-07-14T15:55:41.673 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.684+0000 7fcd3b7fe700 1 -- 172.21.15.98:0/2681526869 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1269124556 0 0) 0x7fcd3c0d13d0 con 0x7fcd3c0d0f70 2023-07-14T15:55:41.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.684+0000 7fcd40f9b700 1 --2- 172.21.15.98:0/2681526869 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcd3c15fee0 0x7fcd3c15ded0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcd30009840 tx=0x7fcd30009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f69024e3089ec99 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:55:41.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.685+0000 7fcd3b7fe700 1 -- 172.21.15.98:0/2681526869 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd30011830 con 0x7fcd3c15fee0 2023-07-14T15:55:41.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.685+0000 7fcd3b7fe700 1 -- 172.21.15.98:0/2681526869 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd30011990 con 0x7fcd3c15fee0 2023-07-14T15:55:41.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.685+0000 7fcd3b7fe700 1 -- 172.21.15.98:0/2681526869 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd30011d20 con 0x7fcd3c15fee0 2023-07-14T15:55:41.674 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.685+0000 7fcd431ff700 1 -- 172.21.15.98:0/2681526869 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcd3c15fee0 msgr2=0x7fcd3c15ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:41.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.685+0000 7fcd431ff700 1 --2- 172.21.15.98:0/2681526869 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcd3c15fee0 0x7fcd3c15ded0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcd30009840 tx=0x7fcd30009b50 comp rx=0 tx=0).stop 2023-07-14T15:55:41.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.685+0000 7fcd431ff700 1 -- 172.21.15.98:0/2681526869 shutdown_connections 2023-07-14T15:55:41.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.685+0000 7fcd431ff700 1 --2- 172.21.15.98:0/2681526869 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcd3c15fee0 0x7fcd3c15ded0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:41.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.685+0000 7fcd431ff700 1 --2- 172.21.15.98:0/2681526869 >> v2:172.21.15.37:3300/0 conn(0x7fcd3c1603b0 0x7fcd3c0d0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:41.675 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.685+0000 7fcd431ff700 1 -- 172.21.15.98:0/2681526869 >> 172.21.15.98:0/2681526869 conn(0x7fcd3c09c1b0 msgr2=0x7fcd3c0d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:55:41.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.685+0000 7fcd431ff700 1 -- 172.21.15.98:0/2681526869 shutdown_connections 2023-07-14T15:55:41.676 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.685+0000 7fcd431ff700 1 -- 172.21.15.98:0/2681526869 wait complete. 2023-07-14T15:55:41.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.687+0000 7fcd431ff700 1 Processor -- start 2023-07-14T15:55:41.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.687+0000 7fcd431ff700 1 -- start start 2023-07-14T15:55:41.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.688+0000 7fcd431ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcd3c0d0f70 0x7fcd3c0c9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:41.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.688+0000 7fcd431ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd3c15fee0 0x7fcd3c1f1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:41.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.688+0000 7fcd431ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd3c1603b0 0x7fcd3c0b66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:41.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.688+0000 7fcd431ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3c1f2470 con 0x7fcd3c15fee0 2023-07-14T15:55:41.678 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.688+0000 7fcd431ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3c0b6be0 con 0x7fcd3c1603b0 2023-07-14T15:55:41.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.688+0000 7fcd431ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3c0b6e80 con 0x7fcd3c0d0f70 2023-07-14T15:55:41.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.688+0000 7fcd40f9b700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcd3c0d0f70 0x7fcd3c0c9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:41.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.688+0000 7fcd40f9b700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcd3c0d0f70 0x7fcd3c0c9220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3301/0 says I am v2:172.21.15.98:58034/0 (socket says 172.21.15.98:58034) 2023-07-14T15:55:41.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.688+0000 7fcd40f9b700 1 -- 172.21.15.98:0/674681410 learned_addr learned my addr 172.21.15.98:0/674681410 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-07-14T15:55:41.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.688+0000 7fcd4179c700 1 --2- 172.21.15.98:0/674681410 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd3c1603b0 0x7fcd3c0b66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:41.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.689+0000 7fcd3bfff700 1 --2- 172.21.15.98:0/674681410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd3c15fee0 0x7fcd3c1f1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:41.679 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.689+0000 7fcd40f9b700 1 -- 172.21.15.98:0/674681410 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd3c1603b0 msgr2=0x7fcd3c0b66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:41.680 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.689+0000 7fcd40f9b700 1 --2- 172.21.15.98:0/674681410 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd3c1603b0 0x7fcd3c0b66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:41.680 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.689+0000 7fcd40f9b700 1 -- 172.21.15.98:0/674681410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd3c15fee0 msgr2=0x7fcd3c1f1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:41.680 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.689+0000 7fcd40f9b700 1 --2- 172.21.15.98:0/674681410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd3c15fee0 0x7fcd3c1f1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:41.680 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.689+0000 7fcd40f9b700 1 -- 172.21.15.98:0/674681410 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd300094a0 con 0x7fcd3c0d0f70 2023-07-14T15:55:41.680 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.689+0000 7fcd3bfff700 1 --2- 172.21.15.98:0/674681410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd3c15fee0 0x7fcd3c1f1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:55:41.680 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.689+0000 7fcd40f9b700 1 --2- 172.21.15.98:0/674681410 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcd3c0d0f70 0x7fcd3c0c9220 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcd30009fd0 tx=0x7fcd30004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:55:41.680 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.689+0000 7fcd397fa700 1 -- 172.21.15.98:0/674681410 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd30004480 con 0x7fcd3c0d0f70 2023-07-14T15:55:41.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.689+0000 7fcd397fa700 1 -- 172.21.15.98:0/674681410 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd3001f070 con 0x7fcd3c0d0f70 2023-07-14T15:55:41.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.689+0000 7fcd431ff700 1 -- 172.21.15.98:0/674681410 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd3c0b7160 con 0x7fcd3c0d0f70 2023-07-14T15:55:41.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.689+0000 7fcd397fa700 1 -- 172.21.15.98:0/674681410 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd300038c0 con 0x7fcd3c0d0f70 2023-07-14T15:55:41.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.689+0000 7fcd431ff700 1 -- 172.21.15.98:0/674681410 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd3c0b7720 con 0x7fcd3c0d0f70 2023-07-14T15:55:41.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.690+0000 7fcd397fa700 1 -- 172.21.15.98:0/674681410 <== mon.2 v2:172.21.15.98:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcd30021030 con 0x7fcd3c0d0f70 2023-07-14T15:55:41.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.690+0000 7fcd397fa700 1 -- 172.21.15.98:0/674681410 <== mon.2 v2:172.21.15.98:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fcd30003d20 con 0x7fcd3c0d0f70 2023-07-14T15:55:41.681 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.690+0000 7fcd431ff700 1 -- 172.21.15.98:0/674681410 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd3c067840 con 0x7fcd3c0d0f70 2023-07-14T15:55:41.682 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.693+0000 7fcd397fa700 1 -- 172.21.15.98:0/674681410 <== mon.2 v2:172.21.15.98:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fcd30044b20 con 0x7fcd3c0d0f70 2023-07-14T15:55:41.764 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.778+0000 7fcd431ff700 1 -- 172.21.15.98:0/674681410 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a1db6690-c160-4366-9c82-2cca17e4bba9", "id": 2} v 0) v1 -- 0x7fcd3c09c580 con 0x7fcd3c0d0f70 2023-07-14T15:55:41.772 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.786+0000 7fcd397fa700 1 -- 172.21.15.98:0/674681410 <== mon.2 v2:172.21.15.98:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a1db6690-c160-4366-9c82-2cca17e4bba9", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcd30033070 con 0x7fcd3c0d0f70 2023-07-14T15:55:41.772 INFO:teuthology.orchestra.run.smithi098.stdout:2 2023-07-14T15:55:41.773 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.787+0000 7fcd431ff700 1 -- 172.21.15.98:0/674681410 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcd3c0d0f70 msgr2=0x7fcd3c0c9220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:41.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.787+0000 7fcd431ff700 1 --2- 172.21.15.98:0/674681410 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcd3c0d0f70 0x7fcd3c0c9220 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcd30009fd0 tx=0x7fcd30004750 comp rx=0 tx=0).stop 2023-07-14T15:55:41.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.787+0000 7fcd431ff700 1 -- 172.21.15.98:0/674681410 shutdown_connections 2023-07-14T15:55:41.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.787+0000 7fcd431ff700 1 --2- 172.21.15.98:0/674681410 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd3c1603b0 0x7fcd3c0b66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:41.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.787+0000 7fcd431ff700 1 --2- 172.21.15.98:0/674681410 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcd3c0d0f70 0x7fcd3c0c9220 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:41.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.787+0000 7fcd431ff700 1 --2- 172.21.15.98:0/674681410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd3c15fee0 0x7fcd3c1f1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:41.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.787+0000 7fcd431ff700 1 -- 172.21.15.98:0/674681410 >> 172.21.15.98:0/674681410 conn(0x7fcd3c09c1b0 msgr2=0x7fcd3c1586b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:55:41.774 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.787+0000 7fcd431ff700 1 -- 172.21.15.98:0/674681410 shutdown_connections 2023-07-14T15:55:41.775 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.787+0000 7fcd431ff700 1 -- 172.21.15.98:0/674681410 wait complete. 2023-07-14T15:55:41.790 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph osd new 767b8220-e79a-4a86-a162-6b3b73198379 3 2023-07-14T15:55:41.889 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-14T15:55:41.903+0000 7f1d55b07200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T15:55:41.893 INFO:tasks.ceph.mgr.x.smithi098.stderr:2023-07-14T15:55:41.907+0000 7fa44c4e4200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T15:55:41.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.997+0000 7f66df1ff700 1 Processor -- start 2023-07-14T15:55:41.984 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.998+0000 7f66df1ff700 1 -- start start 2023-07-14T15:55:41.985 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.999+0000 7f66df1ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f66d815fee0 0x7f66d815ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:41.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.999+0000 7f66df1ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66d815dc50 con 0x7f66d81603b0 2023-07-14T15:55:41.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.999+0000 7f66df1ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66d80b2940 con 0x7f66d80d1140 2023-07-14T15:55:41.986 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:41.999+0000 7f66df1ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66d80b2c20 con 0x7f66d815fee0 2023-07-14T15:55:41.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.000+0000 7f66dd79c700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f66d80d1140 0x7f66d80b39e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:34784/0 (socket says 172.21.15.98:34784) 2023-07-14T15:55:41.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.000+0000 7f66dd79c700 1 -- 172.21.15.98:0/563736690 learned_addr learned my addr 172.21.15.98:0/563736690 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-07-14T15:55:41.987 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.000+0000 7f66dcf9b700 1 --2- 172.21.15.98:0/563736690 >> v2:172.21.15.37:3300/0 conn(0x7f66d815fee0 0x7f66d815ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:41.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.000+0000 7f66d77fe700 1 -- 172.21.15.98:0/563736690 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3686312472 0 0) 0x7f66d80b2940 con 0x7f66d80d1140 2023-07-14T15:55:41.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.000+0000 7f66d77fe700 1 -- 172.21.15.98:0/563736690 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66c80035b0 con 0x7f66d80d1140 2023-07-14T15:55:41.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.000+0000 7f66d77fe700 1 -- 172.21.15.98:0/563736690 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2006917747 0 0) 0x7f66d815dc50 con 0x7f66d81603b0 2023-07-14T15:55:41.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.000+0000 7f66d77fe700 1 -- 172.21.15.98:0/563736690 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66d80b2940 con 0x7f66d81603b0 2023-07-14T15:55:41.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.000+0000 7f66dcf9b700 1 -- 172.21.15.98:0/563736690 >> v1:172.21.15.98:6789/0 conn(0x7f66d80d1140 legacy=0x7f66d80b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:41.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.000+0000 7f66dcf9b700 1 -- 172.21.15.98:0/563736690 >> v1:172.21.15.37:6789/0 conn(0x7f66d81603b0 legacy=0x7f66d80d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:41.988 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.000+0000 7f66dcf9b700 1 -- 172.21.15.98:0/563736690 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d80b2f00 con 0x7f66d815fee0 2023-07-14T15:55:41.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.000+0000 7f66dcf9b700 1 --2- 172.21.15.98:0/563736690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66d815fee0 0x7f66d815ded0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f66cc009840 tx=0x7f66cc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c573dccadd7ccd0f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:55:41.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.001+0000 7f66d77fe700 1 -- 172.21.15.98:0/563736690 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66cc011830 con 0x7f66d815fee0 2023-07-14T15:55:41.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.001+0000 7f66d77fe700 1 -- 172.21.15.98:0/563736690 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66cc011990 con 0x7f66d815fee0 2023-07-14T15:55:41.989 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.001+0000 7f66d77fe700 1 -- 172.21.15.98:0/563736690 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66cc011d20 con 0x7f66d815fee0 2023-07-14T15:55:41.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.002+0000 7f66df1ff700 1 -- 172.21.15.98:0/563736690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66d815fee0 msgr2=0x7f66d815ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:41.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.002+0000 7f66df1ff700 1 --2- 172.21.15.98:0/563736690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66d815fee0 0x7f66d815ded0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f66cc009840 tx=0x7f66cc009b50 comp rx=0 tx=0).stop 2023-07-14T15:55:41.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.002+0000 7f66df1ff700 1 -- 172.21.15.98:0/563736690 shutdown_connections 2023-07-14T15:55:41.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.002+0000 7f66df1ff700 1 --2- 172.21.15.98:0/563736690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66d815fee0 0x7f66d815ded0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:41.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.002+0000 7f66df1ff700 1 -- 172.21.15.98:0/563736690 >> 172.21.15.98:0/563736690 conn(0x7f66d809c1b0 msgr2=0x7f66d80d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:55:41.990 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.002+0000 7f66df1ff700 1 -- 172.21.15.98:0/563736690 shutdown_connections 2023-07-14T15:55:41.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.002+0000 7f66df1ff700 1 -- 172.21.15.98:0/563736690 wait complete. 2023-07-14T15:55:41.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.004+0000 7f66df1ff700 1 Processor -- start 2023-07-14T15:55:41.991 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.005+0000 7f66df1ff700 1 -- start start 2023-07-14T15:55:41.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.006+0000 7f66df1ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66d80d1140 0x7f66d80b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:41.992 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.006+0000 7f66df1ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f66d815fee0 0x7f66d80b6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:41.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.006+0000 7f66df1ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66d81603b0 0x7f66d80b69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:41.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.006+0000 7f66df1ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d80b07e0 con 0x7f66d80d1140 2023-07-14T15:55:41.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.006+0000 7f66df1ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d80b0ac0 con 0x7f66d81603b0 2023-07-14T15:55:41.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.006+0000 7f66df1ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66d80b0da0 con 0x7f66d815fee0 2023-07-14T15:55:41.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.006+0000 7f66dd79c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66d81603b0 0x7f66d80b69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:41.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.006+0000 7f66dd79c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66d81603b0 0x7f66d80b69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51350/0 (socket says 172.21.15.98:51350) 2023-07-14T15:55:41.993 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.006+0000 7f66dd79c700 1 -- 172.21.15.98:0/1652275911 learned_addr learned my addr 172.21.15.98:0/1652275911 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-07-14T15:55:41.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.006+0000 7f66dcf9b700 1 --2- 172.21.15.98:0/1652275911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66d80d1140 0x7f66d80b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:41.994 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.006+0000 7f66d7fff700 1 --2- 172.21.15.98:0/1652275911 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f66d815fee0 0x7f66d80b6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:41.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.006+0000 7f66dd79c700 1 -- 172.21.15.98:0/1652275911 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f66d815fee0 msgr2=0x7f66d80b6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:41.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.006+0000 7f66dd79c700 1 --2- 172.21.15.98:0/1652275911 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f66d815fee0 0x7f66d80b6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:41.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.006+0000 7f66dd79c700 1 -- 172.21.15.98:0/1652275911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66d80d1140 msgr2=0x7f66d80b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:41.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.006+0000 7f66dd79c700 1 --2- 172.21.15.98:0/1652275911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66d80d1140 0x7f66d80b5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:41.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.007+0000 7f66dd79c700 1 -- 172.21.15.98:0/1652275911 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66cc0094a0 con 0x7f66d81603b0 2023-07-14T15:55:41.995 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.007+0000 7f66dd79c700 1 --2- 172.21.15.98:0/1652275911 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66d81603b0 0x7f66d80b69b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f66d000caf0 tx=0x7f66d000ce00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:55:41.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.007+0000 7f66d57fa700 1 -- 172.21.15.98:0/1652275911 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d000a9e0 con 0x7f66d81603b0 2023-07-14T15:55:41.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.007+0000 7f66d57fa700 1 -- 172.21.15.98:0/1652275911 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d000ab40 con 0x7f66d81603b0 2023-07-14T15:55:41.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.007+0000 7f66df1ff700 1 -- 172.21.15.98:0/1652275911 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66d80b1080 con 0x7f66d81603b0 2023-07-14T15:55:41.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.007+0000 7f66d57fa700 1 -- 172.21.15.98:0/1652275911 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d0012400 con 0x7f66d81603b0 2023-07-14T15:55:41.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.007+0000 7f66df1ff700 1 -- 172.21.15.98:0/1652275911 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66d80b1a10 con 0x7f66d81603b0 2023-07-14T15:55:41.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.007+0000 7f66d57fa700 1 -- 172.21.15.98:0/1652275911 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f66d0012560 con 0x7f66d81603b0 2023-07-14T15:55:41.996 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.008+0000 7f66d57fa700 1 -- 172.21.15.98:0/1652275911 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f66d0012ca0 con 0x7f66d81603b0 2023-07-14T15:55:41.997 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.008+0000 7f66df1ff700 1 -- 172.21.15.98:0/1652275911 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66d8067840 con 0x7f66d81603b0 2023-07-14T15:55:41.998 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.011+0000 7f66d57fa700 1 -- 172.21.15.98:0/1652275911 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f66d0021060 con 0x7f66d81603b0 2023-07-14T15:55:42.084 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.097+0000 7f66df1ff700 1 -- 172.21.15.98:0/1652275911 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd new", "uuid": "767b8220-e79a-4a86-a162-6b3b73198379", "id": 3} v 0) v1 -- 0x7f66d80b5c90 con 0x7f66d81603b0 2023-07-14T15:55:42.092 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.106+0000 7f66d57fa700 1 -- 172.21.15.98:0/1652275911 <== mon.1 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "767b8220-e79a-4a86-a162-6b3b73198379", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f66d0017070 con 0x7f66d81603b0 2023-07-14T15:55:42.092 INFO:teuthology.orchestra.run.smithi098.stdout:3 2023-07-14T15:55:42.093 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.107+0000 7f66df1ff700 1 -- 172.21.15.98:0/1652275911 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66d81603b0 msgr2=0x7f66d80b69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:42.093 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.107+0000 7f66df1ff700 1 --2- 172.21.15.98:0/1652275911 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66d81603b0 0x7f66d80b69b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f66d000caf0 tx=0x7f66d000ce00 comp rx=0 tx=0).stop 2023-07-14T15:55:42.093 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.107+0000 7f66df1ff700 1 -- 172.21.15.98:0/1652275911 shutdown_connections 2023-07-14T15:55:42.094 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.107+0000 7f66df1ff700 1 --2- 172.21.15.98:0/1652275911 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66d81603b0 0x7f66d80b69b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:42.094 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.107+0000 7f66df1ff700 1 --2- 172.21.15.98:0/1652275911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66d80d1140 0x7f66d80b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:42.094 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.107+0000 7f66df1ff700 1 --2- 172.21.15.98:0/1652275911 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f66d815fee0 0x7f66d80b6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:42.094 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.107+0000 7f66df1ff700 1 -- 172.21.15.98:0/1652275911 >> 172.21.15.98:0/1652275911 conn(0x7f66d809c1b0 msgr2=0x7f66d806a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:55:42.094 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.107+0000 7f66df1ff700 1 -- 172.21.15.98:0/1652275911 shutdown_connections 2023-07-14T15:55:42.094 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.107+0000 7f66df1ff700 1 -- 172.21.15.98:0/1652275911 wait complete. 2023-07-14T15:55:42.110 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph osd new 717bd773-ae7e-4236-ac79-900cf99a37c5 4 2023-07-14T15:55:42.299 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.313+0000 7f317a5ff700 1 Processor -- start 2023-07-14T15:55:42.300 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.313+0000 7f317a5ff700 1 -- start start 2023-07-14T15:55:42.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.315+0000 7f317a5ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f31740cfd50 0x7f31740d2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:42.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.315+0000 7f317a5ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f31740b0ac0 0x7f31740b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:42.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.315+0000 7f317a5ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31740b1840 con 0x7f31740b1e80 2023-07-14T15:55:42.301 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.315+0000 7f317a5ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f317415ccf0 con 0x7f31740cfd50 2023-07-14T15:55:42.302 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.315+0000 7f317a5ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31740b2550 con 0x7f31740b0ac0 2023-07-14T15:55:42.303 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.315+0000 7f3178b9c700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f31740b0ac0 0x7f31740b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:42.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.315+0000 7f3173fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f31740cfd50 0x7f31740d2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:42.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.315+0000 7f316bfff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f31740b1e80 0x7f31740b2d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.98:34310/0 (socket says 172.21.15.98:34310) 2023-07-14T15:55:42.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.315+0000 7f316bfff700 1 -- 172.21.15.98:0/3868873935 learned_addr learned my addr 172.21.15.98:0/3868873935 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-07-14T15:55:42.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.316+0000 7f3173fff700 1 -- 172.21.15.98:0/3868873935 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f31740b0ac0 msgr2=0x7f31740b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:55:42.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.316+0000 7f3173fff700 1 --2- 172.21.15.98:0/3868873935 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f31740b0ac0 0x7f31740b0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:42.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.316+0000 7f3173fff700 1 -- 172.21.15.98:0/3868873935 >> v1:172.21.15.37:6789/0 conn(0x7f31740b1e80 legacy=0x7f31740b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:42.304 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.316+0000 7f3173fff700 1 -- 172.21.15.98:0/3868873935 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31740b2830 con 0x7f31740cfd50 2023-07-14T15:55:42.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.316+0000 7f3173fff700 1 --2- 172.21.15.98:0/3868873935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31740cfd50 0x7f31740d2880 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3164009840 tx=0x7f3164009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0977aee8fb456c5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:55:42.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.316+0000 7f31737fe700 1 -- 172.21.15.98:0/3868873935 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3164011830 con 0x7f31740cfd50 2023-07-14T15:55:42.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.316+0000 7f31737fe700 1 -- 172.21.15.98:0/3868873935 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3164011990 con 0x7f31740cfd50 2023-07-14T15:55:42.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.316+0000 7f31737fe700 1 -- 172.21.15.98:0/3868873935 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3164011d20 con 0x7f31740cfd50 2023-07-14T15:55:42.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.317+0000 7f317a5ff700 1 -- 172.21.15.98:0/3868873935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31740cfd50 msgr2=0x7f31740d2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:42.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.317+0000 7f317a5ff700 1 --2- 172.21.15.98:0/3868873935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31740cfd50 0x7f31740d2880 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3164009840 tx=0x7f3164009b50 comp rx=0 tx=0).stop 2023-07-14T15:55:42.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.317+0000 7f317a5ff700 1 -- 172.21.15.98:0/3868873935 shutdown_connections 2023-07-14T15:55:42.305 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.317+0000 7f317a5ff700 1 --2- 172.21.15.98:0/3868873935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31740cfd50 0x7f31740d2880 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:42.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.317+0000 7f317a5ff700 1 --2- 172.21.15.98:0/3868873935 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f31740b0ac0 0x7f31740b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:42.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.317+0000 7f317a5ff700 1 -- 172.21.15.98:0/3868873935 >> 172.21.15.98:0/3868873935 conn(0x7f317409c1c0 msgr2=0x7f31740d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:55:42.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.317+0000 7f317a5ff700 1 -- 172.21.15.98:0/3868873935 shutdown_connections 2023-07-14T15:55:42.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.317+0000 7f317a5ff700 1 -- 172.21.15.98:0/3868873935 wait complete. 2023-07-14T15:55:42.306 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.319+0000 7f317a5ff700 1 Processor -- start 2023-07-14T15:55:42.307 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.320+0000 7f317a5ff700 1 -- start start 2023-07-14T15:55:42.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.321+0000 7f317a5ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f31740b0ac0 0x7f31741f1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:42.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.321+0000 7f317a5ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31740b1e80 0x7f3174156140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:42.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.321+0000 7f317a5ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31740cfd50 0x7f31740c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:42.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.321+0000 7f317a5ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3174156b50 con 0x7f31740cfd50 2023-07-14T15:55:42.308 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.321+0000 7f317a5ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3174156da0 con 0x7f31740b1e80 2023-07-14T15:55:42.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.321+0000 7f317a5ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3174157080 con 0x7f31740b0ac0 2023-07-14T15:55:42.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.321+0000 7f3173fff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f31740b0ac0 0x7f31741f1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:42.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.321+0000 7f316bfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31740b1e80 0x7f3174156140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:42.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.321+0000 7f3173fff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f31740b0ac0 0x7f31741f1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3301/0 says I am v2:172.21.15.98:58064/0 (socket says 172.21.15.98:58064) 2023-07-14T15:55:42.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.321+0000 7f3173fff700 1 -- 172.21.15.98:0/4028641734 learned_addr learned my addr 172.21.15.98:0/4028641734 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-07-14T15:55:42.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.321+0000 7f3178b9c700 1 --2- 172.21.15.98:0/4028641734 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31740cfd50 0x7f31740c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:42.309 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.321+0000 7f3173fff700 1 -- 172.21.15.98:0/4028641734 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31740b1e80 msgr2=0x7f3174156140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:42.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.321+0000 7f3173fff700 1 --2- 172.21.15.98:0/4028641734 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31740b1e80 0x7f3174156140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:42.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.321+0000 7f3173fff700 1 -- 172.21.15.98:0/4028641734 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31740cfd50 msgr2=0x7f31740c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:42.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.321+0000 7f3173fff700 1 --2- 172.21.15.98:0/4028641734 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31740cfd50 0x7f31740c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:42.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.321+0000 7f3173fff700 1 -- 172.21.15.98:0/4028641734 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31640094a0 con 0x7f31740b0ac0 2023-07-14T15:55:42.310 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.322+0000 7f3173fff700 1 --2- 172.21.15.98:0/4028641734 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f31740b0ac0 0x7f31741f1e10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3164009fd0 tx=0x7f3164004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:55:42.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.322+0000 7f31717fa700 1 -- 172.21.15.98:0/4028641734 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31640036a0 con 0x7f31740b0ac0 2023-07-14T15:55:42.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.322+0000 7f31717fa700 1 -- 172.21.15.98:0/4028641734 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f316401e070 con 0x7f31740b0ac0 2023-07-14T15:55:42.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.322+0000 7f317a5ff700 1 -- 172.21.15.98:0/4028641734 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3174157360 con 0x7f31740b0ac0 2023-07-14T15:55:42.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.322+0000 7f31717fa700 1 -- 172.21.15.98:0/4028641734 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3164003a40 con 0x7f31740b0ac0 2023-07-14T15:55:42.311 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.322+0000 7f317a5ff700 1 -- 172.21.15.98:0/4028641734 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3174157640 con 0x7f31740b0ac0 2023-07-14T15:55:42.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.322+0000 7f31717fa700 1 -- 172.21.15.98:0/4028641734 <== mon.2 v2:172.21.15.98:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f316402d450 con 0x7f31740b0ac0 2023-07-14T15:55:42.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.323+0000 7f31717fa700 1 -- 172.21.15.98:0/4028641734 <== mon.2 v2:172.21.15.98:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f316402dc10 con 0x7f31740b0ac0 2023-07-14T15:55:42.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.323+0000 7f317a5ff700 1 -- 172.21.15.98:0/4028641734 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31740b7150 con 0x7f31740b0ac0 2023-07-14T15:55:42.312 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.326+0000 7f31717fa700 1 -- 172.21.15.98:0/4028641734 <== mon.2 v2:172.21.15.98:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f3164020070 con 0x7f31740b0ac0 2023-07-14T15:55:42.418 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.432+0000 7f317a5ff700 1 -- 172.21.15.98:0/4028641734 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_command({"prefix": "osd new", "uuid": "717bd773-ae7e-4236-ac79-900cf99a37c5", "id": 4} v 0) v1 -- 0x7f3174067840 con 0x7f31740b0ac0 2023-07-14T15:55:42.430 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.444+0000 7f31717fa700 1 -- 172.21.15.98:0/4028641734 <== mon.2 v2:172.21.15.98:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "717bd773-ae7e-4236-ac79-900cf99a37c5", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3164015020 con 0x7f31740b0ac0 2023-07-14T15:55:42.433 INFO:teuthology.orchestra.run.smithi098.stdout:4 2023-07-14T15:55:42.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.447+0000 7f317a5ff700 1 -- 172.21.15.98:0/4028641734 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f31740b0ac0 msgr2=0x7f31741f1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:42.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.447+0000 7f317a5ff700 1 --2- 172.21.15.98:0/4028641734 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f31740b0ac0 0x7f31741f1e10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3164009fd0 tx=0x7f3164004750 comp rx=0 tx=0).stop 2023-07-14T15:55:42.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.447+0000 7f317a5ff700 1 -- 172.21.15.98:0/4028641734 shutdown_connections 2023-07-14T15:55:42.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.447+0000 7f317a5ff700 1 --2- 172.21.15.98:0/4028641734 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31740cfd50 0x7f31740c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:42.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.447+0000 7f317a5ff700 1 --2- 172.21.15.98:0/4028641734 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f31740b0ac0 0x7f31741f1e10 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:42.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.447+0000 7f317a5ff700 1 --2- 172.21.15.98:0/4028641734 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31740b1e80 0x7f3174156140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:42.434 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.447+0000 7f317a5ff700 1 -- 172.21.15.98:0/4028641734 >> 172.21.15.98:0/4028641734 conn(0x7f317409c1c0 msgr2=0x7f31740b45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:55:42.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.448+0000 7f317a5ff700 1 -- 172.21.15.98:0/4028641734 shutdown_connections 2023-07-14T15:55:42.435 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.448+0000 7f317a5ff700 1 -- 172.21.15.98:0/4028641734 wait complete. 2023-07-14T15:55:42.459 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph osd new a941d358-0f03-4136-a9b2-3a1c2e9358cf 5 2023-07-14T15:55:42.624 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-14T15:55:42.637+0000 7f1d55b07200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-14T15:55:42.632 INFO:tasks.ceph.mgr.x.smithi098.stderr:2023-07-14T15:55:42.646+0000 7fa44c4e4200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-14T15:55:42.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.664+0000 7f8263bff700 1 Processor -- start 2023-07-14T15:55:42.650 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.664+0000 7f8263bff700 1 -- start start 2023-07-14T15:55:42.651 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.665+0000 7f8263bff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f825c0d1140 0x7f825c15ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:42.651 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.665+0000 7f8263bff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f825c1603b0 0x7f825c0b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:42.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.665+0000 7f8263bff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f825c15dc50 con 0x7f825c15fee0 2023-07-14T15:55:42.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.665+0000 7f8263bff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f825c0b2940 con 0x7f825c1603b0 2023-07-14T15:55:42.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.665+0000 7f8263bff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f825c0b2c20 con 0x7f825c0d1140 2023-07-14T15:55:42.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.665+0000 7f826119a700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f825c0d1140 0x7f825c15ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:42.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.665+0000 7f826119a700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f825c0d1140 0x7f825c15ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51362/0 (socket says 172.21.15.98:51362) 2023-07-14T15:55:42.652 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.665+0000 7f826119a700 1 -- 172.21.15.98:0/3403750943 learned_addr learned my addr 172.21.15.98:0/3403750943 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-07-14T15:55:42.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.666+0000 7f826119a700 1 -- 172.21.15.98:0/3403750943 >> v2:172.21.15.37:3300/0 conn(0x7f825c1603b0 msgr2=0x7f825c0b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:55:42.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.666+0000 7f826119a700 1 --2- 172.21.15.98:0/3403750943 >> v2:172.21.15.37:3300/0 conn(0x7f825c1603b0 0x7f825c0b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:42.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.666+0000 7f826119a700 1 -- 172.21.15.98:0/3403750943 >> v1:172.21.15.37:6789/0 conn(0x7f825c15fee0 legacy=0x7f825c0d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:55:42.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.666+0000 7f826119a700 1 -- 172.21.15.98:0/3403750943 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f825c0b2f00 con 0x7f825c0d1140 2023-07-14T15:55:42.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.666+0000 7f826119a700 1 --2- 172.21.15.98:0/3403750943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f825c0d1140 0x7f825c15ded0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f825c09c850 tx=0x7f824c009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=445b959ca009a174 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:55:42.654 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.666+0000 7f8260999700 1 -- 172.21.15.98:0/3403750943 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f824c004230 con 0x7f825c0d1140 2023-07-14T15:55:42.655 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.666+0000 7f8260999700 1 -- 172.21.15.98:0/3403750943 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f824c004390 con 0x7f825c0d1140 2023-07-14T15:55:42.655 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.666+0000 7f8260999700 1 -- 172.21.15.98:0/3403750943 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f824c0036a0 con 0x7f825c0d1140 2023-07-14T15:55:42.655 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.667+0000 7f8263bff700 1 -- 172.21.15.98:0/3403750943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f825c0d1140 msgr2=0x7f825c15ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:42.655 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.667+0000 7f8263bff700 1 --2- 172.21.15.98:0/3403750943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f825c0d1140 0x7f825c15ded0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f825c09c850 tx=0x7f824c009bd0 comp rx=0 tx=0).stop 2023-07-14T15:55:42.655 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.667+0000 7f8263bff700 1 -- 172.21.15.98:0/3403750943 shutdown_connections 2023-07-14T15:55:42.655 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.667+0000 7f8263bff700 1 --2- 172.21.15.98:0/3403750943 >> v2:172.21.15.37:3300/0 conn(0x7f825c1603b0 0x7f825c0b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:42.655 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.667+0000 7f8263bff700 1 --2- 172.21.15.98:0/3403750943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f825c0d1140 0x7f825c15ded0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:42.656 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.667+0000 7f8263bff700 1 -- 172.21.15.98:0/3403750943 >> 172.21.15.98:0/3403750943 conn(0x7f825c09c1b0 msgr2=0x7f825c0d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:55:42.656 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.667+0000 7f8263bff700 1 -- 172.21.15.98:0/3403750943 shutdown_connections 2023-07-14T15:55:42.656 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.667+0000 7f8263bff700 1 -- 172.21.15.98:0/3403750943 wait complete. 2023-07-14T15:55:42.657 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.669+0000 7f8263bff700 1 Processor -- start 2023-07-14T15:55:42.657 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.669+0000 7f8263bff700 1 -- start start 2023-07-14T15:55:42.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.670+0000 7f8263bff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f825c0d1140 0x7f825c1471d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:42.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.670+0000 7f8263bff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f825c15fee0 0x7f825c1e7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:42.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.670+0000 7f8263bff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f825c1603b0 0x7f825c0c64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:42.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.670+0000 7f8263bff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825c1e7be0 con 0x7f825c15fee0 2023-07-14T15:55:42.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.670+0000 7f8263bff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825c1e7ec0 con 0x7f825c1603b0 2023-07-14T15:55:42.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.670+0000 7f8263bff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f825c1e81a0 con 0x7f825c0d1140 2023-07-14T15:55:42.658 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.670+0000 7f826199b700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f825c0d1140 0x7f825c1471d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:42.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.670+0000 7f826199b700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f825c0d1140 0x7f825c1471d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3301/0 says I am v2:172.21.15.98:58080/0 (socket says 172.21.15.98:58080) 2023-07-14T15:55:42.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.670+0000 7f826199b700 1 -- 172.21.15.98:0/1338061297 learned_addr learned my addr 172.21.15.98:0/1338061297 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-07-14T15:55:42.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.670+0000 7f826119a700 1 --2- 172.21.15.98:0/1338061297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f825c15fee0 0x7f825c1e7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:42.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.670+0000 7f826219c700 1 --2- 172.21.15.98:0/1338061297 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f825c1603b0 0x7f825c0c64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:42.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.670+0000 7f826199b700 1 -- 172.21.15.98:0/1338061297 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f825c1603b0 msgr2=0x7f825c0c64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:42.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.670+0000 7f826199b700 1 --2- 172.21.15.98:0/1338061297 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f825c1603b0 0x7f825c0c64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:42.659 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.670+0000 7f826199b700 1 -- 172.21.15.98:0/1338061297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f825c15fee0 msgr2=0x7f825c1e7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:42.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.670+0000 7f826199b700 1 --2- 172.21.15.98:0/1338061297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f825c15fee0 0x7f825c1e7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:42.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.670+0000 7f826199b700 1 -- 172.21.15.98:0/1338061297 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f824c009550 con 0x7f825c0d1140 2023-07-14T15:55:42.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.671+0000 7f826199b700 1 --2- 172.21.15.98:0/1338061297 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f825c0d1140 0x7f825c1471d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f825800c4a0 tx=0x7f825800c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:55:42.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.671+0000 7f82527fc700 1 -- 172.21.15.98:0/1338061297 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82580054e0 con 0x7f825c0d1140 2023-07-14T15:55:42.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.671+0000 7f82527fc700 1 -- 172.21.15.98:0/1338061297 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8258003680 con 0x7f825c0d1140 2023-07-14T15:55:42.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.671+0000 7f82527fc700 1 -- 172.21.15.98:0/1338061297 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8258003a30 con 0x7f825c0d1140 2023-07-14T15:55:42.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.671+0000 7f8263bff700 1 -- 172.21.15.98:0/1338061297 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f825c1e8480 con 0x7f825c0d1140 2023-07-14T15:55:42.660 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.671+0000 7f8263bff700 1 -- 172.21.15.98:0/1338061297 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f825c15b3d0 con 0x7f825c0d1140 2023-07-14T15:55:42.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.671+0000 7f82527fc700 1 -- 172.21.15.98:0/1338061297 <== mon.2 v2:172.21.15.98:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8258006820 con 0x7f825c0d1140 2023-07-14T15:55:42.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.671+0000 7f82527fc700 1 -- 172.21.15.98:0/1338061297 <== mon.2 v2:172.21.15.98:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f8258006ad0 con 0x7f825c0d1140 2023-07-14T15:55:42.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.672+0000 7f8263bff700 1 -- 172.21.15.98:0/1338061297 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f825c1e89a0 con 0x7f825c0d1140 2023-07-14T15:55:42.661 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.674+0000 7f82527fc700 1 -- 172.21.15.98:0/1338061297 <== mon.2 v2:172.21.15.98:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f8258017070 con 0x7f825c0d1140 2023-07-14T15:55:42.747 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.760+0000 7f8263bff700 1 -- 172.21.15.98:0/1338061297 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a941d358-0f03-4136-a9b2-3a1c2e9358cf", "id": 5} v 0) v1 -- 0x7f825c067840 con 0x7f825c0d1140 2023-07-14T15:55:42.755 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.768+0000 7f82527fc700 1 -- 172.21.15.98:0/1338061297 <== mon.2 v2:172.21.15.98:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a941d358-0f03-4136-a9b2-3a1c2e9358cf", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8258006db0 con 0x7f825c0d1140 2023-07-14T15:55:42.756 INFO:teuthology.orchestra.run.smithi098.stdout:5 2023-07-14T15:55:42.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.769+0000 7f8263bff700 1 -- 172.21.15.98:0/1338061297 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f825c0d1140 msgr2=0x7f825c1471d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:42.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.769+0000 7f8263bff700 1 --2- 172.21.15.98:0/1338061297 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f825c0d1140 0x7f825c1471d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f825800c4a0 tx=0x7f825800c7b0 comp rx=0 tx=0).stop 2023-07-14T15:55:42.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.769+0000 7f8263bff700 1 -- 172.21.15.98:0/1338061297 shutdown_connections 2023-07-14T15:55:42.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.769+0000 7f8263bff700 1 --2- 172.21.15.98:0/1338061297 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f825c1603b0 0x7f825c0c64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:42.757 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.769+0000 7f8263bff700 1 --2- 172.21.15.98:0/1338061297 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f825c0d1140 0x7f825c1471d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:42.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.769+0000 7f8263bff700 1 --2- 172.21.15.98:0/1338061297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f825c15fee0 0x7f825c1e7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:42.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.769+0000 7f8263bff700 1 -- 172.21.15.98:0/1338061297 >> 172.21.15.98:0/1338061297 conn(0x7f825c09c1b0 msgr2=0x7f825c0b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:55:42.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.770+0000 7f8263bff700 1 -- 172.21.15.98:0/1338061297 shutdown_connections 2023-07-14T15:55:42.758 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.770+0000 7f8263bff700 1 -- 172.21.15.98:0/1338061297 wait complete. 2023-07-14T15:55:42.774 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph osd new 27153772-6d4b-479d-9953-0582e7b96743 6 2023-07-14T15:55:42.815 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-14T15:55:42.828+0000 7f1d55b07200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T15:55:42.829 INFO:tasks.ceph.mgr.x.smithi098.stderr:2023-07-14T15:55:42.842+0000 7fa44c4e4200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T15:55:42.966 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.978+0000 7f3cf9dff700 1 Processor -- start 2023-07-14T15:55:42.966 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.978+0000 7f3cf9dff700 1 -- start start 2023-07-14T15:55:42.967 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.980+0000 7f3cf9dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3cf40b11d0 0x7f3cf40d2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:42.967 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.980+0000 7f3cf9dff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cf40b1840 con 0x7f3cf40b1e80 2023-07-14T15:55:42.967 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.980+0000 7f3cf9dff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cf40b2550 con 0x7f3cf40cfd50 2023-07-14T15:55:42.967 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.980+0000 7f3cf9dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf415ccf0 con 0x7f3cf40b11d0 2023-07-14T15:55:42.967 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.980+0000 7f3cf37fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f3cf40cfd50 0x7f3cf40b2d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:34792/0 (socket says 172.21.15.98:34792) 2023-07-14T15:55:42.968 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.980+0000 7f3cf37fe700 1 -- 172.21.15.98:0/1833572746 learned_addr learned my addr 172.21.15.98:0/1833572746 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-07-14T15:55:42.968 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.980+0000 7f3cf3fff700 1 --2- 172.21.15.98:0/1833572746 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3cf40b11d0 0x7f3cf40d2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:42.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.980+0000 7f3cf27fc700 1 -- 172.21.15.98:0/1833572746 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3690881410 0 0) 0x7f3cf40b2550 con 0x7f3cf40cfd50 2023-07-14T15:55:42.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.980+0000 7f3cf27fc700 1 -- 172.21.15.98:0/1833572746 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cdc0035b0 con 0x7f3cf40cfd50 2023-07-14T15:55:42.969 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.980+0000 7f3cf3fff700 1 -- 172.21.15.98:0/1833572746 >> v1:172.21.15.98:6789/0 conn(0x7f3cf40cfd50 legacy=0x7f3cf40b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:42.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.980+0000 7f3cf3fff700 1 -- 172.21.15.98:0/1833572746 >> v1:172.21.15.37:6789/0 conn(0x7f3cf40b1e80 legacy=0x7f3cf40b0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:42.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.980+0000 7f3cf3fff700 1 -- 172.21.15.98:0/1833572746 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf40b2830 con 0x7f3cf40b11d0 2023-07-14T15:55:42.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.981+0000 7f3cf3fff700 1 --2- 172.21.15.98:0/1833572746 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3cf40b11d0 0x7f3cf40d2880 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3cec009dc0 tx=0x7f3cec00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4b969ee7ed16731 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:55:42.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.981+0000 7f3cf27fc700 1 -- 172.21.15.98:0/1833572746 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cec00e070 con 0x7f3cf40b11d0 2023-07-14T15:55:42.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.981+0000 7f3cf27fc700 1 -- 172.21.15.98:0/1833572746 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cec00bb20 con 0x7f3cf40b11d0 2023-07-14T15:55:42.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.981+0000 7f3cf27fc700 1 -- 172.21.15.98:0/1833572746 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cec012430 con 0x7f3cf40b11d0 2023-07-14T15:55:42.970 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.981+0000 7f3cf9dff700 1 -- 172.21.15.98:0/1833572746 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3cf40b11d0 msgr2=0x7f3cf40d2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:42.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.981+0000 7f3cf9dff700 1 --2- 172.21.15.98:0/1833572746 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3cf40b11d0 0x7f3cf40d2880 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3cec009dc0 tx=0x7f3cec00b330 comp rx=0 tx=0).stop 2023-07-14T15:55:42.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.981+0000 7f3cf9dff700 1 -- 172.21.15.98:0/1833572746 shutdown_connections 2023-07-14T15:55:42.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.981+0000 7f3cf9dff700 1 --2- 172.21.15.98:0/1833572746 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3cf40b11d0 0x7f3cf40d2880 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:42.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.981+0000 7f3cf9dff700 1 -- 172.21.15.98:0/1833572746 >> 172.21.15.98:0/1833572746 conn(0x7f3cf409c1c0 msgr2=0x7f3cf40d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:55:42.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.981+0000 7f3cf9dff700 1 -- 172.21.15.98:0/1833572746 shutdown_connections 2023-07-14T15:55:42.971 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.982+0000 7f3cf9dff700 1 -- 172.21.15.98:0/1833572746 wait complete. 2023-07-14T15:55:42.973 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.983+0000 7f3cf9dff700 1 Processor -- start 2023-07-14T15:55:42.973 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.983+0000 7f3cf9dff700 1 -- start start 2023-07-14T15:55:42.973 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.984+0000 7f3cf9dff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cf40b11d0 0x7f3cf40b68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:42.973 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.984+0000 7f3cf9dff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3cf40b1e80 0x7f3cf414fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:42.973 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.984+0000 7f3cf9dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3cf40cfd50 0x7f3cf415a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:42.973 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.984+0000 7f3cf9dff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf40c8e50 con 0x7f3cf40b11d0 2023-07-14T15:55:42.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.984+0000 7f3cf9dff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf40b6460 con 0x7f3cf40b1e80 2023-07-14T15:55:42.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.984+0000 7f3cf9dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf40b6e30 con 0x7f3cf40cfd50 2023-07-14T15:55:42.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.984+0000 7f3cf2ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3cf40b1e80 0x7f3cf414fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:42.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.984+0000 7f3cf3fff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3cf40cfd50 0x7f3cf415a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:42.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.985+0000 7f3cf3fff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3cf40cfd50 0x7f3cf415a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3301/0 says I am v2:172.21.15.98:58096/0 (socket says 172.21.15.98:58096) 2023-07-14T15:55:42.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.985+0000 7f3cf3fff700 1 -- 172.21.15.98:0/4242847634 learned_addr learned my addr 172.21.15.98:0/4242847634 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-07-14T15:55:42.974 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.985+0000 7f3cf37fe700 1 --2- 172.21.15.98:0/4242847634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cf40b11d0 0x7f3cf40b68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:42.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.985+0000 7f3cf3fff700 1 -- 172.21.15.98:0/4242847634 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3cf40b1e80 msgr2=0x7f3cf414fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:42.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.985+0000 7f3cf3fff700 1 --2- 172.21.15.98:0/4242847634 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3cf40b1e80 0x7f3cf414fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:42.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.985+0000 7f3cf3fff700 1 -- 172.21.15.98:0/4242847634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cf40b11d0 msgr2=0x7f3cf40b68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:42.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.985+0000 7f3cf3fff700 1 --2- 172.21.15.98:0/4242847634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cf40b11d0 0x7f3cf40b68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:42.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.985+0000 7f3cf3fff700 1 -- 172.21.15.98:0/4242847634 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cec009a70 con 0x7f3cf40cfd50 2023-07-14T15:55:42.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.985+0000 7f3cf3fff700 1 --2- 172.21.15.98:0/4242847634 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3cf40cfd50 0x7f3cf415a600 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3cf408b530 tx=0x7f3cec004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:55:42.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.985+0000 7f3cdbfff700 1 -- 172.21.15.98:0/4242847634 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cec012430 con 0x7f3cf40cfd50 2023-07-14T15:55:42.975 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.985+0000 7f3cdbfff700 1 -- 172.21.15.98:0/4242847634 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cec020070 con 0x7f3cf40cfd50 2023-07-14T15:55:42.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.985+0000 7f3cf9dff700 1 -- 172.21.15.98:0/4242847634 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cf40d02a0 con 0x7f3cf40cfd50 2023-07-14T15:55:42.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.985+0000 7f3cdbfff700 1 -- 172.21.15.98:0/4242847634 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cec0098f0 con 0x7f3cf40cfd50 2023-07-14T15:55:42.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.986+0000 7f3cf9dff700 1 -- 172.21.15.98:0/4242847634 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cf40c8b70 con 0x7f3cf40cfd50 2023-07-14T15:55:42.976 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.986+0000 7f3cdbfff700 1 -- 172.21.15.98:0/4242847634 <== mon.2 v2:172.21.15.98:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3cec004340 con 0x7f3cf40cfd50 2023-07-14T15:55:42.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.986+0000 7f3cdbfff700 1 -- 172.21.15.98:0/4242847634 <== mon.2 v2:172.21.15.98:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f3cec022070 con 0x7f3cf40cfd50 2023-07-14T15:55:42.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.987+0000 7f3cf9dff700 1 -- 172.21.15.98:0/4242847634 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cf40b5cb0 con 0x7f3cf40cfd50 2023-07-14T15:55:42.977 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:42.989+0000 7f3cdbfff700 1 -- 172.21.15.98:0/4242847634 <== mon.2 v2:172.21.15.98:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f3cf40b5cb0 con 0x7f3cf40cfd50 2023-07-14T15:55:43.061 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.074+0000 7f3cf9dff700 1 -- 172.21.15.98:0/4242847634 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_command({"prefix": "osd new", "uuid": "27153772-6d4b-479d-9953-0582e7b96743", "id": 6} v 0) v1 -- 0x7f3cf4067840 con 0x7f3cf40cfd50 2023-07-14T15:55:43.068 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.081+0000 7f3cdbfff700 1 -- 172.21.15.98:0/4242847634 <== mon.2 v2:172.21.15.98:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "27153772-6d4b-479d-9953-0582e7b96743", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3cec0045f0 con 0x7f3cf40cfd50 2023-07-14T15:55:43.068 INFO:teuthology.orchestra.run.smithi098.stdout:6 2023-07-14T15:55:43.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.082+0000 7f3cf9dff700 1 -- 172.21.15.98:0/4242847634 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3cf40cfd50 msgr2=0x7f3cf415a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:43.069 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.082+0000 7f3cf9dff700 1 --2- 172.21.15.98:0/4242847634 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3cf40cfd50 0x7f3cf415a600 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3cf408b530 tx=0x7f3cec004ad0 comp rx=0 tx=0).stop 2023-07-14T15:55:43.070 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.082+0000 7f3cf9dff700 1 -- 172.21.15.98:0/4242847634 shutdown_connections 2023-07-14T15:55:43.070 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.082+0000 7f3cf9dff700 1 --2- 172.21.15.98:0/4242847634 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3cf40cfd50 0x7f3cf415a600 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:43.070 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.082+0000 7f3cf9dff700 1 --2- 172.21.15.98:0/4242847634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cf40b11d0 0x7f3cf40b68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:43.070 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.082+0000 7f3cf9dff700 1 --2- 172.21.15.98:0/4242847634 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3cf40b1e80 0x7f3cf414fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:43.070 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.082+0000 7f3cf9dff700 1 -- 172.21.15.98:0/4242847634 >> 172.21.15.98:0/4242847634 conn(0x7f3cf409c1c0 msgr2=0x7f3cf40b0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:55:43.070 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.082+0000 7f3cf9dff700 1 -- 172.21.15.98:0/4242847634 shutdown_connections 2023-07-14T15:55:43.070 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.082+0000 7f3cf9dff700 1 -- 172.21.15.98:0/4242847634 wait complete. 2023-07-14T15:55:43.086 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph osd new d21ffc8e-40bb-47eb-af2c-e3e730d3fb76 7 2023-07-14T15:55:43.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.288+0000 7f6568bff700 1 Processor -- start 2023-07-14T15:55:43.276 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.288+0000 7f6568bff700 1 -- start start 2023-07-14T15:55:43.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.290+0000 7f6568bff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f65640af190 0x7f65640cf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:43.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.290+0000 7f6568bff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f65640b16f0 0x7f65640b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:43.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.290+0000 7f6568bff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f656415cc60 con 0x7f656406d6b0 2023-07-14T15:55:43.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.290+0000 7f6568bff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6564071530 con 0x7f65640b16f0 2023-07-14T15:55:43.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.290+0000 7f6568bff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65640af560 con 0x7f65640af190 2023-07-14T15:55:43.278 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.290+0000 7f656259c700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f65640af190 0x7f65640cf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:43.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.290+0000 7f6561d9b700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f656406d6b0 0x7f6564070e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.98:34804/0 (socket says 172.21.15.98:34804) 2023-07-14T15:55:43.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.290+0000 7f6561d9b700 1 -- 172.21.15.98:0/269824860 learned_addr learned my addr 172.21.15.98:0/269824860 (peer_addr_for_me v1:172.21.15.98:0/0) 2023-07-14T15:55:43.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.290+0000 7f6562d9d700 1 --2- 172.21.15.98:0/269824860 >> v2:172.21.15.98:3300/0 conn(0x7f65640b16f0 0x7f65640b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:43.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.290+0000 7f656259c700 1 -- 172.21.15.98:0/269824860 >> v2:172.21.15.98:3300/0 conn(0x7f65640b16f0 msgr2=0x7f65640b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:55:43.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.290+0000 7f656259c700 1 --2- 172.21.15.98:0/269824860 >> v2:172.21.15.98:3300/0 conn(0x7f65640b16f0 0x7f65640b1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:43.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.290+0000 7f656259c700 1 -- 172.21.15.98:0/269824860 >> v1:172.21.15.98:6789/0 conn(0x7f656406d6b0 legacy=0x7f6564070e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:43.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.290+0000 7f656259c700 1 -- 172.21.15.98:0/269824860 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6564071720 con 0x7f65640af190 2023-07-14T15:55:43.279 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.290+0000 7f6562d9d700 1 --2- 172.21.15.98:0/269824860 >> v2:172.21.15.98:3300/0 conn(0x7f65640b16f0 0x7f65640b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:55:43.280 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.291+0000 7f656259c700 1 --2- 172.21.15.98:0/269824860 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f65640af190 0x7f65640cf5d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6554009840 tx=0x7f6554009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c97e1a2dc5ffde0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:55:43.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.291+0000 7f656159a700 1 -- 172.21.15.98:0/269824860 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6554011830 con 0x7f65640af190 2023-07-14T15:55:43.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.291+0000 7f656159a700 1 -- 172.21.15.98:0/269824860 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6554011990 con 0x7f65640af190 2023-07-14T15:55:43.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.291+0000 7f656159a700 1 -- 172.21.15.98:0/269824860 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6554011d20 con 0x7f65640af190 2023-07-14T15:55:43.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.292+0000 7f6568bff700 1 -- 172.21.15.98:0/269824860 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f65640af190 msgr2=0x7f65640cf5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:43.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.292+0000 7f6568bff700 1 --2- 172.21.15.98:0/269824860 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f65640af190 0x7f65640cf5d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6554009840 tx=0x7f6554009b50 comp rx=0 tx=0).stop 2023-07-14T15:55:43.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.292+0000 7f6568bff700 1 -- 172.21.15.98:0/269824860 shutdown_connections 2023-07-14T15:55:43.281 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.292+0000 7f6568bff700 1 --2- 172.21.15.98:0/269824860 >> v2:172.21.15.98:3300/0 conn(0x7f65640b16f0 0x7f65640b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:43.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.292+0000 7f6568bff700 1 --2- 172.21.15.98:0/269824860 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f65640af190 0x7f65640cf5d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:43.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.292+0000 7f6568bff700 1 -- 172.21.15.98:0/269824860 >> 172.21.15.98:0/269824860 conn(0x7f65640cc610 msgr2=0x7f65640cc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:55:43.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.292+0000 7f6568bff700 1 -- 172.21.15.98:0/269824860 shutdown_connections 2023-07-14T15:55:43.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.292+0000 7f6568bff700 1 -- 172.21.15.98:0/269824860 wait complete. 2023-07-14T15:55:43.282 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.294+0000 7f6568bff700 1 Processor -- start 2023-07-14T15:55:43.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.294+0000 7f6568bff700 1 -- start start 2023-07-14T15:55:43.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.295+0000 7f6568bff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f656406d6b0 0x7f6564158710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:43.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.295+0000 7f6568bff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65640af190 0x7f6564156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:43.284 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.295+0000 7f6568bff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f65640b16f0 0x7f656415ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:43.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.295+0000 7f6568bff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6564158c50 con 0x7f65640af190 2023-07-14T15:55:43.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.295+0000 7f6568bff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6564157670 con 0x7f656406d6b0 2023-07-14T15:55:43.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.295+0000 7f6568bff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6564157950 con 0x7f65640b16f0 2023-07-14T15:55:43.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.295+0000 7f656259c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f656406d6b0 0x7f6564158710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:43.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.295+0000 7f656259c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f656406d6b0 0x7f6564158710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51414/0 (socket says 172.21.15.98:51414) 2023-07-14T15:55:43.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.295+0000 7f656259c700 1 -- 172.21.15.98:0/1547211532 learned_addr learned my addr 172.21.15.98:0/1547211532 (peer_addr_for_me v2:172.21.15.98:0/0) 2023-07-14T15:55:43.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.295+0000 7f6562d9d700 1 --2- 172.21.15.98:0/1547211532 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f65640b16f0 0x7f656415ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:43.285 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.295+0000 7f6561d9b700 1 --2- 172.21.15.98:0/1547211532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65640af190 0x7f6564156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:43.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.295+0000 7f656259c700 1 -- 172.21.15.98:0/1547211532 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f65640b16f0 msgr2=0x7f656415ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:43.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.295+0000 7f656259c700 1 --2- 172.21.15.98:0/1547211532 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f65640b16f0 0x7f656415ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:43.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.295+0000 7f656259c700 1 -- 172.21.15.98:0/1547211532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65640af190 msgr2=0x7f6564156b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:43.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.295+0000 7f656259c700 1 --2- 172.21.15.98:0/1547211532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65640af190 0x7f6564156b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:43.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.295+0000 7f656259c700 1 -- 172.21.15.98:0/1547211532 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f655c009a70 con 0x7f656406d6b0 2023-07-14T15:55:43.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.295+0000 7f6561d9b700 1 --2- 172.21.15.98:0/1547211532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65640af190 0x7f6564156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:55:43.286 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.296+0000 7f656259c700 1 --2- 172.21.15.98:0/1547211532 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f656406d6b0 0x7f6564158710 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6554009fd0 tx=0x7f6554004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:55:43.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.296+0000 7f6552ffd700 1 -- 172.21.15.98:0/1547211532 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65540036a0 con 0x7f656406d6b0 2023-07-14T15:55:43.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.296+0000 7f6552ffd700 1 -- 172.21.15.98:0/1547211532 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f655401f070 con 0x7f656406d6b0 2023-07-14T15:55:43.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.296+0000 7f6568bff700 1 -- 172.21.15.98:0/1547211532 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65540094a0 con 0x7f656406d6b0 2023-07-14T15:55:43.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.296+0000 7f6552ffd700 1 -- 172.21.15.98:0/1547211532 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6554003a20 con 0x7f656406d6b0 2023-07-14T15:55:43.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.296+0000 7f6568bff700 1 -- 172.21.15.98:0/1547211532 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6564157f10 con 0x7f656406d6b0 2023-07-14T15:55:43.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.296+0000 7f6552ffd700 1 -- 172.21.15.98:0/1547211532 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6554026480 con 0x7f656406d6b0 2023-07-14T15:55:43.287 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.297+0000 7f6552ffd700 1 -- 172.21.15.98:0/1547211532 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f6554021070 con 0x7f656406d6b0 2023-07-14T15:55:43.288 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.297+0000 7f6568bff700 1 -- 172.21.15.98:0/1547211532 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65640afde0 con 0x7f656406d6b0 2023-07-14T15:55:43.288 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.300+0000 7f6552ffd700 1 -- 172.21.15.98:0/1547211532 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f655402b020 con 0x7f656406d6b0 2023-07-14T15:55:43.373 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.386+0000 7f6568bff700 1 -- 172.21.15.98:0/1547211532 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d21ffc8e-40bb-47eb-af2c-e3e730d3fb76", "id": 7} v 0) v1 -- 0x7f6564067840 con 0x7f656406d6b0 2023-07-14T15:55:43.381 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.394+0000 7f6552ffd700 1 -- 172.21.15.98:0/1547211532 <== mon.1 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d21ffc8e-40bb-47eb-af2c-e3e730d3fb76", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6554015020 con 0x7f656406d6b0 2023-07-14T15:55:43.382 INFO:teuthology.orchestra.run.smithi098.stdout:7 2023-07-14T15:55:43.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.395+0000 7f6568bff700 1 -- 172.21.15.98:0/1547211532 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f656406d6b0 msgr2=0x7f6564158710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:43.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.395+0000 7f6568bff700 1 --2- 172.21.15.98:0/1547211532 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f656406d6b0 0x7f6564158710 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6554009fd0 tx=0x7f6554004750 comp rx=0 tx=0).stop 2023-07-14T15:55:43.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.395+0000 7f6568bff700 1 -- 172.21.15.98:0/1547211532 shutdown_connections 2023-07-14T15:55:43.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.395+0000 7f6568bff700 1 --2- 172.21.15.98:0/1547211532 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f656406d6b0 0x7f6564158710 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:43.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.395+0000 7f6568bff700 1 --2- 172.21.15.98:0/1547211532 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f65640b16f0 0x7f656415ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:43.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.395+0000 7f6568bff700 1 --2- 172.21.15.98:0/1547211532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65640af190 0x7f6564156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:43.383 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.395+0000 7f6568bff700 1 -- 172.21.15.98:0/1547211532 >> 172.21.15.98:0/1547211532 conn(0x7f65640cc610 msgr2=0x7f65640af6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:55:43.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.395+0000 7f6568bff700 1 -- 172.21.15.98:0/1547211532 shutdown_connections 2023-07-14T15:55:43.384 INFO:teuthology.orchestra.run.smithi098.stderr:2023-07-14T15:55:43.396+0000 7f6568bff700 1 -- 172.21.15.98:0/1547211532 wait complete. 2023-07-14T15:55:43.399 INFO:tasks.ceph.osd.0:Restarting daemon 2023-07-14T15:55:43.400 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-07-14T15:55:43.404 INFO:tasks.ceph.osd.0:Started 2023-07-14T15:55:43.405 INFO:tasks.ceph.osd.1:Restarting daemon 2023-07-14T15:55:43.405 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-07-14T15:55:43.409 INFO:tasks.ceph.osd.1:Started 2023-07-14T15:55:43.409 INFO:tasks.ceph.osd.2:Restarting daemon 2023-07-14T15:55:43.409 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-07-14T15:55:43.417 INFO:tasks.ceph.osd.2:Started 2023-07-14T15:55:43.417 INFO:tasks.ceph.osd.3:Restarting daemon 2023-07-14T15:55:43.418 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-07-14T15:55:43.423 INFO:tasks.ceph.osd.3:Started 2023-07-14T15:55:43.424 INFO:tasks.ceph.osd.4:Restarting daemon 2023-07-14T15:55:43.424 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-07-14T15:55:43.428 INFO:tasks.ceph.osd.4:Started 2023-07-14T15:55:43.429 INFO:tasks.ceph.osd.5:Restarting daemon 2023-07-14T15:55:43.429 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-07-14T15:55:43.433 INFO:tasks.ceph.osd.5:Started 2023-07-14T15:55:43.433 INFO:tasks.ceph.osd.6:Restarting daemon 2023-07-14T15:55:43.434 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-07-14T15:55:43.439 INFO:tasks.ceph.osd.6:Started 2023-07-14T15:55:43.439 INFO:tasks.ceph.osd.7:Restarting daemon 2023-07-14T15:55:43.440 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-07-14T15:55:43.445 INFO:tasks.ceph.osd.7:Started 2023-07-14T15:55:43.446 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T15:55:43.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.718+0000 7efddc1ff700 1 Processor -- start 2023-07-14T15:55:43.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.719+0000 7efddc1ff700 1 -- start start 2023-07-14T15:55:43.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.720+0000 7efddc1ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7efdd40b5cf0 0x7efdd4160c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:43.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.720+0000 7efddc1ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdd40d0de0 con 0x7efdd40b8b80 2023-07-14T15:55:43.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.720+0000 7efddc1ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdd40cd590 con 0x7efdd40cffc0 2023-07-14T15:55:43.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.720+0000 7efddc1ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdd4161190 con 0x7efdd40b5cf0 2023-07-14T15:55:43.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.720+0000 7efdda79c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7efdd40b5cf0 0x7efdd4160c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:43.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.720+0000 7efdd979a700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7efdd40cffc0 0x7efdd40d1270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.37:33530/0 (socket says 172.21.15.37:33530) 2023-07-14T15:55:43.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.720+0000 7efdda79c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7efdd40b5cf0 0x7efdd4160c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.37:48488/0 (socket says 172.21.15.37:48488) 2023-07-14T15:55:43.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.720+0000 7efdd979a700 1 -- 172.21.15.37:0/1638928965 learned_addr learned my addr 172.21.15.37:0/1638928965 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:55:43.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.721+0000 7efdda79c700 1 -- 172.21.15.37:0/1638928965 >> v1:172.21.15.98:6789/0 conn(0x7efdd40cffc0 legacy=0x7efdd40d1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:43.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.721+0000 7efdda79c700 1 -- 172.21.15.37:0/1638928965 >> v1:172.21.15.37:6789/0 conn(0x7efdd40b8b80 legacy=0x7efdd40cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:43.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.721+0000 7efdd8f99700 1 -- 172.21.15.37:0/1638928965 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1066589516 0 0) 0x7efdd40cd590 con 0x7efdd40cffc0 2023-07-14T15:55:43.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.721+0000 7efdda79c700 1 -- 172.21.15.37:0/1638928965 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd40cd870 con 0x7efdd40b5cf0 2023-07-14T15:55:43.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.721+0000 7efdda79c700 1 --2- 172.21.15.37:0/1638928965 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efdd40b5cf0 0x7efdd4160c50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efdcc009d90 tx=0x7efdcc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c5ac140a3228bb7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:55:43.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.721+0000 7efdd8f99700 1 -- 172.21.15.37:0/1638928965 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdcc00e070 con 0x7efdd40b5cf0 2023-07-14T15:55:43.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.721+0000 7efdd8f99700 1 -- 172.21.15.37:0/1638928965 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdcc00bbd0 con 0x7efdd40b5cf0 2023-07-14T15:55:43.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.721+0000 7efdd8f99700 1 -- 172.21.15.37:0/1638928965 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdcc012430 con 0x7efdd40b5cf0 2023-07-14T15:55:43.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.722+0000 7efddc1ff700 1 -- 172.21.15.37:0/1638928965 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efdd40b5cf0 msgr2=0x7efdd4160c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:43.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.722+0000 7efddc1ff700 1 --2- 172.21.15.37:0/1638928965 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efdd40b5cf0 0x7efdd4160c50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efdcc009d90 tx=0x7efdcc00b330 comp rx=0 tx=0).stop 2023-07-14T15:55:43.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.722+0000 7efddc1ff700 1 -- 172.21.15.37:0/1638928965 shutdown_connections 2023-07-14T15:55:43.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.722+0000 7efddc1ff700 1 --2- 172.21.15.37:0/1638928965 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efdd40b5cf0 0x7efdd4160c50 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:43.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.722+0000 7efddc1ff700 1 -- 172.21.15.37:0/1638928965 >> 172.21.15.37:0/1638928965 conn(0x7efdd406b150 msgr2=0x7efdd406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:55:43.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.722+0000 7efddc1ff700 1 -- 172.21.15.37:0/1638928965 shutdown_connections 2023-07-14T15:55:43.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.722+0000 7efddc1ff700 1 -- 172.21.15.37:0/1638928965 wait complete. 2023-07-14T15:55:43.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.724+0000 7efddc1ff700 1 Processor -- start 2023-07-14T15:55:43.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.724+0000 7efddc1ff700 1 -- start start 2023-07-14T15:55:43.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.725+0000 7efddc1ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7efdd40b5cf0 0x7efdd40c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:43.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.725+0000 7efddc1ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efdd40b8b80 0x7efdd41545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:43.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.725+0000 7efddc1ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdd40cffc0 0x7efdd415e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:43.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.725+0000 7efddc1ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd41f6310 con 0x7efdd40cffc0 2023-07-14T15:55:43.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.725+0000 7efddc1ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd4154b20 con 0x7efdd40b8b80 2023-07-14T15:55:43.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.725+0000 7efddc1ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd41f5690 con 0x7efdd40b5cf0 2023-07-14T15:55:43.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.725+0000 7efdda79c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdd40cffc0 0x7efdd415e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:43.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.725+0000 7efdd979a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efdd40b8b80 0x7efdd41545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:43.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.725+0000 7efdd9f9b700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7efdd40b5cf0 0x7efdd40c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:43.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.725+0000 7efdda79c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdd40cffc0 0x7efdd415e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46538/0 (socket says 172.21.15.37:46538) 2023-07-14T15:55:43.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.725+0000 7efdda79c700 1 -- 172.21.15.37:0/3586648616 learned_addr learned my addr 172.21.15.37:0/3586648616 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:55:43.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.725+0000 7efdd979a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efdd40b8b80 0x7efdd41545e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.37:48494/0 (socket says 172.21.15.37:48494) 2023-07-14T15:55:43.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.726+0000 7efdd979a700 1 -- 172.21.15.37:0/3586648616 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7efdd40b5cf0 msgr2=0x7efdd40c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:43.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.726+0000 7efdd979a700 1 --2- 172.21.15.37:0/3586648616 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7efdd40b5cf0 0x7efdd40c8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:43.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.726+0000 7efdd979a700 1 -- 172.21.15.37:0/3586648616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdd40cffc0 msgr2=0x7efdd415e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:43.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.726+0000 7efdd979a700 1 --2- 172.21.15.37:0/3586648616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdd40cffc0 0x7efdd415e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:43.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.726+0000 7efdd979a700 1 -- 172.21.15.37:0/3586648616 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdcc009a70 con 0x7efdd40b8b80 2023-07-14T15:55:43.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.726+0000 7efdd9f9b700 1 --2- 172.21.15.37:0/3586648616 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7efdd40b5cf0 0x7efdd40c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:55:43.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.726+0000 7efdda79c700 1 --2- 172.21.15.37:0/3586648616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdd40cffc0 0x7efdd415e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:55:43.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.726+0000 7efdd979a700 1 --2- 172.21.15.37:0/3586648616 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efdd40b8b80 0x7efdd41545e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7efdc400c3e0 tx=0x7efdc400c6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:55:43.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.726+0000 7efdca7fc700 1 -- 172.21.15.37:0/3586648616 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc4004a70 con 0x7efdd40b8b80 2023-07-14T15:55:43.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.726+0000 7efdca7fc700 1 -- 172.21.15.37:0/3586648616 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc4004bd0 con 0x7efdd40b8b80 2023-07-14T15:55:43.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.726+0000 7efddc1ff700 1 -- 172.21.15.37:0/3586648616 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdd41f5970 con 0x7efdd40b8b80 2023-07-14T15:55:43.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.726+0000 7efdca7fc700 1 -- 172.21.15.37:0/3586648616 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc40070d0 con 0x7efdd40b8b80 2023-07-14T15:55:43.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.726+0000 7efddc1ff700 1 -- 172.21.15.37:0/3586648616 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdd41f5f30 con 0x7efdd40b8b80 2023-07-14T15:55:43.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.727+0000 7efdca7fc700 1 -- 172.21.15.37:0/3586648616 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7efdc4007530 con 0x7efdd40b8b80 2023-07-14T15:55:43.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.727+0000 7efdca7fc700 1 -- 172.21.15.37:0/3586648616 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7efdc40133c0 con 0x7efdd40b8b80 2023-07-14T15:55:43.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.727+0000 7efddc1ff700 1 -- 172.21.15.37:0/3586648616 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdd4067840 con 0x7efdd40b8b80 2023-07-14T15:55:43.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.730+0000 7efdca7fc700 1 -- 172.21.15.37:0/3586648616 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7efdc401d3f0 con 0x7efdd40b8b80 2023-07-14T15:55:43.727 INFO:tasks.ceph.mgr.x.smithi098.stderr:2023-07-14T15:55:43.740+0000 7fa44c4e4200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T15:55:43.751 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-14T15:55:43.765+0000 7f1d55b07200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T15:55:43.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.805+0000 7efddc1ff700 1 -- 172.21.15.37:0/3586648616 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efdd406c9b0 con 0x7efdd40b8b80 2023-07-14T15:55:43.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.806+0000 7efdca7fc700 1 -- 172.21.15.37:0/3586648616 <== mon.1 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7efdc401d590 con 0x7efdd40b8b80 2023-07-14T15:55:43.793 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:55:43.793 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":10,"fsid":"9da30401-a779-4e46-aba6-00c2494c6c67","created":"2023-07-14T15:55:39.898867+0000","modified":"2023-07-14T15:55:43.388192+0000","last_up_change":"0.000000","last_in_change":"2023-07-14T15:55:43.388192+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0d049535-7b87-4276-8fe5-0f74ba422d5e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"79ec948d-ead2-4c2d-923a-dd6eeaac9dbd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a1db6690-c160-4366-9c82-2cca17e4bba9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"767b8220-e79a-4a86-a162-6b3b73198379","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"717bd773-ae7e-4236-ac79-900cf99a37c5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a941d358-0f03-4136-a9b2-3a1c2e9358cf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"27153772-6d4b-479d-9953-0582e7b96743","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d21ffc8e-40bb-47eb-af2c-e3e730d3fb76","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T15:55:43.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.807+0000 7efddc1ff700 1 -- 172.21.15.37:0/3586648616 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efdd40b8b80 msgr2=0x7efdd41545e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:43.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.807+0000 7efddc1ff700 1 --2- 172.21.15.37:0/3586648616 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efdd40b8b80 0x7efdd41545e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7efdc400c3e0 tx=0x7efdc400c6f0 comp rx=0 tx=0).stop 2023-07-14T15:55:43.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.807+0000 7efddc1ff700 1 -- 172.21.15.37:0/3586648616 shutdown_connections 2023-07-14T15:55:43.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.807+0000 7efddc1ff700 1 --2- 172.21.15.37:0/3586648616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdd40cffc0 0x7efdd415e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:43.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.807+0000 7efddc1ff700 1 --2- 172.21.15.37:0/3586648616 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7efdd40b5cf0 0x7efdd40c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:43.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.807+0000 7efddc1ff700 1 --2- 172.21.15.37:0/3586648616 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efdd40b8b80 0x7efdd41545e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:43.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.807+0000 7efddc1ff700 1 -- 172.21.15.37:0/3586648616 >> 172.21.15.37:0/3586648616 conn(0x7efdd406b150 msgr2=0x7efdd415a900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:55:43.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.807+0000 7efddc1ff700 1 -- 172.21.15.37:0/3586648616 shutdown_connections 2023-07-14T15:55:43.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:43.807+0000 7efddc1ff700 1 -- 172.21.15.37:0/3586648616 wait complete. 2023-07-14T15:55:43.812 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-07-14T15:55:43.812 INFO:tasks.ceph:Waiting for OSDs to come up 2023-07-14T15:55:43.824 INFO:tasks.ceph.mgr.x.smithi098.stderr:2023-07-14T15:55:43.837+0000 7fa44c4e4200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T15:55:43.854 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-14T15:55:43.867+0000 7f1d55b07200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T15:55:44.001 INFO:tasks.ceph.mgr.x.smithi098.stderr:2023-07-14T15:55:44.013+0000 7fa44c4e4200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T15:55:44.040 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-14T15:55:44.054+0000 7f1d55b07200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T15:55:44.107 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-07-14T15:55:44.121+0000 7f288f306640 -1 Falling back to public interface 2023-07-14T15:55:44.128 INFO:tasks.ceph.osd.4.smithi098.stderr:2023-07-14T15:55:44.141+0000 7fc9ef917640 -1 Falling back to public interface 2023-07-14T15:55:44.135 INFO:tasks.ceph.osd.6.smithi098.stderr:2023-07-14T15:55:44.148+0000 7fd51613b640 -1 Falling back to public interface 2023-07-14T15:55:44.149 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-14T15:55:44.163+0000 7fd23e4f5640 -1 Falling back to public interface 2023-07-14T15:55:44.150 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-07-14T15:55:44.163+0000 7fe87db00640 -1 Falling back to public interface 2023-07-14T15:55:44.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-14T15:55:44.167+0000 7fae2a897640 -1 Falling back to public interface 2023-07-14T15:55:44.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-14T15:55:44.169+0000 7fae1c7fd700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6820/0: (98) Address already in use 2023-07-14T15:55:44.165 INFO:tasks.ceph.osd.5.smithi098.stderr:2023-07-14T15:55:44.178+0000 7f86f11b6640 -1 Falling back to public interface 2023-07-14T15:55:44.165 INFO:tasks.ceph.osd.7.smithi098.stderr:2023-07-14T15:55:44.178+0000 7fcfee14a640 -1 Falling back to public interface 2023-07-14T15:55:44.165 INFO:tasks.ceph.osd.5.smithi098.stderr:2023-07-14T15:55:44.178+0000 7f86e2ffd700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6816/0: (98) Address already in use 2023-07-14T15:55:44.294 INFO:tasks.ceph.mgr.x.smithi098.stderr:2023-07-14T15:55:44.307+0000 7fa44c4e4200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-14T15:55:44.354 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-14T15:55:44.368+0000 7f1d55b07200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-14T15:55:44.388 INFO:tasks.ceph.mgr.x.smithi098.stderr:2023-07-14T15:55:44.401+0000 7fa44c4e4200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T15:55:44.455 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-14T15:55:44.468+0000 7f1d55b07200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T15:55:44.619 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-14T15:55:44.716 INFO:tasks.ceph.mgr.x.smithi098.stderr:2023-07-14T15:55:44.729+0000 7fa44c4e4200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T15:55:44.793 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-14T15:55:44.806+0000 7f1d55b07200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T15:55:44.798 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.811+0000 7f65ca1ff700 1 Processor -- start 2023-07-14T15:55:44.798 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.812+0000 7f65ca1ff700 1 -- start start 2023-07-14T15:55:44.800 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.813+0000 7f65ca1ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f65c40b85f0 0x7f65c415d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:44.801 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.813+0000 7f65ca1ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f65c40b54b0 0x7f65c40cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:44.801 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.813+0000 7f65ca1ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65c40cf6b0 con 0x7f65c40b4910 2023-07-14T15:55:44.801 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.813+0000 7f65ca1ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65c40cdc40 con 0x7f65c40b54b0 2023-07-14T15:55:44.801 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.813+0000 7f65ca1ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65c415dba0 con 0x7f65c40b85f0 2023-07-14T15:55:44.801 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.813+0000 7f65c2ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f65c40b54b0 0x7f65c40cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:44.801 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.813+0000 7f65c3fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f65c40b4910 0x7f65c40b4d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45930/0 (socket says 172.21.15.37:45930) 2023-07-14T15:55:44.802 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.813+0000 7f65c2ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f65c40b54b0 0x7f65c40cfb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46550/0 (socket says 172.21.15.37:46550) 2023-07-14T15:55:44.802 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.813+0000 7f65c3fff700 1 -- 172.21.15.37:0/3642557347 learned_addr learned my addr 172.21.15.37:0/3642557347 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:55:44.802 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.813+0000 7f65c37fe700 1 --2- 172.21.15.37:0/3642557347 >> v2:172.21.15.98:3300/0 conn(0x7f65c40b85f0 0x7f65c415d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:44.802 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.813+0000 7f65c2ffd700 1 -- 172.21.15.37:0/3642557347 >> v2:172.21.15.98:3300/0 conn(0x7f65c40b85f0 msgr2=0x7f65c415d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:55:44.802 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.813+0000 7f65c2ffd700 1 --2- 172.21.15.37:0/3642557347 >> v2:172.21.15.98:3300/0 conn(0x7f65c40b85f0 0x7f65c415d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:44.802 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.813+0000 7f65c2ffd700 1 -- 172.21.15.37:0/3642557347 >> v1:172.21.15.37:6789/0 conn(0x7f65c40b4910 legacy=0x7f65c40b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:44.802 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.814+0000 7f65c2ffd700 1 -- 172.21.15.37:0/3642557347 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c40cf0a0 con 0x7f65c40b54b0 2023-07-14T15:55:44.803 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.814+0000 7f65c27fc700 1 -- 172.21.15.37:0/3642557347 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2488953971 0 0) 0x7f65c40cf6b0 con 0x7f65c40b4910 2023-07-14T15:55:44.803 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.814+0000 7f65c2ffd700 1 --2- 172.21.15.37:0/3642557347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65c40b54b0 0x7f65c40cfb40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f65c406a110 tx=0x7f65b8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0e799d1e6ac537a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:55:44.803 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.814+0000 7f65c27fc700 1 -- 172.21.15.37:0/3642557347 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b8011830 con 0x7f65c40b54b0 2023-07-14T15:55:44.803 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.814+0000 7f65c27fc700 1 -- 172.21.15.37:0/3642557347 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b8011990 con 0x7f65c40b54b0 2023-07-14T15:55:44.803 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.814+0000 7f65c27fc700 1 -- 172.21.15.37:0/3642557347 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b8011d20 con 0x7f65c40b54b0 2023-07-14T15:55:44.805 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.815+0000 7f65ca1ff700 1 -- 172.21.15.37:0/3642557347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65c40b54b0 msgr2=0x7f65c40cfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:44.805 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.815+0000 7f65ca1ff700 1 --2- 172.21.15.37:0/3642557347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65c40b54b0 0x7f65c40cfb40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f65c406a110 tx=0x7f65b8009b20 comp rx=0 tx=0).stop 2023-07-14T15:55:44.806 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.815+0000 7f65ca1ff700 1 -- 172.21.15.37:0/3642557347 shutdown_connections 2023-07-14T15:55:44.806 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.815+0000 7f65ca1ff700 1 --2- 172.21.15.37:0/3642557347 >> v2:172.21.15.98:3300/0 conn(0x7f65c40b85f0 0x7f65c415d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:44.806 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.815+0000 7f65ca1ff700 1 --2- 172.21.15.37:0/3642557347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65c40b54b0 0x7f65c40cfb40 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:44.806 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.815+0000 7f65ca1ff700 1 -- 172.21.15.37:0/3642557347 >> 172.21.15.37:0/3642557347 conn(0x7f65c406a580 msgr2=0x7f65c406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:55:44.806 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.815+0000 7f65ca1ff700 1 -- 172.21.15.37:0/3642557347 shutdown_connections 2023-07-14T15:55:44.806 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.815+0000 7f65ca1ff700 1 -- 172.21.15.37:0/3642557347 wait complete. 2023-07-14T15:55:44.806 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.817+0000 7f65ca1ff700 1 Processor -- start 2023-07-14T15:55:44.807 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.817+0000 7f65ca1ff700 1 -- start start 2023-07-14T15:55:44.807 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.818+0000 7f65ca1ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65c40b4910 0x7f65c41e60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:44.807 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.818+0000 7f65ca1ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f65c40b54b0 0x7f65c41491e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:44.807 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.818+0000 7f65ca1ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65c40b85f0 0x7f65c41e8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:44.807 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.818+0000 7f65ca1ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c41e9ee0 con 0x7f65c40b4910 2023-07-14T15:55:44.807 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.818+0000 7f65ca1ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c40c92f0 con 0x7f65c40b85f0 2023-07-14T15:55:44.807 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.818+0000 7f65ca1ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65c41e9400 con 0x7f65c40b54b0 2023-07-14T15:55:44.807 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.818+0000 7f65c37fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65c40b4910 0x7f65c41e60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:44.808 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.818+0000 7f65c37fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65c40b4910 0x7f65c41e60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46562/0 (socket says 172.21.15.37:46562) 2023-07-14T15:55:44.808 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.818+0000 7f65c37fe700 1 -- 172.21.15.37:0/393948886 learned_addr learned my addr 172.21.15.37:0/393948886 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:55:44.808 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.818+0000 7f65c3fff700 1 --2- 172.21.15.37:0/393948886 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65c40b85f0 0x7f65c41e8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:44.808 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.818+0000 7f65c2ffd700 1 --2- 172.21.15.37:0/393948886 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f65c40b54b0 0x7f65c41491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:44.808 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.818+0000 7f65c37fe700 1 -- 172.21.15.37:0/393948886 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f65c40b54b0 msgr2=0x7f65c41491e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:44.808 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.818+0000 7f65c37fe700 1 --2- 172.21.15.37:0/393948886 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f65c40b54b0 0x7f65c41491e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:44.808 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.818+0000 7f65c37fe700 1 -- 172.21.15.37:0/393948886 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65c40b85f0 msgr2=0x7f65c41e8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:44.809 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.818+0000 7f65c37fe700 1 --2- 172.21.15.37:0/393948886 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65c40b85f0 0x7f65c41e8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:44.809 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.818+0000 7f65c37fe700 1 -- 172.21.15.37:0/393948886 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b80094a0 con 0x7f65c40b4910 2023-07-14T15:55:44.809 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.819+0000 7f65c37fe700 1 --2- 172.21.15.37:0/393948886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65c40b4910 0x7f65c41e60a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f65b400e870 tx=0x7f65b400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:55:44.809 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.819+0000 7f65abfff700 1 -- 172.21.15.37:0/393948886 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b4009590 con 0x7f65c40b4910 2023-07-14T15:55:44.809 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.819+0000 7f65abfff700 1 -- 172.21.15.37:0/393948886 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b4013680 con 0x7f65c40b4910 2023-07-14T15:55:44.809 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.819+0000 7f65ca1ff700 1 -- 172.21.15.37:0/393948886 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65c41e96e0 con 0x7f65c40b4910 2023-07-14T15:55:44.809 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.819+0000 7f65abfff700 1 -- 172.21.15.37:0/393948886 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b40139f0 con 0x7f65c40b4910 2023-07-14T15:55:44.809 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.819+0000 7f65ca1ff700 1 -- 172.21.15.37:0/393948886 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65c4149720 con 0x7f65c40b4910 2023-07-14T15:55:44.810 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.819+0000 7f65abfff700 1 -- 172.21.15.37:0/393948886 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f65b4005a20 con 0x7f65c40b4910 2023-07-14T15:55:44.810 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.819+0000 7f65abfff700 1 -- 172.21.15.37:0/393948886 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f65b4005cd0 con 0x7f65c40b4910 2023-07-14T15:55:44.810 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.820+0000 7f65ca1ff700 1 -- 172.21.15.37:0/393948886 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65c41e9d30 con 0x7f65c40b4910 2023-07-14T15:55:44.811 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.823+0000 7f65abfff700 1 -- 172.21.15.37:0/393948886 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f65b4021060 con 0x7f65c40b4910 2023-07-14T15:55:44.883 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.897+0000 7f65ca1ff700 1 -- 172.21.15.37:0/393948886 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65c4067840 con 0x7f65c40b4910 2023-07-14T15:55:44.884 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.897+0000 7f65abfff700 1 -- 172.21.15.37:0/393948886 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f65b4029020 con 0x7f65c40b4910 2023-07-14T15:55:44.884 INFO:teuthology.misc.health.smithi037.stdout: 2023-07-14T15:55:44.884 INFO:teuthology.misc.health.smithi037.stdout:{"epoch":10,"fsid":"9da30401-a779-4e46-aba6-00c2494c6c67","created":"2023-07-14T15:55:39.898867+0000","modified":"2023-07-14T15:55:43.388192+0000","last_up_change":"0.000000","last_in_change":"2023-07-14T15:55:43.388192+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0d049535-7b87-4276-8fe5-0f74ba422d5e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"79ec948d-ead2-4c2d-923a-dd6eeaac9dbd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a1db6690-c160-4366-9c82-2cca17e4bba9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"767b8220-e79a-4a86-a162-6b3b73198379","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"717bd773-ae7e-4236-ac79-900cf99a37c5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a941d358-0f03-4136-a9b2-3a1c2e9358cf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"27153772-6d4b-479d-9953-0582e7b96743","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d21ffc8e-40bb-47eb-af2c-e3e730d3fb76","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T15:55:44.885 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.898+0000 7f65ca1ff700 1 -- 172.21.15.37:0/393948886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65c40b4910 msgr2=0x7f65c41e60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:44.885 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.898+0000 7f65ca1ff700 1 --2- 172.21.15.37:0/393948886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65c40b4910 0x7f65c41e60a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f65b400e870 tx=0x7f65b400eb80 comp rx=0 tx=0).stop 2023-07-14T15:55:44.885 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.898+0000 7f65ca1ff700 1 -- 172.21.15.37:0/393948886 shutdown_connections 2023-07-14T15:55:44.886 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.898+0000 7f65ca1ff700 1 --2- 172.21.15.37:0/393948886 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65c40b85f0 0x7f65c41e8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:44.886 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.898+0000 7f65ca1ff700 1 --2- 172.21.15.37:0/393948886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65c40b4910 0x7f65c41e60a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:44.886 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.898+0000 7f65ca1ff700 1 --2- 172.21.15.37:0/393948886 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f65c40b54b0 0x7f65c41491e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:44.886 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.898+0000 7f65ca1ff700 1 -- 172.21.15.37:0/393948886 >> 172.21.15.37:0/393948886 conn(0x7f65c406a580 msgr2=0x7f65c40d14a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:55:44.886 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.898+0000 7f65ca1ff700 1 -- 172.21.15.37:0/393948886 shutdown_connections 2023-07-14T15:55:44.886 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:44.899+0000 7f65ca1ff700 1 -- 172.21.15.37:0/393948886 wait complete. 2023-07-14T15:55:44.900 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-07-14T15:55:44.991 INFO:tasks.ceph.mgr.x.smithi098.stderr:2023-07-14T15:55:45.004+0000 7fa44c4e4200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T15:55:45.083 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-14T15:55:45.097+0000 7f1d55b07200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T15:55:45.189 INFO:tasks.ceph.mgr.x.smithi098.stderr:2023-07-14T15:55:45.202+0000 7fa44c4e4200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T15:55:45.288 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-14T15:55:45.301+0000 7f1d55b07200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T15:55:45.336 INFO:tasks.ceph.mgr.x.smithi098.stderr:2023-07-14T15:55:45.348+0000 7fa44c4e4200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T15:55:45.438 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-14T15:55:45.451+0000 7f1d55b07200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T15:55:45.519 INFO:tasks.ceph.mgr.x.smithi098.stderr:2023-07-14T15:55:45.532+0000 7fa44c4e4200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T15:55:45.633 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-14T15:55:45.647+0000 7f1d55b07200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T15:55:45.848 INFO:tasks.ceph.mgr.x.smithi098.stderr:2023-07-14T15:55:45.860+0000 7fa44c4e4200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T15:55:45.968 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-14T15:55:45.982+0000 7f1d55b07200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T15:55:46.077 INFO:tasks.ceph.mgr.x.smithi098.stderr:2023-07-14T15:55:46.090+0000 7fa44c4e4200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T15:55:46.207 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-14T15:55:46.220+0000 7f1d55b07200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T15:55:46.822 INFO:tasks.ceph.mgr.x.smithi098.stderr:2023-07-14T15:55:46.835+0000 7fa44c4e4200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T15:55:47.045 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-14T15:55:47.059+0000 7f1d55b07200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T15:55:47.691 INFO:tasks.ceph.osd.4.smithi098.stderr:2023-07-14T15:55:47.704+0000 7fc9ef917640 -1 osd.4 0 log_to_monitors true 2023-07-14T15:55:47.701 INFO:tasks.ceph.osd.6.smithi098.stderr:2023-07-14T15:55:47.714+0000 7fd51613b640 -1 osd.6 0 log_to_monitors true 2023-07-14T15:55:47.726 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-14T15:55:47.740+0000 7fae2a897640 -1 osd.1 0 log_to_monitors true 2023-07-14T15:55:47.764 INFO:tasks.ceph.osd.5.smithi098.stderr:2023-07-14T15:55:47.777+0000 7f86f11b6640 -1 osd.5 0 log_to_monitors true 2023-07-14T15:55:47.767 INFO:tasks.ceph.osd.7.smithi098.stderr:2023-07-14T15:55:47.780+0000 7fcfee14a640 -1 osd.7 0 log_to_monitors true 2023-07-14T15:55:47.844 INFO:tasks.ceph.mgr.x.smithi098.stderr:2023-07-14T15:55:47.856+0000 7fa3ffffa700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-07-14T15:55:47.844 INFO:tasks.ceph.mgr.x.smithi098.stderr:2023-07-14T15:55:47.857+0000 7fa3ffffa700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-07-14T15:55:47.934 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-07-14T15:55:47.948+0000 7f288f306640 -1 osd.0 0 log_to_monitors true 2023-07-14T15:55:47.991 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-07-14T15:55:48.005+0000 7fe87db00640 -1 osd.3 0 log_to_monitors true 2023-07-14T15:55:47.996 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-14T15:55:48.010+0000 7fd23e4f5640 -1 osd.2 0 log_to_monitors true 2023-07-14T15:55:49.975 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-14T15:55:49.989+0000 7fae18ff6700 -1 osd.1 0 waiting for initial osdmap 2023-07-14T15:55:49.991 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-14T15:55:50.005+0000 7fae10ffb700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-14T15:55:50.846 INFO:tasks.ceph.osd.6.smithi098.stderr:2023-07-14T15:55:50.859+0000 7fd5047f6700 -1 osd.6 0 waiting for initial osdmap 2023-07-14T15:55:50.869 INFO:tasks.ceph.osd.6.smithi098.stderr:2023-07-14T15:55:50.882+0000 7fd4fc7fb700 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-14T15:55:50.966 INFO:tasks.ceph.osd.5.smithi098.stderr:2023-07-14T15:55:50.979+0000 7f86df7f6700 -1 osd.5 0 waiting for initial osdmap 2023-07-14T15:55:50.977 INFO:tasks.ceph.osd.5.smithi098.stderr:2023-07-14T15:55:50.990+0000 7f86d77fb700 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-14T15:55:51.035 INFO:tasks.ceph.osd.7.smithi098.stderr:2023-07-14T15:55:51.048+0000 7fcfdc7f6700 -1 osd.7 0 waiting for initial osdmap 2023-07-14T15:55:51.057 INFO:tasks.ceph.osd.4.smithi098.stderr:2023-07-14T15:55:51.070+0000 7fc9df7f9700 -1 osd.4 0 waiting for initial osdmap 2023-07-14T15:55:51.058 INFO:tasks.ceph.osd.7.smithi098.stderr:2023-07-14T15:55:51.071+0000 7fcfd47fb700 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-14T15:55:51.074 INFO:tasks.ceph.osd.4.smithi098.stderr:2023-07-14T15:55:51.087+0000 7fc9d5ffb700 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-14T15:55:51.447 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-14T15:55:51.457+0000 7fd22cbf6700 -1 osd.2 0 waiting for initial osdmap 2023-07-14T15:55:51.468 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-14T15:55:51.482+0000 7fd224bfb700 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-14T15:55:51.706 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-14T15:55:51.951 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.964+0000 7f758a3ff700 1 Processor -- start 2023-07-14T15:55:51.951 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.965+0000 7f758a3ff700 1 -- start start 2023-07-14T15:55:51.952 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.966+0000 7f758a3ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f75840b85f0 0x7f758415d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:51.953 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.966+0000 7f758a3ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75840cf6b0 con 0x7f75840b4910 2023-07-14T15:55:51.953 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.966+0000 7f758a3ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75840cdc40 con 0x7f75840b54b0 2023-07-14T15:55:51.953 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.966+0000 7f758a3ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f758415dba0 con 0x7f75840b85f0 2023-07-14T15:55:51.954 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.967+0000 7f7583fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f75840b85f0 0x7f758415d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:51.954 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.967+0000 7f758899c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f75840b4910 0x7f75840b4d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46428/0 (socket says 172.21.15.37:46428) 2023-07-14T15:55:51.955 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.967+0000 7f758899c700 1 -- 172.21.15.37:0/665740328 learned_addr learned my addr 172.21.15.37:0/665740328 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:55:51.955 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.967+0000 7f7583fff700 1 -- 172.21.15.37:0/665740328 >> v1:172.21.15.98:6789/0 conn(0x7f75840b54b0 legacy=0x7f75840cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:51.955 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.967+0000 7f7582ffd700 1 -- 172.21.15.37:0/665740328 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4153425697 0 0) 0x7f75840cdc40 con 0x7f75840b54b0 2023-07-14T15:55:51.956 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.967+0000 7f7583fff700 1 -- 172.21.15.37:0/665740328 >> v1:172.21.15.37:6789/0 conn(0x7f75840b4910 legacy=0x7f75840b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:51.956 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.967+0000 7f7583fff700 1 -- 172.21.15.37:0/665740328 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75840d0250 con 0x7f75840b85f0 2023-07-14T15:55:51.956 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.967+0000 7f7583fff700 1 --2- 172.21.15.37:0/665740328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75840b85f0 0x7f758415d660 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7574009840 tx=0x7f7574009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd39d34ee9dbe4d6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:55:51.957 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.968+0000 7f7582ffd700 1 -- 172.21.15.37:0/665740328 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7574011830 con 0x7f75840b85f0 2023-07-14T15:55:51.957 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.968+0000 7f7582ffd700 1 -- 172.21.15.37:0/665740328 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7574011990 con 0x7f75840b85f0 2023-07-14T15:55:51.957 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.968+0000 7f7582ffd700 1 -- 172.21.15.37:0/665740328 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7574011d20 con 0x7f75840b85f0 2023-07-14T15:55:51.958 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.969+0000 7f758a3ff700 1 -- 172.21.15.37:0/665740328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75840b85f0 msgr2=0x7f758415d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:51.958 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.969+0000 7f758a3ff700 1 --2- 172.21.15.37:0/665740328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75840b85f0 0x7f758415d660 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7574009840 tx=0x7f7574009b50 comp rx=0 tx=0).stop 2023-07-14T15:55:51.959 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.969+0000 7f758a3ff700 1 -- 172.21.15.37:0/665740328 shutdown_connections 2023-07-14T15:55:51.959 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.969+0000 7f758a3ff700 1 --2- 172.21.15.37:0/665740328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75840b85f0 0x7f758415d660 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:51.959 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.969+0000 7f758a3ff700 1 -- 172.21.15.37:0/665740328 >> 172.21.15.37:0/665740328 conn(0x7f758406a580 msgr2=0x7f758406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:55:51.960 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.969+0000 7f758a3ff700 1 -- 172.21.15.37:0/665740328 shutdown_connections 2023-07-14T15:55:51.960 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.969+0000 7f758a3ff700 1 -- 172.21.15.37:0/665740328 wait complete. 2023-07-14T15:55:51.960 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.971+0000 7f758a3ff700 1 Processor -- start 2023-07-14T15:55:51.960 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.972+0000 7f758a3ff700 1 -- start start 2023-07-14T15:55:51.963 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.973+0000 7f758a3ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f75840b4910 0x7f75841f6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:51.963 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.973+0000 7f758a3ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75840b54b0 0x7f75840ca6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:51.964 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.973+0000 7f758a3ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75840b85f0 0x7f7584154660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:51.964 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.973+0000 7f758a3ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75840cac20 con 0x7f75840b85f0 2023-07-14T15:55:51.964 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.973+0000 7f758a3ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75840b2c50 con 0x7f75840b54b0 2023-07-14T15:55:51.964 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.973+0000 7f758a3ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f758415f490 con 0x7f75840b4910 2023-07-14T15:55:51.964 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.973+0000 7f758899c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75840b85f0 0x7f7584154660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:51.964 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.973+0000 7f75837fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75840b54b0 0x7f75840ca6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:51.965 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.973+0000 7f7583fff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f75840b4910 0x7f75841f6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:51.965 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.973+0000 7f758899c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75840b85f0 0x7f7584154660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34712/0 (socket says 172.21.15.37:34712) 2023-07-14T15:55:51.965 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.973+0000 7f758899c700 1 -- 172.21.15.37:0/983961109 learned_addr learned my addr 172.21.15.37:0/983961109 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:55:51.965 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.974+0000 7f758899c700 1 -- 172.21.15.37:0/983961109 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f75840b4910 msgr2=0x7f75841f6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:51.965 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.974+0000 7f758899c700 1 --2- 172.21.15.37:0/983961109 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f75840b4910 0x7f75841f6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:51.965 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.974+0000 7f758899c700 1 -- 172.21.15.37:0/983961109 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75840b54b0 msgr2=0x7f75840ca6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:51.965 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.974+0000 7f758899c700 1 --2- 172.21.15.37:0/983961109 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75840b54b0 0x7f75840ca6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:51.966 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.974+0000 7f758899c700 1 -- 172.21.15.37:0/983961109 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75740094a0 con 0x7f75840b85f0 2023-07-14T15:55:51.966 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.974+0000 7f7583fff700 1 --2- 172.21.15.37:0/983961109 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f75840b4910 0x7f75841f6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:55:51.966 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.974+0000 7f758899c700 1 --2- 172.21.15.37:0/983961109 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75840b85f0 0x7f7584154660 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f757c00cb10 tx=0x7f757c00ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:55:51.966 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.974+0000 7f7580ff9700 1 -- 172.21.15.37:0/983961109 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757c00a9e0 con 0x7f75840b85f0 2023-07-14T15:55:51.966 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.974+0000 7f7580ff9700 1 -- 172.21.15.37:0/983961109 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757c00ab40 con 0x7f75840b85f0 2023-07-14T15:55:51.966 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.974+0000 7f7580ff9700 1 -- 172.21.15.37:0/983961109 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757c012400 con 0x7f75840b85f0 2023-07-14T15:55:51.966 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.974+0000 7f758a3ff700 1 -- 172.21.15.37:0/983961109 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7584154ba0 con 0x7f75840b85f0 2023-07-14T15:55:51.966 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.975+0000 7f758a3ff700 1 -- 172.21.15.37:0/983961109 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75840cb130 con 0x7f75840b85f0 2023-07-14T15:55:51.967 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.976+0000 7f758a3ff700 1 -- 172.21.15.37:0/983961109 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75840ccdc0 con 0x7f75840b85f0 2023-07-14T15:55:51.967 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.978+0000 7f7580ff9700 1 -- 172.21.15.37:0/983961109 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f757c01b3b0 con 0x7f75840b85f0 2023-07-14T15:55:51.967 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.978+0000 7f7580ff9700 1 --2- 172.21.15.37:0/983961109 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f757006ac50 0x7f757006d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:51.968 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.979+0000 7f7580ff9700 1 -- 172.21.15.37:0/983961109 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2791+0+0 (secure 0 0 0) 0x7f757c0882e0 con 0x7f75840b85f0 2023-07-14T15:55:51.968 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.979+0000 7f7583fff700 1 --2- 172.21.15.37:0/983961109 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f757006ac50 0x7f757006d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:51.968 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.980+0000 7f7583fff700 1 --2- 172.21.15.37:0/983961109 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f757006ac50 0x7f757006d100 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f75740090b0 tx=0x7f757401c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:55:51.975 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:51.989+0000 7f7580ff9700 1 -- 172.21.15.37:0/983961109 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f75840ccdc0 con 0x7f75840b85f0 2023-07-14T15:55:52.009 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-07-14T15:55:52.023+0000 7f287d9f6700 -1 osd.0 0 waiting for initial osdmap 2023-07-14T15:55:52.022 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-07-14T15:55:52.036+0000 7f28759fb700 -1 osd.0 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-14T15:55:52.262 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:52.276+0000 7f758a3ff700 1 -- 172.21.15.37:0/983961109 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75840ccdc0 con 0x7f75840b85f0 2023-07-14T15:55:52.263 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:52.277+0000 7f7580ff9700 1 -- 172.21.15.37:0/983961109 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+9970 (secure 0 0 0) 0x7f75840ccdc0 con 0x7f75840b85f0 2023-07-14T15:55:52.263 INFO:teuthology.misc.health.smithi037.stdout: 2023-07-14T15:55:52.263 INFO:teuthology.misc.health.smithi037.stdout:{"epoch":15,"fsid":"9da30401-a779-4e46-aba6-00c2494c6c67","created":"2023-07-14T15:55:39.898867+0000","modified":"2023-07-14T15:55:52.004504+0000","last_up_change":"2023-07-14T15:55:52.004504+0000","last_in_change":"2023-07-14T15:55:43.388192+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0d049535-7b87-4276-8fe5-0f74ba422d5e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"79ec948d-ead2-4c2d-923a-dd6eeaac9dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6823","nonce":1190059746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6826","nonce":1190059746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6831","nonce":1190059746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6829","nonce":1190059746}]},"public_addr":"172.21.15.37:6823/1190059746","cluster_addr":"172.21.15.37:6826/1190059746","heartbeat_back_addr":"172.21.15.37:6831/1190059746","heartbeat_front_addr":"172.21.15.37:6829/1190059746","state":["exists","up"]},{"osd":2,"uuid":"a1db6690-c160-4366-9c82-2cca17e4bba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6809","nonce":2266223499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6813","nonce":2266223499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6820","nonce":2266223499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6816","nonce":2266223499}]},"public_addr":"172.21.15.37:6809/2266223499","cluster_addr":"172.21.15.37:6813/2266223499","heartbeat_back_addr":"172.21.15.37:6820/2266223499","heartbeat_front_addr":"172.21.15.37:6816/2266223499","state":["exists","up"]},{"osd":3,"uuid":"767b8220-e79a-4a86-a162-6b3b73198379","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"717bd773-ae7e-4236-ac79-900cf99a37c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6801","nonce":3529020407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6803","nonce":3529020407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6807","nonce":3529020407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6805","nonce":3529020407}]},"public_addr":"172.21.15.98:6801/3529020407","cluster_addr":"172.21.15.98:6803/3529020407","heartbeat_back_addr":"172.21.15.98:6807/3529020407","heartbeat_front_addr":"172.21.15.98:6805/3529020407","state":["exists","up"]},{"osd":5,"uuid":"a941d358-0f03-4136-a9b2-3a1c2e9358cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6817","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6819","nonce":2311501838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6821","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6823","nonce":2311501838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6829","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6831","nonce":2311501838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6825","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6827","nonce":2311501838}]},"public_addr":"172.21.15.98:6819/2311501838","cluster_addr":"172.21.15.98:6823/2311501838","heartbeat_back_addr":"172.21.15.98:6831/2311501838","heartbeat_front_addr":"172.21.15.98:6827/2311501838","state":["exists","up"]},{"osd":6,"uuid":"27153772-6d4b-479d-9953-0582e7b96743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6809","nonce":1144224691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6811","nonce":1144224691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6815","nonce":1144224691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6813","nonce":1144224691}]},"public_addr":"172.21.15.98:6809/1144224691","cluster_addr":"172.21.15.98:6811/1144224691","heartbeat_back_addr":"172.21.15.98:6815/1144224691","heartbeat_front_addr":"172.21.15.98:6813/1144224691","state":["exists","up"]},{"osd":7,"uuid":"d21ffc8e-40bb-47eb-af2c-e3e730d3fb76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6818","nonce":1144470927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6822","nonce":1144470927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6830","nonce":1144470927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6826","nonce":1144470927}]},"public_addr":"172.21.15.98:6818/1144470927","cluster_addr":"172.21.15.98:6822/1144470927","heartbeat_back_addr":"172.21.15.98:6830/1144470927","heartbeat_front_addr":"172.21.15.98:6826/1144470927","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.739210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.709351+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T15:55:52.266 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:52.279+0000 7f758a3ff700 1 -- 172.21.15.37:0/983961109 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f757006ac50 msgr2=0x7f757006d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:52.266 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:52.279+0000 7f758a3ff700 1 --2- 172.21.15.37:0/983961109 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f757006ac50 0x7f757006d100 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f75740090b0 tx=0x7f757401c040 comp rx=0 tx=0).stop 2023-07-14T15:55:52.266 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:52.279+0000 7f758a3ff700 1 -- 172.21.15.37:0/983961109 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75840b85f0 msgr2=0x7f7584154660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:52.266 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:52.279+0000 7f758a3ff700 1 --2- 172.21.15.37:0/983961109 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75840b85f0 0x7f7584154660 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f757c00cb10 tx=0x7f757c00ce20 comp rx=0 tx=0).stop 2023-07-14T15:55:52.267 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:52.279+0000 7f758a3ff700 1 -- 172.21.15.37:0/983961109 shutdown_connections 2023-07-14T15:55:52.267 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:52.279+0000 7f758a3ff700 1 --2- 172.21.15.37:0/983961109 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f757006ac50 0x7f757006d100 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:52.267 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:52.279+0000 7f758a3ff700 1 --2- 172.21.15.37:0/983961109 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75840b85f0 0x7f7584154660 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:52.267 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:52.279+0000 7f758a3ff700 1 --2- 172.21.15.37:0/983961109 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f75840b4910 0x7f75841f6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:52.267 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:52.279+0000 7f758a3ff700 1 --2- 172.21.15.37:0/983961109 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75840b54b0 0x7f75840ca6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:52.267 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:52.279+0000 7f758a3ff700 1 -- 172.21.15.37:0/983961109 >> 172.21.15.37:0/983961109 conn(0x7f758406a580 msgr2=0x7f75840d0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:55:52.267 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:52.280+0000 7f758a3ff700 1 -- 172.21.15.37:0/983961109 shutdown_connections 2023-07-14T15:55:52.267 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:52.280+0000 7f758a3ff700 1 -- 172.21.15.37:0/983961109 wait complete. 2023-07-14T15:55:52.285 DEBUG:teuthology.misc:6 of 8 OSDs are up 2023-07-14T15:55:52.424 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-07-14T15:55:52.438+0000 7fe86c1f6700 -1 osd.3 0 waiting for initial osdmap 2023-07-14T15:55:52.447 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-07-14T15:55:52.461+0000 7fe8641fb700 -1 osd.3 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-14T15:55:58.226 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T15:55:58.232 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T15:55:59.090 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-14T15:55:59.276 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.289+0000 7fa0963ff700 1 Processor -- start 2023-07-14T15:55:59.276 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.289+0000 7fa0963ff700 1 -- start start 2023-07-14T15:55:59.277 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.291+0000 7fa0963ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa0900b85f0 0x7fa09015d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:59.277 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.291+0000 7fa0963ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0900cf6b0 con 0x7fa0900b4910 2023-07-14T15:55:59.277 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.291+0000 7fa0963ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0900cdc40 con 0x7fa0900b54b0 2023-07-14T15:55:59.277 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.291+0000 7fa0963ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa09015dba0 con 0x7fa0900b85f0 2023-07-14T15:55:59.279 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.291+0000 7fa09499c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa0900b4910 0x7fa0900b4d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46430/0 (socket says 172.21.15.37:46430) 2023-07-14T15:55:59.279 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.291+0000 7fa09499c700 1 -- 172.21.15.37:0/1406651389 learned_addr learned my addr 172.21.15.37:0/1406651389 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:55:59.279 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.291+0000 7fa08ffff700 1 --2- 172.21.15.37:0/1406651389 >> v2:172.21.15.98:3300/0 conn(0x7fa0900b85f0 0x7fa09015d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:59.280 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.291+0000 7fa08effd700 1 -- 172.21.15.37:0/1406651389 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3375908054 0 0) 0x7fa0900cf6b0 con 0x7fa0900b4910 2023-07-14T15:55:59.280 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.291+0000 7fa08effd700 1 -- 172.21.15.37:0/1406651389 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0780035b0 con 0x7fa0900b4910 2023-07-14T15:55:59.280 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.292+0000 7fa08effd700 1 -- 172.21.15.37:0/1406651389 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1537867621 0 0) 0x7fa0900cdc40 con 0x7fa0900b54b0 2023-07-14T15:55:59.280 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.292+0000 7fa08effd700 1 -- 172.21.15.37:0/1406651389 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0900cf6b0 con 0x7fa0900b54b0 2023-07-14T15:55:59.280 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.292+0000 7fa08effd700 1 -- 172.21.15.37:0/1406651389 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4158108175 0 0) 0x7fa0780035b0 con 0x7fa0900b4910 2023-07-14T15:55:59.280 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.292+0000 7fa08effd700 1 -- 172.21.15.37:0/1406651389 >> v2:172.21.15.98:3300/0 conn(0x7fa0900b85f0 msgr2=0x7fa09015d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:55:59.281 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.292+0000 7fa08effd700 1 --2- 172.21.15.37:0/1406651389 >> v2:172.21.15.98:3300/0 conn(0x7fa0900b85f0 0x7fa09015d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:59.281 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.292+0000 7fa08effd700 1 -- 172.21.15.37:0/1406651389 >> v1:172.21.15.98:6789/0 conn(0x7fa0900b54b0 legacy=0x7fa0900cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:59.281 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.292+0000 7fa08effd700 1 -- 172.21.15.37:0/1406651389 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0900d0250 con 0x7fa0900b4910 2023-07-14T15:55:59.281 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.292+0000 7fa08effd700 1 -- 172.21.15.37:0/1406651389 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48633207 0 0) 0x7fa0880019f0 con 0x7fa0900b4910 2023-07-14T15:55:59.281 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.292+0000 7fa08effd700 1 -- 172.21.15.37:0/1406651389 >> v1:172.21.15.37:6789/0 conn(0x7fa0900b4910 legacy=0x7fa0900b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:59.281 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.292+0000 7fa08effd700 1 --2- 172.21.15.37:0/1406651389 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa078003be0 0x7fa078003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:59.281 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.292+0000 7fa08effd700 1 --2- 172.21.15.37:0/1406651389 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa078004850 0x7fa078004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:59.281 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.292+0000 7fa08effd700 1 --2- 172.21.15.37:0/1406651389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa078005250 0x7fa07800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:59.282 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.292+0000 7fa08effd700 1 -- 172.21.15.37:0/1406651389 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09015dba0 con 0x7fa078005250 2023-07-14T15:55:59.282 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.292+0000 7fa08effd700 1 -- 172.21.15.37:0/1406651389 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07800c160 con 0x7fa078004850 2023-07-14T15:55:59.282 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.292+0000 7fa08effd700 1 -- 172.21.15.37:0/1406651389 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa07800c320 con 0x7fa078003be0 2023-07-14T15:55:59.282 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.292+0000 7fa09499c700 1 --2- 172.21.15.37:0/1406651389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa078005250 0x7fa07800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:59.282 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.292+0000 7fa08ffff700 1 --2- 172.21.15.37:0/1406651389 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa078003be0 0x7fa078003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:59.282 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.292+0000 7fa08f7fe700 1 --2- 172.21.15.37:0/1406651389 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa078004850 0x7fa078004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:59.282 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.293+0000 7fa09499c700 1 -- 172.21.15.37:0/1406651389 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa078003be0 msgr2=0x7fa078003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:55:59.283 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.293+0000 7fa09499c700 1 --2- 172.21.15.37:0/1406651389 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa078003be0 0x7fa078003fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:59.283 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.293+0000 7fa09499c700 1 -- 172.21.15.37:0/1406651389 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa078004850 msgr2=0x7fa078004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:55:59.283 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.293+0000 7fa09499c700 1 --2- 172.21.15.37:0/1406651389 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa078004850 0x7fa078004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:59.283 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.293+0000 7fa09499c700 1 -- 172.21.15.37:0/1406651389 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0780035b0 con 0x7fa078005250 2023-07-14T15:55:59.283 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.293+0000 7fa09499c700 1 -- 172.21.15.37:0/1406651389 reap_dead start 2023-07-14T15:55:59.283 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.293+0000 7fa09499c700 1 --2- 172.21.15.37:0/1406651389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa078005250 0x7fa07800ba10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa088002230 tx=0x7fa078005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39ea67d130e2f5c4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:55:59.283 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.293+0000 7fa08effd700 1 -- 172.21.15.37:0/1406651389 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0880072d0 con 0x7fa078005250 2023-07-14T15:55:59.284 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.293+0000 7fa08effd700 1 -- 172.21.15.37:0/1406651389 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa088007430 con 0x7fa078005250 2023-07-14T15:55:59.284 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.293+0000 7fa08effd700 1 -- 172.21.15.37:0/1406651389 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0880077e0 con 0x7fa078005250 2023-07-14T15:55:59.286 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.294+0000 7fa0963ff700 1 -- 172.21.15.37:0/1406651389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa078005250 msgr2=0x7fa07800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:59.286 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.294+0000 7fa0963ff700 1 --2- 172.21.15.37:0/1406651389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa078005250 0x7fa07800ba10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa088002230 tx=0x7fa078005880 comp rx=0 tx=0).stop 2023-07-14T15:55:59.286 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.294+0000 7fa0963ff700 1 -- 172.21.15.37:0/1406651389 shutdown_connections 2023-07-14T15:55:59.286 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.294+0000 7fa0963ff700 1 --2- 172.21.15.37:0/1406651389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa078005250 0x7fa07800ba10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:59.286 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.294+0000 7fa0963ff700 1 -- 172.21.15.37:0/1406651389 >> 172.21.15.37:0/1406651389 conn(0x7fa09006a580 msgr2=0x7fa09006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:55:59.286 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.294+0000 7fa0963ff700 1 -- 172.21.15.37:0/1406651389 shutdown_connections 2023-07-14T15:55:59.286 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.294+0000 7fa0963ff700 1 -- 172.21.15.37:0/1406651389 wait complete. 2023-07-14T15:55:59.287 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.296+0000 7fa0963ff700 1 Processor -- start 2023-07-14T15:55:59.287 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.296+0000 7fa0963ff700 1 -- start start 2023-07-14T15:55:59.287 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.297+0000 7fa0963ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa078005250 0x7fa090157a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:59.287 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.297+0000 7fa0963ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa09014d2b0 0x7fa0900cc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:59.287 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.297+0000 7fa0963ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa0900c7340 0x7fa0900c77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:59.287 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.297+0000 7fa0963ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0900c7cf0 con 0x7fa078005250 2023-07-14T15:55:59.287 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.297+0000 7fa0963ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0901f2400 con 0x7fa09014d2b0 2023-07-14T15:55:59.288 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.297+0000 7fa0963ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0900ccbe0 con 0x7fa0900c7340 2023-07-14T15:55:59.288 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.297+0000 7fa08ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa078005250 0x7fa090157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:59.288 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.297+0000 7fa08ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa078005250 0x7fa090157a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34728/0 (socket says 172.21.15.37:34728) 2023-07-14T15:55:59.288 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.297+0000 7fa08ffff700 1 -- 172.21.15.37:0/1433136496 learned_addr learned my addr 172.21.15.37:0/1433136496 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:55:59.288 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.297+0000 7fa09499c700 1 --2- 172.21.15.37:0/1433136496 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa0900c7340 0x7fa0900c77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:59.288 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.297+0000 7fa08f7fe700 1 --2- 172.21.15.37:0/1433136496 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa09014d2b0 0x7fa0900cc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:59.288 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.297+0000 7fa08ffff700 1 -- 172.21.15.37:0/1433136496 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa0900c7340 msgr2=0x7fa0900c77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:59.289 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.297+0000 7fa08ffff700 1 --2- 172.21.15.37:0/1433136496 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa0900c7340 0x7fa0900c77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:59.289 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.297+0000 7fa08ffff700 1 -- 172.21.15.37:0/1433136496 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa09014d2b0 msgr2=0x7fa0900cc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:59.289 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.297+0000 7fa08ffff700 1 --2- 172.21.15.37:0/1433136496 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa09014d2b0 0x7fa0900cc0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:59.289 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.297+0000 7fa08ffff700 1 -- 172.21.15.37:0/1433136496 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0900cc900 con 0x7fa078005250 2023-07-14T15:55:59.289 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.298+0000 7fa08ffff700 1 --2- 172.21.15.37:0/1433136496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa078005250 0x7fa090157a80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa0800119a0 tx=0x7fa080011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:55:59.289 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.298+0000 7fa08cff9700 1 -- 172.21.15.37:0/1433136496 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08000f940 con 0x7fa078005250 2023-07-14T15:55:59.289 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.298+0000 7fa08cff9700 1 -- 172.21.15.37:0/1433136496 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08000faa0 con 0x7fa078005250 2023-07-14T15:55:59.289 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.298+0000 7fa08cff9700 1 -- 172.21.15.37:0/1433136496 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08000fe30 con 0x7fa078005250 2023-07-14T15:55:59.290 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.298+0000 7fa0963ff700 1 -- 172.21.15.37:0/1433136496 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa09015ee80 con 0x7fa078005250 2023-07-14T15:55:59.290 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.298+0000 7fa0963ff700 1 -- 172.21.15.37:0/1433136496 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa09015f440 con 0x7fa078005250 2023-07-14T15:55:59.290 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.299+0000 7fa0963ff700 1 -- 172.21.15.37:0/1433136496 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa09015f660 con 0x7fa078005250 2023-07-14T15:55:59.291 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.300+0000 7fa08cff9700 1 -- 172.21.15.37:0/1433136496 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa080014440 con 0x7fa078005250 2023-07-14T15:55:59.291 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.301+0000 7fa08cff9700 1 --2- 172.21.15.37:0/1433136496 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa07c06ad10 0x7fa07c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:59.291 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.301+0000 7fa08cff9700 1 -- 172.21.15.37:0/1433136496 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa0800897c0 con 0x7fa078005250 2023-07-14T15:55:59.291 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.302+0000 7fa08f7fe700 1 --2- 172.21.15.37:0/1433136496 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa07c06ad10 0x7fa07c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:59.291 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.302+0000 7fa08f7fe700 1 --2- 172.21.15.37:0/1433136496 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa07c06ad10 0x7fa07c06d1c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa0900d0bb0 tx=0x7fa084009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:55:59.292 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.306+0000 7fa08cff9700 1 -- 172.21.15.37:0/1433136496 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa080058680 con 0x7fa078005250 2023-07-14T15:55:59.500 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.514+0000 7fa0963ff700 1 -- 172.21.15.37:0/1433136496 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa090067840 con 0x7fa078005250 2023-07-14T15:55:59.501 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.515+0000 7fa08cff9700 1 -- 172.21.15.37:0/1433136496 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12814 (secure 0 0 0) 0x7fa080022020 con 0x7fa078005250 2023-07-14T15:55:59.501 INFO:teuthology.misc.health.smithi037.stdout: 2023-07-14T15:55:59.501 INFO:teuthology.misc.health.smithi037.stdout:{"epoch":18,"fsid":"9da30401-a779-4e46-aba6-00c2494c6c67","created":"2023-07-14T15:55:39.898867+0000","modified":"2023-07-14T15:55:55.030428+0000","last_up_change":"2023-07-14T15:55:53.025696+0000","last_in_change":"2023-07-14T15:55:43.388192+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T15:55:52.907261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d049535-7b87-4276-8fe5-0f74ba422d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6801","nonce":2783032392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6803","nonce":2783032392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6807","nonce":2783032392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6805","nonce":2783032392}]},"public_addr":"172.21.15.37:6801/2783032392","cluster_addr":"172.21.15.37:6803/2783032392","heartbeat_back_addr":"172.21.15.37:6807/2783032392","heartbeat_front_addr":"172.21.15.37:6805/2783032392","state":["exists","up"]},{"osd":1,"uuid":"79ec948d-ead2-4c2d-923a-dd6eeaac9dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6823","nonce":1190059746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6826","nonce":1190059746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6831","nonce":1190059746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6829","nonce":1190059746}]},"public_addr":"172.21.15.37:6823/1190059746","cluster_addr":"172.21.15.37:6826/1190059746","heartbeat_back_addr":"172.21.15.37:6831/1190059746","heartbeat_front_addr":"172.21.15.37:6829/1190059746","state":["exists","up"]},{"osd":2,"uuid":"a1db6690-c160-4366-9c82-2cca17e4bba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6809","nonce":2266223499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6813","nonce":2266223499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6820","nonce":2266223499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6816","nonce":2266223499}]},"public_addr":"172.21.15.37:6809/2266223499","cluster_addr":"172.21.15.37:6813/2266223499","heartbeat_back_addr":"172.21.15.37:6820/2266223499","heartbeat_front_addr":"172.21.15.37:6816/2266223499","state":["exists","up"]},{"osd":3,"uuid":"767b8220-e79a-4a86-a162-6b3b73198379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6812","nonce":4166694594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6817","nonce":4166694594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6828","nonce":4166694594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6822","nonce":4166694594}]},"public_addr":"172.21.15.37:6812/4166694594","cluster_addr":"172.21.15.37:6817/4166694594","heartbeat_back_addr":"172.21.15.37:6828/4166694594","heartbeat_front_addr":"172.21.15.37:6822/4166694594","state":["exists","up"]},{"osd":4,"uuid":"717bd773-ae7e-4236-ac79-900cf99a37c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6801","nonce":3529020407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6803","nonce":3529020407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6807","nonce":3529020407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6805","nonce":3529020407}]},"public_addr":"172.21.15.98:6801/3529020407","cluster_addr":"172.21.15.98:6803/3529020407","heartbeat_back_addr":"172.21.15.98:6807/3529020407","heartbeat_front_addr":"172.21.15.98:6805/3529020407","state":["exists","up"]},{"osd":5,"uuid":"a941d358-0f03-4136-a9b2-3a1c2e9358cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6817","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6819","nonce":2311501838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6821","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6823","nonce":2311501838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6829","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6831","nonce":2311501838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6825","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6827","nonce":2311501838}]},"public_addr":"172.21.15.98:6819/2311501838","cluster_addr":"172.21.15.98:6823/2311501838","heartbeat_back_addr":"172.21.15.98:6831/2311501838","heartbeat_front_addr":"172.21.15.98:6827/2311501838","state":["exists","up"]},{"osd":6,"uuid":"27153772-6d4b-479d-9953-0582e7b96743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6809","nonce":1144224691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6811","nonce":1144224691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6815","nonce":1144224691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6813","nonce":1144224691}]},"public_addr":"172.21.15.98:6809/1144224691","cluster_addr":"172.21.15.98:6811/1144224691","heartbeat_back_addr":"172.21.15.98:6815/1144224691","heartbeat_front_addr":"172.21.15.98:6813/1144224691","state":["exists","up"]},{"osd":7,"uuid":"d21ffc8e-40bb-47eb-af2c-e3e730d3fb76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6818","nonce":1144470927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6822","nonce":1144470927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6830","nonce":1144470927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6826","nonce":1144470927}]},"public_addr":"172.21.15.98:6818/1144470927","cluster_addr":"172.21.15.98:6822/1144470927","heartbeat_back_addr":"172.21.15.98:6830/1144470927","heartbeat_front_addr":"172.21.15.98:6826/1144470927","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.921114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.739210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.024016+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.002527+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.698127+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.813416+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.709351+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.815457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T15:55:59.503 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.517+0000 7fa0963ff700 1 -- 172.21.15.37:0/1433136496 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa07c06ad10 msgr2=0x7fa07c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:59.503 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.517+0000 7fa0963ff700 1 --2- 172.21.15.37:0/1433136496 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa07c06ad10 0x7fa07c06d1c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa0900d0bb0 tx=0x7fa084009040 comp rx=0 tx=0).stop 2023-07-14T15:55:59.504 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.517+0000 7fa0963ff700 1 -- 172.21.15.37:0/1433136496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa078005250 msgr2=0x7fa090157a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:59.504 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.517+0000 7fa0963ff700 1 --2- 172.21.15.37:0/1433136496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa078005250 0x7fa090157a80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa0800119a0 tx=0x7fa080011d60 comp rx=0 tx=0).stop 2023-07-14T15:55:59.504 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.517+0000 7fa0963ff700 1 -- 172.21.15.37:0/1433136496 shutdown_connections 2023-07-14T15:55:59.504 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.517+0000 7fa0963ff700 1 --2- 172.21.15.37:0/1433136496 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa07c06ad10 0x7fa07c06d1c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:59.504 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.517+0000 7fa0963ff700 1 --2- 172.21.15.37:0/1433136496 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa0900c7340 0x7fa0900c77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:59.504 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.517+0000 7fa0963ff700 1 --2- 172.21.15.37:0/1433136496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa078005250 0x7fa090157a80 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:59.504 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.517+0000 7fa0963ff700 1 --2- 172.21.15.37:0/1433136496 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa09014d2b0 0x7fa0900cc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:59.505 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.517+0000 7fa0963ff700 1 -- 172.21.15.37:0/1433136496 >> 172.21.15.37:0/1433136496 conn(0x7fa09006a580 msgr2=0x7fa0900b7580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:55:59.505 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.517+0000 7fa0963ff700 1 -- 172.21.15.37:0/1433136496 shutdown_connections 2023-07-14T15:55:59.505 INFO:teuthology.misc.health.smithi037.stderr:2023-07-14T15:55:59.517+0000 7fa0963ff700 1 -- 172.21.15.37:0/1433136496 wait complete. 2023-07-14T15:55:59.519 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-07-14T15:55:59.519 INFO:tasks.ceph:Creating RBD pool 2023-07-14T15:55:59.520 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd pool create rbd 8 2023-07-14T15:55:59.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.729+0000 7fd1fb7ff700 1 Processor -- start 2023-07-14T15:55:59.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.729+0000 7fd1fb7ff700 1 -- start start 2023-07-14T15:55:59.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.731+0000 7fd1fb7ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd1f40b1e80 0x7fd1f40d2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:59.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.731+0000 7fd1fb7ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd1f40b0ac0 0x7fd1f40b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:59.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.731+0000 7fd1fb7ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1f40b1840 con 0x7fd1f40cfd50 2023-07-14T15:55:59.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.731+0000 7fd1fb7ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1f415ccf0 con 0x7fd1f40b1e80 2023-07-14T15:55:59.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.731+0000 7fd1fb7ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f40b2550 con 0x7fd1f40b0ac0 2023-07-14T15:55:59.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.731+0000 7fd1f8d9a700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd1f40b1e80 0x7fd1f40d2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:59.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.731+0000 7fd1f9d9c700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd1f40b0ac0 0x7fd1f40b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:59.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.731+0000 7fd1f8d9a700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd1f40b1e80 0x7fd1f40d2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.37:33414/0 (socket says 172.21.15.37:33414) 2023-07-14T15:55:59.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.731+0000 7fd1f8d9a700 1 -- 172.21.15.37:0/1966712703 learned_addr learned my addr 172.21.15.37:0/1966712703 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:55:59.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.732+0000 7fd1f8d9a700 1 -- 172.21.15.37:0/1966712703 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd1f40b0ac0 msgr2=0x7fd1f40b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:55:59.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.732+0000 7fd1f8d9a700 1 --2- 172.21.15.37:0/1966712703 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd1f40b0ac0 0x7fd1f40b0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:59.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.732+0000 7fd1f8d9a700 1 -- 172.21.15.37:0/1966712703 >> v1:172.21.15.98:6789/0 conn(0x7fd1f40cfd50 legacy=0x7fd1f40b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:59.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.732+0000 7fd1f8d9a700 1 -- 172.21.15.37:0/1966712703 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f40b2830 con 0x7fd1f40b1e80 2023-07-14T15:55:59.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.732+0000 7fd1f9d9c700 1 --2- 172.21.15.37:0/1966712703 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd1f40b0ac0 0x7fd1f40b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:55:59.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.732+0000 7fd1ebfff700 1 -- 172.21.15.37:0/1966712703 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 892559745 0 0) 0x7fd1f40b1840 con 0x7fd1f40cfd50 2023-07-14T15:55:59.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.732+0000 7fd1f8d9a700 1 --2- 172.21.15.37:0/1966712703 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1f40b1e80 0x7fd1f40d2880 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd1e40098f0 tx=0x7fd1e4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec5e60e61ee17913 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:55:59.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.732+0000 7fd1ebfff700 1 -- 172.21.15.37:0/1966712703 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e4011830 con 0x7fd1f40b1e80 2023-07-14T15:55:59.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.732+0000 7fd1ebfff700 1 -- 172.21.15.37:0/1966712703 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e4011990 con 0x7fd1f40b1e80 2023-07-14T15:55:59.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.732+0000 7fd1ebfff700 1 -- 172.21.15.37:0/1966712703 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e4011d20 con 0x7fd1f40b1e80 2023-07-14T15:55:59.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.733+0000 7fd1fb7ff700 1 -- 172.21.15.37:0/1966712703 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1f40b1e80 msgr2=0x7fd1f40d2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:59.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.733+0000 7fd1fb7ff700 1 --2- 172.21.15.37:0/1966712703 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1f40b1e80 0x7fd1f40d2880 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd1e40098f0 tx=0x7fd1e4009c00 comp rx=0 tx=0).stop 2023-07-14T15:55:59.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.733+0000 7fd1fb7ff700 1 -- 172.21.15.37:0/1966712703 shutdown_connections 2023-07-14T15:55:59.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.733+0000 7fd1fb7ff700 1 --2- 172.21.15.37:0/1966712703 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd1f40b0ac0 0x7fd1f40b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:59.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.733+0000 7fd1fb7ff700 1 --2- 172.21.15.37:0/1966712703 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1f40b1e80 0x7fd1f40d2880 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:59.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.733+0000 7fd1fb7ff700 1 -- 172.21.15.37:0/1966712703 >> 172.21.15.37:0/1966712703 conn(0x7fd1f409c1c0 msgr2=0x7fd1f40d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:55:59.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.733+0000 7fd1fb7ff700 1 -- 172.21.15.37:0/1966712703 shutdown_connections 2023-07-14T15:55:59.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.733+0000 7fd1fb7ff700 1 -- 172.21.15.37:0/1966712703 wait complete. 2023-07-14T15:55:59.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.735+0000 7fd1fb7ff700 1 Processor -- start 2023-07-14T15:55:59.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.735+0000 7fd1fb7ff700 1 -- start start 2023-07-14T15:55:59.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.737+0000 7fd1fb7ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd1f40b0ac0 0x7fd1f4158f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:59.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.737+0000 7fd1fb7ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1f40b1e80 0x7fd1f415a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:59.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.737+0000 7fd1fb7ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1f40cfd50 0x7fd1f40b3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:59.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.737+0000 7fd1fb7ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f41597e0 con 0x7fd1f40b1e80 2023-07-14T15:55:59.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.737+0000 7fd1fb7ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f415a320 con 0x7fd1f40cfd50 2023-07-14T15:55:59.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.737+0000 7fd1fb7ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f41599f0 con 0x7fd1f40b0ac0 2023-07-14T15:55:59.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.737+0000 7fd1f8d9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1f40b1e80 0x7fd1f415a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:59.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.737+0000 7fd1f8d9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1f40b1e80 0x7fd1f415a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34732/0 (socket says 172.21.15.37:34732) 2023-07-14T15:55:59.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.737+0000 7fd1f8d9a700 1 -- 172.21.15.37:0/1312371057 learned_addr learned my addr 172.21.15.37:0/1312371057 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:55:59.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.737+0000 7fd1f9d9c700 1 --2- 172.21.15.37:0/1312371057 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1f40cfd50 0x7fd1f40b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:59.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.737+0000 7fd1f959b700 1 --2- 172.21.15.37:0/1312371057 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd1f40b0ac0 0x7fd1f4158f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:59.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.737+0000 7fd1f8d9a700 1 -- 172.21.15.37:0/1312371057 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd1f40b0ac0 msgr2=0x7fd1f4158f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:59.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.737+0000 7fd1f8d9a700 1 --2- 172.21.15.37:0/1312371057 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd1f40b0ac0 0x7fd1f4158f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:59.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.737+0000 7fd1f8d9a700 1 -- 172.21.15.37:0/1312371057 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1f40cfd50 msgr2=0x7fd1f40b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:55:59.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.737+0000 7fd1f8d9a700 1 --2- 172.21.15.37:0/1312371057 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1f40cfd50 0x7fd1f40b3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:55:59.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.738+0000 7fd1f8d9a700 1 -- 172.21.15.37:0/1312371057 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ec009a70 con 0x7fd1f40b1e80 2023-07-14T15:55:59.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.738+0000 7fd1f8d9a700 1 --2- 172.21.15.37:0/1312371057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1f40b1e80 0x7fd1f415a7b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd1e4013000 tx=0x7fd1e4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:55:59.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.738+0000 7fd1e9ffb700 1 -- 172.21.15.37:0/1312371057 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e40042c0 con 0x7fd1f40b1e80 2023-07-14T15:55:59.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.738+0000 7fd1e9ffb700 1 -- 172.21.15.37:0/1312371057 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e401f070 con 0x7fd1f40b1e80 2023-07-14T15:55:59.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.738+0000 7fd1fb7ff700 1 -- 172.21.15.37:0/1312371057 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1e4009550 con 0x7fd1f40b1e80 2023-07-14T15:55:59.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.738+0000 7fd1e9ffb700 1 -- 172.21.15.37:0/1312371057 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e40036a0 con 0x7fd1f40b1e80 2023-07-14T15:55:59.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.738+0000 7fd1fb7ff700 1 -- 172.21.15.37:0/1312371057 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1f4159fb0 con 0x7fd1f40b1e80 2023-07-14T15:55:59.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.739+0000 7fd1fb7ff700 1 -- 172.21.15.37:0/1312371057 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1f415a4b0 con 0x7fd1f40b1e80 2023-07-14T15:55:59.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.740+0000 7fd1e9ffb700 1 -- 172.21.15.37:0/1312371057 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd1e4021030 con 0x7fd1f40b1e80 2023-07-14T15:55:59.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.741+0000 7fd1e9ffb700 1 --2- 172.21.15.37:0/1312371057 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd1d806ace0 0x7fd1d806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:55:59.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.741+0000 7fd1e9ffb700 1 -- 172.21.15.37:0/1312371057 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd1e408a450 con 0x7fd1f40b1e80 2023-07-14T15:55:59.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.742+0000 7fd1f959b700 1 --2- 172.21.15.37:0/1312371057 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd1d806ace0 0x7fd1d806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:55:59.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.742+0000 7fd1f959b700 1 --2- 172.21.15.37:0/1312371057 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd1d806ace0 0x7fd1d806d190 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd1f0000f60 tx=0x7fd1f0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:55:59.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.746+0000 7fd1e9ffb700 1 -- 172.21.15.37:0/1312371057 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd1e4055ac0 con 0x7fd1f40b1e80 2023-07-14T15:55:59.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:55:59.953+0000 7fd1fb7ff700 1 -- 172.21.15.37:0/1312371057 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fd1f4067840 con 0x7fd1f40b1e80 2023-07-14T15:56:00.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:00.914+0000 7fd1e9ffb700 1 -- 172.21.15.37:0/1312371057 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v19) v1 ==== 109+0+0 (secure 0 0 0) 0x7fd1e40590e0 con 0x7fd1f40b1e80 2023-07-14T15:56:00.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:00.918+0000 7fd1fb7ff700 1 -- 172.21.15.37:0/1312371057 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd1d806ace0 msgr2=0x7fd1d806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:00.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:00.918+0000 7fd1fb7ff700 1 --2- 172.21.15.37:0/1312371057 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd1d806ace0 0x7fd1d806d190 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd1f0000f60 tx=0x7fd1f0009040 comp rx=0 tx=0).stop 2023-07-14T15:56:00.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:00.918+0000 7fd1fb7ff700 1 -- 172.21.15.37:0/1312371057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1f40b1e80 msgr2=0x7fd1f415a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:00.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:00.918+0000 7fd1fb7ff700 1 --2- 172.21.15.37:0/1312371057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1f40b1e80 0x7fd1f415a7b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd1e4013000 tx=0x7fd1e4004750 comp rx=0 tx=0).stop 2023-07-14T15:56:00.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:00.918+0000 7fd1fb7ff700 1 -- 172.21.15.37:0/1312371057 shutdown_connections 2023-07-14T15:56:00.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:00.918+0000 7fd1fb7ff700 1 --2- 172.21.15.37:0/1312371057 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1f40cfd50 0x7fd1f40b3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:00.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:00.918+0000 7fd1fb7ff700 1 --2- 172.21.15.37:0/1312371057 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd1d806ace0 0x7fd1d806d190 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:00.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:00.918+0000 7fd1fb7ff700 1 --2- 172.21.15.37:0/1312371057 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd1f40b0ac0 0x7fd1f4158f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:00.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:00.918+0000 7fd1fb7ff700 1 --2- 172.21.15.37:0/1312371057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1f40b1e80 0x7fd1f415a7b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:00.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:00.918+0000 7fd1fb7ff700 1 -- 172.21.15.37:0/1312371057 >> 172.21.15.37:0/1312371057 conn(0x7fd1f409c1c0 msgr2=0x7fd1f406a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:00.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:00.918+0000 7fd1fb7ff700 1 -- 172.21.15.37:0/1312371057 shutdown_connections 2023-07-14T15:56:00.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:00.918+0000 7fd1fb7ff700 1 -- 172.21.15.37:0/1312371057 wait complete. 2023-07-14T15:56:00.907 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'rbd' created 2023-07-14T15:56:00.927 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-07-14T15:56:01.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.143+0000 7f449a3ff700 1 Processor -- start 2023-07-14T15:56:01.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.143+0000 7f449a3ff700 1 -- start start 2023-07-14T15:56:01.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.144+0000 7f449a3ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f44941462d0 0x7f44940cd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:01.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.144+0000 7f449a3ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f44940cf780 0x7f44940cfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:01.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.144+0000 7f449a3ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44940d0120 con 0x7f44940d2310 2023-07-14T15:56:01.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.144+0000 7f449a3ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44940d1270 con 0x7f44941462d0 2023-07-14T15:56:01.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.144+0000 7f449a3ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44940d1550 con 0x7f44940cf780 2023-07-14T15:56:01.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.144+0000 7f44937fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f44940d2310 0x7f44940d09d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50468/0 (socket says 172.21.15.37:50468) 2023-07-14T15:56:01.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.144+0000 7f44937fe700 1 -- 172.21.15.37:0/4025087896 learned_addr learned my addr 172.21.15.37:0/4025087896 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:01.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.145+0000 7f449899c700 1 --2- 172.21.15.37:0/4025087896 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f44940cf780 0x7f44940cfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:01.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.145+0000 7f4493fff700 1 --2- 172.21.15.37:0/4025087896 >> v2:172.21.15.98:3300/0 conn(0x7f44941462d0 0x7f44940cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:01.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.145+0000 7f4492ffd700 1 -- 172.21.15.37:0/4025087896 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2495676991 0 0) 0x7f44940d0120 con 0x7f44940d2310 2023-07-14T15:56:01.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.145+0000 7f4492ffd700 1 -- 172.21.15.37:0/4025087896 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f447c0035b0 con 0x7f44940d2310 2023-07-14T15:56:01.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.145+0000 7f4492ffd700 1 -- 172.21.15.37:0/4025087896 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 795184181 0 0) 0x7f447c0035b0 con 0x7f44940d2310 2023-07-14T15:56:01.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.145+0000 7f4492ffd700 1 -- 172.21.15.37:0/4025087896 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f44940cf780 msgr2=0x7f44940cfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:01.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.145+0000 7f4492ffd700 1 --2- 172.21.15.37:0/4025087896 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f44940cf780 0x7f44940cfbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:01.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.145+0000 7f4492ffd700 1 -- 172.21.15.37:0/4025087896 >> v2:172.21.15.98:3300/0 conn(0x7f44941462d0 msgr2=0x7f44940cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:01.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.145+0000 7f4492ffd700 1 --2- 172.21.15.37:0/4025087896 >> v2:172.21.15.98:3300/0 conn(0x7f44941462d0 0x7f44940cd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:01.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.145+0000 7f4492ffd700 1 -- 172.21.15.37:0/4025087896 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44940d1830 con 0x7f44940d2310 2023-07-14T15:56:01.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.145+0000 7f4492ffd700 1 -- 172.21.15.37:0/4025087896 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48633207 0 0) 0x7f4488001670 con 0x7f44940d2310 2023-07-14T15:56:01.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.145+0000 7f4492ffd700 1 -- 172.21.15.37:0/4025087896 >> v1:172.21.15.37:6789/0 conn(0x7f44940d2310 legacy=0x7f44940d09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:01.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.145+0000 7f4492ffd700 1 --2- 172.21.15.37:0/4025087896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f447c003a00 0x7f447c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:01.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.145+0000 7f4492ffd700 1 --2- 172.21.15.37:0/4025087896 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f447c004430 0x7f447c0048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:01.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.145+0000 7f4492ffd700 1 --2- 172.21.15.37:0/4025087896 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f44940cf780 0x7f447c004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:01.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.145+0000 7f4492ffd700 1 -- 172.21.15.37:0/4025087896 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44940d1270 con 0x7f447c003a00 2023-07-14T15:56:01.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.145+0000 7f4492ffd700 1 -- 172.21.15.37:0/4025087896 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44940d1550 con 0x7f447c004430 2023-07-14T15:56:01.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.145+0000 7f4492ffd700 1 -- 172.21.15.37:0/4025087896 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f447c00ba10 con 0x7f44940cf780 2023-07-14T15:56:01.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.146+0000 7f4493fff700 1 --2- 172.21.15.37:0/4025087896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f447c003a00 0x7f447c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:01.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.146+0000 7f44937fe700 1 --2- 172.21.15.37:0/4025087896 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f447c004430 0x7f447c0048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:01.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.146+0000 7f449899c700 1 --2- 172.21.15.37:0/4025087896 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f44940cf780 0x7f447c004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:01.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.146+0000 7f4493fff700 1 -- 172.21.15.37:0/4025087896 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f44940cf780 msgr2=0x7f447c004fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:01.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.146+0000 7f4493fff700 1 --2- 172.21.15.37:0/4025087896 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f44940cf780 0x7f447c004fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:01.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.146+0000 7f4493fff700 1 -- 172.21.15.37:0/4025087896 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f447c004430 msgr2=0x7f447c0048f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:01.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.146+0000 7f4493fff700 1 --2- 172.21.15.37:0/4025087896 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f447c004430 0x7f447c0048f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:01.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.146+0000 7f4493fff700 1 -- 172.21.15.37:0/4025087896 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f447c0035b0 con 0x7f447c003a00 2023-07-14T15:56:01.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.146+0000 7f4493fff700 1 --2- 172.21.15.37:0/4025087896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f447c003a00 0x7f447c003e10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4484009b60 tx=0x7f447c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb8f09e7e96d62a4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:01.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.146+0000 7f4492ffd700 1 -- 172.21.15.37:0/4025087896 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448400e6c0 con 0x7f447c003a00 2023-07-14T15:56:01.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.147+0000 7f4492ffd700 1 -- 172.21.15.37:0/4025087896 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f448400e820 con 0x7f447c003a00 2023-07-14T15:56:01.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.147+0000 7f4492ffd700 1 -- 172.21.15.37:0/4025087896 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448400eb90 con 0x7f447c003a00 2023-07-14T15:56:01.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.147+0000 7f449a3ff700 1 -- 172.21.15.37:0/4025087896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f447c003a00 msgr2=0x7f447c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:01.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.147+0000 7f449a3ff700 1 --2- 172.21.15.37:0/4025087896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f447c003a00 0x7f447c003e10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4484009b60 tx=0x7f447c005880 comp rx=0 tx=0).stop 2023-07-14T15:56:01.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.147+0000 7f449899c700 1 -- 172.21.15.37:0/4025087896 reap_dead start 2023-07-14T15:56:01.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.147+0000 7f449a3ff700 1 -- 172.21.15.37:0/4025087896 shutdown_connections 2023-07-14T15:56:01.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.147+0000 7f449a3ff700 1 -- 172.21.15.37:0/4025087896 >> 172.21.15.37:0/4025087896 conn(0x7f449406a4d0 msgr2=0x7f449406a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:01.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.147+0000 7f449a3ff700 1 -- 172.21.15.37:0/4025087896 shutdown_connections 2023-07-14T15:56:01.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.147+0000 7f449a3ff700 1 -- 172.21.15.37:0/4025087896 wait complete. 2023-07-14T15:56:01.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.149+0000 7f449a3ff700 1 Processor -- start 2023-07-14T15:56:01.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.149+0000 7f449a3ff700 1 -- start start 2023-07-14T15:56:01.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.150+0000 7f449a3ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f447c003a00 0x7f44941536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:01.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.150+0000 7f449a3ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4494153dd0 0x7f4494154240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:01.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.150+0000 7f449a3ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f449415af20 0x7f449415b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:01.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.150+0000 7f449a3ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449415b900 con 0x7f449415af20 2023-07-14T15:56:01.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.150+0000 7f449a3ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44940c75c0 con 0x7f4494153dd0 2023-07-14T15:56:01.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.150+0000 7f449a3ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4494153c00 con 0x7f447c003a00 2023-07-14T15:56:01.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.150+0000 7f449899c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f449415af20 0x7f449415b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:01.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.150+0000 7f449899c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f449415af20 0x7f449415b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47570/0 (socket says 172.21.15.37:47570) 2023-07-14T15:56:01.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.150+0000 7f449899c700 1 -- 172.21.15.37:0/3072454770 learned_addr learned my addr 172.21.15.37:0/3072454770 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:01.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.151+0000 7f4493fff700 1 --2- 172.21.15.37:0/3072454770 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f447c003a00 0x7f44941536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:01.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.151+0000 7f44937fe700 1 --2- 172.21.15.37:0/3072454770 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4494153dd0 0x7f4494154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:01.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.151+0000 7f449899c700 1 -- 172.21.15.37:0/3072454770 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f447c003a00 msgr2=0x7f44941536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:01.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.151+0000 7f449899c700 1 --2- 172.21.15.37:0/3072454770 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f447c003a00 0x7f44941536c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:01.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.151+0000 7f449899c700 1 -- 172.21.15.37:0/3072454770 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4494153dd0 msgr2=0x7f4494154240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:01.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.151+0000 7f449899c700 1 --2- 172.21.15.37:0/3072454770 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4494153dd0 0x7f4494154240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:01.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.151+0000 7f449899c700 1 -- 172.21.15.37:0/3072454770 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44940c7ce0 con 0x7f449415af20 2023-07-14T15:56:01.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.151+0000 7f449899c700 1 --2- 172.21.15.37:0/3072454770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f449415af20 0x7f449415b3c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f449406b040 tx=0x7f448c011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:01.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.151+0000 7f4490ff9700 1 -- 172.21.15.37:0/3072454770 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448c00e040 con 0x7f449415af20 2023-07-14T15:56:01.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.151+0000 7f4490ff9700 1 -- 172.21.15.37:0/3072454770 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f448c00f040 con 0x7f449415af20 2023-07-14T15:56:01.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.151+0000 7f4490ff9700 1 -- 172.21.15.37:0/3072454770 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448c00fc70 con 0x7f449415af20 2023-07-14T15:56:01.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.151+0000 7f449a3ff700 1 -- 172.21.15.37:0/3072454770 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44940c69b0 con 0x7f449415af20 2023-07-14T15:56:01.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.151+0000 7f449a3ff700 1 -- 172.21.15.37:0/3072454770 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44940c6f70 con 0x7f449415af20 2023-07-14T15:56:01.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.152+0000 7f449a3ff700 1 -- 172.21.15.37:0/3072454770 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44940c7770 con 0x7f449415af20 2023-07-14T15:56:01.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.153+0000 7f4490ff9700 1 -- 172.21.15.37:0/3072454770 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f448c022460 con 0x7f449415af20 2023-07-14T15:56:01.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.154+0000 7f4490ff9700 1 --2- 172.21.15.37:0/3072454770 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f448006ace0 0x7f448006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:01.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.154+0000 7f4490ff9700 1 -- 172.21.15.37:0/3072454770 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f448c0895e0 con 0x7f449415af20 2023-07-14T15:56:01.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.155+0000 7f4493fff700 1 --2- 172.21.15.37:0/3072454770 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f448006ace0 0x7f448006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:01.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.155+0000 7f4493fff700 1 --2- 172.21.15.37:0/3072454770 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f448006ace0 0x7f448006d190 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f44840090b0 tx=0x7f448401f040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:01.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.159+0000 7f4490ff9700 1 -- 172.21.15.37:0/3072454770 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f44940c7770 con 0x7f449415af20 2023-07-14T15:56:01.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.367+0000 7f449a3ff700 1 -- 172.21.15.37:0/3072454770 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f44940c7770 con 0x7f449415af20 2023-07-14T15:56:01.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.917+0000 7f4490ff9700 1 -- 172.21.15.37:0/3072454770 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v20) v1 ==== 173+0+0 (secure 0 0 0) 0x7f44940c7770 con 0x7f449415af20 2023-07-14T15:56:01.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.921+0000 7f449a3ff700 1 -- 172.21.15.37:0/3072454770 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f448006ace0 msgr2=0x7f448006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:01.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.921+0000 7f449a3ff700 1 --2- 172.21.15.37:0/3072454770 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f448006ace0 0x7f448006d190 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f44840090b0 tx=0x7f448401f040 comp rx=0 tx=0).stop 2023-07-14T15:56:01.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.921+0000 7f449a3ff700 1 -- 172.21.15.37:0/3072454770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f449415af20 msgr2=0x7f449415b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:01.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.921+0000 7f449a3ff700 1 --2- 172.21.15.37:0/3072454770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f449415af20 0x7f449415b3c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f449406b040 tx=0x7f448c011ed0 comp rx=0 tx=0).stop 2023-07-14T15:56:01.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.921+0000 7f449a3ff700 1 -- 172.21.15.37:0/3072454770 shutdown_connections 2023-07-14T15:56:01.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.921+0000 7f449a3ff700 1 --2- 172.21.15.37:0/3072454770 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f448006ace0 0x7f448006d190 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:01.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.921+0000 7f449a3ff700 1 --2- 172.21.15.37:0/3072454770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f449415af20 0x7f449415b3c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:01.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.921+0000 7f449a3ff700 1 --2- 172.21.15.37:0/3072454770 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f447c003a00 0x7f44941536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:01.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.921+0000 7f449a3ff700 1 --2- 172.21.15.37:0/3072454770 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4494153dd0 0x7f4494154240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:01.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.921+0000 7f449a3ff700 1 -- 172.21.15.37:0/3072454770 >> 172.21.15.37:0/3072454770 conn(0x7f449406a4d0 msgr2=0x7f449415f410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:01.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.921+0000 7f449a3ff700 1 -- 172.21.15.37:0/3072454770 shutdown_connections 2023-07-14T15:56:01.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:01.921+0000 7f449a3ff700 1 -- 172.21.15.37:0/3072454770 wait complete. 2023-07-14T15:56:01.910 INFO:teuthology.orchestra.run.smithi037.stderr:enabled application 'rbd' on pool 'rbd' 2023-07-14T15:56:01.929 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-07-14T15:56:01.929 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-14T15:56:01.929 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-14T15:56:01.934 INFO:tasks.ceph.mds.a:Started 2023-07-14T15:56:01.934 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-14T15:56:01.935 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-14T15:56:01.939 INFO:tasks.ceph.mds.c:Started 2023-07-14T15:56:01.939 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-14T15:56:01.939 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-14T15:56:01.944 INFO:tasks.ceph.mds.b:Started 2023-07-14T15:56:01.944 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-14T15:56:01.944 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-14T15:56:01.949 INFO:tasks.ceph.mds.d:Started 2023-07-14T15:56:01.949 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-07-14T15:56:01.949 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T15:56:02.093 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2023-07-14T15:56:02.093 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-07-14T15:56:02.097 INFO:tasks.ceph.mds.b.smithi098.stdout:starting mds.b at 2023-07-14T15:56:02.099 INFO:tasks.ceph.mds.d.smithi098.stdout:starting mds.d at 2023-07-14T15:56:02.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.180+0000 7f3c67dff700 1 Processor -- start 2023-07-14T15:56:02.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.180+0000 7f3c67dff700 1 -- start start 2023-07-14T15:56:02.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.181+0000 7f3c67dff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3c600b85f0 0x7f3c6015d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:02.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.181+0000 7f3c67dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3c600b54b0 0x7f3c600cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:02.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.181+0000 7f3c67dff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c600cf6b0 con 0x7f3c600b4910 2023-07-14T15:56:02.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.181+0000 7f3c67dff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c600cdc40 con 0x7f3c600b85f0 2023-07-14T15:56:02.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.181+0000 7f3c67dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6015dba0 con 0x7f3c600b54b0 2023-07-14T15:56:02.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.181+0000 7f3c6539a700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3c600b54b0 0x7f3c600cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:02.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.181+0000 7f3c65b9b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3c600b85f0 0x7f3c6015d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:02.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.181+0000 7f3c6539a700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3c600b54b0 0x7f3c600cfb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3301/0 says I am v2:172.21.15.37:41462/0 (socket says 172.21.15.37:41462) 2023-07-14T15:56:02.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.181+0000 7f3c6539a700 1 -- 172.21.15.37:0/4217570441 learned_addr learned my addr 172.21.15.37:0/4217570441 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:02.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.182+0000 7f3c6539a700 1 -- 172.21.15.37:0/4217570441 >> v2:172.21.15.98:3300/0 conn(0x7f3c600b85f0 msgr2=0x7f3c6015d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:02.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.182+0000 7f3c6539a700 1 --2- 172.21.15.37:0/4217570441 >> v2:172.21.15.98:3300/0 conn(0x7f3c600b85f0 0x7f3c6015d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:02.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.182+0000 7f3c64b99700 1 -- 172.21.15.37:0/4217570441 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1302789019 0 0) 0x7f3c600cf6b0 con 0x7f3c600b4910 2023-07-14T15:56:02.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.182+0000 7f3c6539a700 1 -- 172.21.15.37:0/4217570441 >> v1:172.21.15.98:6789/0 conn(0x7f3c600b4910 legacy=0x7f3c6015dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:02.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.182+0000 7f3c6539a700 1 -- 172.21.15.37:0/4217570441 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c600cf0a0 con 0x7f3c600b54b0 2023-07-14T15:56:02.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.182+0000 7f3c65b9b700 1 --2- 172.21.15.37:0/4217570441 >> v2:172.21.15.98:3300/0 conn(0x7f3c600b85f0 0x7f3c6015d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:56:02.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.182+0000 7f3c6539a700 1 --2- 172.21.15.37:0/4217570441 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3c600b54b0 0x7f3c600cfb40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3c500098f0 tx=0x7f3c50009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e2951e2bcd9e9be server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:02.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.182+0000 7f3c64b99700 1 -- 172.21.15.37:0/4217570441 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c50011830 con 0x7f3c600b54b0 2023-07-14T15:56:02.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.182+0000 7f3c64b99700 1 -- 172.21.15.37:0/4217570441 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c50011990 con 0x7f3c600b54b0 2023-07-14T15:56:02.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.182+0000 7f3c64b99700 1 -- 172.21.15.37:0/4217570441 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c50011d20 con 0x7f3c600b54b0 2023-07-14T15:56:02.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.183+0000 7f3c67dff700 1 -- 172.21.15.37:0/4217570441 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3c600b54b0 msgr2=0x7f3c600cfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:02.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.183+0000 7f3c67dff700 1 --2- 172.21.15.37:0/4217570441 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3c600b54b0 0x7f3c600cfb40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3c500098f0 tx=0x7f3c50009c00 comp rx=0 tx=0).stop 2023-07-14T15:56:02.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.183+0000 7f3c67dff700 1 -- 172.21.15.37:0/4217570441 shutdown_connections 2023-07-14T15:56:02.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.183+0000 7f3c67dff700 1 --2- 172.21.15.37:0/4217570441 >> v2:172.21.15.98:3300/0 conn(0x7f3c600b85f0 0x7f3c6015d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:02.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.183+0000 7f3c67dff700 1 --2- 172.21.15.37:0/4217570441 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3c600b54b0 0x7f3c600cfb40 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:02.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.183+0000 7f3c67dff700 1 -- 172.21.15.37:0/4217570441 >> 172.21.15.37:0/4217570441 conn(0x7f3c6006a580 msgr2=0x7f3c6006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:02.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.183+0000 7f3c67dff700 1 -- 172.21.15.37:0/4217570441 shutdown_connections 2023-07-14T15:56:02.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.183+0000 7f3c67dff700 1 -- 172.21.15.37:0/4217570441 wait complete. 2023-07-14T15:56:02.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.185+0000 7f3c67dff700 1 Processor -- start 2023-07-14T15:56:02.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.185+0000 7f3c67dff700 1 -- start start 2023-07-14T15:56:02.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.186+0000 7f3c67dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3c600b4910 0x7f3c600b4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:02.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.186+0000 7f3c67dff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c600b54b0 0x7f3c60159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:02.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.186+0000 7f3c67dff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c600b85f0 0x7f3c6015a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:02.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.186+0000 7f3c67dff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c600c7550 con 0x7f3c600b54b0 2023-07-14T15:56:02.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.186+0000 7f3c67dff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c600c69a0 con 0x7f3c600b85f0 2023-07-14T15:56:02.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.186+0000 7f3c67dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c600c6bb0 con 0x7f3c600b4910 2023-07-14T15:56:02.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.186+0000 7f3c6539a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c600b54b0 0x7f3c60159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:02.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.186+0000 7f3c65b9b700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3c600b4910 0x7f3c600b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:02.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.186+0000 7f3c65b9b700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3c600b4910 0x7f3c600b4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3301/0 says I am v2:172.21.15.37:41472/0 (socket says 172.21.15.37:41472) 2023-07-14T15:56:02.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.186+0000 7f3c65b9b700 1 -- 172.21.15.37:0/3999405314 learned_addr learned my addr 172.21.15.37:0/3999405314 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:02.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.186+0000 7f3c6539a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c600b54b0 0x7f3c60159e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47626/0 (socket says 172.21.15.37:47626) 2023-07-14T15:56:02.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.186+0000 7f3c6639c700 1 --2- 172.21.15.37:0/3999405314 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c600b85f0 0x7f3c6015a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:02.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.186+0000 7f3c65b9b700 1 -- 172.21.15.37:0/3999405314 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c600b85f0 msgr2=0x7f3c6015a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:02.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.186+0000 7f3c65b9b700 1 --2- 172.21.15.37:0/3999405314 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c600b85f0 0x7f3c6015a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:02.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.186+0000 7f3c65b9b700 1 -- 172.21.15.37:0/3999405314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c600b54b0 msgr2=0x7f3c60159e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:02.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.186+0000 7f3c65b9b700 1 --2- 172.21.15.37:0/3999405314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c600b54b0 0x7f3c60159e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:02.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.186+0000 7f3c65b9b700 1 -- 172.21.15.37:0/3999405314 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c5c0094a0 con 0x7f3c600b4910 2023-07-14T15:56:02.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.186+0000 7f3c6539a700 1 --2- 172.21.15.37:0/3999405314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c600b54b0 0x7f3c60159e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:56:02.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.187+0000 7f3c65b9b700 1 --2- 172.21.15.37:0/3999405314 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3c600b4910 0x7f3c600b4120 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c00ebe0 tx=0x7f3c5c00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:02.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.187+0000 7f3c567fc700 1 -- 172.21.15.37:0/3999405314 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c009760 con 0x7f3c600b4910 2023-07-14T15:56:02.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.187+0000 7f3c567fc700 1 -- 172.21.15.37:0/3999405314 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c5c00c850 con 0x7f3c600b4910 2023-07-14T15:56:02.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.187+0000 7f3c67dff700 1 -- 172.21.15.37:0/3999405314 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c50009550 con 0x7f3c600b4910 2023-07-14T15:56:02.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.187+0000 7f3c567fc700 1 -- 172.21.15.37:0/3999405314 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c00cbe0 con 0x7f3c600b4910 2023-07-14T15:56:02.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.187+0000 7f3c67dff700 1 -- 172.21.15.37:0/3999405314 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c600c7170 con 0x7f3c600b4910 2023-07-14T15:56:02.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.188+0000 7f3c67dff700 1 -- 172.21.15.37:0/3999405314 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c600c7690 con 0x7f3c600b4910 2023-07-14T15:56:02.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.189+0000 7f3c567fc700 1 -- 172.21.15.37:0/3999405314 <== mon.2 v2:172.21.15.98:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3c5c00cd40 con 0x7f3c600b4910 2023-07-14T15:56:02.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.190+0000 7f3c567fc700 1 --2- 172.21.15.37:0/3999405314 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f3c4406ace0 0x7f3c4406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:02.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.190+0000 7f3c567fc700 1 -- 172.21.15.37:0/3999405314 <== mon.2 v2:172.21.15.98:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3c5c089180 con 0x7f3c600b4910 2023-07-14T15:56:02.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.190+0000 7f3c6539a700 1 --2- 172.21.15.37:0/3999405314 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f3c4406ace0 0x7f3c4406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:02.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.191+0000 7f3c6539a700 1 --2- 172.21.15.37:0/3999405314 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f3c4406ace0 0x7f3c4406d190 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3c50009130 tx=0x7f3c50008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:02.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.196+0000 7f3c567fc700 1 -- 172.21.15.37:0/3999405314 <== mon.2 v2:172.21.15.98:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3c5c054570 con 0x7f3c600b4910 2023-07-14T15:56:02.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.406+0000 7f3c67dff700 1 -- 172.21.15.37:0/3999405314 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c600c6cf0 con 0x7f3c600b4910 2023-07-14T15:56:02.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.407+0000 7f3c567fc700 1 -- 172.21.15.37:0/3999405314 <== mon.2 v2:172.21.15.98:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+14639 (secure 0 0 0) 0x7f3c600c6cf0 con 0x7f3c600b4910 2023-07-14T15:56:02.394 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:56:02.394 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"9da30401-a779-4e46-aba6-00c2494c6c67","created":"2023-07-14T15:55:39.898867+0000","modified":"2023-07-14T15:56:01.912926+0000","last_up_change":"2023-07-14T15:55:53.025696+0000","last_in_change":"2023-07-14T15:55:43.388192+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T15:55:52.907261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T15:55:59.992839+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d049535-7b87-4276-8fe5-0f74ba422d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6801","nonce":2783032392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6803","nonce":2783032392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6807","nonce":2783032392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6805","nonce":2783032392}]},"public_addr":"172.21.15.37:6801/2783032392","cluster_addr":"172.21.15.37:6803/2783032392","heartbeat_back_addr":"172.21.15.37:6807/2783032392","heartbeat_front_addr":"172.21.15.37:6805/2783032392","state":["exists","up"]},{"osd":1,"uuid":"79ec948d-ead2-4c2d-923a-dd6eeaac9dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6823","nonce":1190059746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6826","nonce":1190059746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6831","nonce":1190059746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6829","nonce":1190059746}]},"public_addr":"172.21.15.37:6823/1190059746","cluster_addr":"172.21.15.37:6826/1190059746","heartbeat_back_addr":"172.21.15.37:6831/1190059746","heartbeat_front_addr":"172.21.15.37:6829/1190059746","state":["exists","up"]},{"osd":2,"uuid":"a1db6690-c160-4366-9c82-2cca17e4bba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6809","nonce":2266223499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6813","nonce":2266223499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6820","nonce":2266223499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6816","nonce":2266223499}]},"public_addr":"172.21.15.37:6809/2266223499","cluster_addr":"172.21.15.37:6813/2266223499","heartbeat_back_addr":"172.21.15.37:6820/2266223499","heartbeat_front_addr":"172.21.15.37:6816/2266223499","state":["exists","up"]},{"osd":3,"uuid":"767b8220-e79a-4a86-a162-6b3b73198379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6812","nonce":4166694594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6817","nonce":4166694594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6828","nonce":4166694594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6822","nonce":4166694594}]},"public_addr":"172.21.15.37:6812/4166694594","cluster_addr":"172.21.15.37:6817/4166694594","heartbeat_back_addr":"172.21.15.37:6828/4166694594","heartbeat_front_addr":"172.21.15.37:6822/4166694594","state":["exists","up"]},{"osd":4,"uuid":"717bd773-ae7e-4236-ac79-900cf99a37c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6801","nonce":3529020407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6803","nonce":3529020407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6807","nonce":3529020407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6805","nonce":3529020407}]},"public_addr":"172.21.15.98:6801/3529020407","cluster_addr":"172.21.15.98:6803/3529020407","heartbeat_back_addr":"172.21.15.98:6807/3529020407","heartbeat_front_addr":"172.21.15.98:6805/3529020407","state":["exists","up"]},{"osd":5,"uuid":"a941d358-0f03-4136-a9b2-3a1c2e9358cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6817","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6819","nonce":2311501838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6821","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6823","nonce":2311501838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6829","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6831","nonce":2311501838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6825","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6827","nonce":2311501838}]},"public_addr":"172.21.15.98:6819/2311501838","cluster_addr":"172.21.15.98:6823/2311501838","heartbeat_back_addr":"172.21.15.98:6831/2311501838","heartbeat_front_addr":"172.21.15.98:6827/2311501838","state":["exists","up"]},{"osd":6,"uuid":"27153772-6d4b-479d-9953-0582e7b96743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6809","nonce":1144224691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6811","nonce":1144224691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6815","nonce":1144224691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6813","nonce":1144224691}]},"public_addr":"172.21.15.98:6809/1144224691","cluster_addr":"172.21.15.98:6811/1144224691","heartbeat_back_addr":"172.21.15.98:6815/1144224691","heartbeat_front_addr":"172.21.15.98:6813/1144224691","state":["exists","up"]},{"osd":7,"uuid":"d21ffc8e-40bb-47eb-af2c-e3e730d3fb76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6818","nonce":1144470927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6822","nonce":1144470927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6830","nonce":1144470927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6826","nonce":1144470927}]},"public_addr":"172.21.15.98:6818/1144470927","cluster_addr":"172.21.15.98:6822/1144470927","heartbeat_back_addr":"172.21.15.98:6830/1144470927","heartbeat_front_addr":"172.21.15.98:6826/1144470927","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.921114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.739210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.024016+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.002527+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.698127+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.813416+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.709351+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.815457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T15:56:02.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.410+0000 7f3c67dff700 1 -- 172.21.15.37:0/3999405314 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f3c4406ace0 msgr2=0x7f3c4406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:02.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.410+0000 7f3c67dff700 1 --2- 172.21.15.37:0/3999405314 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f3c4406ace0 0x7f3c4406d190 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3c50009130 tx=0x7f3c50008030 comp rx=0 tx=0).stop 2023-07-14T15:56:02.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.410+0000 7f3c67dff700 1 -- 172.21.15.37:0/3999405314 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3c600b4910 msgr2=0x7f3c600b4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:02.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.410+0000 7f3c67dff700 1 --2- 172.21.15.37:0/3999405314 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3c600b4910 0x7f3c600b4120 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c00ebe0 tx=0x7f3c5c00eef0 comp rx=0 tx=0).stop 2023-07-14T15:56:02.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.410+0000 7f3c67dff700 1 -- 172.21.15.37:0/3999405314 shutdown_connections 2023-07-14T15:56:02.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.410+0000 7f3c67dff700 1 --2- 172.21.15.37:0/3999405314 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c600b85f0 0x7f3c6015a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:02.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.410+0000 7f3c67dff700 1 --2- 172.21.15.37:0/3999405314 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f3c4406ace0 0x7f3c4406d190 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:02.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.410+0000 7f3c67dff700 1 --2- 172.21.15.37:0/3999405314 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3c600b4910 0x7f3c600b4120 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:02.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.410+0000 7f3c67dff700 1 --2- 172.21.15.37:0/3999405314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c600b54b0 0x7f3c60159e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:02.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.410+0000 7f3c67dff700 1 -- 172.21.15.37:0/3999405314 >> 172.21.15.37:0/3999405314 conn(0x7f3c6006a580 msgr2=0x7f3c600b6d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:02.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.410+0000 7f3c67dff700 1 -- 172.21.15.37:0/3999405314 shutdown_connections 2023-07-14T15:56:02.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.410+0000 7f3c67dff700 1 -- 172.21.15.37:0/3999405314 wait complete. 2023-07-14T15:56:02.414 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T15:55:52.907261+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T15:55:59.992839+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T15:56:02.415 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T15:56:02.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.631+0000 7fa194fff700 1 Processor -- start 2023-07-14T15:56:02.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.632+0000 7fa194fff700 1 -- start start 2023-07-14T15:56:02.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.633+0000 7fa194fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa19015fee0 0x7fa19015ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:02.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.633+0000 7fa194fff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa19015dc50 con 0x7fa1901603b0 2023-07-14T15:56:02.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.633+0000 7fa194fff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1900b2940 con 0x7fa1900d1140 2023-07-14T15:56:02.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.633+0000 7fa194fff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1900b2c20 con 0x7fa19015fee0 2023-07-14T15:56:02.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.633+0000 7fa187fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa1901603b0 0x7fa1900d0a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50476/0 (socket says 172.21.15.37:50476) 2023-07-14T15:56:02.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.633+0000 7fa187fff700 1 -- 172.21.15.37:0/2705679079 learned_addr learned my addr 172.21.15.37:0/2705679079 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:02.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.633+0000 7fa18e59c700 1 --2- 172.21.15.37:0/2705679079 >> v2:172.21.15.37:3300/0 conn(0x7fa19015fee0 0x7fa19015ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:02.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.634+0000 7fa18e59c700 1 -- 172.21.15.37:0/2705679079 >> v1:172.21.15.98:6789/0 conn(0x7fa1900d1140 legacy=0x7fa1900b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:02.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.633+0000 7fa18dd9b700 1 -- 172.21.15.37:0/2705679079 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1387530566 0 0) 0x7fa19015dc50 con 0x7fa1901603b0 2023-07-14T15:56:02.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.634+0000 7fa18e59c700 1 -- 172.21.15.37:0/2705679079 >> v1:172.21.15.37:6789/0 conn(0x7fa1901603b0 legacy=0x7fa1900d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:02.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.634+0000 7fa18e59c700 1 -- 172.21.15.37:0/2705679079 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1900b2f00 con 0x7fa19015fee0 2023-07-14T15:56:02.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.634+0000 7fa18e59c700 1 --2- 172.21.15.37:0/2705679079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa19015fee0 0x7fa19015ded0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa1800097c0 tx=0x7fa180009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6602d5d3703eba85 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:02.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.634+0000 7fa18dd9b700 1 -- 172.21.15.37:0/2705679079 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa180004230 con 0x7fa19015fee0 2023-07-14T15:56:02.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.634+0000 7fa18dd9b700 1 -- 172.21.15.37:0/2705679079 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa180004390 con 0x7fa19015fee0 2023-07-14T15:56:02.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.634+0000 7fa18dd9b700 1 -- 172.21.15.37:0/2705679079 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1800036a0 con 0x7fa19015fee0 2023-07-14T15:56:02.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.635+0000 7fa194fff700 1 -- 172.21.15.37:0/2705679079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa19015fee0 msgr2=0x7fa19015ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:02.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.635+0000 7fa194fff700 1 --2- 172.21.15.37:0/2705679079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa19015fee0 0x7fa19015ded0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa1800097c0 tx=0x7fa180009ad0 comp rx=0 tx=0).stop 2023-07-14T15:56:02.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.635+0000 7fa194fff700 1 -- 172.21.15.37:0/2705679079 shutdown_connections 2023-07-14T15:56:02.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.635+0000 7fa194fff700 1 --2- 172.21.15.37:0/2705679079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa19015fee0 0x7fa19015ded0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:02.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.635+0000 7fa194fff700 1 -- 172.21.15.37:0/2705679079 >> 172.21.15.37:0/2705679079 conn(0x7fa19009c1b0 msgr2=0x7fa1900d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:02.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.635+0000 7fa194fff700 1 -- 172.21.15.37:0/2705679079 shutdown_connections 2023-07-14T15:56:02.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.635+0000 7fa194fff700 1 -- 172.21.15.37:0/2705679079 wait complete. 2023-07-14T15:56:02.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.636+0000 7fa194fff700 1 Processor -- start 2023-07-14T15:56:02.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.637+0000 7fa194fff700 1 -- start start 2023-07-14T15:56:02.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.637+0000 7fa194fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1900d1140 0x7fa1900c7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:02.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.638+0000 7fa194fff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa19015fee0 0x7fa190157760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:02.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.638+0000 7fa194fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1901603b0 0x7fa1900b4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:02.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.638+0000 7fa194fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1900c7840 con 0x7fa1901603b0 2023-07-14T15:56:02.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.638+0000 7fa194fff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1901f2d10 con 0x7fa1900d1140 2023-07-14T15:56:02.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.638+0000 7fa194fff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa190157ca0 con 0x7fa19015fee0 2023-07-14T15:56:02.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.638+0000 7fa18ed9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1901603b0 0x7fa1900b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:02.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.638+0000 7fa18ed9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1901603b0 0x7fa1900b4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47644/0 (socket says 172.21.15.37:47644) 2023-07-14T15:56:02.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.638+0000 7fa18ed9d700 1 -- 172.21.15.37:0/1525838306 learned_addr learned my addr 172.21.15.37:0/1525838306 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:02.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.638+0000 7fa18e59c700 1 --2- 172.21.15.37:0/1525838306 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1900d1140 0x7fa1900c7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:02.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.638+0000 7fa187fff700 1 --2- 172.21.15.37:0/1525838306 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa19015fee0 0x7fa190157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:02.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.638+0000 7fa18ed9d700 1 -- 172.21.15.37:0/1525838306 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa19015fee0 msgr2=0x7fa190157760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:02.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.638+0000 7fa18ed9d700 1 --2- 172.21.15.37:0/1525838306 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa19015fee0 0x7fa190157760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:02.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.638+0000 7fa18ed9d700 1 -- 172.21.15.37:0/1525838306 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1900d1140 msgr2=0x7fa1900c7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:02.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.638+0000 7fa18ed9d700 1 --2- 172.21.15.37:0/1525838306 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1900d1140 0x7fa1900c7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:02.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.638+0000 7fa18ed9d700 1 -- 172.21.15.37:0/1525838306 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1800094a0 con 0x7fa1901603b0 2023-07-14T15:56:02.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.639+0000 7fa18ed9d700 1 --2- 172.21.15.37:0/1525838306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1901603b0 0x7fa1900b4480 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa18800c870 tx=0x7fa18800cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:02.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.639+0000 7fa186ffd700 1 -- 172.21.15.37:0/1525838306 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa188003e30 con 0x7fa1901603b0 2023-07-14T15:56:02.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.639+0000 7fa186ffd700 1 -- 172.21.15.37:0/1525838306 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa188005070 con 0x7fa1901603b0 2023-07-14T15:56:02.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.639+0000 7fa194fff700 1 -- 172.21.15.37:0/1525838306 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1901f2190 con 0x7fa1901603b0 2023-07-14T15:56:02.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.639+0000 7fa186ffd700 1 -- 172.21.15.37:0/1525838306 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa188005420 con 0x7fa1901603b0 2023-07-14T15:56:02.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.639+0000 7fa194fff700 1 -- 172.21.15.37:0/1525838306 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1901f2750 con 0x7fa1901603b0 2023-07-14T15:56:02.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.640+0000 7fa194fff700 1 -- 172.21.15.37:0/1525838306 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa190158cc0 con 0x7fa1901603b0 2023-07-14T15:56:02.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.641+0000 7fa186ffd700 1 -- 172.21.15.37:0/1525838306 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa188005580 con 0x7fa1901603b0 2023-07-14T15:56:02.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.642+0000 7fa186ffd700 1 --2- 172.21.15.37:0/1525838306 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa17006ace0 0x7fa17006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:02.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.642+0000 7fa186ffd700 1 -- 172.21.15.37:0/1525838306 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa188088300 con 0x7fa1901603b0 2023-07-14T15:56:02.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.642+0000 7fa18e59c700 1 --2- 172.21.15.37:0/1525838306 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa17006ace0 0x7fa17006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:02.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.643+0000 7fa18e59c700 1 --2- 172.21.15.37:0/1525838306 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa17006ace0 0x7fa17006d190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa1800090b0 tx=0x7fa180008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:02.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.646+0000 7fa186ffd700 1 -- 172.21.15.37:0/1525838306 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa188053700 con 0x7fa1901603b0 2023-07-14T15:56:02.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.852+0000 7fa194fff700 1 -- 172.21.15.37:0/1525838306 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa190067840 con 0x7fa1901603b0 2023-07-14T15:56:02.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.853+0000 7fa186ffd700 1 -- 172.21.15.37:0/1525838306 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa188056d20 con 0x7fa1901603b0 2023-07-14T15:56:02.840 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-14T15:56:02.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.855+0000 7fa194fff700 1 -- 172.21.15.37:0/1525838306 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa17006ace0 msgr2=0x7fa17006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:02.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.855+0000 7fa194fff700 1 --2- 172.21.15.37:0/1525838306 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa17006ace0 0x7fa17006d190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa1800090b0 tx=0x7fa180008030 comp rx=0 tx=0).stop 2023-07-14T15:56:02.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.855+0000 7fa194fff700 1 -- 172.21.15.37:0/1525838306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1901603b0 msgr2=0x7fa1900b4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:02.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.855+0000 7fa194fff700 1 --2- 172.21.15.37:0/1525838306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1901603b0 0x7fa1900b4480 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa18800c870 tx=0x7fa18800cb80 comp rx=0 tx=0).stop 2023-07-14T15:56:02.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.855+0000 7fa194fff700 1 -- 172.21.15.37:0/1525838306 shutdown_connections 2023-07-14T15:56:02.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.855+0000 7fa194fff700 1 --2- 172.21.15.37:0/1525838306 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1900d1140 0x7fa1900c7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:02.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.855+0000 7fa194fff700 1 --2- 172.21.15.37:0/1525838306 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa17006ace0 0x7fa17006d190 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:02.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.855+0000 7fa194fff700 1 --2- 172.21.15.37:0/1525838306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1901603b0 0x7fa1900b4480 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:02.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.855+0000 7fa194fff700 1 --2- 172.21.15.37:0/1525838306 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa19015fee0 0x7fa190157760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:02.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.855+0000 7fa194fff700 1 -- 172.21.15.37:0/1525838306 >> 172.21.15.37:0/1525838306 conn(0x7fa19009c1b0 msgr2=0x7fa19006a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:02.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.855+0000 7fa194fff700 1 -- 172.21.15.37:0/1525838306 shutdown_connections 2023-07-14T15:56:02.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:02.855+0000 7fa194fff700 1 -- 172.21.15.37:0/1525838306 wait complete. 2023-07-14T15:56:02.860 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T15:56:03.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.080+0000 7f9735dff700 1 Processor -- start 2023-07-14T15:56:03.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.080+0000 7f9735dff700 1 -- start start 2023-07-14T15:56:03.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.081+0000 7f9735dff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f973006c0d0 0x7f973006f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:03.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.081+0000 7f9735dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f97300ae000 0x7f97300cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:03.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.081+0000 7f9735dff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9730159870 con 0x7f9730071730 2023-07-14T15:56:03.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.081+0000 7f9735dff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97300ae400 con 0x7f973006c0d0 2023-07-14T15:56:03.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.081+0000 7f9735dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97300ca790 con 0x7f97300ae000 2023-07-14T15:56:03.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.081+0000 7f972ffff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f97300ae000 0x7f97300cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:03.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.081+0000 7f972effd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f973006c0d0 0x7f973006f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:03.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.081+0000 7f972f7fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f9730071730 0x7f973006b9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.37:57288/0 (socket says 172.21.15.37:57288) 2023-07-14T15:56:03.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.082+0000 7f972f7fe700 1 -- 172.21.15.37:0/3521336278 learned_addr learned my addr 172.21.15.37:0/3521336278 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:03.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.082+0000 7f972e7fc700 1 -- 172.21.15.37:0/3521336278 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2188509961 0 0) 0x7f9730159870 con 0x7f9730071730 2023-07-14T15:56:03.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.082+0000 7f972e7fc700 1 -- 172.21.15.37:0/3521336278 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97180035b0 con 0x7f9730071730 2023-07-14T15:56:03.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.082+0000 7f972ffff700 1 -- 172.21.15.37:0/3521336278 >> v2:172.21.15.98:3300/0 conn(0x7f973006c0d0 msgr2=0x7f973006f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:03.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.082+0000 7f972ffff700 1 --2- 172.21.15.37:0/3521336278 >> v2:172.21.15.98:3300/0 conn(0x7f973006c0d0 0x7f973006f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:03.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.082+0000 7f972ffff700 1 -- 172.21.15.37:0/3521336278 >> v1:172.21.15.98:6789/0 conn(0x7f9730071730 legacy=0x7f973006b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:03.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.082+0000 7f972ffff700 1 -- 172.21.15.37:0/3521336278 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97300cc780 con 0x7f97300ae000 2023-07-14T15:56:03.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.082+0000 7f972effd700 1 --2- 172.21.15.37:0/3521336278 >> v2:172.21.15.98:3300/0 conn(0x7f973006c0d0 0x7f973006f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:56:03.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.082+0000 7f972ffff700 1 --2- 172.21.15.37:0/3521336278 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f97300ae000 0x7f97300cd220 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9728009d90 tx=0x7f972800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8353c3f5d37f97b7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:03.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.083+0000 7f972e7fc700 1 -- 172.21.15.37:0/3521336278 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972800e070 con 0x7f97300ae000 2023-07-14T15:56:03.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.083+0000 7f972e7fc700 1 -- 172.21.15.37:0/3521336278 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f972800bb20 con 0x7f97300ae000 2023-07-14T15:56:03.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.083+0000 7f972e7fc700 1 -- 172.21.15.37:0/3521336278 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9728012430 con 0x7f97300ae000 2023-07-14T15:56:03.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.083+0000 7f9735dff700 1 -- 172.21.15.37:0/3521336278 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f97300ae000 msgr2=0x7f97300cd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:03.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.083+0000 7f9735dff700 1 --2- 172.21.15.37:0/3521336278 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f97300ae000 0x7f97300cd220 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9728009d90 tx=0x7f972800b330 comp rx=0 tx=0).stop 2023-07-14T15:56:03.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.083+0000 7f9735dff700 1 -- 172.21.15.37:0/3521336278 shutdown_connections 2023-07-14T15:56:03.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.083+0000 7f9735dff700 1 --2- 172.21.15.37:0/3521336278 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f97300ae000 0x7f97300cd220 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:03.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.083+0000 7f9735dff700 1 --2- 172.21.15.37:0/3521336278 >> v2:172.21.15.98:3300/0 conn(0x7f973006c0d0 0x7f973006f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:03.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.083+0000 7f9735dff700 1 -- 172.21.15.37:0/3521336278 >> 172.21.15.37:0/3521336278 conn(0x7f973006aac0 msgr2=0x7f97300b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:03.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.083+0000 7f9735dff700 1 -- 172.21.15.37:0/3521336278 shutdown_connections 2023-07-14T15:56:03.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.083+0000 7f9735dff700 1 -- 172.21.15.37:0/3521336278 wait complete. 2023-07-14T15:56:03.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.085+0000 7f9735dff700 1 Processor -- start 2023-07-14T15:56:03.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.085+0000 7f9735dff700 1 -- start start 2023-07-14T15:56:03.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.086+0000 7f9735dff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f973006c0d0 0x7f9730154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:03.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.086+0000 7f9735dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f9730071730 0x7f97300c5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:03.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.086+0000 7f9735dff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f97300ae000 0x7f97300c6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:03.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.086+0000 7f9735dff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9730154540 con 0x7f973006c0d0 2023-07-14T15:56:03.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.086+0000 7f9735dff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97300b28f0 con 0x7f97300ae000 2023-07-14T15:56:03.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.086+0000 7f9735dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97300b2bd0 con 0x7f9730071730 2023-07-14T15:56:03.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.086+0000 7f972f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f973006c0d0 0x7f9730154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:03.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.086+0000 7f972f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f973006c0d0 0x7f9730154000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47652/0 (socket says 172.21.15.37:47652) 2023-07-14T15:56:03.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.086+0000 7f972f7fe700 1 -- 172.21.15.37:0/3352585470 learned_addr learned my addr 172.21.15.37:0/3352585470 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:03.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.086+0000 7f972effd700 1 --2- 172.21.15.37:0/3352585470 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f9730071730 0x7f97300c5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:03.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.086+0000 7f972ffff700 1 --2- 172.21.15.37:0/3352585470 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f97300ae000 0x7f97300c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:03.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.087+0000 7f972f7fe700 1 -- 172.21.15.37:0/3352585470 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f9730071730 msgr2=0x7f97300c5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:03.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.087+0000 7f972f7fe700 1 --2- 172.21.15.37:0/3352585470 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f9730071730 0x7f97300c5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:03.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.087+0000 7f972f7fe700 1 -- 172.21.15.37:0/3352585470 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f97300ae000 msgr2=0x7f97300c6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:03.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.087+0000 7f972f7fe700 1 --2- 172.21.15.37:0/3352585470 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f97300ae000 0x7f97300c6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:03.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.087+0000 7f972f7fe700 1 -- 172.21.15.37:0/3352585470 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97240094a0 con 0x7f973006c0d0 2023-07-14T15:56:03.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.087+0000 7f972f7fe700 1 --2- 172.21.15.37:0/3352585470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f973006c0d0 0x7f9730154000 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f972000c700 tx=0x7f972000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:03.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.087+0000 7f9717fff700 1 -- 172.21.15.37:0/3352585470 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9720005d70 con 0x7f973006c0d0 2023-07-14T15:56:03.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.087+0000 7f9717fff700 1 -- 172.21.15.37:0/3352585470 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97200070d0 con 0x7f973006c0d0 2023-07-14T15:56:03.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.087+0000 7f9717fff700 1 -- 172.21.15.37:0/3352585470 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9720007460 con 0x7f973006c0d0 2023-07-14T15:56:03.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.087+0000 7f9735dff700 1 -- 172.21.15.37:0/3352585470 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9728009a70 con 0x7f973006c0d0 2023-07-14T15:56:03.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.087+0000 7f9735dff700 1 -- 172.21.15.37:0/3352585470 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97300b3190 con 0x7f973006c0d0 2023-07-14T15:56:03.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.088+0000 7f9735dff700 1 -- 172.21.15.37:0/3352585470 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97300ce880 con 0x7f973006c0d0 2023-07-14T15:56:03.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.089+0000 7f9717fff700 1 -- 172.21.15.37:0/3352585470 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f97200075c0 con 0x7f973006c0d0 2023-07-14T15:56:03.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.090+0000 7f9717fff700 1 --2- 172.21.15.37:0/3352585470 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f971c06ace0 0x7f971c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:03.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.090+0000 7f9717fff700 1 -- 172.21.15.37:0/3352585470 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f97200885e0 con 0x7f973006c0d0 2023-07-14T15:56:03.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.091+0000 7f972effd700 1 --2- 172.21.15.37:0/3352585470 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f971c06ace0 0x7f971c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:03.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.091+0000 7f972effd700 1 --2- 172.21.15.37:0/3352585470 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f971c06ace0 0x7f971c06d190 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f97300cf870 tx=0x7f9724009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:03.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.095+0000 7f9717fff700 1 -- 172.21.15.37:0/3352585470 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9720053940 con 0x7f973006c0d0 2023-07-14T15:56:03.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.305+0000 7f9735dff700 1 -- 172.21.15.37:0/3352585470 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f97300cbad0 con 0x7f973006c0d0 2023-07-14T15:56:03.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.305+0000 7f9717fff700 1 -- 172.21.15.37:0/3352585470 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9720017020 con 0x7f973006c0d0 2023-07-14T15:56:03.293 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-14T15:56:03.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.307+0000 7f9735dff700 1 -- 172.21.15.37:0/3352585470 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f971c06ace0 msgr2=0x7f971c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:03.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.307+0000 7f9735dff700 1 --2- 172.21.15.37:0/3352585470 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f971c06ace0 0x7f971c06d190 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f97300cf870 tx=0x7f9724009210 comp rx=0 tx=0).stop 2023-07-14T15:56:03.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.307+0000 7f9735dff700 1 -- 172.21.15.37:0/3352585470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f973006c0d0 msgr2=0x7f9730154000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:03.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.307+0000 7f9735dff700 1 --2- 172.21.15.37:0/3352585470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f973006c0d0 0x7f9730154000 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f972000c700 tx=0x7f972000ca10 comp rx=0 tx=0).stop 2023-07-14T15:56:03.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.308+0000 7f9735dff700 1 -- 172.21.15.37:0/3352585470 shutdown_connections 2023-07-14T15:56:03.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.308+0000 7f9735dff700 1 --2- 172.21.15.37:0/3352585470 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f97300ae000 0x7f97300c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:03.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.308+0000 7f9735dff700 1 --2- 172.21.15.37:0/3352585470 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f971c06ace0 0x7f971c06d190 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:03.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.308+0000 7f9735dff700 1 --2- 172.21.15.37:0/3352585470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f973006c0d0 0x7f9730154000 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:03.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.308+0000 7f9735dff700 1 --2- 172.21.15.37:0/3352585470 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f9730071730 0x7f97300c5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:03.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.308+0000 7f9735dff700 1 -- 172.21.15.37:0/3352585470 >> 172.21.15.37:0/3352585470 conn(0x7f973006aac0 msgr2=0x7f97301589f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:03.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.308+0000 7f9735dff700 1 -- 172.21.15.37:0/3352585470 shutdown_connections 2023-07-14T15:56:03.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.308+0000 7f9735dff700 1 -- 172.21.15.37:0/3352585470 wait complete. 2023-07-14T15:56:03.313 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T15:56:03.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.527+0000 7f71ae7ff700 1 Processor -- start 2023-07-14T15:56:03.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.527+0000 7f71ae7ff700 1 -- start start 2023-07-14T15:56:03.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.528+0000 7f71ae7ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f71a80b85f0 0x7f71a815d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:03.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.529+0000 7f71ae7ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f71a80b4910 0x7f71a80b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:03.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.529+0000 7f71ae7ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71a80b52b0 con 0x7f71a80b54b0 2023-07-14T15:56:03.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.529+0000 7f71ae7ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71a80cf6b0 con 0x7f71a80b85f0 2023-07-14T15:56:03.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.529+0000 7f71ae7ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71a80cdc40 con 0x7f71a80b4910 2023-07-14T15:56:03.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.529+0000 7f71a7fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f71a80b85f0 0x7f71a815d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:03.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.529+0000 7f71acd9c700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f71a80b4910 0x7f71a80b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:03.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.529+0000 7f71a7fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f71a80b85f0 0x7f71a815d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.37:56390/0 (socket says 172.21.15.37:56390) 2023-07-14T15:56:03.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.529+0000 7f719ffff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f71a80b54b0 0x7f71a80cfb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.37:57292/0 (socket says 172.21.15.37:57292) 2023-07-14T15:56:03.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.529+0000 7f71a7fff700 1 -- 172.21.15.37:0/2572187750 learned_addr learned my addr 172.21.15.37:0/2572187750 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:03.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.529+0000 7f71a7fff700 1 -- 172.21.15.37:0/2572187750 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f71a80b4910 msgr2=0x7f71a80b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:03.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.529+0000 7f71a7fff700 1 --2- 172.21.15.37:0/2572187750 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f71a80b4910 0x7f71a80b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:03.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.529+0000 7f71a7fff700 1 -- 172.21.15.37:0/2572187750 >> v1:172.21.15.98:6789/0 conn(0x7f71a80b54b0 legacy=0x7f71a80cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:03.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.530+0000 7f71a7fff700 1 -- 172.21.15.37:0/2572187750 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a815dba0 con 0x7f71a80b85f0 2023-07-14T15:56:03.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.529+0000 7f71a77fe700 1 -- 172.21.15.37:0/2572187750 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1576423291 0 0) 0x7f71a80b52b0 con 0x7f71a80b54b0 2023-07-14T15:56:03.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.530+0000 7f71a7fff700 1 --2- 172.21.15.37:0/2572187750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71a80b85f0 0x7f71a815d660 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f71980098f0 tx=0x7f7198009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1ee785dd68956d1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:03.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.530+0000 7f71a77fe700 1 -- 172.21.15.37:0/2572187750 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7198011830 con 0x7f71a80b85f0 2023-07-14T15:56:03.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.530+0000 7f71a77fe700 1 -- 172.21.15.37:0/2572187750 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7198011990 con 0x7f71a80b85f0 2023-07-14T15:56:03.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.530+0000 7f71a77fe700 1 -- 172.21.15.37:0/2572187750 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7198011d20 con 0x7f71a80b85f0 2023-07-14T15:56:03.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.531+0000 7f71ae7ff700 1 -- 172.21.15.37:0/2572187750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71a80b85f0 msgr2=0x7f71a815d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:03.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.531+0000 7f71ae7ff700 1 --2- 172.21.15.37:0/2572187750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71a80b85f0 0x7f71a815d660 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f71980098f0 tx=0x7f7198009c00 comp rx=0 tx=0).stop 2023-07-14T15:56:03.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.531+0000 7f71ae7ff700 1 -- 172.21.15.37:0/2572187750 shutdown_connections 2023-07-14T15:56:03.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.531+0000 7f71ae7ff700 1 --2- 172.21.15.37:0/2572187750 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f71a80b4910 0x7f71a80b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:03.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.531+0000 7f71ae7ff700 1 --2- 172.21.15.37:0/2572187750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71a80b85f0 0x7f71a815d660 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:03.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.531+0000 7f71ae7ff700 1 -- 172.21.15.37:0/2572187750 >> 172.21.15.37:0/2572187750 conn(0x7f71a806a580 msgr2=0x7f71a806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:03.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.531+0000 7f71ae7ff700 1 -- 172.21.15.37:0/2572187750 shutdown_connections 2023-07-14T15:56:03.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.531+0000 7f71ae7ff700 1 -- 172.21.15.37:0/2572187750 wait complete. 2023-07-14T15:56:03.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.532+0000 7f71ae7ff700 1 Processor -- start 2023-07-14T15:56:03.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.533+0000 7f71ae7ff700 1 -- start start 2023-07-14T15:56:03.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.533+0000 7f71ae7ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71a80b4910 0x7f71a8157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:03.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.534+0000 7f71ae7ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f71a80b54b0 0x7f71a8149530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:03.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.534+0000 7f71ae7ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71a80b85f0 0x7f71a81f5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:03.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.534+0000 7f71ae7ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a8149a70 con 0x7f71a80b85f0 2023-07-14T15:56:03.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.534+0000 7f71ae7ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a81f5860 con 0x7f71a80b4910 2023-07-14T15:56:03.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.534+0000 7f71ae7ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71a8155300 con 0x7f71a80b54b0 2023-07-14T15:56:03.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.534+0000 7f71acd9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71a80b85f0 0x7f71a81f5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:03.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.534+0000 7f71acd9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71a80b85f0 0x7f71a81f5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47668/0 (socket says 172.21.15.37:47668) 2023-07-14T15:56:03.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.534+0000 7f71acd9c700 1 -- 172.21.15.37:0/3210879805 learned_addr learned my addr 172.21.15.37:0/3210879805 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:03.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.534+0000 7f71a7fff700 1 --2- 172.21.15.37:0/3210879805 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71a80b4910 0x7f71a8157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:03.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.534+0000 7f719ffff700 1 --2- 172.21.15.37:0/3210879805 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f71a80b54b0 0x7f71a8149530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:03.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.534+0000 7f71acd9c700 1 -- 172.21.15.37:0/3210879805 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f71a80b54b0 msgr2=0x7f71a8149530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:03.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.534+0000 7f71acd9c700 1 --2- 172.21.15.37:0/3210879805 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f71a80b54b0 0x7f71a8149530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:03.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.534+0000 7f71acd9c700 1 -- 172.21.15.37:0/3210879805 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71a80b4910 msgr2=0x7f71a8157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:03.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.534+0000 7f71acd9c700 1 --2- 172.21.15.37:0/3210879805 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71a80b4910 0x7f71a8157c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:03.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.534+0000 7f71acd9c700 1 -- 172.21.15.37:0/3210879805 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7198009550 con 0x7f71a80b85f0 2023-07-14T15:56:03.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.534+0000 7f71a7fff700 1 --2- 172.21.15.37:0/3210879805 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71a80b4910 0x7f71a8157c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:56:03.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.535+0000 7f71acd9c700 1 --2- 172.21.15.37:0/3210879805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71a80b85f0 0x7f71a81f5cf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f71a000efc0 tx=0x7f71a000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:03.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.535+0000 7f71a57fa700 1 -- 172.21.15.37:0/3210879805 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a0009ea0 con 0x7f71a80b85f0 2023-07-14T15:56:03.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.535+0000 7f71a57fa700 1 -- 172.21.15.37:0/3210879805 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a000f040 con 0x7f71a80b85f0 2023-07-14T15:56:03.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.535+0000 7f71ae7ff700 1 -- 172.21.15.37:0/3210879805 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71a8154d40 con 0x7f71a80b85f0 2023-07-14T15:56:03.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.535+0000 7f71a57fa700 1 -- 172.21.15.37:0/3210879805 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a000ced0 con 0x7f71a80b85f0 2023-07-14T15:56:03.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.535+0000 7f71ae7ff700 1 -- 172.21.15.37:0/3210879805 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71a81f54f0 con 0x7f71a80b85f0 2023-07-14T15:56:03.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.536+0000 7f71ae7ff700 1 -- 172.21.15.37:0/3210879805 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71a81f5a10 con 0x7f71a80b85f0 2023-07-14T15:56:03.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.537+0000 7f71a57fa700 1 -- 172.21.15.37:0/3210879805 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f71a0014480 con 0x7f71a80b85f0 2023-07-14T15:56:03.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.538+0000 7f71a57fa700 1 --2- 172.21.15.37:0/3210879805 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f718806acb0 0x7f718806d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:03.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.538+0000 7f71a57fa700 1 -- 172.21.15.37:0/3210879805 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f71a0089bf0 con 0x7f71a80b85f0 2023-07-14T15:56:03.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.539+0000 7f71a7fff700 1 --2- 172.21.15.37:0/3210879805 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f718806acb0 0x7f718806d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:03.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.539+0000 7f71a7fff700 1 --2- 172.21.15.37:0/3210879805 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f718806acb0 0x7f718806d160 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7198014040 tx=0x7f7198008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:03.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.543+0000 7f71a57fa700 1 -- 172.21.15.37:0/3210879805 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f71a81f5a10 con 0x7f71a80b85f0 2023-07-14T15:56:03.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.806+0000 7f71ae7ff700 1 -- 172.21.15.37:0/3210879805 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f71a81f59d0 con 0x7f71a80b85f0 2023-07-14T15:56:03.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.806+0000 7f71a57fa700 1 -- 172.21.15.37:0/3210879805 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3518 (secure 0 0 0) 0x7f71a0018dd0 con 0x7f71a80b85f0 2023-07-14T15:56:03.794 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:56:03.794 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/596800720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":596800720},{"type":"v1","addr":"172.21.15.37:6835","nonce":596800720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4318,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/1611780456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1611780456},{"type":"v1","addr":"172.21.15.37:6834","nonce":1611780456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4324,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/586880065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":586880065},{"type":"v1","addr":"172.21.15.98:6835","nonce":586880065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4327,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2731892479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2731892479},{"type":"v1","addr":"172.21.15.98:6837","nonce":2731892479}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-07-14T15:56:03.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.809+0000 7f71ae7ff700 1 -- 172.21.15.37:0/3210879805 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f718806acb0 msgr2=0x7f718806d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:03.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.809+0000 7f71ae7ff700 1 --2- 172.21.15.37:0/3210879805 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f718806acb0 0x7f718806d160 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7198014040 tx=0x7f7198008030 comp rx=0 tx=0).stop 2023-07-14T15:56:03.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.809+0000 7f71ae7ff700 1 -- 172.21.15.37:0/3210879805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71a80b85f0 msgr2=0x7f71a81f5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:03.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.809+0000 7f71ae7ff700 1 --2- 172.21.15.37:0/3210879805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71a80b85f0 0x7f71a81f5cf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f71a000efc0 tx=0x7f71a000c3a0 comp rx=0 tx=0).stop 2023-07-14T15:56:03.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.809+0000 7f71ae7ff700 1 -- 172.21.15.37:0/3210879805 shutdown_connections 2023-07-14T15:56:03.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.809+0000 7f71ae7ff700 1 --2- 172.21.15.37:0/3210879805 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71a80b4910 0x7f71a8157c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:03.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.809+0000 7f71ae7ff700 1 --2- 172.21.15.37:0/3210879805 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f718806acb0 0x7f718806d160 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:03.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.809+0000 7f71ae7ff700 1 --2- 172.21.15.37:0/3210879805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71a80b85f0 0x7f71a81f5cf0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:03.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.809+0000 7f71ae7ff700 1 --2- 172.21.15.37:0/3210879805 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f71a80b54b0 0x7f71a8149530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:03.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.809+0000 7f71ae7ff700 1 -- 172.21.15.37:0/3210879805 >> 172.21.15.37:0/3210879805 conn(0x7f71a806a580 msgr2=0x7f71a815acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:03.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.809+0000 7f71ae7ff700 1 -- 172.21.15.37:0/3210879805 shutdown_connections 2023-07-14T15:56:03.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:03.809+0000 7f71ae7ff700 1 -- 172.21.15.37:0/3210879805 wait complete. 2023-07-14T15:56:03.798 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 3 2023-07-14T15:56:03.814 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T15:56:04.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.030+0000 7f3b095ff700 1 Processor -- start 2023-07-14T15:56:04.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.030+0000 7f3b095ff700 1 -- start start 2023-07-14T15:56:04.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.031+0000 7f3b095ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3b040b85f0 0x7f3b0415d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:04.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.031+0000 7f3b095ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3b040b54b0 0x7f3b040cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:04.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.031+0000 7f3b095ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b040cf6b0 con 0x7f3b040b4910 2023-07-14T15:56:04.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.031+0000 7f3b095ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b040cdc40 con 0x7f3b040b85f0 2023-07-14T15:56:04.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.031+0000 7f3b095ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b0415dba0 con 0x7f3b040b54b0 2023-07-14T15:56:04.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.032+0000 7f3b02ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3b040b85f0 0x7f3b0415d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:04.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.032+0000 7f3b037fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3b040b4910 0x7f3b040b4d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50486/0 (socket says 172.21.15.37:50486) 2023-07-14T15:56:04.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.032+0000 7f3b037fe700 1 -- 172.21.15.37:0/2643556443 learned_addr learned my addr 172.21.15.37:0/2643556443 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:04.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.032+0000 7f3b027fc700 1 --2- 172.21.15.37:0/2643556443 >> v2:172.21.15.98:3300/0 conn(0x7f3b040b54b0 0x7f3b040cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:04.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.032+0000 7f3b02ffd700 1 -- 172.21.15.37:0/2643556443 >> v2:172.21.15.98:3300/0 conn(0x7f3b040b54b0 msgr2=0x7f3b040cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:04.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.032+0000 7f3b02ffd700 1 --2- 172.21.15.37:0/2643556443 >> v2:172.21.15.98:3300/0 conn(0x7f3b040b54b0 0x7f3b040cfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:04.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.032+0000 7f3b02ffd700 1 -- 172.21.15.37:0/2643556443 >> v1:172.21.15.37:6789/0 conn(0x7f3b040b4910 legacy=0x7f3b040b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:04.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.032+0000 7f3b02ffd700 1 -- 172.21.15.37:0/2643556443 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b040cf0a0 con 0x7f3b040b85f0 2023-07-14T15:56:04.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.032+0000 7f3b01ffb700 1 -- 172.21.15.37:0/2643556443 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2208349531 0 0) 0x7f3b040cf6b0 con 0x7f3b040b4910 2023-07-14T15:56:04.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.032+0000 7f3b02ffd700 1 --2- 172.21.15.37:0/2643556443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b040b85f0 0x7f3b0415d660 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3b0406a0c0 tx=0x7f3af4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48a3afffc261ef76 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:04.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.033+0000 7f3b01ffb700 1 -- 172.21.15.37:0/2643556443 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af4011830 con 0x7f3b040b85f0 2023-07-14T15:56:04.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.033+0000 7f3b01ffb700 1 -- 172.21.15.37:0/2643556443 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af4011990 con 0x7f3b040b85f0 2023-07-14T15:56:04.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.033+0000 7f3b01ffb700 1 -- 172.21.15.37:0/2643556443 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af4011d20 con 0x7f3b040b85f0 2023-07-14T15:56:04.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.033+0000 7f3b095ff700 1 -- 172.21.15.37:0/2643556443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b040b85f0 msgr2=0x7f3b0415d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:04.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.033+0000 7f3b095ff700 1 --2- 172.21.15.37:0/2643556443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b040b85f0 0x7f3b0415d660 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3b0406a0c0 tx=0x7f3af4009b20 comp rx=0 tx=0).stop 2023-07-14T15:56:04.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.033+0000 7f3b095ff700 1 -- 172.21.15.37:0/2643556443 shutdown_connections 2023-07-14T15:56:04.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.033+0000 7f3b095ff700 1 --2- 172.21.15.37:0/2643556443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b040b85f0 0x7f3b0415d660 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:04.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.033+0000 7f3b095ff700 1 --2- 172.21.15.37:0/2643556443 >> v2:172.21.15.98:3300/0 conn(0x7f3b040b54b0 0x7f3b040cfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:04.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.033+0000 7f3b095ff700 1 -- 172.21.15.37:0/2643556443 >> 172.21.15.37:0/2643556443 conn(0x7f3b0406a580 msgr2=0x7f3b0406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:04.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.033+0000 7f3b095ff700 1 -- 172.21.15.37:0/2643556443 shutdown_connections 2023-07-14T15:56:04.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.033+0000 7f3b095ff700 1 -- 172.21.15.37:0/2643556443 wait complete. 2023-07-14T15:56:04.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.035+0000 7f3b095ff700 1 Processor -- start 2023-07-14T15:56:04.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.035+0000 7f3b095ff700 1 -- start start 2023-07-14T15:56:04.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.036+0000 7f3b095ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b040b4910 0x7f3b040caa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:04.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.036+0000 7f3b095ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b040b54b0 0x7f3b040a9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:04.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.036+0000 7f3b095ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3b040b85f0 0x7f3b041f1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:04.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.036+0000 7f3b095ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b040aabd0 con 0x7f3b040b4910 2023-07-14T15:56:04.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.036+0000 7f3b095ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b040a9d60 con 0x7f3b040b54b0 2023-07-14T15:56:04.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.036+0000 7f3b095ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b040a9f50 con 0x7f3b040b85f0 2023-07-14T15:56:04.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.036+0000 7f3b02ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b040b4910 0x7f3b040caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:04.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.036+0000 7f3b02ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b040b4910 0x7f3b040caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47686/0 (socket says 172.21.15.37:47686) 2023-07-14T15:56:04.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.036+0000 7f3b02ffd700 1 -- 172.21.15.37:0/2179086278 learned_addr learned my addr 172.21.15.37:0/2179086278 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:04.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.037+0000 7f3b027fc700 1 --2- 172.21.15.37:0/2179086278 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b040b54b0 0x7f3b040a9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:04.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.037+0000 7f3b037fe700 1 --2- 172.21.15.37:0/2179086278 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3b040b85f0 0x7f3b041f1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:04.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.037+0000 7f3b02ffd700 1 -- 172.21.15.37:0/2179086278 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3b040b85f0 msgr2=0x7f3b041f1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:04.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.037+0000 7f3b02ffd700 1 --2- 172.21.15.37:0/2179086278 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3b040b85f0 0x7f3b041f1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:04.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.037+0000 7f3b02ffd700 1 -- 172.21.15.37:0/2179086278 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b040b54b0 msgr2=0x7f3b040a9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:04.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.037+0000 7f3b02ffd700 1 --2- 172.21.15.37:0/2179086278 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b040b54b0 0x7f3b040a9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:04.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.037+0000 7f3b02ffd700 1 -- 172.21.15.37:0/2179086278 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af40094a0 con 0x7f3b040b4910 2023-07-14T15:56:04.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.037+0000 7f3b037fe700 1 --2- 172.21.15.37:0/2179086278 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3b040b85f0 0x7f3b041f1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:56:04.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.037+0000 7f3b02ffd700 1 --2- 172.21.15.37:0/2179086278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b040b4910 0x7f3b040caa90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3af4014040 tx=0x7f3af4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:04.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.037+0000 7f3aeb7fe700 1 -- 172.21.15.37:0/2179086278 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af40036a0 con 0x7f3b040b4910 2023-07-14T15:56:04.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.037+0000 7f3aeb7fe700 1 -- 172.21.15.37:0/2179086278 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af401e070 con 0x7f3b040b4910 2023-07-14T15:56:04.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.037+0000 7f3b095ff700 1 -- 172.21.15.37:0/2179086278 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b040aa230 con 0x7f3b040b4910 2023-07-14T15:56:04.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.037+0000 7f3aeb7fe700 1 -- 172.21.15.37:0/2179086278 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af4003a00 con 0x7f3b040b4910 2023-07-14T15:56:04.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.038+0000 7f3b095ff700 1 -- 172.21.15.37:0/2179086278 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b040aa7f0 con 0x7f3b040b4910 2023-07-14T15:56:04.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.039+0000 7f3b095ff700 1 -- 172.21.15.37:0/2179086278 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b040aa980 con 0x7f3b040b4910 2023-07-14T15:56:04.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.040+0000 7f3aeb7fe700 1 -- 172.21.15.37:0/2179086278 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3af4003b60 con 0x7f3b040b4910 2023-07-14T15:56:04.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.040+0000 7f3aeb7fe700 1 --2- 172.21.15.37:0/2179086278 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f3af006ace0 0x7f3af006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:04.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.041+0000 7f3aeb7fe700 1 -- 172.21.15.37:0/2179086278 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3af408a100 con 0x7f3b040b4910 2023-07-14T15:56:04.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.041+0000 7f3b027fc700 1 --2- 172.21.15.37:0/2179086278 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f3af006ace0 0x7f3af006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:04.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.042+0000 7f3b027fc700 1 --2- 172.21.15.37:0/2179086278 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f3af006ace0 0x7f3af006d190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3b040cd440 tx=0x7f3af8009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:04.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.045+0000 7f3aeb7fe700 1 -- 172.21.15.37:0/2179086278 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3af40554f0 con 0x7f3b040b4910 2023-07-14T15:56:04.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.252+0000 7f3b095ff700 1 -- 172.21.15.37:0/2179086278 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b04067840 con 0x7f3b040b4910 2023-07-14T15:56:04.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.253+0000 7f3aeb7fe700 1 -- 172.21.15.37:0/2179086278 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+14626 (secure 0 0 0) 0x7f3af4058b10 con 0x7f3b040b4910 2023-07-14T15:56:04.241 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:56:04.241 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":21,"fsid":"9da30401-a779-4e46-aba6-00c2494c6c67","created":"2023-07-14T15:55:39.898867+0000","modified":"2023-07-14T15:56:02.920084+0000","last_up_change":"2023-07-14T15:55:53.025696+0000","last_in_change":"2023-07-14T15:55:43.388192+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T15:55:52.907261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T15:55:59.992839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d049535-7b87-4276-8fe5-0f74ba422d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6801","nonce":2783032392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6803","nonce":2783032392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6807","nonce":2783032392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6805","nonce":2783032392}]},"public_addr":"172.21.15.37:6801/2783032392","cluster_addr":"172.21.15.37:6803/2783032392","heartbeat_back_addr":"172.21.15.37:6807/2783032392","heartbeat_front_addr":"172.21.15.37:6805/2783032392","state":["exists","up"]},{"osd":1,"uuid":"79ec948d-ead2-4c2d-923a-dd6eeaac9dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6823","nonce":1190059746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6826","nonce":1190059746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6831","nonce":1190059746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6829","nonce":1190059746}]},"public_addr":"172.21.15.37:6823/1190059746","cluster_addr":"172.21.15.37:6826/1190059746","heartbeat_back_addr":"172.21.15.37:6831/1190059746","heartbeat_front_addr":"172.21.15.37:6829/1190059746","state":["exists","up"]},{"osd":2,"uuid":"a1db6690-c160-4366-9c82-2cca17e4bba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6809","nonce":2266223499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6813","nonce":2266223499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6820","nonce":2266223499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6816","nonce":2266223499}]},"public_addr":"172.21.15.37:6809/2266223499","cluster_addr":"172.21.15.37:6813/2266223499","heartbeat_back_addr":"172.21.15.37:6820/2266223499","heartbeat_front_addr":"172.21.15.37:6816/2266223499","state":["exists","up"]},{"osd":3,"uuid":"767b8220-e79a-4a86-a162-6b3b73198379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6812","nonce":4166694594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6817","nonce":4166694594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6828","nonce":4166694594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6822","nonce":4166694594}]},"public_addr":"172.21.15.37:6812/4166694594","cluster_addr":"172.21.15.37:6817/4166694594","heartbeat_back_addr":"172.21.15.37:6828/4166694594","heartbeat_front_addr":"172.21.15.37:6822/4166694594","state":["exists","up"]},{"osd":4,"uuid":"717bd773-ae7e-4236-ac79-900cf99a37c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6801","nonce":3529020407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6803","nonce":3529020407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6807","nonce":3529020407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6805","nonce":3529020407}]},"public_addr":"172.21.15.98:6801/3529020407","cluster_addr":"172.21.15.98:6803/3529020407","heartbeat_back_addr":"172.21.15.98:6807/3529020407","heartbeat_front_addr":"172.21.15.98:6805/3529020407","state":["exists","up"]},{"osd":5,"uuid":"a941d358-0f03-4136-a9b2-3a1c2e9358cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6817","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6819","nonce":2311501838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6821","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6823","nonce":2311501838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6829","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6831","nonce":2311501838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6825","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6827","nonce":2311501838}]},"public_addr":"172.21.15.98:6819/2311501838","cluster_addr":"172.21.15.98:6823/2311501838","heartbeat_back_addr":"172.21.15.98:6831/2311501838","heartbeat_front_addr":"172.21.15.98:6827/2311501838","state":["exists","up"]},{"osd":6,"uuid":"27153772-6d4b-479d-9953-0582e7b96743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6809","nonce":1144224691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6811","nonce":1144224691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6815","nonce":1144224691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6813","nonce":1144224691}]},"public_addr":"172.21.15.98:6809/1144224691","cluster_addr":"172.21.15.98:6811/1144224691","heartbeat_back_addr":"172.21.15.98:6815/1144224691","heartbeat_front_addr":"172.21.15.98:6813/1144224691","state":["exists","up"]},{"osd":7,"uuid":"d21ffc8e-40bb-47eb-af2c-e3e730d3fb76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6818","nonce":1144470927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6822","nonce":1144470927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6830","nonce":1144470927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6826","nonce":1144470927}]},"public_addr":"172.21.15.98:6818/1144470927","cluster_addr":"172.21.15.98:6822/1144470927","heartbeat_back_addr":"172.21.15.98:6830/1144470927","heartbeat_front_addr":"172.21.15.98:6826/1144470927","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.921114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.739210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.024016+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.002527+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.698127+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.813416+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.709351+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.815457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T15:56:04.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.256+0000 7f3b095ff700 1 -- 172.21.15.37:0/2179086278 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f3af006ace0 msgr2=0x7f3af006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:04.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.256+0000 7f3b095ff700 1 --2- 172.21.15.37:0/2179086278 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f3af006ace0 0x7f3af006d190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3b040cd440 tx=0x7f3af8009210 comp rx=0 tx=0).stop 2023-07-14T15:56:04.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.256+0000 7f3b095ff700 1 -- 172.21.15.37:0/2179086278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b040b4910 msgr2=0x7f3b040caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:04.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.256+0000 7f3b095ff700 1 --2- 172.21.15.37:0/2179086278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b040b4910 0x7f3b040caa90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3af4014040 tx=0x7f3af4004750 comp rx=0 tx=0).stop 2023-07-14T15:56:04.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.256+0000 7f3b095ff700 1 -- 172.21.15.37:0/2179086278 shutdown_connections 2023-07-14T15:56:04.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.256+0000 7f3b095ff700 1 --2- 172.21.15.37:0/2179086278 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f3af006ace0 0x7f3af006d190 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:04.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.256+0000 7f3b095ff700 1 --2- 172.21.15.37:0/2179086278 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3b040b85f0 0x7f3b041f1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:04.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.256+0000 7f3b095ff700 1 --2- 172.21.15.37:0/2179086278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b040b4910 0x7f3b040caa90 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:04.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.256+0000 7f3b095ff700 1 --2- 172.21.15.37:0/2179086278 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b040b54b0 0x7f3b040a9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:04.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.256+0000 7f3b095ff700 1 -- 172.21.15.37:0/2179086278 >> 172.21.15.37:0/2179086278 conn(0x7f3b0406a580 msgr2=0x7f3b04072e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:04.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.256+0000 7f3b095ff700 1 -- 172.21.15.37:0/2179086278 shutdown_connections 2023-07-14T15:56:04.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.256+0000 7f3b095ff700 1 -- 172.21.15.37:0/2179086278 wait complete. 2023-07-14T15:56:04.261 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T15:55:52.907261+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T15:55:59.992839+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T15:56:04.262 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T15:56:04.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.479+0000 7ff1947ff700 1 Processor -- start 2023-07-14T15:56:04.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.479+0000 7ff1947ff700 1 -- start start 2023-07-14T15:56:04.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.480+0000 7ff1947ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff18c15fee0 0x7ff18c15ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:04.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.480+0000 7ff1947ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff18c1603b0 0x7ff18c0d0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:04.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.480+0000 7ff1947ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff18c0d13d0 con 0x7ff18c0d0f70 2023-07-14T15:56:04.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.480+0000 7ff1947ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff18c15dc50 con 0x7ff18c1603b0 2023-07-14T15:56:04.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.480+0000 7ff1947ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c0b2940 con 0x7ff18c15fee0 2023-07-14T15:56:04.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.480+0000 7ff191d9a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff18c1603b0 0x7ff18c0d0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:04.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.481+0000 7ff191d9a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff18c1603b0 0x7ff18c0d0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47690/0 (socket says 172.21.15.37:47690) 2023-07-14T15:56:04.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.481+0000 7ff191d9a700 1 -- 172.21.15.37:0/2178239517 learned_addr learned my addr 172.21.15.37:0/2178239517 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:04.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.481+0000 7ff19259b700 1 --2- 172.21.15.37:0/2178239517 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff18c15fee0 0x7ff18c15ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:04.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.481+0000 7ff191d9a700 1 -- 172.21.15.37:0/2178239517 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff18c15fee0 msgr2=0x7ff18c15ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:04.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.481+0000 7ff191d9a700 1 --2- 172.21.15.37:0/2178239517 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff18c15fee0 0x7ff18c15ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:04.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.481+0000 7ff191d9a700 1 -- 172.21.15.37:0/2178239517 >> v1:172.21.15.98:6789/0 conn(0x7ff18c0d0f70 legacy=0x7ff18c0b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:04.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.481+0000 7ff191d9a700 1 -- 172.21.15.37:0/2178239517 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff18c0b2c20 con 0x7ff18c1603b0 2023-07-14T15:56:04.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.481+0000 7ff191599700 1 -- 172.21.15.37:0/2178239517 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3199404793 0 0) 0x7ff18c0d13d0 con 0x7ff18c0d0f70 2023-07-14T15:56:04.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.481+0000 7ff191d9a700 1 --2- 172.21.15.37:0/2178239517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff18c1603b0 0x7ff18c0d0a30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff17c0098f0 tx=0x7ff17c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a4b84d05ecccb0c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:04.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.481+0000 7ff191599700 1 -- 172.21.15.37:0/2178239517 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c011830 con 0x7ff18c1603b0 2023-07-14T15:56:04.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.481+0000 7ff191599700 1 -- 172.21.15.37:0/2178239517 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff17c011990 con 0x7ff18c1603b0 2023-07-14T15:56:04.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.482+0000 7ff191599700 1 -- 172.21.15.37:0/2178239517 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c011d20 con 0x7ff18c1603b0 2023-07-14T15:56:04.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.482+0000 7ff1947ff700 1 -- 172.21.15.37:0/2178239517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff18c1603b0 msgr2=0x7ff18c0d0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:04.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.482+0000 7ff1947ff700 1 --2- 172.21.15.37:0/2178239517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff18c1603b0 0x7ff18c0d0a30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff17c0098f0 tx=0x7ff17c009c00 comp rx=0 tx=0).stop 2023-07-14T15:56:04.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.482+0000 7ff1947ff700 1 -- 172.21.15.37:0/2178239517 shutdown_connections 2023-07-14T15:56:04.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.482+0000 7ff1947ff700 1 --2- 172.21.15.37:0/2178239517 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff18c15fee0 0x7ff18c15ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:04.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.482+0000 7ff1947ff700 1 --2- 172.21.15.37:0/2178239517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff18c1603b0 0x7ff18c0d0a30 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:04.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.482+0000 7ff1947ff700 1 -- 172.21.15.37:0/2178239517 >> 172.21.15.37:0/2178239517 conn(0x7ff18c09c1b0 msgr2=0x7ff18c0d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:04.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.482+0000 7ff1947ff700 1 -- 172.21.15.37:0/2178239517 shutdown_connections 2023-07-14T15:56:04.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.482+0000 7ff1947ff700 1 -- 172.21.15.37:0/2178239517 wait complete. 2023-07-14T15:56:04.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.484+0000 7ff1947ff700 1 Processor -- start 2023-07-14T15:56:04.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.484+0000 7ff1947ff700 1 -- start start 2023-07-14T15:56:04.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.485+0000 7ff1947ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff18c0d0f70 0x7ff18c0c7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:04.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.485+0000 7ff1947ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff18c15fee0 0x7ff18c15a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:04.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.485+0000 7ff1947ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff18c1603b0 0x7ff18c15aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:04.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.485+0000 7ff1947ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c0c64f0 con 0x7ff18c15fee0 2023-07-14T15:56:04.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.485+0000 7ff1947ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c0b6af0 con 0x7ff18c0d0f70 2023-07-14T15:56:04.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.485+0000 7ff1947ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c0c6740 con 0x7ff18c1603b0 2023-07-14T15:56:04.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.485+0000 7ff191d9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff18c15fee0 0x7ff18c15a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:04.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.485+0000 7ff191d9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff18c15fee0 0x7ff18c15a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47702/0 (socket says 172.21.15.37:47702) 2023-07-14T15:56:04.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.485+0000 7ff191d9a700 1 -- 172.21.15.37:0/1656786435 learned_addr learned my addr 172.21.15.37:0/1656786435 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:04.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.485+0000 7ff19259b700 1 --2- 172.21.15.37:0/1656786435 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff18c0d0f70 0x7ff18c0c7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:04.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.485+0000 7ff192d9c700 1 --2- 172.21.15.37:0/1656786435 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff18c1603b0 0x7ff18c15aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:04.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.486+0000 7ff191d9a700 1 -- 172.21.15.37:0/1656786435 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff18c1603b0 msgr2=0x7ff18c15aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:04.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.486+0000 7ff191d9a700 1 --2- 172.21.15.37:0/1656786435 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff18c1603b0 0x7ff18c15aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:04.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.486+0000 7ff191d9a700 1 -- 172.21.15.37:0/1656786435 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff18c0d0f70 msgr2=0x7ff18c0c7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:04.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.486+0000 7ff191d9a700 1 --2- 172.21.15.37:0/1656786435 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff18c0d0f70 0x7ff18c0c7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:04.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.486+0000 7ff191d9a700 1 -- 172.21.15.37:0/1656786435 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff17c009550 con 0x7ff18c15fee0 2023-07-14T15:56:04.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.486+0000 7ff192d9c700 1 --2- 172.21.15.37:0/1656786435 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff18c1603b0 0x7ff18c15aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:56:04.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.486+0000 7ff191d9a700 1 --2- 172.21.15.37:0/1656786435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff18c15fee0 0x7ff18c15a520 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff17c014040 tx=0x7ff17c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:04.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.486+0000 7ff182ffd700 1 -- 172.21.15.37:0/1656786435 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c004480 con 0x7ff18c15fee0 2023-07-14T15:56:04.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.486+0000 7ff182ffd700 1 -- 172.21.15.37:0/1656786435 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff17c01f070 con 0x7ff18c15fee0 2023-07-14T15:56:04.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.486+0000 7ff1947ff700 1 -- 172.21.15.37:0/1656786435 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff18c0c6a20 con 0x7ff18c15fee0 2023-07-14T15:56:04.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.486+0000 7ff182ffd700 1 -- 172.21.15.37:0/1656786435 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c0038a0 con 0x7ff18c15fee0 2023-07-14T15:56:04.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.486+0000 7ff1947ff700 1 -- 172.21.15.37:0/1656786435 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff18c158910 con 0x7ff18c15fee0 2023-07-14T15:56:04.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.487+0000 7ff1947ff700 1 -- 172.21.15.37:0/1656786435 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff18c0c6f40 con 0x7ff18c15fee0 2023-07-14T15:56:04.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.488+0000 7ff182ffd700 1 -- 172.21.15.37:0/1656786435 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff17c021030 con 0x7ff18c15fee0 2023-07-14T15:56:04.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.489+0000 7ff182ffd700 1 --2- 172.21.15.37:0/1656786435 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff17006ace0 0x7ff17006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:04.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.489+0000 7ff182ffd700 1 -- 172.21.15.37:0/1656786435 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff17c08a5d0 con 0x7ff18c15fee0 2023-07-14T15:56:04.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.489+0000 7ff19259b700 1 --2- 172.21.15.37:0/1656786435 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff17006ace0 0x7ff17006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:04.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.490+0000 7ff19259b700 1 --2- 172.21.15.37:0/1656786435 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff17006ace0 0x7ff17006d190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff188009b70 tx=0x7ff188008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:04.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.493+0000 7ff182ffd700 1 -- 172.21.15.37:0/1656786435 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff18c0c6f40 con 0x7ff18c15fee0 2023-07-14T15:56:04.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.700+0000 7ff1947ff700 1 -- 172.21.15.37:0/1656786435 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff18c0c6f40 con 0x7ff18c15fee0 2023-07-14T15:56:04.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.700+0000 7ff182ffd700 1 -- 172.21.15.37:0/1656786435 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff18c0c6f40 con 0x7ff18c15fee0 2023-07-14T15:56:04.688 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-14T15:56:04.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.703+0000 7ff1947ff700 1 -- 172.21.15.37:0/1656786435 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff17006ace0 msgr2=0x7ff17006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:04.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.703+0000 7ff1947ff700 1 --2- 172.21.15.37:0/1656786435 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff17006ace0 0x7ff17006d190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff188009b70 tx=0x7ff188008040 comp rx=0 tx=0).stop 2023-07-14T15:56:04.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.703+0000 7ff1947ff700 1 -- 172.21.15.37:0/1656786435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff18c15fee0 msgr2=0x7ff18c15a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:04.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.703+0000 7ff1947ff700 1 --2- 172.21.15.37:0/1656786435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff18c15fee0 0x7ff18c15a520 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff17c014040 tx=0x7ff17c004750 comp rx=0 tx=0).stop 2023-07-14T15:56:04.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.703+0000 7ff1947ff700 1 -- 172.21.15.37:0/1656786435 shutdown_connections 2023-07-14T15:56:04.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.703+0000 7ff1947ff700 1 --2- 172.21.15.37:0/1656786435 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff18c0d0f70 0x7ff18c0c7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:04.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.703+0000 7ff1947ff700 1 --2- 172.21.15.37:0/1656786435 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff17006ace0 0x7ff17006d190 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:04.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.703+0000 7ff1947ff700 1 --2- 172.21.15.37:0/1656786435 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff18c1603b0 0x7ff18c15aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:04.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.703+0000 7ff1947ff700 1 --2- 172.21.15.37:0/1656786435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff18c15fee0 0x7ff18c15a520 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:04.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.703+0000 7ff1947ff700 1 -- 172.21.15.37:0/1656786435 >> 172.21.15.37:0/1656786435 conn(0x7ff18c09c1b0 msgr2=0x7ff18c06b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:04.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.703+0000 7ff1947ff700 1 -- 172.21.15.37:0/1656786435 shutdown_connections 2023-07-14T15:56:04.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.703+0000 7ff1947ff700 1 -- 172.21.15.37:0/1656786435 wait complete. 2023-07-14T15:56:04.708 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T15:56:04.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.926+0000 7f2f76bff700 1 Processor -- start 2023-07-14T15:56:04.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.926+0000 7f2f76bff700 1 -- start start 2023-07-14T15:56:04.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.927+0000 7f2f76bff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f2f700d1140 0x7f2f7015ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:04.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.927+0000 7f2f76bff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2f701603b0 0x7f2f700b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:04.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.927+0000 7f2f76bff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f7015dc50 con 0x7f2f7015fee0 2023-07-14T15:56:04.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.927+0000 7f2f76bff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f700b2940 con 0x7f2f701603b0 2023-07-14T15:56:04.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.927+0000 7f2f76bff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f700b2c20 con 0x7f2f700d1140 2023-07-14T15:56:04.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.928+0000 7f2f7519c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2f701603b0 0x7f2f700b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:04.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.928+0000 7f2f7499b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2f7015fee0 0x7f2f700d0a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50502/0 (socket says 172.21.15.37:50502) 2023-07-14T15:56:04.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.928+0000 7f2f7499b700 1 -- 172.21.15.37:0/1432218352 learned_addr learned my addr 172.21.15.37:0/1432218352 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:04.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.928+0000 7f2f6ffff700 1 --2- 172.21.15.37:0/1432218352 >> v2:172.21.15.98:3300/0 conn(0x7f2f700d1140 0x7f2f7015ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:04.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.928+0000 7f2f7519c700 1 -- 172.21.15.37:0/1432218352 >> v2:172.21.15.98:3300/0 conn(0x7f2f700d1140 msgr2=0x7f2f7015ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:04.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.928+0000 7f2f7519c700 1 --2- 172.21.15.37:0/1432218352 >> v2:172.21.15.98:3300/0 conn(0x7f2f700d1140 0x7f2f7015ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:04.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.928+0000 7f2f7519c700 1 -- 172.21.15.37:0/1432218352 >> v1:172.21.15.37:6789/0 conn(0x7f2f7015fee0 legacy=0x7f2f700d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:04.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.928+0000 7f2f7519c700 1 -- 172.21.15.37:0/1432218352 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f700b2f00 con 0x7f2f701603b0 2023-07-14T15:56:04.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.928+0000 7f2f7519c700 1 --2- 172.21.15.37:0/1432218352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f701603b0 0x7f2f700b39e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2f7009c850 tx=0x7f2f6800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d37126aa05a80bd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:04.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.929+0000 7f2f6f7fe700 1 -- 172.21.15.37:0/1432218352 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6800e070 con 0x7f2f701603b0 2023-07-14T15:56:04.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.929+0000 7f2f6f7fe700 1 -- 172.21.15.37:0/1432218352 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f6800bb20 con 0x7f2f701603b0 2023-07-14T15:56:04.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.929+0000 7f2f6f7fe700 1 -- 172.21.15.37:0/1432218352 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f68012430 con 0x7f2f701603b0 2023-07-14T15:56:04.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.930+0000 7f2f76bff700 1 -- 172.21.15.37:0/1432218352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f701603b0 msgr2=0x7f2f700b39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:04.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.930+0000 7f2f76bff700 1 --2- 172.21.15.37:0/1432218352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f701603b0 0x7f2f700b39e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2f7009c850 tx=0x7f2f6800b330 comp rx=0 tx=0).stop 2023-07-14T15:56:04.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.930+0000 7f2f76bff700 1 -- 172.21.15.37:0/1432218352 shutdown_connections 2023-07-14T15:56:04.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.930+0000 7f2f76bff700 1 --2- 172.21.15.37:0/1432218352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f701603b0 0x7f2f700b39e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:04.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.930+0000 7f2f76bff700 1 --2- 172.21.15.37:0/1432218352 >> v2:172.21.15.98:3300/0 conn(0x7f2f700d1140 0x7f2f7015ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:04.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.930+0000 7f2f76bff700 1 -- 172.21.15.37:0/1432218352 >> 172.21.15.37:0/1432218352 conn(0x7f2f7009c1b0 msgr2=0x7f2f700d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:04.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.930+0000 7f2f76bff700 1 -- 172.21.15.37:0/1432218352 shutdown_connections 2023-07-14T15:56:04.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.930+0000 7f2f76bff700 1 -- 172.21.15.37:0/1432218352 wait complete. 2023-07-14T15:56:04.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.932+0000 7f2f76bff700 1 Processor -- start 2023-07-14T15:56:04.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.932+0000 7f2f76bff700 1 -- start start 2023-07-14T15:56:04.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.933+0000 7f2f76bff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2f700d1140 0x7f2f701f18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:04.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.933+0000 7f2f76bff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f7015fee0 0x7f2f700b66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:04.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.933+0000 7f2f76bff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f701603b0 0x7f2f700b1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:04.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.933+0000 7f2f76bff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f701f1e10 con 0x7f2f701603b0 2023-07-14T15:56:04.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.933+0000 7f2f76bff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7006bb30 con 0x7f2f7015fee0 2023-07-14T15:56:04.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.933+0000 7f2f76bff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f700c74e0 con 0x7f2f700d1140 2023-07-14T15:56:04.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.933+0000 7f2f7519c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f701603b0 0x7f2f700b1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:04.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.933+0000 7f2f7519c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f701603b0 0x7f2f700b1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47722/0 (socket says 172.21.15.37:47722) 2023-07-14T15:56:04.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.933+0000 7f2f7519c700 1 -- 172.21.15.37:0/219501959 learned_addr learned my addr 172.21.15.37:0/219501959 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:04.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.933+0000 7f2f6ffff700 1 --2- 172.21.15.37:0/219501959 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f7015fee0 0x7f2f700b66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:04.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.933+0000 7f2f7499b700 1 --2- 172.21.15.37:0/219501959 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2f700d1140 0x7f2f701f18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:04.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.934+0000 7f2f7519c700 1 -- 172.21.15.37:0/219501959 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2f700d1140 msgr2=0x7f2f701f18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:04.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.934+0000 7f2f7519c700 1 --2- 172.21.15.37:0/219501959 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2f700d1140 0x7f2f701f18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:04.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.934+0000 7f2f7519c700 1 -- 172.21.15.37:0/219501959 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f7015fee0 msgr2=0x7f2f700b66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:04.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.934+0000 7f2f7519c700 1 --2- 172.21.15.37:0/219501959 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f7015fee0 0x7f2f700b66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:04.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.934+0000 7f2f7519c700 1 -- 172.21.15.37:0/219501959 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f68009a70 con 0x7f2f701603b0 2023-07-14T15:56:04.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.934+0000 7f2f7499b700 1 --2- 172.21.15.37:0/219501959 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2f700d1140 0x7f2f701f18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:56:04.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.934+0000 7f2f7519c700 1 --2- 172.21.15.37:0/219501959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f701603b0 0x7f2f700b1000 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2f7008b260 tx=0x7f2f68004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:04.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.934+0000 7f2f6d7fa700 1 -- 172.21.15.37:0/219501959 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f68012430 con 0x7f2f701603b0 2023-07-14T15:56:04.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.934+0000 7f2f6d7fa700 1 -- 172.21.15.37:0/219501959 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f68020070 con 0x7f2f701603b0 2023-07-14T15:56:04.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.934+0000 7f2f6d7fa700 1 -- 172.21.15.37:0/219501959 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f68004280 con 0x7f2f701603b0 2023-07-14T15:56:04.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.934+0000 7f2f76bff700 1 -- 172.21.15.37:0/219501959 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f700c68d0 con 0x7f2f701603b0 2023-07-14T15:56:04.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.934+0000 7f2f76bff700 1 -- 172.21.15.37:0/219501959 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f700c6e90 con 0x7f2f701603b0 2023-07-14T15:56:04.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.935+0000 7f2f76bff700 1 -- 172.21.15.37:0/219501959 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f700c7690 con 0x7f2f701603b0 2023-07-14T15:56:04.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.936+0000 7f2f6d7fa700 1 -- 172.21.15.37:0/219501959 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2f680043e0 con 0x7f2f701603b0 2023-07-14T15:56:04.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.937+0000 7f2f6d7fa700 1 --2- 172.21.15.37:0/219501959 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f2f5406ace0 0x7f2f5406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:04.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.937+0000 7f2f6d7fa700 1 -- 172.21.15.37:0/219501959 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2f68022070 con 0x7f2f701603b0 2023-07-14T15:56:04.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.938+0000 7f2f7499b700 1 --2- 172.21.15.37:0/219501959 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f2f5406ace0 0x7f2f5406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:04.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.939+0000 7f2f7499b700 1 --2- 172.21.15.37:0/219501959 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f2f5406ace0 0x7f2f5406d190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2f64007fd0 tx=0x7f2f64009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:04.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:04.942+0000 7f2f6d7fa700 1 -- 172.21.15.37:0/219501959 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2f700c7690 con 0x7f2f701603b0 2023-07-14T15:56:05.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.148+0000 7f2f76bff700 1 -- 172.21.15.37:0/219501959 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2f700c7650 con 0x7f2f701603b0 2023-07-14T15:56:05.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.149+0000 7f2f6d7fa700 1 -- 172.21.15.37:0/219501959 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2f6802c020 con 0x7f2f701603b0 2023-07-14T15:56:05.137 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-14T15:56:05.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.151+0000 7f2f76bff700 1 -- 172.21.15.37:0/219501959 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f2f5406ace0 msgr2=0x7f2f5406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:05.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.151+0000 7f2f76bff700 1 --2- 172.21.15.37:0/219501959 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f2f5406ace0 0x7f2f5406d190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2f64007fd0 tx=0x7f2f64009040 comp rx=0 tx=0).stop 2023-07-14T15:56:05.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.151+0000 7f2f76bff700 1 -- 172.21.15.37:0/219501959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f701603b0 msgr2=0x7f2f700b1000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:05.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.151+0000 7f2f76bff700 1 --2- 172.21.15.37:0/219501959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f701603b0 0x7f2f700b1000 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2f7008b260 tx=0x7f2f68004ad0 comp rx=0 tx=0).stop 2023-07-14T15:56:05.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.151+0000 7f2f76bff700 1 -- 172.21.15.37:0/219501959 shutdown_connections 2023-07-14T15:56:05.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.151+0000 7f2f76bff700 1 --2- 172.21.15.37:0/219501959 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f2f5406ace0 0x7f2f5406d190 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:05.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.151+0000 7f2f76bff700 1 --2- 172.21.15.37:0/219501959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f701603b0 0x7f2f700b1000 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:05.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.151+0000 7f2f76bff700 1 --2- 172.21.15.37:0/219501959 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2f700d1140 0x7f2f701f18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:05.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.151+0000 7f2f76bff700 1 --2- 172.21.15.37:0/219501959 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2f7015fee0 0x7f2f700b66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:05.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.151+0000 7f2f76bff700 1 -- 172.21.15.37:0/219501959 >> 172.21.15.37:0/219501959 conn(0x7f2f7009c1b0 msgr2=0x7f2f700d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:05.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.151+0000 7f2f76bff700 1 -- 172.21.15.37:0/219501959 shutdown_connections 2023-07-14T15:56:05.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.151+0000 7f2f76bff700 1 -- 172.21.15.37:0/219501959 wait complete. 2023-07-14T15:56:05.156 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-14T15:56:05.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.371+0000 7f959b1ff700 1 Processor -- start 2023-07-14T15:56:05.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.371+0000 7f959b1ff700 1 -- start start 2023-07-14T15:56:05.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.372+0000 7f959b1ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f95940b85f0 0x7f959415d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:05.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.373+0000 7f959b1ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95940cf6b0 con 0x7f95940b54b0 2023-07-14T15:56:05.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.373+0000 7f959b1ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95940cdc40 con 0x7f95940b4910 2023-07-14T15:56:05.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.373+0000 7f959b1ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f959415dba0 con 0x7f95940b85f0 2023-07-14T15:56:05.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.373+0000 7f9593fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f95940b54b0 0x7f95940cfb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50514/0 (socket says 172.21.15.37:50514) 2023-07-14T15:56:05.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.373+0000 7f9593fff700 1 -- 172.21.15.37:0/1433876059 learned_addr learned my addr 172.21.15.37:0/1433876059 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:05.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.373+0000 7f9598f9b700 1 --2- 172.21.15.37:0/1433876059 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f95940b85f0 0x7f959415d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:05.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.373+0000 7f95937fe700 1 -- 172.21.15.37:0/1433876059 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2477295756 0 0) 0x7f95940cf6b0 con 0x7f95940b54b0 2023-07-14T15:56:05.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.373+0000 7f95937fe700 1 -- 172.21.15.37:0/1433876059 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95840035b0 con 0x7f95940b54b0 2023-07-14T15:56:05.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.373+0000 7f95937fe700 1 -- 172.21.15.37:0/1433876059 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1334339430 0 0) 0x7f95940cdc40 con 0x7f95940b4910 2023-07-14T15:56:05.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.373+0000 7f95937fe700 1 -- 172.21.15.37:0/1433876059 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95940cf6b0 con 0x7f95940b4910 2023-07-14T15:56:05.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.373+0000 7f9598f9b700 1 -- 172.21.15.37:0/1433876059 >> v1:172.21.15.98:6789/0 conn(0x7f95940b4910 legacy=0x7f959415dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:05.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.373+0000 7f9598f9b700 1 -- 172.21.15.37:0/1433876059 >> v1:172.21.15.37:6789/0 conn(0x7f95940b54b0 legacy=0x7f95940cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:05.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.373+0000 7f95937fe700 1 -- 172.21.15.37:0/1433876059 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2876776438 0 0) 0x7f95840035b0 con 0x7f95940b54b0 2023-07-14T15:56:05.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.373+0000 7f9598f9b700 1 -- 172.21.15.37:0/1433876059 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95940d0250 con 0x7f95940b85f0 2023-07-14T15:56:05.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.374+0000 7f9598f9b700 1 --2- 172.21.15.37:0/1433876059 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f95940b85f0 0x7f959415d660 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9588009870 tx=0x7f9588009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=555b33e1d7eb037b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:05.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.374+0000 7f95937fe700 1 -- 172.21.15.37:0/1433876059 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9580001670 con 0x7f95940b85f0 2023-07-14T15:56:05.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.374+0000 7f95937fe700 1 -- 172.21.15.37:0/1433876059 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9588004030 con 0x7f95940b85f0 2023-07-14T15:56:05.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.374+0000 7f95937fe700 1 -- 172.21.15.37:0/1433876059 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95880043c0 con 0x7f95940b85f0 2023-07-14T15:56:05.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.375+0000 7f959b1ff700 1 -- 172.21.15.37:0/1433876059 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f95940b85f0 msgr2=0x7f959415d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:05.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.375+0000 7f959b1ff700 1 --2- 172.21.15.37:0/1433876059 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f95940b85f0 0x7f959415d660 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9588009870 tx=0x7f9588009b80 comp rx=0 tx=0).stop 2023-07-14T15:56:05.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.375+0000 7f959b1ff700 1 -- 172.21.15.37:0/1433876059 shutdown_connections 2023-07-14T15:56:05.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.375+0000 7f959b1ff700 1 --2- 172.21.15.37:0/1433876059 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f95940b85f0 0x7f959415d660 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:05.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.375+0000 7f959b1ff700 1 -- 172.21.15.37:0/1433876059 >> 172.21.15.37:0/1433876059 conn(0x7f959406a580 msgr2=0x7f959406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:05.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.375+0000 7f959b1ff700 1 -- 172.21.15.37:0/1433876059 shutdown_connections 2023-07-14T15:56:05.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.375+0000 7f959b1ff700 1 -- 172.21.15.37:0/1433876059 wait complete. 2023-07-14T15:56:05.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.376+0000 7f959b1ff700 1 Processor -- start 2023-07-14T15:56:05.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.377+0000 7f959b1ff700 1 -- start start 2023-07-14T15:56:05.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.377+0000 7f959b1ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95940b4910 0x7f95940c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:05.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.377+0000 7f959b1ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95940b54b0 0x7f959414d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:05.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.377+0000 7f959b1ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f95940b85f0 0x7f95941f5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:05.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.377+0000 7f959b1ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95940c9120 con 0x7f95940b4910 2023-07-14T15:56:05.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.377+0000 7f959b1ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95940c9400 con 0x7f95940b54b0 2023-07-14T15:56:05.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.377+0000 7f959b1ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95940c96e0 con 0x7f95940b85f0 2023-07-14T15:56:05.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.378+0000 7f9598f9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95940b4910 0x7f95940c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:05.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.378+0000 7f9598f9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95940b4910 0x7f95940c8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47738/0 (socket says 172.21.15.37:47738) 2023-07-14T15:56:05.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.378+0000 7f9598f9b700 1 -- 172.21.15.37:0/2655966822 learned_addr learned my addr 172.21.15.37:0/2655966822 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:05.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.378+0000 7f9593fff700 1 --2- 172.21.15.37:0/2655966822 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95940b54b0 0x7f959414d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:05.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.378+0000 7f9598f9b700 1 -- 172.21.15.37:0/2655966822 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f95940b85f0 msgr2=0x7f95941f5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:05.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.378+0000 7f959979c700 1 --2- 172.21.15.37:0/2655966822 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f95940b85f0 0x7f95941f5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:05.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.378+0000 7f9598f9b700 1 --2- 172.21.15.37:0/2655966822 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f95940b85f0 0x7f95941f5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:05.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.378+0000 7f9598f9b700 1 -- 172.21.15.37:0/2655966822 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95940b54b0 msgr2=0x7f959414d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:05.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.378+0000 7f9598f9b700 1 --2- 172.21.15.37:0/2655966822 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95940b54b0 0x7f959414d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:05.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.378+0000 7f9598f9b700 1 -- 172.21.15.37:0/2655966822 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95880094a0 con 0x7f95940b4910 2023-07-14T15:56:05.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.378+0000 7f9593fff700 1 --2- 172.21.15.37:0/2655966822 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95940b54b0 0x7f959414d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:56:05.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.378+0000 7f959979c700 1 --2- 172.21.15.37:0/2655966822 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f95940b85f0 0x7f95941f5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:56:05.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.378+0000 7f9598f9b700 1 --2- 172.21.15.37:0/2655966822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95940b4910 0x7f95940c8a20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9588000c00 tx=0x7f9588004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:05.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.379+0000 7f95917fa700 1 -- 172.21.15.37:0/2655966822 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9588003df0 con 0x7f95940b4910 2023-07-14T15:56:05.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.379+0000 7f95917fa700 1 -- 172.21.15.37:0/2655966822 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f958801f070 con 0x7f95940b4910 2023-07-14T15:56:05.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.379+0000 7f95917fa700 1 -- 172.21.15.37:0/2655966822 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9588011870 con 0x7f95940b4910 2023-07-14T15:56:05.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.379+0000 7f959b1ff700 1 -- 172.21.15.37:0/2655966822 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95941f57a0 con 0x7f95940b4910 2023-07-14T15:56:05.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.379+0000 7f959b1ff700 1 -- 172.21.15.37:0/2655966822 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95940cc420 con 0x7f95940b4910 2023-07-14T15:56:05.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.380+0000 7f959b1ff700 1 -- 172.21.15.37:0/2655966822 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9594067840 con 0x7f95940b4910 2023-07-14T15:56:05.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.381+0000 7f95917fa700 1 -- 172.21.15.37:0/2655966822 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9588021030 con 0x7f95940b4910 2023-07-14T15:56:05.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.382+0000 7f95917fa700 1 --2- 172.21.15.37:0/2655966822 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f957806ace0 0x7f957806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:05.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.382+0000 7f95917fa700 1 -- 172.21.15.37:0/2655966822 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f958808a680 con 0x7f95940b4910 2023-07-14T15:56:05.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.383+0000 7f9593fff700 1 --2- 172.21.15.37:0/2655966822 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f957806ace0 0x7f957806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:05.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.383+0000 7f9593fff700 1 --2- 172.21.15.37:0/2655966822 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f957806ace0 0x7f957806d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9580001eb0 tx=0x7f9580009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:05.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.386+0000 7f95917fa700 1 -- 172.21.15.37:0/2655966822 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9588055b90 con 0x7f95940b4910 2023-07-14T15:56:05.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.597+0000 7f959b1ff700 1 -- 172.21.15.37:0/2655966822 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f959406b440 con 0x7f95940b4910 2023-07-14T15:56:05.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.598+0000 7f95917fa700 1 -- 172.21.15.37:0/2655966822 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v21) v1 ==== 84+0+126 (secure 0 0 0) 0x7f95880591b0 con 0x7f95940b4910 2023-07-14T15:56:05.585 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:56:05.585 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-07-14T15:56:05.586 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:56:05.586 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2023-07-14T15:56:05.586 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2023-07-14T15:56:05.586 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-14T15:56:05.586 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:56:05.586 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 2, 2023-07-14T15:56:05.586 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": "rbd" 2023-07-14T15:56:05.587 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:56:05.587 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-07-14T15:56:05.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.600+0000 7f959b1ff700 1 -- 172.21.15.37:0/2655966822 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f957806ace0 msgr2=0x7f957806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:05.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.600+0000 7f959b1ff700 1 --2- 172.21.15.37:0/2655966822 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f957806ace0 0x7f957806d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9580001eb0 tx=0x7f9580009040 comp rx=0 tx=0).stop 2023-07-14T15:56:05.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.600+0000 7f959b1ff700 1 -- 172.21.15.37:0/2655966822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95940b4910 msgr2=0x7f95940c8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:05.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.600+0000 7f959b1ff700 1 --2- 172.21.15.37:0/2655966822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95940b4910 0x7f95940c8a20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9588000c00 tx=0x7f9588004750 comp rx=0 tx=0).stop 2023-07-14T15:56:05.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.600+0000 7f959b1ff700 1 -- 172.21.15.37:0/2655966822 shutdown_connections 2023-07-14T15:56:05.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.600+0000 7f959b1ff700 1 --2- 172.21.15.37:0/2655966822 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f957806ace0 0x7f957806d190 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:05.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.600+0000 7f959b1ff700 1 --2- 172.21.15.37:0/2655966822 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f95940b85f0 0x7f95941f5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:05.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.600+0000 7f959b1ff700 1 --2- 172.21.15.37:0/2655966822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95940b4910 0x7f95940c8a20 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:05.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.600+0000 7f959b1ff700 1 --2- 172.21.15.37:0/2655966822 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95940b54b0 0x7f959414d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:05.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.600+0000 7f959b1ff700 1 -- 172.21.15.37:0/2655966822 >> 172.21.15.37:0/2655966822 conn(0x7f959406a580 msgr2=0x7f95940b7170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:05.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.600+0000 7f959b1ff700 1 -- 172.21.15.37:0/2655966822 shutdown_connections 2023-07-14T15:56:05.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.600+0000 7f959b1ff700 1 -- 172.21.15.37:0/2655966822 wait complete. 2023-07-14T15:56:05.605 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-14T15:56:05.606 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-14T15:56:05.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.823+0000 7fbe519ff700 1 Processor -- start 2023-07-14T15:56:05.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.823+0000 7fbe519ff700 1 -- start start 2023-07-14T15:56:05.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.824+0000 7fbe519ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbe4c0cd890 0x7fbe4c0d09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:05.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.825+0000 7fbe519ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe4c0d1270 con 0x7fbe4c1462d0 2023-07-14T15:56:05.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.825+0000 7fbe519ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe4c0d1550 con 0x7fbe4c0cf780 2023-07-14T15:56:05.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.825+0000 7fbe519ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe4c0cdd00 con 0x7fbe4c0cd890 2023-07-14T15:56:05.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.825+0000 7fbe4affd700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fbe4c1462d0 0x7fbe4c0d2310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50520/0 (socket says 172.21.15.37:50520) 2023-07-14T15:56:05.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.825+0000 7fbe4affd700 1 -- 172.21.15.37:0/554758778 learned_addr learned my addr 172.21.15.37:0/554758778 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:05.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.825+0000 7fbe43fff700 1 --2- 172.21.15.37:0/554758778 >> v2:172.21.15.37:3300/0 conn(0x7fbe4c0cd890 0x7fbe4c0d09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:05.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.825+0000 7fbe43fff700 1 -- 172.21.15.37:0/554758778 >> v1:172.21.15.98:6789/0 conn(0x7fbe4c0cf780 legacy=0x7fbe4c0cfba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:05.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.825+0000 7fbe43fff700 1 -- 172.21.15.37:0/554758778 >> v1:172.21.15.37:6789/0 conn(0x7fbe4c1462d0 legacy=0x7fbe4c0d2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:05.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.825+0000 7fbe43fff700 1 -- 172.21.15.37:0/554758778 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe4c0d1830 con 0x7fbe4c0cd890 2023-07-14T15:56:05.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.825+0000 7fbe43fff700 1 --2- 172.21.15.37:0/554758778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe4c0cd890 0x7fbe4c0d09d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbe34009840 tx=0x7fbe34009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cad57eb6e191a672 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:05.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.826+0000 7fbe4a7fc700 1 -- 172.21.15.37:0/554758778 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe34011830 con 0x7fbe4c0cd890 2023-07-14T15:56:05.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.826+0000 7fbe4a7fc700 1 -- 172.21.15.37:0/554758778 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe34011990 con 0x7fbe4c0cd890 2023-07-14T15:56:05.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.826+0000 7fbe4a7fc700 1 -- 172.21.15.37:0/554758778 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe34011d20 con 0x7fbe4c0cd890 2023-07-14T15:56:05.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.826+0000 7fbe519ff700 1 -- 172.21.15.37:0/554758778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe4c0cd890 msgr2=0x7fbe4c0d09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:05.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.826+0000 7fbe519ff700 1 --2- 172.21.15.37:0/554758778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe4c0cd890 0x7fbe4c0d09d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbe34009840 tx=0x7fbe34009b50 comp rx=0 tx=0).stop 2023-07-14T15:56:05.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.826+0000 7fbe519ff700 1 -- 172.21.15.37:0/554758778 shutdown_connections 2023-07-14T15:56:05.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.826+0000 7fbe519ff700 1 --2- 172.21.15.37:0/554758778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe4c0cd890 0x7fbe4c0d09d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:05.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.826+0000 7fbe519ff700 1 -- 172.21.15.37:0/554758778 >> 172.21.15.37:0/554758778 conn(0x7fbe4c06a4d0 msgr2=0x7fbe4c06a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:05.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.826+0000 7fbe519ff700 1 -- 172.21.15.37:0/554758778 shutdown_connections 2023-07-14T15:56:05.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.826+0000 7fbe519ff700 1 -- 172.21.15.37:0/554758778 wait complete. 2023-07-14T15:56:05.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.828+0000 7fbe519ff700 1 Processor -- start 2023-07-14T15:56:05.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.828+0000 7fbe519ff700 1 -- start start 2023-07-14T15:56:05.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.829+0000 7fbe519ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe4c0cd890 0x7fbe4c0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:05.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.829+0000 7fbe519ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbe4c0cf780 0x7fbe4c1f1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:05.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.829+0000 7fbe519ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe4c1462d0 0x7fbe4c0b3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:05.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.829+0000 7fbe519ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4c0cba20 con 0x7fbe4c1462d0 2023-07-14T15:56:05.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.829+0000 7fbe519ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4c0cbd00 con 0x7fbe4c0cd890 2023-07-14T15:56:05.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.829+0000 7fbe519ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4c0cbfe0 con 0x7fbe4c0cf780 2023-07-14T15:56:05.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.829+0000 7fbe4b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe4c1462d0 0x7fbe4c0b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:05.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.829+0000 7fbe4b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe4c1462d0 0x7fbe4c0b3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47758/0 (socket says 172.21.15.37:47758) 2023-07-14T15:56:05.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.830+0000 7fbe4b7fe700 1 -- 172.21.15.37:0/1315845708 learned_addr learned my addr 172.21.15.37:0/1315845708 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:05.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.830+0000 7fbe43fff700 1 --2- 172.21.15.37:0/1315845708 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbe4c0cf780 0x7fbe4c1f1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:05.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.830+0000 7fbe4affd700 1 --2- 172.21.15.37:0/1315845708 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe4c0cd890 0x7fbe4c0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:05.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.830+0000 7fbe4b7fe700 1 -- 172.21.15.37:0/1315845708 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbe4c0cf780 msgr2=0x7fbe4c1f1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:05.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.830+0000 7fbe4b7fe700 1 --2- 172.21.15.37:0/1315845708 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbe4c0cf780 0x7fbe4c1f1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:05.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.830+0000 7fbe4b7fe700 1 -- 172.21.15.37:0/1315845708 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe4c0cd890 msgr2=0x7fbe4c0b7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:05.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.830+0000 7fbe4b7fe700 1 --2- 172.21.15.37:0/1315845708 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe4c0cd890 0x7fbe4c0b7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:05.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.830+0000 7fbe4b7fe700 1 -- 172.21.15.37:0/1315845708 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe340094a0 con 0x7fbe4c1462d0 2023-07-14T15:56:05.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.830+0000 7fbe4affd700 1 --2- 172.21.15.37:0/1315845708 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe4c0cd890 0x7fbe4c0b7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:56:05.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.830+0000 7fbe4b7fe700 1 --2- 172.21.15.37:0/1315845708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe4c1462d0 0x7fbe4c0b3620 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbe4400cba0 tx=0x7fbe4400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:05.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.830+0000 7fbe48ff9700 1 -- 172.21.15.37:0/1315845708 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe44003c00 con 0x7fbe4c1462d0 2023-07-14T15:56:05.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.830+0000 7fbe519ff700 1 -- 172.21.15.37:0/1315845708 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe4c0cc2c0 con 0x7fbe4c1462d0 2023-07-14T15:56:05.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.830+0000 7fbe519ff700 1 -- 172.21.15.37:0/1315845708 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe4c0b3280 con 0x7fbe4c1462d0 2023-07-14T15:56:05.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.830+0000 7fbe48ff9700 1 -- 172.21.15.37:0/1315845708 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe44001c80 con 0x7fbe4c1462d0 2023-07-14T15:56:05.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.830+0000 7fbe48ff9700 1 -- 172.21.15.37:0/1315845708 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4400a980 con 0x7fbe4c1462d0 2023-07-14T15:56:05.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.831+0000 7fbe519ff700 1 -- 172.21.15.37:0/1315845708 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe4c067840 con 0x7fbe4c1462d0 2023-07-14T15:56:05.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.833+0000 7fbe48ff9700 1 -- 172.21.15.37:0/1315845708 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbe4400aae0 con 0x7fbe4c1462d0 2023-07-14T15:56:05.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.834+0000 7fbe48ff9700 1 --2- 172.21.15.37:0/1315845708 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbe2c06ace0 0x7fbe2c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:05.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.834+0000 7fbe48ff9700 1 -- 172.21.15.37:0/1315845708 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fbe44089280 con 0x7fbe4c1462d0 2023-07-14T15:56:05.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.834+0000 7fbe4affd700 1 --2- 172.21.15.37:0/1315845708 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbe2c06ace0 0x7fbe2c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:05.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.835+0000 7fbe4affd700 1 --2- 172.21.15.37:0/1315845708 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbe2c06ace0 0x7fbe2c06d190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c005910 tx=0x7fbe3c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:05.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:05.839+0000 7fbe48ff9700 1 -- 172.21.15.37:0/1315845708 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fbe440545f0 con 0x7fbe4c1462d0 2023-07-14T15:56:06.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:06.050+0000 7fbe519ff700 1 -- 172.21.15.37:0/1315845708 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fbe4c0cbb60 con 0x7fbe4c1462d0 2023-07-14T15:56:06.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:06.937+0000 7fbe48ff9700 1 -- 172.21.15.37:0/1315845708 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v22) v1 ==== 138+0+0 (secure 0 0 0) 0x7fbe4c0cbb60 con 0x7fbe4c1462d0 2023-07-14T15:56:06.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:06.944+0000 7fbe519ff700 1 -- 172.21.15.37:0/1315845708 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbe2c06ace0 msgr2=0x7fbe2c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:06.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:06.944+0000 7fbe519ff700 1 --2- 172.21.15.37:0/1315845708 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbe2c06ace0 0x7fbe2c06d190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c005910 tx=0x7fbe3c009040 comp rx=0 tx=0).stop 2023-07-14T15:56:06.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:06.944+0000 7fbe519ff700 1 -- 172.21.15.37:0/1315845708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe4c1462d0 msgr2=0x7fbe4c0b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:06.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:06.944+0000 7fbe519ff700 1 --2- 172.21.15.37:0/1315845708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe4c1462d0 0x7fbe4c0b3620 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbe4400cba0 tx=0x7fbe4400cf60 comp rx=0 tx=0).stop 2023-07-14T15:56:06.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:06.945+0000 7fbe519ff700 1 -- 172.21.15.37:0/1315845708 shutdown_connections 2023-07-14T15:56:06.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:06.945+0000 7fbe519ff700 1 --2- 172.21.15.37:0/1315845708 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe4c0cd890 0x7fbe4c0b7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:06.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:06.945+0000 7fbe519ff700 1 --2- 172.21.15.37:0/1315845708 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbe2c06ace0 0x7fbe2c06d190 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:06.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:06.945+0000 7fbe519ff700 1 --2- 172.21.15.37:0/1315845708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe4c1462d0 0x7fbe4c0b3620 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:06.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:06.945+0000 7fbe519ff700 1 --2- 172.21.15.37:0/1315845708 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbe4c0cf780 0x7fbe4c1f1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:06.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:06.945+0000 7fbe519ff700 1 -- 172.21.15.37:0/1315845708 >> 172.21.15.37:0/1315845708 conn(0x7fbe4c06a4d0 msgr2=0x7fbe4c15f410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:06.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:06.945+0000 7fbe519ff700 1 -- 172.21.15.37:0/1315845708 shutdown_connections 2023-07-14T15:56:06.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:06.946+0000 7fbe519ff700 1 -- 172.21.15.37:0/1315845708 wait complete. 2023-07-14T15:56:06.936 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2023-07-14T15:56:06.956 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-14T15:56:07.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.183+0000 7f45425ff700 1 Processor -- start 2023-07-14T15:56:07.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.183+0000 7f45425ff700 1 -- start start 2023-07-14T15:56:07.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.184+0000 7f45425ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f453c15ff50 0x7f453c0d0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:07.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.184+0000 7f45425ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f453c0b4720 con 0x7f453c0d2ab0 2023-07-14T15:56:07.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.184+0000 7f45425ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f453c0b3a50 con 0x7f453c0b1fc0 2023-07-14T15:56:07.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.184+0000 7f45425ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f453c0b0560 con 0x7f453c15ff50 2023-07-14T15:56:07.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.185+0000 7f453b7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f453c0d2ab0 0x7f453c0b2820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50526/0 (socket says 172.21.15.37:50526) 2023-07-14T15:56:07.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.185+0000 7f453b7fe700 1 -- 172.21.15.37:0/124695000 learned_addr learned my addr 172.21.15.37:0/124695000 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:07.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.185+0000 7f453bfff700 1 --2- 172.21.15.37:0/124695000 >> v2:172.21.15.37:3300/0 conn(0x7f453c15ff50 0x7f453c0d0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:07.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.185+0000 7f453affd700 1 -- 172.21.15.37:0/124695000 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3393928331 0 0) 0x7f4530001110 con 0x7f453c0d2ab0 2023-07-14T15:56:07.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.185+0000 7f453affd700 1 -- 172.21.15.37:0/124695000 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45240035b0 con 0x7f453c0d2ab0 2023-07-14T15:56:07.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.185+0000 7f453bfff700 1 -- 172.21.15.37:0/124695000 >> v1:172.21.15.98:6789/0 conn(0x7f453c0b1fc0 legacy=0x7f453c0b2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:07.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.185+0000 7f453bfff700 1 -- 172.21.15.37:0/124695000 >> v1:172.21.15.37:6789/0 conn(0x7f453c0d2ab0 legacy=0x7f453c0b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:07.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.185+0000 7f453bfff700 1 -- 172.21.15.37:0/124695000 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f453c0b0b20 con 0x7f453c15ff50 2023-07-14T15:56:07.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.185+0000 7f453bfff700 1 --2- 172.21.15.37:0/124695000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f453c15ff50 0x7f453c0d0a90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f452c009840 tx=0x7f452c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=719e7cd671b3964b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:07.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.186+0000 7f453affd700 1 -- 172.21.15.37:0/124695000 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452c011830 con 0x7f453c15ff50 2023-07-14T15:56:07.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.186+0000 7f453affd700 1 -- 172.21.15.37:0/124695000 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f452c011990 con 0x7f453c15ff50 2023-07-14T15:56:07.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.186+0000 7f453affd700 1 -- 172.21.15.37:0/124695000 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452c011d20 con 0x7f453c15ff50 2023-07-14T15:56:07.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.186+0000 7f45425ff700 1 -- 172.21.15.37:0/124695000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f453c15ff50 msgr2=0x7f453c0d0a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:07.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.186+0000 7f45425ff700 1 --2- 172.21.15.37:0/124695000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f453c15ff50 0x7f453c0d0a90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f452c009840 tx=0x7f452c009b50 comp rx=0 tx=0).stop 2023-07-14T15:56:07.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.186+0000 7f45425ff700 1 -- 172.21.15.37:0/124695000 shutdown_connections 2023-07-14T15:56:07.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.186+0000 7f45425ff700 1 --2- 172.21.15.37:0/124695000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f453c15ff50 0x7f453c0d0a90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:07.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.186+0000 7f45425ff700 1 -- 172.21.15.37:0/124695000 >> 172.21.15.37:0/124695000 conn(0x7f453c09c1f0 msgr2=0x7f453c0d2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:07.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.186+0000 7f45425ff700 1 -- 172.21.15.37:0/124695000 shutdown_connections 2023-07-14T15:56:07.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.186+0000 7f45425ff700 1 -- 172.21.15.37:0/124695000 wait complete. 2023-07-14T15:56:07.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.188+0000 7f45425ff700 1 Processor -- start 2023-07-14T15:56:07.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.188+0000 7f45425ff700 1 -- start start 2023-07-14T15:56:07.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.189+0000 7f45425ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f453c0b1fc0 0x7f453c0b82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:07.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.189+0000 7f45425ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f453c15ff50 0x7f453c0cc110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:07.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.189+0000 7f45425ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f453c152000 0x7f453c0ca0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:07.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.189+0000 7f45425ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453c0cad50 con 0x7f453c0b1fc0 2023-07-14T15:56:07.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.189+0000 7f45425ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453c0c6d40 con 0x7f453c152000 2023-07-14T15:56:07.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.189+0000 7f45425ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f453c0cc7f0 con 0x7f453c15ff50 2023-07-14T15:56:07.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.190+0000 7f453bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f453c0b1fc0 0x7f453c0b82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:07.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.190+0000 7f453bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f453c0b1fc0 0x7f453c0b82f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47762/0 (socket says 172.21.15.37:47762) 2023-07-14T15:56:07.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.190+0000 7f453bfff700 1 -- 172.21.15.37:0/1923080942 learned_addr learned my addr 172.21.15.37:0/1923080942 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:07.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.190+0000 7f453b7fe700 1 --2- 172.21.15.37:0/1923080942 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f453c15ff50 0x7f453c0cc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:07.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.190+0000 7f4540b9c700 1 --2- 172.21.15.37:0/1923080942 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f453c152000 0x7f453c0ca0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:07.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.190+0000 7f453bfff700 1 -- 172.21.15.37:0/1923080942 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f453c15ff50 msgr2=0x7f453c0cc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:07.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.190+0000 7f453bfff700 1 --2- 172.21.15.37:0/1923080942 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f453c15ff50 0x7f453c0cc110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:07.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.190+0000 7f453bfff700 1 -- 172.21.15.37:0/1923080942 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f453c152000 msgr2=0x7f453c0ca0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:07.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.190+0000 7f453bfff700 1 --2- 172.21.15.37:0/1923080942 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f453c152000 0x7f453c0ca0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:07.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.190+0000 7f453bfff700 1 -- 172.21.15.37:0/1923080942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f452c0094a0 con 0x7f453c0b1fc0 2023-07-14T15:56:07.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.190+0000 7f453bfff700 1 --2- 172.21.15.37:0/1923080942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f453c0b1fc0 0x7f453c0b82f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f452c009fd0 tx=0x7f452c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:07.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.191+0000 7f4538ff9700 1 -- 172.21.15.37:0/1923080942 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452c0036a0 con 0x7f453c0b1fc0 2023-07-14T15:56:07.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.191+0000 7f4538ff9700 1 -- 172.21.15.37:0/1923080942 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f452c01e070 con 0x7f453c0b1fc0 2023-07-14T15:56:07.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.191+0000 7f4538ff9700 1 -- 172.21.15.37:0/1923080942 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452c003a40 con 0x7f453c0b1fc0 2023-07-14T15:56:07.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.191+0000 7f45425ff700 1 -- 172.21.15.37:0/1923080942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f453c0ccad0 con 0x7f453c0b1fc0 2023-07-14T15:56:07.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.191+0000 7f45425ff700 1 -- 172.21.15.37:0/1923080942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f453c0c69d0 con 0x7f453c0b1fc0 2023-07-14T15:56:07.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.192+0000 7f45425ff700 1 -- 172.21.15.37:0/1923080942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f453c0b2690 con 0x7f453c0b1fc0 2023-07-14T15:56:07.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.193+0000 7f4538ff9700 1 -- 172.21.15.37:0/1923080942 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f452c003ba0 con 0x7f453c0b1fc0 2023-07-14T15:56:07.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.194+0000 7f4538ff9700 1 --2- 172.21.15.37:0/1923080942 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f452806ace0 0x7f452806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:07.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.194+0000 7f4538ff9700 1 -- 172.21.15.37:0/1923080942 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f452c08a2c0 con 0x7f453c0b1fc0 2023-07-14T15:56:07.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.194+0000 7f453b7fe700 1 --2- 172.21.15.37:0/1923080942 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f452806ace0 0x7f452806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:07.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.195+0000 7f453b7fe700 1 --2- 172.21.15.37:0/1923080942 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f452806ace0 0x7f452806d190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4530007fd0 tx=0x7f4530007c40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:07.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.198+0000 7f4538ff9700 1 -- 172.21.15.37:0/1923080942 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f452c055540 con 0x7f453c0b1fc0 2023-07-14T15:56:07.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.407+0000 7f45425ff700 1 -- 172.21.15.37:0/1923080942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f453c067840 con 0x7f453c0b1fc0 2023-07-14T15:56:07.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.945+0000 7f4538ff9700 1 -- 172.21.15.37:0/1923080942 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v23) v1 ==== 170+0+0 (secure 0 0 0) 0x7f452c058b60 con 0x7f453c0b1fc0 2023-07-14T15:56:07.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.950+0000 7f45425ff700 1 -- 172.21.15.37:0/1923080942 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f452806ace0 msgr2=0x7f452806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:07.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.950+0000 7f45425ff700 1 --2- 172.21.15.37:0/1923080942 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f452806ace0 0x7f452806d190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4530007fd0 tx=0x7f4530007c40 comp rx=0 tx=0).stop 2023-07-14T15:56:07.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.950+0000 7f45425ff700 1 -- 172.21.15.37:0/1923080942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f453c0b1fc0 msgr2=0x7f453c0b82f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:07.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.950+0000 7f45425ff700 1 --2- 172.21.15.37:0/1923080942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f453c0b1fc0 0x7f453c0b82f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f452c009fd0 tx=0x7f452c004750 comp rx=0 tx=0).stop 2023-07-14T15:56:07.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.950+0000 7f45425ff700 1 -- 172.21.15.37:0/1923080942 shutdown_connections 2023-07-14T15:56:07.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.950+0000 7f45425ff700 1 --2- 172.21.15.37:0/1923080942 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f453c152000 0x7f453c0ca0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:07.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.950+0000 7f45425ff700 1 --2- 172.21.15.37:0/1923080942 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f452806ace0 0x7f452806d190 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:07.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.950+0000 7f45425ff700 1 --2- 172.21.15.37:0/1923080942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f453c0b1fc0 0x7f453c0b82f0 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f452c009fd0 tx=0x7f452c004750 comp rx=0 tx=0).stop 2023-07-14T15:56:07.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.950+0000 7f45425ff700 1 --2- 172.21.15.37:0/1923080942 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f453c15ff50 0x7f453c0cc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:07.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.950+0000 7f45425ff700 1 -- 172.21.15.37:0/1923080942 >> 172.21.15.37:0/1923080942 conn(0x7f453c09c1f0 msgr2=0x7f453c0d3830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:07.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.952+0000 7f45425ff700 1 -- 172.21.15.37:0/1923080942 shutdown_connections 2023-07-14T15:56:07.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:07.953+0000 7f45425ff700 1 -- 172.21.15.37:0/1923080942 wait complete. 2023-07-14T15:56:07.953 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2023-07-14T15:56:07.974 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-14T15:56:08.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.192+0000 7f2cbd5ff700 1 Processor -- start 2023-07-14T15:56:08.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.192+0000 7f2cbd5ff700 1 -- start start 2023-07-14T15:56:08.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.193+0000 7f2cbd5ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2cb815fee0 0x7f2cb815ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:08.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.193+0000 7f2cbd5ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f2cb81603b0 0x7f2cb80d0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:08.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.194+0000 7f2cbd5ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cb80d1370 con 0x7f2cb80d0f70 2023-07-14T15:56:08.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.194+0000 7f2cbd5ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cb815dc50 con 0x7f2cb815fee0 2023-07-14T15:56:08.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.194+0000 7f2cbd5ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cb80b2940 con 0x7f2cb81603b0 2023-07-14T15:56:08.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.194+0000 7f2cb6ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2cb815fee0 0x7f2cb815ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:08.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.194+0000 7f2cb6ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2cb815fee0 0x7f2cb815ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47778/0 (socket says 172.21.15.37:47778) 2023-07-14T15:56:08.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.194+0000 7f2cb6ffd700 1 -- 172.21.15.37:0/1152124695 learned_addr learned my addr 172.21.15.37:0/1152124695 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:08.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.194+0000 7f2cb67fc700 1 --2- 172.21.15.37:0/1152124695 >> v2:172.21.15.98:3300/0 conn(0x7f2cb81603b0 0x7f2cb80d0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:08.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.194+0000 7f2cb6ffd700 1 -- 172.21.15.37:0/1152124695 >> v2:172.21.15.98:3300/0 conn(0x7f2cb81603b0 msgr2=0x7f2cb80d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:08.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.194+0000 7f2cb6ffd700 1 --2- 172.21.15.37:0/1152124695 >> v2:172.21.15.98:3300/0 conn(0x7f2cb81603b0 0x7f2cb80d0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:08.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.194+0000 7f2cb6ffd700 1 -- 172.21.15.37:0/1152124695 >> v1:172.21.15.98:6789/0 conn(0x7f2cb80d0f70 legacy=0x7f2cb80b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:08.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.194+0000 7f2cb6ffd700 1 -- 172.21.15.37:0/1152124695 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb80b2c20 con 0x7f2cb815fee0 2023-07-14T15:56:08.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.195+0000 7f2cb6ffd700 1 --2- 172.21.15.37:0/1152124695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cb815fee0 0x7f2cb815ded0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2cb808d510 tx=0x7f2ca8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f395fb0aa8d4bc87 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:08.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.195+0000 7f2cb5ffb700 1 -- 172.21.15.37:0/1152124695 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8011830 con 0x7f2cb815fee0 2023-07-14T15:56:08.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.195+0000 7f2cb5ffb700 1 -- 172.21.15.37:0/1152124695 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca8011990 con 0x7f2cb815fee0 2023-07-14T15:56:08.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.195+0000 7f2cb5ffb700 1 -- 172.21.15.37:0/1152124695 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8011d20 con 0x7f2cb815fee0 2023-07-14T15:56:08.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.195+0000 7f2cbd5ff700 1 -- 172.21.15.37:0/1152124695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cb815fee0 msgr2=0x7f2cb815ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:08.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.195+0000 7f2cbd5ff700 1 --2- 172.21.15.37:0/1152124695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cb815fee0 0x7f2cb815ded0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2cb808d510 tx=0x7f2ca8009bd0 comp rx=0 tx=0).stop 2023-07-14T15:56:08.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.195+0000 7f2cbd5ff700 1 -- 172.21.15.37:0/1152124695 shutdown_connections 2023-07-14T15:56:08.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.195+0000 7f2cbd5ff700 1 --2- 172.21.15.37:0/1152124695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cb815fee0 0x7f2cb815ded0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:08.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.195+0000 7f2cbd5ff700 1 --2- 172.21.15.37:0/1152124695 >> v2:172.21.15.98:3300/0 conn(0x7f2cb81603b0 0x7f2cb80d0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:08.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.195+0000 7f2cbd5ff700 1 -- 172.21.15.37:0/1152124695 >> 172.21.15.37:0/1152124695 conn(0x7f2cb809c1b0 msgr2=0x7f2cb80d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:08.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.195+0000 7f2cbd5ff700 1 -- 172.21.15.37:0/1152124695 shutdown_connections 2023-07-14T15:56:08.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.196+0000 7f2cbd5ff700 1 -- 172.21.15.37:0/1152124695 wait complete. 2023-07-14T15:56:08.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.198+0000 7f2cbd5ff700 1 Processor -- start 2023-07-14T15:56:08.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.198+0000 7f2cbd5ff700 1 -- start start 2023-07-14T15:56:08.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.199+0000 7f2cbd5ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2cb80d0f70 0x7f2cb80c9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:08.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.199+0000 7f2cbd5ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cb815fee0 0x7f2cb80afa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:08.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.199+0000 7f2cbd5ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2cb81603b0 0x7f2cb81f1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:08.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.199+0000 7f2cbd5ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb80aff50 con 0x7f2cb815fee0 2023-07-14T15:56:08.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.199+0000 7f2cbd5ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb80b0140 con 0x7f2cb81603b0 2023-07-14T15:56:08.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.199+0000 7f2cbd5ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb80b0420 con 0x7f2cb80d0f70 2023-07-14T15:56:08.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.200+0000 7f2cb67fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cb815fee0 0x7f2cb80afa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:08.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.200+0000 7f2cb67fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cb815fee0 0x7f2cb80afa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47792/0 (socket says 172.21.15.37:47792) 2023-07-14T15:56:08.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.200+0000 7f2cb67fc700 1 -- 172.21.15.37:0/527533365 learned_addr learned my addr 172.21.15.37:0/527533365 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:08.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.200+0000 7f2cb6ffd700 1 --2- 172.21.15.37:0/527533365 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2cb80d0f70 0x7f2cb80c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:08.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.200+0000 7f2cb77fe700 1 --2- 172.21.15.37:0/527533365 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2cb81603b0 0x7f2cb81f1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:08.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.200+0000 7f2cb67fc700 1 -- 172.21.15.37:0/527533365 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2cb80d0f70 msgr2=0x7f2cb80c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:08.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.200+0000 7f2cb67fc700 1 --2- 172.21.15.37:0/527533365 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2cb80d0f70 0x7f2cb80c9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:08.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.200+0000 7f2cb67fc700 1 -- 172.21.15.37:0/527533365 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2cb81603b0 msgr2=0x7f2cb81f1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:08.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.200+0000 7f2cb67fc700 1 --2- 172.21.15.37:0/527533365 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2cb81603b0 0x7f2cb81f1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:08.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.200+0000 7f2cb67fc700 1 -- 172.21.15.37:0/527533365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca8009550 con 0x7f2cb815fee0 2023-07-14T15:56:08.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.200+0000 7f2cb67fc700 1 --2- 172.21.15.37:0/527533365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cb815fee0 0x7f2cb80afa10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2cac00e870 tx=0x7f2cac00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:08.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.201+0000 7f2c9f7fe700 1 -- 172.21.15.37:0/527533365 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cac009590 con 0x7f2cb815fee0 2023-07-14T15:56:08.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.201+0000 7f2c9f7fe700 1 -- 172.21.15.37:0/527533365 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cac013680 con 0x7f2cb815fee0 2023-07-14T15:56:08.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.201+0000 7f2c9f7fe700 1 -- 172.21.15.37:0/527533365 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cac0139f0 con 0x7f2cb815fee0 2023-07-14T15:56:08.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.201+0000 7f2cbd5ff700 1 -- 172.21.15.37:0/527533365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cb80b0700 con 0x7f2cb815fee0 2023-07-14T15:56:08.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.201+0000 7f2cbd5ff700 1 -- 172.21.15.37:0/527533365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb80b0cc0 con 0x7f2cb815fee0 2023-07-14T15:56:08.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.202+0000 7f2cbd5ff700 1 -- 172.21.15.37:0/527533365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cb80b0ee0 con 0x7f2cb815fee0 2023-07-14T15:56:08.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.203+0000 7f2c9f7fe700 1 -- 172.21.15.37:0/527533365 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2cac013b50 con 0x7f2cb815fee0 2023-07-14T15:56:08.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.204+0000 7f2c9f7fe700 1 --2- 172.21.15.37:0/527533365 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f2ca406ace0 0x7f2ca406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:08.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.204+0000 7f2c9f7fe700 1 -- 172.21.15.37:0/527533365 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f2cac089a60 con 0x7f2cb815fee0 2023-07-14T15:56:08.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.205+0000 7f2cb6ffd700 1 --2- 172.21.15.37:0/527533365 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f2ca406ace0 0x7f2ca406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:08.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.205+0000 7f2cb6ffd700 1 --2- 172.21.15.37:0/527533365 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f2ca406ace0 0x7f2ca406d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8009c10 tx=0x7f2ca8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:08.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.208+0000 7f2c9f7fe700 1 -- 172.21.15.37:0/527533365 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2cac0585e0 con 0x7f2cb815fee0 2023-07-14T15:56:08.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.457+0000 7f2cbd5ff700 1 -- 172.21.15.37:0/527533365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f2cb8067840 con 0x7f2cb815fee0 2023-07-14T15:56:08.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.965+0000 7f2c9f7fe700 1 -- 172.21.15.37:0/527533365 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f2cac058170 con 0x7f2cb815fee0 2023-07-14T15:56:08.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.970+0000 7f2cbd5ff700 1 -- 172.21.15.37:0/527533365 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f2ca406ace0 msgr2=0x7f2ca406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:08.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.970+0000 7f2cbd5ff700 1 --2- 172.21.15.37:0/527533365 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f2ca406ace0 0x7f2ca406d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8009c10 tx=0x7f2ca8008030 comp rx=0 tx=0).stop 2023-07-14T15:56:08.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.970+0000 7f2cbd5ff700 1 -- 172.21.15.37:0/527533365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cb815fee0 msgr2=0x7f2cb80afa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:08.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.970+0000 7f2cbd5ff700 1 --2- 172.21.15.37:0/527533365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cb815fee0 0x7f2cb80afa10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2cac00e870 tx=0x7f2cac00eb80 comp rx=0 tx=0).stop 2023-07-14T15:56:08.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.971+0000 7f2cbd5ff700 1 -- 172.21.15.37:0/527533365 shutdown_connections 2023-07-14T15:56:08.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.971+0000 7f2cbd5ff700 1 --2- 172.21.15.37:0/527533365 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2cb81603b0 0x7f2cb81f1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:08.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.971+0000 7f2cbd5ff700 1 --2- 172.21.15.37:0/527533365 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f2ca406ace0 0x7f2ca406d190 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:08.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.971+0000 7f2cbd5ff700 1 --2- 172.21.15.37:0/527533365 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2cb80d0f70 0x7f2cb80c9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:08.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.971+0000 7f2cbd5ff700 1 --2- 172.21.15.37:0/527533365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cb815fee0 0x7f2cb80afa10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:08.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.971+0000 7f2cbd5ff700 1 -- 172.21.15.37:0/527533365 >> 172.21.15.37:0/527533365 conn(0x7f2cb809c1b0 msgr2=0x7f2cb815f390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:08.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.972+0000 7f2cbd5ff700 1 -- 172.21.15.37:0/527533365 shutdown_connections 2023-07-14T15:56:08.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:08.972+0000 7f2cbd5ff700 1 -- 172.21.15.37:0/527533365 wait complete. 2023-07-14T15:56:08.961 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 3 and data pool 4 2023-07-14T15:56:08.987 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T15:56:09.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.202+0000 7fcbc69ff700 1 Processor -- start 2023-07-14T15:56:09.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.203+0000 7fcbc69ff700 1 -- start start 2023-07-14T15:56:09.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.204+0000 7fcbc69ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcbc00b54b0 0x7fcbc00cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:09.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.204+0000 7fcbc69ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fcbc00b4910 0x7fcbc00b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:09.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.204+0000 7fcbc69ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbc00cf6b0 con 0x7fcbc00b85f0 2023-07-14T15:56:09.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.204+0000 7fcbc69ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbc00b5270 con 0x7fcbc00b54b0 2023-07-14T15:56:09.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.204+0000 7fcbc69ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbc00cdc40 con 0x7fcbc00b4910 2023-07-14T15:56:09.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.204+0000 7fcbbf7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcbc00b54b0 0x7fcbc00cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:09.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.204+0000 7fcbbffff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fcbc00b85f0 0x7fcbc015d660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50528/0 (socket says 172.21.15.37:50528) 2023-07-14T15:56:09.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.204+0000 7fcbbffff700 1 -- 172.21.15.37:0/759358906 learned_addr learned my addr 172.21.15.37:0/759358906 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:09.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.204+0000 7fcbc4f9c700 1 --2- 172.21.15.37:0/759358906 >> v2:172.21.15.98:3300/0 conn(0x7fcbc00b4910 0x7fcbc00b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:09.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.205+0000 7fcbbf7fe700 1 -- 172.21.15.37:0/759358906 >> v2:172.21.15.98:3300/0 conn(0x7fcbc00b4910 msgr2=0x7fcbc00b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:09.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.205+0000 7fcbbf7fe700 1 --2- 172.21.15.37:0/759358906 >> v2:172.21.15.98:3300/0 conn(0x7fcbc00b4910 0x7fcbc00b4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:09.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.205+0000 7fcbbf7fe700 1 -- 172.21.15.37:0/759358906 >> v1:172.21.15.37:6789/0 conn(0x7fcbc00b85f0 legacy=0x7fcbc015d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:09.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.205+0000 7fcbbf7fe700 1 -- 172.21.15.37:0/759358906 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc00cf0a0 con 0x7fcbc00b54b0 2023-07-14T15:56:09.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.205+0000 7fcbbeffd700 1 -- 172.21.15.37:0/759358906 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 954146504 0 0) 0x7fcbc00cf6b0 con 0x7fcbc00b85f0 2023-07-14T15:56:09.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.205+0000 7fcbbf7fe700 1 --2- 172.21.15.37:0/759358906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbc00b54b0 0x7fcbc00cfb40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcbc0161270 tx=0x7fcbb4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1711dc58cf15e61 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:09.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.205+0000 7fcbbeffd700 1 -- 172.21.15.37:0/759358906 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb4011830 con 0x7fcbc00b54b0 2023-07-14T15:56:09.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.205+0000 7fcbbeffd700 1 -- 172.21.15.37:0/759358906 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb4011990 con 0x7fcbc00b54b0 2023-07-14T15:56:09.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.205+0000 7fcbbeffd700 1 -- 172.21.15.37:0/759358906 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb4011d20 con 0x7fcbc00b54b0 2023-07-14T15:56:09.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.206+0000 7fcbc69ff700 1 -- 172.21.15.37:0/759358906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbc00b54b0 msgr2=0x7fcbc00cfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:09.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.206+0000 7fcbc69ff700 1 --2- 172.21.15.37:0/759358906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbc00b54b0 0x7fcbc00cfb40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcbc0161270 tx=0x7fcbb4009b20 comp rx=0 tx=0).stop 2023-07-14T15:56:09.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.206+0000 7fcbc69ff700 1 -- 172.21.15.37:0/759358906 shutdown_connections 2023-07-14T15:56:09.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.206+0000 7fcbc69ff700 1 --2- 172.21.15.37:0/759358906 >> v2:172.21.15.98:3300/0 conn(0x7fcbc00b4910 0x7fcbc00b4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:09.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.206+0000 7fcbc69ff700 1 --2- 172.21.15.37:0/759358906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbc00b54b0 0x7fcbc00cfb40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:09.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.206+0000 7fcbc69ff700 1 -- 172.21.15.37:0/759358906 >> 172.21.15.37:0/759358906 conn(0x7fcbc006a580 msgr2=0x7fcbc006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:09.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.206+0000 7fcbc69ff700 1 -- 172.21.15.37:0/759358906 shutdown_connections 2023-07-14T15:56:09.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.206+0000 7fcbc69ff700 1 -- 172.21.15.37:0/759358906 wait complete. 2023-07-14T15:56:09.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.208+0000 7fcbc69ff700 1 Processor -- start 2023-07-14T15:56:09.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.208+0000 7fcbc69ff700 1 -- start start 2023-07-14T15:56:09.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.209+0000 7fcbc69ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbc00b4910 0x7fcbc01542d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:09.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.209+0000 7fcbc69ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbc00b54b0 0x7fcbc00cb260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:09.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.209+0000 7fcbc69ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcbc00b85f0 0x7fcbc015e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:09.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.209+0000 7fcbc69ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc00cc810 con 0x7fcbc00b4910 2023-07-14T15:56:09.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.209+0000 7fcbc69ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc00cbb90 con 0x7fcbc00b54b0 2023-07-14T15:56:09.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.209+0000 7fcbc69ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc00cbe70 con 0x7fcbc00b85f0 2023-07-14T15:56:09.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.209+0000 7fcbbffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbc00b4910 0x7fcbc01542d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:09.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.209+0000 7fcbbffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbc00b4910 0x7fcbc01542d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47808/0 (socket says 172.21.15.37:47808) 2023-07-14T15:56:09.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.209+0000 7fcbbffff700 1 -- 172.21.15.37:0/539712977 learned_addr learned my addr 172.21.15.37:0/539712977 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:09.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.209+0000 7fcbbf7fe700 1 --2- 172.21.15.37:0/539712977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbc00b54b0 0x7fcbc00cb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:09.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.209+0000 7fcbc4f9c700 1 --2- 172.21.15.37:0/539712977 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcbc00b85f0 0x7fcbc015e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:09.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.209+0000 7fcbbffff700 1 -- 172.21.15.37:0/539712977 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcbc00b85f0 msgr2=0x7fcbc015e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:09.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.209+0000 7fcbbffff700 1 --2- 172.21.15.37:0/539712977 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcbc00b85f0 0x7fcbc015e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:09.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.209+0000 7fcbbffff700 1 -- 172.21.15.37:0/539712977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbc00b54b0 msgr2=0x7fcbc00cb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:09.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.209+0000 7fcbbffff700 1 --2- 172.21.15.37:0/539712977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbc00b54b0 0x7fcbc00cb260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:09.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.209+0000 7fcbbffff700 1 -- 172.21.15.37:0/539712977 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb40094a0 con 0x7fcbc00b4910 2023-07-14T15:56:09.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.209+0000 7fcbc4f9c700 1 --2- 172.21.15.37:0/539712977 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcbc00b85f0 0x7fcbc015e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:56:09.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.210+0000 7fcbbffff700 1 --2- 172.21.15.37:0/539712977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbc00b4910 0x7fcbc01542d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcbb000c550 tx=0x7fcbb000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:09.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.210+0000 7fcbbcff9700 1 -- 172.21.15.37:0/539712977 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb0004c80 con 0x7fcbc00b4910 2023-07-14T15:56:09.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.210+0000 7fcbbcff9700 1 -- 172.21.15.37:0/539712977 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb0004e00 con 0x7fcbc00b4910 2023-07-14T15:56:09.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.210+0000 7fcbc69ff700 1 -- 172.21.15.37:0/539712977 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbc00cc150 con 0x7fcbc00b4910 2023-07-14T15:56:09.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.210+0000 7fcbbcff9700 1 -- 172.21.15.37:0/539712977 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb0007310 con 0x7fcbc00b4910 2023-07-14T15:56:09.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.210+0000 7fcbc69ff700 1 -- 172.21.15.37:0/539712977 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbc0154810 con 0x7fcbc00b4910 2023-07-14T15:56:09.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.211+0000 7fcbc69ff700 1 -- 172.21.15.37:0/539712977 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbc00cc950 con 0x7fcbc00b4910 2023-07-14T15:56:09.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.212+0000 7fcbbcff9700 1 -- 172.21.15.37:0/539712977 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcbb0007470 con 0x7fcbc00b4910 2023-07-14T15:56:09.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.213+0000 7fcbbcff9700 1 --2- 172.21.15.37:0/539712977 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fcbac06ad10 0x7fcbac06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:09.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.213+0000 7fcbbcff9700 1 -- 172.21.15.37:0/539712977 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcbb00890b0 con 0x7fcbc00b4910 2023-07-14T15:56:09.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.214+0000 7fcbbf7fe700 1 --2- 172.21.15.37:0/539712977 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fcbac06ad10 0x7fcbac06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:09.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.214+0000 7fcbbf7fe700 1 --2- 172.21.15.37:0/539712977 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fcbac06ad10 0x7fcbac06d1c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcbb40090b0 tx=0x7fcbb4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:09.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.218+0000 7fcbbcff9700 1 -- 172.21.15.37:0/539712977 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fcbc00cc950 con 0x7fcbc00b4910 2023-07-14T15:56:09.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.425+0000 7fcbc69ff700 1 -- 172.21.15.37:0/539712977 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcbc00cc950 con 0x7fcbc00b4910 2023-07-14T15:56:09.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.427+0000 7fcbbcff9700 1 -- 172.21.15.37:0/539712977 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18354 (secure 0 0 0) 0x7fcbc00cc950 con 0x7fcbc00b4910 2023-07-14T15:56:09.414 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:56:09.414 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":24,"fsid":"9da30401-a779-4e46-aba6-00c2494c6c67","created":"2023-07-14T15:55:39.898867+0000","modified":"2023-07-14T15:56:08.459541+0000","last_up_change":"2023-07-14T15:55:53.025696+0000","last_in_change":"2023-07-14T15:55:43.388192+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T15:55:52.907261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T15:55:59.992839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T15:56:06.091064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T15:56:07.448694+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d049535-7b87-4276-8fe5-0f74ba422d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6801","nonce":2783032392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6803","nonce":2783032392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6807","nonce":2783032392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6805","nonce":2783032392}]},"public_addr":"172.21.15.37:6801/2783032392","cluster_addr":"172.21.15.37:6803/2783032392","heartbeat_back_addr":"172.21.15.37:6807/2783032392","heartbeat_front_addr":"172.21.15.37:6805/2783032392","state":["exists","up"]},{"osd":1,"uuid":"79ec948d-ead2-4c2d-923a-dd6eeaac9dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6823","nonce":1190059746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6826","nonce":1190059746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6831","nonce":1190059746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6829","nonce":1190059746}]},"public_addr":"172.21.15.37:6823/1190059746","cluster_addr":"172.21.15.37:6826/1190059746","heartbeat_back_addr":"172.21.15.37:6831/1190059746","heartbeat_front_addr":"172.21.15.37:6829/1190059746","state":["exists","up"]},{"osd":2,"uuid":"a1db6690-c160-4366-9c82-2cca17e4bba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6809","nonce":2266223499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6813","nonce":2266223499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6820","nonce":2266223499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6816","nonce":2266223499}]},"public_addr":"172.21.15.37:6809/2266223499","cluster_addr":"172.21.15.37:6813/2266223499","heartbeat_back_addr":"172.21.15.37:6820/2266223499","heartbeat_front_addr":"172.21.15.37:6816/2266223499","state":["exists","up"]},{"osd":3,"uuid":"767b8220-e79a-4a86-a162-6b3b73198379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6812","nonce":4166694594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6817","nonce":4166694594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6828","nonce":4166694594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6822","nonce":4166694594}]},"public_addr":"172.21.15.37:6812/4166694594","cluster_addr":"172.21.15.37:6817/4166694594","heartbeat_back_addr":"172.21.15.37:6828/4166694594","heartbeat_front_addr":"172.21.15.37:6822/4166694594","state":["exists","up"]},{"osd":4,"uuid":"717bd773-ae7e-4236-ac79-900cf99a37c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6801","nonce":3529020407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6803","nonce":3529020407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6807","nonce":3529020407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6805","nonce":3529020407}]},"public_addr":"172.21.15.98:6801/3529020407","cluster_addr":"172.21.15.98:6803/3529020407","heartbeat_back_addr":"172.21.15.98:6807/3529020407","heartbeat_front_addr":"172.21.15.98:6805/3529020407","state":["exists","up"]},{"osd":5,"uuid":"a941d358-0f03-4136-a9b2-3a1c2e9358cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6817","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6819","nonce":2311501838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6821","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6823","nonce":2311501838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6829","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6831","nonce":2311501838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6825","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6827","nonce":2311501838}]},"public_addr":"172.21.15.98:6819/2311501838","cluster_addr":"172.21.15.98:6823/2311501838","heartbeat_back_addr":"172.21.15.98:6831/2311501838","heartbeat_front_addr":"172.21.15.98:6827/2311501838","state":["exists","up"]},{"osd":6,"uuid":"27153772-6d4b-479d-9953-0582e7b96743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6809","nonce":1144224691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6811","nonce":1144224691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6815","nonce":1144224691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6813","nonce":1144224691}]},"public_addr":"172.21.15.98:6809/1144224691","cluster_addr":"172.21.15.98:6811/1144224691","heartbeat_back_addr":"172.21.15.98:6815/1144224691","heartbeat_front_addr":"172.21.15.98:6813/1144224691","state":["exists","up"]},{"osd":7,"uuid":"d21ffc8e-40bb-47eb-af2c-e3e730d3fb76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6818","nonce":1144470927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6822","nonce":1144470927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6830","nonce":1144470927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6826","nonce":1144470927}]},"public_addr":"172.21.15.98:6818/1144470927","cluster_addr":"172.21.15.98:6822/1144470927","heartbeat_back_addr":"172.21.15.98:6830/1144470927","heartbeat_front_addr":"172.21.15.98:6826/1144470927","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.921114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.739210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.024016+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.002527+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.698127+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.813416+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.709351+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.815457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T15:56:09.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.429+0000 7fcbc69ff700 1 -- 172.21.15.37:0/539712977 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fcbac06ad10 msgr2=0x7fcbac06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:09.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.429+0000 7fcbc69ff700 1 --2- 172.21.15.37:0/539712977 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fcbac06ad10 0x7fcbac06d1c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcbb40090b0 tx=0x7fcbb4008030 comp rx=0 tx=0).stop 2023-07-14T15:56:09.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.429+0000 7fcbc69ff700 1 -- 172.21.15.37:0/539712977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbc00b4910 msgr2=0x7fcbc01542d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:09.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.429+0000 7fcbc69ff700 1 --2- 172.21.15.37:0/539712977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbc00b4910 0x7fcbc01542d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcbb000c550 tx=0x7fcbb000c860 comp rx=0 tx=0).stop 2023-07-14T15:56:09.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.429+0000 7fcbc69ff700 1 -- 172.21.15.37:0/539712977 shutdown_connections 2023-07-14T15:56:09.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.429+0000 7fcbc69ff700 1 --2- 172.21.15.37:0/539712977 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fcbac06ad10 0x7fcbac06d1c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:09.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.429+0000 7fcbc69ff700 1 --2- 172.21.15.37:0/539712977 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcbc00b85f0 0x7fcbc015e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:09.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.429+0000 7fcbc69ff700 1 --2- 172.21.15.37:0/539712977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbc00b4910 0x7fcbc01542d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:09.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.429+0000 7fcbc69ff700 1 --2- 172.21.15.37:0/539712977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbc00b54b0 0x7fcbc00cb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:09.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.429+0000 7fcbc69ff700 1 -- 172.21.15.37:0/539712977 >> 172.21.15.37:0/539712977 conn(0x7fcbc006a580 msgr2=0x7fcbc015c670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:09.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.430+0000 7fcbc69ff700 1 -- 172.21.15.37:0/539712977 shutdown_connections 2023-07-14T15:56:09.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.430+0000 7fcbc69ff700 1 -- 172.21.15.37:0/539712977 wait complete. 2023-07-14T15:56:09.435 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T15:56:09.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.650+0000 7f2356dff700 1 Processor -- start 2023-07-14T15:56:09.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.651+0000 7f2356dff700 1 -- start start 2023-07-14T15:56:09.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.652+0000 7f2356dff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f23500b85f0 0x7f235015d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:09.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.652+0000 7f2356dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f23500b54b0 0x7f23500cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:09.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.652+0000 7f2356dff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f23500b4910 0x7f23500b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:09.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.652+0000 7f2356dff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23500b52d0 con 0x7f23500b4910 2023-07-14T15:56:09.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.653+0000 7f2356dff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23500cf6b0 con 0x7f23500b85f0 2023-07-14T15:56:09.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.653+0000 7f2356dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23500cdc40 con 0x7f23500b54b0 2023-07-14T15:56:09.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.653+0000 7f235539c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f23500b4910 0x7f23500b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:09.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.653+0000 7f235539c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f23500b4910 0x7f23500b4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47812/0 (socket says 172.21.15.37:47812) 2023-07-14T15:56:09.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.653+0000 7f235539c700 1 -- 172.21.15.37:0/1170683672 learned_addr learned my addr 172.21.15.37:0/1170683672 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:09.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.653+0000 7f234ffff700 1 --2- 172.21.15.37:0/1170683672 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f23500b54b0 0x7f23500cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:09.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.653+0000 7f2354b9b700 1 --2- 172.21.15.37:0/1170683672 >> v2:172.21.15.98:3300/0 conn(0x7f23500b85f0 0x7f235015d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:09.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.653+0000 7f235539c700 1 -- 172.21.15.37:0/1170683672 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f23500b54b0 msgr2=0x7f23500cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:09.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.653+0000 7f235539c700 1 --2- 172.21.15.37:0/1170683672 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f23500b54b0 0x7f23500cfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:09.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.653+0000 7f235539c700 1 -- 172.21.15.37:0/1170683672 >> v2:172.21.15.98:3300/0 conn(0x7f23500b85f0 msgr2=0x7f235015d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:09.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.653+0000 7f235539c700 1 --2- 172.21.15.37:0/1170683672 >> v2:172.21.15.98:3300/0 conn(0x7f23500b85f0 0x7f235015d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:09.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.653+0000 7f235539c700 1 -- 172.21.15.37:0/1170683672 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f235015dba0 con 0x7f23500b4910 2023-07-14T15:56:09.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.653+0000 7f2354b9b700 1 --2- 172.21.15.37:0/1170683672 >> v2:172.21.15.98:3300/0 conn(0x7f23500b85f0 0x7f235015d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:56:09.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.653+0000 7f235539c700 1 --2- 172.21.15.37:0/1170683672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23500b4910 0x7f23500b4d90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f235006a110 tx=0x7f234800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27908fbae956e8f0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:09.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.654+0000 7f234f7fe700 1 -- 172.21.15.37:0/1170683672 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f234800e070 con 0x7f23500b4910 2023-07-14T15:56:09.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.654+0000 7f234f7fe700 1 -- 172.21.15.37:0/1170683672 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f234800b910 con 0x7f23500b4910 2023-07-14T15:56:09.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.654+0000 7f234f7fe700 1 -- 172.21.15.37:0/1170683672 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f234800bcc0 con 0x7f23500b4910 2023-07-14T15:56:09.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.654+0000 7f2356dff700 1 -- 172.21.15.37:0/1170683672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23500b4910 msgr2=0x7f23500b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:09.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.654+0000 7f2356dff700 1 --2- 172.21.15.37:0/1170683672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23500b4910 0x7f23500b4d90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f235006a110 tx=0x7f234800b330 comp rx=0 tx=0).stop 2023-07-14T15:56:09.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.654+0000 7f2356dff700 1 -- 172.21.15.37:0/1170683672 shutdown_connections 2023-07-14T15:56:09.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.654+0000 7f2356dff700 1 --2- 172.21.15.37:0/1170683672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23500b4910 0x7f23500b4d90 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:09.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.654+0000 7f2356dff700 1 --2- 172.21.15.37:0/1170683672 >> v2:172.21.15.98:3300/0 conn(0x7f23500b85f0 0x7f235015d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:09.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.654+0000 7f2356dff700 1 --2- 172.21.15.37:0/1170683672 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f23500b54b0 0x7f23500cfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:09.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.654+0000 7f2356dff700 1 -- 172.21.15.37:0/1170683672 >> 172.21.15.37:0/1170683672 conn(0x7f235006a580 msgr2=0x7f235006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:09.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.654+0000 7f2356dff700 1 -- 172.21.15.37:0/1170683672 shutdown_connections 2023-07-14T15:56:09.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.654+0000 7f2356dff700 1 -- 172.21.15.37:0/1170683672 wait complete. 2023-07-14T15:56:09.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.656+0000 7f2356dff700 1 Processor -- start 2023-07-14T15:56:09.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.656+0000 7f2356dff700 1 -- start start 2023-07-14T15:56:09.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.657+0000 7f2356dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f23500b4910 0x7f2350157700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:09.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.657+0000 7f2356dff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23500b54b0 0x7f23501591e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:09.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.657+0000 7f2356dff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23500b85f0 0x7f23500c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:09.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.657+0000 7f2356dff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23501f5f40 con 0x7f23500b54b0 2023-07-14T15:56:09.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.657+0000 7f2356dff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23501f5630 con 0x7f23500b85f0 2023-07-14T15:56:09.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.657+0000 7f2356dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2350159c30 con 0x7f23500b4910 2023-07-14T15:56:09.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.657+0000 7f234ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23500b54b0 0x7f23501591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:09.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.657+0000 7f234ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23500b54b0 0x7f23501591e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47826/0 (socket says 172.21.15.37:47826) 2023-07-14T15:56:09.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.657+0000 7f234ffff700 1 -- 172.21.15.37:0/4226770339 learned_addr learned my addr 172.21.15.37:0/4226770339 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:09.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.658+0000 7f235539c700 1 --2- 172.21.15.37:0/4226770339 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23500b85f0 0x7f23500c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:09.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.658+0000 7f2354b9b700 1 --2- 172.21.15.37:0/4226770339 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f23500b4910 0x7f2350157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:09.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.658+0000 7f234ffff700 1 -- 172.21.15.37:0/4226770339 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f23500b4910 msgr2=0x7f2350157700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:09.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.658+0000 7f234ffff700 1 --2- 172.21.15.37:0/4226770339 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f23500b4910 0x7f2350157700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:09.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.658+0000 7f234ffff700 1 -- 172.21.15.37:0/4226770339 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23500b85f0 msgr2=0x7f23500c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:09.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.658+0000 7f234ffff700 1 --2- 172.21.15.37:0/4226770339 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23500b85f0 0x7f23500c9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:09.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.658+0000 7f234ffff700 1 -- 172.21.15.37:0/4226770339 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2348009b30 con 0x7f23500b54b0 2023-07-14T15:56:09.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.658+0000 7f234ffff700 1 --2- 172.21.15.37:0/4226770339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23500b54b0 0x7f23501591e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f233c00e930 tx=0x7f233c00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:09.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.658+0000 7f234d7fa700 1 -- 172.21.15.37:0/4226770339 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c013680 con 0x7f23500b54b0 2023-07-14T15:56:09.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.658+0000 7f234d7fa700 1 -- 172.21.15.37:0/4226770339 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233c0137e0 con 0x7f23500b54b0 2023-07-14T15:56:09.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.658+0000 7f2356dff700 1 -- 172.21.15.37:0/4226770339 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23501f5880 con 0x7f23500b54b0 2023-07-14T15:56:09.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.658+0000 7f234d7fa700 1 -- 172.21.15.37:0/4226770339 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c013b70 con 0x7f23500b54b0 2023-07-14T15:56:09.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.658+0000 7f2356dff700 1 -- 172.21.15.37:0/4226770339 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23501f5c10 con 0x7f23500b54b0 2023-07-14T15:56:09.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.659+0000 7f2356dff700 1 -- 172.21.15.37:0/4226770339 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2350067840 con 0x7f23500b54b0 2023-07-14T15:56:09.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.660+0000 7f234d7fa700 1 -- 172.21.15.37:0/4226770339 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f233c013cd0 con 0x7f23500b54b0 2023-07-14T15:56:09.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.662+0000 7f234d7fa700 1 --2- 172.21.15.37:0/4226770339 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f233406ace0 0x7f233406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:09.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.662+0000 7f234d7fa700 1 -- 172.21.15.37:0/4226770339 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f233c0893d0 con 0x7f23500b54b0 2023-07-14T15:56:09.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.662+0000 7f2354b9b700 1 --2- 172.21.15.37:0/4226770339 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f233406ace0 0x7f233406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:09.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.663+0000 7f2354b9b700 1 --2- 172.21.15.37:0/4226770339 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f233406ace0 0x7f233406d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f23440099d0 tx=0x7f2344008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:09.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.666+0000 7f234d7fa700 1 -- 172.21.15.37:0/4226770339 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f233c054470 con 0x7f23500b54b0 2023-07-14T15:56:09.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.876+0000 7f2356dff700 1 -- 172.21.15.37:0/4226770339 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f235006b440 con 0x7f23500b54b0 2023-07-14T15:56:09.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.878+0000 7f234d7fa700 1 -- 172.21.15.37:0/4226770339 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18354 (secure 0 0 0) 0x7f233c057a90 con 0x7f23500b54b0 2023-07-14T15:56:09.865 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:56:09.866 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":24,"fsid":"9da30401-a779-4e46-aba6-00c2494c6c67","created":"2023-07-14T15:55:39.898867+0000","modified":"2023-07-14T15:56:08.459541+0000","last_up_change":"2023-07-14T15:55:53.025696+0000","last_in_change":"2023-07-14T15:55:43.388192+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T15:55:52.907261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T15:55:59.992839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T15:56:06.091064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T15:56:07.448694+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d049535-7b87-4276-8fe5-0f74ba422d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6801","nonce":2783032392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6803","nonce":2783032392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6807","nonce":2783032392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6805","nonce":2783032392}]},"public_addr":"172.21.15.37:6801/2783032392","cluster_addr":"172.21.15.37:6803/2783032392","heartbeat_back_addr":"172.21.15.37:6807/2783032392","heartbeat_front_addr":"172.21.15.37:6805/2783032392","state":["exists","up"]},{"osd":1,"uuid":"79ec948d-ead2-4c2d-923a-dd6eeaac9dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6823","nonce":1190059746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6826","nonce":1190059746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6831","nonce":1190059746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6829","nonce":1190059746}]},"public_addr":"172.21.15.37:6823/1190059746","cluster_addr":"172.21.15.37:6826/1190059746","heartbeat_back_addr":"172.21.15.37:6831/1190059746","heartbeat_front_addr":"172.21.15.37:6829/1190059746","state":["exists","up"]},{"osd":2,"uuid":"a1db6690-c160-4366-9c82-2cca17e4bba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6809","nonce":2266223499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6813","nonce":2266223499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6820","nonce":2266223499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6816","nonce":2266223499}]},"public_addr":"172.21.15.37:6809/2266223499","cluster_addr":"172.21.15.37:6813/2266223499","heartbeat_back_addr":"172.21.15.37:6820/2266223499","heartbeat_front_addr":"172.21.15.37:6816/2266223499","state":["exists","up"]},{"osd":3,"uuid":"767b8220-e79a-4a86-a162-6b3b73198379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6812","nonce":4166694594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6817","nonce":4166694594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6828","nonce":4166694594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6822","nonce":4166694594}]},"public_addr":"172.21.15.37:6812/4166694594","cluster_addr":"172.21.15.37:6817/4166694594","heartbeat_back_addr":"172.21.15.37:6828/4166694594","heartbeat_front_addr":"172.21.15.37:6822/4166694594","state":["exists","up"]},{"osd":4,"uuid":"717bd773-ae7e-4236-ac79-900cf99a37c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6801","nonce":3529020407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6803","nonce":3529020407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6807","nonce":3529020407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6805","nonce":3529020407}]},"public_addr":"172.21.15.98:6801/3529020407","cluster_addr":"172.21.15.98:6803/3529020407","heartbeat_back_addr":"172.21.15.98:6807/3529020407","heartbeat_front_addr":"172.21.15.98:6805/3529020407","state":["exists","up"]},{"osd":5,"uuid":"a941d358-0f03-4136-a9b2-3a1c2e9358cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6817","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6819","nonce":2311501838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6821","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6823","nonce":2311501838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6829","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6831","nonce":2311501838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6825","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6827","nonce":2311501838}]},"public_addr":"172.21.15.98:6819/2311501838","cluster_addr":"172.21.15.98:6823/2311501838","heartbeat_back_addr":"172.21.15.98:6831/2311501838","heartbeat_front_addr":"172.21.15.98:6827/2311501838","state":["exists","up"]},{"osd":6,"uuid":"27153772-6d4b-479d-9953-0582e7b96743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6809","nonce":1144224691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6811","nonce":1144224691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6815","nonce":1144224691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6813","nonce":1144224691}]},"public_addr":"172.21.15.98:6809/1144224691","cluster_addr":"172.21.15.98:6811/1144224691","heartbeat_back_addr":"172.21.15.98:6815/1144224691","heartbeat_front_addr":"172.21.15.98:6813/1144224691","state":["exists","up"]},{"osd":7,"uuid":"d21ffc8e-40bb-47eb-af2c-e3e730d3fb76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6818","nonce":1144470927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6822","nonce":1144470927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6830","nonce":1144470927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6826","nonce":1144470927}]},"public_addr":"172.21.15.98:6818/1144470927","cluster_addr":"172.21.15.98:6822/1144470927","heartbeat_back_addr":"172.21.15.98:6830/1144470927","heartbeat_front_addr":"172.21.15.98:6826/1144470927","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.921114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.739210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.024016+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.002527+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.698127+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.813416+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.709351+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.815457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T15:56:09.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.880+0000 7f2356dff700 1 -- 172.21.15.37:0/4226770339 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f233406ace0 msgr2=0x7f233406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:09.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.880+0000 7f2356dff700 1 --2- 172.21.15.37:0/4226770339 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f233406ace0 0x7f233406d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f23440099d0 tx=0x7f2344008040 comp rx=0 tx=0).stop 2023-07-14T15:56:09.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.880+0000 7f2356dff700 1 -- 172.21.15.37:0/4226770339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23500b54b0 msgr2=0x7f23501591e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:09.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.880+0000 7f2356dff700 1 --2- 172.21.15.37:0/4226770339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23500b54b0 0x7f23501591e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f233c00e930 tx=0x7f233c00ec40 comp rx=0 tx=0).stop 2023-07-14T15:56:09.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.880+0000 7f2356dff700 1 -- 172.21.15.37:0/4226770339 shutdown_connections 2023-07-14T15:56:09.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.880+0000 7f2356dff700 1 --2- 172.21.15.37:0/4226770339 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23500b85f0 0x7f23500c9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:09.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.880+0000 7f2356dff700 1 --2- 172.21.15.37:0/4226770339 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f233406ace0 0x7f233406d190 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:09.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.880+0000 7f2356dff700 1 --2- 172.21.15.37:0/4226770339 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f23500b4910 0x7f2350157700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:09.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.880+0000 7f2356dff700 1 --2- 172.21.15.37:0/4226770339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23500b54b0 0x7f23501591e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:09.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.880+0000 7f2356dff700 1 -- 172.21.15.37:0/4226770339 >> 172.21.15.37:0/4226770339 conn(0x7f235006a580 msgr2=0x7f23500d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:09.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.881+0000 7f2356dff700 1 -- 172.21.15.37:0/4226770339 shutdown_connections 2023-07-14T15:56:09.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:09.881+0000 7f2356dff700 1 -- 172.21.15.37:0/4226770339 wait complete. 2023-07-14T15:56:09.886 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-14T15:56:10.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.107+0000 7ff0c63ff700 1 Processor -- start 2023-07-14T15:56:10.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.108+0000 7ff0c63ff700 1 -- start start 2023-07-14T15:56:10.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.109+0000 7ff0c63ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff0c00d1140 0x7ff0c015ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:10.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.109+0000 7ff0c63ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff0c01603b0 0x7ff0c00b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:10.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.109+0000 7ff0c63ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0c015dc50 con 0x7ff0c015fee0 2023-07-14T15:56:10.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.109+0000 7ff0c63ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0c00b2940 con 0x7ff0c00d1140 2023-07-14T15:56:10.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.109+0000 7ff0c63ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0c00b2c20 con 0x7ff0c01603b0 2023-07-14T15:56:10.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.109+0000 7ff0bffff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff0c015fee0 0x7ff0c00d0a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36736/0 (socket says 172.21.15.37:36736) 2023-07-14T15:56:10.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.109+0000 7ff0bffff700 1 -- 172.21.15.37:0/2358026527 learned_addr learned my addr 172.21.15.37:0/2358026527 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:10.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.109+0000 7ff0bf7fe700 1 --2- 172.21.15.37:0/2358026527 >> v2:172.21.15.37:3300/0 conn(0x7ff0c00d1140 0x7ff0c015ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:10.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.110+0000 7ff0c499c700 1 --2- 172.21.15.37:0/2358026527 >> v2:172.21.15.98:3300/0 conn(0x7ff0c01603b0 0x7ff0c00b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:10.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.110+0000 7ff0bf7fe700 1 -- 172.21.15.37:0/2358026527 >> v2:172.21.15.98:3300/0 conn(0x7ff0c01603b0 msgr2=0x7ff0c00b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:10.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.110+0000 7ff0bf7fe700 1 --2- 172.21.15.37:0/2358026527 >> v2:172.21.15.98:3300/0 conn(0x7ff0c01603b0 0x7ff0c00b39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:10.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.110+0000 7ff0bf7fe700 1 -- 172.21.15.37:0/2358026527 >> v1:172.21.15.37:6789/0 conn(0x7ff0c015fee0 legacy=0x7ff0c00d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:10.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.110+0000 7ff0bf7fe700 1 -- 172.21.15.37:0/2358026527 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c00b2f00 con 0x7ff0c00d1140 2023-07-14T15:56:10.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.110+0000 7ff0c499c700 1 --2- 172.21.15.37:0/2358026527 >> v2:172.21.15.98:3300/0 conn(0x7ff0c01603b0 0x7ff0c00b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:56:10.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.110+0000 7ff0beffd700 1 -- 172.21.15.37:0/2358026527 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 10137294 0 0) 0x7ff0c015dc50 con 0x7ff0c015fee0 2023-07-14T15:56:10.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.110+0000 7ff0bf7fe700 1 --2- 172.21.15.37:0/2358026527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0c00d1140 0x7ff0c015ded0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff0c00b8ee0 tx=0x7ff0b4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac9990c0f9795906 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:10.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.110+0000 7ff0beffd700 1 -- 172.21.15.37:0/2358026527 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b4011830 con 0x7ff0c00d1140 2023-07-14T15:56:10.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.110+0000 7ff0beffd700 1 -- 172.21.15.37:0/2358026527 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0b4011990 con 0x7ff0c00d1140 2023-07-14T15:56:10.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.110+0000 7ff0beffd700 1 -- 172.21.15.37:0/2358026527 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b4011d20 con 0x7ff0c00d1140 2023-07-14T15:56:10.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.111+0000 7ff0c63ff700 1 -- 172.21.15.37:0/2358026527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0c00d1140 msgr2=0x7ff0c015ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:10.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.111+0000 7ff0c63ff700 1 --2- 172.21.15.37:0/2358026527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0c00d1140 0x7ff0c015ded0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff0c00b8ee0 tx=0x7ff0b4009b20 comp rx=0 tx=0).stop 2023-07-14T15:56:10.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.111+0000 7ff0c63ff700 1 -- 172.21.15.37:0/2358026527 shutdown_connections 2023-07-14T15:56:10.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.111+0000 7ff0c63ff700 1 --2- 172.21.15.37:0/2358026527 >> v2:172.21.15.98:3300/0 conn(0x7ff0c01603b0 0x7ff0c00b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:10.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.111+0000 7ff0c63ff700 1 --2- 172.21.15.37:0/2358026527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0c00d1140 0x7ff0c015ded0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:10.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.111+0000 7ff0c63ff700 1 -- 172.21.15.37:0/2358026527 >> 172.21.15.37:0/2358026527 conn(0x7ff0c009c1b0 msgr2=0x7ff0c00d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:10.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.111+0000 7ff0c63ff700 1 -- 172.21.15.37:0/2358026527 shutdown_connections 2023-07-14T15:56:10.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.111+0000 7ff0c63ff700 1 -- 172.21.15.37:0/2358026527 wait complete. 2023-07-14T15:56:10.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.112+0000 7ff0c63ff700 1 Processor -- start 2023-07-14T15:56:10.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.113+0000 7ff0c63ff700 1 -- start start 2023-07-14T15:56:10.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.114+0000 7ff0c63ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0c00d1140 0x7ff0c01552b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:10.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.114+0000 7ff0c63ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0c015fee0 0x7ff0c00b0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:10.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.114+0000 7ff0c63ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff0c01603b0 0x7ff0c00b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:10.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.114+0000 7ff0c63ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c0157380 con 0x7ff0c015fee0 2023-07-14T15:56:10.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.114+0000 7ff0c63ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c00b1320 con 0x7ff0c00d1140 2023-07-14T15:56:10.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.114+0000 7ff0c63ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c0156d30 con 0x7ff0c01603b0 2023-07-14T15:56:10.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.114+0000 7ff0bf7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0c015fee0 0x7ff0c00b0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:10.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.114+0000 7ff0bf7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0c015fee0 0x7ff0c00b0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60350/0 (socket says 172.21.15.37:60350) 2023-07-14T15:56:10.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.114+0000 7ff0bf7fe700 1 -- 172.21.15.37:0/2409942649 learned_addr learned my addr 172.21.15.37:0/2409942649 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:10.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.114+0000 7ff0bffff700 1 --2- 172.21.15.37:0/2409942649 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0c00d1140 0x7ff0c01552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:10.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.114+0000 7ff0c499c700 1 --2- 172.21.15.37:0/2409942649 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff0c01603b0 0x7ff0c00b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:10.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.114+0000 7ff0bf7fe700 1 -- 172.21.15.37:0/2409942649 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff0c01603b0 msgr2=0x7ff0c00b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:10.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.114+0000 7ff0bf7fe700 1 --2- 172.21.15.37:0/2409942649 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff0c01603b0 0x7ff0c00b5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:10.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.114+0000 7ff0bf7fe700 1 -- 172.21.15.37:0/2409942649 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0c00d1140 msgr2=0x7ff0c01552b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:10.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.114+0000 7ff0bf7fe700 1 --2- 172.21.15.37:0/2409942649 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0c00d1140 0x7ff0c01552b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:10.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.114+0000 7ff0bf7fe700 1 -- 172.21.15.37:0/2409942649 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b40094a0 con 0x7ff0c015fee0 2023-07-14T15:56:10.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.115+0000 7ff0bf7fe700 1 --2- 172.21.15.37:0/2409942649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0c015fee0 0x7ff0c00b0a60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff0b4000c00 tx=0x7ff0b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:10.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.115+0000 7ff0bcff9700 1 -- 172.21.15.37:0/2409942649 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b40036a0 con 0x7ff0c015fee0 2023-07-14T15:56:10.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.115+0000 7ff0bcff9700 1 -- 172.21.15.37:0/2409942649 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0b401e070 con 0x7ff0c015fee0 2023-07-14T15:56:10.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.115+0000 7ff0bcff9700 1 -- 172.21.15.37:0/2409942649 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b4003a20 con 0x7ff0c015fee0 2023-07-14T15:56:10.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.115+0000 7ff0c63ff700 1 -- 172.21.15.37:0/2409942649 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0c0157010 con 0x7ff0c015fee0 2023-07-14T15:56:10.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.115+0000 7ff0c63ff700 1 -- 172.21.15.37:0/2409942649 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0c00b0fa0 con 0x7ff0c015fee0 2023-07-14T15:56:10.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.116+0000 7ff0c63ff700 1 -- 172.21.15.37:0/2409942649 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0c01574f0 con 0x7ff0c015fee0 2023-07-14T15:56:10.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.117+0000 7ff0bcff9700 1 -- 172.21.15.37:0/2409942649 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff0b4003b80 con 0x7ff0c015fee0 2023-07-14T15:56:10.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.118+0000 7ff0bcff9700 1 --2- 172.21.15.37:0/2409942649 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff0ac06ace0 0x7ff0ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:10.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.118+0000 7ff0bcff9700 1 -- 172.21.15.37:0/2409942649 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff0b408a4f0 con 0x7ff0c015fee0 2023-07-14T15:56:10.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.118+0000 7ff0bffff700 1 --2- 172.21.15.37:0/2409942649 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff0ac06ace0 0x7ff0ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:10.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.119+0000 7ff0bffff700 1 --2- 172.21.15.37:0/2409942649 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff0ac06ace0 0x7ff0ac06d190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0007fd0 tx=0x7ff0b0007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:10.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.122+0000 7ff0bcff9700 1 -- 172.21.15.37:0/2409942649 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff0b4055590 con 0x7ff0c015fee0 2023-07-14T15:56:10.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.379+0000 7ff0c63ff700 1 -- 172.21.15.37:0/2409942649 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff0c0067840 con 0x7ff0c015fee0 2023-07-14T15:56:10.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.976+0000 7ff0bcff9700 1 -- 172.21.15.37:0/2409942649 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff0b4058bb0 con 0x7ff0c015fee0 2023-07-14T15:56:10.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.979+0000 7ff0c63ff700 1 -- 172.21.15.37:0/2409942649 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff0ac06ace0 msgr2=0x7ff0ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:10.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.979+0000 7ff0c63ff700 1 --2- 172.21.15.37:0/2409942649 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff0ac06ace0 0x7ff0ac06d190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0007fd0 tx=0x7ff0b0007de0 comp rx=0 tx=0).stop 2023-07-14T15:56:10.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.979+0000 7ff0c63ff700 1 -- 172.21.15.37:0/2409942649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0c015fee0 msgr2=0x7ff0c00b0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:10.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.979+0000 7ff0c63ff700 1 --2- 172.21.15.37:0/2409942649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0c015fee0 0x7ff0c00b0a60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff0b4000c00 tx=0x7ff0b4004750 comp rx=0 tx=0).stop 2023-07-14T15:56:10.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.979+0000 7ff0c63ff700 1 -- 172.21.15.37:0/2409942649 shutdown_connections 2023-07-14T15:56:10.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.979+0000 7ff0c63ff700 1 --2- 172.21.15.37:0/2409942649 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0c00d1140 0x7ff0c01552b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:10.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.979+0000 7ff0c63ff700 1 --2- 172.21.15.37:0/2409942649 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff0ac06ace0 0x7ff0ac06d190 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:10.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.979+0000 7ff0c63ff700 1 --2- 172.21.15.37:0/2409942649 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff0c01603b0 0x7ff0c00b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:10.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.979+0000 7ff0c63ff700 1 --2- 172.21.15.37:0/2409942649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0c015fee0 0x7ff0c00b0a60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:10.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.979+0000 7ff0c63ff700 1 -- 172.21.15.37:0/2409942649 >> 172.21.15.37:0/2409942649 conn(0x7ff0c009c1b0 msgr2=0x7ff0c015bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:10.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.979+0000 7ff0c63ff700 1 -- 172.21.15.37:0/2409942649 shutdown_connections 2023-07-14T15:56:10.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:10.979+0000 7ff0c63ff700 1 -- 172.21.15.37:0/2409942649 wait complete. 2023-07-14T15:56:10.985 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-14T15:56:10.986 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-14T15:56:11.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.206+0000 7f4da63ff700 1 Processor -- start 2023-07-14T15:56:11.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.206+0000 7f4da63ff700 1 -- start start 2023-07-14T15:56:11.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.207+0000 7f4da63ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4da015c6b0 0x7f4da00d3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:11.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.207+0000 7f4da63ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4da0160d00 0x7f4da00d1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:11.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.207+0000 7f4da63ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4da00cd550 con 0x7f4da0160180 2023-07-14T15:56:11.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.207+0000 7f4da63ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4da015ca80 con 0x7f4da0160d00 2023-07-14T15:56:11.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.207+0000 7f4da63ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da00cd830 con 0x7f4da015c6b0 2023-07-14T15:56:11.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.207+0000 7f4da499c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4da0160d00 0x7f4da00d1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:11.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.207+0000 7f4d9f7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4da0160180 0x7f4da01605f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36742/0 (socket says 172.21.15.37:36742) 2023-07-14T15:56:11.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.207+0000 7f4d9f7fe700 1 -- 172.21.15.37:0/963497310 learned_addr learned my addr 172.21.15.37:0/963497310 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:11.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.207+0000 7f4d9ffff700 1 --2- 172.21.15.37:0/963497310 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4da015c6b0 0x7f4da00d3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:11.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.208+0000 7f4da499c700 1 -- 172.21.15.37:0/963497310 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4da015c6b0 msgr2=0x7f4da00d3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:11.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.208+0000 7f4d9effd700 1 -- 172.21.15.37:0/963497310 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3738060126 0 0) 0x7f4da00cd550 con 0x7f4da0160180 2023-07-14T15:56:11.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.208+0000 7f4da499c700 1 --2- 172.21.15.37:0/963497310 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4da015c6b0 0x7f4da00d3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:11.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.208+0000 7f4da499c700 1 -- 172.21.15.37:0/963497310 >> v1:172.21.15.37:6789/0 conn(0x7f4da0160180 legacy=0x7f4da01605f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:11.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.208+0000 7f4da499c700 1 -- 172.21.15.37:0/963497310 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da00cdb10 con 0x7f4da0160d00 2023-07-14T15:56:11.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.208+0000 7f4da499c700 1 --2- 172.21.15.37:0/963497310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4da0160d00 0x7f4da00d1230 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4d98009dc0 tx=0x7f4d9800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d69cbaf0bcfac94b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:11.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.208+0000 7f4d9effd700 1 -- 172.21.15.37:0/963497310 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9800e070 con 0x7f4da0160d00 2023-07-14T15:56:11.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.208+0000 7f4d9effd700 1 -- 172.21.15.37:0/963497310 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d9800bb90 con 0x7f4da0160d00 2023-07-14T15:56:11.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.208+0000 7f4d9effd700 1 -- 172.21.15.37:0/963497310 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d98012430 con 0x7f4da0160d00 2023-07-14T15:56:11.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.209+0000 7f4da63ff700 1 -- 172.21.15.37:0/963497310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4da0160d00 msgr2=0x7f4da00d1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:11.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.209+0000 7f4da63ff700 1 --2- 172.21.15.37:0/963497310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4da0160d00 0x7f4da00d1230 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4d98009dc0 tx=0x7f4d9800b330 comp rx=0 tx=0).stop 2023-07-14T15:56:11.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.209+0000 7f4da63ff700 1 -- 172.21.15.37:0/963497310 shutdown_connections 2023-07-14T15:56:11.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.209+0000 7f4da63ff700 1 --2- 172.21.15.37:0/963497310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4da0160d00 0x7f4da00d1230 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:11.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.209+0000 7f4da63ff700 1 --2- 172.21.15.37:0/963497310 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4da015c6b0 0x7f4da00d3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:11.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.209+0000 7f4da63ff700 1 -- 172.21.15.37:0/963497310 >> 172.21.15.37:0/963497310 conn(0x7f4da006a680 msgr2=0x7f4da006aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:11.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.209+0000 7f4da63ff700 1 -- 172.21.15.37:0/963497310 shutdown_connections 2023-07-14T15:56:11.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.209+0000 7f4da63ff700 1 -- 172.21.15.37:0/963497310 wait complete. 2023-07-14T15:56:11.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.211+0000 7f4da63ff700 1 Processor -- start 2023-07-14T15:56:11.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.211+0000 7f4da63ff700 1 -- start start 2023-07-14T15:56:11.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.212+0000 7f4da63ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4da015c6b0 0x7f4da00b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:11.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.212+0000 7f4da63ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4da0160180 0x7f4da014d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:11.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.212+0000 7f4da63ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4da0160d00 0x7f4da00cc600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:11.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.212+0000 7f4da63ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da00c6a30 con 0x7f4da0160180 2023-07-14T15:56:11.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.212+0000 7f4da63ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da00c6d10 con 0x7f4da015c6b0 2023-07-14T15:56:11.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.212+0000 7f4da63ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da00c6ff0 con 0x7f4da0160d00 2023-07-14T15:56:11.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.212+0000 7f4d9f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4da0160180 0x7f4da014d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:11.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.212+0000 7f4d9f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4da0160180 0x7f4da014d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60364/0 (socket says 172.21.15.37:60364) 2023-07-14T15:56:11.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.212+0000 7f4d9f7fe700 1 -- 172.21.15.37:0/1815455124 learned_addr learned my addr 172.21.15.37:0/1815455124 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:11.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.212+0000 7f4da499c700 1 --2- 172.21.15.37:0/1815455124 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4da0160d00 0x7f4da00cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:11.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.212+0000 7f4d9ffff700 1 --2- 172.21.15.37:0/1815455124 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4da015c6b0 0x7f4da00b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:11.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.212+0000 7f4d9f7fe700 1 -- 172.21.15.37:0/1815455124 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4da0160d00 msgr2=0x7f4da00cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:11.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.212+0000 7f4d9f7fe700 1 --2- 172.21.15.37:0/1815455124 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4da0160d00 0x7f4da00cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:11.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.212+0000 7f4d9f7fe700 1 -- 172.21.15.37:0/1815455124 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4da015c6b0 msgr2=0x7f4da00b6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:11.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.212+0000 7f4d9f7fe700 1 --2- 172.21.15.37:0/1815455124 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4da015c6b0 0x7f4da00b6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:11.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.212+0000 7f4d9f7fe700 1 -- 172.21.15.37:0/1815455124 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d98009a70 con 0x7f4da0160180 2023-07-14T15:56:11.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.212+0000 7f4d9ffff700 1 --2- 172.21.15.37:0/1815455124 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4da015c6b0 0x7f4da00b6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:56:11.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.213+0000 7f4d9f7fe700 1 --2- 172.21.15.37:0/1815455124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4da0160180 0x7f4da014d9c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4d940011e0 tx=0x7f4d9400cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:11.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.213+0000 7f4d9cff9700 1 -- 172.21.15.37:0/1815455124 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d94004c80 con 0x7f4da0160180 2023-07-14T15:56:11.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.213+0000 7f4d9cff9700 1 -- 172.21.15.37:0/1815455124 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d94004e00 con 0x7f4da0160180 2023-07-14T15:56:11.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.213+0000 7f4da63ff700 1 -- 172.21.15.37:0/1815455124 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4da00c72d0 con 0x7f4da0160180 2023-07-14T15:56:11.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.213+0000 7f4d9cff9700 1 -- 172.21.15.37:0/1815455124 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d94007310 con 0x7f4da0160180 2023-07-14T15:56:11.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.213+0000 7f4da63ff700 1 -- 172.21.15.37:0/1815455124 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4da00b66d0 con 0x7f4da0160180 2023-07-14T15:56:11.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.214+0000 7f4da63ff700 1 -- 172.21.15.37:0/1815455124 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4da00c77f0 con 0x7f4da0160180 2023-07-14T15:56:11.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.215+0000 7f4d9cff9700 1 -- 172.21.15.37:0/1815455124 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4d94007470 con 0x7f4da0160180 2023-07-14T15:56:11.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.216+0000 7f4d9cff9700 1 --2- 172.21.15.37:0/1815455124 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4d8c06ace0 0x7f4d8c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:11.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.216+0000 7f4d9cff9700 1 -- 172.21.15.37:0/1815455124 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4d94089230 con 0x7f4da0160180 2023-07-14T15:56:11.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.216+0000 7f4d9ffff700 1 --2- 172.21.15.37:0/1815455124 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4d8c06ace0 0x7f4d8c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:11.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.217+0000 7f4d9ffff700 1 --2- 172.21.15.37:0/1815455124 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4d8c06ace0 0x7f4d8c06d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4d90009820 tx=0x7f4d90008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:11.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.220+0000 7f4d9cff9700 1 -- 172.21.15.37:0/1815455124 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4da00c77f0 con 0x7f4da0160180 2023-07-14T15:56:11.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.473+0000 7f4da63ff700 1 -- 172.21.15.37:0/1815455124 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4da00c77f0 con 0x7f4da0160180 2023-07-14T15:56:11.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.983+0000 7f4d9cff9700 1 -- 172.21.15.37:0/1815455124 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4da00c77f0 con 0x7f4da0160180 2023-07-14T15:56:11.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.986+0000 7f4da63ff700 1 -- 172.21.15.37:0/1815455124 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4d8c06ace0 msgr2=0x7f4d8c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:11.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.986+0000 7f4da63ff700 1 --2- 172.21.15.37:0/1815455124 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4d8c06ace0 0x7f4d8c06d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4d90009820 tx=0x7f4d90008040 comp rx=0 tx=0).stop 2023-07-14T15:56:11.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.986+0000 7f4da63ff700 1 -- 172.21.15.37:0/1815455124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4da0160180 msgr2=0x7f4da014d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:11.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.986+0000 7f4da63ff700 1 --2- 172.21.15.37:0/1815455124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4da0160180 0x7f4da014d9c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4d940011e0 tx=0x7f4d9400cae0 comp rx=0 tx=0).stop 2023-07-14T15:56:11.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.986+0000 7f4da63ff700 1 -- 172.21.15.37:0/1815455124 shutdown_connections 2023-07-14T15:56:11.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.986+0000 7f4da63ff700 1 --2- 172.21.15.37:0/1815455124 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4da015c6b0 0x7f4da00b6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:11.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.986+0000 7f4da63ff700 1 --2- 172.21.15.37:0/1815455124 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4d8c06ace0 0x7f4d8c06d190 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:11.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.986+0000 7f4da63ff700 1 --2- 172.21.15.37:0/1815455124 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4da0160d00 0x7f4da00cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:11.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.986+0000 7f4da63ff700 1 --2- 172.21.15.37:0/1815455124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4da0160180 0x7f4da014d9c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:11.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.986+0000 7f4da63ff700 1 -- 172.21.15.37:0/1815455124 >> 172.21.15.37:0/1815455124 conn(0x7f4da006a680 msgr2=0x7f4da00cf970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:11.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.986+0000 7f4da63ff700 1 -- 172.21.15.37:0/1815455124 shutdown_connections 2023-07-14T15:56:11.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:11.986+0000 7f4da63ff700 1 -- 172.21.15.37:0/1815455124 wait complete. 2023-07-14T15:56:11.993 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-14T15:56:11.994 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T15:56:12.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.209+0000 7fd10fbff700 1 Processor -- start 2023-07-14T15:56:12.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.210+0000 7fd10fbff700 1 -- start start 2023-07-14T15:56:12.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.211+0000 7fd10fbff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd1080cfff0 0x7fd1080b33e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:12.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.211+0000 7fd10fbff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd1080b4030 0x7fd108166510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:12.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.211+0000 7fd10fbff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1080b2f50 con 0x7fd1080b2030 2023-07-14T15:56:12.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.211+0000 7fd10fbff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1080b2620 con 0x7fd1080cfff0 2023-07-14T15:56:12.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.211+0000 7fd10fbff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1080b2900 con 0x7fd1080b4030 2023-07-14T15:56:12.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.211+0000 7fd10d99b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd1080cfff0 0x7fd1080b33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:12.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.211+0000 7fd10d99b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd1080cfff0 0x7fd1080b33e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60366/0 (socket says 172.21.15.37:60366) 2023-07-14T15:56:12.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.211+0000 7fd10d99b700 1 -- 172.21.15.37:0/3206489381 learned_addr learned my addr 172.21.15.37:0/3206489381 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:12.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.211+0000 7fd10e19c700 1 --2- 172.21.15.37:0/3206489381 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd1080b4030 0x7fd108166510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:12.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.211+0000 7fd10d99b700 1 -- 172.21.15.37:0/3206489381 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd1080b4030 msgr2=0x7fd108166510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:12.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.211+0000 7fd10d99b700 1 --2- 172.21.15.37:0/3206489381 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd1080b4030 0x7fd108166510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:12.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.211+0000 7fd10d99b700 1 -- 172.21.15.37:0/3206489381 >> v1:172.21.15.98:6789/0 conn(0x7fd1080b2030 legacy=0x7fd1080b3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:12.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.211+0000 7fd10d99b700 1 -- 172.21.15.37:0/3206489381 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1080b2be0 con 0x7fd1080cfff0 2023-07-14T15:56:12.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.212+0000 7fd10d99b700 1 --2- 172.21.15.37:0/3206489381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1080cfff0 0x7fd1080b33e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd1040098f0 tx=0x7fd104009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff31b312330412c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:12.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.212+0000 7fd10c999700 1 -- 172.21.15.37:0/3206489381 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd104004230 con 0x7fd1080cfff0 2023-07-14T15:56:12.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.212+0000 7fd10c999700 1 -- 172.21.15.37:0/3206489381 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd104004390 con 0x7fd1080cfff0 2023-07-14T15:56:12.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.212+0000 7fd10c999700 1 -- 172.21.15.37:0/3206489381 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1040036a0 con 0x7fd1080cfff0 2023-07-14T15:56:12.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.212+0000 7fd10fbff700 1 -- 172.21.15.37:0/3206489381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1080cfff0 msgr2=0x7fd1080b33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:12.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.212+0000 7fd10fbff700 1 --2- 172.21.15.37:0/3206489381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1080cfff0 0x7fd1080b33e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd1040098f0 tx=0x7fd104009c00 comp rx=0 tx=0).stop 2023-07-14T15:56:12.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.212+0000 7fd10fbff700 1 -- 172.21.15.37:0/3206489381 shutdown_connections 2023-07-14T15:56:12.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.213+0000 7fd10fbff700 1 --2- 172.21.15.37:0/3206489381 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd1080b4030 0x7fd108166510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:12.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.213+0000 7fd10fbff700 1 --2- 172.21.15.37:0/3206489381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1080cfff0 0x7fd1080b33e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:12.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.213+0000 7fd10fbff700 1 -- 172.21.15.37:0/3206489381 >> 172.21.15.37:0/3206489381 conn(0x7fd10809c160 msgr2=0x7fd1080d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:12.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.213+0000 7fd10fbff700 1 -- 172.21.15.37:0/3206489381 shutdown_connections 2023-07-14T15:56:12.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.213+0000 7fd10fbff700 1 -- 172.21.15.37:0/3206489381 wait complete. 2023-07-14T15:56:12.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.214+0000 7fd10fbff700 1 Processor -- start 2023-07-14T15:56:12.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.215+0000 7fd10fbff700 1 -- start start 2023-07-14T15:56:12.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.215+0000 7fd10fbff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd1080b2030 0x7fd10815c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:12.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.215+0000 7fd10fbff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1080b4030 0x7fd10815b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:12.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.215+0000 7fd10fbff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1080cfff0 0x7fd10809faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:12.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.215+0000 7fd10fbff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1080cad30 con 0x7fd1080cfff0 2023-07-14T15:56:12.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.215+0000 7fd10fbff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10815c640 con 0x7fd1080b4030 2023-07-14T15:56:12.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.215+0000 7fd10fbff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd10809d780 con 0x7fd1080b2030 2023-07-14T15:56:12.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.216+0000 7fd10e19c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1080cfff0 0x7fd10809faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:12.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.216+0000 7fd10e19c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1080cfff0 0x7fd10809faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60382/0 (socket says 172.21.15.37:60382) 2023-07-14T15:56:12.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.216+0000 7fd10e19c700 1 -- 172.21.15.37:0/3341957872 learned_addr learned my addr 172.21.15.37:0/3341957872 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:12.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.216+0000 7fd10d99b700 1 --2- 172.21.15.37:0/3341957872 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd1080b2030 0x7fd10815c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:12.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.216+0000 7fd10d19a700 1 --2- 172.21.15.37:0/3341957872 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1080b4030 0x7fd10815b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:12.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.216+0000 7fd10e19c700 1 -- 172.21.15.37:0/3341957872 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd1080b2030 msgr2=0x7fd10815c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:12.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.216+0000 7fd10e19c700 1 --2- 172.21.15.37:0/3341957872 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd1080b2030 0x7fd10815c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:12.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.216+0000 7fd10e19c700 1 -- 172.21.15.37:0/3341957872 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1080b4030 msgr2=0x7fd10815b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:12.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.216+0000 7fd10e19c700 1 --2- 172.21.15.37:0/3341957872 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1080b4030 0x7fd10815b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:12.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.216+0000 7fd10e19c700 1 -- 172.21.15.37:0/3341957872 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd104009550 con 0x7fd1080cfff0 2023-07-14T15:56:12.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.216+0000 7fd10e19c700 1 --2- 172.21.15.37:0/3341957872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1080cfff0 0x7fd10809faa0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd100007e40 tx=0x7fd10000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:12.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.217+0000 7fd0fe7fc700 1 -- 172.21.15.37:0/3341957872 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10000eea0 con 0x7fd1080cfff0 2023-07-14T15:56:12.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.217+0000 7fd0fe7fc700 1 -- 172.21.15.37:0/3341957872 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd100014420 con 0x7fd1080cfff0 2023-07-14T15:56:12.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.217+0000 7fd10fbff700 1 -- 172.21.15.37:0/3341957872 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd10809da60 con 0x7fd1080cfff0 2023-07-14T15:56:12.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.217+0000 7fd0fe7fc700 1 -- 172.21.15.37:0/3341957872 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1000147b0 con 0x7fd1080cfff0 2023-07-14T15:56:12.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.217+0000 7fd10fbff700 1 -- 172.21.15.37:0/3341957872 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd10809e020 con 0x7fd1080cfff0 2023-07-14T15:56:12.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.218+0000 7fd10fbff700 1 -- 172.21.15.37:0/3341957872 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd108067840 con 0x7fd1080cfff0 2023-07-14T15:56:12.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.219+0000 7fd0fe7fc700 1 -- 172.21.15.37:0/3341957872 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd100014910 con 0x7fd1080cfff0 2023-07-14T15:56:12.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.220+0000 7fd0fe7fc700 1 --2- 172.21.15.37:0/3341957872 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd0ec06ace0 0x7fd0ec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:12.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.220+0000 7fd0fe7fc700 1 -- 172.21.15.37:0/3341957872 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd100089d60 con 0x7fd1080cfff0 2023-07-14T15:56:12.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.220+0000 7fd10d99b700 1 --2- 172.21.15.37:0/3341957872 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd0ec06ace0 0x7fd0ec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:12.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.221+0000 7fd10d99b700 1 --2- 172.21.15.37:0/3341957872 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd0ec06ace0 0x7fd0ec06d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd104009130 tx=0x7fd104008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:12.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.224+0000 7fd0fe7fc700 1 -- 172.21.15.37:0/3341957872 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd100054d70 con 0x7fd1080cfff0 2023-07-14T15:56:12.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.477+0000 7fd10fbff700 1 -- 172.21.15.37:0/3341957872 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd1080b3c00 con 0x7fd1080cfff0 2023-07-14T15:56:12.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.477+0000 7fd0fe7fc700 1 -- 172.21.15.37:0/3341957872 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4697 (secure 0 0 0) 0x7fd100058390 con 0x7fd1080cfff0 2023-07-14T15:56:12.464 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:56:12.465 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/596800720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":596800720},{"type":"v1","addr":"172.21.15.37:6835","nonce":596800720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4318,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/1611780456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1611780456},{"type":"v1","addr":"172.21.15.37:6834","nonce":1611780456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4324,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/586880065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":586880065},{"type":"v1","addr":"172.21.15.98:6835","nonce":586880065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T15:56:08.459886+0000","modified":"2023-07-14T15:56:11.974298+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4327},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4327":{"gid":4327,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6837/2731892479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2731892479},{"type":"v1","addr":"172.21.15.98:6837","nonce":2731892479}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T15:56:12.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.479+0000 7fd10fbff700 1 -- 172.21.15.37:0/3341957872 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd0ec06ace0 msgr2=0x7fd0ec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:12.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.479+0000 7fd10fbff700 1 --2- 172.21.15.37:0/3341957872 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd0ec06ace0 0x7fd0ec06d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd104009130 tx=0x7fd104008030 comp rx=0 tx=0).stop 2023-07-14T15:56:12.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.479+0000 7fd10fbff700 1 -- 172.21.15.37:0/3341957872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1080cfff0 msgr2=0x7fd10809faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:12.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.479+0000 7fd10fbff700 1 --2- 172.21.15.37:0/3341957872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1080cfff0 0x7fd10809faa0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd100007e40 tx=0x7fd10000e3c0 comp rx=0 tx=0).stop 2023-07-14T15:56:12.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.480+0000 7fd10fbff700 1 -- 172.21.15.37:0/3341957872 shutdown_connections 2023-07-14T15:56:12.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.480+0000 7fd10fbff700 1 --2- 172.21.15.37:0/3341957872 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd0ec06ace0 0x7fd0ec06d190 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:12.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.480+0000 7fd10fbff700 1 --2- 172.21.15.37:0/3341957872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1080cfff0 0x7fd10809faa0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:12.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.480+0000 7fd10fbff700 1 --2- 172.21.15.37:0/3341957872 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd1080b2030 0x7fd10815c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:12.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.480+0000 7fd10fbff700 1 --2- 172.21.15.37:0/3341957872 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1080b4030 0x7fd10815b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:12.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.480+0000 7fd10fbff700 1 -- 172.21.15.37:0/3341957872 >> 172.21.15.37:0/3341957872 conn(0x7fd10809c160 msgr2=0x7fd10806b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:12.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.480+0000 7fd10fbff700 1 -- 172.21.15.37:0/3341957872 shutdown_connections 2023-07-14T15:56:12.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.480+0000 7fd10fbff700 1 -- 172.21.15.37:0/3341957872 wait complete. 2023-07-14T15:56:12.468 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 7 2023-07-14T15:56:12.485 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T15:56:12.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.698+0000 7fd85a3ff700 1 Processor -- start 2023-07-14T15:56:12.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.698+0000 7fd85a3ff700 1 -- start start 2023-07-14T15:56:12.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.700+0000 7fd85a3ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd8540b8b80 0x7fd8540b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:12.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.700+0000 7fd85a3ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd854160c50 0x7fd8540cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:12.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.700+0000 7fd85a3ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8540cf6f0 con 0x7fd8540cf8b0 2023-07-14T15:56:12.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.700+0000 7fd85a3ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8540d0de0 con 0x7fd854160c50 2023-07-14T15:56:12.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.700+0000 7fd85a3ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8540cd590 con 0x7fd8540b8b80 2023-07-14T15:56:12.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.700+0000 7fd8537fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd854160c50 0x7fd8540cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:12.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.700+0000 7fd8537fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd854160c50 0x7fd8540cf1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60398/0 (socket says 172.21.15.37:60398) 2023-07-14T15:56:12.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.700+0000 7fd8537fe700 1 -- 172.21.15.37:0/2441005003 learned_addr learned my addr 172.21.15.37:0/2441005003 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:12.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.700+0000 7fd853fff700 1 --2- 172.21.15.37:0/2441005003 >> v2:172.21.15.98:3300/0 conn(0x7fd8540b8b80 0x7fd8540b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:12.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.700+0000 7fd8537fe700 1 -- 172.21.15.37:0/2441005003 >> v2:172.21.15.98:3300/0 conn(0x7fd8540b8b80 msgr2=0x7fd8540b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:12.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.700+0000 7fd8537fe700 1 --2- 172.21.15.37:0/2441005003 >> v2:172.21.15.98:3300/0 conn(0x7fd8540b8b80 0x7fd8540b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:12.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.700+0000 7fd8537fe700 1 -- 172.21.15.37:0/2441005003 >> v1:172.21.15.98:6789/0 conn(0x7fd8540cf8b0 legacy=0x7fd8540d1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:12.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.700+0000 7fd8537fe700 1 -- 172.21.15.37:0/2441005003 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8540cd870 con 0x7fd854160c50 2023-07-14T15:56:12.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.701+0000 7fd8537fe700 1 --2- 172.21.15.37:0/2441005003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd854160c50 0x7fd8540cf1b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd8540cf880 tx=0x7fd848009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c73407b1351f02a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:12.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.701+0000 7fd852ffd700 1 -- 172.21.15.37:0/2441005003 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd848004230 con 0x7fd854160c50 2023-07-14T15:56:12.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.701+0000 7fd852ffd700 1 -- 172.21.15.37:0/2441005003 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd848004390 con 0x7fd854160c50 2023-07-14T15:56:12.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.701+0000 7fd852ffd700 1 -- 172.21.15.37:0/2441005003 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8480036a0 con 0x7fd854160c50 2023-07-14T15:56:12.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.701+0000 7fd85a3ff700 1 -- 172.21.15.37:0/2441005003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd854160c50 msgr2=0x7fd8540cf1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:12.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.701+0000 7fd85a3ff700 1 --2- 172.21.15.37:0/2441005003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd854160c50 0x7fd8540cf1b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd8540cf880 tx=0x7fd848009bd0 comp rx=0 tx=0).stop 2023-07-14T15:56:12.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.701+0000 7fd85a3ff700 1 -- 172.21.15.37:0/2441005003 shutdown_connections 2023-07-14T15:56:12.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.701+0000 7fd85a3ff700 1 --2- 172.21.15.37:0/2441005003 >> v2:172.21.15.98:3300/0 conn(0x7fd8540b8b80 0x7fd8540b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:12.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.701+0000 7fd85a3ff700 1 --2- 172.21.15.37:0/2441005003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd854160c50 0x7fd8540cf1b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:12.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.701+0000 7fd85a3ff700 1 -- 172.21.15.37:0/2441005003 >> 172.21.15.37:0/2441005003 conn(0x7fd85406b150 msgr2=0x7fd85406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:12.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.702+0000 7fd85a3ff700 1 -- 172.21.15.37:0/2441005003 shutdown_connections 2023-07-14T15:56:12.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.702+0000 7fd85a3ff700 1 -- 172.21.15.37:0/2441005003 wait complete. 2023-07-14T15:56:12.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.703+0000 7fd85a3ff700 1 Processor -- start 2023-07-14T15:56:12.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.703+0000 7fd85a3ff700 1 -- start start 2023-07-14T15:56:12.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.704+0000 7fd85a3ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd8540b8b80 0x7fd85414a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:12.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.704+0000 7fd85a3ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8540cf8b0 0x7fd8540cc620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:12.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.704+0000 7fd85a3ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd854160c50 0x7fd8541f1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:12.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.704+0000 7fd85a3ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8540ca880 con 0x7fd8540cf8b0 2023-07-14T15:56:12.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.704+0000 7fd85a3ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85414a010 con 0x7fd854160c50 2023-07-14T15:56:12.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.704+0000 7fd85a3ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8540c9f70 con 0x7fd8540b8b80 2023-07-14T15:56:12.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.705+0000 7fd8537fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8540cf8b0 0x7fd8540cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:12.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.705+0000 7fd8537fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8540cf8b0 0x7fd8540cc620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60408/0 (socket says 172.21.15.37:60408) 2023-07-14T15:56:12.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.705+0000 7fd8537fe700 1 -- 172.21.15.37:0/1035657908 learned_addr learned my addr 172.21.15.37:0/1035657908 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:12.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.705+0000 7fd853fff700 1 --2- 172.21.15.37:0/1035657908 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd8540b8b80 0x7fd85414a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:12.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.705+0000 7fd85899c700 1 --2- 172.21.15.37:0/1035657908 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd854160c50 0x7fd8541f1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:12.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.705+0000 7fd8537fe700 1 -- 172.21.15.37:0/1035657908 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd8540b8b80 msgr2=0x7fd85414a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:12.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.705+0000 7fd8537fe700 1 --2- 172.21.15.37:0/1035657908 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd8540b8b80 0x7fd85414a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:12.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.705+0000 7fd8537fe700 1 -- 172.21.15.37:0/1035657908 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd854160c50 msgr2=0x7fd8541f1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:12.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.705+0000 7fd8537fe700 1 --2- 172.21.15.37:0/1035657908 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd854160c50 0x7fd8541f1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:12.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.705+0000 7fd8537fe700 1 -- 172.21.15.37:0/1035657908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd848009550 con 0x7fd8540cf8b0 2023-07-14T15:56:12.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.705+0000 7fd85899c700 1 --2- 172.21.15.37:0/1035657908 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd854160c50 0x7fd8541f1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:56:12.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.705+0000 7fd8537fe700 1 --2- 172.21.15.37:0/1035657908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8540cf8b0 0x7fd8540cc620 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd848009130 tx=0x7fd848004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:12.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.705+0000 7fd850ff9700 1 -- 172.21.15.37:0/1035657908 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd848003c10 con 0x7fd8540cf8b0 2023-07-14T15:56:12.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.706+0000 7fd850ff9700 1 -- 172.21.15.37:0/1035657908 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd84801f070 con 0x7fd8540cf8b0 2023-07-14T15:56:12.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.706+0000 7fd85a3ff700 1 -- 172.21.15.37:0/1035657908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8540ccfc0 con 0x7fd8540cf8b0 2023-07-14T15:56:12.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.706+0000 7fd850ff9700 1 -- 172.21.15.37:0/1035657908 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd848011630 con 0x7fd8540cf8b0 2023-07-14T15:56:12.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.706+0000 7fd85a3ff700 1 -- 172.21.15.37:0/1035657908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8540ca4a0 con 0x7fd8540cf8b0 2023-07-14T15:56:12.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.707+0000 7fd85a3ff700 1 -- 172.21.15.37:0/1035657908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8540ca9c0 con 0x7fd8540cf8b0 2023-07-14T15:56:12.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.708+0000 7fd850ff9700 1 -- 172.21.15.37:0/1035657908 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd848021030 con 0x7fd8540cf8b0 2023-07-14T15:56:12.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.708+0000 7fd850ff9700 1 --2- 172.21.15.37:0/1035657908 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd84006ace0 0x7fd84006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:12.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.709+0000 7fd850ff9700 1 -- 172.21.15.37:0/1035657908 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd84808aa40 con 0x7fd8540cf8b0 2023-07-14T15:56:12.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.709+0000 7fd853fff700 1 --2- 172.21.15.37:0/1035657908 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd84006ace0 0x7fd84006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:12.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.709+0000 7fd853fff700 1 --2- 172.21.15.37:0/1035657908 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd84006ace0 0x7fd84006d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd844006b20 tx=0x7fd844008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:12.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.713+0000 7fd850ff9700 1 -- 172.21.15.37:0/1035657908 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd8540ca9c0 con 0x7fd8540cf8b0 2023-07-14T15:56:12.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.923+0000 7fd85a3ff700 1 -- 172.21.15.37:0/1035657908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd8540ca9c0 con 0x7fd8540cf8b0 2023-07-14T15:56:12.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.924+0000 7fd850ff9700 1 -- 172.21.15.37:0/1035657908 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18341 (secure 0 0 0) 0x7fd8540ca9c0 con 0x7fd8540cf8b0 2023-07-14T15:56:12.912 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:56:12.912 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"fsid":"9da30401-a779-4e46-aba6-00c2494c6c67","created":"2023-07-14T15:55:39.898867+0000","modified":"2023-07-14T15:56:09.959850+0000","last_up_change":"2023-07-14T15:55:53.025696+0000","last_in_change":"2023-07-14T15:55:43.388192+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T15:55:52.907261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T15:55:59.992839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T15:56:06.091064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T15:56:07.448694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d049535-7b87-4276-8fe5-0f74ba422d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6801","nonce":2783032392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6803","nonce":2783032392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6807","nonce":2783032392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6805","nonce":2783032392}]},"public_addr":"172.21.15.37:6801/2783032392","cluster_addr":"172.21.15.37:6803/2783032392","heartbeat_back_addr":"172.21.15.37:6807/2783032392","heartbeat_front_addr":"172.21.15.37:6805/2783032392","state":["exists","up"]},{"osd":1,"uuid":"79ec948d-ead2-4c2d-923a-dd6eeaac9dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6823","nonce":1190059746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6826","nonce":1190059746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6831","nonce":1190059746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6829","nonce":1190059746}]},"public_addr":"172.21.15.37:6823/1190059746","cluster_addr":"172.21.15.37:6826/1190059746","heartbeat_back_addr":"172.21.15.37:6831/1190059746","heartbeat_front_addr":"172.21.15.37:6829/1190059746","state":["exists","up"]},{"osd":2,"uuid":"a1db6690-c160-4366-9c82-2cca17e4bba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6809","nonce":2266223499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6813","nonce":2266223499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6820","nonce":2266223499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6816","nonce":2266223499}]},"public_addr":"172.21.15.37:6809/2266223499","cluster_addr":"172.21.15.37:6813/2266223499","heartbeat_back_addr":"172.21.15.37:6820/2266223499","heartbeat_front_addr":"172.21.15.37:6816/2266223499","state":["exists","up"]},{"osd":3,"uuid":"767b8220-e79a-4a86-a162-6b3b73198379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6812","nonce":4166694594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6817","nonce":4166694594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6828","nonce":4166694594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6822","nonce":4166694594}]},"public_addr":"172.21.15.37:6812/4166694594","cluster_addr":"172.21.15.37:6817/4166694594","heartbeat_back_addr":"172.21.15.37:6828/4166694594","heartbeat_front_addr":"172.21.15.37:6822/4166694594","state":["exists","up"]},{"osd":4,"uuid":"717bd773-ae7e-4236-ac79-900cf99a37c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6801","nonce":3529020407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6803","nonce":3529020407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6807","nonce":3529020407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6805","nonce":3529020407}]},"public_addr":"172.21.15.98:6801/3529020407","cluster_addr":"172.21.15.98:6803/3529020407","heartbeat_back_addr":"172.21.15.98:6807/3529020407","heartbeat_front_addr":"172.21.15.98:6805/3529020407","state":["exists","up"]},{"osd":5,"uuid":"a941d358-0f03-4136-a9b2-3a1c2e9358cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6817","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6819","nonce":2311501838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6821","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6823","nonce":2311501838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6829","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6831","nonce":2311501838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6825","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6827","nonce":2311501838}]},"public_addr":"172.21.15.98:6819/2311501838","cluster_addr":"172.21.15.98:6823/2311501838","heartbeat_back_addr":"172.21.15.98:6831/2311501838","heartbeat_front_addr":"172.21.15.98:6827/2311501838","state":["exists","up"]},{"osd":6,"uuid":"27153772-6d4b-479d-9953-0582e7b96743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6809","nonce":1144224691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6811","nonce":1144224691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6815","nonce":1144224691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6813","nonce":1144224691}]},"public_addr":"172.21.15.98:6809/1144224691","cluster_addr":"172.21.15.98:6811/1144224691","heartbeat_back_addr":"172.21.15.98:6815/1144224691","heartbeat_front_addr":"172.21.15.98:6813/1144224691","state":["exists","up"]},{"osd":7,"uuid":"d21ffc8e-40bb-47eb-af2c-e3e730d3fb76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6818","nonce":1144470927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6822","nonce":1144470927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6830","nonce":1144470927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6826","nonce":1144470927}]},"public_addr":"172.21.15.98:6818/1144470927","cluster_addr":"172.21.15.98:6822/1144470927","heartbeat_back_addr":"172.21.15.98:6830/1144470927","heartbeat_front_addr":"172.21.15.98:6826/1144470927","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.921114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.739210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.024016+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.002527+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.698127+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.813416+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.709351+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.815457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T15:56:12.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.926+0000 7fd85a3ff700 1 -- 172.21.15.37:0/1035657908 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd84006ace0 msgr2=0x7fd84006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:12.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.926+0000 7fd85a3ff700 1 --2- 172.21.15.37:0/1035657908 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd84006ace0 0x7fd84006d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd844006b20 tx=0x7fd844008040 comp rx=0 tx=0).stop 2023-07-14T15:56:12.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.926+0000 7fd85a3ff700 1 -- 172.21.15.37:0/1035657908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8540cf8b0 msgr2=0x7fd8540cc620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:12.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.926+0000 7fd85a3ff700 1 --2- 172.21.15.37:0/1035657908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8540cf8b0 0x7fd8540cc620 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd848009130 tx=0x7fd848004750 comp rx=0 tx=0).stop 2023-07-14T15:56:12.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.926+0000 7fd85a3ff700 1 -- 172.21.15.37:0/1035657908 shutdown_connections 2023-07-14T15:56:12.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.926+0000 7fd85a3ff700 1 --2- 172.21.15.37:0/1035657908 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd854160c50 0x7fd8541f1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:12.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.926+0000 7fd85a3ff700 1 --2- 172.21.15.37:0/1035657908 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd84006ace0 0x7fd84006d190 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:12.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.926+0000 7fd85a3ff700 1 --2- 172.21.15.37:0/1035657908 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd8540b8b80 0x7fd85414a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:12.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.926+0000 7fd85a3ff700 1 --2- 172.21.15.37:0/1035657908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8540cf8b0 0x7fd8540cc620 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:12.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.926+0000 7fd85a3ff700 1 -- 172.21.15.37:0/1035657908 >> 172.21.15.37:0/1035657908 conn(0x7fd85406b150 msgr2=0x7fd85415dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:12.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.926+0000 7fd85a3ff700 1 -- 172.21.15.37:0/1035657908 shutdown_connections 2023-07-14T15:56:12.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:12.926+0000 7fd85a3ff700 1 -- 172.21.15.37:0/1035657908 wait complete. 2023-07-14T15:56:12.932 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-14T15:56:12.932 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T15:56:13.113 INFO:tasks.ceph.mds.d.smithi098.stderr:2023-07-14T15:56:13.127+0000 7f81d09f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-14T15:56:13.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.147+0000 7fcb1a9ff700 1 Processor -- start 2023-07-14T15:56:13.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.147+0000 7fcb1a9ff700 1 -- start start 2023-07-14T15:56:13.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.148+0000 7fcb1a9ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcb140b85f0 0x7fcb1415d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:13.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.148+0000 7fcb1a9ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fcb140b4910 0x7fcb140b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:13.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.148+0000 7fcb1a9ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb140cf6b0 con 0x7fcb140b54b0 2023-07-14T15:56:13.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.148+0000 7fcb1a9ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb140b5270 con 0x7fcb140b85f0 2023-07-14T15:56:13.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.148+0000 7fcb1a9ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb140cdc40 con 0x7fcb140b4910 2023-07-14T15:56:13.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.148+0000 7fcb13fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcb140b85f0 0x7fcb1415d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:13.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.148+0000 7fcb0bfff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fcb140b54b0 0x7fcb140cfb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36754/0 (socket says 172.21.15.37:36754) 2023-07-14T15:56:13.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.148+0000 7fcb0bfff700 1 -- 172.21.15.37:0/2319340507 learned_addr learned my addr 172.21.15.37:0/2319340507 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:13.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.149+0000 7fcb18f9c700 1 --2- 172.21.15.37:0/2319340507 >> v2:172.21.15.98:3300/0 conn(0x7fcb140b4910 0x7fcb140b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:13.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.149+0000 7fcb13fff700 1 -- 172.21.15.37:0/2319340507 >> v2:172.21.15.98:3300/0 conn(0x7fcb140b4910 msgr2=0x7fcb140b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:13.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.149+0000 7fcb13fff700 1 --2- 172.21.15.37:0/2319340507 >> v2:172.21.15.98:3300/0 conn(0x7fcb140b4910 0x7fcb140b4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:13.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.149+0000 7fcb137fe700 1 -- 172.21.15.37:0/2319340507 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 141148980 0 0) 0x7fcb140cf6b0 con 0x7fcb140b54b0 2023-07-14T15:56:13.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.149+0000 7fcb13fff700 1 -- 172.21.15.37:0/2319340507 >> v1:172.21.15.37:6789/0 conn(0x7fcb140b54b0 legacy=0x7fcb140cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:13.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.149+0000 7fcb13fff700 1 -- 172.21.15.37:0/2319340507 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb1415dba0 con 0x7fcb140b85f0 2023-07-14T15:56:13.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.149+0000 7fcb13fff700 1 --2- 172.21.15.37:0/2319340507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb140b85f0 0x7fcb1415d660 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcb14161270 tx=0x7fcb04009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1a5972f963ecc3c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:13.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.149+0000 7fcb137fe700 1 -- 172.21.15.37:0/2319340507 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb04011830 con 0x7fcb140b85f0 2023-07-14T15:56:13.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.149+0000 7fcb137fe700 1 -- 172.21.15.37:0/2319340507 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb04011990 con 0x7fcb140b85f0 2023-07-14T15:56:13.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.149+0000 7fcb137fe700 1 -- 172.21.15.37:0/2319340507 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb04011d20 con 0x7fcb140b85f0 2023-07-14T15:56:13.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.150+0000 7fcb1a9ff700 1 -- 172.21.15.37:0/2319340507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb140b85f0 msgr2=0x7fcb1415d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:13.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.150+0000 7fcb1a9ff700 1 --2- 172.21.15.37:0/2319340507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb140b85f0 0x7fcb1415d660 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcb14161270 tx=0x7fcb04009b20 comp rx=0 tx=0).stop 2023-07-14T15:56:13.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.150+0000 7fcb1a9ff700 1 -- 172.21.15.37:0/2319340507 shutdown_connections 2023-07-14T15:56:13.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.150+0000 7fcb1a9ff700 1 --2- 172.21.15.37:0/2319340507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb140b85f0 0x7fcb1415d660 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:13.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.150+0000 7fcb1a9ff700 1 --2- 172.21.15.37:0/2319340507 >> v2:172.21.15.98:3300/0 conn(0x7fcb140b4910 0x7fcb140b4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:13.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.150+0000 7fcb1a9ff700 1 -- 172.21.15.37:0/2319340507 >> 172.21.15.37:0/2319340507 conn(0x7fcb1406a580 msgr2=0x7fcb1406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:13.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.150+0000 7fcb1a9ff700 1 -- 172.21.15.37:0/2319340507 shutdown_connections 2023-07-14T15:56:13.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.150+0000 7fcb1a9ff700 1 -- 172.21.15.37:0/2319340507 wait complete. 2023-07-14T15:56:13.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.152+0000 7fcb1a9ff700 1 Processor -- start 2023-07-14T15:56:13.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.152+0000 7fcb1a9ff700 1 -- start start 2023-07-14T15:56:13.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.153+0000 7fcb1a9ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb140b4910 0x7fcb1414a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:13.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.153+0000 7fcb1a9ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcb140b54b0 0x7fcb140cc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:13.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.153+0000 7fcb1a9ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb140b85f0 0x7fcb140c6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:13.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.153+0000 7fcb1a9ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1414a7e0 con 0x7fcb140b4910 2023-07-14T15:56:13.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.153+0000 7fcb1a9ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb140cb670 con 0x7fcb140b85f0 2023-07-14T15:56:13.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.153+0000 7fcb1a9ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb140cb950 con 0x7fcb140b54b0 2023-07-14T15:56:13.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.153+0000 7fcb13fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb140b4910 0x7fcb1414a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:13.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.153+0000 7fcb13fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb140b4910 0x7fcb1414a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60428/0 (socket says 172.21.15.37:60428) 2023-07-14T15:56:13.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.153+0000 7fcb13fff700 1 -- 172.21.15.37:0/3876016325 learned_addr learned my addr 172.21.15.37:0/3876016325 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:13.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.153+0000 7fcb18f9c700 1 --2- 172.21.15.37:0/3876016325 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb140b85f0 0x7fcb140c6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:13.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.153+0000 7fcb13fff700 1 -- 172.21.15.37:0/3876016325 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcb140b54b0 msgr2=0x7fcb140cc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:13.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.153+0000 7fcb13fff700 1 --2- 172.21.15.37:0/3876016325 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcb140b54b0 0x7fcb140cc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:13.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.153+0000 7fcb13fff700 1 -- 172.21.15.37:0/3876016325 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb140b85f0 msgr2=0x7fcb140c6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:13.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.153+0000 7fcb13fff700 1 --2- 172.21.15.37:0/3876016325 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb140b85f0 0x7fcb140c6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:13.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.153+0000 7fcb13fff700 1 -- 172.21.15.37:0/3876016325 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb040094a0 con 0x7fcb140b4910 2023-07-14T15:56:13.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.154+0000 7fcb18f9c700 1 --2- 172.21.15.37:0/3876016325 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb140b85f0 0x7fcb140c6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:56:13.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.154+0000 7fcb13fff700 1 --2- 172.21.15.37:0/3876016325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb140b4910 0x7fcb1414a2a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcb04014040 tx=0x7fcb04004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:13.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.154+0000 7fcb117fa700 1 -- 172.21.15.37:0/3876016325 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb040038a0 con 0x7fcb140b4910 2023-07-14T15:56:13.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.154+0000 7fcb117fa700 1 -- 172.21.15.37:0/3876016325 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb0401e070 con 0x7fcb140b4910 2023-07-14T15:56:13.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.154+0000 7fcb117fa700 1 -- 172.21.15.37:0/3876016325 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb04003c00 con 0x7fcb140b4910 2023-07-14T15:56:13.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.154+0000 7fcb1a9ff700 1 -- 172.21.15.37:0/3876016325 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb140cbc30 con 0x7fcb140b4910 2023-07-14T15:56:13.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.154+0000 7fcb1a9ff700 1 -- 172.21.15.37:0/3876016325 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb140cc1f0 con 0x7fcb140b4910 2023-07-14T15:56:13.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.155+0000 7fcb1a9ff700 1 -- 172.21.15.37:0/3876016325 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb140670c0 con 0x7fcb140b4910 2023-07-14T15:56:13.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.156+0000 7fcb117fa700 1 -- 172.21.15.37:0/3876016325 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcb0402d450 con 0x7fcb140b4910 2023-07-14T15:56:13.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.157+0000 7fcb117fa700 1 --2- 172.21.15.37:0/3876016325 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fcaf406ad10 0x7fcaf406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:13.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.157+0000 7fcb117fa700 1 -- 172.21.15.37:0/3876016325 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcb0408a540 con 0x7fcb140b4910 2023-07-14T15:56:13.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.157+0000 7fcb0bfff700 1 --2- 172.21.15.37:0/3876016325 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fcaf406ad10 0x7fcaf406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:13.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.158+0000 7fcb0bfff700 1 --2- 172.21.15.37:0/3876016325 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fcaf406ad10 0x7fcaf406d1c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcafc0011e0 tx=0x7fcafc0079b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:13.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.161+0000 7fcb117fa700 1 -- 172.21.15.37:0/3876016325 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fcb040555e0 con 0x7fcb140b4910 2023-07-14T15:56:13.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.363+0000 7fcb1a9ff700 1 -- 172.21.15.37:0/3876016325 --> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcb140cf0a0 con 0x7fcaf406ad10 2023-07-14T15:56:13.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.374+0000 7fcb117fa700 1 -- 172.21.15.37:0/3876016325 <== mgr.4100 v2:172.21.15.98:6832/3163748069 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280802 (secure 0 0 0) 0x7fcafc0070d0 con 0x7fcaf406ad10 2023-07-14T15:56:13.364 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:56:13.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.378+0000 7fcb1a9ff700 1 -- 172.21.15.37:0/3876016325 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fcaf406ad10 msgr2=0x7fcaf406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:13.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.378+0000 7fcb1a9ff700 1 --2- 172.21.15.37:0/3876016325 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fcaf406ad10 0x7fcaf406d1c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcafc0011e0 tx=0x7fcafc0079b0 comp rx=0 tx=0).stop 2023-07-14T15:56:13.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.378+0000 7fcb1a9ff700 1 -- 172.21.15.37:0/3876016325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb140b4910 msgr2=0x7fcb1414a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:13.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.378+0000 7fcb1a9ff700 1 --2- 172.21.15.37:0/3876016325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb140b4910 0x7fcb1414a2a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcb04014040 tx=0x7fcb04004750 comp rx=0 tx=0).stop 2023-07-14T15:56:13.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.378+0000 7fcb1a9ff700 1 -- 172.21.15.37:0/3876016325 shutdown_connections 2023-07-14T15:56:13.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.378+0000 7fcb1a9ff700 1 --2- 172.21.15.37:0/3876016325 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb140b85f0 0x7fcb140c6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:13.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.378+0000 7fcb1a9ff700 1 --2- 172.21.15.37:0/3876016325 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fcaf406ad10 0x7fcaf406d1c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:13.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.378+0000 7fcb1a9ff700 1 --2- 172.21.15.37:0/3876016325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb140b4910 0x7fcb1414a2a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:13.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.378+0000 7fcb1a9ff700 1 --2- 172.21.15.37:0/3876016325 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcb140b54b0 0x7fcb140cc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:13.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.378+0000 7fcb1a9ff700 1 -- 172.21.15.37:0/3876016325 >> 172.21.15.37:0/3876016325 conn(0x7fcb1406a580 msgr2=0x7fcb140b5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:13.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.378+0000 7fcb1a9ff700 1 -- 172.21.15.37:0/3876016325 shutdown_connections 2023-07-14T15:56:13.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.378+0000 7fcb1a9ff700 1 -- 172.21.15.37:0/3876016325 wait complete. 2023-07-14T15:56:13.368 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-14T15:56:13.383 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2023-07-14T15:56:12.854446+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590480,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":179,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":160,"acting":160,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":78,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218572,"kb_used_data":2956,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756148,"statfs":{"total":773094113280,"available":772870295552,"internally_reserved":0,"allocated":3026944,"data_stored":1827090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.917020"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.954625+0000","last_change":"2023-07-14T15:56:07.954625+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.954625+0000","last_undegraded":"2023-07-14T15:56:07.954625+0000","last_fullsized":"2023-07-14T15:56:07.954625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-14T15:56:08.990527+0000","last_change":"2023-07-14T15:56:08.984210+0000","last_active":"2023-07-14T15:56:08.990527+0000","last_peered":"2023-07-14T15:56:08.990527+0000","last_clean":"2023-07-14T15:56:08.990527+0000","last_became_active":"2023-07-14T15:56:08.983924+0000","last_became_peered":"2023-07-14T15:56:08.983924+0000","last_unstale":"2023-07-14T15:56:08.990527+0000","last_undegraded":"2023-07-14T15:56:08.990527+0000","last_fullsized":"2023-07-14T15:56:08.990527+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:41:30.227081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-14T15:56:08.972640+0000","last_change":"2023-07-14T15:56:08.968523+0000","last_active":"2023-07-14T15:56:08.972640+0000","last_peered":"2023-07-14T15:56:08.972640+0000","last_clean":"2023-07-14T15:56:08.972640+0000","last_became_active":"2023-07-14T15:56:08.968214+0000","last_became_peered":"2023-07-14T15:56:08.968214+0000","last_unstale":"2023-07-14T15:56:08.972640+0000","last_undegraded":"2023-07-14T15:56:08.972640+0000","last_fullsized":"2023-07-14T15:56:08.972640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:31:21.325556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.962570+0000","last_change":"2023-07-14T15:56:07.962570+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.962570+0000","last_undegraded":"2023-07-14T15:56:07.962570+0000","last_fullsized":"2023-07-14T15:56:07.962570+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.962984+0000","last_change":"2023-07-14T15:56:07.962984+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.962984+0000","last_undegraded":"2023-07-14T15:56:07.962984+0000","last_fullsized":"2023-07-14T15:56:07.962984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489987+0000","last_change":"2023-07-14T15:56:08.963001+0000","last_active":"2023-07-14T15:56:10.489987+0000","last_peered":"2023-07-14T15:56:10.489987+0000","last_clean":"2023-07-14T15:56:10.489987+0000","last_became_active":"2023-07-14T15:56:08.962689+0000","last_became_peered":"2023-07-14T15:56:08.962689+0000","last_unstale":"2023-07-14T15:56:10.489987+0000","last_undegraded":"2023-07-14T15:56:10.489987+0000","last_fullsized":"2023-07-14T15:56:10.489987+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:54:19.293355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489747+0000","last_change":"2023-07-14T15:56:08.974509+0000","last_active":"2023-07-14T15:56:10.489747+0000","last_peered":"2023-07-14T15:56:10.489747+0000","last_clean":"2023-07-14T15:56:10.489747+0000","last_became_active":"2023-07-14T15:56:08.974197+0000","last_became_peered":"2023-07-14T15:56:08.974197+0000","last_unstale":"2023-07-14T15:56:10.489747+0000","last_undegraded":"2023-07-14T15:56:10.489747+0000","last_fullsized":"2023-07-14T15:56:10.489747+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:59:57.661468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489832+0000","last_change":"2023-07-14T15:56:08.965378+0000","last_active":"2023-07-14T15:56:10.489832+0000","last_peered":"2023-07-14T15:56:10.489832+0000","last_clean":"2023-07-14T15:56:10.489832+0000","last_became_active":"2023-07-14T15:56:08.965029+0000","last_became_peered":"2023-07-14T15:56:08.965029+0000","last_unstale":"2023-07-14T15:56:10.489832+0000","last_undegraded":"2023-07-14T15:56:10.489832+0000","last_fullsized":"2023-07-14T15:56:10.489832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:11:49.645623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489209+0000","last_change":"2023-07-14T15:56:08.990555+0000","last_active":"2023-07-14T15:56:10.489209+0000","last_peered":"2023-07-14T15:56:10.489209+0000","last_clean":"2023-07-14T15:56:10.489209+0000","last_became_active":"2023-07-14T15:56:08.990204+0000","last_became_peered":"2023-07-14T15:56:08.990204+0000","last_unstale":"2023-07-14T15:56:10.489209+0000","last_undegraded":"2023-07-14T15:56:10.489209+0000","last_fullsized":"2023-07-14T15:56:10.489209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:53:14.967321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489549+0000","last_change":"2023-07-14T15:56:08.986185+0000","last_active":"2023-07-14T15:56:10.489549+0000","last_peered":"2023-07-14T15:56:10.489549+0000","last_clean":"2023-07-14T15:56:10.489549+0000","last_became_active":"2023-07-14T15:56:08.985934+0000","last_became_peered":"2023-07-14T15:56:08.985934+0000","last_unstale":"2023-07-14T15:56:10.489549+0000","last_undegraded":"2023-07-14T15:56:10.489549+0000","last_fullsized":"2023-07-14T15:56:10.489549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:22:06.842480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-14T15:56:08.969365+0000","last_change":"2023-07-14T15:56:08.962497+0000","last_active":"2023-07-14T15:56:08.969365+0000","last_peered":"2023-07-14T15:56:08.969365+0000","last_clean":"2023-07-14T15:56:08.969365+0000","last_became_active":"2023-07-14T15:56:08.962200+0000","last_became_peered":"2023-07-14T15:56:08.962200+0000","last_unstale":"2023-07-14T15:56:08.969365+0000","last_undegraded":"2023-07-14T15:56:08.969365+0000","last_fullsized":"2023-07-14T15:56:08.969365+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:39:06.825044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.962275+0000","last_change":"2023-07-14T15:56:07.962275+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.962275+0000","last_undegraded":"2023-07-14T15:56:07.962275+0000","last_fullsized":"2023-07-14T15:56:07.962275+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-14T15:56:08.972576+0000","last_change":"2023-07-14T15:56:08.967374+0000","last_active":"2023-07-14T15:56:08.972576+0000","last_peered":"2023-07-14T15:56:08.972576+0000","last_clean":"2023-07-14T15:56:08.972576+0000","last_became_active":"2023-07-14T15:56:08.967057+0000","last_became_peered":"2023-07-14T15:56:08.967057+0000","last_unstale":"2023-07-14T15:56:08.972576+0000","last_undegraded":"2023-07-14T15:56:08.972576+0000","last_fullsized":"2023-07-14T15:56:08.972576+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:39:15.295100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.490060+0000","last_change":"2023-07-14T15:56:08.961701+0000","last_active":"2023-07-14T15:56:10.490060+0000","last_peered":"2023-07-14T15:56:10.490060+0000","last_clean":"2023-07-14T15:56:10.490060+0000","last_became_active":"2023-07-14T15:56:08.961444+0000","last_became_peered":"2023-07-14T15:56:08.961444+0000","last_unstale":"2023-07-14T15:56:10.490060+0000","last_undegraded":"2023-07-14T15:56:10.490060+0000","last_fullsized":"2023-07-14T15:56:10.490060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:23:33.554098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489929+0000","last_change":"2023-07-14T15:56:08.985138+0000","last_active":"2023-07-14T15:56:10.489929+0000","last_peered":"2023-07-14T15:56:10.489929+0000","last_clean":"2023-07-14T15:56:10.489929+0000","last_became_active":"2023-07-14T15:56:08.984870+0000","last_became_peered":"2023-07-14T15:56:08.984870+0000","last_unstale":"2023-07-14T15:56:10.489929+0000","last_undegraded":"2023-07-14T15:56:10.489929+0000","last_fullsized":"2023-07-14T15:56:10.489929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:09:13.220323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489843+0000","last_change":"2023-07-14T15:56:08.985164+0000","last_active":"2023-07-14T15:56:10.489843+0000","last_peered":"2023-07-14T15:56:10.489843+0000","last_clean":"2023-07-14T15:56:10.489843+0000","last_became_active":"2023-07-14T15:56:08.984883+0000","last_became_peered":"2023-07-14T15:56:08.984883+0000","last_unstale":"2023-07-14T15:56:10.489843+0000","last_undegraded":"2023-07-14T15:56:10.489843+0000","last_fullsized":"2023-07-14T15:56:10.489843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:36:15.019527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.963599+0000","last_change":"2023-07-14T15:56:07.963599+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.963599+0000","last_undegraded":"2023-07-14T15:56:07.963599+0000","last_fullsized":"2023-07-14T15:56:07.963599+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"24'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489692+0000","last_change":"2023-07-14T15:56:07.968145+0000","last_active":"2023-07-14T15:56:10.489692+0000","last_peered":"2023-07-14T15:56:10.489692+0000","last_clean":"2023-07-14T15:56:10.489692+0000","last_became_active":"2023-07-14T15:56:07.967843+0000","last_became_peered":"2023-07-14T15:56:07.967843+0000","last_unstale":"2023-07-14T15:56:10.489692+0000","last_undegraded":"2023-07-14T15:56:10.489692+0000","last_fullsized":"2023-07-14T15:56:10.489692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:24:32.242091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2023-07-14T15:56:06.945009+0000","last_change":"2023-07-14T15:56:06.945009+0000","last_active":"2023-07-14T15:56:06.930113+0000","last_peered":"2023-07-14T15:56:06.930113+0000","last_clean":"2023-07-14T15:56:06.930113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:06.945009+0000","last_undegraded":"2023-07-14T15:56:06.945009+0000","last_fullsized":"2023-07-14T15:56:06.945009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2023-07-14T15:56:06.940103+0000","last_change":"2023-07-14T15:56:06.940103+0000","last_active":"2023-07-14T15:56:06.930113+0000","last_peered":"2023-07-14T15:56:06.930113+0000","last_clean":"2023-07-14T15:56:06.930113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:06.940103+0000","last_undegraded":"2023-07-14T15:56:06.940103+0000","last_fullsized":"2023-07-14T15:56:06.940103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.959093+0000","last_change":"2023-07-14T15:56:07.959093+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.959093+0000","last_undegraded":"2023-07-14T15:56:07.959093+0000","last_fullsized":"2023-07-14T15:56:07.959093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2023-07-14T15:56:06.939641+0000","last_change":"2023-07-14T15:56:06.939641+0000","last_active":"2023-07-14T15:56:06.930113+0000","last_peered":"2023-07-14T15:56:06.930113+0000","last_clean":"2023-07-14T15:56:06.930113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:06.939641+0000","last_undegraded":"2023-07-14T15:56:06.939641+0000","last_fullsized":"2023-07-14T15:56:06.939641+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T15:56:07.976968+0000","last_change":"2023-07-14T15:56:07.970831+0000","last_active":"2023-07-14T15:56:07.976968+0000","last_peered":"2023-07-14T15:56:07.976968+0000","last_clean":"2023-07-14T15:56:07.976968+0000","last_became_active":"2023-07-14T15:56:07.970450+0000","last_became_peered":"2023-07-14T15:56:07.970450+0000","last_unstale":"2023-07-14T15:56:07.976968+0000","last_undegraded":"2023-07-14T15:56:07.976968+0000","last_fullsized":"2023-07-14T15:56:07.976968+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:20:49.571526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"24'3","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-14T15:56:08.991954+0000","last_change":"2023-07-14T15:56:07.964545+0000","last_active":"2023-07-14T15:56:08.991954+0000","last_peered":"2023-07-14T15:56:08.991954+0000","last_clean":"2023-07-14T15:56:08.991954+0000","last_became_active":"2023-07-14T15:56:07.963768+0000","last_became_peered":"2023-07-14T15:56:07.963768+0000","last_unstale":"2023-07-14T15:56:08.991954+0000","last_undegraded":"2023-07-14T15:56:08.991954+0000","last_fullsized":"2023-07-14T15:56:08.991954+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:52:08.226282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T15:56:07.975673+0000","last_change":"2023-07-14T15:56:07.970523+0000","last_active":"2023-07-14T15:56:07.975673+0000","last_peered":"2023-07-14T15:56:07.975673+0000","last_clean":"2023-07-14T15:56:07.975673+0000","last_became_active":"2023-07-14T15:56:07.970142+0000","last_became_peered":"2023-07-14T15:56:07.970142+0000","last_unstale":"2023-07-14T15:56:07.975673+0000","last_undegraded":"2023-07-14T15:56:07.975673+0000","last_fullsized":"2023-07-14T15:56:07.975673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:08:34.958562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.951094+0000","last_change":"2023-07-14T15:56:07.951094+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.951094+0000","last_undegraded":"2023-07-14T15:56:07.951094+0000","last_fullsized":"2023-07-14T15:56:07.951094+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T15:56:07.975009+0000","last_change":"2023-07-14T15:56:07.970235+0000","last_active":"2023-07-14T15:56:07.975009+0000","last_peered":"2023-07-14T15:56:07.975009+0000","last_clean":"2023-07-14T15:56:07.975009+0000","last_became_active":"2023-07-14T15:56:07.969938+0000","last_became_peered":"2023-07-14T15:56:07.969938+0000","last_unstale":"2023-07-14T15:56:07.975009+0000","last_undegraded":"2023-07-14T15:56:07.975009+0000","last_fullsized":"2023-07-14T15:56:07.975009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:32:25.876269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489380+0000","last_change":"2023-07-14T15:56:08.980388+0000","last_active":"2023-07-14T15:56:10.489380+0000","last_peered":"2023-07-14T15:56:10.489380+0000","last_clean":"2023-07-14T15:56:10.489380+0000","last_became_active":"2023-07-14T15:56:08.980080+0000","last_became_peered":"2023-07-14T15:56:08.980080+0000","last_unstale":"2023-07-14T15:56:10.489380+0000","last_undegraded":"2023-07-14T15:56:10.489380+0000","last_fullsized":"2023-07-14T15:56:10.489380+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:20:12.345478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489365+0000","last_change":"2023-07-14T15:56:07.975515+0000","last_active":"2023-07-14T15:56:10.489365+0000","last_peered":"2023-07-14T15:56:10.489365+0000","last_clean":"2023-07-14T15:56:10.489365+0000","last_became_active":"2023-07-14T15:56:07.975155+0000","last_became_peered":"2023-07-14T15:56:07.975155+0000","last_unstale":"2023-07-14T15:56:10.489365+0000","last_undegraded":"2023-07-14T15:56:10.489365+0000","last_fullsized":"2023-07-14T15:56:10.489365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:33:36.247286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.961503+0000","last_change":"2023-07-14T15:56:07.961503+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.961503+0000","last_undegraded":"2023-07-14T15:56:07.961503+0000","last_fullsized":"2023-07-14T15:56:07.961503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T15:56:07.975702+0000","last_change":"2023-07-14T15:56:07.970580+0000","last_active":"2023-07-14T15:56:07.975702+0000","last_peered":"2023-07-14T15:56:07.975702+0000","last_clean":"2023-07-14T15:56:07.975702+0000","last_became_active":"2023-07-14T15:56:07.970015+0000","last_became_peered":"2023-07-14T15:56:07.970015+0000","last_unstale":"2023-07-14T15:56:07.975702+0000","last_undegraded":"2023-07-14T15:56:07.975702+0000","last_fullsized":"2023-07-14T15:56:07.975702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:57:57.420084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"24'8","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489443+0000","last_change":"2023-07-14T15:56:07.968155+0000","last_active":"2023-07-14T15:56:10.489443+0000","last_peered":"2023-07-14T15:56:10.489443+0000","last_clean":"2023-07-14T15:56:10.489443+0000","last_became_active":"2023-07-14T15:56:07.967859+0000","last_became_peered":"2023-07-14T15:56:07.967859+0000","last_unstale":"2023-07-14T15:56:10.489443+0000","last_undegraded":"2023-07-14T15:56:10.489443+0000","last_fullsized":"2023-07-14T15:56:10.489443+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:15:27.451548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"24'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-14T15:56:08.991660+0000","last_change":"2023-07-14T15:56:07.967243+0000","last_active":"2023-07-14T15:56:08.991660+0000","last_peered":"2023-07-14T15:56:08.991660+0000","last_clean":"2023-07-14T15:56:08.991660+0000","last_became_active":"2023-07-14T15:56:07.966979+0000","last_became_peered":"2023-07-14T15:56:07.966979+0000","last_unstale":"2023-07-14T15:56:08.991660+0000","last_undegraded":"2023-07-14T15:56:08.991660+0000","last_fullsized":"2023-07-14T15:56:08.991660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:25:07.493777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.955562+0000","last_change":"2023-07-14T15:56:07.955562+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.955562+0000","last_undegraded":"2023-07-14T15:56:07.955562+0000","last_fullsized":"2023-07-14T15:56:07.955562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T15:56:07.976948+0000","last_change":"2023-07-14T15:56:07.968894+0000","last_active":"2023-07-14T15:56:07.976948+0000","last_peered":"2023-07-14T15:56:07.976948+0000","last_clean":"2023-07-14T15:56:07.976948+0000","last_became_active":"2023-07-14T15:56:07.968577+0000","last_became_peered":"2023-07-14T15:56:07.968577+0000","last_unstale":"2023-07-14T15:56:07.976948+0000","last_undegraded":"2023-07-14T15:56:07.976948+0000","last_fullsized":"2023-07-14T15:56:07.976948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:14:49.443210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489497+0000","last_change":"2023-07-14T15:56:08.985023+0000","last_active":"2023-07-14T15:56:10.489497+0000","last_peered":"2023-07-14T15:56:10.489497+0000","last_clean":"2023-07-14T15:56:10.489497+0000","last_became_active":"2023-07-14T15:56:08.984743+0000","last_became_peered":"2023-07-14T15:56:08.984743+0000","last_unstale":"2023-07-14T15:56:10.489497+0000","last_undegraded":"2023-07-14T15:56:10.489497+0000","last_fullsized":"2023-07-14T15:56:10.489497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:52:49.596576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T15:56:07.979827+0000","last_change":"2023-07-14T15:56:07.975480+0000","last_active":"2023-07-14T15:56:07.979827+0000","last_peered":"2023-07-14T15:56:07.979827+0000","last_clean":"2023-07-14T15:56:07.979827+0000","last_became_active":"2023-07-14T15:56:07.975128+0000","last_became_peered":"2023-07-14T15:56:07.975128+0000","last_unstale":"2023-07-14T15:56:07.979827+0000","last_undegraded":"2023-07-14T15:56:07.979827+0000","last_fullsized":"2023-07-14T15:56:07.979827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:40:47.692782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.950885+0000","last_change":"2023-07-14T15:56:07.950885+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.950885+0000","last_undegraded":"2023-07-14T15:56:07.950885+0000","last_fullsized":"2023-07-14T15:56:07.950885+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-14T15:56:08.960224+0000","last_change":"2023-07-14T15:56:07.973033+0000","last_active":"2023-07-14T15:56:08.960224+0000","last_peered":"2023-07-14T15:56:08.960224+0000","last_clean":"2023-07-14T15:56:08.960224+0000","last_became_active":"2023-07-14T15:56:07.972707+0000","last_became_peered":"2023-07-14T15:56:07.972707+0000","last_unstale":"2023-07-14T15:56:08.960224+0000","last_undegraded":"2023-07-14T15:56:08.960224+0000","last_fullsized":"2023-07-14T15:56:08.960224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:07:50.160969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2023-07-14T15:56:06.942568+0000","last_change":"2023-07-14T15:56:06.942568+0000","last_active":"2023-07-14T15:56:06.930113+0000","last_peered":"2023-07-14T15:56:06.930113+0000","last_clean":"2023-07-14T15:56:06.930113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:06.942568+0000","last_undegraded":"2023-07-14T15:56:06.942568+0000","last_fullsized":"2023-07-14T15:56:06.942568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-14T15:56:08.969375+0000","last_change":"2023-07-14T15:56:08.963200+0000","last_active":"2023-07-14T15:56:08.969375+0000","last_peered":"2023-07-14T15:56:08.969375+0000","last_clean":"2023-07-14T15:56:08.969375+0000","last_became_active":"2023-07-14T15:56:08.962998+0000","last_became_peered":"2023-07-14T15:56:08.962998+0000","last_unstale":"2023-07-14T15:56:08.969375+0000","last_undegraded":"2023-07-14T15:56:08.969375+0000","last_fullsized":"2023-07-14T15:56:08.969375+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:37:06.277634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T15:56:07.979885+0000","last_change":"2023-07-14T15:56:07.976310+0000","last_active":"2023-07-14T15:56:07.979885+0000","last_peered":"2023-07-14T15:56:07.979885+0000","last_clean":"2023-07-14T15:56:07.979885+0000","last_became_active":"2023-07-14T15:56:07.975997+0000","last_became_peered":"2023-07-14T15:56:07.975997+0000","last_unstale":"2023-07-14T15:56:07.979885+0000","last_undegraded":"2023-07-14T15:56:07.979885+0000","last_fullsized":"2023-07-14T15:56:07.979885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:41:09.214376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.961029+0000","last_change":"2023-07-14T15:56:07.961029+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.961029+0000","last_undegraded":"2023-07-14T15:56:07.961029+0000","last_fullsized":"2023-07-14T15:56:07.961029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T15:56:07.974822+0000","last_change":"2023-07-14T15:56:07.969636+0000","last_active":"2023-07-14T15:56:07.974822+0000","last_peered":"2023-07-14T15:56:07.974822+0000","last_clean":"2023-07-14T15:56:07.974822+0000","last_became_active":"2023-07-14T15:56:07.969277+0000","last_became_peered":"2023-07-14T15:56:07.969277+0000","last_unstale":"2023-07-14T15:56:07.974822+0000","last_undegraded":"2023-07-14T15:56:07.974822+0000","last_fullsized":"2023-07-14T15:56:07.974822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:03:12.896062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.954093+0000","last_change":"2023-07-14T15:56:07.954093+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.954093+0000","last_undegraded":"2023-07-14T15:56:07.954093+0000","last_fullsized":"2023-07-14T15:56:07.954093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2023-07-14T15:56:06.944913+0000","last_change":"2023-07-14T15:56:06.944913+0000","last_active":"2023-07-14T15:56:06.930113+0000","last_peered":"2023-07-14T15:56:06.930113+0000","last_clean":"2023-07-14T15:56:06.930113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:06.944913+0000","last_undegraded":"2023-07-14T15:56:06.944913+0000","last_fullsized":"2023-07-14T15:56:06.944913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T15:56:06.940962+0000","last_change":"2023-07-14T15:56:02.621850+0000","last_active":"2023-07-14T15:56:06.940962+0000","last_peered":"2023-07-14T15:56:06.940962+0000","last_clean":"2023-07-14T15:56:06.940962+0000","last_became_active":"2023-07-14T15:56:02.621471+0000","last_became_peered":"2023-07-14T15:56:02.621471+0000","last_unstale":"2023-07-14T15:56:06.940962+0000","last_undegraded":"2023-07-14T15:56:06.940962+0000","last_fullsized":"2023-07-14T15:56:06.940962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:03:08.971454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T15:56:07.973829+0000","last_change":"2023-07-14T15:56:07.965851+0000","last_active":"2023-07-14T15:56:07.973829+0000","last_peered":"2023-07-14T15:56:07.973829+0000","last_clean":"2023-07-14T15:56:07.973829+0000","last_became_active":"2023-07-14T15:56:07.965312+0000","last_became_peered":"2023-07-14T15:56:07.965312+0000","last_unstale":"2023-07-14T15:56:07.973829+0000","last_undegraded":"2023-07-14T15:56:07.973829+0000","last_fullsized":"2023-07-14T15:56:07.973829+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:49:41.982719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.488879+0000","last_change":"2023-07-14T15:56:08.974753+0000","last_active":"2023-07-14T15:56:10.488879+0000","last_peered":"2023-07-14T15:56:10.488879+0000","last_clean":"2023-07-14T15:56:10.488879+0000","last_became_active":"2023-07-14T15:56:08.974482+0000","last_became_peered":"2023-07-14T15:56:08.974482+0000","last_unstale":"2023-07-14T15:56:10.488879+0000","last_undegraded":"2023-07-14T15:56:10.488879+0000","last_fullsized":"2023-07-14T15:56:10.488879+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:22:21.802038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T15:56:07.952879+0000","last_change":"2023-07-14T15:56:02.621963+0000","last_active":"2023-07-14T15:56:07.952879+0000","last_peered":"2023-07-14T15:56:07.952879+0000","last_clean":"2023-07-14T15:56:07.952879+0000","last_became_active":"2023-07-14T15:56:02.621678+0000","last_became_peered":"2023-07-14T15:56:02.621678+0000","last_unstale":"2023-07-14T15:56:07.952879+0000","last_undegraded":"2023-07-14T15:56:07.952879+0000","last_fullsized":"2023-07-14T15:56:07.952879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:41:51.335640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-14T15:56:08.959245+0000","last_change":"2023-07-14T15:56:07.970834+0000","last_active":"2023-07-14T15:56:08.959245+0000","last_peered":"2023-07-14T15:56:08.959245+0000","last_clean":"2023-07-14T15:56:08.959245+0000","last_became_active":"2023-07-14T15:56:07.970464+0000","last_became_peered":"2023-07-14T15:56:07.970464+0000","last_unstale":"2023-07-14T15:56:08.959245+0000","last_undegraded":"2023-07-14T15:56:08.959245+0000","last_fullsized":"2023-07-14T15:56:08.959245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:47:36.646483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489620+0000","last_change":"2023-07-14T15:56:08.974479+0000","last_active":"2023-07-14T15:56:10.489620+0000","last_peered":"2023-07-14T15:56:10.489620+0000","last_clean":"2023-07-14T15:56:10.489620+0000","last_became_active":"2023-07-14T15:56:08.974197+0000","last_became_peered":"2023-07-14T15:56:08.974197+0000","last_unstale":"2023-07-14T15:56:10.489620+0000","last_undegraded":"2023-07-14T15:56:10.489620+0000","last_fullsized":"2023-07-14T15:56:10.489620+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:10:08.144011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T15:56:06.942990+0000","last_change":"2023-07-14T15:56:01.925110+0000","last_active":"2023-07-14T15:56:06.942990+0000","last_peered":"2023-07-14T15:56:06.942990+0000","last_clean":"2023-07-14T15:56:06.942990+0000","last_became_active":"2023-07-14T15:56:01.924723+0000","last_became_peered":"2023-07-14T15:56:01.924723+0000","last_unstale":"2023-07-14T15:56:06.942990+0000","last_undegraded":"2023-07-14T15:56:06.942990+0000","last_fullsized":"2023-07-14T15:56:06.942990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:05:05.697085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2023-07-14T15:56:06.939541+0000","last_change":"2023-07-14T15:56:06.939541+0000","last_active":"2023-07-14T15:56:06.930113+0000","last_peered":"2023-07-14T15:56:06.930113+0000","last_clean":"2023-07-14T15:56:06.930113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:06.939541+0000","last_undegraded":"2023-07-14T15:56:06.939541+0000","last_fullsized":"2023-07-14T15:56:06.939541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489621+0000","last_change":"2023-07-14T15:56:08.981489+0000","last_active":"2023-07-14T15:56:10.489621+0000","last_peered":"2023-07-14T15:56:10.489621+0000","last_clean":"2023-07-14T15:56:10.489621+0000","last_became_active":"2023-07-14T15:56:08.981064+0000","last_became_peered":"2023-07-14T15:56:08.981064+0000","last_unstale":"2023-07-14T15:56:10.489621+0000","last_undegraded":"2023-07-14T15:56:10.489621+0000","last_fullsized":"2023-07-14T15:56:10.489621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:09:43.406898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T15:56:07.953532+0000","last_change":"2023-07-14T15:56:01.923465+0000","last_active":"2023-07-14T15:56:07.953532+0000","last_peered":"2023-07-14T15:56:07.953532+0000","last_clean":"2023-07-14T15:56:07.953532+0000","last_became_active":"2023-07-14T15:56:01.923160+0000","last_became_peered":"2023-07-14T15:56:01.923160+0000","last_unstale":"2023-07-14T15:56:07.953532+0000","last_undegraded":"2023-07-14T15:56:07.953532+0000","last_fullsized":"2023-07-14T15:56:07.953532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:07:22.773242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":175,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489184+0000","last_change":"2023-07-14T15:55:54.040065+0000","last_active":"2023-07-14T15:56:10.489184+0000","last_peered":"2023-07-14T15:56:10.489184+0000","last_clean":"2023-07-14T15:56:10.489184+0000","last_became_active":"2023-07-14T15:55:54.038885+0000","last_became_peered":"2023-07-14T15:55:54.038885+0000","last_unstale":"2023-07-14T15:56:10.489184+0000","last_undegraded":"2023-07-14T15:56:10.489184+0000","last_fullsized":"2023-07-14T15:56:10.489184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:55:53.025696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:55:53.025696+0000","last_clean_scrub_stamp":"2023-07-14T15:55:53.025696+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:14:43.173657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2023-07-14T15:56:06.943708+0000","last_change":"2023-07-14T15:56:06.943708+0000","last_active":"2023-07-14T15:56:06.930113+0000","last_peered":"2023-07-14T15:56:06.930113+0000","last_clean":"2023-07-14T15:56:06.930113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:06.943708+0000","last_undegraded":"2023-07-14T15:56:06.943708+0000","last_fullsized":"2023-07-14T15:56:06.943708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.960438+0000","last_change":"2023-07-14T15:56:07.960438+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.960438+0000","last_undegraded":"2023-07-14T15:56:07.960438+0000","last_fullsized":"2023-07-14T15:56:07.960438+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T15:56:07.952062+0000","last_change":"2023-07-14T15:56:01.920714+0000","last_active":"2023-07-14T15:56:07.952062+0000","last_peered":"2023-07-14T15:56:07.952062+0000","last_clean":"2023-07-14T15:56:07.952062+0000","last_became_active":"2023-07-14T15:56:01.920325+0000","last_became_peered":"2023-07-14T15:56:01.920325+0000","last_unstale":"2023-07-14T15:56:07.952062+0000","last_undegraded":"2023-07-14T15:56:07.952062+0000","last_fullsized":"2023-07-14T15:56:07.952062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:52:29.180496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.488883+0000","last_change":"2023-07-14T15:56:07.970542+0000","last_active":"2023-07-14T15:56:10.488883+0000","last_peered":"2023-07-14T15:56:10.488883+0000","last_clean":"2023-07-14T15:56:10.488883+0000","last_became_active":"2023-07-14T15:56:07.970172+0000","last_became_peered":"2023-07-14T15:56:07.970172+0000","last_unstale":"2023-07-14T15:56:10.488883+0000","last_undegraded":"2023-07-14T15:56:10.488883+0000","last_fullsized":"2023-07-14T15:56:10.488883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:31:45.916927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T15:56:07.952243+0000","last_change":"2023-07-14T15:56:01.923631+0000","last_active":"2023-07-14T15:56:07.952243+0000","last_peered":"2023-07-14T15:56:07.952243+0000","last_clean":"2023-07-14T15:56:07.952243+0000","last_became_active":"2023-07-14T15:56:01.922783+0000","last_became_peered":"2023-07-14T15:56:01.922783+0000","last_unstale":"2023-07-14T15:56:07.952243+0000","last_undegraded":"2023-07-14T15:56:07.952243+0000","last_fullsized":"2023-07-14T15:56:07.952243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:53:41.072475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489594+0000","last_change":"2023-07-14T15:56:07.967762+0000","last_active":"2023-07-14T15:56:10.489594+0000","last_peered":"2023-07-14T15:56:10.489594+0000","last_clean":"2023-07-14T15:56:10.489594+0000","last_became_active":"2023-07-14T15:56:07.967471+0000","last_became_peered":"2023-07-14T15:56:07.967471+0000","last_unstale":"2023-07-14T15:56:10.489594+0000","last_undegraded":"2023-07-14T15:56:10.489594+0000","last_fullsized":"2023-07-14T15:56:10.489594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:29:31.273078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489319+0000","last_change":"2023-07-14T15:56:08.976758+0000","last_active":"2023-07-14T15:56:10.489319+0000","last_peered":"2023-07-14T15:56:10.489319+0000","last_clean":"2023-07-14T15:56:10.489319+0000","last_became_active":"2023-07-14T15:56:08.976318+0000","last_became_peered":"2023-07-14T15:56:08.976318+0000","last_unstale":"2023-07-14T15:56:10.489319+0000","last_undegraded":"2023-07-14T15:56:10.489319+0000","last_fullsized":"2023-07-14T15:56:10.489319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:18:49.883894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2023-07-14T15:56:06.945529+0000","last_change":"2023-07-14T15:56:06.945529+0000","last_active":"2023-07-14T15:56:06.930113+0000","last_peered":"2023-07-14T15:56:06.930113+0000","last_clean":"2023-07-14T15:56:06.930113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:06.945529+0000","last_undegraded":"2023-07-14T15:56:06.945529+0000","last_fullsized":"2023-07-14T15:56:06.945529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T15:56:06.947613+0000","last_change":"2023-07-14T15:56:01.965649+0000","last_active":"2023-07-14T15:56:06.947613+0000","last_peered":"2023-07-14T15:56:06.947613+0000","last_clean":"2023-07-14T15:56:06.947613+0000","last_became_active":"2023-07-14T15:56:01.965344+0000","last_became_peered":"2023-07-14T15:56:01.965344+0000","last_unstale":"2023-07-14T15:56:06.947613+0000","last_undegraded":"2023-07-14T15:56:06.947613+0000","last_fullsized":"2023-07-14T15:56:06.947613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:05:05.697085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T15:56:07.953390+0000","last_change":"2023-07-14T15:56:01.966578+0000","last_active":"2023-07-14T15:56:07.953390+0000","last_peered":"2023-07-14T15:56:07.953390+0000","last_clean":"2023-07-14T15:56:07.953390+0000","last_became_active":"2023-07-14T15:56:01.966216+0000","last_became_peered":"2023-07-14T15:56:01.966216+0000","last_unstale":"2023-07-14T15:56:07.953390+0000","last_undegraded":"2023-07-14T15:56:07.953390+0000","last_fullsized":"2023-07-14T15:56:07.953390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:04:26.951849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2023-07-14T15:56:06.945247+0000","last_change":"2023-07-14T15:56:06.945247+0000","last_active":"2023-07-14T15:56:06.930113+0000","last_peered":"2023-07-14T15:56:06.930113+0000","last_clean":"2023-07-14T15:56:06.930113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:06.945247+0000","last_undegraded":"2023-07-14T15:56:06.945247+0000","last_fullsized":"2023-07-14T15:56:06.945247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.949736+0000","last_change":"2023-07-14T15:56:07.949736+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.949736+0000","last_undegraded":"2023-07-14T15:56:07.949736+0000","last_fullsized":"2023-07-14T15:56:07.949736+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2023-07-14T15:56:06.945000+0000","last_change":"2023-07-14T15:56:06.945000+0000","last_active":"2023-07-14T15:56:06.930113+0000","last_peered":"2023-07-14T15:56:06.930113+0000","last_clean":"2023-07-14T15:56:06.930113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:06.945000+0000","last_undegraded":"2023-07-14T15:56:06.945000+0000","last_fullsized":"2023-07-14T15:56:06.945000+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.490013+0000","last_change":"2023-07-14T15:56:07.968681+0000","last_active":"2023-07-14T15:56:10.490013+0000","last_peered":"2023-07-14T15:56:10.490013+0000","last_clean":"2023-07-14T15:56:10.490013+0000","last_became_active":"2023-07-14T15:56:07.968350+0000","last_became_peered":"2023-07-14T15:56:07.968350+0000","last_unstale":"2023-07-14T15:56:10.490013+0000","last_undegraded":"2023-07-14T15:56:10.490013+0000","last_fullsized":"2023-07-14T15:56:10.490013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:12:08.491508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.951717+0000","last_change":"2023-07-14T15:56:07.951717+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.951717+0000","last_undegraded":"2023-07-14T15:56:07.951717+0000","last_fullsized":"2023-07-14T15:56:07.951717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T15:56:07.975803+0000","last_change":"2023-07-14T15:56:07.971194+0000","last_active":"2023-07-14T15:56:07.975803+0000","last_peered":"2023-07-14T15:56:07.975803+0000","last_clean":"2023-07-14T15:56:07.975803+0000","last_became_active":"2023-07-14T15:56:07.970215+0000","last_became_peered":"2023-07-14T15:56:07.970215+0000","last_unstale":"2023-07-14T15:56:07.975803+0000","last_undegraded":"2023-07-14T15:56:07.975803+0000","last_fullsized":"2023-07-14T15:56:07.975803+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:40:04.386118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.955961+0000","last_change":"2023-07-14T15:56:07.955961+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.955961+0000","last_undegraded":"2023-07-14T15:56:07.955961+0000","last_fullsized":"2023-07-14T15:56:07.955961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2023-07-14T15:56:06.939718+0000","last_change":"2023-07-14T15:56:06.939718+0000","last_active":"2023-07-14T15:56:06.930113+0000","last_peered":"2023-07-14T15:56:06.930113+0000","last_clean":"2023-07-14T15:56:06.930113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:06.939718+0000","last_undegraded":"2023-07-14T15:56:06.939718+0000","last_fullsized":"2023-07-14T15:56:06.939718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2023-07-14T15:56:06.940302+0000","last_change":"2023-07-14T15:56:06.940302+0000","last_active":"2023-07-14T15:56:06.930113+0000","last_peered":"2023-07-14T15:56:06.930113+0000","last_clean":"2023-07-14T15:56:06.930113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:06.940302+0000","last_undegraded":"2023-07-14T15:56:06.940302+0000","last_fullsized":"2023-07-14T15:56:06.940302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.949666+0000","last_change":"2023-07-14T15:56:07.949666+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.949666+0000","last_undegraded":"2023-07-14T15:56:07.949666+0000","last_fullsized":"2023-07-14T15:56:07.949666+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489873+0000","last_change":"2023-07-14T15:56:08.962047+0000","last_active":"2023-07-14T15:56:10.489873+0000","last_peered":"2023-07-14T15:56:10.489873+0000","last_clean":"2023-07-14T15:56:10.489873+0000","last_became_active":"2023-07-14T15:56:08.961657+0000","last_became_peered":"2023-07-14T15:56:08.961657+0000","last_unstale":"2023-07-14T15:56:10.489873+0000","last_undegraded":"2023-07-14T15:56:10.489873+0000","last_fullsized":"2023-07-14T15:56:10.489873+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:32:30.477405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.488979+0000","last_change":"2023-07-14T15:56:08.979917+0000","last_active":"2023-07-14T15:56:10.488979+0000","last_peered":"2023-07-14T15:56:10.488979+0000","last_clean":"2023-07-14T15:56:10.488979+0000","last_became_active":"2023-07-14T15:56:08.979617+0000","last_became_peered":"2023-07-14T15:56:08.979617+0000","last_unstale":"2023-07-14T15:56:10.488979+0000","last_undegraded":"2023-07-14T15:56:10.488979+0000","last_fullsized":"2023-07-14T15:56:10.488979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:10:09.608521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-14T15:56:08.973967+0000","last_change":"2023-07-14T15:56:08.971350+0000","last_active":"2023-07-14T15:56:08.973967+0000","last_peered":"2023-07-14T15:56:08.973967+0000","last_clean":"2023-07-14T15:56:08.973967+0000","last_became_active":"2023-07-14T15:56:08.970957+0000","last_became_peered":"2023-07-14T15:56:08.970957+0000","last_unstale":"2023-07-14T15:56:08.973967+0000","last_undegraded":"2023-07-14T15:56:08.973967+0000","last_fullsized":"2023-07-14T15:56:08.973967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:55:29.083644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":78,"acting":78,"num_store_stats":5},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476742,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":74768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]}]},{"osd":0,"up_from":16,"seq":68719476743,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":229376,"data_stored":81396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":258048,"data_stored":95267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":860160,"data_stored":686219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]}]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":74768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":74768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]}]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":811008,"data_stored":665136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]}]},{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":74768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T15:56:13.391 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T15:56:13.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.639+0000 7f7ae2dff700 1 Processor -- start 2023-07-14T15:56:13.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.639+0000 7f7ae2dff700 1 -- start start 2023-07-14T15:56:13.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.640+0000 7f7ae2dff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f7adc1593c0 0x7f7adc0ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:13.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.640+0000 7f7ae2dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7adc159790 0x7f7adc0af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:13.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.640+0000 7f7ae2dff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7adc0c9540 con 0x7f7adc0c9b30 2023-07-14T15:56:13.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.640+0000 7f7ae2dff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7adc0c9ff0 con 0x7f7adc1593c0 2023-07-14T15:56:13.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.640+0000 7f7ae2dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7adc0ce3d0 con 0x7f7adc159790 2023-07-14T15:56:13.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.641+0000 7f7ae0b9b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f7adc1593c0 0x7f7adc0ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:13.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.641+0000 7f7ae139c700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7adc159790 0x7f7adc0af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:13.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.641+0000 7f7ae139c700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7adc159790 0x7f7adc0af940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3301/0 says I am v2:172.21.15.37:51070/0 (socket says 172.21.15.37:51070) 2023-07-14T15:56:13.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.641+0000 7f7ae139c700 1 -- 172.21.15.37:0/4110382424 learned_addr learned my addr 172.21.15.37:0/4110382424 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:13.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.641+0000 7f7ae0b9b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f7adc1593c0 0x7f7adc0ccce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.37:51064/0 (socket says 172.21.15.37:51064) 2023-07-14T15:56:13.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.641+0000 7f7adb7fe700 1 -- 172.21.15.37:0/4110382424 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3177841553 0 0) 0x7f7adc0c9540 con 0x7f7adc0c9b30 2023-07-14T15:56:13.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.641+0000 7f7ae139c700 1 -- 172.21.15.37:0/4110382424 >> v2:172.21.15.98:3300/0 conn(0x7f7adc1593c0 msgr2=0x7f7adc0ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:13.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.641+0000 7f7ae139c700 1 --2- 172.21.15.37:0/4110382424 >> v2:172.21.15.98:3300/0 conn(0x7f7adc1593c0 0x7f7adc0ccce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:13.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.641+0000 7f7ae139c700 1 -- 172.21.15.37:0/4110382424 >> v1:172.21.15.98:6789/0 conn(0x7f7adc0c9b30 legacy=0x7f7adc15db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:13.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.641+0000 7f7ae139c700 1 -- 172.21.15.37:0/4110382424 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7adc0ce6b0 con 0x7f7adc159790 2023-07-14T15:56:13.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.641+0000 7f7ae0b9b700 1 --2- 172.21.15.37:0/4110382424 >> v2:172.21.15.98:3300/0 conn(0x7f7adc1593c0 0x7f7adc0ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:56:13.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.641+0000 7f7ae139c700 1 --2- 172.21.15.37:0/4110382424 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7adc159790 0x7f7adc0af940 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4009e50 tx=0x7f7ad400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f2f7aa4cf7e5186 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:13.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.642+0000 7f7adb7fe700 1 -- 172.21.15.37:0/4110382424 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad400e070 con 0x7f7adc159790 2023-07-14T15:56:13.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.642+0000 7f7adb7fe700 1 -- 172.21.15.37:0/4110382424 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad400b910 con 0x7f7adc159790 2023-07-14T15:56:13.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.642+0000 7f7adb7fe700 1 -- 172.21.15.37:0/4110382424 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad400bcc0 con 0x7f7adc159790 2023-07-14T15:56:13.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.642+0000 7f7ae2dff700 1 -- 172.21.15.37:0/4110382424 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7adc159790 msgr2=0x7f7adc0af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:13.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.642+0000 7f7ae2dff700 1 --2- 172.21.15.37:0/4110382424 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7adc159790 0x7f7adc0af940 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4009e50 tx=0x7f7ad400b330 comp rx=0 tx=0).stop 2023-07-14T15:56:13.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.642+0000 7f7ae2dff700 1 -- 172.21.15.37:0/4110382424 shutdown_connections 2023-07-14T15:56:13.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.642+0000 7f7ae2dff700 1 --2- 172.21.15.37:0/4110382424 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7adc159790 0x7f7adc0af940 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:13.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.642+0000 7f7ae2dff700 1 --2- 172.21.15.37:0/4110382424 >> v2:172.21.15.98:3300/0 conn(0x7f7adc1593c0 0x7f7adc0ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:13.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.642+0000 7f7ae2dff700 1 -- 172.21.15.37:0/4110382424 >> 172.21.15.37:0/4110382424 conn(0x7f7adc0b08c0 msgr2=0x7f7adc0b0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:13.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.642+0000 7f7ae2dff700 1 -- 172.21.15.37:0/4110382424 shutdown_connections 2023-07-14T15:56:13.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.643+0000 7f7ae2dff700 1 -- 172.21.15.37:0/4110382424 wait complete. 2023-07-14T15:56:13.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.644+0000 7f7ae2dff700 1 Processor -- start 2023-07-14T15:56:13.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.644+0000 7f7ae2dff700 1 -- start start 2023-07-14T15:56:13.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.645+0000 7f7ae2dff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7adc0c9b30 0x7f7adc1508c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:13.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.645+0000 7f7ae2dff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7adc1593c0 0x7f7adc14a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:13.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.645+0000 7f7ae2dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7adc159790 0x7f7adc1520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:13.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.645+0000 7f7ae2dff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7adc150e00 con 0x7f7adc0c9b30 2023-07-14T15:56:13.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.645+0000 7f7ae2dff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7adc0b32f0 con 0x7f7adc1593c0 2023-07-14T15:56:13.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.645+0000 7f7ae2dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7adc0b3890 con 0x7f7adc159790 2023-07-14T15:56:13.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.646+0000 7f7ae0b9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7adc0c9b30 0x7f7adc1508c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:13.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.646+0000 7f7ae0b9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7adc0c9b30 0x7f7adc1508c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60432/0 (socket says 172.21.15.37:60432) 2023-07-14T15:56:13.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.646+0000 7f7ae0b9b700 1 -- 172.21.15.37:0/1164117436 learned_addr learned my addr 172.21.15.37:0/1164117436 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:13.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.646+0000 7f7ae139c700 1 --2- 172.21.15.37:0/1164117436 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7adc159790 0x7f7adc1520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:13.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.646+0000 7f7adbfff700 1 --2- 172.21.15.37:0/1164117436 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7adc1593c0 0x7f7adc14a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:13.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.646+0000 7f7ae0b9b700 1 -- 172.21.15.37:0/1164117436 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7adc159790 msgr2=0x7f7adc1520d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:13.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.646+0000 7f7ae0b9b700 1 --2- 172.21.15.37:0/1164117436 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7adc159790 0x7f7adc1520d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:13.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.646+0000 7f7ae0b9b700 1 -- 172.21.15.37:0/1164117436 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7adc1593c0 msgr2=0x7f7adc14a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:13.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.646+0000 7f7ae0b9b700 1 --2- 172.21.15.37:0/1164117436 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7adc1593c0 0x7f7adc14a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:13.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.646+0000 7f7ae0b9b700 1 -- 172.21.15.37:0/1164117436 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad000b740 con 0x7f7adc0c9b30 2023-07-14T15:56:13.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.646+0000 7f7ae139c700 1 --2- 172.21.15.37:0/1164117436 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7adc159790 0x7f7adc1520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:56:13.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.646+0000 7f7adbfff700 1 --2- 172.21.15.37:0/1164117436 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7adc1593c0 0x7f7adc14a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:56:13.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.646+0000 7f7ae0b9b700 1 --2- 172.21.15.37:0/1164117436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7adc0c9b30 0x7f7adc1508c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0010f50 tx=0x7f7ad000e6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:13.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.647+0000 7f7ad97fa700 1 -- 172.21.15.37:0/1164117436 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad0011650 con 0x7f7adc0c9b30 2023-07-14T15:56:13.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.647+0000 7f7ad97fa700 1 -- 172.21.15.37:0/1164117436 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad00117b0 con 0x7f7adc0c9b30 2023-07-14T15:56:13.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.647+0000 7f7ad97fa700 1 -- 172.21.15.37:0/1164117436 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad0011b40 con 0x7f7adc0c9b30 2023-07-14T15:56:13.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.647+0000 7f7ae2dff700 1 -- 172.21.15.37:0/1164117436 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ad4009b30 con 0x7f7adc0c9b30 2023-07-14T15:56:13.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.647+0000 7f7ae2dff700 1 -- 172.21.15.37:0/1164117436 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7adc151010 con 0x7f7adc0c9b30 2023-07-14T15:56:13.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.648+0000 7f7ae2dff700 1 -- 172.21.15.37:0/1164117436 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7adc0b3b70 con 0x7f7adc0c9b30 2023-07-14T15:56:13.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.649+0000 7f7ad97fa700 1 -- 172.21.15.37:0/1164117436 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7ad0011ca0 con 0x7f7adc0c9b30 2023-07-14T15:56:13.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.650+0000 7f7ad97fa700 1 --2- 172.21.15.37:0/1164117436 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f7ac006ace0 0x7f7ac006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:13.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.650+0000 7f7ad97fa700 1 -- 172.21.15.37:0/1164117436 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7ad008c350 con 0x7f7adc0c9b30 2023-07-14T15:56:13.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.651+0000 7f7adbfff700 1 --2- 172.21.15.37:0/1164117436 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f7ac006ace0 0x7f7ac006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:13.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.651+0000 7f7adbfff700 1 --2- 172.21.15.37:0/1164117436 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f7ac006ace0 0x7f7ac006d190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7adc0cdb90 tx=0x7f7ac8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:13.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.654+0000 7f7ad97fa700 1 -- 172.21.15.37:0/1164117436 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7ad0057360 con 0x7f7adc0c9b30 2023-07-14T15:56:13.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.859+0000 7f7ae2dff700 1 -- 172.21.15.37:0/1164117436 --> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7adc06f9e0 con 0x7f7ac006ace0 2023-07-14T15:56:13.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.867+0000 7f7ad97fa700 1 -- 172.21.15.37:0/1164117436 <== mgr.4100 v2:172.21.15.98:6832/3163748069 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280802 (secure 0 0 0) 0x7f7ac8001ca0 con 0x7f7ac006ace0 2023-07-14T15:56:13.857 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:56:13.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.871+0000 7f7ae2dff700 1 -- 172.21.15.37:0/1164117436 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f7ac006ace0 msgr2=0x7f7ac006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:13.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.871+0000 7f7ae2dff700 1 --2- 172.21.15.37:0/1164117436 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f7ac006ace0 0x7f7ac006d190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7adc0cdb90 tx=0x7f7ac8009040 comp rx=0 tx=0).stop 2023-07-14T15:56:13.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.871+0000 7f7ae2dff700 1 -- 172.21.15.37:0/1164117436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7adc0c9b30 msgr2=0x7f7adc1508c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:13.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.871+0000 7f7ae2dff700 1 --2- 172.21.15.37:0/1164117436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7adc0c9b30 0x7f7adc1508c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0010f50 tx=0x7f7ad000e6f0 comp rx=0 tx=0).stop 2023-07-14T15:56:13.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.871+0000 7f7ae2dff700 1 -- 172.21.15.37:0/1164117436 shutdown_connections 2023-07-14T15:56:13.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.871+0000 7f7ae2dff700 1 --2- 172.21.15.37:0/1164117436 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f7ac006ace0 0x7f7ac006d190 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:13.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.871+0000 7f7ae2dff700 1 --2- 172.21.15.37:0/1164117436 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7adc159790 0x7f7adc1520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:13.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.871+0000 7f7ae2dff700 1 --2- 172.21.15.37:0/1164117436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7adc0c9b30 0x7f7adc1508c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:13.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.871+0000 7f7ae2dff700 1 --2- 172.21.15.37:0/1164117436 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7adc1593c0 0x7f7adc14a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:13.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.871+0000 7f7ae2dff700 1 -- 172.21.15.37:0/1164117436 >> 172.21.15.37:0/1164117436 conn(0x7f7adc0b08c0 msgr2=0x7f7adc14e810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:13.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.871+0000 7f7ae2dff700 1 -- 172.21.15.37:0/1164117436 shutdown_connections 2023-07-14T15:56:13.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:13.871+0000 7f7ae2dff700 1 -- 172.21.15.37:0/1164117436 wait complete. 2023-07-14T15:56:13.861 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-14T15:56:13.876 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2023-07-14T15:56:12.854446+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590480,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":179,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":160,"acting":160,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":78,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218572,"kb_used_data":2956,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756148,"statfs":{"total":773094113280,"available":772870295552,"internally_reserved":0,"allocated":3026944,"data_stored":1827090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.917020"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.954625+0000","last_change":"2023-07-14T15:56:07.954625+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.954625+0000","last_undegraded":"2023-07-14T15:56:07.954625+0000","last_fullsized":"2023-07-14T15:56:07.954625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-14T15:56:08.990527+0000","last_change":"2023-07-14T15:56:08.984210+0000","last_active":"2023-07-14T15:56:08.990527+0000","last_peered":"2023-07-14T15:56:08.990527+0000","last_clean":"2023-07-14T15:56:08.990527+0000","last_became_active":"2023-07-14T15:56:08.983924+0000","last_became_peered":"2023-07-14T15:56:08.983924+0000","last_unstale":"2023-07-14T15:56:08.990527+0000","last_undegraded":"2023-07-14T15:56:08.990527+0000","last_fullsized":"2023-07-14T15:56:08.990527+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:41:30.227081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-14T15:56:08.972640+0000","last_change":"2023-07-14T15:56:08.968523+0000","last_active":"2023-07-14T15:56:08.972640+0000","last_peered":"2023-07-14T15:56:08.972640+0000","last_clean":"2023-07-14T15:56:08.972640+0000","last_became_active":"2023-07-14T15:56:08.968214+0000","last_became_peered":"2023-07-14T15:56:08.968214+0000","last_unstale":"2023-07-14T15:56:08.972640+0000","last_undegraded":"2023-07-14T15:56:08.972640+0000","last_fullsized":"2023-07-14T15:56:08.972640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:31:21.325556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.962570+0000","last_change":"2023-07-14T15:56:07.962570+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.962570+0000","last_undegraded":"2023-07-14T15:56:07.962570+0000","last_fullsized":"2023-07-14T15:56:07.962570+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.962984+0000","last_change":"2023-07-14T15:56:07.962984+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.962984+0000","last_undegraded":"2023-07-14T15:56:07.962984+0000","last_fullsized":"2023-07-14T15:56:07.962984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489987+0000","last_change":"2023-07-14T15:56:08.963001+0000","last_active":"2023-07-14T15:56:10.489987+0000","last_peered":"2023-07-14T15:56:10.489987+0000","last_clean":"2023-07-14T15:56:10.489987+0000","last_became_active":"2023-07-14T15:56:08.962689+0000","last_became_peered":"2023-07-14T15:56:08.962689+0000","last_unstale":"2023-07-14T15:56:10.489987+0000","last_undegraded":"2023-07-14T15:56:10.489987+0000","last_fullsized":"2023-07-14T15:56:10.489987+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:54:19.293355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489747+0000","last_change":"2023-07-14T15:56:08.974509+0000","last_active":"2023-07-14T15:56:10.489747+0000","last_peered":"2023-07-14T15:56:10.489747+0000","last_clean":"2023-07-14T15:56:10.489747+0000","last_became_active":"2023-07-14T15:56:08.974197+0000","last_became_peered":"2023-07-14T15:56:08.974197+0000","last_unstale":"2023-07-14T15:56:10.489747+0000","last_undegraded":"2023-07-14T15:56:10.489747+0000","last_fullsized":"2023-07-14T15:56:10.489747+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:59:57.661468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489832+0000","last_change":"2023-07-14T15:56:08.965378+0000","last_active":"2023-07-14T15:56:10.489832+0000","last_peered":"2023-07-14T15:56:10.489832+0000","last_clean":"2023-07-14T15:56:10.489832+0000","last_became_active":"2023-07-14T15:56:08.965029+0000","last_became_peered":"2023-07-14T15:56:08.965029+0000","last_unstale":"2023-07-14T15:56:10.489832+0000","last_undegraded":"2023-07-14T15:56:10.489832+0000","last_fullsized":"2023-07-14T15:56:10.489832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:11:49.645623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489209+0000","last_change":"2023-07-14T15:56:08.990555+0000","last_active":"2023-07-14T15:56:10.489209+0000","last_peered":"2023-07-14T15:56:10.489209+0000","last_clean":"2023-07-14T15:56:10.489209+0000","last_became_active":"2023-07-14T15:56:08.990204+0000","last_became_peered":"2023-07-14T15:56:08.990204+0000","last_unstale":"2023-07-14T15:56:10.489209+0000","last_undegraded":"2023-07-14T15:56:10.489209+0000","last_fullsized":"2023-07-14T15:56:10.489209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:53:14.967321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489549+0000","last_change":"2023-07-14T15:56:08.986185+0000","last_active":"2023-07-14T15:56:10.489549+0000","last_peered":"2023-07-14T15:56:10.489549+0000","last_clean":"2023-07-14T15:56:10.489549+0000","last_became_active":"2023-07-14T15:56:08.985934+0000","last_became_peered":"2023-07-14T15:56:08.985934+0000","last_unstale":"2023-07-14T15:56:10.489549+0000","last_undegraded":"2023-07-14T15:56:10.489549+0000","last_fullsized":"2023-07-14T15:56:10.489549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:22:06.842480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-14T15:56:08.969365+0000","last_change":"2023-07-14T15:56:08.962497+0000","last_active":"2023-07-14T15:56:08.969365+0000","last_peered":"2023-07-14T15:56:08.969365+0000","last_clean":"2023-07-14T15:56:08.969365+0000","last_became_active":"2023-07-14T15:56:08.962200+0000","last_became_peered":"2023-07-14T15:56:08.962200+0000","last_unstale":"2023-07-14T15:56:08.969365+0000","last_undegraded":"2023-07-14T15:56:08.969365+0000","last_fullsized":"2023-07-14T15:56:08.969365+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:39:06.825044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.962275+0000","last_change":"2023-07-14T15:56:07.962275+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.962275+0000","last_undegraded":"2023-07-14T15:56:07.962275+0000","last_fullsized":"2023-07-14T15:56:07.962275+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-14T15:56:08.972576+0000","last_change":"2023-07-14T15:56:08.967374+0000","last_active":"2023-07-14T15:56:08.972576+0000","last_peered":"2023-07-14T15:56:08.972576+0000","last_clean":"2023-07-14T15:56:08.972576+0000","last_became_active":"2023-07-14T15:56:08.967057+0000","last_became_peered":"2023-07-14T15:56:08.967057+0000","last_unstale":"2023-07-14T15:56:08.972576+0000","last_undegraded":"2023-07-14T15:56:08.972576+0000","last_fullsized":"2023-07-14T15:56:08.972576+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:39:15.295100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.490060+0000","last_change":"2023-07-14T15:56:08.961701+0000","last_active":"2023-07-14T15:56:10.490060+0000","last_peered":"2023-07-14T15:56:10.490060+0000","last_clean":"2023-07-14T15:56:10.490060+0000","last_became_active":"2023-07-14T15:56:08.961444+0000","last_became_peered":"2023-07-14T15:56:08.961444+0000","last_unstale":"2023-07-14T15:56:10.490060+0000","last_undegraded":"2023-07-14T15:56:10.490060+0000","last_fullsized":"2023-07-14T15:56:10.490060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:23:33.554098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489929+0000","last_change":"2023-07-14T15:56:08.985138+0000","last_active":"2023-07-14T15:56:10.489929+0000","last_peered":"2023-07-14T15:56:10.489929+0000","last_clean":"2023-07-14T15:56:10.489929+0000","last_became_active":"2023-07-14T15:56:08.984870+0000","last_became_peered":"2023-07-14T15:56:08.984870+0000","last_unstale":"2023-07-14T15:56:10.489929+0000","last_undegraded":"2023-07-14T15:56:10.489929+0000","last_fullsized":"2023-07-14T15:56:10.489929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:09:13.220323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489843+0000","last_change":"2023-07-14T15:56:08.985164+0000","last_active":"2023-07-14T15:56:10.489843+0000","last_peered":"2023-07-14T15:56:10.489843+0000","last_clean":"2023-07-14T15:56:10.489843+0000","last_became_active":"2023-07-14T15:56:08.984883+0000","last_became_peered":"2023-07-14T15:56:08.984883+0000","last_unstale":"2023-07-14T15:56:10.489843+0000","last_undegraded":"2023-07-14T15:56:10.489843+0000","last_fullsized":"2023-07-14T15:56:10.489843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:36:15.019527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.963599+0000","last_change":"2023-07-14T15:56:07.963599+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.963599+0000","last_undegraded":"2023-07-14T15:56:07.963599+0000","last_fullsized":"2023-07-14T15:56:07.963599+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"24'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489692+0000","last_change":"2023-07-14T15:56:07.968145+0000","last_active":"2023-07-14T15:56:10.489692+0000","last_peered":"2023-07-14T15:56:10.489692+0000","last_clean":"2023-07-14T15:56:10.489692+0000","last_became_active":"2023-07-14T15:56:07.967843+0000","last_became_peered":"2023-07-14T15:56:07.967843+0000","last_unstale":"2023-07-14T15:56:10.489692+0000","last_undegraded":"2023-07-14T15:56:10.489692+0000","last_fullsized":"2023-07-14T15:56:10.489692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:24:32.242091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2023-07-14T15:56:06.945009+0000","last_change":"2023-07-14T15:56:06.945009+0000","last_active":"2023-07-14T15:56:06.930113+0000","last_peered":"2023-07-14T15:56:06.930113+0000","last_clean":"2023-07-14T15:56:06.930113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:06.945009+0000","last_undegraded":"2023-07-14T15:56:06.945009+0000","last_fullsized":"2023-07-14T15:56:06.945009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2023-07-14T15:56:06.940103+0000","last_change":"2023-07-14T15:56:06.940103+0000","last_active":"2023-07-14T15:56:06.930113+0000","last_peered":"2023-07-14T15:56:06.930113+0000","last_clean":"2023-07-14T15:56:06.930113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:06.940103+0000","last_undegraded":"2023-07-14T15:56:06.940103+0000","last_fullsized":"2023-07-14T15:56:06.940103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.959093+0000","last_change":"2023-07-14T15:56:07.959093+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.959093+0000","last_undegraded":"2023-07-14T15:56:07.959093+0000","last_fullsized":"2023-07-14T15:56:07.959093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2023-07-14T15:56:06.939641+0000","last_change":"2023-07-14T15:56:06.939641+0000","last_active":"2023-07-14T15:56:06.930113+0000","last_peered":"2023-07-14T15:56:06.930113+0000","last_clean":"2023-07-14T15:56:06.930113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:06.939641+0000","last_undegraded":"2023-07-14T15:56:06.939641+0000","last_fullsized":"2023-07-14T15:56:06.939641+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T15:56:07.976968+0000","last_change":"2023-07-14T15:56:07.970831+0000","last_active":"2023-07-14T15:56:07.976968+0000","last_peered":"2023-07-14T15:56:07.976968+0000","last_clean":"2023-07-14T15:56:07.976968+0000","last_became_active":"2023-07-14T15:56:07.970450+0000","last_became_peered":"2023-07-14T15:56:07.970450+0000","last_unstale":"2023-07-14T15:56:07.976968+0000","last_undegraded":"2023-07-14T15:56:07.976968+0000","last_fullsized":"2023-07-14T15:56:07.976968+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:20:49.571526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"24'3","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-14T15:56:08.991954+0000","last_change":"2023-07-14T15:56:07.964545+0000","last_active":"2023-07-14T15:56:08.991954+0000","last_peered":"2023-07-14T15:56:08.991954+0000","last_clean":"2023-07-14T15:56:08.991954+0000","last_became_active":"2023-07-14T15:56:07.963768+0000","last_became_peered":"2023-07-14T15:56:07.963768+0000","last_unstale":"2023-07-14T15:56:08.991954+0000","last_undegraded":"2023-07-14T15:56:08.991954+0000","last_fullsized":"2023-07-14T15:56:08.991954+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:52:08.226282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T15:56:07.975673+0000","last_change":"2023-07-14T15:56:07.970523+0000","last_active":"2023-07-14T15:56:07.975673+0000","last_peered":"2023-07-14T15:56:07.975673+0000","last_clean":"2023-07-14T15:56:07.975673+0000","last_became_active":"2023-07-14T15:56:07.970142+0000","last_became_peered":"2023-07-14T15:56:07.970142+0000","last_unstale":"2023-07-14T15:56:07.975673+0000","last_undegraded":"2023-07-14T15:56:07.975673+0000","last_fullsized":"2023-07-14T15:56:07.975673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:08:34.958562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.951094+0000","last_change":"2023-07-14T15:56:07.951094+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.951094+0000","last_undegraded":"2023-07-14T15:56:07.951094+0000","last_fullsized":"2023-07-14T15:56:07.951094+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T15:56:07.975009+0000","last_change":"2023-07-14T15:56:07.970235+0000","last_active":"2023-07-14T15:56:07.975009+0000","last_peered":"2023-07-14T15:56:07.975009+0000","last_clean":"2023-07-14T15:56:07.975009+0000","last_became_active":"2023-07-14T15:56:07.969938+0000","last_became_peered":"2023-07-14T15:56:07.969938+0000","last_unstale":"2023-07-14T15:56:07.975009+0000","last_undegraded":"2023-07-14T15:56:07.975009+0000","last_fullsized":"2023-07-14T15:56:07.975009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:32:25.876269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489380+0000","last_change":"2023-07-14T15:56:08.980388+0000","last_active":"2023-07-14T15:56:10.489380+0000","last_peered":"2023-07-14T15:56:10.489380+0000","last_clean":"2023-07-14T15:56:10.489380+0000","last_became_active":"2023-07-14T15:56:08.980080+0000","last_became_peered":"2023-07-14T15:56:08.980080+0000","last_unstale":"2023-07-14T15:56:10.489380+0000","last_undegraded":"2023-07-14T15:56:10.489380+0000","last_fullsized":"2023-07-14T15:56:10.489380+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:20:12.345478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489365+0000","last_change":"2023-07-14T15:56:07.975515+0000","last_active":"2023-07-14T15:56:10.489365+0000","last_peered":"2023-07-14T15:56:10.489365+0000","last_clean":"2023-07-14T15:56:10.489365+0000","last_became_active":"2023-07-14T15:56:07.975155+0000","last_became_peered":"2023-07-14T15:56:07.975155+0000","last_unstale":"2023-07-14T15:56:10.489365+0000","last_undegraded":"2023-07-14T15:56:10.489365+0000","last_fullsized":"2023-07-14T15:56:10.489365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:33:36.247286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.961503+0000","last_change":"2023-07-14T15:56:07.961503+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.961503+0000","last_undegraded":"2023-07-14T15:56:07.961503+0000","last_fullsized":"2023-07-14T15:56:07.961503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T15:56:07.975702+0000","last_change":"2023-07-14T15:56:07.970580+0000","last_active":"2023-07-14T15:56:07.975702+0000","last_peered":"2023-07-14T15:56:07.975702+0000","last_clean":"2023-07-14T15:56:07.975702+0000","last_became_active":"2023-07-14T15:56:07.970015+0000","last_became_peered":"2023-07-14T15:56:07.970015+0000","last_unstale":"2023-07-14T15:56:07.975702+0000","last_undegraded":"2023-07-14T15:56:07.975702+0000","last_fullsized":"2023-07-14T15:56:07.975702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:57:57.420084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"24'8","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489443+0000","last_change":"2023-07-14T15:56:07.968155+0000","last_active":"2023-07-14T15:56:10.489443+0000","last_peered":"2023-07-14T15:56:10.489443+0000","last_clean":"2023-07-14T15:56:10.489443+0000","last_became_active":"2023-07-14T15:56:07.967859+0000","last_became_peered":"2023-07-14T15:56:07.967859+0000","last_unstale":"2023-07-14T15:56:10.489443+0000","last_undegraded":"2023-07-14T15:56:10.489443+0000","last_fullsized":"2023-07-14T15:56:10.489443+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:15:27.451548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"24'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-14T15:56:08.991660+0000","last_change":"2023-07-14T15:56:07.967243+0000","last_active":"2023-07-14T15:56:08.991660+0000","last_peered":"2023-07-14T15:56:08.991660+0000","last_clean":"2023-07-14T15:56:08.991660+0000","last_became_active":"2023-07-14T15:56:07.966979+0000","last_became_peered":"2023-07-14T15:56:07.966979+0000","last_unstale":"2023-07-14T15:56:08.991660+0000","last_undegraded":"2023-07-14T15:56:08.991660+0000","last_fullsized":"2023-07-14T15:56:08.991660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:25:07.493777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.955562+0000","last_change":"2023-07-14T15:56:07.955562+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.955562+0000","last_undegraded":"2023-07-14T15:56:07.955562+0000","last_fullsized":"2023-07-14T15:56:07.955562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T15:56:07.976948+0000","last_change":"2023-07-14T15:56:07.968894+0000","last_active":"2023-07-14T15:56:07.976948+0000","last_peered":"2023-07-14T15:56:07.976948+0000","last_clean":"2023-07-14T15:56:07.976948+0000","last_became_active":"2023-07-14T15:56:07.968577+0000","last_became_peered":"2023-07-14T15:56:07.968577+0000","last_unstale":"2023-07-14T15:56:07.976948+0000","last_undegraded":"2023-07-14T15:56:07.976948+0000","last_fullsized":"2023-07-14T15:56:07.976948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:14:49.443210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489497+0000","last_change":"2023-07-14T15:56:08.985023+0000","last_active":"2023-07-14T15:56:10.489497+0000","last_peered":"2023-07-14T15:56:10.489497+0000","last_clean":"2023-07-14T15:56:10.489497+0000","last_became_active":"2023-07-14T15:56:08.984743+0000","last_became_peered":"2023-07-14T15:56:08.984743+0000","last_unstale":"2023-07-14T15:56:10.489497+0000","last_undegraded":"2023-07-14T15:56:10.489497+0000","last_fullsized":"2023-07-14T15:56:10.489497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:52:49.596576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T15:56:07.979827+0000","last_change":"2023-07-14T15:56:07.975480+0000","last_active":"2023-07-14T15:56:07.979827+0000","last_peered":"2023-07-14T15:56:07.979827+0000","last_clean":"2023-07-14T15:56:07.979827+0000","last_became_active":"2023-07-14T15:56:07.975128+0000","last_became_peered":"2023-07-14T15:56:07.975128+0000","last_unstale":"2023-07-14T15:56:07.979827+0000","last_undegraded":"2023-07-14T15:56:07.979827+0000","last_fullsized":"2023-07-14T15:56:07.979827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:40:47.692782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.950885+0000","last_change":"2023-07-14T15:56:07.950885+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.950885+0000","last_undegraded":"2023-07-14T15:56:07.950885+0000","last_fullsized":"2023-07-14T15:56:07.950885+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-14T15:56:08.960224+0000","last_change":"2023-07-14T15:56:07.973033+0000","last_active":"2023-07-14T15:56:08.960224+0000","last_peered":"2023-07-14T15:56:08.960224+0000","last_clean":"2023-07-14T15:56:08.960224+0000","last_became_active":"2023-07-14T15:56:07.972707+0000","last_became_peered":"2023-07-14T15:56:07.972707+0000","last_unstale":"2023-07-14T15:56:08.960224+0000","last_undegraded":"2023-07-14T15:56:08.960224+0000","last_fullsized":"2023-07-14T15:56:08.960224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:07:50.160969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2023-07-14T15:56:06.942568+0000","last_change":"2023-07-14T15:56:06.942568+0000","last_active":"2023-07-14T15:56:06.930113+0000","last_peered":"2023-07-14T15:56:06.930113+0000","last_clean":"2023-07-14T15:56:06.930113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:06.942568+0000","last_undegraded":"2023-07-14T15:56:06.942568+0000","last_fullsized":"2023-07-14T15:56:06.942568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-14T15:56:08.969375+0000","last_change":"2023-07-14T15:56:08.963200+0000","last_active":"2023-07-14T15:56:08.969375+0000","last_peered":"2023-07-14T15:56:08.969375+0000","last_clean":"2023-07-14T15:56:08.969375+0000","last_became_active":"2023-07-14T15:56:08.962998+0000","last_became_peered":"2023-07-14T15:56:08.962998+0000","last_unstale":"2023-07-14T15:56:08.969375+0000","last_undegraded":"2023-07-14T15:56:08.969375+0000","last_fullsized":"2023-07-14T15:56:08.969375+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:37:06.277634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T15:56:07.979885+0000","last_change":"2023-07-14T15:56:07.976310+0000","last_active":"2023-07-14T15:56:07.979885+0000","last_peered":"2023-07-14T15:56:07.979885+0000","last_clean":"2023-07-14T15:56:07.979885+0000","last_became_active":"2023-07-14T15:56:07.975997+0000","last_became_peered":"2023-07-14T15:56:07.975997+0000","last_unstale":"2023-07-14T15:56:07.979885+0000","last_undegraded":"2023-07-14T15:56:07.979885+0000","last_fullsized":"2023-07-14T15:56:07.979885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:41:09.214376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.961029+0000","last_change":"2023-07-14T15:56:07.961029+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.961029+0000","last_undegraded":"2023-07-14T15:56:07.961029+0000","last_fullsized":"2023-07-14T15:56:07.961029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T15:56:07.974822+0000","last_change":"2023-07-14T15:56:07.969636+0000","last_active":"2023-07-14T15:56:07.974822+0000","last_peered":"2023-07-14T15:56:07.974822+0000","last_clean":"2023-07-14T15:56:07.974822+0000","last_became_active":"2023-07-14T15:56:07.969277+0000","last_became_peered":"2023-07-14T15:56:07.969277+0000","last_unstale":"2023-07-14T15:56:07.974822+0000","last_undegraded":"2023-07-14T15:56:07.974822+0000","last_fullsized":"2023-07-14T15:56:07.974822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:03:12.896062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.954093+0000","last_change":"2023-07-14T15:56:07.954093+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.954093+0000","last_undegraded":"2023-07-14T15:56:07.954093+0000","last_fullsized":"2023-07-14T15:56:07.954093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2023-07-14T15:56:06.944913+0000","last_change":"2023-07-14T15:56:06.944913+0000","last_active":"2023-07-14T15:56:06.930113+0000","last_peered":"2023-07-14T15:56:06.930113+0000","last_clean":"2023-07-14T15:56:06.930113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:06.944913+0000","last_undegraded":"2023-07-14T15:56:06.944913+0000","last_fullsized":"2023-07-14T15:56:06.944913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T15:56:06.940962+0000","last_change":"2023-07-14T15:56:02.621850+0000","last_active":"2023-07-14T15:56:06.940962+0000","last_peered":"2023-07-14T15:56:06.940962+0000","last_clean":"2023-07-14T15:56:06.940962+0000","last_became_active":"2023-07-14T15:56:02.621471+0000","last_became_peered":"2023-07-14T15:56:02.621471+0000","last_unstale":"2023-07-14T15:56:06.940962+0000","last_undegraded":"2023-07-14T15:56:06.940962+0000","last_fullsized":"2023-07-14T15:56:06.940962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:03:08.971454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T15:56:07.973829+0000","last_change":"2023-07-14T15:56:07.965851+0000","last_active":"2023-07-14T15:56:07.973829+0000","last_peered":"2023-07-14T15:56:07.973829+0000","last_clean":"2023-07-14T15:56:07.973829+0000","last_became_active":"2023-07-14T15:56:07.965312+0000","last_became_peered":"2023-07-14T15:56:07.965312+0000","last_unstale":"2023-07-14T15:56:07.973829+0000","last_undegraded":"2023-07-14T15:56:07.973829+0000","last_fullsized":"2023-07-14T15:56:07.973829+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:49:41.982719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.488879+0000","last_change":"2023-07-14T15:56:08.974753+0000","last_active":"2023-07-14T15:56:10.488879+0000","last_peered":"2023-07-14T15:56:10.488879+0000","last_clean":"2023-07-14T15:56:10.488879+0000","last_became_active":"2023-07-14T15:56:08.974482+0000","last_became_peered":"2023-07-14T15:56:08.974482+0000","last_unstale":"2023-07-14T15:56:10.488879+0000","last_undegraded":"2023-07-14T15:56:10.488879+0000","last_fullsized":"2023-07-14T15:56:10.488879+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:22:21.802038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T15:56:07.952879+0000","last_change":"2023-07-14T15:56:02.621963+0000","last_active":"2023-07-14T15:56:07.952879+0000","last_peered":"2023-07-14T15:56:07.952879+0000","last_clean":"2023-07-14T15:56:07.952879+0000","last_became_active":"2023-07-14T15:56:02.621678+0000","last_became_peered":"2023-07-14T15:56:02.621678+0000","last_unstale":"2023-07-14T15:56:07.952879+0000","last_undegraded":"2023-07-14T15:56:07.952879+0000","last_fullsized":"2023-07-14T15:56:07.952879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:41:51.335640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-14T15:56:08.959245+0000","last_change":"2023-07-14T15:56:07.970834+0000","last_active":"2023-07-14T15:56:08.959245+0000","last_peered":"2023-07-14T15:56:08.959245+0000","last_clean":"2023-07-14T15:56:08.959245+0000","last_became_active":"2023-07-14T15:56:07.970464+0000","last_became_peered":"2023-07-14T15:56:07.970464+0000","last_unstale":"2023-07-14T15:56:08.959245+0000","last_undegraded":"2023-07-14T15:56:08.959245+0000","last_fullsized":"2023-07-14T15:56:08.959245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:47:36.646483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489620+0000","last_change":"2023-07-14T15:56:08.974479+0000","last_active":"2023-07-14T15:56:10.489620+0000","last_peered":"2023-07-14T15:56:10.489620+0000","last_clean":"2023-07-14T15:56:10.489620+0000","last_became_active":"2023-07-14T15:56:08.974197+0000","last_became_peered":"2023-07-14T15:56:08.974197+0000","last_unstale":"2023-07-14T15:56:10.489620+0000","last_undegraded":"2023-07-14T15:56:10.489620+0000","last_fullsized":"2023-07-14T15:56:10.489620+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:10:08.144011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T15:56:06.942990+0000","last_change":"2023-07-14T15:56:01.925110+0000","last_active":"2023-07-14T15:56:06.942990+0000","last_peered":"2023-07-14T15:56:06.942990+0000","last_clean":"2023-07-14T15:56:06.942990+0000","last_became_active":"2023-07-14T15:56:01.924723+0000","last_became_peered":"2023-07-14T15:56:01.924723+0000","last_unstale":"2023-07-14T15:56:06.942990+0000","last_undegraded":"2023-07-14T15:56:06.942990+0000","last_fullsized":"2023-07-14T15:56:06.942990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:05:05.697085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2023-07-14T15:56:06.939541+0000","last_change":"2023-07-14T15:56:06.939541+0000","last_active":"2023-07-14T15:56:06.930113+0000","last_peered":"2023-07-14T15:56:06.930113+0000","last_clean":"2023-07-14T15:56:06.930113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:06.939541+0000","last_undegraded":"2023-07-14T15:56:06.939541+0000","last_fullsized":"2023-07-14T15:56:06.939541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489621+0000","last_change":"2023-07-14T15:56:08.981489+0000","last_active":"2023-07-14T15:56:10.489621+0000","last_peered":"2023-07-14T15:56:10.489621+0000","last_clean":"2023-07-14T15:56:10.489621+0000","last_became_active":"2023-07-14T15:56:08.981064+0000","last_became_peered":"2023-07-14T15:56:08.981064+0000","last_unstale":"2023-07-14T15:56:10.489621+0000","last_undegraded":"2023-07-14T15:56:10.489621+0000","last_fullsized":"2023-07-14T15:56:10.489621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:09:43.406898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T15:56:07.953532+0000","last_change":"2023-07-14T15:56:01.923465+0000","last_active":"2023-07-14T15:56:07.953532+0000","last_peered":"2023-07-14T15:56:07.953532+0000","last_clean":"2023-07-14T15:56:07.953532+0000","last_became_active":"2023-07-14T15:56:01.923160+0000","last_became_peered":"2023-07-14T15:56:01.923160+0000","last_unstale":"2023-07-14T15:56:07.953532+0000","last_undegraded":"2023-07-14T15:56:07.953532+0000","last_fullsized":"2023-07-14T15:56:07.953532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:07:22.773242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":175,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489184+0000","last_change":"2023-07-14T15:55:54.040065+0000","last_active":"2023-07-14T15:56:10.489184+0000","last_peered":"2023-07-14T15:56:10.489184+0000","last_clean":"2023-07-14T15:56:10.489184+0000","last_became_active":"2023-07-14T15:55:54.038885+0000","last_became_peered":"2023-07-14T15:55:54.038885+0000","last_unstale":"2023-07-14T15:56:10.489184+0000","last_undegraded":"2023-07-14T15:56:10.489184+0000","last_fullsized":"2023-07-14T15:56:10.489184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:55:53.025696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:55:53.025696+0000","last_clean_scrub_stamp":"2023-07-14T15:55:53.025696+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:14:43.173657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2023-07-14T15:56:06.943708+0000","last_change":"2023-07-14T15:56:06.943708+0000","last_active":"2023-07-14T15:56:06.930113+0000","last_peered":"2023-07-14T15:56:06.930113+0000","last_clean":"2023-07-14T15:56:06.930113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:06.943708+0000","last_undegraded":"2023-07-14T15:56:06.943708+0000","last_fullsized":"2023-07-14T15:56:06.943708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.960438+0000","last_change":"2023-07-14T15:56:07.960438+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.960438+0000","last_undegraded":"2023-07-14T15:56:07.960438+0000","last_fullsized":"2023-07-14T15:56:07.960438+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T15:56:07.952062+0000","last_change":"2023-07-14T15:56:01.920714+0000","last_active":"2023-07-14T15:56:07.952062+0000","last_peered":"2023-07-14T15:56:07.952062+0000","last_clean":"2023-07-14T15:56:07.952062+0000","last_became_active":"2023-07-14T15:56:01.920325+0000","last_became_peered":"2023-07-14T15:56:01.920325+0000","last_unstale":"2023-07-14T15:56:07.952062+0000","last_undegraded":"2023-07-14T15:56:07.952062+0000","last_fullsized":"2023-07-14T15:56:07.952062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:52:29.180496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.488883+0000","last_change":"2023-07-14T15:56:07.970542+0000","last_active":"2023-07-14T15:56:10.488883+0000","last_peered":"2023-07-14T15:56:10.488883+0000","last_clean":"2023-07-14T15:56:10.488883+0000","last_became_active":"2023-07-14T15:56:07.970172+0000","last_became_peered":"2023-07-14T15:56:07.970172+0000","last_unstale":"2023-07-14T15:56:10.488883+0000","last_undegraded":"2023-07-14T15:56:10.488883+0000","last_fullsized":"2023-07-14T15:56:10.488883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:31:45.916927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T15:56:07.952243+0000","last_change":"2023-07-14T15:56:01.923631+0000","last_active":"2023-07-14T15:56:07.952243+0000","last_peered":"2023-07-14T15:56:07.952243+0000","last_clean":"2023-07-14T15:56:07.952243+0000","last_became_active":"2023-07-14T15:56:01.922783+0000","last_became_peered":"2023-07-14T15:56:01.922783+0000","last_unstale":"2023-07-14T15:56:07.952243+0000","last_undegraded":"2023-07-14T15:56:07.952243+0000","last_fullsized":"2023-07-14T15:56:07.952243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:53:41.072475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489594+0000","last_change":"2023-07-14T15:56:07.967762+0000","last_active":"2023-07-14T15:56:10.489594+0000","last_peered":"2023-07-14T15:56:10.489594+0000","last_clean":"2023-07-14T15:56:10.489594+0000","last_became_active":"2023-07-14T15:56:07.967471+0000","last_became_peered":"2023-07-14T15:56:07.967471+0000","last_unstale":"2023-07-14T15:56:10.489594+0000","last_undegraded":"2023-07-14T15:56:10.489594+0000","last_fullsized":"2023-07-14T15:56:10.489594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:29:31.273078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489319+0000","last_change":"2023-07-14T15:56:08.976758+0000","last_active":"2023-07-14T15:56:10.489319+0000","last_peered":"2023-07-14T15:56:10.489319+0000","last_clean":"2023-07-14T15:56:10.489319+0000","last_became_active":"2023-07-14T15:56:08.976318+0000","last_became_peered":"2023-07-14T15:56:08.976318+0000","last_unstale":"2023-07-14T15:56:10.489319+0000","last_undegraded":"2023-07-14T15:56:10.489319+0000","last_fullsized":"2023-07-14T15:56:10.489319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:18:49.883894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2023-07-14T15:56:06.945529+0000","last_change":"2023-07-14T15:56:06.945529+0000","last_active":"2023-07-14T15:56:06.930113+0000","last_peered":"2023-07-14T15:56:06.930113+0000","last_clean":"2023-07-14T15:56:06.930113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:06.945529+0000","last_undegraded":"2023-07-14T15:56:06.945529+0000","last_fullsized":"2023-07-14T15:56:06.945529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T15:56:06.947613+0000","last_change":"2023-07-14T15:56:01.965649+0000","last_active":"2023-07-14T15:56:06.947613+0000","last_peered":"2023-07-14T15:56:06.947613+0000","last_clean":"2023-07-14T15:56:06.947613+0000","last_became_active":"2023-07-14T15:56:01.965344+0000","last_became_peered":"2023-07-14T15:56:01.965344+0000","last_unstale":"2023-07-14T15:56:06.947613+0000","last_undegraded":"2023-07-14T15:56:06.947613+0000","last_fullsized":"2023-07-14T15:56:06.947613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:05:05.697085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T15:56:07.953390+0000","last_change":"2023-07-14T15:56:01.966578+0000","last_active":"2023-07-14T15:56:07.953390+0000","last_peered":"2023-07-14T15:56:07.953390+0000","last_clean":"2023-07-14T15:56:07.953390+0000","last_became_active":"2023-07-14T15:56:01.966216+0000","last_became_peered":"2023-07-14T15:56:01.966216+0000","last_unstale":"2023-07-14T15:56:07.953390+0000","last_undegraded":"2023-07-14T15:56:07.953390+0000","last_fullsized":"2023-07-14T15:56:07.953390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:04:26.951849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2023-07-14T15:56:06.945247+0000","last_change":"2023-07-14T15:56:06.945247+0000","last_active":"2023-07-14T15:56:06.930113+0000","last_peered":"2023-07-14T15:56:06.930113+0000","last_clean":"2023-07-14T15:56:06.930113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:06.945247+0000","last_undegraded":"2023-07-14T15:56:06.945247+0000","last_fullsized":"2023-07-14T15:56:06.945247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.949736+0000","last_change":"2023-07-14T15:56:07.949736+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.949736+0000","last_undegraded":"2023-07-14T15:56:07.949736+0000","last_fullsized":"2023-07-14T15:56:07.949736+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2023-07-14T15:56:06.945000+0000","last_change":"2023-07-14T15:56:06.945000+0000","last_active":"2023-07-14T15:56:06.930113+0000","last_peered":"2023-07-14T15:56:06.930113+0000","last_clean":"2023-07-14T15:56:06.930113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:06.945000+0000","last_undegraded":"2023-07-14T15:56:06.945000+0000","last_fullsized":"2023-07-14T15:56:06.945000+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.490013+0000","last_change":"2023-07-14T15:56:07.968681+0000","last_active":"2023-07-14T15:56:10.490013+0000","last_peered":"2023-07-14T15:56:10.490013+0000","last_clean":"2023-07-14T15:56:10.490013+0000","last_became_active":"2023-07-14T15:56:07.968350+0000","last_became_peered":"2023-07-14T15:56:07.968350+0000","last_unstale":"2023-07-14T15:56:10.490013+0000","last_undegraded":"2023-07-14T15:56:10.490013+0000","last_fullsized":"2023-07-14T15:56:10.490013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:12:08.491508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.951717+0000","last_change":"2023-07-14T15:56:07.951717+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.951717+0000","last_undegraded":"2023-07-14T15:56:07.951717+0000","last_fullsized":"2023-07-14T15:56:07.951717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T15:56:07.975803+0000","last_change":"2023-07-14T15:56:07.971194+0000","last_active":"2023-07-14T15:56:07.975803+0000","last_peered":"2023-07-14T15:56:07.975803+0000","last_clean":"2023-07-14T15:56:07.975803+0000","last_became_active":"2023-07-14T15:56:07.970215+0000","last_became_peered":"2023-07-14T15:56:07.970215+0000","last_unstale":"2023-07-14T15:56:07.975803+0000","last_undegraded":"2023-07-14T15:56:07.975803+0000","last_fullsized":"2023-07-14T15:56:07.975803+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:40:04.386118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.955961+0000","last_change":"2023-07-14T15:56:07.955961+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.955961+0000","last_undegraded":"2023-07-14T15:56:07.955961+0000","last_fullsized":"2023-07-14T15:56:07.955961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2023-07-14T15:56:06.939718+0000","last_change":"2023-07-14T15:56:06.939718+0000","last_active":"2023-07-14T15:56:06.930113+0000","last_peered":"2023-07-14T15:56:06.930113+0000","last_clean":"2023-07-14T15:56:06.930113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:06.939718+0000","last_undegraded":"2023-07-14T15:56:06.939718+0000","last_fullsized":"2023-07-14T15:56:06.939718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2023-07-14T15:56:06.940302+0000","last_change":"2023-07-14T15:56:06.940302+0000","last_active":"2023-07-14T15:56:06.930113+0000","last_peered":"2023-07-14T15:56:06.930113+0000","last_clean":"2023-07-14T15:56:06.930113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:06.940302+0000","last_undegraded":"2023-07-14T15:56:06.940302+0000","last_fullsized":"2023-07-14T15:56:06.940302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.949666+0000","last_change":"2023-07-14T15:56:07.949666+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.949666+0000","last_undegraded":"2023-07-14T15:56:07.949666+0000","last_fullsized":"2023-07-14T15:56:07.949666+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489873+0000","last_change":"2023-07-14T15:56:08.962047+0000","last_active":"2023-07-14T15:56:10.489873+0000","last_peered":"2023-07-14T15:56:10.489873+0000","last_clean":"2023-07-14T15:56:10.489873+0000","last_became_active":"2023-07-14T15:56:08.961657+0000","last_became_peered":"2023-07-14T15:56:08.961657+0000","last_unstale":"2023-07-14T15:56:10.489873+0000","last_undegraded":"2023-07-14T15:56:10.489873+0000","last_fullsized":"2023-07-14T15:56:10.489873+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:32:30.477405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.488979+0000","last_change":"2023-07-14T15:56:08.979917+0000","last_active":"2023-07-14T15:56:10.488979+0000","last_peered":"2023-07-14T15:56:10.488979+0000","last_clean":"2023-07-14T15:56:10.488979+0000","last_became_active":"2023-07-14T15:56:08.979617+0000","last_became_peered":"2023-07-14T15:56:08.979617+0000","last_unstale":"2023-07-14T15:56:10.488979+0000","last_undegraded":"2023-07-14T15:56:10.488979+0000","last_fullsized":"2023-07-14T15:56:10.488979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:10:09.608521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-14T15:56:08.973967+0000","last_change":"2023-07-14T15:56:08.971350+0000","last_active":"2023-07-14T15:56:08.973967+0000","last_peered":"2023-07-14T15:56:08.973967+0000","last_clean":"2023-07-14T15:56:08.973967+0000","last_became_active":"2023-07-14T15:56:08.970957+0000","last_became_peered":"2023-07-14T15:56:08.970957+0000","last_unstale":"2023-07-14T15:56:08.973967+0000","last_undegraded":"2023-07-14T15:56:08.973967+0000","last_fullsized":"2023-07-14T15:56:08.973967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:55:29.083644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":78,"acting":78,"num_store_stats":5},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476742,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":74768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]}]},{"osd":0,"up_from":16,"seq":68719476743,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":229376,"data_stored":81396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":258048,"data_stored":95267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":860160,"data_stored":686219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]}]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":74768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":74768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]}]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":811008,"data_stored":665136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]}]},{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":74768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T15:56:13.883 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T15:56:14.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.131+0000 7fae893ff700 1 Processor -- start 2023-07-14T15:56:14.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.131+0000 7fae893ff700 1 -- start start 2023-07-14T15:56:14.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.132+0000 7fae893ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fae840b85f0 0x7fae8415d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:14.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.132+0000 7fae893ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fae840b54b0 0x7fae840cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:14.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.133+0000 7fae893ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae840cf6b0 con 0x7fae840b4910 2023-07-14T15:56:14.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.133+0000 7fae893ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae840cdc40 con 0x7fae840b54b0 2023-07-14T15:56:14.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.133+0000 7fae893ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae8415dba0 con 0x7fae840b85f0 2023-07-14T15:56:14.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.133+0000 7fae827fc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fae840b54b0 0x7fae840cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:14.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.133+0000 7fae837fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fae840b4910 0x7fae840b4d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36768/0 (socket says 172.21.15.37:36768) 2023-07-14T15:56:14.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.133+0000 7fae837fe700 1 -- 172.21.15.37:0/2056710820 learned_addr learned my addr 172.21.15.37:0/2056710820 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:14.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.133+0000 7fae82ffd700 1 --2- 172.21.15.37:0/2056710820 >> v2:172.21.15.98:3300/0 conn(0x7fae840b85f0 0x7fae8415d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:14.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.133+0000 7fae827fc700 1 -- 172.21.15.37:0/2056710820 >> v2:172.21.15.98:3300/0 conn(0x7fae840b85f0 msgr2=0x7fae8415d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:14.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.133+0000 7fae827fc700 1 --2- 172.21.15.37:0/2056710820 >> v2:172.21.15.98:3300/0 conn(0x7fae840b85f0 0x7fae8415d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:14.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.133+0000 7fae827fc700 1 -- 172.21.15.37:0/2056710820 >> v1:172.21.15.37:6789/0 conn(0x7fae840b4910 legacy=0x7fae840b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:14.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.133+0000 7fae827fc700 1 -- 172.21.15.37:0/2056710820 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae840cf0a0 con 0x7fae840b54b0 2023-07-14T15:56:14.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.133+0000 7fae827fc700 1 --2- 172.21.15.37:0/2056710820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae840b54b0 0x7fae840cfb40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fae8406a110 tx=0x7fae78009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18bbcd7e40717d17 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:14.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.134+0000 7fae81ffb700 1 -- 172.21.15.37:0/2056710820 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae78011830 con 0x7fae840b54b0 2023-07-14T15:56:14.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.134+0000 7fae81ffb700 1 -- 172.21.15.37:0/2056710820 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae78011990 con 0x7fae840b54b0 2023-07-14T15:56:14.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.134+0000 7fae81ffb700 1 -- 172.21.15.37:0/2056710820 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae78011d20 con 0x7fae840b54b0 2023-07-14T15:56:14.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.134+0000 7fae893ff700 1 -- 172.21.15.37:0/2056710820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae840b54b0 msgr2=0x7fae840cfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:14.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.134+0000 7fae893ff700 1 --2- 172.21.15.37:0/2056710820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae840b54b0 0x7fae840cfb40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fae8406a110 tx=0x7fae78009b20 comp rx=0 tx=0).stop 2023-07-14T15:56:14.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.134+0000 7fae893ff700 1 -- 172.21.15.37:0/2056710820 shutdown_connections 2023-07-14T15:56:14.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.134+0000 7fae893ff700 1 --2- 172.21.15.37:0/2056710820 >> v2:172.21.15.98:3300/0 conn(0x7fae840b85f0 0x7fae8415d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:14.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.134+0000 7fae893ff700 1 --2- 172.21.15.37:0/2056710820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae840b54b0 0x7fae840cfb40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:14.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.134+0000 7fae893ff700 1 -- 172.21.15.37:0/2056710820 >> 172.21.15.37:0/2056710820 conn(0x7fae8406a580 msgr2=0x7fae8406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:14.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.134+0000 7fae893ff700 1 -- 172.21.15.37:0/2056710820 shutdown_connections 2023-07-14T15:56:14.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.134+0000 7fae893ff700 1 -- 172.21.15.37:0/2056710820 wait complete. 2023-07-14T15:56:14.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.136+0000 7fae893ff700 1 Processor -- start 2023-07-14T15:56:14.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.136+0000 7fae893ff700 1 -- start start 2023-07-14T15:56:14.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.137+0000 7fae893ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae840b4910 0x7fae840a99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:14.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.137+0000 7fae893ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae840b54b0 0x7fae841f18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:14.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.137+0000 7fae893ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fae840b85f0 0x7fae840cb550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:14.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.137+0000 7fae893ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae840c8c00 con 0x7fae840b54b0 2023-07-14T15:56:14.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.137+0000 7fae893ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae840c8ee0 con 0x7fae840b4910 2023-07-14T15:56:14.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.137+0000 7fae893ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae840c91c0 con 0x7fae840b85f0 2023-07-14T15:56:14.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.138+0000 7fae827fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae840b54b0 0x7fae841f18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:14.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.138+0000 7fae827fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae840b54b0 0x7fae841f18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60454/0 (socket says 172.21.15.37:60454) 2023-07-14T15:56:14.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.138+0000 7fae827fc700 1 -- 172.21.15.37:0/2640624230 learned_addr learned my addr 172.21.15.37:0/2640624230 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:14.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.138+0000 7fae82ffd700 1 --2- 172.21.15.37:0/2640624230 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae840b4910 0x7fae840a99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:14.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.138+0000 7fae837fe700 1 --2- 172.21.15.37:0/2640624230 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fae840b85f0 0x7fae840cb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:14.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.138+0000 7fae827fc700 1 -- 172.21.15.37:0/2640624230 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fae840b85f0 msgr2=0x7fae840cb550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:14.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.138+0000 7fae827fc700 1 --2- 172.21.15.37:0/2640624230 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fae840b85f0 0x7fae840cb550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:14.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.138+0000 7fae827fc700 1 -- 172.21.15.37:0/2640624230 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae840b4910 msgr2=0x7fae840a99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:14.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.138+0000 7fae827fc700 1 --2- 172.21.15.37:0/2640624230 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae840b4910 0x7fae840a99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:14.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.138+0000 7fae827fc700 1 -- 172.21.15.37:0/2640624230 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae780094a0 con 0x7fae840b54b0 2023-07-14T15:56:14.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.138+0000 7fae827fc700 1 --2- 172.21.15.37:0/2640624230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae840b54b0 0x7fae841f18b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fae78000c00 tx=0x7fae78004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:14.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.139+0000 7fae6b7fe700 1 -- 172.21.15.37:0/2640624230 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae780036a0 con 0x7fae840b54b0 2023-07-14T15:56:14.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.139+0000 7fae6b7fe700 1 -- 172.21.15.37:0/2640624230 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae7801f070 con 0x7fae840b54b0 2023-07-14T15:56:14.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.139+0000 7fae6b7fe700 1 -- 172.21.15.37:0/2640624230 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae78003a40 con 0x7fae840b54b0 2023-07-14T15:56:14.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.139+0000 7fae893ff700 1 -- 172.21.15.37:0/2640624230 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae840c94a0 con 0x7fae840b54b0 2023-07-14T15:56:14.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.139+0000 7fae893ff700 1 -- 172.21.15.37:0/2640624230 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae841f1df0 con 0x7fae840b54b0 2023-07-14T15:56:14.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.140+0000 7fae893ff700 1 -- 172.21.15.37:0/2640624230 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae840c9020 con 0x7fae840b54b0 2023-07-14T15:56:14.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.141+0000 7fae6b7fe700 1 -- 172.21.15.37:0/2640624230 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fae78003ba0 con 0x7fae840b54b0 2023-07-14T15:56:14.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.142+0000 7fae6b7fe700 1 --2- 172.21.15.37:0/2640624230 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fae7006ace0 0x7fae7006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:14.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.142+0000 7fae6b7fe700 1 -- 172.21.15.37:0/2640624230 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fae78021070 con 0x7fae840b54b0 2023-07-14T15:56:14.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.142+0000 7fae82ffd700 1 --2- 172.21.15.37:0/2640624230 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fae7006ace0 0x7fae7006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:14.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.143+0000 7fae82ffd700 1 --2- 172.21.15.37:0/2640624230 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fae7006ace0 0x7fae7006d190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fae74006b20 tx=0x7fae74008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:14.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.146+0000 7fae6b7fe700 1 -- 172.21.15.37:0/2640624230 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fae840c9020 con 0x7fae840b54b0 2023-07-14T15:56:14.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.349+0000 7fae893ff700 1 -- 172.21.15.37:0/2640624230 --> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fae840cd680 con 0x7fae7006ace0 2023-07-14T15:56:14.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.357+0000 7fae6b7fe700 1 -- 172.21.15.37:0/2640624230 <== mgr.4100 v2:172.21.15.98:6832/3163748069 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280802 (secure 0 0 0) 0x7fae740076b0 con 0x7fae7006ace0 2023-07-14T15:56:14.347 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:56:14.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.361+0000 7fae893ff700 1 -- 172.21.15.37:0/2640624230 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fae7006ace0 msgr2=0x7fae7006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:14.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.361+0000 7fae893ff700 1 --2- 172.21.15.37:0/2640624230 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fae7006ace0 0x7fae7006d190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fae74006b20 tx=0x7fae74008040 comp rx=0 tx=0).stop 2023-07-14T15:56:14.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.361+0000 7fae893ff700 1 -- 172.21.15.37:0/2640624230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae840b54b0 msgr2=0x7fae841f18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:14.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.361+0000 7fae893ff700 1 --2- 172.21.15.37:0/2640624230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae840b54b0 0x7fae841f18b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fae78000c00 tx=0x7fae78004750 comp rx=0 tx=0).stop 2023-07-14T15:56:14.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.361+0000 7fae893ff700 1 -- 172.21.15.37:0/2640624230 shutdown_connections 2023-07-14T15:56:14.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.361+0000 7fae893ff700 1 --2- 172.21.15.37:0/2640624230 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae840b4910 0x7fae840a99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:14.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.361+0000 7fae893ff700 1 --2- 172.21.15.37:0/2640624230 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fae7006ace0 0x7fae7006d190 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:14.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.361+0000 7fae893ff700 1 --2- 172.21.15.37:0/2640624230 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fae840b85f0 0x7fae840cb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:14.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.361+0000 7fae893ff700 1 --2- 172.21.15.37:0/2640624230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae840b54b0 0x7fae841f18b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:14.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.361+0000 7fae893ff700 1 -- 172.21.15.37:0/2640624230 >> 172.21.15.37:0/2640624230 conn(0x7fae8406a580 msgr2=0x7fae840d1560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:14.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.362+0000 7fae893ff700 1 -- 172.21.15.37:0/2640624230 shutdown_connections 2023-07-14T15:56:14.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.362+0000 7fae893ff700 1 -- 172.21.15.37:0/2640624230 wait complete. 2023-07-14T15:56:14.351 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-14T15:56:14.366 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2023-07-14T15:56:12.854446+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590480,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":179,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":160,"acting":160,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":78,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218572,"kb_used_data":2956,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756148,"statfs":{"total":773094113280,"available":772870295552,"internally_reserved":0,"allocated":3026944,"data_stored":1827090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.917020"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.954625+0000","last_change":"2023-07-14T15:56:07.954625+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.954625+0000","last_undegraded":"2023-07-14T15:56:07.954625+0000","last_fullsized":"2023-07-14T15:56:07.954625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-14T15:56:08.990527+0000","last_change":"2023-07-14T15:56:08.984210+0000","last_active":"2023-07-14T15:56:08.990527+0000","last_peered":"2023-07-14T15:56:08.990527+0000","last_clean":"2023-07-14T15:56:08.990527+0000","last_became_active":"2023-07-14T15:56:08.983924+0000","last_became_peered":"2023-07-14T15:56:08.983924+0000","last_unstale":"2023-07-14T15:56:08.990527+0000","last_undegraded":"2023-07-14T15:56:08.990527+0000","last_fullsized":"2023-07-14T15:56:08.990527+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:41:30.227081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-14T15:56:08.972640+0000","last_change":"2023-07-14T15:56:08.968523+0000","last_active":"2023-07-14T15:56:08.972640+0000","last_peered":"2023-07-14T15:56:08.972640+0000","last_clean":"2023-07-14T15:56:08.972640+0000","last_became_active":"2023-07-14T15:56:08.968214+0000","last_became_peered":"2023-07-14T15:56:08.968214+0000","last_unstale":"2023-07-14T15:56:08.972640+0000","last_undegraded":"2023-07-14T15:56:08.972640+0000","last_fullsized":"2023-07-14T15:56:08.972640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:31:21.325556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.962570+0000","last_change":"2023-07-14T15:56:07.962570+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.962570+0000","last_undegraded":"2023-07-14T15:56:07.962570+0000","last_fullsized":"2023-07-14T15:56:07.962570+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.962984+0000","last_change":"2023-07-14T15:56:07.962984+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.962984+0000","last_undegraded":"2023-07-14T15:56:07.962984+0000","last_fullsized":"2023-07-14T15:56:07.962984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489987+0000","last_change":"2023-07-14T15:56:08.963001+0000","last_active":"2023-07-14T15:56:10.489987+0000","last_peered":"2023-07-14T15:56:10.489987+0000","last_clean":"2023-07-14T15:56:10.489987+0000","last_became_active":"2023-07-14T15:56:08.962689+0000","last_became_peered":"2023-07-14T15:56:08.962689+0000","last_unstale":"2023-07-14T15:56:10.489987+0000","last_undegraded":"2023-07-14T15:56:10.489987+0000","last_fullsized":"2023-07-14T15:56:10.489987+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:54:19.293355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489747+0000","last_change":"2023-07-14T15:56:08.974509+0000","last_active":"2023-07-14T15:56:10.489747+0000","last_peered":"2023-07-14T15:56:10.489747+0000","last_clean":"2023-07-14T15:56:10.489747+0000","last_became_active":"2023-07-14T15:56:08.974197+0000","last_became_peered":"2023-07-14T15:56:08.974197+0000","last_unstale":"2023-07-14T15:56:10.489747+0000","last_undegraded":"2023-07-14T15:56:10.489747+0000","last_fullsized":"2023-07-14T15:56:10.489747+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:59:57.661468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489832+0000","last_change":"2023-07-14T15:56:08.965378+0000","last_active":"2023-07-14T15:56:10.489832+0000","last_peered":"2023-07-14T15:56:10.489832+0000","last_clean":"2023-07-14T15:56:10.489832+0000","last_became_active":"2023-07-14T15:56:08.965029+0000","last_became_peered":"2023-07-14T15:56:08.965029+0000","last_unstale":"2023-07-14T15:56:10.489832+0000","last_undegraded":"2023-07-14T15:56:10.489832+0000","last_fullsized":"2023-07-14T15:56:10.489832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:11:49.645623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489209+0000","last_change":"2023-07-14T15:56:08.990555+0000","last_active":"2023-07-14T15:56:10.489209+0000","last_peered":"2023-07-14T15:56:10.489209+0000","last_clean":"2023-07-14T15:56:10.489209+0000","last_became_active":"2023-07-14T15:56:08.990204+0000","last_became_peered":"2023-07-14T15:56:08.990204+0000","last_unstale":"2023-07-14T15:56:10.489209+0000","last_undegraded":"2023-07-14T15:56:10.489209+0000","last_fullsized":"2023-07-14T15:56:10.489209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:53:14.967321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489549+0000","last_change":"2023-07-14T15:56:08.986185+0000","last_active":"2023-07-14T15:56:10.489549+0000","last_peered":"2023-07-14T15:56:10.489549+0000","last_clean":"2023-07-14T15:56:10.489549+0000","last_became_active":"2023-07-14T15:56:08.985934+0000","last_became_peered":"2023-07-14T15:56:08.985934+0000","last_unstale":"2023-07-14T15:56:10.489549+0000","last_undegraded":"2023-07-14T15:56:10.489549+0000","last_fullsized":"2023-07-14T15:56:10.489549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:22:06.842480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-14T15:56:08.969365+0000","last_change":"2023-07-14T15:56:08.962497+0000","last_active":"2023-07-14T15:56:08.969365+0000","last_peered":"2023-07-14T15:56:08.969365+0000","last_clean":"2023-07-14T15:56:08.969365+0000","last_became_active":"2023-07-14T15:56:08.962200+0000","last_became_peered":"2023-07-14T15:56:08.962200+0000","last_unstale":"2023-07-14T15:56:08.969365+0000","last_undegraded":"2023-07-14T15:56:08.969365+0000","last_fullsized":"2023-07-14T15:56:08.969365+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:39:06.825044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.962275+0000","last_change":"2023-07-14T15:56:07.962275+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.962275+0000","last_undegraded":"2023-07-14T15:56:07.962275+0000","last_fullsized":"2023-07-14T15:56:07.962275+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-14T15:56:08.972576+0000","last_change":"2023-07-14T15:56:08.967374+0000","last_active":"2023-07-14T15:56:08.972576+0000","last_peered":"2023-07-14T15:56:08.972576+0000","last_clean":"2023-07-14T15:56:08.972576+0000","last_became_active":"2023-07-14T15:56:08.967057+0000","last_became_peered":"2023-07-14T15:56:08.967057+0000","last_unstale":"2023-07-14T15:56:08.972576+0000","last_undegraded":"2023-07-14T15:56:08.972576+0000","last_fullsized":"2023-07-14T15:56:08.972576+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:39:15.295100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.490060+0000","last_change":"2023-07-14T15:56:08.961701+0000","last_active":"2023-07-14T15:56:10.490060+0000","last_peered":"2023-07-14T15:56:10.490060+0000","last_clean":"2023-07-14T15:56:10.490060+0000","last_became_active":"2023-07-14T15:56:08.961444+0000","last_became_peered":"2023-07-14T15:56:08.961444+0000","last_unstale":"2023-07-14T15:56:10.490060+0000","last_undegraded":"2023-07-14T15:56:10.490060+0000","last_fullsized":"2023-07-14T15:56:10.490060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:23:33.554098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489929+0000","last_change":"2023-07-14T15:56:08.985138+0000","last_active":"2023-07-14T15:56:10.489929+0000","last_peered":"2023-07-14T15:56:10.489929+0000","last_clean":"2023-07-14T15:56:10.489929+0000","last_became_active":"2023-07-14T15:56:08.984870+0000","last_became_peered":"2023-07-14T15:56:08.984870+0000","last_unstale":"2023-07-14T15:56:10.489929+0000","last_undegraded":"2023-07-14T15:56:10.489929+0000","last_fullsized":"2023-07-14T15:56:10.489929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:09:13.220323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489843+0000","last_change":"2023-07-14T15:56:08.985164+0000","last_active":"2023-07-14T15:56:10.489843+0000","last_peered":"2023-07-14T15:56:10.489843+0000","last_clean":"2023-07-14T15:56:10.489843+0000","last_became_active":"2023-07-14T15:56:08.984883+0000","last_became_peered":"2023-07-14T15:56:08.984883+0000","last_unstale":"2023-07-14T15:56:10.489843+0000","last_undegraded":"2023-07-14T15:56:10.489843+0000","last_fullsized":"2023-07-14T15:56:10.489843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:36:15.019527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.963599+0000","last_change":"2023-07-14T15:56:07.963599+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.963599+0000","last_undegraded":"2023-07-14T15:56:07.963599+0000","last_fullsized":"2023-07-14T15:56:07.963599+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"24'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489692+0000","last_change":"2023-07-14T15:56:07.968145+0000","last_active":"2023-07-14T15:56:10.489692+0000","last_peered":"2023-07-14T15:56:10.489692+0000","last_clean":"2023-07-14T15:56:10.489692+0000","last_became_active":"2023-07-14T15:56:07.967843+0000","last_became_peered":"2023-07-14T15:56:07.967843+0000","last_unstale":"2023-07-14T15:56:10.489692+0000","last_undegraded":"2023-07-14T15:56:10.489692+0000","last_fullsized":"2023-07-14T15:56:10.489692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:24:32.242091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2023-07-14T15:56:06.945009+0000","last_change":"2023-07-14T15:56:06.945009+0000","last_active":"2023-07-14T15:56:06.930113+0000","last_peered":"2023-07-14T15:56:06.930113+0000","last_clean":"2023-07-14T15:56:06.930113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:06.945009+0000","last_undegraded":"2023-07-14T15:56:06.945009+0000","last_fullsized":"2023-07-14T15:56:06.945009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2023-07-14T15:56:06.940103+0000","last_change":"2023-07-14T15:56:06.940103+0000","last_active":"2023-07-14T15:56:06.930113+0000","last_peered":"2023-07-14T15:56:06.930113+0000","last_clean":"2023-07-14T15:56:06.930113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:06.940103+0000","last_undegraded":"2023-07-14T15:56:06.940103+0000","last_fullsized":"2023-07-14T15:56:06.940103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.959093+0000","last_change":"2023-07-14T15:56:07.959093+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.959093+0000","last_undegraded":"2023-07-14T15:56:07.959093+0000","last_fullsized":"2023-07-14T15:56:07.959093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2023-07-14T15:56:06.939641+0000","last_change":"2023-07-14T15:56:06.939641+0000","last_active":"2023-07-14T15:56:06.930113+0000","last_peered":"2023-07-14T15:56:06.930113+0000","last_clean":"2023-07-14T15:56:06.930113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:06.939641+0000","last_undegraded":"2023-07-14T15:56:06.939641+0000","last_fullsized":"2023-07-14T15:56:06.939641+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T15:56:07.976968+0000","last_change":"2023-07-14T15:56:07.970831+0000","last_active":"2023-07-14T15:56:07.976968+0000","last_peered":"2023-07-14T15:56:07.976968+0000","last_clean":"2023-07-14T15:56:07.976968+0000","last_became_active":"2023-07-14T15:56:07.970450+0000","last_became_peered":"2023-07-14T15:56:07.970450+0000","last_unstale":"2023-07-14T15:56:07.976968+0000","last_undegraded":"2023-07-14T15:56:07.976968+0000","last_fullsized":"2023-07-14T15:56:07.976968+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:20:49.571526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"24'3","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-14T15:56:08.991954+0000","last_change":"2023-07-14T15:56:07.964545+0000","last_active":"2023-07-14T15:56:08.991954+0000","last_peered":"2023-07-14T15:56:08.991954+0000","last_clean":"2023-07-14T15:56:08.991954+0000","last_became_active":"2023-07-14T15:56:07.963768+0000","last_became_peered":"2023-07-14T15:56:07.963768+0000","last_unstale":"2023-07-14T15:56:08.991954+0000","last_undegraded":"2023-07-14T15:56:08.991954+0000","last_fullsized":"2023-07-14T15:56:08.991954+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:52:08.226282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T15:56:07.975673+0000","last_change":"2023-07-14T15:56:07.970523+0000","last_active":"2023-07-14T15:56:07.975673+0000","last_peered":"2023-07-14T15:56:07.975673+0000","last_clean":"2023-07-14T15:56:07.975673+0000","last_became_active":"2023-07-14T15:56:07.970142+0000","last_became_peered":"2023-07-14T15:56:07.970142+0000","last_unstale":"2023-07-14T15:56:07.975673+0000","last_undegraded":"2023-07-14T15:56:07.975673+0000","last_fullsized":"2023-07-14T15:56:07.975673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:08:34.958562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.951094+0000","last_change":"2023-07-14T15:56:07.951094+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.951094+0000","last_undegraded":"2023-07-14T15:56:07.951094+0000","last_fullsized":"2023-07-14T15:56:07.951094+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T15:56:07.975009+0000","last_change":"2023-07-14T15:56:07.970235+0000","last_active":"2023-07-14T15:56:07.975009+0000","last_peered":"2023-07-14T15:56:07.975009+0000","last_clean":"2023-07-14T15:56:07.975009+0000","last_became_active":"2023-07-14T15:56:07.969938+0000","last_became_peered":"2023-07-14T15:56:07.969938+0000","last_unstale":"2023-07-14T15:56:07.975009+0000","last_undegraded":"2023-07-14T15:56:07.975009+0000","last_fullsized":"2023-07-14T15:56:07.975009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:32:25.876269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489380+0000","last_change":"2023-07-14T15:56:08.980388+0000","last_active":"2023-07-14T15:56:10.489380+0000","last_peered":"2023-07-14T15:56:10.489380+0000","last_clean":"2023-07-14T15:56:10.489380+0000","last_became_active":"2023-07-14T15:56:08.980080+0000","last_became_peered":"2023-07-14T15:56:08.980080+0000","last_unstale":"2023-07-14T15:56:10.489380+0000","last_undegraded":"2023-07-14T15:56:10.489380+0000","last_fullsized":"2023-07-14T15:56:10.489380+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:20:12.345478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489365+0000","last_change":"2023-07-14T15:56:07.975515+0000","last_active":"2023-07-14T15:56:10.489365+0000","last_peered":"2023-07-14T15:56:10.489365+0000","last_clean":"2023-07-14T15:56:10.489365+0000","last_became_active":"2023-07-14T15:56:07.975155+0000","last_became_peered":"2023-07-14T15:56:07.975155+0000","last_unstale":"2023-07-14T15:56:10.489365+0000","last_undegraded":"2023-07-14T15:56:10.489365+0000","last_fullsized":"2023-07-14T15:56:10.489365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:33:36.247286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.961503+0000","last_change":"2023-07-14T15:56:07.961503+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.961503+0000","last_undegraded":"2023-07-14T15:56:07.961503+0000","last_fullsized":"2023-07-14T15:56:07.961503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T15:56:07.975702+0000","last_change":"2023-07-14T15:56:07.970580+0000","last_active":"2023-07-14T15:56:07.975702+0000","last_peered":"2023-07-14T15:56:07.975702+0000","last_clean":"2023-07-14T15:56:07.975702+0000","last_became_active":"2023-07-14T15:56:07.970015+0000","last_became_peered":"2023-07-14T15:56:07.970015+0000","last_unstale":"2023-07-14T15:56:07.975702+0000","last_undegraded":"2023-07-14T15:56:07.975702+0000","last_fullsized":"2023-07-14T15:56:07.975702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:57:57.420084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"24'8","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489443+0000","last_change":"2023-07-14T15:56:07.968155+0000","last_active":"2023-07-14T15:56:10.489443+0000","last_peered":"2023-07-14T15:56:10.489443+0000","last_clean":"2023-07-14T15:56:10.489443+0000","last_became_active":"2023-07-14T15:56:07.967859+0000","last_became_peered":"2023-07-14T15:56:07.967859+0000","last_unstale":"2023-07-14T15:56:10.489443+0000","last_undegraded":"2023-07-14T15:56:10.489443+0000","last_fullsized":"2023-07-14T15:56:10.489443+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:15:27.451548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"24'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-14T15:56:08.991660+0000","last_change":"2023-07-14T15:56:07.967243+0000","last_active":"2023-07-14T15:56:08.991660+0000","last_peered":"2023-07-14T15:56:08.991660+0000","last_clean":"2023-07-14T15:56:08.991660+0000","last_became_active":"2023-07-14T15:56:07.966979+0000","last_became_peered":"2023-07-14T15:56:07.966979+0000","last_unstale":"2023-07-14T15:56:08.991660+0000","last_undegraded":"2023-07-14T15:56:08.991660+0000","last_fullsized":"2023-07-14T15:56:08.991660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:25:07.493777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.955562+0000","last_change":"2023-07-14T15:56:07.955562+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.955562+0000","last_undegraded":"2023-07-14T15:56:07.955562+0000","last_fullsized":"2023-07-14T15:56:07.955562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T15:56:07.976948+0000","last_change":"2023-07-14T15:56:07.968894+0000","last_active":"2023-07-14T15:56:07.976948+0000","last_peered":"2023-07-14T15:56:07.976948+0000","last_clean":"2023-07-14T15:56:07.976948+0000","last_became_active":"2023-07-14T15:56:07.968577+0000","last_became_peered":"2023-07-14T15:56:07.968577+0000","last_unstale":"2023-07-14T15:56:07.976948+0000","last_undegraded":"2023-07-14T15:56:07.976948+0000","last_fullsized":"2023-07-14T15:56:07.976948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:14:49.443210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489497+0000","last_change":"2023-07-14T15:56:08.985023+0000","last_active":"2023-07-14T15:56:10.489497+0000","last_peered":"2023-07-14T15:56:10.489497+0000","last_clean":"2023-07-14T15:56:10.489497+0000","last_became_active":"2023-07-14T15:56:08.984743+0000","last_became_peered":"2023-07-14T15:56:08.984743+0000","last_unstale":"2023-07-14T15:56:10.489497+0000","last_undegraded":"2023-07-14T15:56:10.489497+0000","last_fullsized":"2023-07-14T15:56:10.489497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:52:49.596576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T15:56:07.979827+0000","last_change":"2023-07-14T15:56:07.975480+0000","last_active":"2023-07-14T15:56:07.979827+0000","last_peered":"2023-07-14T15:56:07.979827+0000","last_clean":"2023-07-14T15:56:07.979827+0000","last_became_active":"2023-07-14T15:56:07.975128+0000","last_became_peered":"2023-07-14T15:56:07.975128+0000","last_unstale":"2023-07-14T15:56:07.979827+0000","last_undegraded":"2023-07-14T15:56:07.979827+0000","last_fullsized":"2023-07-14T15:56:07.979827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:40:47.692782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.950885+0000","last_change":"2023-07-14T15:56:07.950885+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.950885+0000","last_undegraded":"2023-07-14T15:56:07.950885+0000","last_fullsized":"2023-07-14T15:56:07.950885+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-14T15:56:08.960224+0000","last_change":"2023-07-14T15:56:07.973033+0000","last_active":"2023-07-14T15:56:08.960224+0000","last_peered":"2023-07-14T15:56:08.960224+0000","last_clean":"2023-07-14T15:56:08.960224+0000","last_became_active":"2023-07-14T15:56:07.972707+0000","last_became_peered":"2023-07-14T15:56:07.972707+0000","last_unstale":"2023-07-14T15:56:08.960224+0000","last_undegraded":"2023-07-14T15:56:08.960224+0000","last_fullsized":"2023-07-14T15:56:08.960224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:07:50.160969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2023-07-14T15:56:06.942568+0000","last_change":"2023-07-14T15:56:06.942568+0000","last_active":"2023-07-14T15:56:06.930113+0000","last_peered":"2023-07-14T15:56:06.930113+0000","last_clean":"2023-07-14T15:56:06.930113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:06.942568+0000","last_undegraded":"2023-07-14T15:56:06.942568+0000","last_fullsized":"2023-07-14T15:56:06.942568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-14T15:56:08.969375+0000","last_change":"2023-07-14T15:56:08.963200+0000","last_active":"2023-07-14T15:56:08.969375+0000","last_peered":"2023-07-14T15:56:08.969375+0000","last_clean":"2023-07-14T15:56:08.969375+0000","last_became_active":"2023-07-14T15:56:08.962998+0000","last_became_peered":"2023-07-14T15:56:08.962998+0000","last_unstale":"2023-07-14T15:56:08.969375+0000","last_undegraded":"2023-07-14T15:56:08.969375+0000","last_fullsized":"2023-07-14T15:56:08.969375+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:37:06.277634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T15:56:07.979885+0000","last_change":"2023-07-14T15:56:07.976310+0000","last_active":"2023-07-14T15:56:07.979885+0000","last_peered":"2023-07-14T15:56:07.979885+0000","last_clean":"2023-07-14T15:56:07.979885+0000","last_became_active":"2023-07-14T15:56:07.975997+0000","last_became_peered":"2023-07-14T15:56:07.975997+0000","last_unstale":"2023-07-14T15:56:07.979885+0000","last_undegraded":"2023-07-14T15:56:07.979885+0000","last_fullsized":"2023-07-14T15:56:07.979885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:41:09.214376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.961029+0000","last_change":"2023-07-14T15:56:07.961029+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.961029+0000","last_undegraded":"2023-07-14T15:56:07.961029+0000","last_fullsized":"2023-07-14T15:56:07.961029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T15:56:07.974822+0000","last_change":"2023-07-14T15:56:07.969636+0000","last_active":"2023-07-14T15:56:07.974822+0000","last_peered":"2023-07-14T15:56:07.974822+0000","last_clean":"2023-07-14T15:56:07.974822+0000","last_became_active":"2023-07-14T15:56:07.969277+0000","last_became_peered":"2023-07-14T15:56:07.969277+0000","last_unstale":"2023-07-14T15:56:07.974822+0000","last_undegraded":"2023-07-14T15:56:07.974822+0000","last_fullsized":"2023-07-14T15:56:07.974822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:03:12.896062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.954093+0000","last_change":"2023-07-14T15:56:07.954093+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.954093+0000","last_undegraded":"2023-07-14T15:56:07.954093+0000","last_fullsized":"2023-07-14T15:56:07.954093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2023-07-14T15:56:06.944913+0000","last_change":"2023-07-14T15:56:06.944913+0000","last_active":"2023-07-14T15:56:06.930113+0000","last_peered":"2023-07-14T15:56:06.930113+0000","last_clean":"2023-07-14T15:56:06.930113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:06.944913+0000","last_undegraded":"2023-07-14T15:56:06.944913+0000","last_fullsized":"2023-07-14T15:56:06.944913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T15:56:06.940962+0000","last_change":"2023-07-14T15:56:02.621850+0000","last_active":"2023-07-14T15:56:06.940962+0000","last_peered":"2023-07-14T15:56:06.940962+0000","last_clean":"2023-07-14T15:56:06.940962+0000","last_became_active":"2023-07-14T15:56:02.621471+0000","last_became_peered":"2023-07-14T15:56:02.621471+0000","last_unstale":"2023-07-14T15:56:06.940962+0000","last_undegraded":"2023-07-14T15:56:06.940962+0000","last_fullsized":"2023-07-14T15:56:06.940962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:03:08.971454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T15:56:07.973829+0000","last_change":"2023-07-14T15:56:07.965851+0000","last_active":"2023-07-14T15:56:07.973829+0000","last_peered":"2023-07-14T15:56:07.973829+0000","last_clean":"2023-07-14T15:56:07.973829+0000","last_became_active":"2023-07-14T15:56:07.965312+0000","last_became_peered":"2023-07-14T15:56:07.965312+0000","last_unstale":"2023-07-14T15:56:07.973829+0000","last_undegraded":"2023-07-14T15:56:07.973829+0000","last_fullsized":"2023-07-14T15:56:07.973829+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:49:41.982719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.488879+0000","last_change":"2023-07-14T15:56:08.974753+0000","last_active":"2023-07-14T15:56:10.488879+0000","last_peered":"2023-07-14T15:56:10.488879+0000","last_clean":"2023-07-14T15:56:10.488879+0000","last_became_active":"2023-07-14T15:56:08.974482+0000","last_became_peered":"2023-07-14T15:56:08.974482+0000","last_unstale":"2023-07-14T15:56:10.488879+0000","last_undegraded":"2023-07-14T15:56:10.488879+0000","last_fullsized":"2023-07-14T15:56:10.488879+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:22:21.802038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T15:56:07.952879+0000","last_change":"2023-07-14T15:56:02.621963+0000","last_active":"2023-07-14T15:56:07.952879+0000","last_peered":"2023-07-14T15:56:07.952879+0000","last_clean":"2023-07-14T15:56:07.952879+0000","last_became_active":"2023-07-14T15:56:02.621678+0000","last_became_peered":"2023-07-14T15:56:02.621678+0000","last_unstale":"2023-07-14T15:56:07.952879+0000","last_undegraded":"2023-07-14T15:56:07.952879+0000","last_fullsized":"2023-07-14T15:56:07.952879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:41:51.335640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-14T15:56:08.959245+0000","last_change":"2023-07-14T15:56:07.970834+0000","last_active":"2023-07-14T15:56:08.959245+0000","last_peered":"2023-07-14T15:56:08.959245+0000","last_clean":"2023-07-14T15:56:08.959245+0000","last_became_active":"2023-07-14T15:56:07.970464+0000","last_became_peered":"2023-07-14T15:56:07.970464+0000","last_unstale":"2023-07-14T15:56:08.959245+0000","last_undegraded":"2023-07-14T15:56:08.959245+0000","last_fullsized":"2023-07-14T15:56:08.959245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:47:36.646483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489620+0000","last_change":"2023-07-14T15:56:08.974479+0000","last_active":"2023-07-14T15:56:10.489620+0000","last_peered":"2023-07-14T15:56:10.489620+0000","last_clean":"2023-07-14T15:56:10.489620+0000","last_became_active":"2023-07-14T15:56:08.974197+0000","last_became_peered":"2023-07-14T15:56:08.974197+0000","last_unstale":"2023-07-14T15:56:10.489620+0000","last_undegraded":"2023-07-14T15:56:10.489620+0000","last_fullsized":"2023-07-14T15:56:10.489620+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:10:08.144011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T15:56:06.942990+0000","last_change":"2023-07-14T15:56:01.925110+0000","last_active":"2023-07-14T15:56:06.942990+0000","last_peered":"2023-07-14T15:56:06.942990+0000","last_clean":"2023-07-14T15:56:06.942990+0000","last_became_active":"2023-07-14T15:56:01.924723+0000","last_became_peered":"2023-07-14T15:56:01.924723+0000","last_unstale":"2023-07-14T15:56:06.942990+0000","last_undegraded":"2023-07-14T15:56:06.942990+0000","last_fullsized":"2023-07-14T15:56:06.942990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:05:05.697085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2023-07-14T15:56:06.939541+0000","last_change":"2023-07-14T15:56:06.939541+0000","last_active":"2023-07-14T15:56:06.930113+0000","last_peered":"2023-07-14T15:56:06.930113+0000","last_clean":"2023-07-14T15:56:06.930113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:06.939541+0000","last_undegraded":"2023-07-14T15:56:06.939541+0000","last_fullsized":"2023-07-14T15:56:06.939541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489621+0000","last_change":"2023-07-14T15:56:08.981489+0000","last_active":"2023-07-14T15:56:10.489621+0000","last_peered":"2023-07-14T15:56:10.489621+0000","last_clean":"2023-07-14T15:56:10.489621+0000","last_became_active":"2023-07-14T15:56:08.981064+0000","last_became_peered":"2023-07-14T15:56:08.981064+0000","last_unstale":"2023-07-14T15:56:10.489621+0000","last_undegraded":"2023-07-14T15:56:10.489621+0000","last_fullsized":"2023-07-14T15:56:10.489621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:09:43.406898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T15:56:07.953532+0000","last_change":"2023-07-14T15:56:01.923465+0000","last_active":"2023-07-14T15:56:07.953532+0000","last_peered":"2023-07-14T15:56:07.953532+0000","last_clean":"2023-07-14T15:56:07.953532+0000","last_became_active":"2023-07-14T15:56:01.923160+0000","last_became_peered":"2023-07-14T15:56:01.923160+0000","last_unstale":"2023-07-14T15:56:07.953532+0000","last_undegraded":"2023-07-14T15:56:07.953532+0000","last_fullsized":"2023-07-14T15:56:07.953532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:07:22.773242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":175,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489184+0000","last_change":"2023-07-14T15:55:54.040065+0000","last_active":"2023-07-14T15:56:10.489184+0000","last_peered":"2023-07-14T15:56:10.489184+0000","last_clean":"2023-07-14T15:56:10.489184+0000","last_became_active":"2023-07-14T15:55:54.038885+0000","last_became_peered":"2023-07-14T15:55:54.038885+0000","last_unstale":"2023-07-14T15:56:10.489184+0000","last_undegraded":"2023-07-14T15:56:10.489184+0000","last_fullsized":"2023-07-14T15:56:10.489184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:55:53.025696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:55:53.025696+0000","last_clean_scrub_stamp":"2023-07-14T15:55:53.025696+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:14:43.173657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2023-07-14T15:56:06.943708+0000","last_change":"2023-07-14T15:56:06.943708+0000","last_active":"2023-07-14T15:56:06.930113+0000","last_peered":"2023-07-14T15:56:06.930113+0000","last_clean":"2023-07-14T15:56:06.930113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:06.943708+0000","last_undegraded":"2023-07-14T15:56:06.943708+0000","last_fullsized":"2023-07-14T15:56:06.943708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.960438+0000","last_change":"2023-07-14T15:56:07.960438+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.960438+0000","last_undegraded":"2023-07-14T15:56:07.960438+0000","last_fullsized":"2023-07-14T15:56:07.960438+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T15:56:07.952062+0000","last_change":"2023-07-14T15:56:01.920714+0000","last_active":"2023-07-14T15:56:07.952062+0000","last_peered":"2023-07-14T15:56:07.952062+0000","last_clean":"2023-07-14T15:56:07.952062+0000","last_became_active":"2023-07-14T15:56:01.920325+0000","last_became_peered":"2023-07-14T15:56:01.920325+0000","last_unstale":"2023-07-14T15:56:07.952062+0000","last_undegraded":"2023-07-14T15:56:07.952062+0000","last_fullsized":"2023-07-14T15:56:07.952062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:52:29.180496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.488883+0000","last_change":"2023-07-14T15:56:07.970542+0000","last_active":"2023-07-14T15:56:10.488883+0000","last_peered":"2023-07-14T15:56:10.488883+0000","last_clean":"2023-07-14T15:56:10.488883+0000","last_became_active":"2023-07-14T15:56:07.970172+0000","last_became_peered":"2023-07-14T15:56:07.970172+0000","last_unstale":"2023-07-14T15:56:10.488883+0000","last_undegraded":"2023-07-14T15:56:10.488883+0000","last_fullsized":"2023-07-14T15:56:10.488883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:31:45.916927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T15:56:07.952243+0000","last_change":"2023-07-14T15:56:01.923631+0000","last_active":"2023-07-14T15:56:07.952243+0000","last_peered":"2023-07-14T15:56:07.952243+0000","last_clean":"2023-07-14T15:56:07.952243+0000","last_became_active":"2023-07-14T15:56:01.922783+0000","last_became_peered":"2023-07-14T15:56:01.922783+0000","last_unstale":"2023-07-14T15:56:07.952243+0000","last_undegraded":"2023-07-14T15:56:07.952243+0000","last_fullsized":"2023-07-14T15:56:07.952243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:53:41.072475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489594+0000","last_change":"2023-07-14T15:56:07.967762+0000","last_active":"2023-07-14T15:56:10.489594+0000","last_peered":"2023-07-14T15:56:10.489594+0000","last_clean":"2023-07-14T15:56:10.489594+0000","last_became_active":"2023-07-14T15:56:07.967471+0000","last_became_peered":"2023-07-14T15:56:07.967471+0000","last_unstale":"2023-07-14T15:56:10.489594+0000","last_undegraded":"2023-07-14T15:56:10.489594+0000","last_fullsized":"2023-07-14T15:56:10.489594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:29:31.273078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489319+0000","last_change":"2023-07-14T15:56:08.976758+0000","last_active":"2023-07-14T15:56:10.489319+0000","last_peered":"2023-07-14T15:56:10.489319+0000","last_clean":"2023-07-14T15:56:10.489319+0000","last_became_active":"2023-07-14T15:56:08.976318+0000","last_became_peered":"2023-07-14T15:56:08.976318+0000","last_unstale":"2023-07-14T15:56:10.489319+0000","last_undegraded":"2023-07-14T15:56:10.489319+0000","last_fullsized":"2023-07-14T15:56:10.489319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:18:49.883894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2023-07-14T15:56:06.945529+0000","last_change":"2023-07-14T15:56:06.945529+0000","last_active":"2023-07-14T15:56:06.930113+0000","last_peered":"2023-07-14T15:56:06.930113+0000","last_clean":"2023-07-14T15:56:06.930113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:06.945529+0000","last_undegraded":"2023-07-14T15:56:06.945529+0000","last_fullsized":"2023-07-14T15:56:06.945529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T15:56:06.947613+0000","last_change":"2023-07-14T15:56:01.965649+0000","last_active":"2023-07-14T15:56:06.947613+0000","last_peered":"2023-07-14T15:56:06.947613+0000","last_clean":"2023-07-14T15:56:06.947613+0000","last_became_active":"2023-07-14T15:56:01.965344+0000","last_became_peered":"2023-07-14T15:56:01.965344+0000","last_unstale":"2023-07-14T15:56:06.947613+0000","last_undegraded":"2023-07-14T15:56:06.947613+0000","last_fullsized":"2023-07-14T15:56:06.947613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:05:05.697085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T15:56:07.953390+0000","last_change":"2023-07-14T15:56:01.966578+0000","last_active":"2023-07-14T15:56:07.953390+0000","last_peered":"2023-07-14T15:56:07.953390+0000","last_clean":"2023-07-14T15:56:07.953390+0000","last_became_active":"2023-07-14T15:56:01.966216+0000","last_became_peered":"2023-07-14T15:56:01.966216+0000","last_unstale":"2023-07-14T15:56:07.953390+0000","last_undegraded":"2023-07-14T15:56:07.953390+0000","last_fullsized":"2023-07-14T15:56:07.953390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:04:26.951849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2023-07-14T15:56:06.945247+0000","last_change":"2023-07-14T15:56:06.945247+0000","last_active":"2023-07-14T15:56:06.930113+0000","last_peered":"2023-07-14T15:56:06.930113+0000","last_clean":"2023-07-14T15:56:06.930113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:06.945247+0000","last_undegraded":"2023-07-14T15:56:06.945247+0000","last_fullsized":"2023-07-14T15:56:06.945247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.949736+0000","last_change":"2023-07-14T15:56:07.949736+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.949736+0000","last_undegraded":"2023-07-14T15:56:07.949736+0000","last_fullsized":"2023-07-14T15:56:07.949736+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2023-07-14T15:56:06.945000+0000","last_change":"2023-07-14T15:56:06.945000+0000","last_active":"2023-07-14T15:56:06.930113+0000","last_peered":"2023-07-14T15:56:06.930113+0000","last_clean":"2023-07-14T15:56:06.930113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:06.945000+0000","last_undegraded":"2023-07-14T15:56:06.945000+0000","last_fullsized":"2023-07-14T15:56:06.945000+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.490013+0000","last_change":"2023-07-14T15:56:07.968681+0000","last_active":"2023-07-14T15:56:10.490013+0000","last_peered":"2023-07-14T15:56:10.490013+0000","last_clean":"2023-07-14T15:56:10.490013+0000","last_became_active":"2023-07-14T15:56:07.968350+0000","last_became_peered":"2023-07-14T15:56:07.968350+0000","last_unstale":"2023-07-14T15:56:10.490013+0000","last_undegraded":"2023-07-14T15:56:10.490013+0000","last_fullsized":"2023-07-14T15:56:10.490013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:12:08.491508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.951717+0000","last_change":"2023-07-14T15:56:07.951717+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.951717+0000","last_undegraded":"2023-07-14T15:56:07.951717+0000","last_fullsized":"2023-07-14T15:56:07.951717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T15:56:07.975803+0000","last_change":"2023-07-14T15:56:07.971194+0000","last_active":"2023-07-14T15:56:07.975803+0000","last_peered":"2023-07-14T15:56:07.975803+0000","last_clean":"2023-07-14T15:56:07.975803+0000","last_became_active":"2023-07-14T15:56:07.970215+0000","last_became_peered":"2023-07-14T15:56:07.970215+0000","last_unstale":"2023-07-14T15:56:07.975803+0000","last_undegraded":"2023-07-14T15:56:07.975803+0000","last_fullsized":"2023-07-14T15:56:07.975803+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:40:04.386118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.955961+0000","last_change":"2023-07-14T15:56:07.955961+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.955961+0000","last_undegraded":"2023-07-14T15:56:07.955961+0000","last_fullsized":"2023-07-14T15:56:07.955961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2023-07-14T15:56:06.939718+0000","last_change":"2023-07-14T15:56:06.939718+0000","last_active":"2023-07-14T15:56:06.930113+0000","last_peered":"2023-07-14T15:56:06.930113+0000","last_clean":"2023-07-14T15:56:06.930113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:06.939718+0000","last_undegraded":"2023-07-14T15:56:06.939718+0000","last_fullsized":"2023-07-14T15:56:06.939718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2023-07-14T15:56:06.940302+0000","last_change":"2023-07-14T15:56:06.940302+0000","last_active":"2023-07-14T15:56:06.930113+0000","last_peered":"2023-07-14T15:56:06.930113+0000","last_clean":"2023-07-14T15:56:06.930113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:06.940302+0000","last_undegraded":"2023-07-14T15:56:06.940302+0000","last_fullsized":"2023-07-14T15:56:06.940302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":23,"state":"creating+peering","last_fresh":"2023-07-14T15:56:07.949666+0000","last_change":"2023-07-14T15:56:07.949666+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.949666+0000","last_undegraded":"2023-07-14T15:56:07.949666+0000","last_fullsized":"2023-07-14T15:56:07.949666+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489873+0000","last_change":"2023-07-14T15:56:08.962047+0000","last_active":"2023-07-14T15:56:10.489873+0000","last_peered":"2023-07-14T15:56:10.489873+0000","last_clean":"2023-07-14T15:56:10.489873+0000","last_became_active":"2023-07-14T15:56:08.961657+0000","last_became_peered":"2023-07-14T15:56:08.961657+0000","last_unstale":"2023-07-14T15:56:10.489873+0000","last_undegraded":"2023-07-14T15:56:10.489873+0000","last_fullsized":"2023-07-14T15:56:10.489873+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:32:30.477405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.488979+0000","last_change":"2023-07-14T15:56:08.979917+0000","last_active":"2023-07-14T15:56:10.488979+0000","last_peered":"2023-07-14T15:56:10.488979+0000","last_clean":"2023-07-14T15:56:10.488979+0000","last_became_active":"2023-07-14T15:56:08.979617+0000","last_became_peered":"2023-07-14T15:56:08.979617+0000","last_unstale":"2023-07-14T15:56:10.488979+0000","last_undegraded":"2023-07-14T15:56:10.488979+0000","last_fullsized":"2023-07-14T15:56:10.488979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:10:09.608521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-14T15:56:08.973967+0000","last_change":"2023-07-14T15:56:08.971350+0000","last_active":"2023-07-14T15:56:08.973967+0000","last_peered":"2023-07-14T15:56:08.973967+0000","last_clean":"2023-07-14T15:56:08.973967+0000","last_became_active":"2023-07-14T15:56:08.970957+0000","last_became_peered":"2023-07-14T15:56:08.970957+0000","last_unstale":"2023-07-14T15:56:08.973967+0000","last_undegraded":"2023-07-14T15:56:08.973967+0000","last_fullsized":"2023-07-14T15:56:08.973967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:55:29.083644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:56:07.936740+0000","last_change":"2023-07-14T15:56:07.936740+0000","last_active":"2023-07-14T15:56:07.936740+0000","last_peered":"2023-07-14T15:56:07.936740+0000","last_clean":"2023-07-14T15:56:07.936740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:56:07.936740+0000","last_undegraded":"2023-07-14T15:56:07.936740+0000","last_fullsized":"2023-07-14T15:56:07.936740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":78,"acting":78,"num_store_stats":5},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476742,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":74768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]}]},{"osd":0,"up_from":16,"seq":68719476743,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":229376,"data_stored":81396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":258048,"data_stored":95267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":860160,"data_stored":686219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]}]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":74768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":74768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]}]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":811008,"data_stored":665136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]}]},{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":74768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T15:56:14.373 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3f is not active+clean 2023-07-14T15:56:14.373 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T15:56:07.936740+0000', 'last_change': '2023-07-14T15:56:07.936740+0000', 'last_active': '2023-07-14T15:56:07.936740+0000', 'last_peered': '2023-07-14T15:56:07.936740+0000', 'last_clean': '2023-07-14T15:56:07.936740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:07.936740+0000', 'last_undegraded': '2023-07-14T15:56:07.936740+0000', 'last_fullsized': '2023-07-14T15:56:07.936740+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T15:56:14.374 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3e is not active+clean 2023-07-14T15:56:14.374 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 23, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:56:07.954625+0000', 'last_change': '2023-07-14T15:56:07.954625+0000', 'last_active': '2023-07-14T15:56:07.936740+0000', 'last_peered': '2023-07-14T15:56:07.936740+0000', 'last_clean': '2023-07-14T15:56:07.936740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:07.954625+0000', 'last_undegraded': '2023-07-14T15:56:07.954625+0000', 'last_fullsized': '2023-07-14T15:56:07.954625+0000', 'mapping_epoch': 23, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 23, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T15:56:14.374 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3b is not active+clean 2023-07-14T15:56:14.375 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T15:56:07.936740+0000', 'last_change': '2023-07-14T15:56:07.936740+0000', 'last_active': '2023-07-14T15:56:07.936740+0000', 'last_peered': '2023-07-14T15:56:07.936740+0000', 'last_clean': '2023-07-14T15:56:07.936740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:07.936740+0000', 'last_undegraded': '2023-07-14T15:56:07.936740+0000', 'last_fullsized': '2023-07-14T15:56:07.936740+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T15:56:14.375 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3a is not active+clean 2023-07-14T15:56:14.375 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 23, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:56:07.962570+0000', 'last_change': '2023-07-14T15:56:07.962570+0000', 'last_active': '2023-07-14T15:56:07.936740+0000', 'last_peered': '2023-07-14T15:56:07.936740+0000', 'last_clean': '2023-07-14T15:56:07.936740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:07.962570+0000', 'last_undegraded': '2023-07-14T15:56:07.962570+0000', 'last_fullsized': '2023-07-14T15:56:07.962570+0000', 'mapping_epoch': 23, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 23, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T15:56:14.375 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.39 is not active+clean 2023-07-14T15:56:14.376 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 23, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:56:07.962984+0000', 'last_change': '2023-07-14T15:56:07.962984+0000', 'last_active': '2023-07-14T15:56:07.936740+0000', 'last_peered': '2023-07-14T15:56:07.936740+0000', 'last_clean': '2023-07-14T15:56:07.936740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:07.962984+0000', 'last_undegraded': '2023-07-14T15:56:07.962984+0000', 'last_fullsized': '2023-07-14T15:56:07.962984+0000', 'mapping_epoch': 23, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 23, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T15:56:14.376 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.37 is not active+clean 2023-07-14T15:56:14.376 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T15:56:07.936740+0000', 'last_change': '2023-07-14T15:56:07.936740+0000', 'last_active': '2023-07-14T15:56:07.936740+0000', 'last_peered': '2023-07-14T15:56:07.936740+0000', 'last_clean': '2023-07-14T15:56:07.936740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:07.936740+0000', 'last_undegraded': '2023-07-14T15:56:07.936740+0000', 'last_fullsized': '2023-07-14T15:56:07.936740+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T15:56:14.377 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.34 is not active+clean 2023-07-14T15:56:14.377 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T15:56:07.936740+0000', 'last_change': '2023-07-14T15:56:07.936740+0000', 'last_active': '2023-07-14T15:56:07.936740+0000', 'last_peered': '2023-07-14T15:56:07.936740+0000', 'last_clean': '2023-07-14T15:56:07.936740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:07.936740+0000', 'last_undegraded': '2023-07-14T15:56:07.936740+0000', 'last_fullsized': '2023-07-14T15:56:07.936740+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T15:56:14.377 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.30 is not active+clean 2023-07-14T15:56:14.377 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 23, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:56:07.962275+0000', 'last_change': '2023-07-14T15:56:07.962275+0000', 'last_active': '2023-07-14T15:56:07.936740+0000', 'last_peered': '2023-07-14T15:56:07.936740+0000', 'last_clean': '2023-07-14T15:56:07.936740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:07.962275+0000', 'last_undegraded': '2023-07-14T15:56:07.962275+0000', 'last_fullsized': '2023-07-14T15:56:07.962275+0000', 'mapping_epoch': 23, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 23, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T15:56:14.378 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2f is not active+clean 2023-07-14T15:56:14.378 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T15:56:07.936740+0000', 'last_change': '2023-07-14T15:56:07.936740+0000', 'last_active': '2023-07-14T15:56:07.936740+0000', 'last_peered': '2023-07-14T15:56:07.936740+0000', 'last_clean': '2023-07-14T15:56:07.936740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:07.936740+0000', 'last_undegraded': '2023-07-14T15:56:07.936740+0000', 'last_fullsized': '2023-07-14T15:56:07.936740+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T15:56:14.378 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2d is not active+clean 2023-07-14T15:56:14.378 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T15:56:07.936740+0000', 'last_change': '2023-07-14T15:56:07.936740+0000', 'last_active': '2023-07-14T15:56:07.936740+0000', 'last_peered': '2023-07-14T15:56:07.936740+0000', 'last_clean': '2023-07-14T15:56:07.936740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:07.936740+0000', 'last_undegraded': '2023-07-14T15:56:07.936740+0000', 'last_fullsized': '2023-07-14T15:56:07.936740+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T15:56:14.379 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2a is not active+clean 2023-07-14T15:56:14.379 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T15:56:07.936740+0000', 'last_change': '2023-07-14T15:56:07.936740+0000', 'last_active': '2023-07-14T15:56:07.936740+0000', 'last_peered': '2023-07-14T15:56:07.936740+0000', 'last_clean': '2023-07-14T15:56:07.936740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:07.936740+0000', 'last_undegraded': '2023-07-14T15:56:07.936740+0000', 'last_fullsized': '2023-07-14T15:56:07.936740+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T15:56:14.379 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.29 is not active+clean 2023-07-14T15:56:14.379 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T15:56:07.936740+0000', 'last_change': '2023-07-14T15:56:07.936740+0000', 'last_active': '2023-07-14T15:56:07.936740+0000', 'last_peered': '2023-07-14T15:56:07.936740+0000', 'last_clean': '2023-07-14T15:56:07.936740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:07.936740+0000', 'last_undegraded': '2023-07-14T15:56:07.936740+0000', 'last_fullsized': '2023-07-14T15:56:07.936740+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T15:56:14.380 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.27 is not active+clean 2023-07-14T15:56:14.380 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T15:56:07.936740+0000', 'last_change': '2023-07-14T15:56:07.936740+0000', 'last_active': '2023-07-14T15:56:07.936740+0000', 'last_peered': '2023-07-14T15:56:07.936740+0000', 'last_clean': '2023-07-14T15:56:07.936740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:07.936740+0000', 'last_undegraded': '2023-07-14T15:56:07.936740+0000', 'last_fullsized': '2023-07-14T15:56:07.936740+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T15:56:14.380 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.26 is not active+clean 2023-07-14T15:56:14.380 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T15:56:07.936740+0000', 'last_change': '2023-07-14T15:56:07.936740+0000', 'last_active': '2023-07-14T15:56:07.936740+0000', 'last_peered': '2023-07-14T15:56:07.936740+0000', 'last_clean': '2023-07-14T15:56:07.936740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:07.936740+0000', 'last_undegraded': '2023-07-14T15:56:07.936740+0000', 'last_fullsized': '2023-07-14T15:56:07.936740+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T15:56:14.381 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.25 is not active+clean 2023-07-14T15:56:14.381 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 23, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:56:07.963599+0000', 'last_change': '2023-07-14T15:56:07.963599+0000', 'last_active': '2023-07-14T15:56:07.936740+0000', 'last_peered': '2023-07-14T15:56:07.936740+0000', 'last_clean': '2023-07-14T15:56:07.936740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:07.963599+0000', 'last_undegraded': '2023-07-14T15:56:07.963599+0000', 'last_fullsized': '2023-07-14T15:56:07.963599+0000', 'mapping_epoch': 23, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 23, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T15:56:14.381 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2023-07-14T15:56:14.381 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T15:56:07.936740+0000', 'last_change': '2023-07-14T15:56:07.936740+0000', 'last_active': '2023-07-14T15:56:07.936740+0000', 'last_peered': '2023-07-14T15:56:07.936740+0000', 'last_clean': '2023-07-14T15:56:07.936740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:07.936740+0000', 'last_undegraded': '2023-07-14T15:56:07.936740+0000', 'last_fullsized': '2023-07-14T15:56:07.936740+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T15:56:14.382 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2023-07-14T15:56:14.382 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 22, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:56:06.945009+0000', 'last_change': '2023-07-14T15:56:06.945009+0000', 'last_active': '2023-07-14T15:56:06.930113+0000', 'last_peered': '2023-07-14T15:56:06.930113+0000', 'last_clean': '2023-07-14T15:56:06.930113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:06.945009+0000', 'last_undegraded': '2023-07-14T15:56:06.945009+0000', 'last_fullsized': '2023-07-14T15:56:06.945009+0000', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:06.930113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:06.930113+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:06.930113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T15:56:14.382 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2023-07-14T15:56:14.383 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T15:56:07.936740+0000', 'last_change': '2023-07-14T15:56:07.936740+0000', 'last_active': '2023-07-14T15:56:07.936740+0000', 'last_peered': '2023-07-14T15:56:07.936740+0000', 'last_clean': '2023-07-14T15:56:07.936740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:07.936740+0000', 'last_undegraded': '2023-07-14T15:56:07.936740+0000', 'last_fullsized': '2023-07-14T15:56:07.936740+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T15:56:14.383 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2023-07-14T15:56:14.383 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 22, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:56:06.940103+0000', 'last_change': '2023-07-14T15:56:06.940103+0000', 'last_active': '2023-07-14T15:56:06.930113+0000', 'last_peered': '2023-07-14T15:56:06.930113+0000', 'last_clean': '2023-07-14T15:56:06.930113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:06.940103+0000', 'last_undegraded': '2023-07-14T15:56:06.940103+0000', 'last_fullsized': '2023-07-14T15:56:06.940103+0000', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:06.930113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:06.930113+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:06.930113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T15:56:14.383 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2023-07-14T15:56:14.384 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 23, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:56:07.959093+0000', 'last_change': '2023-07-14T15:56:07.959093+0000', 'last_active': '2023-07-14T15:56:07.936740+0000', 'last_peered': '2023-07-14T15:56:07.936740+0000', 'last_clean': '2023-07-14T15:56:07.936740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:07.959093+0000', 'last_undegraded': '2023-07-14T15:56:07.959093+0000', 'last_fullsized': '2023-07-14T15:56:07.959093+0000', 'mapping_epoch': 23, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 23, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T15:56:14.384 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2023-07-14T15:56:14.384 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 22, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:56:06.939641+0000', 'last_change': '2023-07-14T15:56:06.939641+0000', 'last_active': '2023-07-14T15:56:06.930113+0000', 'last_peered': '2023-07-14T15:56:06.930113+0000', 'last_clean': '2023-07-14T15:56:06.930113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:06.939641+0000', 'last_undegraded': '2023-07-14T15:56:06.939641+0000', 'last_fullsized': '2023-07-14T15:56:06.939641+0000', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:06.930113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:06.930113+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:06.930113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T15:56:14.384 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2023-07-14T15:56:14.385 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T15:56:07.936740+0000', 'last_change': '2023-07-14T15:56:07.936740+0000', 'last_active': '2023-07-14T15:56:07.936740+0000', 'last_peered': '2023-07-14T15:56:07.936740+0000', 'last_clean': '2023-07-14T15:56:07.936740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:07.936740+0000', 'last_undegraded': '2023-07-14T15:56:07.936740+0000', 'last_fullsized': '2023-07-14T15:56:07.936740+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T15:56:14.385 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2023-07-14T15:56:14.385 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T15:56:07.936740+0000', 'last_change': '2023-07-14T15:56:07.936740+0000', 'last_active': '2023-07-14T15:56:07.936740+0000', 'last_peered': '2023-07-14T15:56:07.936740+0000', 'last_clean': '2023-07-14T15:56:07.936740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:07.936740+0000', 'last_undegraded': '2023-07-14T15:56:07.936740+0000', 'last_fullsized': '2023-07-14T15:56:07.936740+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T15:56:14.385 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2023-07-14T15:56:14.386 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T15:56:07.936740+0000', 'last_change': '2023-07-14T15:56:07.936740+0000', 'last_active': '2023-07-14T15:56:07.936740+0000', 'last_peered': '2023-07-14T15:56:07.936740+0000', 'last_clean': '2023-07-14T15:56:07.936740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:07.936740+0000', 'last_undegraded': '2023-07-14T15:56:07.936740+0000', 'last_fullsized': '2023-07-14T15:56:07.936740+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T15:56:14.386 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2023-07-14T15:56:14.386 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 23, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:56:07.951094+0000', 'last_change': '2023-07-14T15:56:07.951094+0000', 'last_active': '2023-07-14T15:56:07.936740+0000', 'last_peered': '2023-07-14T15:56:07.936740+0000', 'last_clean': '2023-07-14T15:56:07.936740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:07.951094+0000', 'last_undegraded': '2023-07-14T15:56:07.951094+0000', 'last_fullsized': '2023-07-14T15:56:07.951094+0000', 'mapping_epoch': 23, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 23, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T15:56:14.387 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2023-07-14T15:56:14.387 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 23, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:56:07.961503+0000', 'last_change': '2023-07-14T15:56:07.961503+0000', 'last_active': '2023-07-14T15:56:07.936740+0000', 'last_peered': '2023-07-14T15:56:07.936740+0000', 'last_clean': '2023-07-14T15:56:07.936740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:07.961503+0000', 'last_undegraded': '2023-07-14T15:56:07.961503+0000', 'last_fullsized': '2023-07-14T15:56:07.961503+0000', 'mapping_epoch': 23, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 23, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T15:56:14.387 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2023-07-14T15:56:14.387 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T15:56:07.936740+0000', 'last_change': '2023-07-14T15:56:07.936740+0000', 'last_active': '2023-07-14T15:56:07.936740+0000', 'last_peered': '2023-07-14T15:56:07.936740+0000', 'last_clean': '2023-07-14T15:56:07.936740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:07.936740+0000', 'last_undegraded': '2023-07-14T15:56:07.936740+0000', 'last_fullsized': '2023-07-14T15:56:07.936740+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T15:56:14.388 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2023-07-14T15:56:14.388 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T15:56:07.936740+0000', 'last_change': '2023-07-14T15:56:07.936740+0000', 'last_active': '2023-07-14T15:56:07.936740+0000', 'last_peered': '2023-07-14T15:56:07.936740+0000', 'last_clean': '2023-07-14T15:56:07.936740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:07.936740+0000', 'last_undegraded': '2023-07-14T15:56:07.936740+0000', 'last_fullsized': '2023-07-14T15:56:07.936740+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T15:56:14.388 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2023-07-14T15:56:14.388 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 23, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:56:07.955562+0000', 'last_change': '2023-07-14T15:56:07.955562+0000', 'last_active': '2023-07-14T15:56:07.936740+0000', 'last_peered': '2023-07-14T15:56:07.936740+0000', 'last_clean': '2023-07-14T15:56:07.936740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:07.955562+0000', 'last_undegraded': '2023-07-14T15:56:07.955562+0000', 'last_fullsized': '2023-07-14T15:56:07.955562+0000', 'mapping_epoch': 23, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 23, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T15:56:14.389 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2023-07-14T15:56:14.389 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 23, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:56:07.950885+0000', 'last_change': '2023-07-14T15:56:07.950885+0000', 'last_active': '2023-07-14T15:56:07.936740+0000', 'last_peered': '2023-07-14T15:56:07.936740+0000', 'last_clean': '2023-07-14T15:56:07.936740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:07.950885+0000', 'last_undegraded': '2023-07-14T15:56:07.950885+0000', 'last_fullsized': '2023-07-14T15:56:07.950885+0000', 'mapping_epoch': 23, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 23, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T15:56:14.389 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2023-07-14T15:56:14.389 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T15:56:07.936740+0000', 'last_change': '2023-07-14T15:56:07.936740+0000', 'last_active': '2023-07-14T15:56:07.936740+0000', 'last_peered': '2023-07-14T15:56:07.936740+0000', 'last_clean': '2023-07-14T15:56:07.936740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:07.936740+0000', 'last_undegraded': '2023-07-14T15:56:07.936740+0000', 'last_fullsized': '2023-07-14T15:56:07.936740+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T15:56:14.390 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2023-07-14T15:56:14.390 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 22, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:56:06.942568+0000', 'last_change': '2023-07-14T15:56:06.942568+0000', 'last_active': '2023-07-14T15:56:06.930113+0000', 'last_peered': '2023-07-14T15:56:06.930113+0000', 'last_clean': '2023-07-14T15:56:06.930113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:06.942568+0000', 'last_undegraded': '2023-07-14T15:56:06.942568+0000', 'last_fullsized': '2023-07-14T15:56:06.942568+0000', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:06.930113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:06.930113+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:06.930113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T15:56:14.390 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2023-07-14T15:56:14.390 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 23, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:56:07.961029+0000', 'last_change': '2023-07-14T15:56:07.961029+0000', 'last_active': '2023-07-14T15:56:07.936740+0000', 'last_peered': '2023-07-14T15:56:07.936740+0000', 'last_clean': '2023-07-14T15:56:07.936740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:07.961029+0000', 'last_undegraded': '2023-07-14T15:56:07.961029+0000', 'last_fullsized': '2023-07-14T15:56:07.961029+0000', 'mapping_epoch': 23, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 23, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T15:56:14.391 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2023-07-14T15:56:14.391 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 23, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:56:07.954093+0000', 'last_change': '2023-07-14T15:56:07.954093+0000', 'last_active': '2023-07-14T15:56:07.936740+0000', 'last_peered': '2023-07-14T15:56:07.936740+0000', 'last_clean': '2023-07-14T15:56:07.936740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:07.954093+0000', 'last_undegraded': '2023-07-14T15:56:07.954093+0000', 'last_fullsized': '2023-07-14T15:56:07.954093+0000', 'mapping_epoch': 23, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 23, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T15:56:14.391 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2023-07-14T15:56:14.391 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 22, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:56:06.944913+0000', 'last_change': '2023-07-14T15:56:06.944913+0000', 'last_active': '2023-07-14T15:56:06.930113+0000', 'last_peered': '2023-07-14T15:56:06.930113+0000', 'last_clean': '2023-07-14T15:56:06.930113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:06.944913+0000', 'last_undegraded': '2023-07-14T15:56:06.944913+0000', 'last_fullsized': '2023-07-14T15:56:06.944913+0000', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:06.930113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:06.930113+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:06.930113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T15:56:14.392 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2023-07-14T15:56:14.392 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T15:56:07.936740+0000', 'last_change': '2023-07-14T15:56:07.936740+0000', 'last_active': '2023-07-14T15:56:07.936740+0000', 'last_peered': '2023-07-14T15:56:07.936740+0000', 'last_clean': '2023-07-14T15:56:07.936740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:07.936740+0000', 'last_undegraded': '2023-07-14T15:56:07.936740+0000', 'last_fullsized': '2023-07-14T15:56:07.936740+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T15:56:14.392 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2023-07-14T15:56:14.393 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 22, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:56:06.939541+0000', 'last_change': '2023-07-14T15:56:06.939541+0000', 'last_active': '2023-07-14T15:56:06.930113+0000', 'last_peered': '2023-07-14T15:56:06.930113+0000', 'last_clean': '2023-07-14T15:56:06.930113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:06.939541+0000', 'last_undegraded': '2023-07-14T15:56:06.939541+0000', 'last_fullsized': '2023-07-14T15:56:06.939541+0000', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:06.930113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:06.930113+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:06.930113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T15:56:14.393 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2023-07-14T15:56:14.393 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 22, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:56:06.943708+0000', 'last_change': '2023-07-14T15:56:06.943708+0000', 'last_active': '2023-07-14T15:56:06.930113+0000', 'last_peered': '2023-07-14T15:56:06.930113+0000', 'last_clean': '2023-07-14T15:56:06.930113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:06.943708+0000', 'last_undegraded': '2023-07-14T15:56:06.943708+0000', 'last_fullsized': '2023-07-14T15:56:06.943708+0000', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:06.930113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:06.930113+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:06.930113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T15:56:14.393 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2023-07-14T15:56:14.394 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 23, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:56:07.960438+0000', 'last_change': '2023-07-14T15:56:07.960438+0000', 'last_active': '2023-07-14T15:56:07.936740+0000', 'last_peered': '2023-07-14T15:56:07.936740+0000', 'last_clean': '2023-07-14T15:56:07.936740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:07.960438+0000', 'last_undegraded': '2023-07-14T15:56:07.960438+0000', 'last_fullsized': '2023-07-14T15:56:07.960438+0000', 'mapping_epoch': 23, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 23, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T15:56:14.394 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2023-07-14T15:56:14.394 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T15:56:07.936740+0000', 'last_change': '2023-07-14T15:56:07.936740+0000', 'last_active': '2023-07-14T15:56:07.936740+0000', 'last_peered': '2023-07-14T15:56:07.936740+0000', 'last_clean': '2023-07-14T15:56:07.936740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:07.936740+0000', 'last_undegraded': '2023-07-14T15:56:07.936740+0000', 'last_fullsized': '2023-07-14T15:56:07.936740+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T15:56:14.394 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2023-07-14T15:56:14.395 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 22, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:56:06.945529+0000', 'last_change': '2023-07-14T15:56:06.945529+0000', 'last_active': '2023-07-14T15:56:06.930113+0000', 'last_peered': '2023-07-14T15:56:06.930113+0000', 'last_clean': '2023-07-14T15:56:06.930113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:06.945529+0000', 'last_undegraded': '2023-07-14T15:56:06.945529+0000', 'last_fullsized': '2023-07-14T15:56:06.945529+0000', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:06.930113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:06.930113+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:06.930113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T15:56:14.395 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2023-07-14T15:56:14.395 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T15:56:07.936740+0000', 'last_change': '2023-07-14T15:56:07.936740+0000', 'last_active': '2023-07-14T15:56:07.936740+0000', 'last_peered': '2023-07-14T15:56:07.936740+0000', 'last_clean': '2023-07-14T15:56:07.936740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:07.936740+0000', 'last_undegraded': '2023-07-14T15:56:07.936740+0000', 'last_fullsized': '2023-07-14T15:56:07.936740+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T15:56:14.395 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2023-07-14T15:56:14.396 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 22, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:56:06.945247+0000', 'last_change': '2023-07-14T15:56:06.945247+0000', 'last_active': '2023-07-14T15:56:06.930113+0000', 'last_peered': '2023-07-14T15:56:06.930113+0000', 'last_clean': '2023-07-14T15:56:06.930113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:06.945247+0000', 'last_undegraded': '2023-07-14T15:56:06.945247+0000', 'last_fullsized': '2023-07-14T15:56:06.945247+0000', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:06.930113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:06.930113+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:06.930113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T15:56:14.396 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2023-07-14T15:56:14.396 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 23, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:56:07.949736+0000', 'last_change': '2023-07-14T15:56:07.949736+0000', 'last_active': '2023-07-14T15:56:07.936740+0000', 'last_peered': '2023-07-14T15:56:07.936740+0000', 'last_clean': '2023-07-14T15:56:07.936740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:07.949736+0000', 'last_undegraded': '2023-07-14T15:56:07.949736+0000', 'last_fullsized': '2023-07-14T15:56:07.949736+0000', 'mapping_epoch': 23, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 23, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T15:56:14.396 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2023-07-14T15:56:14.397 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 22, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:56:06.945000+0000', 'last_change': '2023-07-14T15:56:06.945000+0000', 'last_active': '2023-07-14T15:56:06.930113+0000', 'last_peered': '2023-07-14T15:56:06.930113+0000', 'last_clean': '2023-07-14T15:56:06.930113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:06.945000+0000', 'last_undegraded': '2023-07-14T15:56:06.945000+0000', 'last_fullsized': '2023-07-14T15:56:06.945000+0000', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:06.930113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:06.930113+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:06.930113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T15:56:14.397 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2023-07-14T15:56:14.397 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T15:56:07.936740+0000', 'last_change': '2023-07-14T15:56:07.936740+0000', 'last_active': '2023-07-14T15:56:07.936740+0000', 'last_peered': '2023-07-14T15:56:07.936740+0000', 'last_clean': '2023-07-14T15:56:07.936740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:07.936740+0000', 'last_undegraded': '2023-07-14T15:56:07.936740+0000', 'last_fullsized': '2023-07-14T15:56:07.936740+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T15:56:14.398 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2023-07-14T15:56:14.398 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 23, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:56:07.951717+0000', 'last_change': '2023-07-14T15:56:07.951717+0000', 'last_active': '2023-07-14T15:56:07.936740+0000', 'last_peered': '2023-07-14T15:56:07.936740+0000', 'last_clean': '2023-07-14T15:56:07.936740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:07.951717+0000', 'last_undegraded': '2023-07-14T15:56:07.951717+0000', 'last_fullsized': '2023-07-14T15:56:07.951717+0000', 'mapping_epoch': 23, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 23, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T15:56:14.398 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2023-07-14T15:56:14.398 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 23, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:56:07.955961+0000', 'last_change': '2023-07-14T15:56:07.955961+0000', 'last_active': '2023-07-14T15:56:07.936740+0000', 'last_peered': '2023-07-14T15:56:07.936740+0000', 'last_clean': '2023-07-14T15:56:07.936740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:07.955961+0000', 'last_undegraded': '2023-07-14T15:56:07.955961+0000', 'last_fullsized': '2023-07-14T15:56:07.955961+0000', 'mapping_epoch': 23, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 23, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T15:56:14.399 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2023-07-14T15:56:14.399 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 22, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:56:06.939718+0000', 'last_change': '2023-07-14T15:56:06.939718+0000', 'last_active': '2023-07-14T15:56:06.930113+0000', 'last_peered': '2023-07-14T15:56:06.930113+0000', 'last_clean': '2023-07-14T15:56:06.930113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:06.939718+0000', 'last_undegraded': '2023-07-14T15:56:06.939718+0000', 'last_fullsized': '2023-07-14T15:56:06.939718+0000', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:06.930113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:06.930113+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:06.930113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T15:56:14.399 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2023-07-14T15:56:14.399 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T15:56:07.936740+0000', 'last_change': '2023-07-14T15:56:07.936740+0000', 'last_active': '2023-07-14T15:56:07.936740+0000', 'last_peered': '2023-07-14T15:56:07.936740+0000', 'last_clean': '2023-07-14T15:56:07.936740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:07.936740+0000', 'last_undegraded': '2023-07-14T15:56:07.936740+0000', 'last_fullsized': '2023-07-14T15:56:07.936740+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T15:56:14.400 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2023-07-14T15:56:14.400 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 22, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:56:06.940302+0000', 'last_change': '2023-07-14T15:56:06.940302+0000', 'last_active': '2023-07-14T15:56:06.930113+0000', 'last_peered': '2023-07-14T15:56:06.930113+0000', 'last_clean': '2023-07-14T15:56:06.930113+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:06.940302+0000', 'last_undegraded': '2023-07-14T15:56:06.940302+0000', 'last_fullsized': '2023-07-14T15:56:06.940302+0000', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:06.930113+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:06.930113+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:06.930113+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T15:56:14.400 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2023-07-14T15:56:14.400 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 23, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:56:07.949666+0000', 'last_change': '2023-07-14T15:56:07.949666+0000', 'last_active': '2023-07-14T15:56:07.936740+0000', 'last_peered': '2023-07-14T15:56:07.936740+0000', 'last_clean': '2023-07-14T15:56:07.936740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:07.949666+0000', 'last_undegraded': '2023-07-14T15:56:07.949666+0000', 'last_fullsized': '2023-07-14T15:56:07.949666+0000', 'mapping_epoch': 23, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 23, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T15:56:14.401 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.23 is not active+clean 2023-07-14T15:56:14.401 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T15:56:07.936740+0000', 'last_change': '2023-07-14T15:56:07.936740+0000', 'last_active': '2023-07-14T15:56:07.936740+0000', 'last_peered': '2023-07-14T15:56:07.936740+0000', 'last_clean': '2023-07-14T15:56:07.936740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:07.936740+0000', 'last_undegraded': '2023-07-14T15:56:07.936740+0000', 'last_fullsized': '2023-07-14T15:56:07.936740+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T15:56:14.401 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.24 is not active+clean 2023-07-14T15:56:14.401 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T15:56:07.936740+0000', 'last_change': '2023-07-14T15:56:07.936740+0000', 'last_active': '2023-07-14T15:56:07.936740+0000', 'last_peered': '2023-07-14T15:56:07.936740+0000', 'last_clean': '2023-07-14T15:56:07.936740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:56:07.936740+0000', 'last_undegraded': '2023-07-14T15:56:07.936740+0000', 'last_fullsized': '2023-07-14T15:56:07.936740+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'last_clean_scrub_stamp': '2023-07-14T15:56:07.936740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T15:56:14.402 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-14T15:56:14.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.620+0000 7f8c30fff700 1 Processor -- start 2023-07-14T15:56:14.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.620+0000 7f8c30fff700 1 -- start start 2023-07-14T15:56:14.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.621+0000 7f8c30fff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f8c2c0b54b0 0x7f8c2c0cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:14.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.622+0000 7f8c30fff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c2c0cf6b0 con 0x7f8c2c0b85f0 2023-07-14T15:56:14.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.622+0000 7f8c30fff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c2c0cdc40 con 0x7f8c2c0b4910 2023-07-14T15:56:14.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.622+0000 7f8c30fff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c0cf0a0 con 0x7f8c2c0b54b0 2023-07-14T15:56:14.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.622+0000 7f8c2a59c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8c2c0b85f0 0x7f8c2c15d660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36772/0 (socket says 172.21.15.37:36772) 2023-07-14T15:56:14.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.622+0000 7f8c2a59c700 1 -- 172.21.15.37:0/1685537050 learned_addr learned my addr 172.21.15.37:0/1685537050 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:14.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.622+0000 7f8c29d9b700 1 --2- 172.21.15.37:0/1685537050 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f8c2c0b54b0 0x7f8c2c0cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:14.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.622+0000 7f8c2959a700 1 -- 172.21.15.37:0/1685537050 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 266426137 0 0) 0x7f8c2c0cf6b0 con 0x7f8c2c0b85f0 2023-07-14T15:56:14.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.622+0000 7f8c2959a700 1 -- 172.21.15.37:0/1685537050 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c140035b0 con 0x7f8c2c0b85f0 2023-07-14T15:56:14.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.622+0000 7f8c2959a700 1 -- 172.21.15.37:0/1685537050 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 742239526 0 0) 0x7f8c2c0cdc40 con 0x7f8c2c0b4910 2023-07-14T15:56:14.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.622+0000 7f8c2959a700 1 -- 172.21.15.37:0/1685537050 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c2c0cf6b0 con 0x7f8c2c0b4910 2023-07-14T15:56:14.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.622+0000 7f8c29d9b700 1 -- 172.21.15.37:0/1685537050 >> v1:172.21.15.98:6789/0 conn(0x7f8c2c0b4910 legacy=0x7f8c2c15dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:14.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.623+0000 7f8c29d9b700 1 -- 172.21.15.37:0/1685537050 >> v1:172.21.15.37:6789/0 conn(0x7f8c2c0b85f0 legacy=0x7f8c2c15d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:14.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.623+0000 7f8c29d9b700 1 -- 172.21.15.37:0/1685537050 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c2c0b89c0 con 0x7f8c2c0b54b0 2023-07-14T15:56:14.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.623+0000 7f8c29d9b700 1 --2- 172.21.15.37:0/1685537050 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f8c2c0b54b0 0x7f8c2c0cfb40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8c20009870 tx=0x7f8c20009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c17797521f040aa4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:14.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.623+0000 7f8c2959a700 1 -- 172.21.15.37:0/1685537050 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c20011830 con 0x7f8c2c0b54b0 2023-07-14T15:56:14.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.623+0000 7f8c2959a700 1 -- 172.21.15.37:0/1685537050 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c20011990 con 0x7f8c2c0b54b0 2023-07-14T15:56:14.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.623+0000 7f8c2959a700 1 -- 172.21.15.37:0/1685537050 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c20011d00 con 0x7f8c2c0b54b0 2023-07-14T15:56:14.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.624+0000 7f8c30fff700 1 -- 172.21.15.37:0/1685537050 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f8c2c0b54b0 msgr2=0x7f8c2c0cfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:14.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.624+0000 7f8c30fff700 1 --2- 172.21.15.37:0/1685537050 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f8c2c0b54b0 0x7f8c2c0cfb40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8c20009870 tx=0x7f8c20009b80 comp rx=0 tx=0).stop 2023-07-14T15:56:14.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.624+0000 7f8c30fff700 1 -- 172.21.15.37:0/1685537050 shutdown_connections 2023-07-14T15:56:14.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.624+0000 7f8c30fff700 1 --2- 172.21.15.37:0/1685537050 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f8c2c0b54b0 0x7f8c2c0cfb40 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:14.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.624+0000 7f8c30fff700 1 -- 172.21.15.37:0/1685537050 >> 172.21.15.37:0/1685537050 conn(0x7f8c2c06a580 msgr2=0x7f8c2c06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:14.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.624+0000 7f8c30fff700 1 -- 172.21.15.37:0/1685537050 shutdown_connections 2023-07-14T15:56:14.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.624+0000 7f8c30fff700 1 -- 172.21.15.37:0/1685537050 wait complete. 2023-07-14T15:56:14.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.626+0000 7f8c30fff700 1 Processor -- start 2023-07-14T15:56:14.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.626+0000 7f8c30fff700 1 -- start start 2023-07-14T15:56:14.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.627+0000 7f8c30fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c2c0b4910 0x7f8c2c14d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:14.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.627+0000 7f8c30fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c2c0b54b0 0x7f8c2c0cbc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:14.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.627+0000 7f8c30fff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f8c2c0b85f0 0x7f8c2c15f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:14.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.627+0000 7f8c30fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c14d810 con 0x7f8c2c0b4910 2023-07-14T15:56:14.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.627+0000 7f8c30fff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c0cab80 con 0x7f8c2c0b54b0 2023-07-14T15:56:14.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.627+0000 7f8c30fff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c0cae60 con 0x7f8c2c0b85f0 2023-07-14T15:56:14.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.627+0000 7f8c2a59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c2c0b4910 0x7f8c2c14d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:14.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.627+0000 7f8c2a59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c2c0b4910 0x7f8c2c14d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60464/0 (socket says 172.21.15.37:60464) 2023-07-14T15:56:14.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.627+0000 7f8c2a59c700 1 -- 172.21.15.37:0/2632181853 learned_addr learned my addr 172.21.15.37:0/2632181853 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:14.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.627+0000 7f8c2a59c700 1 -- 172.21.15.37:0/2632181853 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f8c2c0b85f0 msgr2=0x7f8c2c15f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:14.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.627+0000 7f8c29d9b700 1 --2- 172.21.15.37:0/2632181853 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c2c0b54b0 0x7f8c2c0cbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:14.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.627+0000 7f8c2ad9d700 1 --2- 172.21.15.37:0/2632181853 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f8c2c0b85f0 0x7f8c2c15f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:14.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.628+0000 7f8c2a59c700 1 --2- 172.21.15.37:0/2632181853 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f8c2c0b85f0 0x7f8c2c15f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:14.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.628+0000 7f8c2a59c700 1 -- 172.21.15.37:0/2632181853 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c2c0b54b0 msgr2=0x7f8c2c0cbc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:14.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.628+0000 7f8c2a59c700 1 --2- 172.21.15.37:0/2632181853 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c2c0b54b0 0x7f8c2c0cbc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:14.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.628+0000 7f8c2a59c700 1 -- 172.21.15.37:0/2632181853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c200094a0 con 0x7f8c2c0b4910 2023-07-14T15:56:14.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.628+0000 7f8c29d9b700 1 --2- 172.21.15.37:0/2632181853 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c2c0b54b0 0x7f8c2c0cbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:56:14.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.628+0000 7f8c2ad9d700 1 --2- 172.21.15.37:0/2632181853 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f8c2c0b85f0 0x7f8c2c15f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:56:14.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.628+0000 7f8c2a59c700 1 --2- 172.21.15.37:0/2632181853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c2c0b4910 0x7f8c2c14d2d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c00c4d0 tx=0x7f8c1c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:14.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.628+0000 7f8c1affd700 1 -- 172.21.15.37:0/2632181853 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c005d70 con 0x7f8c2c0b4910 2023-07-14T15:56:14.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.628+0000 7f8c1affd700 1 -- 172.21.15.37:0/2632181853 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1c0070d0 con 0x7f8c2c0b4910 2023-07-14T15:56:14.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.628+0000 7f8c1affd700 1 -- 172.21.15.37:0/2632181853 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c007480 con 0x7f8c2c0b4910 2023-07-14T15:56:14.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.628+0000 7f8c30fff700 1 -- 172.21.15.37:0/2632181853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c2c0cb140 con 0x7f8c2c0b4910 2023-07-14T15:56:14.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.628+0000 7f8c30fff700 1 -- 172.21.15.37:0/2632181853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c2c0cb700 con 0x7f8c2c0b4910 2023-07-14T15:56:14.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.629+0000 7f8c30fff700 1 -- 172.21.15.37:0/2632181853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c2c067840 con 0x7f8c2c0b4910 2023-07-14T15:56:14.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.630+0000 7f8c1affd700 1 -- 172.21.15.37:0/2632181853 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8c1c0075e0 con 0x7f8c2c0b4910 2023-07-14T15:56:14.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.631+0000 7f8c1affd700 1 --2- 172.21.15.37:0/2632181853 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f8c0c06ace0 0x7f8c0c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:14.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.631+0000 7f8c1affd700 1 -- 172.21.15.37:0/2632181853 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8c1c088b10 con 0x7f8c2c0b4910 2023-07-14T15:56:14.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.632+0000 7f8c29d9b700 1 --2- 172.21.15.37:0/2632181853 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f8c0c06ace0 0x7f8c0c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:14.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.632+0000 7f8c29d9b700 1 --2- 172.21.15.37:0/2632181853 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f8c0c06ace0 0x7f8c0c06d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8c200097c0 tx=0x7f8c20008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:14.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.636+0000 7f8c1affd700 1 -- 172.21.15.37:0/2632181853 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8c1c053b20 con 0x7f8c2c0b4910 2023-07-14T15:56:14.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.931+0000 7f8c30fff700 1 -- 172.21.15.37:0/2632181853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f8c2c06b440 con 0x7f8c2c0b4910 2023-07-14T15:56:14.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.931+0000 7f8c1affd700 1 -- 172.21.15.37:0/2632181853 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1171 (secure 0 0 0) 0x7f8c1c057140 con 0x7f8c2c0b4910 2023-07-14T15:56:14.919 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:56:14.919 INFO:teuthology.orchestra.run.smithi037.stdout:{"fsid":"9da30401-a779-4e46-aba6-00c2494c6c67","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":35,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":25,"num_osds":8,"num_up_osds":8,"osd_up_since":1689350153,"num_in_osds":8,"osd_in_since":1689350143,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":51},{"state_name":"creating+peering","count":29},{"state_name":"unknown","count":25}],"num_pgs":105,"num_pools":4,"num_objects":10,"data_bytes":590480,"bytes_used":223817728,"bytes_avail":772870295552,"bytes_total":773094113280,"unknown_pgs_ratio":0.2380952388048172,"inactive_pgs_ratio":0.27619048953056335,"write_bytes_sec":346,"read_op_per_sec":0,"write_op_per_sec":3},"fsmap":{"epoch":7,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"d","status":"up:active","gid":4327}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-07-14T15:55:39.900079+0000","services":{}},"progress_events":{}} 2023-07-14T15:56:14.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.934+0000 7f8c30fff700 1 -- 172.21.15.37:0/2632181853 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f8c0c06ace0 msgr2=0x7f8c0c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:14.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.934+0000 7f8c30fff700 1 --2- 172.21.15.37:0/2632181853 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f8c0c06ace0 0x7f8c0c06d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8c200097c0 tx=0x7f8c20008030 comp rx=0 tx=0).stop 2023-07-14T15:56:14.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.934+0000 7f8c30fff700 1 -- 172.21.15.37:0/2632181853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c2c0b4910 msgr2=0x7f8c2c14d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:14.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.934+0000 7f8c30fff700 1 --2- 172.21.15.37:0/2632181853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c2c0b4910 0x7f8c2c14d2d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c00c4d0 tx=0x7f8c1c00c890 comp rx=0 tx=0).stop 2023-07-14T15:56:14.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.934+0000 7f8c30fff700 1 -- 172.21.15.37:0/2632181853 shutdown_connections 2023-07-14T15:56:14.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.934+0000 7f8c30fff700 1 --2- 172.21.15.37:0/2632181853 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f8c0c06ace0 0x7f8c0c06d190 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:14.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.934+0000 7f8c30fff700 1 --2- 172.21.15.37:0/2632181853 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f8c2c0b85f0 0x7f8c2c15f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:14.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.934+0000 7f8c30fff700 1 --2- 172.21.15.37:0/2632181853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c2c0b4910 0x7f8c2c14d2d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:14.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.934+0000 7f8c30fff700 1 --2- 172.21.15.37:0/2632181853 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c2c0b54b0 0x7f8c2c0cbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:14.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.934+0000 7f8c30fff700 1 -- 172.21.15.37:0/2632181853 >> 172.21.15.37:0/2632181853 conn(0x7f8c2c06a580 msgr2=0x7f8c2c0c6980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:14.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.934+0000 7f8c30fff700 1 -- 172.21.15.37:0/2632181853 shutdown_connections 2023-07-14T15:56:14.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:14.934+0000 7f8c30fff700 1 -- 172.21.15.37:0/2632181853 wait complete. 2023-07-14T15:56:14.939 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-14T15:56:14.940 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T15:56:15.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.154+0000 7f4f297ff700 1 Processor -- start 2023-07-14T15:56:15.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.154+0000 7f4f297ff700 1 -- start start 2023-07-14T15:56:15.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.156+0000 7f4f297ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f4f240b54b0 0x7f4f240cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:15.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.156+0000 7f4f297ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4f240b4910 0x7f4f240b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:15.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.156+0000 7f4f297ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f240b52b0 con 0x7f4f240b85f0 2023-07-14T15:56:15.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.156+0000 7f4f297ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f240cf6b0 con 0x7f4f240b54b0 2023-07-14T15:56:15.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.156+0000 7f4f297ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f240cdc40 con 0x7f4f240b4910 2023-07-14T15:56:15.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.156+0000 7f4f22ffd700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4f240b85f0 0x7f4f2415d660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36788/0 (socket says 172.21.15.37:36788) 2023-07-14T15:56:15.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.156+0000 7f4f22ffd700 1 -- 172.21.15.37:0/2287278458 learned_addr learned my addr 172.21.15.37:0/2287278458 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:15.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.156+0000 7f4f1bfff700 1 --2- 172.21.15.37:0/2287278458 >> v2:172.21.15.98:3300/0 conn(0x7f4f240b54b0 0x7f4f240cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:15.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.156+0000 7f4f237fe700 1 --2- 172.21.15.37:0/2287278458 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4f240b4910 0x7f4f240b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:15.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.156+0000 7f4f227fc700 1 -- 172.21.15.37:0/2287278458 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2525959394 0 0) 0x7f4f240b52b0 con 0x7f4f240b85f0 2023-07-14T15:56:15.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.156+0000 7f4f227fc700 1 -- 172.21.15.37:0/2287278458 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f100035b0 con 0x7f4f240b85f0 2023-07-14T15:56:15.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.157+0000 7f4f227fc700 1 -- 172.21.15.37:0/2287278458 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1509320395 0 0) 0x7f4f100035b0 con 0x7f4f240b85f0 2023-07-14T15:56:15.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.157+0000 7f4f227fc700 1 -- 172.21.15.37:0/2287278458 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4f240b4910 msgr2=0x7f4f240b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:15.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.157+0000 7f4f227fc700 1 --2- 172.21.15.37:0/2287278458 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4f240b4910 0x7f4f240b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:15.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.157+0000 7f4f227fc700 1 -- 172.21.15.37:0/2287278458 >> v2:172.21.15.98:3300/0 conn(0x7f4f240b54b0 msgr2=0x7f4f240cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:15.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.157+0000 7f4f227fc700 1 --2- 172.21.15.37:0/2287278458 >> v2:172.21.15.98:3300/0 conn(0x7f4f240b54b0 0x7f4f240cfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:15.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.157+0000 7f4f227fc700 1 -- 172.21.15.37:0/2287278458 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f240cf0a0 con 0x7f4f240b85f0 2023-07-14T15:56:15.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.157+0000 7f4f227fc700 1 -- 172.21.15.37:0/2287278458 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48633207 0 0) 0x7f4f14001670 con 0x7f4f240b85f0 2023-07-14T15:56:15.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.157+0000 7f4f227fc700 1 -- 172.21.15.37:0/2287278458 >> v1:172.21.15.37:6789/0 conn(0x7f4f240b85f0 legacy=0x7f4f2415d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:15.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.157+0000 7f4f227fc700 1 --2- 172.21.15.37:0/2287278458 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4f240b4910 0x7f4f10003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:15.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.157+0000 7f4f227fc700 1 --2- 172.21.15.37:0/2287278458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f10003f80 0x7f4f10004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:15.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.157+0000 7f4f227fc700 1 --2- 172.21.15.37:0/2287278458 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f10004d90 0x7f4f10005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:15.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.157+0000 7f4f227fc700 1 -- 172.21.15.37:0/2287278458 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f240cf6b0 con 0x7f4f10003f80 2023-07-14T15:56:15.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.157+0000 7f4f227fc700 1 -- 172.21.15.37:0/2287278458 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f240cdc40 con 0x7f4f10004d90 2023-07-14T15:56:15.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.157+0000 7f4f227fc700 1 -- 172.21.15.37:0/2287278458 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1000ba40 con 0x7f4f240b4910 2023-07-14T15:56:15.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.157+0000 7f4f1bfff700 1 --2- 172.21.15.37:0/2287278458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f10003f80 0x7f4f10004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:15.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.157+0000 7f4f22ffd700 1 --2- 172.21.15.37:0/2287278458 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4f240b4910 0x7f4f10003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:15.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.157+0000 7f4f237fe700 1 --2- 172.21.15.37:0/2287278458 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f10004d90 0x7f4f10005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:15.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.157+0000 7f4f1bfff700 1 -- 172.21.15.37:0/2287278458 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4f240b4910 msgr2=0x7f4f10003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:15.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.157+0000 7f4f1bfff700 1 --2- 172.21.15.37:0/2287278458 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4f240b4910 0x7f4f10003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:15.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.157+0000 7f4f1bfff700 1 -- 172.21.15.37:0/2287278458 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f10004d90 msgr2=0x7f4f10005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:15.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.157+0000 7f4f1bfff700 1 --2- 172.21.15.37:0/2287278458 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f10004d90 0x7f4f10005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:15.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.157+0000 7f4f1bfff700 1 -- 172.21.15.37:0/2287278458 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f100035b0 con 0x7f4f10003f80 2023-07-14T15:56:15.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.158+0000 7f4f1bfff700 1 --2- 172.21.15.37:0/2287278458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f10003f80 0x7f4f10004850 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c009b60 tx=0x7f4f10005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc6cd311a77b0e44 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:15.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.158+0000 7f4f227fc700 1 -- 172.21.15.37:0/2287278458 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c00e660 con 0x7f4f10003f80 2023-07-14T15:56:15.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.158+0000 7f4f227fc700 1 -- 172.21.15.37:0/2287278458 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f0c00e7c0 con 0x7f4f10003f80 2023-07-14T15:56:15.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.158+0000 7f4f227fc700 1 -- 172.21.15.37:0/2287278458 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c00eb30 con 0x7f4f10003f80 2023-07-14T15:56:15.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.158+0000 7f4f297ff700 1 -- 172.21.15.37:0/2287278458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f10003f80 msgr2=0x7f4f10004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:15.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.158+0000 7f4f297ff700 1 --2- 172.21.15.37:0/2287278458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f10003f80 0x7f4f10004850 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c009b60 tx=0x7f4f10005880 comp rx=0 tx=0).stop 2023-07-14T15:56:15.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.158+0000 7f4f237fe700 1 -- 172.21.15.37:0/2287278458 reap_dead start 2023-07-14T15:56:15.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.159+0000 7f4f297ff700 1 -- 172.21.15.37:0/2287278458 shutdown_connections 2023-07-14T15:56:15.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.159+0000 7f4f297ff700 1 -- 172.21.15.37:0/2287278458 >> 172.21.15.37:0/2287278458 conn(0x7f4f2406a580 msgr2=0x7f4f2406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:15.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.159+0000 7f4f297ff700 1 -- 172.21.15.37:0/2287278458 shutdown_connections 2023-07-14T15:56:15.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.159+0000 7f4f297ff700 1 -- 172.21.15.37:0/2287278458 wait complete. 2023-07-14T15:56:15.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.160+0000 7f4f297ff700 1 Processor -- start 2023-07-14T15:56:15.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.161+0000 7f4f297ff700 1 -- start start 2023-07-14T15:56:15.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.161+0000 7f4f297ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f10003f80 0x7f4f241f23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:15.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.161+0000 7f4f297ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4f2414d240 0x7f4f240b6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:15.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.161+0000 7f4f297ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f2414d6b0 0x7f4f240b7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:15.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.162+0000 7f4f297ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2415cd60 con 0x7f4f10003f80 2023-07-14T15:56:15.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.162+0000 7f4f297ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2415d040 con 0x7f4f2414d6b0 2023-07-14T15:56:15.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.162+0000 7f4f297ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2415d320 con 0x7f4f2414d240 2023-07-14T15:56:15.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.162+0000 7f4f22ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f10003f80 0x7f4f241f23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:15.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.162+0000 7f4f22ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f10003f80 0x7f4f241f23e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60486/0 (socket says 172.21.15.37:60486) 2023-07-14T15:56:15.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.162+0000 7f4f22ffd700 1 -- 172.21.15.37:0/1349423467 learned_addr learned my addr 172.21.15.37:0/1349423467 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:15.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.162+0000 7f4f1bfff700 1 --2- 172.21.15.37:0/1349423467 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4f2414d240 0x7f4f240b6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:15.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.162+0000 7f4f237fe700 1 --2- 172.21.15.37:0/1349423467 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f2414d6b0 0x7f4f240b7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:15.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.162+0000 7f4f22ffd700 1 -- 172.21.15.37:0/1349423467 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4f2414d240 msgr2=0x7f4f240b6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:15.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.162+0000 7f4f22ffd700 1 --2- 172.21.15.37:0/1349423467 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4f2414d240 0x7f4f240b6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:15.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.162+0000 7f4f22ffd700 1 -- 172.21.15.37:0/1349423467 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f2414d6b0 msgr2=0x7f4f240b7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:15.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.162+0000 7f4f22ffd700 1 --2- 172.21.15.37:0/1349423467 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f2414d6b0 0x7f4f240b7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:15.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.162+0000 7f4f22ffd700 1 -- 172.21.15.37:0/1349423467 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f2415d600 con 0x7f4f10003f80 2023-07-14T15:56:15.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.162+0000 7f4f237fe700 1 --2- 172.21.15.37:0/1349423467 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f2414d6b0 0x7f4f240b7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:56:15.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.162+0000 7f4f22ffd700 1 --2- 172.21.15.37:0/1349423467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f10003f80 0x7f4f241f23e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4f14007310 tx=0x7f4f14007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:15.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.163+0000 7f4f1b7fe700 1 -- 172.21.15.37:0/1349423467 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1400f5e0 con 0x7f4f10003f80 2023-07-14T15:56:15.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.163+0000 7f4f1b7fe700 1 -- 172.21.15.37:0/1349423467 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f1400f760 con 0x7f4f10003f80 2023-07-14T15:56:15.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.163+0000 7f4f1b7fe700 1 -- 172.21.15.37:0/1349423467 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1400fb10 con 0x7f4f10003f80 2023-07-14T15:56:15.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.163+0000 7f4f297ff700 1 -- 172.21.15.37:0/1349423467 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f2415d8e0 con 0x7f4f10003f80 2023-07-14T15:56:15.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.163+0000 7f4f297ff700 1 -- 172.21.15.37:0/1349423467 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f240c8970 con 0x7f4f10003f80 2023-07-14T15:56:15.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.164+0000 7f4f297ff700 1 -- 172.21.15.37:0/1349423467 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f24067840 con 0x7f4f10003f80 2023-07-14T15:56:15.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.165+0000 7f4f1b7fe700 1 -- 172.21.15.37:0/1349423467 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4f1400fc70 con 0x7f4f10003f80 2023-07-14T15:56:15.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.165+0000 7f4f1b7fe700 1 --2- 172.21.15.37:0/1349423467 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4f0406ace0 0x7f4f0406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:15.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.166+0000 7f4f1b7fe700 1 -- 172.21.15.37:0/1349423467 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4f140894b0 con 0x7f4f10003f80 2023-07-14T15:56:15.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.166+0000 7f4f1bfff700 1 --2- 172.21.15.37:0/1349423467 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4f0406ace0 0x7f4f0406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:15.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.166+0000 7f4f1bfff700 1 --2- 172.21.15.37:0/1349423467 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4f0406ace0 0x7f4f0406d190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c0090b0 tx=0x7f4f0c01f040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:15.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.170+0000 7f4f1b7fe700 1 -- 172.21.15.37:0/1349423467 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4f140544d0 con 0x7f4f10003f80 2023-07-14T15:56:15.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.374+0000 7f4f297ff700 1 -- 172.21.15.37:0/1349423467 --> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4f2415d1b0 con 0x7f4f0406ace0 2023-07-14T15:56:15.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.383+0000 7f4f1b7fe700 1 -- 172.21.15.37:0/1349423467 <== mgr.4100 v2:172.21.15.98:6832/3163748069 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286768 (secure 0 0 0) 0x7f4f2415d1b0 con 0x7f4f0406ace0 2023-07-14T15:56:15.375 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:56:15.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.387+0000 7f4f297ff700 1 -- 172.21.15.37:0/1349423467 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4f0406ace0 msgr2=0x7f4f0406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:15.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.387+0000 7f4f297ff700 1 --2- 172.21.15.37:0/1349423467 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4f0406ace0 0x7f4f0406d190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c0090b0 tx=0x7f4f0c01f040 comp rx=0 tx=0).stop 2023-07-14T15:56:15.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.387+0000 7f4f297ff700 1 -- 172.21.15.37:0/1349423467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f10003f80 msgr2=0x7f4f241f23e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:15.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.387+0000 7f4f297ff700 1 --2- 172.21.15.37:0/1349423467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f10003f80 0x7f4f241f23e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4f14007310 tx=0x7f4f14007620 comp rx=0 tx=0).stop 2023-07-14T15:56:15.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.387+0000 7f4f297ff700 1 -- 172.21.15.37:0/1349423467 shutdown_connections 2023-07-14T15:56:15.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.387+0000 7f4f297ff700 1 --2- 172.21.15.37:0/1349423467 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f2414d6b0 0x7f4f240b7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:15.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.387+0000 7f4f297ff700 1 --2- 172.21.15.37:0/1349423467 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4f0406ace0 0x7f4f0406d190 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:15.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.387+0000 7f4f297ff700 1 --2- 172.21.15.37:0/1349423467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f10003f80 0x7f4f241f23e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:15.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.387+0000 7f4f297ff700 1 --2- 172.21.15.37:0/1349423467 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4f2414d240 0x7f4f240b6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:15.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.388+0000 7f4f297ff700 1 -- 172.21.15.37:0/1349423467 >> 172.21.15.37:0/1349423467 conn(0x7f4f2406a580 msgr2=0x7f4f240d1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:15.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.388+0000 7f4f297ff700 1 -- 172.21.15.37:0/1349423467 shutdown_connections 2023-07-14T15:56:15.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:15.388+0000 7f4f297ff700 1 -- 172.21.15.37:0/1349423467 wait complete. 2023-07-14T15:56:15.379 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-14T15:56:15.392 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2023-07-14T15:56:14.855101+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":202,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218824,"kb_used_data":3208,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755896,"statfs":{"total":773094113280,"available":772870037504,"internally_reserved":0,"allocated":3284992,"data_stored":1946876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.908849"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969224+0000","last_change":"2023-07-14T15:56:08.983100+0000","last_active":"2023-07-14T15:56:09.969224+0000","last_peered":"2023-07-14T15:56:09.969224+0000","last_clean":"2023-07-14T15:56:09.969224+0000","last_became_active":"2023-07-14T15:56:08.982847+0000","last_became_peered":"2023-07-14T15:56:08.982847+0000","last_unstale":"2023-07-14T15:56:09.969224+0000","last_undegraded":"2023-07-14T15:56:09.969224+0000","last_fullsized":"2023-07-14T15:56:09.969224+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:52:49.596576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489972+0000","last_change":"2023-07-14T15:56:08.961552+0000","last_active":"2023-07-14T15:56:10.489972+0000","last_peered":"2023-07-14T15:56:10.489972+0000","last_clean":"2023-07-14T15:56:10.489972+0000","last_became_active":"2023-07-14T15:56:08.960866+0000","last_became_peered":"2023-07-14T15:56:08.960866+0000","last_unstale":"2023-07-14T15:56:10.489972+0000","last_undegraded":"2023-07-14T15:56:10.489972+0000","last_fullsized":"2023-07-14T15:56:10.489972+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:30:24.180248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968575+0000","last_change":"2023-07-14T15:56:08.984210+0000","last_active":"2023-07-14T15:56:09.968575+0000","last_peered":"2023-07-14T15:56:09.968575+0000","last_clean":"2023-07-14T15:56:09.968575+0000","last_became_active":"2023-07-14T15:56:08.983924+0000","last_became_peered":"2023-07-14T15:56:08.983924+0000","last_unstale":"2023-07-14T15:56:09.968575+0000","last_undegraded":"2023-07-14T15:56:09.968575+0000","last_fullsized":"2023-07-14T15:56:09.968575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:51:26.834028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968877+0000","last_change":"2023-07-14T15:56:08.968523+0000","last_active":"2023-07-14T15:56:09.968877+0000","last_peered":"2023-07-14T15:56:09.968877+0000","last_clean":"2023-07-14T15:56:09.968877+0000","last_became_active":"2023-07-14T15:56:08.968214+0000","last_became_peered":"2023-07-14T15:56:08.968214+0000","last_unstale":"2023-07-14T15:56:09.968877+0000","last_undegraded":"2023-07-14T15:56:09.968877+0000","last_fullsized":"2023-07-14T15:56:09.968877+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:28:16.724128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.317844+0000","last_change":"2023-07-14T15:56:08.960575+0000","last_active":"2023-07-14T15:56:10.317844+0000","last_peered":"2023-07-14T15:56:10.317844+0000","last_clean":"2023-07-14T15:56:10.317844+0000","last_became_active":"2023-07-14T15:56:08.959986+0000","last_became_peered":"2023-07-14T15:56:08.959986+0000","last_unstale":"2023-07-14T15:56:10.317844+0000","last_undegraded":"2023-07-14T15:56:10.317844+0000","last_fullsized":"2023-07-14T15:56:10.317844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:36:15.019527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968975+0000","last_change":"2023-07-14T15:56:08.970285+0000","last_active":"2023-07-14T15:56:09.968975+0000","last_peered":"2023-07-14T15:56:09.968975+0000","last_clean":"2023-07-14T15:56:09.968975+0000","last_became_active":"2023-07-14T15:56:08.969969+0000","last_became_peered":"2023-07-14T15:56:08.969969+0000","last_unstale":"2023-07-14T15:56:09.968975+0000","last_undegraded":"2023-07-14T15:56:09.968975+0000","last_fullsized":"2023-07-14T15:56:09.968975+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:04:03.590683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968616+0000","last_change":"2023-07-14T15:56:08.964590+0000","last_active":"2023-07-14T15:56:09.968616+0000","last_peered":"2023-07-14T15:56:09.968616+0000","last_clean":"2023-07-14T15:56:09.968616+0000","last_became_active":"2023-07-14T15:56:08.963896+0000","last_became_peered":"2023-07-14T15:56:08.963896+0000","last_unstale":"2023-07-14T15:56:09.968616+0000","last_undegraded":"2023-07-14T15:56:09.968616+0000","last_fullsized":"2023-07-14T15:56:09.968616+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:31:53.434325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489987+0000","last_change":"2023-07-14T15:56:08.963001+0000","last_active":"2023-07-14T15:56:10.489987+0000","last_peered":"2023-07-14T15:56:10.489987+0000","last_clean":"2023-07-14T15:56:10.489987+0000","last_became_active":"2023-07-14T15:56:08.962689+0000","last_became_peered":"2023-07-14T15:56:08.962689+0000","last_unstale":"2023-07-14T15:56:10.489987+0000","last_undegraded":"2023-07-14T15:56:10.489987+0000","last_fullsized":"2023-07-14T15:56:10.489987+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:54:19.293355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.318103+0000","last_change":"2023-07-14T15:56:08.982014+0000","last_active":"2023-07-14T15:56:10.318103+0000","last_peered":"2023-07-14T15:56:10.318103+0000","last_clean":"2023-07-14T15:56:10.318103+0000","last_became_active":"2023-07-14T15:56:08.981754+0000","last_became_peered":"2023-07-14T15:56:08.981754+0000","last_unstale":"2023-07-14T15:56:10.318103+0000","last_undegraded":"2023-07-14T15:56:10.318103+0000","last_fullsized":"2023-07-14T15:56:10.318103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:12:09.498134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489747+0000","last_change":"2023-07-14T15:56:08.974509+0000","last_active":"2023-07-14T15:56:10.489747+0000","last_peered":"2023-07-14T15:56:10.489747+0000","last_clean":"2023-07-14T15:56:10.489747+0000","last_became_active":"2023-07-14T15:56:08.974197+0000","last_became_peered":"2023-07-14T15:56:08.974197+0000","last_unstale":"2023-07-14T15:56:10.489747+0000","last_undegraded":"2023-07-14T15:56:10.489747+0000","last_fullsized":"2023-07-14T15:56:10.489747+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:59:57.661468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489832+0000","last_change":"2023-07-14T15:56:08.965378+0000","last_active":"2023-07-14T15:56:10.489832+0000","last_peered":"2023-07-14T15:56:10.489832+0000","last_clean":"2023-07-14T15:56:10.489832+0000","last_became_active":"2023-07-14T15:56:08.965029+0000","last_became_peered":"2023-07-14T15:56:08.965029+0000","last_unstale":"2023-07-14T15:56:10.489832+0000","last_undegraded":"2023-07-14T15:56:10.489832+0000","last_fullsized":"2023-07-14T15:56:10.489832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:11:49.645623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969340+0000","last_change":"2023-07-14T15:56:08.979271+0000","last_active":"2023-07-14T15:56:09.969340+0000","last_peered":"2023-07-14T15:56:09.969340+0000","last_clean":"2023-07-14T15:56:09.969340+0000","last_became_active":"2023-07-14T15:56:08.978838+0000","last_became_peered":"2023-07-14T15:56:08.978838+0000","last_unstale":"2023-07-14T15:56:09.969340+0000","last_undegraded":"2023-07-14T15:56:09.969340+0000","last_fullsized":"2023-07-14T15:56:09.969340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:24:33.248717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489209+0000","last_change":"2023-07-14T15:56:08.990555+0000","last_active":"2023-07-14T15:56:10.489209+0000","last_peered":"2023-07-14T15:56:10.489209+0000","last_clean":"2023-07-14T15:56:10.489209+0000","last_became_active":"2023-07-14T15:56:08.990204+0000","last_became_peered":"2023-07-14T15:56:08.990204+0000","last_unstale":"2023-07-14T15:56:10.489209+0000","last_undegraded":"2023-07-14T15:56:10.489209+0000","last_fullsized":"2023-07-14T15:56:10.489209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:53:14.967321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489549+0000","last_change":"2023-07-14T15:56:08.986185+0000","last_active":"2023-07-14T15:56:10.489549+0000","last_peered":"2023-07-14T15:56:10.489549+0000","last_clean":"2023-07-14T15:56:10.489549+0000","last_became_active":"2023-07-14T15:56:08.985934+0000","last_became_peered":"2023-07-14T15:56:08.985934+0000","last_unstale":"2023-07-14T15:56:10.489549+0000","last_undegraded":"2023-07-14T15:56:10.489549+0000","last_fullsized":"2023-07-14T15:56:10.489549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:22:06.842480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968260+0000","last_change":"2023-07-14T15:56:08.962497+0000","last_active":"2023-07-14T15:56:09.968260+0000","last_peered":"2023-07-14T15:56:09.968260+0000","last_clean":"2023-07-14T15:56:09.968260+0000","last_became_active":"2023-07-14T15:56:08.962200+0000","last_became_peered":"2023-07-14T15:56:08.962200+0000","last_unstale":"2023-07-14T15:56:09.968260+0000","last_undegraded":"2023-07-14T15:56:09.968260+0000","last_fullsized":"2023-07-14T15:56:09.968260+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:51:55.348364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968662+0000","last_change":"2023-07-14T15:56:08.967526+0000","last_active":"2023-07-14T15:56:09.968662+0000","last_peered":"2023-07-14T15:56:09.968662+0000","last_clean":"2023-07-14T15:56:09.968662+0000","last_became_active":"2023-07-14T15:56:08.967220+0000","last_became_peered":"2023-07-14T15:56:08.967220+0000","last_unstale":"2023-07-14T15:56:09.968662+0000","last_undegraded":"2023-07-14T15:56:09.968662+0000","last_fullsized":"2023-07-14T15:56:09.968662+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:38:26.539859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489384+0000","last_change":"2023-07-14T15:56:08.973815+0000","last_active":"2023-07-14T15:56:10.489384+0000","last_peered":"2023-07-14T15:56:10.489384+0000","last_clean":"2023-07-14T15:56:10.489384+0000","last_became_active":"2023-07-14T15:56:08.973497+0000","last_became_peered":"2023-07-14T15:56:08.973497+0000","last_unstale":"2023-07-14T15:56:10.489384+0000","last_undegraded":"2023-07-14T15:56:10.489384+0000","last_fullsized":"2023-07-14T15:56:10.489384+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:18:49.883894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969348+0000","last_change":"2023-07-14T15:56:08.967374+0000","last_active":"2023-07-14T15:56:09.969348+0000","last_peered":"2023-07-14T15:56:09.969348+0000","last_clean":"2023-07-14T15:56:09.969348+0000","last_became_active":"2023-07-14T15:56:08.967057+0000","last_became_peered":"2023-07-14T15:56:08.967057+0000","last_unstale":"2023-07-14T15:56:09.969348+0000","last_undegraded":"2023-07-14T15:56:09.969348+0000","last_fullsized":"2023-07-14T15:56:09.969348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:12:21.171093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969523+0000","last_change":"2023-07-14T15:56:08.980915+0000","last_active":"2023-07-14T15:56:09.969523+0000","last_peered":"2023-07-14T15:56:09.969523+0000","last_clean":"2023-07-14T15:56:09.969523+0000","last_became_active":"2023-07-14T15:56:08.971846+0000","last_became_peered":"2023-07-14T15:56:08.971846+0000","last_unstale":"2023-07-14T15:56:09.969523+0000","last_undegraded":"2023-07-14T15:56:09.969523+0000","last_fullsized":"2023-07-14T15:56:09.969523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:09:13.220323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.490060+0000","last_change":"2023-07-14T15:56:08.961701+0000","last_active":"2023-07-14T15:56:10.490060+0000","last_peered":"2023-07-14T15:56:10.490060+0000","last_clean":"2023-07-14T15:56:10.490060+0000","last_became_active":"2023-07-14T15:56:08.961444+0000","last_became_peered":"2023-07-14T15:56:08.961444+0000","last_unstale":"2023-07-14T15:56:10.490060+0000","last_undegraded":"2023-07-14T15:56:10.490060+0000","last_fullsized":"2023-07-14T15:56:10.490060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:23:33.554098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489929+0000","last_change":"2023-07-14T15:56:08.985138+0000","last_active":"2023-07-14T15:56:10.489929+0000","last_peered":"2023-07-14T15:56:10.489929+0000","last_clean":"2023-07-14T15:56:10.489929+0000","last_became_active":"2023-07-14T15:56:08.984870+0000","last_became_peered":"2023-07-14T15:56:08.984870+0000","last_unstale":"2023-07-14T15:56:10.489929+0000","last_undegraded":"2023-07-14T15:56:10.489929+0000","last_fullsized":"2023-07-14T15:56:10.489929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:09:13.220323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489967+0000","last_change":"2023-07-14T15:56:08.977755+0000","last_active":"2023-07-14T15:56:10.489967+0000","last_peered":"2023-07-14T15:56:10.489967+0000","last_clean":"2023-07-14T15:56:10.489967+0000","last_became_active":"2023-07-14T15:56:08.977492+0000","last_became_peered":"2023-07-14T15:56:08.977492+0000","last_unstale":"2023-07-14T15:56:10.489967+0000","last_undegraded":"2023-07-14T15:56:10.489967+0000","last_fullsized":"2023-07-14T15:56:10.489967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:09:43.406898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.317997+0000","last_change":"2023-07-14T15:56:08.963406+0000","last_active":"2023-07-14T15:56:10.317997+0000","last_peered":"2023-07-14T15:56:10.317997+0000","last_clean":"2023-07-14T15:56:10.317997+0000","last_became_active":"2023-07-14T15:56:08.961612+0000","last_became_peered":"2023-07-14T15:56:08.961612+0000","last_unstale":"2023-07-14T15:56:10.317997+0000","last_undegraded":"2023-07-14T15:56:10.317997+0000","last_fullsized":"2023-07-14T15:56:10.317997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:09:13.220323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489843+0000","last_change":"2023-07-14T15:56:08.985164+0000","last_active":"2023-07-14T15:56:10.489843+0000","last_peered":"2023-07-14T15:56:10.489843+0000","last_clean":"2023-07-14T15:56:10.489843+0000","last_became_active":"2023-07-14T15:56:08.984883+0000","last_became_peered":"2023-07-14T15:56:08.984883+0000","last_unstale":"2023-07-14T15:56:10.489843+0000","last_undegraded":"2023-07-14T15:56:10.489843+0000","last_fullsized":"2023-07-14T15:56:10.489843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:36:15.019527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.318240+0000","last_change":"2023-07-14T15:56:08.970245+0000","last_active":"2023-07-14T15:56:10.318240+0000","last_peered":"2023-07-14T15:56:10.318240+0000","last_clean":"2023-07-14T15:56:10.318240+0000","last_became_active":"2023-07-14T15:56:08.969945+0000","last_became_peered":"2023-07-14T15:56:08.969945+0000","last_unstale":"2023-07-14T15:56:10.318240+0000","last_undegraded":"2023-07-14T15:56:10.318240+0000","last_fullsized":"2023-07-14T15:56:10.318240+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:11:26.760684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489912+0000","last_change":"2023-07-14T15:56:08.986579+0000","last_active":"2023-07-14T15:56:10.489912+0000","last_peered":"2023-07-14T15:56:10.489912+0000","last_clean":"2023-07-14T15:56:10.489912+0000","last_became_active":"2023-07-14T15:56:08.986128+0000","last_became_peered":"2023-07-14T15:56:08.986128+0000","last_unstale":"2023-07-14T15:56:10.489912+0000","last_undegraded":"2023-07-14T15:56:10.489912+0000","last_fullsized":"2023-07-14T15:56:10.489912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:10:08.144011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969597+0000","last_change":"2023-07-14T15:56:08.971097+0000","last_active":"2023-07-14T15:56:09.969597+0000","last_peered":"2023-07-14T15:56:09.969597+0000","last_clean":"2023-07-14T15:56:09.969597+0000","last_became_active":"2023-07-14T15:56:08.970763+0000","last_became_peered":"2023-07-14T15:56:08.970763+0000","last_unstale":"2023-07-14T15:56:09.969597+0000","last_undegraded":"2023-07-14T15:56:09.969597+0000","last_fullsized":"2023-07-14T15:56:09.969597+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:16:10.020252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"24'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489692+0000","last_change":"2023-07-14T15:56:07.968145+0000","last_active":"2023-07-14T15:56:10.489692+0000","last_peered":"2023-07-14T15:56:10.489692+0000","last_clean":"2023-07-14T15:56:10.489692+0000","last_became_active":"2023-07-14T15:56:07.967843+0000","last_became_peered":"2023-07-14T15:56:07.967843+0000","last_unstale":"2023-07-14T15:56:10.489692+0000","last_undegraded":"2023-07-14T15:56:10.489692+0000","last_fullsized":"2023-07-14T15:56:10.489692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:24:32.242091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489357+0000","last_change":"2023-07-14T15:56:08.985388+0000","last_active":"2023-07-14T15:56:10.489357+0000","last_peered":"2023-07-14T15:56:10.489357+0000","last_clean":"2023-07-14T15:56:10.489357+0000","last_became_active":"2023-07-14T15:56:08.985075+0000","last_became_peered":"2023-07-14T15:56:08.985075+0000","last_unstale":"2023-07-14T15:56:10.489357+0000","last_undegraded":"2023-07-14T15:56:10.489357+0000","last_fullsized":"2023-07-14T15:56:10.489357+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:53:14.967321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.317657+0000","last_change":"2023-07-14T15:56:07.965016+0000","last_active":"2023-07-14T15:56:10.317657+0000","last_peered":"2023-07-14T15:56:10.317657+0000","last_clean":"2023-07-14T15:56:10.317657+0000","last_became_active":"2023-07-14T15:56:07.964727+0000","last_became_peered":"2023-07-14T15:56:07.964727+0000","last_unstale":"2023-07-14T15:56:10.317657+0000","last_undegraded":"2023-07-14T15:56:10.317657+0000","last_fullsized":"2023-07-14T15:56:10.317657+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:24:32.242091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.318283+0000","last_change":"2023-07-14T15:56:08.962222+0000","last_active":"2023-07-14T15:56:10.318283+0000","last_peered":"2023-07-14T15:56:10.318283+0000","last_clean":"2023-07-14T15:56:10.318283+0000","last_became_active":"2023-07-14T15:56:08.960614+0000","last_became_peered":"2023-07-14T15:56:08.960614+0000","last_unstale":"2023-07-14T15:56:10.318283+0000","last_undegraded":"2023-07-14T15:56:10.318283+0000","last_fullsized":"2023-07-14T15:56:10.318283+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:47:05.132046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968718+0000","last_change":"2023-07-14T15:56:07.963140+0000","last_active":"2023-07-14T15:56:09.968718+0000","last_peered":"2023-07-14T15:56:09.968718+0000","last_clean":"2023-07-14T15:56:09.968718+0000","last_became_active":"2023-07-14T15:56:07.962450+0000","last_became_peered":"2023-07-14T15:56:07.962450+0000","last_unstale":"2023-07-14T15:56:09.968718+0000","last_undegraded":"2023-07-14T15:56:09.968718+0000","last_fullsized":"2023-07-14T15:56:09.968718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:16:19.549915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.970237+0000","last_change":"2023-07-14T15:56:08.982827+0000","last_active":"2023-07-14T15:56:09.970237+0000","last_peered":"2023-07-14T15:56:09.970237+0000","last_clean":"2023-07-14T15:56:09.970237+0000","last_became_active":"2023-07-14T15:56:08.982548+0000","last_became_peered":"2023-07-14T15:56:08.982548+0000","last_unstale":"2023-07-14T15:56:09.970237+0000","last_undegraded":"2023-07-14T15:56:09.970237+0000","last_fullsized":"2023-07-14T15:56:09.970237+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:11:32.675035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969543+0000","last_change":"2023-07-14T15:56:07.974534+0000","last_active":"2023-07-14T15:56:09.969543+0000","last_peered":"2023-07-14T15:56:09.969543+0000","last_clean":"2023-07-14T15:56:09.969543+0000","last_became_active":"2023-07-14T15:56:07.974303+0000","last_became_peered":"2023-07-14T15:56:07.974303+0000","last_unstale":"2023-07-14T15:56:09.969543+0000","last_undegraded":"2023-07-14T15:56:09.969543+0000","last_fullsized":"2023-07-14T15:56:09.969543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:12:08.491508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489120+0000","last_change":"2023-07-14T15:56:08.972999+0000","last_active":"2023-07-14T15:56:10.489120+0000","last_peered":"2023-07-14T15:56:10.489120+0000","last_clean":"2023-07-14T15:56:10.489120+0000","last_became_active":"2023-07-14T15:56:08.972737+0000","last_became_peered":"2023-07-14T15:56:08.972737+0000","last_unstale":"2023-07-14T15:56:10.489120+0000","last_undegraded":"2023-07-14T15:56:10.489120+0000","last_fullsized":"2023-07-14T15:56:10.489120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:31:46.923553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.490157+0000","last_change":"2023-07-14T15:56:07.970831+0000","last_active":"2023-07-14T15:56:10.490157+0000","last_peered":"2023-07-14T15:56:10.490157+0000","last_clean":"2023-07-14T15:56:10.490157+0000","last_became_active":"2023-07-14T15:56:07.970450+0000","last_became_peered":"2023-07-14T15:56:07.970450+0000","last_unstale":"2023-07-14T15:56:10.490157+0000","last_undegraded":"2023-07-14T15:56:10.490157+0000","last_fullsized":"2023-07-14T15:56:10.490157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:20:57.146500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.317671+0000","last_change":"2023-07-14T15:56:08.969440+0000","last_active":"2023-07-14T15:56:10.317671+0000","last_peered":"2023-07-14T15:56:10.317671+0000","last_clean":"2023-07-14T15:56:10.317671+0000","last_became_active":"2023-07-14T15:56:08.966859+0000","last_became_peered":"2023-07-14T15:56:08.966859+0000","last_unstale":"2023-07-14T15:56:10.317671+0000","last_undegraded":"2023-07-14T15:56:10.317671+0000","last_fullsized":"2023-07-14T15:56:10.317671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:22:06.842480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"24'3","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968598+0000","last_change":"2023-07-14T15:56:07.964545+0000","last_active":"2023-07-14T15:56:09.968598+0000","last_peered":"2023-07-14T15:56:09.968598+0000","last_clean":"2023-07-14T15:56:09.968598+0000","last_became_active":"2023-07-14T15:56:07.963768+0000","last_became_peered":"2023-07-14T15:56:07.963768+0000","last_unstale":"2023-07-14T15:56:09.968598+0000","last_undegraded":"2023-07-14T15:56:09.968598+0000","last_fullsized":"2023-07-14T15:56:09.968598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:47:20.344379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.318158+0000","last_change":"2023-07-14T15:56:08.970241+0000","last_active":"2023-07-14T15:56:10.318158+0000","last_peered":"2023-07-14T15:56:10.318158+0000","last_clean":"2023-07-14T15:56:10.318158+0000","last_became_active":"2023-07-14T15:56:08.969947+0000","last_became_peered":"2023-07-14T15:56:08.969947+0000","last_unstale":"2023-07-14T15:56:10.318158+0000","last_undegraded":"2023-07-14T15:56:10.318158+0000","last_fullsized":"2023-07-14T15:56:10.318158+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:10:40.403063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"24'6","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969540+0000","last_change":"2023-07-14T15:56:07.970523+0000","last_active":"2023-07-14T15:56:09.969540+0000","last_peered":"2023-07-14T15:56:09.969540+0000","last_clean":"2023-07-14T15:56:09.969540+0000","last_became_active":"2023-07-14T15:56:07.970142+0000","last_became_peered":"2023-07-14T15:56:07.970142+0000","last_unstale":"2023-07-14T15:56:09.969540+0000","last_undegraded":"2023-07-14T15:56:09.969540+0000","last_fullsized":"2023-07-14T15:56:09.969540+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:47:08.966111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489691+0000","last_change":"2023-07-14T15:56:08.969130+0000","last_active":"2023-07-14T15:56:10.489691+0000","last_peered":"2023-07-14T15:56:10.489691+0000","last_clean":"2023-07-14T15:56:10.489691+0000","last_became_active":"2023-07-14T15:56:08.968814+0000","last_became_peered":"2023-07-14T15:56:08.968814+0000","last_unstale":"2023-07-14T15:56:10.489691+0000","last_undegraded":"2023-07-14T15:56:10.489691+0000","last_fullsized":"2023-07-14T15:56:10.489691+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:28:16.724128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969426+0000","last_change":"2023-07-14T15:56:07.970235+0000","last_active":"2023-07-14T15:56:09.969426+0000","last_peered":"2023-07-14T15:56:09.969426+0000","last_clean":"2023-07-14T15:56:09.969426+0000","last_became_active":"2023-07-14T15:56:07.969938+0000","last_became_peered":"2023-07-14T15:56:07.969938+0000","last_unstale":"2023-07-14T15:56:09.969426+0000","last_undegraded":"2023-07-14T15:56:09.969426+0000","last_fullsized":"2023-07-14T15:56:09.969426+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:03:38.271024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489380+0000","last_change":"2023-07-14T15:56:08.980388+0000","last_active":"2023-07-14T15:56:10.489380+0000","last_peered":"2023-07-14T15:56:10.489380+0000","last_clean":"2023-07-14T15:56:10.489380+0000","last_became_active":"2023-07-14T15:56:08.980080+0000","last_became_peered":"2023-07-14T15:56:08.980080+0000","last_unstale":"2023-07-14T15:56:10.489380+0000","last_undegraded":"2023-07-14T15:56:10.489380+0000","last_fullsized":"2023-07-14T15:56:10.489380+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:20:12.345478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489365+0000","last_change":"2023-07-14T15:56:07.975515+0000","last_active":"2023-07-14T15:56:10.489365+0000","last_peered":"2023-07-14T15:56:10.489365+0000","last_clean":"2023-07-14T15:56:10.489365+0000","last_became_active":"2023-07-14T15:56:07.975155+0000","last_became_peered":"2023-07-14T15:56:07.975155+0000","last_unstale":"2023-07-14T15:56:10.489365+0000","last_undegraded":"2023-07-14T15:56:10.489365+0000","last_fullsized":"2023-07-14T15:56:10.489365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:33:36.247286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.970018+0000","last_change":"2023-07-14T15:56:08.970329+0000","last_active":"2023-07-14T15:56:09.970018+0000","last_peered":"2023-07-14T15:56:09.970018+0000","last_clean":"2023-07-14T15:56:09.970018+0000","last_became_active":"2023-07-14T15:56:08.970021+0000","last_became_peered":"2023-07-14T15:56:08.970021+0000","last_unstale":"2023-07-14T15:56:09.970018+0000","last_undegraded":"2023-07-14T15:56:09.970018+0000","last_fullsized":"2023-07-14T15:56:09.970018+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:59:48.587072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968889+0000","last_change":"2023-07-14T15:56:07.970580+0000","last_active":"2023-07-14T15:56:09.968889+0000","last_peered":"2023-07-14T15:56:09.968889+0000","last_clean":"2023-07-14T15:56:09.968889+0000","last_became_active":"2023-07-14T15:56:07.970015+0000","last_became_peered":"2023-07-14T15:56:07.970015+0000","last_unstale":"2023-07-14T15:56:09.968889+0000","last_undegraded":"2023-07-14T15:56:09.968889+0000","last_fullsized":"2023-07-14T15:56:09.968889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:14:44.479408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969220+0000","last_change":"2023-07-14T15:56:08.980174+0000","last_active":"2023-07-14T15:56:09.969220+0000","last_peered":"2023-07-14T15:56:09.969220+0000","last_clean":"2023-07-14T15:56:09.969220+0000","last_became_active":"2023-07-14T15:56:08.979596+0000","last_became_peered":"2023-07-14T15:56:08.979596+0000","last_unstale":"2023-07-14T15:56:09.969220+0000","last_undegraded":"2023-07-14T15:56:09.969220+0000","last_fullsized":"2023-07-14T15:56:09.969220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:15:28.458174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"24'8","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489443+0000","last_change":"2023-07-14T15:56:07.968155+0000","last_active":"2023-07-14T15:56:10.489443+0000","last_peered":"2023-07-14T15:56:10.489443+0000","last_clean":"2023-07-14T15:56:10.489443+0000","last_became_active":"2023-07-14T15:56:07.967859+0000","last_became_peered":"2023-07-14T15:56:07.967859+0000","last_unstale":"2023-07-14T15:56:10.489443+0000","last_undegraded":"2023-07-14T15:56:10.489443+0000","last_fullsized":"2023-07-14T15:56:10.489443+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:15:27.451548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969509+0000","last_change":"2023-07-14T15:56:08.977704+0000","last_active":"2023-07-14T15:56:09.969509+0000","last_peered":"2023-07-14T15:56:09.969509+0000","last_clean":"2023-07-14T15:56:09.969509+0000","last_became_active":"2023-07-14T15:56:08.977428+0000","last_became_peered":"2023-07-14T15:56:08.977428+0000","last_unstale":"2023-07-14T15:56:09.969509+0000","last_undegraded":"2023-07-14T15:56:09.969509+0000","last_fullsized":"2023-07-14T15:56:09.969509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:32:30.477405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"24'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969149+0000","last_change":"2023-07-14T15:56:07.967243+0000","last_active":"2023-07-14T15:56:09.969149+0000","last_peered":"2023-07-14T15:56:09.969149+0000","last_clean":"2023-07-14T15:56:09.969149+0000","last_became_active":"2023-07-14T15:56:07.966979+0000","last_became_peered":"2023-07-14T15:56:07.966979+0000","last_unstale":"2023-07-14T15:56:09.969149+0000","last_undegraded":"2023-07-14T15:56:09.969149+0000","last_fullsized":"2023-07-14T15:56:09.969149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:01:03.734490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969353+0000","last_change":"2023-07-14T15:56:08.972023+0000","last_active":"2023-07-14T15:56:09.969353+0000","last_peered":"2023-07-14T15:56:09.969353+0000","last_clean":"2023-07-14T15:56:09.969353+0000","last_became_active":"2023-07-14T15:56:08.971728+0000","last_became_peered":"2023-07-14T15:56:08.971728+0000","last_unstale":"2023-07-14T15:56:09.969353+0000","last_undegraded":"2023-07-14T15:56:09.969353+0000","last_fullsized":"2023-07-14T15:56:09.969353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:28:39.134928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.490181+0000","last_change":"2023-07-14T15:56:07.968894+0000","last_active":"2023-07-14T15:56:10.490181+0000","last_peered":"2023-07-14T15:56:10.490181+0000","last_clean":"2023-07-14T15:56:10.490181+0000","last_became_active":"2023-07-14T15:56:07.968577+0000","last_became_peered":"2023-07-14T15:56:07.968577+0000","last_unstale":"2023-07-14T15:56:10.490181+0000","last_undegraded":"2023-07-14T15:56:10.490181+0000","last_fullsized":"2023-07-14T15:56:10.490181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:45:38.253764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489497+0000","last_change":"2023-07-14T15:56:08.985023+0000","last_active":"2023-07-14T15:56:10.489497+0000","last_peered":"2023-07-14T15:56:10.489497+0000","last_clean":"2023-07-14T15:56:10.489497+0000","last_became_active":"2023-07-14T15:56:08.984743+0000","last_became_peered":"2023-07-14T15:56:08.984743+0000","last_unstale":"2023-07-14T15:56:10.489497+0000","last_undegraded":"2023-07-14T15:56:10.489497+0000","last_fullsized":"2023-07-14T15:56:10.489497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:52:49.596576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"24'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969616+0000","last_change":"2023-07-14T15:56:07.975480+0000","last_active":"2023-07-14T15:56:09.969616+0000","last_peered":"2023-07-14T15:56:09.969616+0000","last_clean":"2023-07-14T15:56:09.969616+0000","last_became_active":"2023-07-14T15:56:07.975128+0000","last_became_peered":"2023-07-14T15:56:07.975128+0000","last_unstale":"2023-07-14T15:56:09.969616+0000","last_undegraded":"2023-07-14T15:56:09.969616+0000","last_fullsized":"2023-07-14T15:56:09.969616+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:35:54.302044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489485+0000","last_change":"2023-07-14T15:56:08.971193+0000","last_active":"2023-07-14T15:56:10.489485+0000","last_peered":"2023-07-14T15:56:10.489485+0000","last_clean":"2023-07-14T15:56:10.489485+0000","last_became_active":"2023-07-14T15:56:08.970747+0000","last_became_peered":"2023-07-14T15:56:08.970747+0000","last_unstale":"2023-07-14T15:56:10.489485+0000","last_undegraded":"2023-07-14T15:56:10.489485+0000","last_fullsized":"2023-07-14T15:56:10.489485+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:47:21.351005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968901+0000","last_change":"2023-07-14T15:56:07.973033+0000","last_active":"2023-07-14T15:56:09.968901+0000","last_peered":"2023-07-14T15:56:09.968901+0000","last_clean":"2023-07-14T15:56:09.968901+0000","last_became_active":"2023-07-14T15:56:07.972707+0000","last_became_peered":"2023-07-14T15:56:07.972707+0000","last_unstale":"2023-07-14T15:56:09.968901+0000","last_undegraded":"2023-07-14T15:56:09.968901+0000","last_fullsized":"2023-07-14T15:56:09.968901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:30:23.173622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969628+0000","last_change":"2023-07-14T15:56:08.983804+0000","last_active":"2023-07-14T15:56:09.969628+0000","last_peered":"2023-07-14T15:56:09.969628+0000","last_clean":"2023-07-14T15:56:09.969628+0000","last_became_active":"2023-07-14T15:56:08.983565+0000","last_became_peered":"2023-07-14T15:56:08.983565+0000","last_unstale":"2023-07-14T15:56:09.969628+0000","last_undegraded":"2023-07-14T15:56:09.969628+0000","last_fullsized":"2023-07-14T15:56:09.969628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:23:33.554098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.b","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489252+0000","last_change":"2023-07-14T15:56:07.973408+0000","last_active":"2023-07-14T15:56:10.489252+0000","last_peered":"2023-07-14T15:56:10.489252+0000","last_clean":"2023-07-14T15:56:10.489252+0000","last_became_active":"2023-07-14T15:56:07.973090+0000","last_became_peered":"2023-07-14T15:56:07.973090+0000","last_unstale":"2023-07-14T15:56:10.489252+0000","last_undegraded":"2023-07-14T15:56:10.489252+0000","last_fullsized":"2023-07-14T15:56:10.489252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:10:08.601895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968784+0000","last_change":"2023-07-14T15:56:08.963200+0000","last_active":"2023-07-14T15:56:09.968784+0000","last_peered":"2023-07-14T15:56:09.968784+0000","last_clean":"2023-07-14T15:56:09.968784+0000","last_became_active":"2023-07-14T15:56:08.962998+0000","last_became_peered":"2023-07-14T15:56:08.962998+0000","last_unstale":"2023-07-14T15:56:09.968784+0000","last_undegraded":"2023-07-14T15:56:09.968784+0000","last_fullsized":"2023-07-14T15:56:09.968784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:38:45.760463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969028+0000","last_change":"2023-07-14T15:56:07.976310+0000","last_active":"2023-07-14T15:56:09.969028+0000","last_peered":"2023-07-14T15:56:09.969028+0000","last_clean":"2023-07-14T15:56:09.969028+0000","last_became_active":"2023-07-14T15:56:07.975997+0000","last_became_peered":"2023-07-14T15:56:07.975997+0000","last_unstale":"2023-07-14T15:56:09.969028+0000","last_undegraded":"2023-07-14T15:56:09.969028+0000","last_fullsized":"2023-07-14T15:56:09.969028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:58:04.257883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969893+0000","last_change":"2023-07-14T15:56:08.975038+0000","last_active":"2023-07-14T15:56:09.969893+0000","last_peered":"2023-07-14T15:56:09.969893+0000","last_clean":"2023-07-14T15:56:09.969893+0000","last_became_active":"2023-07-14T15:56:08.974739+0000","last_became_peered":"2023-07-14T15:56:08.974739+0000","last_unstale":"2023-07-14T15:56:09.969893+0000","last_undegraded":"2023-07-14T15:56:09.969893+0000","last_fullsized":"2023-07-14T15:56:09.969893+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:11:18.956807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968825+0000","last_change":"2023-07-14T15:56:07.969636+0000","last_active":"2023-07-14T15:56:09.968825+0000","last_peered":"2023-07-14T15:56:09.968825+0000","last_clean":"2023-07-14T15:56:09.968825+0000","last_became_active":"2023-07-14T15:56:07.969277+0000","last_became_peered":"2023-07-14T15:56:07.969277+0000","last_unstale":"2023-07-14T15:56:09.968825+0000","last_undegraded":"2023-07-14T15:56:09.968825+0000","last_fullsized":"2023-07-14T15:56:09.968825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:16:33.190367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.490104+0000","last_change":"2023-07-14T15:56:08.961767+0000","last_active":"2023-07-14T15:56:10.490104+0000","last_peered":"2023-07-14T15:56:10.490104+0000","last_clean":"2023-07-14T15:56:10.490104+0000","last_became_active":"2023-07-14T15:56:08.961258+0000","last_became_peered":"2023-07-14T15:56:08.961258+0000","last_unstale":"2023-07-14T15:56:10.490104+0000","last_undegraded":"2023-07-14T15:56:10.490104+0000","last_fullsized":"2023-07-14T15:56:10.490104+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:12:21.171093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.317923+0000","last_change":"2023-07-14T15:56:07.971828+0000","last_active":"2023-07-14T15:56:10.317923+0000","last_peered":"2023-07-14T15:56:10.317923+0000","last_clean":"2023-07-14T15:56:10.317923+0000","last_became_active":"2023-07-14T15:56:07.971500+0000","last_became_peered":"2023-07-14T15:56:07.971500+0000","last_unstale":"2023-07-14T15:56:10.317923+0000","last_undegraded":"2023-07-14T15:56:10.317923+0000","last_fullsized":"2023-07-14T15:56:10.317923+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:54:18.286729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489687+0000","last_change":"2023-07-14T15:56:08.978423+0000","last_active":"2023-07-14T15:56:10.489687+0000","last_peered":"2023-07-14T15:56:10.489687+0000","last_clean":"2023-07-14T15:56:10.489687+0000","last_became_active":"2023-07-14T15:56:08.978126+0000","last_became_peered":"2023-07-14T15:56:08.978126+0000","last_unstale":"2023-07-14T15:56:10.489687+0000","last_undegraded":"2023-07-14T15:56:10.489687+0000","last_fullsized":"2023-07-14T15:56:10.489687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:29:32.279704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969494+0000","last_change":"2023-07-14T15:56:02.621850+0000","last_active":"2023-07-14T15:56:09.969494+0000","last_peered":"2023-07-14T15:56:09.969494+0000","last_clean":"2023-07-14T15:56:09.969494+0000","last_became_active":"2023-07-14T15:56:02.621471+0000","last_became_peered":"2023-07-14T15:56:02.621471+0000","last_unstale":"2023-07-14T15:56:09.969494+0000","last_undegraded":"2023-07-14T15:56:09.969494+0000","last_fullsized":"2023-07-14T15:56:09.969494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:54:12.263158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.490008+0000","last_change":"2023-07-14T15:56:07.965851+0000","last_active":"2023-07-14T15:56:10.490008+0000","last_peered":"2023-07-14T15:56:10.490008+0000","last_clean":"2023-07-14T15:56:10.490008+0000","last_became_active":"2023-07-14T15:56:07.965312+0000","last_became_peered":"2023-07-14T15:56:07.965312+0000","last_unstale":"2023-07-14T15:56:10.490008+0000","last_undegraded":"2023-07-14T15:56:10.490008+0000","last_fullsized":"2023-07-14T15:56:10.490008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:01:03.734490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.488879+0000","last_change":"2023-07-14T15:56:08.974753+0000","last_active":"2023-07-14T15:56:10.488879+0000","last_peered":"2023-07-14T15:56:10.488879+0000","last_clean":"2023-07-14T15:56:10.488879+0000","last_became_active":"2023-07-14T15:56:08.974482+0000","last_became_peered":"2023-07-14T15:56:08.974482+0000","last_unstale":"2023-07-14T15:56:10.488879+0000","last_undegraded":"2023-07-14T15:56:10.488879+0000","last_fullsized":"2023-07-14T15:56:10.488879+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:22:21.802038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969169+0000","last_change":"2023-07-14T15:56:02.621963+0000","last_active":"2023-07-14T15:56:09.969169+0000","last_peered":"2023-07-14T15:56:09.969169+0000","last_clean":"2023-07-14T15:56:09.969169+0000","last_became_active":"2023-07-14T15:56:02.621678+0000","last_became_peered":"2023-07-14T15:56:02.621678+0000","last_unstale":"2023-07-14T15:56:09.969169+0000","last_undegraded":"2023-07-14T15:56:09.969169+0000","last_fullsized":"2023-07-14T15:56:09.969169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:42:28.210730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968484+0000","last_change":"2023-07-14T15:56:07.970834+0000","last_active":"2023-07-14T15:56:09.968484+0000","last_peered":"2023-07-14T15:56:09.968484+0000","last_clean":"2023-07-14T15:56:09.968484+0000","last_became_active":"2023-07-14T15:56:07.970464+0000","last_became_peered":"2023-07-14T15:56:07.970464+0000","last_unstale":"2023-07-14T15:56:09.968484+0000","last_undegraded":"2023-07-14T15:56:09.968484+0000","last_fullsized":"2023-07-14T15:56:09.968484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:00:38.398401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489620+0000","last_change":"2023-07-14T15:56:08.974479+0000","last_active":"2023-07-14T15:56:10.489620+0000","last_peered":"2023-07-14T15:56:10.489620+0000","last_clean":"2023-07-14T15:56:10.489620+0000","last_became_active":"2023-07-14T15:56:08.974197+0000","last_became_peered":"2023-07-14T15:56:08.974197+0000","last_unstale":"2023-07-14T15:56:10.489620+0000","last_undegraded":"2023-07-14T15:56:10.489620+0000","last_fullsized":"2023-07-14T15:56:10.489620+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:10:08.144011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489381+0000","last_change":"2023-07-14T15:56:01.925110+0000","last_active":"2023-07-14T15:56:10.489381+0000","last_peered":"2023-07-14T15:56:10.489381+0000","last_clean":"2023-07-14T15:56:10.489381+0000","last_became_active":"2023-07-14T15:56:01.924723+0000","last_became_peered":"2023-07-14T15:56:01.924723+0000","last_unstale":"2023-07-14T15:56:10.489381+0000","last_undegraded":"2023-07-14T15:56:10.489381+0000","last_fullsized":"2023-07-14T15:56:10.489381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:33:30.223715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968791+0000","last_change":"2023-07-14T15:56:07.971753+0000","last_active":"2023-07-14T15:56:09.968791+0000","last_peered":"2023-07-14T15:56:09.968791+0000","last_clean":"2023-07-14T15:56:09.968791+0000","last_became_active":"2023-07-14T15:56:07.971447+0000","last_became_peered":"2023-07-14T15:56:07.971447+0000","last_unstale":"2023-07-14T15:56:09.968791+0000","last_undegraded":"2023-07-14T15:56:09.968791+0000","last_fullsized":"2023-07-14T15:56:09.968791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:14:57.078074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489621+0000","last_change":"2023-07-14T15:56:08.981489+0000","last_active":"2023-07-14T15:56:10.489621+0000","last_peered":"2023-07-14T15:56:10.489621+0000","last_clean":"2023-07-14T15:56:10.489621+0000","last_became_active":"2023-07-14T15:56:08.981064+0000","last_became_peered":"2023-07-14T15:56:08.981064+0000","last_unstale":"2023-07-14T15:56:10.489621+0000","last_undegraded":"2023-07-14T15:56:10.489621+0000","last_fullsized":"2023-07-14T15:56:10.489621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:09:43.406898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968541+0000","last_change":"2023-07-14T15:56:01.923465+0000","last_active":"2023-07-14T15:56:09.968541+0000","last_peered":"2023-07-14T15:56:09.968541+0000","last_clean":"2023-07-14T15:56:09.968541+0000","last_became_active":"2023-07-14T15:56:01.923160+0000","last_became_peered":"2023-07-14T15:56:01.923160+0000","last_unstale":"2023-07-14T15:56:09.968541+0000","last_undegraded":"2023-07-14T15:56:09.968541+0000","last_fullsized":"2023-07-14T15:56:09.968541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:50:40.374649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":175,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489184+0000","last_change":"2023-07-14T15:55:54.040065+0000","last_active":"2023-07-14T15:56:10.489184+0000","last_peered":"2023-07-14T15:56:10.489184+0000","last_clean":"2023-07-14T15:56:10.489184+0000","last_became_active":"2023-07-14T15:55:54.038885+0000","last_became_peered":"2023-07-14T15:55:54.038885+0000","last_unstale":"2023-07-14T15:56:10.489184+0000","last_undegraded":"2023-07-14T15:56:10.489184+0000","last_fullsized":"2023-07-14T15:56:10.489184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:55:53.025696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:55:53.025696+0000","last_clean_scrub_stamp":"2023-07-14T15:55:53.025696+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:14:43.173657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.317859+0000","last_change":"2023-07-14T15:56:07.970931+0000","last_active":"2023-07-14T15:56:10.317859+0000","last_peered":"2023-07-14T15:56:10.317859+0000","last_clean":"2023-07-14T15:56:10.317859+0000","last_became_active":"2023-07-14T15:56:07.970576+0000","last_became_peered":"2023-07-14T15:56:07.970576+0000","last_unstale":"2023-07-14T15:56:10.317859+0000","last_undegraded":"2023-07-14T15:56:10.317859+0000","last_fullsized":"2023-07-14T15:56:10.317859+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:32:29.470779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969965+0000","last_change":"2023-07-14T15:56:08.972039+0000","last_active":"2023-07-14T15:56:09.969965+0000","last_peered":"2023-07-14T15:56:09.969965+0000","last_clean":"2023-07-14T15:56:09.969965+0000","last_became_active":"2023-07-14T15:56:08.971718+0000","last_became_peered":"2023-07-14T15:56:08.971718+0000","last_unstale":"2023-07-14T15:56:09.969965+0000","last_undegraded":"2023-07-14T15:56:09.969965+0000","last_fullsized":"2023-07-14T15:56:09.969965+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:31:57.408531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968778+0000","last_change":"2023-07-14T15:56:01.920714+0000","last_active":"2023-07-14T15:56:09.968778+0000","last_peered":"2023-07-14T15:56:09.968778+0000","last_clean":"2023-07-14T15:56:09.968778+0000","last_became_active":"2023-07-14T15:56:01.920325+0000","last_became_peered":"2023-07-14T15:56:01.920325+0000","last_unstale":"2023-07-14T15:56:09.968778+0000","last_undegraded":"2023-07-14T15:56:09.968778+0000","last_fullsized":"2023-07-14T15:56:09.968778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:03:08.403097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.488883+0000","last_change":"2023-07-14T15:56:07.970542+0000","last_active":"2023-07-14T15:56:10.488883+0000","last_peered":"2023-07-14T15:56:10.488883+0000","last_clean":"2023-07-14T15:56:10.488883+0000","last_became_active":"2023-07-14T15:56:07.970172+0000","last_became_peered":"2023-07-14T15:56:07.970172+0000","last_unstale":"2023-07-14T15:56:10.488883+0000","last_undegraded":"2023-07-14T15:56:10.488883+0000","last_fullsized":"2023-07-14T15:56:10.488883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:31:45.916927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969443+0000","last_change":"2023-07-14T15:56:08.980388+0000","last_active":"2023-07-14T15:56:09.969443+0000","last_peered":"2023-07-14T15:56:09.969443+0000","last_clean":"2023-07-14T15:56:09.969443+0000","last_became_active":"2023-07-14T15:56:08.979897+0000","last_became_peered":"2023-07-14T15:56:08.979897+0000","last_unstale":"2023-07-14T15:56:09.969443+0000","last_undegraded":"2023-07-14T15:56:09.969443+0000","last_fullsized":"2023-07-14T15:56:09.969443+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:11:49.645623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969752+0000","last_change":"2023-07-14T15:56:01.923631+0000","last_active":"2023-07-14T15:56:09.969752+0000","last_peered":"2023-07-14T15:56:09.969752+0000","last_clean":"2023-07-14T15:56:09.969752+0000","last_became_active":"2023-07-14T15:56:01.922783+0000","last_became_peered":"2023-07-14T15:56:01.922783+0000","last_unstale":"2023-07-14T15:56:09.969752+0000","last_undegraded":"2023-07-14T15:56:09.969752+0000","last_fullsized":"2023-07-14T15:56:09.969752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:27:47.642533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489594+0000","last_change":"2023-07-14T15:56:07.967762+0000","last_active":"2023-07-14T15:56:10.489594+0000","last_peered":"2023-07-14T15:56:10.489594+0000","last_clean":"2023-07-14T15:56:10.489594+0000","last_became_active":"2023-07-14T15:56:07.967471+0000","last_became_peered":"2023-07-14T15:56:07.967471+0000","last_unstale":"2023-07-14T15:56:10.489594+0000","last_undegraded":"2023-07-14T15:56:10.489594+0000","last_fullsized":"2023-07-14T15:56:10.489594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:29:31.273078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489319+0000","last_change":"2023-07-14T15:56:08.976758+0000","last_active":"2023-07-14T15:56:10.489319+0000","last_peered":"2023-07-14T15:56:10.489319+0000","last_clean":"2023-07-14T15:56:10.489319+0000","last_became_active":"2023-07-14T15:56:08.976318+0000","last_became_peered":"2023-07-14T15:56:08.976318+0000","last_unstale":"2023-07-14T15:56:10.489319+0000","last_undegraded":"2023-07-14T15:56:10.489319+0000","last_fullsized":"2023-07-14T15:56:10.489319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:18:49.883894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.318181+0000","last_change":"2023-07-14T15:56:07.967060+0000","last_active":"2023-07-14T15:56:10.318181+0000","last_peered":"2023-07-14T15:56:10.318181+0000","last_clean":"2023-07-14T15:56:10.318181+0000","last_became_active":"2023-07-14T15:56:07.966852+0000","last_became_peered":"2023-07-14T15:56:07.966852+0000","last_unstale":"2023-07-14T15:56:10.318181+0000","last_undegraded":"2023-07-14T15:56:10.318181+0000","last_fullsized":"2023-07-14T15:56:10.318181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:58:00.742453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.318071+0000","last_change":"2023-07-14T15:56:01.965649+0000","last_active":"2023-07-14T15:56:10.318071+0000","last_peered":"2023-07-14T15:56:10.318071+0000","last_clean":"2023-07-14T15:56:10.318071+0000","last_became_active":"2023-07-14T15:56:01.965344+0000","last_became_peered":"2023-07-14T15:56:01.965344+0000","last_unstale":"2023-07-14T15:56:10.318071+0000","last_undegraded":"2023-07-14T15:56:10.318071+0000","last_fullsized":"2023-07-14T15:56:10.318071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:23:26.523901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.317808+0000","last_change":"2023-07-14T15:56:08.961123+0000","last_active":"2023-07-14T15:56:10.317808+0000","last_peered":"2023-07-14T15:56:10.317808+0000","last_clean":"2023-07-14T15:56:10.317808+0000","last_became_active":"2023-07-14T15:56:08.960675+0000","last_became_peered":"2023-07-14T15:56:08.960675+0000","last_unstale":"2023-07-14T15:56:10.317808+0000","last_undegraded":"2023-07-14T15:56:10.317808+0000","last_fullsized":"2023-07-14T15:56:10.317808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:11:49.645623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.970285+0000","last_change":"2023-07-14T15:56:01.966578+0000","last_active":"2023-07-14T15:56:09.970285+0000","last_peered":"2023-07-14T15:56:09.970285+0000","last_clean":"2023-07-14T15:56:09.970285+0000","last_became_active":"2023-07-14T15:56:01.966216+0000","last_became_peered":"2023-07-14T15:56:01.966216+0000","last_unstale":"2023-07-14T15:56:09.970285+0000","last_undegraded":"2023-07-14T15:56:09.970285+0000","last_fullsized":"2023-07-14T15:56:09.970285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:16:28.116727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.318279+0000","last_change":"2023-07-14T15:56:07.970881+0000","last_active":"2023-07-14T15:56:10.318279+0000","last_peered":"2023-07-14T15:56:10.318279+0000","last_clean":"2023-07-14T15:56:10.318279+0000","last_became_active":"2023-07-14T15:56:07.970596+0000","last_became_peered":"2023-07-14T15:56:07.970596+0000","last_unstale":"2023-07-14T15:56:10.318279+0000","last_undegraded":"2023-07-14T15:56:10.318279+0000","last_fullsized":"2023-07-14T15:56:10.318279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:29:12.393151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489389+0000","last_change":"2023-07-14T15:56:08.964323+0000","last_active":"2023-07-14T15:56:10.489389+0000","last_peered":"2023-07-14T15:56:10.489389+0000","last_clean":"2023-07-14T15:56:10.489389+0000","last_became_active":"2023-07-14T15:56:08.964024+0000","last_became_peered":"2023-07-14T15:56:08.964024+0000","last_unstale":"2023-07-14T15:56:10.489389+0000","last_undegraded":"2023-07-14T15:56:10.489389+0000","last_fullsized":"2023-07-14T15:56:10.489389+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:00:39.405027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"24'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.317703+0000","last_change":"2023-07-14T15:56:07.965044+0000","last_active":"2023-07-14T15:56:10.317703+0000","last_peered":"2023-07-14T15:56:10.317703+0000","last_clean":"2023-07-14T15:56:10.317703+0000","last_became_active":"2023-07-14T15:56:07.964585+0000","last_became_peered":"2023-07-14T15:56:07.964585+0000","last_unstale":"2023-07-14T15:56:10.317703+0000","last_undegraded":"2023-07-14T15:56:10.317703+0000","last_fullsized":"2023-07-14T15:56:10.317703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:59:56.654841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.318165+0000","last_change":"2023-07-14T15:56:08.972801+0000","last_active":"2023-07-14T15:56:10.318165+0000","last_peered":"2023-07-14T15:56:10.318165+0000","last_clean":"2023-07-14T15:56:10.318165+0000","last_became_active":"2023-07-14T15:56:08.972481+0000","last_became_peered":"2023-07-14T15:56:08.972481+0000","last_unstale":"2023-07-14T15:56:10.318165+0000","last_undegraded":"2023-07-14T15:56:10.318165+0000","last_fullsized":"2023-07-14T15:56:10.318165+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:35:57.456677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.490013+0000","last_change":"2023-07-14T15:56:07.968681+0000","last_active":"2023-07-14T15:56:10.490013+0000","last_peered":"2023-07-14T15:56:10.490013+0000","last_clean":"2023-07-14T15:56:10.490013+0000","last_became_active":"2023-07-14T15:56:07.968350+0000","last_became_peered":"2023-07-14T15:56:07.968350+0000","last_unstale":"2023-07-14T15:56:10.490013+0000","last_undegraded":"2023-07-14T15:56:10.490013+0000","last_fullsized":"2023-07-14T15:56:10.490013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:12:08.491508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489567+0000","last_change":"2023-07-14T15:56:08.987218+0000","last_active":"2023-07-14T15:56:10.489567+0000","last_peered":"2023-07-14T15:56:10.489567+0000","last_clean":"2023-07-14T15:56:10.489567+0000","last_became_active":"2023-07-14T15:56:08.986928+0000","last_became_peered":"2023-07-14T15:56:08.986928+0000","last_unstale":"2023-07-14T15:56:10.489567+0000","last_undegraded":"2023-07-14T15:56:10.489567+0000","last_fullsized":"2023-07-14T15:56:10.489567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:38:45.760463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969829+0000","last_change":"2023-07-14T15:56:07.971194+0000","last_active":"2023-07-14T15:56:09.969829+0000","last_peered":"2023-07-14T15:56:09.969829+0000","last_clean":"2023-07-14T15:56:09.969829+0000","last_became_active":"2023-07-14T15:56:07.970215+0000","last_became_peered":"2023-07-14T15:56:07.970215+0000","last_unstale":"2023-07-14T15:56:09.969829+0000","last_undegraded":"2023-07-14T15:56:09.969829+0000","last_fullsized":"2023-07-14T15:56:09.969829+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:57:28.541870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489443+0000","last_change":"2023-07-14T15:56:08.976795+0000","last_active":"2023-07-14T15:56:10.489443+0000","last_peered":"2023-07-14T15:56:10.489443+0000","last_clean":"2023-07-14T15:56:10.489443+0000","last_became_active":"2023-07-14T15:56:08.976405+0000","last_became_peered":"2023-07-14T15:56:08.976405+0000","last_unstale":"2023-07-14T15:56:10.489443+0000","last_undegraded":"2023-07-14T15:56:10.489443+0000","last_fullsized":"2023-07-14T15:56:10.489443+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:51:26.834028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"24'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969185+0000","last_change":"2023-07-14T15:56:07.977048+0000","last_active":"2023-07-14T15:56:09.969185+0000","last_peered":"2023-07-14T15:56:09.969185+0000","last_clean":"2023-07-14T15:56:09.969185+0000","last_became_active":"2023-07-14T15:56:07.976771+0000","last_became_peered":"2023-07-14T15:56:07.976771+0000","last_unstale":"2023-07-14T15:56:09.969185+0000","last_undegraded":"2023-07-14T15:56:09.969185+0000","last_fullsized":"2023-07-14T15:56:09.969185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:22:05.835854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489537+0000","last_change":"2023-07-14T15:56:08.976062+0000","last_active":"2023-07-14T15:56:10.489537+0000","last_peered":"2023-07-14T15:56:10.489537+0000","last_clean":"2023-07-14T15:56:10.489537+0000","last_became_active":"2023-07-14T15:56:08.975745+0000","last_became_peered":"2023-07-14T15:56:08.975745+0000","last_unstale":"2023-07-14T15:56:10.489537+0000","last_undegraded":"2023-07-14T15:56:10.489537+0000","last_fullsized":"2023-07-14T15:56:10.489537+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:20:12.345478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"24'4","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969619+0000","last_change":"2023-07-14T15:56:07.974964+0000","last_active":"2023-07-14T15:56:09.969619+0000","last_peered":"2023-07-14T15:56:09.969619+0000","last_clean":"2023-07-14T15:56:09.969619+0000","last_became_active":"2023-07-14T15:56:07.974696+0000","last_became_peered":"2023-07-14T15:56:07.974696+0000","last_unstale":"2023-07-14T15:56:09.969619+0000","last_undegraded":"2023-07-14T15:56:09.969619+0000","last_fullsized":"2023-07-14T15:56:09.969619+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:10:39.396437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489229+0000","last_change":"2023-07-14T15:56:08.962402+0000","last_active":"2023-07-14T15:56:10.489229+0000","last_peered":"2023-07-14T15:56:10.489229+0000","last_clean":"2023-07-14T15:56:10.489229+0000","last_became_active":"2023-07-14T15:56:08.962087+0000","last_became_peered":"2023-07-14T15:56:08.962087+0000","last_unstale":"2023-07-14T15:56:10.489229+0000","last_undegraded":"2023-07-14T15:56:10.489229+0000","last_fullsized":"2023-07-14T15:56:10.489229+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:51:55.348364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489873+0000","last_change":"2023-07-14T15:56:08.962047+0000","last_active":"2023-07-14T15:56:10.489873+0000","last_peered":"2023-07-14T15:56:10.489873+0000","last_clean":"2023-07-14T15:56:10.489873+0000","last_became_active":"2023-07-14T15:56:08.961657+0000","last_became_peered":"2023-07-14T15:56:08.961657+0000","last_unstale":"2023-07-14T15:56:10.489873+0000","last_undegraded":"2023-07-14T15:56:10.489873+0000","last_fullsized":"2023-07-14T15:56:10.489873+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:32:30.477405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.488979+0000","last_change":"2023-07-14T15:56:08.979917+0000","last_active":"2023-07-14T15:56:10.488979+0000","last_peered":"2023-07-14T15:56:10.488979+0000","last_clean":"2023-07-14T15:56:10.488979+0000","last_became_active":"2023-07-14T15:56:08.979617+0000","last_became_peered":"2023-07-14T15:56:08.979617+0000","last_unstale":"2023-07-14T15:56:10.488979+0000","last_undegraded":"2023-07-14T15:56:10.488979+0000","last_fullsized":"2023-07-14T15:56:10.488979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:10:09.608521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968216+0000","last_change":"2023-07-14T15:56:08.971350+0000","last_active":"2023-07-14T15:56:09.968216+0000","last_peered":"2023-07-14T15:56:09.968216+0000","last_clean":"2023-07-14T15:56:09.968216+0000","last_became_active":"2023-07-14T15:56:08.970957+0000","last_became_peered":"2023-07-14T15:56:08.970957+0000","last_unstale":"2023-07-14T15:56:09.968216+0000","last_undegraded":"2023-07-14T15:56:09.968216+0000","last_fullsized":"2023-07-14T15:56:09.968216+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:02:13.093743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969481+0000","last_change":"2023-07-14T15:56:08.968381+0000","last_active":"2023-07-14T15:56:09.969481+0000","last_peered":"2023-07-14T15:56:09.969481+0000","last_clean":"2023-07-14T15:56:09.969481+0000","last_became_active":"2023-07-14T15:56:08.968037+0000","last_became_peered":"2023-07-14T15:56:08.968037+0000","last_unstale":"2023-07-14T15:56:09.969481+0000","last_undegraded":"2023-07-14T15:56:09.969481+0000","last_fullsized":"2023-07-14T15:56:09.969481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:36:15.019527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969340+0000","last_change":"2023-07-14T15:56:08.960651+0000","last_active":"2023-07-14T15:56:09.969340+0000","last_peered":"2023-07-14T15:56:09.969340+0000","last_clean":"2023-07-14T15:56:09.969340+0000","last_became_active":"2023-07-14T15:56:08.960387+0000","last_became_peered":"2023-07-14T15:56:08.960387+0000","last_unstale":"2023-07-14T15:56:09.969340+0000","last_undegraded":"2023-07-14T15:56:09.969340+0000","last_fullsized":"2023-07-14T15:56:09.969340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:59:57.661468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476743,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":96845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]},{"osd":0,"up_from":16,"seq":68719476744,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":95323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":258048,"data_stored":95267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":860160,"data_stored":686219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]}]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":96741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]}]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":253952,"data_stored":95177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]}]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":851968,"data_stored":686127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.085}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]}]},{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":253952,"data_stored":95177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T15:56:18.401 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T15:56:18.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.625+0000 7eff549ff700 1 Processor -- start 2023-07-14T15:56:18.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.626+0000 7eff549ff700 1 -- start start 2023-07-14T15:56:18.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.627+0000 7eff549ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7eff500cffc0 0x7eff500b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:18.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.627+0000 7eff549ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7eff50160c50 0x7eff500cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:18.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.627+0000 7eff549ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff500cf6f0 con 0x7eff500b8b80 2023-07-14T15:56:18.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.627+0000 7eff549ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff500d0de0 con 0x7eff50160c50 2023-07-14T15:56:18.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.627+0000 7eff549ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff501610f0 con 0x7eff500cffc0 2023-07-14T15:56:18.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.627+0000 7eff4ed9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7eff50160c50 0x7eff500cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:18.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.627+0000 7eff4ed9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7eff50160c50 0x7eff500cf1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60502/0 (socket says 172.21.15.37:60502) 2023-07-14T15:56:18.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.627+0000 7eff4ed9d700 1 -- 172.21.15.37:0/2047756370 learned_addr learned my addr 172.21.15.37:0/2047756370 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:18.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.627+0000 7eff47fff700 1 --2- 172.21.15.37:0/2047756370 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7eff500cffc0 0x7eff500b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:18.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.628+0000 7eff4ed9d700 1 -- 172.21.15.37:0/2047756370 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7eff500cffc0 msgr2=0x7eff500b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:18.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.628+0000 7eff4ed9d700 1 --2- 172.21.15.37:0/2047756370 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7eff500cffc0 0x7eff500b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:18.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.628+0000 7eff4ed9d700 1 -- 172.21.15.37:0/2047756370 >> v1:172.21.15.98:6789/0 conn(0x7eff500b8b80 legacy=0x7eff500cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:18.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.628+0000 7eff4ed9d700 1 -- 172.21.15.37:0/2047756370 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff500cd590 con 0x7eff50160c50 2023-07-14T15:56:18.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.628+0000 7eff4ed9d700 1 --2- 172.21.15.37:0/2047756370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff50160c50 0x7eff500cf1b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7eff48009e50 tx=0x7eff4800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf05d974d5fb1faa server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:18.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.628+0000 7eff4dd9b700 1 -- 172.21.15.37:0/2047756370 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4800e070 con 0x7eff50160c50 2023-07-14T15:56:18.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.628+0000 7eff4dd9b700 1 -- 172.21.15.37:0/2047756370 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff4800b910 con 0x7eff50160c50 2023-07-14T15:56:18.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.628+0000 7eff4dd9b700 1 -- 172.21.15.37:0/2047756370 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4800bcc0 con 0x7eff50160c50 2023-07-14T15:56:18.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.629+0000 7eff549ff700 1 -- 172.21.15.37:0/2047756370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff50160c50 msgr2=0x7eff500cf1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:18.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.629+0000 7eff549ff700 1 --2- 172.21.15.37:0/2047756370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff50160c50 0x7eff500cf1b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7eff48009e50 tx=0x7eff4800b330 comp rx=0 tx=0).stop 2023-07-14T15:56:18.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.629+0000 7eff549ff700 1 -- 172.21.15.37:0/2047756370 shutdown_connections 2023-07-14T15:56:18.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.629+0000 7eff549ff700 1 --2- 172.21.15.37:0/2047756370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff50160c50 0x7eff500cf1b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:18.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.629+0000 7eff549ff700 1 --2- 172.21.15.37:0/2047756370 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7eff500cffc0 0x7eff500b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:18.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.629+0000 7eff549ff700 1 -- 172.21.15.37:0/2047756370 >> 172.21.15.37:0/2047756370 conn(0x7eff5006b150 msgr2=0x7eff5006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:18.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.629+0000 7eff549ff700 1 -- 172.21.15.37:0/2047756370 shutdown_connections 2023-07-14T15:56:18.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.629+0000 7eff549ff700 1 -- 172.21.15.37:0/2047756370 wait complete. 2023-07-14T15:56:18.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.631+0000 7eff549ff700 1 Processor -- start 2023-07-14T15:56:18.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.631+0000 7eff549ff700 1 -- start start 2023-07-14T15:56:18.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.632+0000 7eff549ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7eff500b8b80 0x7eff501f17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:18.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.632+0000 7eff549ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff500cffc0 0x7eff500b3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:18.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.632+0000 7eff549ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff50160c50 0x7eff501f5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:18.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.632+0000 7eff549ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff500b3fd0 con 0x7eff50160c50 2023-07-14T15:56:18.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.632+0000 7eff549ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff501f62a0 con 0x7eff500cffc0 2023-07-14T15:56:18.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.632+0000 7eff549ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff500b4dc0 con 0x7eff500b8b80 2023-07-14T15:56:18.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.632+0000 7eff4ed9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff50160c50 0x7eff501f5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:18.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.632+0000 7eff4ed9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff50160c50 0x7eff501f5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60516/0 (socket says 172.21.15.37:60516) 2023-07-14T15:56:18.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.632+0000 7eff4ed9d700 1 -- 172.21.15.37:0/2474560804 learned_addr learned my addr 172.21.15.37:0/2474560804 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:18.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.632+0000 7eff4e59c700 1 --2- 172.21.15.37:0/2474560804 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7eff500b8b80 0x7eff501f17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:18.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.632+0000 7eff47fff700 1 --2- 172.21.15.37:0/2474560804 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff500cffc0 0x7eff500b3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:18.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.632+0000 7eff4ed9d700 1 -- 172.21.15.37:0/2474560804 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7eff500b8b80 msgr2=0x7eff501f17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:18.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.632+0000 7eff4ed9d700 1 --2- 172.21.15.37:0/2474560804 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7eff500b8b80 0x7eff501f17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:18.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.632+0000 7eff4ed9d700 1 -- 172.21.15.37:0/2474560804 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff500cffc0 msgr2=0x7eff500b3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:18.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.632+0000 7eff4ed9d700 1 --2- 172.21.15.37:0/2474560804 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff500cffc0 0x7eff500b3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:18.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.632+0000 7eff4ed9d700 1 -- 172.21.15.37:0/2474560804 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff48009b30 con 0x7eff50160c50 2023-07-14T15:56:18.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.632+0000 7eff4e59c700 1 --2- 172.21.15.37:0/2474560804 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7eff500b8b80 0x7eff501f17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:56:18.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.632+0000 7eff47fff700 1 --2- 172.21.15.37:0/2474560804 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff500cffc0 0x7eff500b3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:56:18.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.633+0000 7eff4ed9d700 1 --2- 172.21.15.37:0/2474560804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff50160c50 0x7eff501f5d60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7eff4800b680 tx=0x7eff48004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:18.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.633+0000 7eff46ffd700 1 -- 172.21.15.37:0/2474560804 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff480099b0 con 0x7eff50160c50 2023-07-14T15:56:18.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.633+0000 7eff46ffd700 1 -- 172.21.15.37:0/2474560804 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff480092e0 con 0x7eff50160c50 2023-07-14T15:56:18.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.633+0000 7eff46ffd700 1 -- 172.21.15.37:0/2474560804 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4801c640 con 0x7eff50160c50 2023-07-14T15:56:18.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.633+0000 7eff549ff700 1 -- 172.21.15.37:0/2474560804 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff500b41b0 con 0x7eff50160c50 2023-07-14T15:56:18.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.633+0000 7eff549ff700 1 -- 172.21.15.37:0/2474560804 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff500b4770 con 0x7eff50160c50 2023-07-14T15:56:18.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.634+0000 7eff549ff700 1 -- 172.21.15.37:0/2474560804 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff500b4f70 con 0x7eff50160c50 2023-07-14T15:56:18.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.635+0000 7eff46ffd700 1 -- 172.21.15.37:0/2474560804 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7eff4801c7a0 con 0x7eff50160c50 2023-07-14T15:56:18.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.636+0000 7eff46ffd700 1 --2- 172.21.15.37:0/2474560804 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7eff3006ad10 0x7eff3006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:18.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.636+0000 7eff46ffd700 1 -- 172.21.15.37:0/2474560804 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7eff4808b1a0 con 0x7eff50160c50 2023-07-14T15:56:18.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.637+0000 7eff4e59c700 1 --2- 172.21.15.37:0/2474560804 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7eff3006ad10 0x7eff3006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:18.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.637+0000 7eff4e59c700 1 --2- 172.21.15.37:0/2474560804 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7eff3006ad10 0x7eff3006d1c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7eff40000f60 tx=0x7eff40009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:18.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.640+0000 7eff46ffd700 1 -- 172.21.15.37:0/2474560804 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7eff500b4f70 con 0x7eff50160c50 2023-07-14T15:56:18.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.844+0000 7eff549ff700 1 -- 172.21.15.37:0/2474560804 --> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7eff500cdb50 con 0x7eff3006ad10 2023-07-14T15:56:18.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.854+0000 7eff46ffd700 1 -- 172.21.15.37:0/2474560804 <== mgr.4100 v2:172.21.15.98:6832/3163748069 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286768 (secure 0 0 0) 0x7eff40014420 con 0x7eff3006ad10 2023-07-14T15:56:18.844 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:56:18.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.858+0000 7eff549ff700 1 -- 172.21.15.37:0/2474560804 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7eff3006ad10 msgr2=0x7eff3006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:18.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.858+0000 7eff549ff700 1 --2- 172.21.15.37:0/2474560804 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7eff3006ad10 0x7eff3006d1c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7eff40000f60 tx=0x7eff40009040 comp rx=0 tx=0).stop 2023-07-14T15:56:18.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.859+0000 7eff549ff700 1 -- 172.21.15.37:0/2474560804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff50160c50 msgr2=0x7eff501f5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:18.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.859+0000 7eff549ff700 1 --2- 172.21.15.37:0/2474560804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff50160c50 0x7eff501f5d60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7eff4800b680 tx=0x7eff48004ad0 comp rx=0 tx=0).stop 2023-07-14T15:56:18.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.859+0000 7eff549ff700 1 -- 172.21.15.37:0/2474560804 shutdown_connections 2023-07-14T15:56:18.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.859+0000 7eff549ff700 1 --2- 172.21.15.37:0/2474560804 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7eff3006ad10 0x7eff3006d1c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:18.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.859+0000 7eff549ff700 1 --2- 172.21.15.37:0/2474560804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff50160c50 0x7eff501f5d60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:18.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.859+0000 7eff549ff700 1 --2- 172.21.15.37:0/2474560804 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7eff500b8b80 0x7eff501f17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:18.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.859+0000 7eff549ff700 1 --2- 172.21.15.37:0/2474560804 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff500cffc0 0x7eff500b3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:18.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.859+0000 7eff549ff700 1 -- 172.21.15.37:0/2474560804 >> 172.21.15.37:0/2474560804 conn(0x7eff5006b150 msgr2=0x7eff5015b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:18.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.859+0000 7eff549ff700 1 -- 172.21.15.37:0/2474560804 shutdown_connections 2023-07-14T15:56:18.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:18.859+0000 7eff549ff700 1 -- 172.21.15.37:0/2474560804 wait complete. 2023-07-14T15:56:18.847 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-14T15:56:18.863 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2023-07-14T15:56:16.855752+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":202,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218824,"kb_used_data":3208,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755896,"statfs":{"total":773094113280,"available":772870037504,"internally_reserved":0,"allocated":3284992,"data_stored":1946876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002288"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969224+0000","last_change":"2023-07-14T15:56:08.983100+0000","last_active":"2023-07-14T15:56:09.969224+0000","last_peered":"2023-07-14T15:56:09.969224+0000","last_clean":"2023-07-14T15:56:09.969224+0000","last_became_active":"2023-07-14T15:56:08.982847+0000","last_became_peered":"2023-07-14T15:56:08.982847+0000","last_unstale":"2023-07-14T15:56:09.969224+0000","last_undegraded":"2023-07-14T15:56:09.969224+0000","last_fullsized":"2023-07-14T15:56:09.969224+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:52:49.596576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489972+0000","last_change":"2023-07-14T15:56:08.961552+0000","last_active":"2023-07-14T15:56:10.489972+0000","last_peered":"2023-07-14T15:56:10.489972+0000","last_clean":"2023-07-14T15:56:10.489972+0000","last_became_active":"2023-07-14T15:56:08.960866+0000","last_became_peered":"2023-07-14T15:56:08.960866+0000","last_unstale":"2023-07-14T15:56:10.489972+0000","last_undegraded":"2023-07-14T15:56:10.489972+0000","last_fullsized":"2023-07-14T15:56:10.489972+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:30:24.180248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968575+0000","last_change":"2023-07-14T15:56:08.984210+0000","last_active":"2023-07-14T15:56:09.968575+0000","last_peered":"2023-07-14T15:56:09.968575+0000","last_clean":"2023-07-14T15:56:09.968575+0000","last_became_active":"2023-07-14T15:56:08.983924+0000","last_became_peered":"2023-07-14T15:56:08.983924+0000","last_unstale":"2023-07-14T15:56:09.968575+0000","last_undegraded":"2023-07-14T15:56:09.968575+0000","last_fullsized":"2023-07-14T15:56:09.968575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:51:26.834028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968877+0000","last_change":"2023-07-14T15:56:08.968523+0000","last_active":"2023-07-14T15:56:09.968877+0000","last_peered":"2023-07-14T15:56:09.968877+0000","last_clean":"2023-07-14T15:56:09.968877+0000","last_became_active":"2023-07-14T15:56:08.968214+0000","last_became_peered":"2023-07-14T15:56:08.968214+0000","last_unstale":"2023-07-14T15:56:09.968877+0000","last_undegraded":"2023-07-14T15:56:09.968877+0000","last_fullsized":"2023-07-14T15:56:09.968877+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:28:16.724128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.317844+0000","last_change":"2023-07-14T15:56:08.960575+0000","last_active":"2023-07-14T15:56:10.317844+0000","last_peered":"2023-07-14T15:56:10.317844+0000","last_clean":"2023-07-14T15:56:10.317844+0000","last_became_active":"2023-07-14T15:56:08.959986+0000","last_became_peered":"2023-07-14T15:56:08.959986+0000","last_unstale":"2023-07-14T15:56:10.317844+0000","last_undegraded":"2023-07-14T15:56:10.317844+0000","last_fullsized":"2023-07-14T15:56:10.317844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:36:15.019527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968975+0000","last_change":"2023-07-14T15:56:08.970285+0000","last_active":"2023-07-14T15:56:09.968975+0000","last_peered":"2023-07-14T15:56:09.968975+0000","last_clean":"2023-07-14T15:56:09.968975+0000","last_became_active":"2023-07-14T15:56:08.969969+0000","last_became_peered":"2023-07-14T15:56:08.969969+0000","last_unstale":"2023-07-14T15:56:09.968975+0000","last_undegraded":"2023-07-14T15:56:09.968975+0000","last_fullsized":"2023-07-14T15:56:09.968975+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:04:03.590683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968616+0000","last_change":"2023-07-14T15:56:08.964590+0000","last_active":"2023-07-14T15:56:09.968616+0000","last_peered":"2023-07-14T15:56:09.968616+0000","last_clean":"2023-07-14T15:56:09.968616+0000","last_became_active":"2023-07-14T15:56:08.963896+0000","last_became_peered":"2023-07-14T15:56:08.963896+0000","last_unstale":"2023-07-14T15:56:09.968616+0000","last_undegraded":"2023-07-14T15:56:09.968616+0000","last_fullsized":"2023-07-14T15:56:09.968616+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:31:53.434325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489987+0000","last_change":"2023-07-14T15:56:08.963001+0000","last_active":"2023-07-14T15:56:10.489987+0000","last_peered":"2023-07-14T15:56:10.489987+0000","last_clean":"2023-07-14T15:56:10.489987+0000","last_became_active":"2023-07-14T15:56:08.962689+0000","last_became_peered":"2023-07-14T15:56:08.962689+0000","last_unstale":"2023-07-14T15:56:10.489987+0000","last_undegraded":"2023-07-14T15:56:10.489987+0000","last_fullsized":"2023-07-14T15:56:10.489987+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:54:19.293355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.318103+0000","last_change":"2023-07-14T15:56:08.982014+0000","last_active":"2023-07-14T15:56:10.318103+0000","last_peered":"2023-07-14T15:56:10.318103+0000","last_clean":"2023-07-14T15:56:10.318103+0000","last_became_active":"2023-07-14T15:56:08.981754+0000","last_became_peered":"2023-07-14T15:56:08.981754+0000","last_unstale":"2023-07-14T15:56:10.318103+0000","last_undegraded":"2023-07-14T15:56:10.318103+0000","last_fullsized":"2023-07-14T15:56:10.318103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:12:09.498134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489747+0000","last_change":"2023-07-14T15:56:08.974509+0000","last_active":"2023-07-14T15:56:10.489747+0000","last_peered":"2023-07-14T15:56:10.489747+0000","last_clean":"2023-07-14T15:56:10.489747+0000","last_became_active":"2023-07-14T15:56:08.974197+0000","last_became_peered":"2023-07-14T15:56:08.974197+0000","last_unstale":"2023-07-14T15:56:10.489747+0000","last_undegraded":"2023-07-14T15:56:10.489747+0000","last_fullsized":"2023-07-14T15:56:10.489747+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:59:57.661468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489832+0000","last_change":"2023-07-14T15:56:08.965378+0000","last_active":"2023-07-14T15:56:10.489832+0000","last_peered":"2023-07-14T15:56:10.489832+0000","last_clean":"2023-07-14T15:56:10.489832+0000","last_became_active":"2023-07-14T15:56:08.965029+0000","last_became_peered":"2023-07-14T15:56:08.965029+0000","last_unstale":"2023-07-14T15:56:10.489832+0000","last_undegraded":"2023-07-14T15:56:10.489832+0000","last_fullsized":"2023-07-14T15:56:10.489832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:11:49.645623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969340+0000","last_change":"2023-07-14T15:56:08.979271+0000","last_active":"2023-07-14T15:56:09.969340+0000","last_peered":"2023-07-14T15:56:09.969340+0000","last_clean":"2023-07-14T15:56:09.969340+0000","last_became_active":"2023-07-14T15:56:08.978838+0000","last_became_peered":"2023-07-14T15:56:08.978838+0000","last_unstale":"2023-07-14T15:56:09.969340+0000","last_undegraded":"2023-07-14T15:56:09.969340+0000","last_fullsized":"2023-07-14T15:56:09.969340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:24:33.248717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489209+0000","last_change":"2023-07-14T15:56:08.990555+0000","last_active":"2023-07-14T15:56:10.489209+0000","last_peered":"2023-07-14T15:56:10.489209+0000","last_clean":"2023-07-14T15:56:10.489209+0000","last_became_active":"2023-07-14T15:56:08.990204+0000","last_became_peered":"2023-07-14T15:56:08.990204+0000","last_unstale":"2023-07-14T15:56:10.489209+0000","last_undegraded":"2023-07-14T15:56:10.489209+0000","last_fullsized":"2023-07-14T15:56:10.489209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:53:14.967321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489549+0000","last_change":"2023-07-14T15:56:08.986185+0000","last_active":"2023-07-14T15:56:10.489549+0000","last_peered":"2023-07-14T15:56:10.489549+0000","last_clean":"2023-07-14T15:56:10.489549+0000","last_became_active":"2023-07-14T15:56:08.985934+0000","last_became_peered":"2023-07-14T15:56:08.985934+0000","last_unstale":"2023-07-14T15:56:10.489549+0000","last_undegraded":"2023-07-14T15:56:10.489549+0000","last_fullsized":"2023-07-14T15:56:10.489549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:22:06.842480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968260+0000","last_change":"2023-07-14T15:56:08.962497+0000","last_active":"2023-07-14T15:56:09.968260+0000","last_peered":"2023-07-14T15:56:09.968260+0000","last_clean":"2023-07-14T15:56:09.968260+0000","last_became_active":"2023-07-14T15:56:08.962200+0000","last_became_peered":"2023-07-14T15:56:08.962200+0000","last_unstale":"2023-07-14T15:56:09.968260+0000","last_undegraded":"2023-07-14T15:56:09.968260+0000","last_fullsized":"2023-07-14T15:56:09.968260+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:51:55.348364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968662+0000","last_change":"2023-07-14T15:56:08.967526+0000","last_active":"2023-07-14T15:56:09.968662+0000","last_peered":"2023-07-14T15:56:09.968662+0000","last_clean":"2023-07-14T15:56:09.968662+0000","last_became_active":"2023-07-14T15:56:08.967220+0000","last_became_peered":"2023-07-14T15:56:08.967220+0000","last_unstale":"2023-07-14T15:56:09.968662+0000","last_undegraded":"2023-07-14T15:56:09.968662+0000","last_fullsized":"2023-07-14T15:56:09.968662+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:38:26.539859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489384+0000","last_change":"2023-07-14T15:56:08.973815+0000","last_active":"2023-07-14T15:56:10.489384+0000","last_peered":"2023-07-14T15:56:10.489384+0000","last_clean":"2023-07-14T15:56:10.489384+0000","last_became_active":"2023-07-14T15:56:08.973497+0000","last_became_peered":"2023-07-14T15:56:08.973497+0000","last_unstale":"2023-07-14T15:56:10.489384+0000","last_undegraded":"2023-07-14T15:56:10.489384+0000","last_fullsized":"2023-07-14T15:56:10.489384+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:18:49.883894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969348+0000","last_change":"2023-07-14T15:56:08.967374+0000","last_active":"2023-07-14T15:56:09.969348+0000","last_peered":"2023-07-14T15:56:09.969348+0000","last_clean":"2023-07-14T15:56:09.969348+0000","last_became_active":"2023-07-14T15:56:08.967057+0000","last_became_peered":"2023-07-14T15:56:08.967057+0000","last_unstale":"2023-07-14T15:56:09.969348+0000","last_undegraded":"2023-07-14T15:56:09.969348+0000","last_fullsized":"2023-07-14T15:56:09.969348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:12:21.171093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969523+0000","last_change":"2023-07-14T15:56:08.980915+0000","last_active":"2023-07-14T15:56:09.969523+0000","last_peered":"2023-07-14T15:56:09.969523+0000","last_clean":"2023-07-14T15:56:09.969523+0000","last_became_active":"2023-07-14T15:56:08.971846+0000","last_became_peered":"2023-07-14T15:56:08.971846+0000","last_unstale":"2023-07-14T15:56:09.969523+0000","last_undegraded":"2023-07-14T15:56:09.969523+0000","last_fullsized":"2023-07-14T15:56:09.969523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:09:13.220323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.490060+0000","last_change":"2023-07-14T15:56:08.961701+0000","last_active":"2023-07-14T15:56:10.490060+0000","last_peered":"2023-07-14T15:56:10.490060+0000","last_clean":"2023-07-14T15:56:10.490060+0000","last_became_active":"2023-07-14T15:56:08.961444+0000","last_became_peered":"2023-07-14T15:56:08.961444+0000","last_unstale":"2023-07-14T15:56:10.490060+0000","last_undegraded":"2023-07-14T15:56:10.490060+0000","last_fullsized":"2023-07-14T15:56:10.490060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:23:33.554098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489929+0000","last_change":"2023-07-14T15:56:08.985138+0000","last_active":"2023-07-14T15:56:10.489929+0000","last_peered":"2023-07-14T15:56:10.489929+0000","last_clean":"2023-07-14T15:56:10.489929+0000","last_became_active":"2023-07-14T15:56:08.984870+0000","last_became_peered":"2023-07-14T15:56:08.984870+0000","last_unstale":"2023-07-14T15:56:10.489929+0000","last_undegraded":"2023-07-14T15:56:10.489929+0000","last_fullsized":"2023-07-14T15:56:10.489929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:09:13.220323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489967+0000","last_change":"2023-07-14T15:56:08.977755+0000","last_active":"2023-07-14T15:56:10.489967+0000","last_peered":"2023-07-14T15:56:10.489967+0000","last_clean":"2023-07-14T15:56:10.489967+0000","last_became_active":"2023-07-14T15:56:08.977492+0000","last_became_peered":"2023-07-14T15:56:08.977492+0000","last_unstale":"2023-07-14T15:56:10.489967+0000","last_undegraded":"2023-07-14T15:56:10.489967+0000","last_fullsized":"2023-07-14T15:56:10.489967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:09:43.406898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.317997+0000","last_change":"2023-07-14T15:56:08.963406+0000","last_active":"2023-07-14T15:56:10.317997+0000","last_peered":"2023-07-14T15:56:10.317997+0000","last_clean":"2023-07-14T15:56:10.317997+0000","last_became_active":"2023-07-14T15:56:08.961612+0000","last_became_peered":"2023-07-14T15:56:08.961612+0000","last_unstale":"2023-07-14T15:56:10.317997+0000","last_undegraded":"2023-07-14T15:56:10.317997+0000","last_fullsized":"2023-07-14T15:56:10.317997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:09:13.220323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489843+0000","last_change":"2023-07-14T15:56:08.985164+0000","last_active":"2023-07-14T15:56:10.489843+0000","last_peered":"2023-07-14T15:56:10.489843+0000","last_clean":"2023-07-14T15:56:10.489843+0000","last_became_active":"2023-07-14T15:56:08.984883+0000","last_became_peered":"2023-07-14T15:56:08.984883+0000","last_unstale":"2023-07-14T15:56:10.489843+0000","last_undegraded":"2023-07-14T15:56:10.489843+0000","last_fullsized":"2023-07-14T15:56:10.489843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:36:15.019527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.318240+0000","last_change":"2023-07-14T15:56:08.970245+0000","last_active":"2023-07-14T15:56:10.318240+0000","last_peered":"2023-07-14T15:56:10.318240+0000","last_clean":"2023-07-14T15:56:10.318240+0000","last_became_active":"2023-07-14T15:56:08.969945+0000","last_became_peered":"2023-07-14T15:56:08.969945+0000","last_unstale":"2023-07-14T15:56:10.318240+0000","last_undegraded":"2023-07-14T15:56:10.318240+0000","last_fullsized":"2023-07-14T15:56:10.318240+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:11:26.760684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489912+0000","last_change":"2023-07-14T15:56:08.986579+0000","last_active":"2023-07-14T15:56:10.489912+0000","last_peered":"2023-07-14T15:56:10.489912+0000","last_clean":"2023-07-14T15:56:10.489912+0000","last_became_active":"2023-07-14T15:56:08.986128+0000","last_became_peered":"2023-07-14T15:56:08.986128+0000","last_unstale":"2023-07-14T15:56:10.489912+0000","last_undegraded":"2023-07-14T15:56:10.489912+0000","last_fullsized":"2023-07-14T15:56:10.489912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:10:08.144011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969597+0000","last_change":"2023-07-14T15:56:08.971097+0000","last_active":"2023-07-14T15:56:09.969597+0000","last_peered":"2023-07-14T15:56:09.969597+0000","last_clean":"2023-07-14T15:56:09.969597+0000","last_became_active":"2023-07-14T15:56:08.970763+0000","last_became_peered":"2023-07-14T15:56:08.970763+0000","last_unstale":"2023-07-14T15:56:09.969597+0000","last_undegraded":"2023-07-14T15:56:09.969597+0000","last_fullsized":"2023-07-14T15:56:09.969597+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:16:10.020252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"24'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489692+0000","last_change":"2023-07-14T15:56:07.968145+0000","last_active":"2023-07-14T15:56:10.489692+0000","last_peered":"2023-07-14T15:56:10.489692+0000","last_clean":"2023-07-14T15:56:10.489692+0000","last_became_active":"2023-07-14T15:56:07.967843+0000","last_became_peered":"2023-07-14T15:56:07.967843+0000","last_unstale":"2023-07-14T15:56:10.489692+0000","last_undegraded":"2023-07-14T15:56:10.489692+0000","last_fullsized":"2023-07-14T15:56:10.489692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:24:32.242091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489357+0000","last_change":"2023-07-14T15:56:08.985388+0000","last_active":"2023-07-14T15:56:10.489357+0000","last_peered":"2023-07-14T15:56:10.489357+0000","last_clean":"2023-07-14T15:56:10.489357+0000","last_became_active":"2023-07-14T15:56:08.985075+0000","last_became_peered":"2023-07-14T15:56:08.985075+0000","last_unstale":"2023-07-14T15:56:10.489357+0000","last_undegraded":"2023-07-14T15:56:10.489357+0000","last_fullsized":"2023-07-14T15:56:10.489357+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:53:14.967321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.317657+0000","last_change":"2023-07-14T15:56:07.965016+0000","last_active":"2023-07-14T15:56:10.317657+0000","last_peered":"2023-07-14T15:56:10.317657+0000","last_clean":"2023-07-14T15:56:10.317657+0000","last_became_active":"2023-07-14T15:56:07.964727+0000","last_became_peered":"2023-07-14T15:56:07.964727+0000","last_unstale":"2023-07-14T15:56:10.317657+0000","last_undegraded":"2023-07-14T15:56:10.317657+0000","last_fullsized":"2023-07-14T15:56:10.317657+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:24:32.242091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.318283+0000","last_change":"2023-07-14T15:56:08.962222+0000","last_active":"2023-07-14T15:56:10.318283+0000","last_peered":"2023-07-14T15:56:10.318283+0000","last_clean":"2023-07-14T15:56:10.318283+0000","last_became_active":"2023-07-14T15:56:08.960614+0000","last_became_peered":"2023-07-14T15:56:08.960614+0000","last_unstale":"2023-07-14T15:56:10.318283+0000","last_undegraded":"2023-07-14T15:56:10.318283+0000","last_fullsized":"2023-07-14T15:56:10.318283+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:47:05.132046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968718+0000","last_change":"2023-07-14T15:56:07.963140+0000","last_active":"2023-07-14T15:56:09.968718+0000","last_peered":"2023-07-14T15:56:09.968718+0000","last_clean":"2023-07-14T15:56:09.968718+0000","last_became_active":"2023-07-14T15:56:07.962450+0000","last_became_peered":"2023-07-14T15:56:07.962450+0000","last_unstale":"2023-07-14T15:56:09.968718+0000","last_undegraded":"2023-07-14T15:56:09.968718+0000","last_fullsized":"2023-07-14T15:56:09.968718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:16:19.549915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.970237+0000","last_change":"2023-07-14T15:56:08.982827+0000","last_active":"2023-07-14T15:56:09.970237+0000","last_peered":"2023-07-14T15:56:09.970237+0000","last_clean":"2023-07-14T15:56:09.970237+0000","last_became_active":"2023-07-14T15:56:08.982548+0000","last_became_peered":"2023-07-14T15:56:08.982548+0000","last_unstale":"2023-07-14T15:56:09.970237+0000","last_undegraded":"2023-07-14T15:56:09.970237+0000","last_fullsized":"2023-07-14T15:56:09.970237+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:11:32.675035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969543+0000","last_change":"2023-07-14T15:56:07.974534+0000","last_active":"2023-07-14T15:56:09.969543+0000","last_peered":"2023-07-14T15:56:09.969543+0000","last_clean":"2023-07-14T15:56:09.969543+0000","last_became_active":"2023-07-14T15:56:07.974303+0000","last_became_peered":"2023-07-14T15:56:07.974303+0000","last_unstale":"2023-07-14T15:56:09.969543+0000","last_undegraded":"2023-07-14T15:56:09.969543+0000","last_fullsized":"2023-07-14T15:56:09.969543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:12:08.491508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489120+0000","last_change":"2023-07-14T15:56:08.972999+0000","last_active":"2023-07-14T15:56:10.489120+0000","last_peered":"2023-07-14T15:56:10.489120+0000","last_clean":"2023-07-14T15:56:10.489120+0000","last_became_active":"2023-07-14T15:56:08.972737+0000","last_became_peered":"2023-07-14T15:56:08.972737+0000","last_unstale":"2023-07-14T15:56:10.489120+0000","last_undegraded":"2023-07-14T15:56:10.489120+0000","last_fullsized":"2023-07-14T15:56:10.489120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:31:46.923553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.490157+0000","last_change":"2023-07-14T15:56:07.970831+0000","last_active":"2023-07-14T15:56:10.490157+0000","last_peered":"2023-07-14T15:56:10.490157+0000","last_clean":"2023-07-14T15:56:10.490157+0000","last_became_active":"2023-07-14T15:56:07.970450+0000","last_became_peered":"2023-07-14T15:56:07.970450+0000","last_unstale":"2023-07-14T15:56:10.490157+0000","last_undegraded":"2023-07-14T15:56:10.490157+0000","last_fullsized":"2023-07-14T15:56:10.490157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:20:57.146500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.317671+0000","last_change":"2023-07-14T15:56:08.969440+0000","last_active":"2023-07-14T15:56:10.317671+0000","last_peered":"2023-07-14T15:56:10.317671+0000","last_clean":"2023-07-14T15:56:10.317671+0000","last_became_active":"2023-07-14T15:56:08.966859+0000","last_became_peered":"2023-07-14T15:56:08.966859+0000","last_unstale":"2023-07-14T15:56:10.317671+0000","last_undegraded":"2023-07-14T15:56:10.317671+0000","last_fullsized":"2023-07-14T15:56:10.317671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:22:06.842480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"24'3","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968598+0000","last_change":"2023-07-14T15:56:07.964545+0000","last_active":"2023-07-14T15:56:09.968598+0000","last_peered":"2023-07-14T15:56:09.968598+0000","last_clean":"2023-07-14T15:56:09.968598+0000","last_became_active":"2023-07-14T15:56:07.963768+0000","last_became_peered":"2023-07-14T15:56:07.963768+0000","last_unstale":"2023-07-14T15:56:09.968598+0000","last_undegraded":"2023-07-14T15:56:09.968598+0000","last_fullsized":"2023-07-14T15:56:09.968598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:47:20.344379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.318158+0000","last_change":"2023-07-14T15:56:08.970241+0000","last_active":"2023-07-14T15:56:10.318158+0000","last_peered":"2023-07-14T15:56:10.318158+0000","last_clean":"2023-07-14T15:56:10.318158+0000","last_became_active":"2023-07-14T15:56:08.969947+0000","last_became_peered":"2023-07-14T15:56:08.969947+0000","last_unstale":"2023-07-14T15:56:10.318158+0000","last_undegraded":"2023-07-14T15:56:10.318158+0000","last_fullsized":"2023-07-14T15:56:10.318158+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:10:40.403063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"24'6","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969540+0000","last_change":"2023-07-14T15:56:07.970523+0000","last_active":"2023-07-14T15:56:09.969540+0000","last_peered":"2023-07-14T15:56:09.969540+0000","last_clean":"2023-07-14T15:56:09.969540+0000","last_became_active":"2023-07-14T15:56:07.970142+0000","last_became_peered":"2023-07-14T15:56:07.970142+0000","last_unstale":"2023-07-14T15:56:09.969540+0000","last_undegraded":"2023-07-14T15:56:09.969540+0000","last_fullsized":"2023-07-14T15:56:09.969540+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:47:08.966111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489691+0000","last_change":"2023-07-14T15:56:08.969130+0000","last_active":"2023-07-14T15:56:10.489691+0000","last_peered":"2023-07-14T15:56:10.489691+0000","last_clean":"2023-07-14T15:56:10.489691+0000","last_became_active":"2023-07-14T15:56:08.968814+0000","last_became_peered":"2023-07-14T15:56:08.968814+0000","last_unstale":"2023-07-14T15:56:10.489691+0000","last_undegraded":"2023-07-14T15:56:10.489691+0000","last_fullsized":"2023-07-14T15:56:10.489691+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:28:16.724128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969426+0000","last_change":"2023-07-14T15:56:07.970235+0000","last_active":"2023-07-14T15:56:09.969426+0000","last_peered":"2023-07-14T15:56:09.969426+0000","last_clean":"2023-07-14T15:56:09.969426+0000","last_became_active":"2023-07-14T15:56:07.969938+0000","last_became_peered":"2023-07-14T15:56:07.969938+0000","last_unstale":"2023-07-14T15:56:09.969426+0000","last_undegraded":"2023-07-14T15:56:09.969426+0000","last_fullsized":"2023-07-14T15:56:09.969426+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:03:38.271024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489380+0000","last_change":"2023-07-14T15:56:08.980388+0000","last_active":"2023-07-14T15:56:10.489380+0000","last_peered":"2023-07-14T15:56:10.489380+0000","last_clean":"2023-07-14T15:56:10.489380+0000","last_became_active":"2023-07-14T15:56:08.980080+0000","last_became_peered":"2023-07-14T15:56:08.980080+0000","last_unstale":"2023-07-14T15:56:10.489380+0000","last_undegraded":"2023-07-14T15:56:10.489380+0000","last_fullsized":"2023-07-14T15:56:10.489380+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:20:12.345478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489365+0000","last_change":"2023-07-14T15:56:07.975515+0000","last_active":"2023-07-14T15:56:10.489365+0000","last_peered":"2023-07-14T15:56:10.489365+0000","last_clean":"2023-07-14T15:56:10.489365+0000","last_became_active":"2023-07-14T15:56:07.975155+0000","last_became_peered":"2023-07-14T15:56:07.975155+0000","last_unstale":"2023-07-14T15:56:10.489365+0000","last_undegraded":"2023-07-14T15:56:10.489365+0000","last_fullsized":"2023-07-14T15:56:10.489365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:33:36.247286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.970018+0000","last_change":"2023-07-14T15:56:08.970329+0000","last_active":"2023-07-14T15:56:09.970018+0000","last_peered":"2023-07-14T15:56:09.970018+0000","last_clean":"2023-07-14T15:56:09.970018+0000","last_became_active":"2023-07-14T15:56:08.970021+0000","last_became_peered":"2023-07-14T15:56:08.970021+0000","last_unstale":"2023-07-14T15:56:09.970018+0000","last_undegraded":"2023-07-14T15:56:09.970018+0000","last_fullsized":"2023-07-14T15:56:09.970018+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:59:48.587072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968889+0000","last_change":"2023-07-14T15:56:07.970580+0000","last_active":"2023-07-14T15:56:09.968889+0000","last_peered":"2023-07-14T15:56:09.968889+0000","last_clean":"2023-07-14T15:56:09.968889+0000","last_became_active":"2023-07-14T15:56:07.970015+0000","last_became_peered":"2023-07-14T15:56:07.970015+0000","last_unstale":"2023-07-14T15:56:09.968889+0000","last_undegraded":"2023-07-14T15:56:09.968889+0000","last_fullsized":"2023-07-14T15:56:09.968889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:14:44.479408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969220+0000","last_change":"2023-07-14T15:56:08.980174+0000","last_active":"2023-07-14T15:56:09.969220+0000","last_peered":"2023-07-14T15:56:09.969220+0000","last_clean":"2023-07-14T15:56:09.969220+0000","last_became_active":"2023-07-14T15:56:08.979596+0000","last_became_peered":"2023-07-14T15:56:08.979596+0000","last_unstale":"2023-07-14T15:56:09.969220+0000","last_undegraded":"2023-07-14T15:56:09.969220+0000","last_fullsized":"2023-07-14T15:56:09.969220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:15:28.458174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"24'8","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489443+0000","last_change":"2023-07-14T15:56:07.968155+0000","last_active":"2023-07-14T15:56:10.489443+0000","last_peered":"2023-07-14T15:56:10.489443+0000","last_clean":"2023-07-14T15:56:10.489443+0000","last_became_active":"2023-07-14T15:56:07.967859+0000","last_became_peered":"2023-07-14T15:56:07.967859+0000","last_unstale":"2023-07-14T15:56:10.489443+0000","last_undegraded":"2023-07-14T15:56:10.489443+0000","last_fullsized":"2023-07-14T15:56:10.489443+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:15:27.451548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969509+0000","last_change":"2023-07-14T15:56:08.977704+0000","last_active":"2023-07-14T15:56:09.969509+0000","last_peered":"2023-07-14T15:56:09.969509+0000","last_clean":"2023-07-14T15:56:09.969509+0000","last_became_active":"2023-07-14T15:56:08.977428+0000","last_became_peered":"2023-07-14T15:56:08.977428+0000","last_unstale":"2023-07-14T15:56:09.969509+0000","last_undegraded":"2023-07-14T15:56:09.969509+0000","last_fullsized":"2023-07-14T15:56:09.969509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:32:30.477405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"24'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969149+0000","last_change":"2023-07-14T15:56:07.967243+0000","last_active":"2023-07-14T15:56:09.969149+0000","last_peered":"2023-07-14T15:56:09.969149+0000","last_clean":"2023-07-14T15:56:09.969149+0000","last_became_active":"2023-07-14T15:56:07.966979+0000","last_became_peered":"2023-07-14T15:56:07.966979+0000","last_unstale":"2023-07-14T15:56:09.969149+0000","last_undegraded":"2023-07-14T15:56:09.969149+0000","last_fullsized":"2023-07-14T15:56:09.969149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:01:03.734490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969353+0000","last_change":"2023-07-14T15:56:08.972023+0000","last_active":"2023-07-14T15:56:09.969353+0000","last_peered":"2023-07-14T15:56:09.969353+0000","last_clean":"2023-07-14T15:56:09.969353+0000","last_became_active":"2023-07-14T15:56:08.971728+0000","last_became_peered":"2023-07-14T15:56:08.971728+0000","last_unstale":"2023-07-14T15:56:09.969353+0000","last_undegraded":"2023-07-14T15:56:09.969353+0000","last_fullsized":"2023-07-14T15:56:09.969353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:28:39.134928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.490181+0000","last_change":"2023-07-14T15:56:07.968894+0000","last_active":"2023-07-14T15:56:10.490181+0000","last_peered":"2023-07-14T15:56:10.490181+0000","last_clean":"2023-07-14T15:56:10.490181+0000","last_became_active":"2023-07-14T15:56:07.968577+0000","last_became_peered":"2023-07-14T15:56:07.968577+0000","last_unstale":"2023-07-14T15:56:10.490181+0000","last_undegraded":"2023-07-14T15:56:10.490181+0000","last_fullsized":"2023-07-14T15:56:10.490181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:45:38.253764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489497+0000","last_change":"2023-07-14T15:56:08.985023+0000","last_active":"2023-07-14T15:56:10.489497+0000","last_peered":"2023-07-14T15:56:10.489497+0000","last_clean":"2023-07-14T15:56:10.489497+0000","last_became_active":"2023-07-14T15:56:08.984743+0000","last_became_peered":"2023-07-14T15:56:08.984743+0000","last_unstale":"2023-07-14T15:56:10.489497+0000","last_undegraded":"2023-07-14T15:56:10.489497+0000","last_fullsized":"2023-07-14T15:56:10.489497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:52:49.596576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"24'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969616+0000","last_change":"2023-07-14T15:56:07.975480+0000","last_active":"2023-07-14T15:56:09.969616+0000","last_peered":"2023-07-14T15:56:09.969616+0000","last_clean":"2023-07-14T15:56:09.969616+0000","last_became_active":"2023-07-14T15:56:07.975128+0000","last_became_peered":"2023-07-14T15:56:07.975128+0000","last_unstale":"2023-07-14T15:56:09.969616+0000","last_undegraded":"2023-07-14T15:56:09.969616+0000","last_fullsized":"2023-07-14T15:56:09.969616+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:35:54.302044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489485+0000","last_change":"2023-07-14T15:56:08.971193+0000","last_active":"2023-07-14T15:56:10.489485+0000","last_peered":"2023-07-14T15:56:10.489485+0000","last_clean":"2023-07-14T15:56:10.489485+0000","last_became_active":"2023-07-14T15:56:08.970747+0000","last_became_peered":"2023-07-14T15:56:08.970747+0000","last_unstale":"2023-07-14T15:56:10.489485+0000","last_undegraded":"2023-07-14T15:56:10.489485+0000","last_fullsized":"2023-07-14T15:56:10.489485+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:47:21.351005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968901+0000","last_change":"2023-07-14T15:56:07.973033+0000","last_active":"2023-07-14T15:56:09.968901+0000","last_peered":"2023-07-14T15:56:09.968901+0000","last_clean":"2023-07-14T15:56:09.968901+0000","last_became_active":"2023-07-14T15:56:07.972707+0000","last_became_peered":"2023-07-14T15:56:07.972707+0000","last_unstale":"2023-07-14T15:56:09.968901+0000","last_undegraded":"2023-07-14T15:56:09.968901+0000","last_fullsized":"2023-07-14T15:56:09.968901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:30:23.173622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969628+0000","last_change":"2023-07-14T15:56:08.983804+0000","last_active":"2023-07-14T15:56:09.969628+0000","last_peered":"2023-07-14T15:56:09.969628+0000","last_clean":"2023-07-14T15:56:09.969628+0000","last_became_active":"2023-07-14T15:56:08.983565+0000","last_became_peered":"2023-07-14T15:56:08.983565+0000","last_unstale":"2023-07-14T15:56:09.969628+0000","last_undegraded":"2023-07-14T15:56:09.969628+0000","last_fullsized":"2023-07-14T15:56:09.969628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:23:33.554098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.b","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489252+0000","last_change":"2023-07-14T15:56:07.973408+0000","last_active":"2023-07-14T15:56:10.489252+0000","last_peered":"2023-07-14T15:56:10.489252+0000","last_clean":"2023-07-14T15:56:10.489252+0000","last_became_active":"2023-07-14T15:56:07.973090+0000","last_became_peered":"2023-07-14T15:56:07.973090+0000","last_unstale":"2023-07-14T15:56:10.489252+0000","last_undegraded":"2023-07-14T15:56:10.489252+0000","last_fullsized":"2023-07-14T15:56:10.489252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:10:08.601895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968784+0000","last_change":"2023-07-14T15:56:08.963200+0000","last_active":"2023-07-14T15:56:09.968784+0000","last_peered":"2023-07-14T15:56:09.968784+0000","last_clean":"2023-07-14T15:56:09.968784+0000","last_became_active":"2023-07-14T15:56:08.962998+0000","last_became_peered":"2023-07-14T15:56:08.962998+0000","last_unstale":"2023-07-14T15:56:09.968784+0000","last_undegraded":"2023-07-14T15:56:09.968784+0000","last_fullsized":"2023-07-14T15:56:09.968784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:38:45.760463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969028+0000","last_change":"2023-07-14T15:56:07.976310+0000","last_active":"2023-07-14T15:56:09.969028+0000","last_peered":"2023-07-14T15:56:09.969028+0000","last_clean":"2023-07-14T15:56:09.969028+0000","last_became_active":"2023-07-14T15:56:07.975997+0000","last_became_peered":"2023-07-14T15:56:07.975997+0000","last_unstale":"2023-07-14T15:56:09.969028+0000","last_undegraded":"2023-07-14T15:56:09.969028+0000","last_fullsized":"2023-07-14T15:56:09.969028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:58:04.257883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969893+0000","last_change":"2023-07-14T15:56:08.975038+0000","last_active":"2023-07-14T15:56:09.969893+0000","last_peered":"2023-07-14T15:56:09.969893+0000","last_clean":"2023-07-14T15:56:09.969893+0000","last_became_active":"2023-07-14T15:56:08.974739+0000","last_became_peered":"2023-07-14T15:56:08.974739+0000","last_unstale":"2023-07-14T15:56:09.969893+0000","last_undegraded":"2023-07-14T15:56:09.969893+0000","last_fullsized":"2023-07-14T15:56:09.969893+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:11:18.956807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968825+0000","last_change":"2023-07-14T15:56:07.969636+0000","last_active":"2023-07-14T15:56:09.968825+0000","last_peered":"2023-07-14T15:56:09.968825+0000","last_clean":"2023-07-14T15:56:09.968825+0000","last_became_active":"2023-07-14T15:56:07.969277+0000","last_became_peered":"2023-07-14T15:56:07.969277+0000","last_unstale":"2023-07-14T15:56:09.968825+0000","last_undegraded":"2023-07-14T15:56:09.968825+0000","last_fullsized":"2023-07-14T15:56:09.968825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:16:33.190367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.490104+0000","last_change":"2023-07-14T15:56:08.961767+0000","last_active":"2023-07-14T15:56:10.490104+0000","last_peered":"2023-07-14T15:56:10.490104+0000","last_clean":"2023-07-14T15:56:10.490104+0000","last_became_active":"2023-07-14T15:56:08.961258+0000","last_became_peered":"2023-07-14T15:56:08.961258+0000","last_unstale":"2023-07-14T15:56:10.490104+0000","last_undegraded":"2023-07-14T15:56:10.490104+0000","last_fullsized":"2023-07-14T15:56:10.490104+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:12:21.171093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.317923+0000","last_change":"2023-07-14T15:56:07.971828+0000","last_active":"2023-07-14T15:56:10.317923+0000","last_peered":"2023-07-14T15:56:10.317923+0000","last_clean":"2023-07-14T15:56:10.317923+0000","last_became_active":"2023-07-14T15:56:07.971500+0000","last_became_peered":"2023-07-14T15:56:07.971500+0000","last_unstale":"2023-07-14T15:56:10.317923+0000","last_undegraded":"2023-07-14T15:56:10.317923+0000","last_fullsized":"2023-07-14T15:56:10.317923+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:54:18.286729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489687+0000","last_change":"2023-07-14T15:56:08.978423+0000","last_active":"2023-07-14T15:56:10.489687+0000","last_peered":"2023-07-14T15:56:10.489687+0000","last_clean":"2023-07-14T15:56:10.489687+0000","last_became_active":"2023-07-14T15:56:08.978126+0000","last_became_peered":"2023-07-14T15:56:08.978126+0000","last_unstale":"2023-07-14T15:56:10.489687+0000","last_undegraded":"2023-07-14T15:56:10.489687+0000","last_fullsized":"2023-07-14T15:56:10.489687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:29:32.279704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969494+0000","last_change":"2023-07-14T15:56:02.621850+0000","last_active":"2023-07-14T15:56:09.969494+0000","last_peered":"2023-07-14T15:56:09.969494+0000","last_clean":"2023-07-14T15:56:09.969494+0000","last_became_active":"2023-07-14T15:56:02.621471+0000","last_became_peered":"2023-07-14T15:56:02.621471+0000","last_unstale":"2023-07-14T15:56:09.969494+0000","last_undegraded":"2023-07-14T15:56:09.969494+0000","last_fullsized":"2023-07-14T15:56:09.969494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:54:12.263158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.490008+0000","last_change":"2023-07-14T15:56:07.965851+0000","last_active":"2023-07-14T15:56:10.490008+0000","last_peered":"2023-07-14T15:56:10.490008+0000","last_clean":"2023-07-14T15:56:10.490008+0000","last_became_active":"2023-07-14T15:56:07.965312+0000","last_became_peered":"2023-07-14T15:56:07.965312+0000","last_unstale":"2023-07-14T15:56:10.490008+0000","last_undegraded":"2023-07-14T15:56:10.490008+0000","last_fullsized":"2023-07-14T15:56:10.490008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:01:03.734490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.488879+0000","last_change":"2023-07-14T15:56:08.974753+0000","last_active":"2023-07-14T15:56:10.488879+0000","last_peered":"2023-07-14T15:56:10.488879+0000","last_clean":"2023-07-14T15:56:10.488879+0000","last_became_active":"2023-07-14T15:56:08.974482+0000","last_became_peered":"2023-07-14T15:56:08.974482+0000","last_unstale":"2023-07-14T15:56:10.488879+0000","last_undegraded":"2023-07-14T15:56:10.488879+0000","last_fullsized":"2023-07-14T15:56:10.488879+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:22:21.802038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969169+0000","last_change":"2023-07-14T15:56:02.621963+0000","last_active":"2023-07-14T15:56:09.969169+0000","last_peered":"2023-07-14T15:56:09.969169+0000","last_clean":"2023-07-14T15:56:09.969169+0000","last_became_active":"2023-07-14T15:56:02.621678+0000","last_became_peered":"2023-07-14T15:56:02.621678+0000","last_unstale":"2023-07-14T15:56:09.969169+0000","last_undegraded":"2023-07-14T15:56:09.969169+0000","last_fullsized":"2023-07-14T15:56:09.969169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:42:28.210730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968484+0000","last_change":"2023-07-14T15:56:07.970834+0000","last_active":"2023-07-14T15:56:09.968484+0000","last_peered":"2023-07-14T15:56:09.968484+0000","last_clean":"2023-07-14T15:56:09.968484+0000","last_became_active":"2023-07-14T15:56:07.970464+0000","last_became_peered":"2023-07-14T15:56:07.970464+0000","last_unstale":"2023-07-14T15:56:09.968484+0000","last_undegraded":"2023-07-14T15:56:09.968484+0000","last_fullsized":"2023-07-14T15:56:09.968484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:00:38.398401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489620+0000","last_change":"2023-07-14T15:56:08.974479+0000","last_active":"2023-07-14T15:56:10.489620+0000","last_peered":"2023-07-14T15:56:10.489620+0000","last_clean":"2023-07-14T15:56:10.489620+0000","last_became_active":"2023-07-14T15:56:08.974197+0000","last_became_peered":"2023-07-14T15:56:08.974197+0000","last_unstale":"2023-07-14T15:56:10.489620+0000","last_undegraded":"2023-07-14T15:56:10.489620+0000","last_fullsized":"2023-07-14T15:56:10.489620+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:10:08.144011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489381+0000","last_change":"2023-07-14T15:56:01.925110+0000","last_active":"2023-07-14T15:56:10.489381+0000","last_peered":"2023-07-14T15:56:10.489381+0000","last_clean":"2023-07-14T15:56:10.489381+0000","last_became_active":"2023-07-14T15:56:01.924723+0000","last_became_peered":"2023-07-14T15:56:01.924723+0000","last_unstale":"2023-07-14T15:56:10.489381+0000","last_undegraded":"2023-07-14T15:56:10.489381+0000","last_fullsized":"2023-07-14T15:56:10.489381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:33:30.223715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968791+0000","last_change":"2023-07-14T15:56:07.971753+0000","last_active":"2023-07-14T15:56:09.968791+0000","last_peered":"2023-07-14T15:56:09.968791+0000","last_clean":"2023-07-14T15:56:09.968791+0000","last_became_active":"2023-07-14T15:56:07.971447+0000","last_became_peered":"2023-07-14T15:56:07.971447+0000","last_unstale":"2023-07-14T15:56:09.968791+0000","last_undegraded":"2023-07-14T15:56:09.968791+0000","last_fullsized":"2023-07-14T15:56:09.968791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:14:57.078074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489621+0000","last_change":"2023-07-14T15:56:08.981489+0000","last_active":"2023-07-14T15:56:10.489621+0000","last_peered":"2023-07-14T15:56:10.489621+0000","last_clean":"2023-07-14T15:56:10.489621+0000","last_became_active":"2023-07-14T15:56:08.981064+0000","last_became_peered":"2023-07-14T15:56:08.981064+0000","last_unstale":"2023-07-14T15:56:10.489621+0000","last_undegraded":"2023-07-14T15:56:10.489621+0000","last_fullsized":"2023-07-14T15:56:10.489621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:09:43.406898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968541+0000","last_change":"2023-07-14T15:56:01.923465+0000","last_active":"2023-07-14T15:56:09.968541+0000","last_peered":"2023-07-14T15:56:09.968541+0000","last_clean":"2023-07-14T15:56:09.968541+0000","last_became_active":"2023-07-14T15:56:01.923160+0000","last_became_peered":"2023-07-14T15:56:01.923160+0000","last_unstale":"2023-07-14T15:56:09.968541+0000","last_undegraded":"2023-07-14T15:56:09.968541+0000","last_fullsized":"2023-07-14T15:56:09.968541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:50:40.374649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":175,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489184+0000","last_change":"2023-07-14T15:55:54.040065+0000","last_active":"2023-07-14T15:56:10.489184+0000","last_peered":"2023-07-14T15:56:10.489184+0000","last_clean":"2023-07-14T15:56:10.489184+0000","last_became_active":"2023-07-14T15:55:54.038885+0000","last_became_peered":"2023-07-14T15:55:54.038885+0000","last_unstale":"2023-07-14T15:56:10.489184+0000","last_undegraded":"2023-07-14T15:56:10.489184+0000","last_fullsized":"2023-07-14T15:56:10.489184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:55:53.025696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:55:53.025696+0000","last_clean_scrub_stamp":"2023-07-14T15:55:53.025696+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:14:43.173657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.317859+0000","last_change":"2023-07-14T15:56:07.970931+0000","last_active":"2023-07-14T15:56:10.317859+0000","last_peered":"2023-07-14T15:56:10.317859+0000","last_clean":"2023-07-14T15:56:10.317859+0000","last_became_active":"2023-07-14T15:56:07.970576+0000","last_became_peered":"2023-07-14T15:56:07.970576+0000","last_unstale":"2023-07-14T15:56:10.317859+0000","last_undegraded":"2023-07-14T15:56:10.317859+0000","last_fullsized":"2023-07-14T15:56:10.317859+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:32:29.470779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969965+0000","last_change":"2023-07-14T15:56:08.972039+0000","last_active":"2023-07-14T15:56:09.969965+0000","last_peered":"2023-07-14T15:56:09.969965+0000","last_clean":"2023-07-14T15:56:09.969965+0000","last_became_active":"2023-07-14T15:56:08.971718+0000","last_became_peered":"2023-07-14T15:56:08.971718+0000","last_unstale":"2023-07-14T15:56:09.969965+0000","last_undegraded":"2023-07-14T15:56:09.969965+0000","last_fullsized":"2023-07-14T15:56:09.969965+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:31:57.408531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968778+0000","last_change":"2023-07-14T15:56:01.920714+0000","last_active":"2023-07-14T15:56:09.968778+0000","last_peered":"2023-07-14T15:56:09.968778+0000","last_clean":"2023-07-14T15:56:09.968778+0000","last_became_active":"2023-07-14T15:56:01.920325+0000","last_became_peered":"2023-07-14T15:56:01.920325+0000","last_unstale":"2023-07-14T15:56:09.968778+0000","last_undegraded":"2023-07-14T15:56:09.968778+0000","last_fullsized":"2023-07-14T15:56:09.968778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:03:08.403097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.488883+0000","last_change":"2023-07-14T15:56:07.970542+0000","last_active":"2023-07-14T15:56:10.488883+0000","last_peered":"2023-07-14T15:56:10.488883+0000","last_clean":"2023-07-14T15:56:10.488883+0000","last_became_active":"2023-07-14T15:56:07.970172+0000","last_became_peered":"2023-07-14T15:56:07.970172+0000","last_unstale":"2023-07-14T15:56:10.488883+0000","last_undegraded":"2023-07-14T15:56:10.488883+0000","last_fullsized":"2023-07-14T15:56:10.488883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:31:45.916927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969443+0000","last_change":"2023-07-14T15:56:08.980388+0000","last_active":"2023-07-14T15:56:09.969443+0000","last_peered":"2023-07-14T15:56:09.969443+0000","last_clean":"2023-07-14T15:56:09.969443+0000","last_became_active":"2023-07-14T15:56:08.979897+0000","last_became_peered":"2023-07-14T15:56:08.979897+0000","last_unstale":"2023-07-14T15:56:09.969443+0000","last_undegraded":"2023-07-14T15:56:09.969443+0000","last_fullsized":"2023-07-14T15:56:09.969443+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:11:49.645623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969752+0000","last_change":"2023-07-14T15:56:01.923631+0000","last_active":"2023-07-14T15:56:09.969752+0000","last_peered":"2023-07-14T15:56:09.969752+0000","last_clean":"2023-07-14T15:56:09.969752+0000","last_became_active":"2023-07-14T15:56:01.922783+0000","last_became_peered":"2023-07-14T15:56:01.922783+0000","last_unstale":"2023-07-14T15:56:09.969752+0000","last_undegraded":"2023-07-14T15:56:09.969752+0000","last_fullsized":"2023-07-14T15:56:09.969752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:27:47.642533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489594+0000","last_change":"2023-07-14T15:56:07.967762+0000","last_active":"2023-07-14T15:56:10.489594+0000","last_peered":"2023-07-14T15:56:10.489594+0000","last_clean":"2023-07-14T15:56:10.489594+0000","last_became_active":"2023-07-14T15:56:07.967471+0000","last_became_peered":"2023-07-14T15:56:07.967471+0000","last_unstale":"2023-07-14T15:56:10.489594+0000","last_undegraded":"2023-07-14T15:56:10.489594+0000","last_fullsized":"2023-07-14T15:56:10.489594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:29:31.273078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489319+0000","last_change":"2023-07-14T15:56:08.976758+0000","last_active":"2023-07-14T15:56:10.489319+0000","last_peered":"2023-07-14T15:56:10.489319+0000","last_clean":"2023-07-14T15:56:10.489319+0000","last_became_active":"2023-07-14T15:56:08.976318+0000","last_became_peered":"2023-07-14T15:56:08.976318+0000","last_unstale":"2023-07-14T15:56:10.489319+0000","last_undegraded":"2023-07-14T15:56:10.489319+0000","last_fullsized":"2023-07-14T15:56:10.489319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:18:49.883894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.318181+0000","last_change":"2023-07-14T15:56:07.967060+0000","last_active":"2023-07-14T15:56:10.318181+0000","last_peered":"2023-07-14T15:56:10.318181+0000","last_clean":"2023-07-14T15:56:10.318181+0000","last_became_active":"2023-07-14T15:56:07.966852+0000","last_became_peered":"2023-07-14T15:56:07.966852+0000","last_unstale":"2023-07-14T15:56:10.318181+0000","last_undegraded":"2023-07-14T15:56:10.318181+0000","last_fullsized":"2023-07-14T15:56:10.318181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:58:00.742453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.318071+0000","last_change":"2023-07-14T15:56:01.965649+0000","last_active":"2023-07-14T15:56:10.318071+0000","last_peered":"2023-07-14T15:56:10.318071+0000","last_clean":"2023-07-14T15:56:10.318071+0000","last_became_active":"2023-07-14T15:56:01.965344+0000","last_became_peered":"2023-07-14T15:56:01.965344+0000","last_unstale":"2023-07-14T15:56:10.318071+0000","last_undegraded":"2023-07-14T15:56:10.318071+0000","last_fullsized":"2023-07-14T15:56:10.318071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:23:26.523901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.317808+0000","last_change":"2023-07-14T15:56:08.961123+0000","last_active":"2023-07-14T15:56:10.317808+0000","last_peered":"2023-07-14T15:56:10.317808+0000","last_clean":"2023-07-14T15:56:10.317808+0000","last_became_active":"2023-07-14T15:56:08.960675+0000","last_became_peered":"2023-07-14T15:56:08.960675+0000","last_unstale":"2023-07-14T15:56:10.317808+0000","last_undegraded":"2023-07-14T15:56:10.317808+0000","last_fullsized":"2023-07-14T15:56:10.317808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:11:49.645623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.970285+0000","last_change":"2023-07-14T15:56:01.966578+0000","last_active":"2023-07-14T15:56:09.970285+0000","last_peered":"2023-07-14T15:56:09.970285+0000","last_clean":"2023-07-14T15:56:09.970285+0000","last_became_active":"2023-07-14T15:56:01.966216+0000","last_became_peered":"2023-07-14T15:56:01.966216+0000","last_unstale":"2023-07-14T15:56:09.970285+0000","last_undegraded":"2023-07-14T15:56:09.970285+0000","last_fullsized":"2023-07-14T15:56:09.970285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:16:28.116727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.318279+0000","last_change":"2023-07-14T15:56:07.970881+0000","last_active":"2023-07-14T15:56:10.318279+0000","last_peered":"2023-07-14T15:56:10.318279+0000","last_clean":"2023-07-14T15:56:10.318279+0000","last_became_active":"2023-07-14T15:56:07.970596+0000","last_became_peered":"2023-07-14T15:56:07.970596+0000","last_unstale":"2023-07-14T15:56:10.318279+0000","last_undegraded":"2023-07-14T15:56:10.318279+0000","last_fullsized":"2023-07-14T15:56:10.318279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:29:12.393151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489389+0000","last_change":"2023-07-14T15:56:08.964323+0000","last_active":"2023-07-14T15:56:10.489389+0000","last_peered":"2023-07-14T15:56:10.489389+0000","last_clean":"2023-07-14T15:56:10.489389+0000","last_became_active":"2023-07-14T15:56:08.964024+0000","last_became_peered":"2023-07-14T15:56:08.964024+0000","last_unstale":"2023-07-14T15:56:10.489389+0000","last_undegraded":"2023-07-14T15:56:10.489389+0000","last_fullsized":"2023-07-14T15:56:10.489389+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:00:39.405027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"24'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.317703+0000","last_change":"2023-07-14T15:56:07.965044+0000","last_active":"2023-07-14T15:56:10.317703+0000","last_peered":"2023-07-14T15:56:10.317703+0000","last_clean":"2023-07-14T15:56:10.317703+0000","last_became_active":"2023-07-14T15:56:07.964585+0000","last_became_peered":"2023-07-14T15:56:07.964585+0000","last_unstale":"2023-07-14T15:56:10.317703+0000","last_undegraded":"2023-07-14T15:56:10.317703+0000","last_fullsized":"2023-07-14T15:56:10.317703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:59:56.654841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.318165+0000","last_change":"2023-07-14T15:56:08.972801+0000","last_active":"2023-07-14T15:56:10.318165+0000","last_peered":"2023-07-14T15:56:10.318165+0000","last_clean":"2023-07-14T15:56:10.318165+0000","last_became_active":"2023-07-14T15:56:08.972481+0000","last_became_peered":"2023-07-14T15:56:08.972481+0000","last_unstale":"2023-07-14T15:56:10.318165+0000","last_undegraded":"2023-07-14T15:56:10.318165+0000","last_fullsized":"2023-07-14T15:56:10.318165+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:35:57.456677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.490013+0000","last_change":"2023-07-14T15:56:07.968681+0000","last_active":"2023-07-14T15:56:10.490013+0000","last_peered":"2023-07-14T15:56:10.490013+0000","last_clean":"2023-07-14T15:56:10.490013+0000","last_became_active":"2023-07-14T15:56:07.968350+0000","last_became_peered":"2023-07-14T15:56:07.968350+0000","last_unstale":"2023-07-14T15:56:10.490013+0000","last_undegraded":"2023-07-14T15:56:10.490013+0000","last_fullsized":"2023-07-14T15:56:10.490013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:12:08.491508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489567+0000","last_change":"2023-07-14T15:56:08.987218+0000","last_active":"2023-07-14T15:56:10.489567+0000","last_peered":"2023-07-14T15:56:10.489567+0000","last_clean":"2023-07-14T15:56:10.489567+0000","last_became_active":"2023-07-14T15:56:08.986928+0000","last_became_peered":"2023-07-14T15:56:08.986928+0000","last_unstale":"2023-07-14T15:56:10.489567+0000","last_undegraded":"2023-07-14T15:56:10.489567+0000","last_fullsized":"2023-07-14T15:56:10.489567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:38:45.760463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969829+0000","last_change":"2023-07-14T15:56:07.971194+0000","last_active":"2023-07-14T15:56:09.969829+0000","last_peered":"2023-07-14T15:56:09.969829+0000","last_clean":"2023-07-14T15:56:09.969829+0000","last_became_active":"2023-07-14T15:56:07.970215+0000","last_became_peered":"2023-07-14T15:56:07.970215+0000","last_unstale":"2023-07-14T15:56:09.969829+0000","last_undegraded":"2023-07-14T15:56:09.969829+0000","last_fullsized":"2023-07-14T15:56:09.969829+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:57:28.541870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489443+0000","last_change":"2023-07-14T15:56:08.976795+0000","last_active":"2023-07-14T15:56:10.489443+0000","last_peered":"2023-07-14T15:56:10.489443+0000","last_clean":"2023-07-14T15:56:10.489443+0000","last_became_active":"2023-07-14T15:56:08.976405+0000","last_became_peered":"2023-07-14T15:56:08.976405+0000","last_unstale":"2023-07-14T15:56:10.489443+0000","last_undegraded":"2023-07-14T15:56:10.489443+0000","last_fullsized":"2023-07-14T15:56:10.489443+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:51:26.834028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"24'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969185+0000","last_change":"2023-07-14T15:56:07.977048+0000","last_active":"2023-07-14T15:56:09.969185+0000","last_peered":"2023-07-14T15:56:09.969185+0000","last_clean":"2023-07-14T15:56:09.969185+0000","last_became_active":"2023-07-14T15:56:07.976771+0000","last_became_peered":"2023-07-14T15:56:07.976771+0000","last_unstale":"2023-07-14T15:56:09.969185+0000","last_undegraded":"2023-07-14T15:56:09.969185+0000","last_fullsized":"2023-07-14T15:56:09.969185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:22:05.835854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489537+0000","last_change":"2023-07-14T15:56:08.976062+0000","last_active":"2023-07-14T15:56:10.489537+0000","last_peered":"2023-07-14T15:56:10.489537+0000","last_clean":"2023-07-14T15:56:10.489537+0000","last_became_active":"2023-07-14T15:56:08.975745+0000","last_became_peered":"2023-07-14T15:56:08.975745+0000","last_unstale":"2023-07-14T15:56:10.489537+0000","last_undegraded":"2023-07-14T15:56:10.489537+0000","last_fullsized":"2023-07-14T15:56:10.489537+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:20:12.345478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"24'4","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969619+0000","last_change":"2023-07-14T15:56:07.974964+0000","last_active":"2023-07-14T15:56:09.969619+0000","last_peered":"2023-07-14T15:56:09.969619+0000","last_clean":"2023-07-14T15:56:09.969619+0000","last_became_active":"2023-07-14T15:56:07.974696+0000","last_became_peered":"2023-07-14T15:56:07.974696+0000","last_unstale":"2023-07-14T15:56:09.969619+0000","last_undegraded":"2023-07-14T15:56:09.969619+0000","last_fullsized":"2023-07-14T15:56:09.969619+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:10:39.396437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489229+0000","last_change":"2023-07-14T15:56:08.962402+0000","last_active":"2023-07-14T15:56:10.489229+0000","last_peered":"2023-07-14T15:56:10.489229+0000","last_clean":"2023-07-14T15:56:10.489229+0000","last_became_active":"2023-07-14T15:56:08.962087+0000","last_became_peered":"2023-07-14T15:56:08.962087+0000","last_unstale":"2023-07-14T15:56:10.489229+0000","last_undegraded":"2023-07-14T15:56:10.489229+0000","last_fullsized":"2023-07-14T15:56:10.489229+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:51:55.348364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489873+0000","last_change":"2023-07-14T15:56:08.962047+0000","last_active":"2023-07-14T15:56:10.489873+0000","last_peered":"2023-07-14T15:56:10.489873+0000","last_clean":"2023-07-14T15:56:10.489873+0000","last_became_active":"2023-07-14T15:56:08.961657+0000","last_became_peered":"2023-07-14T15:56:08.961657+0000","last_unstale":"2023-07-14T15:56:10.489873+0000","last_undegraded":"2023-07-14T15:56:10.489873+0000","last_fullsized":"2023-07-14T15:56:10.489873+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:32:30.477405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.488979+0000","last_change":"2023-07-14T15:56:08.979917+0000","last_active":"2023-07-14T15:56:10.488979+0000","last_peered":"2023-07-14T15:56:10.488979+0000","last_clean":"2023-07-14T15:56:10.488979+0000","last_became_active":"2023-07-14T15:56:08.979617+0000","last_became_peered":"2023-07-14T15:56:08.979617+0000","last_unstale":"2023-07-14T15:56:10.488979+0000","last_undegraded":"2023-07-14T15:56:10.488979+0000","last_fullsized":"2023-07-14T15:56:10.488979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:10:09.608521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968216+0000","last_change":"2023-07-14T15:56:08.971350+0000","last_active":"2023-07-14T15:56:09.968216+0000","last_peered":"2023-07-14T15:56:09.968216+0000","last_clean":"2023-07-14T15:56:09.968216+0000","last_became_active":"2023-07-14T15:56:08.970957+0000","last_became_peered":"2023-07-14T15:56:08.970957+0000","last_unstale":"2023-07-14T15:56:09.968216+0000","last_undegraded":"2023-07-14T15:56:09.968216+0000","last_fullsized":"2023-07-14T15:56:09.968216+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:02:13.093743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969481+0000","last_change":"2023-07-14T15:56:08.968381+0000","last_active":"2023-07-14T15:56:09.969481+0000","last_peered":"2023-07-14T15:56:09.969481+0000","last_clean":"2023-07-14T15:56:09.969481+0000","last_became_active":"2023-07-14T15:56:08.968037+0000","last_became_peered":"2023-07-14T15:56:08.968037+0000","last_unstale":"2023-07-14T15:56:09.969481+0000","last_undegraded":"2023-07-14T15:56:09.969481+0000","last_fullsized":"2023-07-14T15:56:09.969481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:36:15.019527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969340+0000","last_change":"2023-07-14T15:56:08.960651+0000","last_active":"2023-07-14T15:56:09.969340+0000","last_peered":"2023-07-14T15:56:09.969340+0000","last_clean":"2023-07-14T15:56:09.969340+0000","last_became_active":"2023-07-14T15:56:08.960387+0000","last_became_peered":"2023-07-14T15:56:08.960387+0000","last_unstale":"2023-07-14T15:56:09.969340+0000","last_undegraded":"2023-07-14T15:56:09.969340+0000","last_fullsized":"2023-07-14T15:56:09.969340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:59:57.661468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476743,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":96845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]},{"osd":0,"up_from":16,"seq":68719476744,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":95323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":258048,"data_stored":95267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":860160,"data_stored":686219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]}]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":96741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]}]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":253952,"data_stored":95177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]}]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":851968,"data_stored":686127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.085}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]}]},{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":253952,"data_stored":95177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T15:56:18.869 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-14T15:56:18.870 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-07-14T15:56:18.870 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-07-14T15:56:18.870 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-07-14T15:56:18.871 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-07-14T15:56:19.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.119+0000 7fe1f07ff700 1 Processor -- start 2023-07-14T15:56:19.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.119+0000 7fe1f07ff700 1 -- start start 2023-07-14T15:56:19.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.120+0000 7fe1f07ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe1e80b54b0 0x7fe1e80cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:19.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.120+0000 7fe1f07ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1e80cf6b0 con 0x7fe1e80b4910 2023-07-14T15:56:19.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.120+0000 7fe1f07ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1e80cdc40 con 0x7fe1e80b85f0 2023-07-14T15:56:19.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.120+0000 7fe1f07ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1e80cf0a0 con 0x7fe1e80b54b0 2023-07-14T15:56:19.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.121+0000 7fe1eed9c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe1e80b4910 0x7fe1e80b4d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36802/0 (socket says 172.21.15.37:36802) 2023-07-14T15:56:19.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.121+0000 7fe1eed9c700 1 -- 172.21.15.37:0/3604671864 learned_addr learned my addr 172.21.15.37:0/3604671864 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:19.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.121+0000 7fe1edd9a700 1 --2- 172.21.15.37:0/3604671864 >> v2:172.21.15.98:3300/0 conn(0x7fe1e80b54b0 0x7fe1e80cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:19.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.121+0000 7fe1ed599700 1 -- 172.21.15.37:0/3604671864 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1808816783 0 0) 0x7fe1e80cf6b0 con 0x7fe1e80b4910 2023-07-14T15:56:19.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.121+0000 7fe1ed599700 1 -- 172.21.15.37:0/3604671864 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1d40035b0 con 0x7fe1e80b4910 2023-07-14T15:56:19.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.121+0000 7fe1edd9a700 1 -- 172.21.15.37:0/3604671864 >> v1:172.21.15.98:6789/0 conn(0x7fe1e80b85f0 legacy=0x7fe1e815d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:19.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.121+0000 7fe1edd9a700 1 -- 172.21.15.37:0/3604671864 >> v1:172.21.15.37:6789/0 conn(0x7fe1e80b4910 legacy=0x7fe1e80b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:19.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.121+0000 7fe1edd9a700 1 -- 172.21.15.37:0/3604671864 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e80b89c0 con 0x7fe1e80b54b0 2023-07-14T15:56:19.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.121+0000 7fe1edd9a700 1 --2- 172.21.15.37:0/3604671864 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1e80b54b0 0x7fe1e80cfb40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8009840 tx=0x7fe1d8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28ea57d8beb1db59 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:19.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.122+0000 7fe1ed599700 1 -- 172.21.15.37:0/3604671864 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d8011830 con 0x7fe1e80b54b0 2023-07-14T15:56:19.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.122+0000 7fe1ed599700 1 -- 172.21.15.37:0/3604671864 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d8011990 con 0x7fe1e80b54b0 2023-07-14T15:56:19.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.122+0000 7fe1ed599700 1 -- 172.21.15.37:0/3604671864 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d8011d20 con 0x7fe1e80b54b0 2023-07-14T15:56:19.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.122+0000 7fe1f07ff700 1 -- 172.21.15.37:0/3604671864 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1e80b54b0 msgr2=0x7fe1e80cfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:19.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.122+0000 7fe1f07ff700 1 --2- 172.21.15.37:0/3604671864 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1e80b54b0 0x7fe1e80cfb40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8009840 tx=0x7fe1d8009b50 comp rx=0 tx=0).stop 2023-07-14T15:56:19.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.122+0000 7fe1f07ff700 1 -- 172.21.15.37:0/3604671864 shutdown_connections 2023-07-14T15:56:19.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.122+0000 7fe1f07ff700 1 --2- 172.21.15.37:0/3604671864 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1e80b54b0 0x7fe1e80cfb40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:19.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.122+0000 7fe1f07ff700 1 -- 172.21.15.37:0/3604671864 >> 172.21.15.37:0/3604671864 conn(0x7fe1e806a580 msgr2=0x7fe1e806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:19.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.122+0000 7fe1f07ff700 1 -- 172.21.15.37:0/3604671864 shutdown_connections 2023-07-14T15:56:19.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.123+0000 7fe1f07ff700 1 -- 172.21.15.37:0/3604671864 wait complete. 2023-07-14T15:56:19.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.124+0000 7fe1f07ff700 1 Processor -- start 2023-07-14T15:56:19.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.125+0000 7fe1f07ff700 1 -- start start 2023-07-14T15:56:19.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.125+0000 7fe1f07ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe1e80b4910 0x7fe1e80cb490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:19.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.125+0000 7fe1f07ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1e80b54b0 0x7fe1e80cb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:19.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.125+0000 7fe1f07ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1e80b85f0 0x7fe1e815e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:19.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.126+0000 7fe1f07ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e80c6d20 con 0x7fe1e80b54b0 2023-07-14T15:56:19.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.126+0000 7fe1f07ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e80c7000 con 0x7fe1e80b85f0 2023-07-14T15:56:19.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.126+0000 7fe1f07ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e80c72e0 con 0x7fe1e80b4910 2023-07-14T15:56:19.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.126+0000 7fe1edd9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1e80b54b0 0x7fe1e80cb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:19.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.126+0000 7fe1edd9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1e80b54b0 0x7fe1e80cb9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60530/0 (socket says 172.21.15.37:60530) 2023-07-14T15:56:19.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.126+0000 7fe1edd9a700 1 -- 172.21.15.37:0/3218040033 learned_addr learned my addr 172.21.15.37:0/3218040033 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:19.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.126+0000 7fe1ee59b700 1 --2- 172.21.15.37:0/3218040033 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe1e80b4910 0x7fe1e80cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:19.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.126+0000 7fe1eed9c700 1 --2- 172.21.15.37:0/3218040033 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1e80b85f0 0x7fe1e815e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:19.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.126+0000 7fe1edd9a700 1 -- 172.21.15.37:0/3218040033 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe1e80b4910 msgr2=0x7fe1e80cb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:19.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.126+0000 7fe1edd9a700 1 --2- 172.21.15.37:0/3218040033 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe1e80b4910 0x7fe1e80cb490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:19.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.126+0000 7fe1edd9a700 1 -- 172.21.15.37:0/3218040033 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1e80b85f0 msgr2=0x7fe1e815e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:19.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.126+0000 7fe1edd9a700 1 --2- 172.21.15.37:0/3218040033 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1e80b85f0 0x7fe1e815e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:19.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.126+0000 7fe1edd9a700 1 -- 172.21.15.37:0/3218040033 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d80094a0 con 0x7fe1e80b54b0 2023-07-14T15:56:19.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.126+0000 7fe1ee59b700 1 --2- 172.21.15.37:0/3218040033 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe1e80b4910 0x7fe1e80cb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:56:19.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.126+0000 7fe1edd9a700 1 --2- 172.21.15.37:0/3218040033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1e80b54b0 0x7fe1e80cb9d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8009fd0 tx=0x7fe1d8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:19.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.127+0000 7fe1deffd700 1 -- 172.21.15.37:0/3218040033 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d80038a0 con 0x7fe1e80b54b0 2023-07-14T15:56:19.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.127+0000 7fe1deffd700 1 -- 172.21.15.37:0/3218040033 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d801f070 con 0x7fe1e80b54b0 2023-07-14T15:56:19.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.127+0000 7fe1f07ff700 1 -- 172.21.15.37:0/3218040033 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1e80c75c0 con 0x7fe1e80b54b0 2023-07-14T15:56:19.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.127+0000 7fe1deffd700 1 -- 172.21.15.37:0/3218040033 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d8003c40 con 0x7fe1e80b54b0 2023-07-14T15:56:19.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.127+0000 7fe1f07ff700 1 -- 172.21.15.37:0/3218040033 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e80c6980 con 0x7fe1e80b54b0 2023-07-14T15:56:19.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.128+0000 7fe1f07ff700 1 -- 172.21.15.37:0/3218040033 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1e8067840 con 0x7fe1e80b54b0 2023-07-14T15:56:19.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.129+0000 7fe1deffd700 1 -- 172.21.15.37:0/3218040033 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe1d8026480 con 0x7fe1e80b54b0 2023-07-14T15:56:19.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.130+0000 7fe1deffd700 1 --2- 172.21.15.37:0/3218040033 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe1cc06ace0 0x7fe1cc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:19.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.130+0000 7fe1deffd700 1 -- 172.21.15.37:0/3218040033 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe1d8021070 con 0x7fe1e80b54b0 2023-07-14T15:56:19.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.130+0000 7fe1ee59b700 1 --2- 172.21.15.37:0/3218040033 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe1cc06ace0 0x7fe1cc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:19.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.131+0000 7fe1ee59b700 1 --2- 172.21.15.37:0/3218040033 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe1cc06ace0 0x7fe1cc06d190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4000f60 tx=0x7fe1e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:19.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.134+0000 7fe1deffd700 1 -- 172.21.15.37:0/3218040033 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe1d8055e90 con 0x7fe1e80b54b0 2023-07-14T15:56:19.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.397+0000 7fe1f07ff700 1 -- 172.21.15.37:0/3218040033 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fe1e806b440 con 0x7fe1e80b54b0 2023-07-14T15:56:19.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.401+0000 7fe1deffd700 1 -- 172.21.15.37:0/3218040033 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170841 (secure 0 0 0) 0x7fe1d8015090 con 0x7fe1e80b54b0 2023-07-14T15:56:19.390 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:56:19.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.404+0000 7fe1f07ff700 1 -- 172.21.15.37:0/3218040033 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe1cc06ace0 msgr2=0x7fe1cc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:19.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.404+0000 7fe1f07ff700 1 --2- 172.21.15.37:0/3218040033 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe1cc06ace0 0x7fe1cc06d190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4000f60 tx=0x7fe1e4009040 comp rx=0 tx=0).stop 2023-07-14T15:56:19.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.404+0000 7fe1f07ff700 1 -- 172.21.15.37:0/3218040033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1e80b54b0 msgr2=0x7fe1e80cb9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:19.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.404+0000 7fe1f07ff700 1 --2- 172.21.15.37:0/3218040033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1e80b54b0 0x7fe1e80cb9d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8009fd0 tx=0x7fe1d8004750 comp rx=0 tx=0).stop 2023-07-14T15:56:19.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.405+0000 7fe1f07ff700 1 -- 172.21.15.37:0/3218040033 shutdown_connections 2023-07-14T15:56:19.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.405+0000 7fe1f07ff700 1 --2- 172.21.15.37:0/3218040033 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1e80b85f0 0x7fe1e815e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:19.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.405+0000 7fe1f07ff700 1 --2- 172.21.15.37:0/3218040033 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe1cc06ace0 0x7fe1cc06d190 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:19.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.405+0000 7fe1f07ff700 1 --2- 172.21.15.37:0/3218040033 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe1e80b4910 0x7fe1e80cb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:19.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.405+0000 7fe1f07ff700 1 --2- 172.21.15.37:0/3218040033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1e80b54b0 0x7fe1e80cb9d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:19.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.405+0000 7fe1f07ff700 1 -- 172.21.15.37:0/3218040033 >> 172.21.15.37:0/3218040033 conn(0x7fe1e806a580 msgr2=0x7fe1e80d0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:19.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.405+0000 7fe1f07ff700 1 -- 172.21.15.37:0/3218040033 shutdown_connections 2023-07-14T15:56:19.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.405+0000 7fe1f07ff700 1 -- 172.21.15.37:0/3218040033 wait complete. 2023-07-14T15:56:19.410 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":5,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":3163748069},{"type":"v1","addr":"172.21.15.98:6833","nonce":3163748069}]},"active_addr":"172.21.15.98:6833/3163748069","active_change":"2023-07-14T15:55:46.838665+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4103,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.98:0","nonce":485552058}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.98:0","nonce":1868049714}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.98:0","nonce":1857890289}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.98:0","nonce":1401330811}]}]} 2023-07-14T15:56:19.414 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-07-14T15:56:19.414 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-07-14T15:56:19.415 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T15:56:19.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.628+0000 7fe5a4dff700 1 Processor -- start 2023-07-14T15:56:19.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.629+0000 7fe5a4dff700 1 -- start start 2023-07-14T15:56:19.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.630+0000 7fe5a4dff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe5a015fc00 0x7fe5a0160ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:19.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.631+0000 7fe5a4dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe5a00b4f30 0x7fe5a00d1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:19.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.631+0000 7fe5a4dff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5a00d0d80 con 0x7fe5a00cf2b0 2023-07-14T15:56:19.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.631+0000 7fe5a4dff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5a00cd520 con 0x7fe5a015fc00 2023-07-14T15:56:19.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.631+0000 7fe5a4dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a0160ff0 con 0x7fe5a00b4f30 2023-07-14T15:56:19.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.631+0000 7fe59e59c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe5a015fc00 0x7fe5a0160ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:19.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.631+0000 7fe597fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe5a00cf2b0 0x7fe5a00b4820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36810/0 (socket says 172.21.15.37:36810) 2023-07-14T15:56:19.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.631+0000 7fe597fff700 1 -- 172.21.15.37:0/2247346444 learned_addr learned my addr 172.21.15.37:0/2247346444 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:19.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.631+0000 7fe59ed9d700 1 --2- 172.21.15.37:0/2247346444 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe5a00b4f30 0x7fe5a00d1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:19.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.631+0000 7fe59e59c700 1 -- 172.21.15.37:0/2247346444 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe5a00b4f30 msgr2=0x7fe5a00d1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:19.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.631+0000 7fe59e59c700 1 --2- 172.21.15.37:0/2247346444 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe5a00b4f30 0x7fe5a00d1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:19.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.631+0000 7fe59e59c700 1 -- 172.21.15.37:0/2247346444 >> v1:172.21.15.37:6789/0 conn(0x7fe5a00cf2b0 legacy=0x7fe5a00b4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:19.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.631+0000 7fe59e59c700 1 -- 172.21.15.37:0/2247346444 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a00cd7c0 con 0x7fe5a015fc00 2023-07-14T15:56:19.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.631+0000 7fe59dd9b700 1 -- 172.21.15.37:0/2247346444 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 571316081 0 0) 0x7fe5a00d0d80 con 0x7fe5a00cf2b0 2023-07-14T15:56:19.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.632+0000 7fe59e59c700 1 --2- 172.21.15.37:0/2247346444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5a015fc00 0x7fe5a0160ab0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe590009820 tx=0x7fe590009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=275a0a4bf34c89a2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:19.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.632+0000 7fe59dd9b700 1 -- 172.21.15.37:0/2247346444 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe590005e30 con 0x7fe5a015fc00 2023-07-14T15:56:19.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.632+0000 7fe59dd9b700 1 -- 172.21.15.37:0/2247346444 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe590006030 con 0x7fe5a015fc00 2023-07-14T15:56:19.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.632+0000 7fe59dd9b700 1 -- 172.21.15.37:0/2247346444 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5900063e0 con 0x7fe5a015fc00 2023-07-14T15:56:19.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.632+0000 7fe5a4dff700 1 -- 172.21.15.37:0/2247346444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5a015fc00 msgr2=0x7fe5a0160ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:19.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.632+0000 7fe5a4dff700 1 --2- 172.21.15.37:0/2247346444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5a015fc00 0x7fe5a0160ab0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe590009820 tx=0x7fe590009b30 comp rx=0 tx=0).stop 2023-07-14T15:56:19.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.632+0000 7fe5a4dff700 1 -- 172.21.15.37:0/2247346444 shutdown_connections 2023-07-14T15:56:19.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.632+0000 7fe5a4dff700 1 --2- 172.21.15.37:0/2247346444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5a015fc00 0x7fe5a0160ab0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:19.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.632+0000 7fe5a4dff700 1 --2- 172.21.15.37:0/2247346444 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe5a00b4f30 0x7fe5a00d1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:19.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.632+0000 7fe5a4dff700 1 -- 172.21.15.37:0/2247346444 >> 172.21.15.37:0/2247346444 conn(0x7fe5a006b160 msgr2=0x7fe5a00cf820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:19.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.632+0000 7fe5a4dff700 1 -- 172.21.15.37:0/2247346444 shutdown_connections 2023-07-14T15:56:19.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.633+0000 7fe5a4dff700 1 -- 172.21.15.37:0/2247346444 wait complete. 2023-07-14T15:56:19.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.635+0000 7fe5a4dff700 1 Processor -- start 2023-07-14T15:56:19.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.635+0000 7fe5a4dff700 1 -- start start 2023-07-14T15:56:19.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.636+0000 7fe5a4dff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5a00b4f30 0x7fe5a00b8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:19.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.636+0000 7fe5a4dff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5a00cf2b0 0x7fe5a00c9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:19.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.636+0000 7fe5a4dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe5a015fc00 0x7fe5a0156e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:19.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.636+0000 7fe5a4dff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a00c7680 con 0x7fe5a00cf2b0 2023-07-14T15:56:19.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.636+0000 7fe5a4dff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a00ccd60 con 0x7fe5a00b4f30 2023-07-14T15:56:19.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.636+0000 7fe5a4dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a00c6a00 con 0x7fe5a015fc00 2023-07-14T15:56:19.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.637+0000 7fe597fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5a00cf2b0 0x7fe5a00c9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:19.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.637+0000 7fe597fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5a00cf2b0 0x7fe5a00c9e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60558/0 (socket says 172.21.15.37:60558) 2023-07-14T15:56:19.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.637+0000 7fe597fff700 1 -- 172.21.15.37:0/2188717355 learned_addr learned my addr 172.21.15.37:0/2188717355 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:19.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.637+0000 7fe59e59c700 1 --2- 172.21.15.37:0/2188717355 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5a00b4f30 0x7fe5a00b8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:19.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.637+0000 7fe59ed9d700 1 --2- 172.21.15.37:0/2188717355 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe5a015fc00 0x7fe5a0156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:19.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.637+0000 7fe597fff700 1 -- 172.21.15.37:0/2188717355 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe5a015fc00 msgr2=0x7fe5a0156e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:19.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.637+0000 7fe597fff700 1 --2- 172.21.15.37:0/2188717355 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe5a015fc00 0x7fe5a0156e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:19.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.637+0000 7fe597fff700 1 -- 172.21.15.37:0/2188717355 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5a00b4f30 msgr2=0x7fe5a00b8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:19.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.637+0000 7fe597fff700 1 --2- 172.21.15.37:0/2188717355 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5a00b4f30 0x7fe5a00b8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:19.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.637+0000 7fe597fff700 1 -- 172.21.15.37:0/2188717355 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe590009430 con 0x7fe5a00cf2b0 2023-07-14T15:56:19.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.637+0000 7fe597fff700 1 --2- 172.21.15.37:0/2188717355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5a00cf2b0 0x7fe5a00c9e70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe58800c750 tx=0x7fe58800ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:19.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.637+0000 7fe596ffd700 1 -- 172.21.15.37:0/2188717355 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe588004c80 con 0x7fe5a00cf2b0 2023-07-14T15:56:19.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.637+0000 7fe596ffd700 1 -- 172.21.15.37:0/2188717355 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe588004e00 con 0x7fe5a00cf2b0 2023-07-14T15:56:19.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.637+0000 7fe596ffd700 1 -- 172.21.15.37:0/2188717355 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe588007310 con 0x7fe5a00cf2b0 2023-07-14T15:56:19.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.637+0000 7fe5a4dff700 1 -- 172.21.15.37:0/2188717355 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5a00c6ce0 con 0x7fe5a00cf2b0 2023-07-14T15:56:19.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.638+0000 7fe5a4dff700 1 -- 172.21.15.37:0/2188717355 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5a00c72a0 con 0x7fe5a00cf2b0 2023-07-14T15:56:19.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.639+0000 7fe5a4dff700 1 -- 172.21.15.37:0/2188717355 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5a00c77c0 con 0x7fe5a00cf2b0 2023-07-14T15:56:19.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.639+0000 7fe596ffd700 1 -- 172.21.15.37:0/2188717355 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe588007470 con 0x7fe5a00cf2b0 2023-07-14T15:56:19.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.640+0000 7fe596ffd700 1 --2- 172.21.15.37:0/2188717355 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe58006ace0 0x7fe58006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:19.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.640+0000 7fe596ffd700 1 -- 172.21.15.37:0/2188717355 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe5880891e0 con 0x7fe5a00cf2b0 2023-07-14T15:56:19.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.641+0000 7fe59e59c700 1 --2- 172.21.15.37:0/2188717355 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe58006ace0 0x7fe58006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:19.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.641+0000 7fe59e59c700 1 --2- 172.21.15.37:0/2188717355 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe58006ace0 0x7fe58006d190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe590013040 tx=0x7fe590008070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:19.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.645+0000 7fe596ffd700 1 -- 172.21.15.37:0/2188717355 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe588054280 con 0x7fe5a00cf2b0 2023-07-14T15:56:19.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.854+0000 7fe5a4dff700 1 -- 172.21.15.37:0/2188717355 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5a004e280 con 0x7fe5a00cf2b0 2023-07-14T15:56:19.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.855+0000 7fe596ffd700 1 -- 172.21.15.37:0/2188717355 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18341 (secure 0 0 0) 0x7fe5880578a0 con 0x7fe5a00cf2b0 2023-07-14T15:56:19.842 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:56:19.843 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"fsid":"9da30401-a779-4e46-aba6-00c2494c6c67","created":"2023-07-14T15:55:39.898867+0000","modified":"2023-07-14T15:56:09.959850+0000","last_up_change":"2023-07-14T15:55:53.025696+0000","last_in_change":"2023-07-14T15:55:43.388192+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T15:55:52.907261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T15:55:59.992839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T15:56:06.091064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T15:56:07.448694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d049535-7b87-4276-8fe5-0f74ba422d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6801","nonce":2783032392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6803","nonce":2783032392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6807","nonce":2783032392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6805","nonce":2783032392}]},"public_addr":"172.21.15.37:6801/2783032392","cluster_addr":"172.21.15.37:6803/2783032392","heartbeat_back_addr":"172.21.15.37:6807/2783032392","heartbeat_front_addr":"172.21.15.37:6805/2783032392","state":["exists","up"]},{"osd":1,"uuid":"79ec948d-ead2-4c2d-923a-dd6eeaac9dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6823","nonce":1190059746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6826","nonce":1190059746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6831","nonce":1190059746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6829","nonce":1190059746}]},"public_addr":"172.21.15.37:6823/1190059746","cluster_addr":"172.21.15.37:6826/1190059746","heartbeat_back_addr":"172.21.15.37:6831/1190059746","heartbeat_front_addr":"172.21.15.37:6829/1190059746","state":["exists","up"]},{"osd":2,"uuid":"a1db6690-c160-4366-9c82-2cca17e4bba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6809","nonce":2266223499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6813","nonce":2266223499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6820","nonce":2266223499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6816","nonce":2266223499}]},"public_addr":"172.21.15.37:6809/2266223499","cluster_addr":"172.21.15.37:6813/2266223499","heartbeat_back_addr":"172.21.15.37:6820/2266223499","heartbeat_front_addr":"172.21.15.37:6816/2266223499","state":["exists","up"]},{"osd":3,"uuid":"767b8220-e79a-4a86-a162-6b3b73198379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6812","nonce":4166694594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6817","nonce":4166694594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6828","nonce":4166694594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6822","nonce":4166694594}]},"public_addr":"172.21.15.37:6812/4166694594","cluster_addr":"172.21.15.37:6817/4166694594","heartbeat_back_addr":"172.21.15.37:6828/4166694594","heartbeat_front_addr":"172.21.15.37:6822/4166694594","state":["exists","up"]},{"osd":4,"uuid":"717bd773-ae7e-4236-ac79-900cf99a37c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6801","nonce":3529020407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6803","nonce":3529020407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6807","nonce":3529020407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6805","nonce":3529020407}]},"public_addr":"172.21.15.98:6801/3529020407","cluster_addr":"172.21.15.98:6803/3529020407","heartbeat_back_addr":"172.21.15.98:6807/3529020407","heartbeat_front_addr":"172.21.15.98:6805/3529020407","state":["exists","up"]},{"osd":5,"uuid":"a941d358-0f03-4136-a9b2-3a1c2e9358cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6817","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6819","nonce":2311501838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6821","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6823","nonce":2311501838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6829","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6831","nonce":2311501838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6825","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6827","nonce":2311501838}]},"public_addr":"172.21.15.98:6819/2311501838","cluster_addr":"172.21.15.98:6823/2311501838","heartbeat_back_addr":"172.21.15.98:6831/2311501838","heartbeat_front_addr":"172.21.15.98:6827/2311501838","state":["exists","up"]},{"osd":6,"uuid":"27153772-6d4b-479d-9953-0582e7b96743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6809","nonce":1144224691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6811","nonce":1144224691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6815","nonce":1144224691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6813","nonce":1144224691}]},"public_addr":"172.21.15.98:6809/1144224691","cluster_addr":"172.21.15.98:6811/1144224691","heartbeat_back_addr":"172.21.15.98:6815/1144224691","heartbeat_front_addr":"172.21.15.98:6813/1144224691","state":["exists","up"]},{"osd":7,"uuid":"d21ffc8e-40bb-47eb-af2c-e3e730d3fb76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6818","nonce":1144470927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6822","nonce":1144470927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6830","nonce":1144470927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6826","nonce":1144470927}]},"public_addr":"172.21.15.98:6818/1144470927","cluster_addr":"172.21.15.98:6822/1144470927","heartbeat_back_addr":"172.21.15.98:6830/1144470927","heartbeat_front_addr":"172.21.15.98:6826/1144470927","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.921114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.739210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.024016+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.002527+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.698127+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.813416+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.709351+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.815457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T15:56:19.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.858+0000 7fe5a4dff700 1 -- 172.21.15.37:0/2188717355 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe58006ace0 msgr2=0x7fe58006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:19.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.858+0000 7fe5a4dff700 1 --2- 172.21.15.37:0/2188717355 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe58006ace0 0x7fe58006d190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe590013040 tx=0x7fe590008070 comp rx=0 tx=0).stop 2023-07-14T15:56:19.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.858+0000 7fe5a4dff700 1 -- 172.21.15.37:0/2188717355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5a00cf2b0 msgr2=0x7fe5a00c9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:19.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.858+0000 7fe5a4dff700 1 --2- 172.21.15.37:0/2188717355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5a00cf2b0 0x7fe5a00c9e70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe58800c750 tx=0x7fe58800ca60 comp rx=0 tx=0).stop 2023-07-14T15:56:19.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.858+0000 7fe5a4dff700 1 -- 172.21.15.37:0/2188717355 shutdown_connections 2023-07-14T15:56:19.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.858+0000 7fe5a4dff700 1 --2- 172.21.15.37:0/2188717355 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5a00b4f30 0x7fe5a00b8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:19.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.858+0000 7fe5a4dff700 1 --2- 172.21.15.37:0/2188717355 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe58006ace0 0x7fe58006d190 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:19.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.858+0000 7fe5a4dff700 1 --2- 172.21.15.37:0/2188717355 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe5a015fc00 0x7fe5a0156e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:19.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.858+0000 7fe5a4dff700 1 --2- 172.21.15.37:0/2188717355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5a00cf2b0 0x7fe5a00c9e70 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:19.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.858+0000 7fe5a4dff700 1 -- 172.21.15.37:0/2188717355 >> 172.21.15.37:0/2188717355 conn(0x7fe5a006b160 msgr2=0x7fe5a00b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:19.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.858+0000 7fe5a4dff700 1 -- 172.21.15.37:0/2188717355 shutdown_connections 2023-07-14T15:56:19.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:19.858+0000 7fe5a4dff700 1 -- 172.21.15.37:0/2188717355 wait complete. 2023-07-14T15:56:19.863 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-07-14T15:56:19.863 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T15:56:20.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.079+0000 7f3eb71ff700 1 Processor -- start 2023-07-14T15:56:20.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.079+0000 7f3eb71ff700 1 -- start start 2023-07-14T15:56:20.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.080+0000 7f3eb71ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3eb00b85f0 0x7f3eb015d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.080+0000 7f3eb71ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eb00cf6b0 con 0x7f3eb00b4910 2023-07-14T15:56:20.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.080+0000 7f3eb71ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eb00cdc40 con 0x7f3eb00b54b0 2023-07-14T15:56:20.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.080+0000 7f3eb71ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb015dba0 con 0x7f3eb00b85f0 2023-07-14T15:56:20.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.080+0000 7f3eb579c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3eb00b4910 0x7f3eb015dda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37242/0 (socket says 172.21.15.37:37242) 2023-07-14T15:56:20.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.080+0000 7f3eb579c700 1 -- 172.21.15.37:0/2324749521 learned_addr learned my addr 172.21.15.37:0/2324749521 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:20.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.081+0000 7f3eb4f9b700 1 --2- 172.21.15.37:0/2324749521 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3eb00b85f0 0x7f3eb015d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.081+0000 7f3eaf7fe700 1 -- 172.21.15.37:0/2324749521 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3400972710 0 0) 0x7f3eb00cf6b0 con 0x7f3eb00b4910 2023-07-14T15:56:20.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.081+0000 7f3eaf7fe700 1 -- 172.21.15.37:0/2324749521 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ea00035b0 con 0x7f3eb00b4910 2023-07-14T15:56:20.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.081+0000 7f3eaf7fe700 1 -- 172.21.15.37:0/2324749521 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2576959884 0 0) 0x7f3ea00035b0 con 0x7f3eb00b4910 2023-07-14T15:56:20.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.081+0000 7f3eaf7fe700 1 -- 172.21.15.37:0/2324749521 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3eb00b85f0 msgr2=0x7f3eb015d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:20.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.081+0000 7f3eaf7fe700 1 --2- 172.21.15.37:0/2324749521 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3eb00b85f0 0x7f3eb015d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.081+0000 7f3eaf7fe700 1 -- 172.21.15.37:0/2324749521 >> v1:172.21.15.98:6789/0 conn(0x7f3eb00b54b0 legacy=0x7f3eb00cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.081+0000 7f3eaf7fe700 1 -- 172.21.15.37:0/2324749521 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb00d0250 con 0x7f3eb00b4910 2023-07-14T15:56:20.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.081+0000 7f3eaf7fe700 1 -- 172.21.15.37:0/2324749521 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48633207 0 0) 0x7f3ea80019f0 con 0x7f3eb00b4910 2023-07-14T15:56:20.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.081+0000 7f3eaf7fe700 1 -- 172.21.15.37:0/2324749521 >> v1:172.21.15.37:6789/0 conn(0x7f3eb00b4910 legacy=0x7f3eb015dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.081+0000 7f3eaf7fe700 1 --2- 172.21.15.37:0/2324749521 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ea0003a30 0x7f3ea0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.081+0000 7f3eaf7fe700 1 --2- 172.21.15.37:0/2324749521 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3eb00b85f0 0x7f3ea0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.081+0000 7f3eaf7fe700 1 --2- 172.21.15.37:0/2324749521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ea0004d90 0x7f3ea0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.081+0000 7f3eaf7fe700 1 -- 172.21.15.37:0/2324749521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb015dba0 con 0x7f3ea0004d90 2023-07-14T15:56:20.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.081+0000 7f3eaf7fe700 1 -- 172.21.15.37:0/2324749521 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea000baf0 con 0x7f3ea0003a30 2023-07-14T15:56:20.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.081+0000 7f3eaf7fe700 1 -- 172.21.15.37:0/2324749521 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea000bcb0 con 0x7f3eb00b85f0 2023-07-14T15:56:20.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.082+0000 7f3eb4f9b700 1 --2- 172.21.15.37:0/2324749521 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ea0003a30 0x7f3ea0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.082+0000 7f3eb579c700 1 --2- 172.21.15.37:0/2324749521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ea0004d90 0x7f3ea0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.082+0000 7f3eaffff700 1 --2- 172.21.15.37:0/2324749521 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3eb00b85f0 0x7f3ea0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.082+0000 7f3eb4f9b700 1 -- 172.21.15.37:0/2324749521 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3eb00b85f0 msgr2=0x7f3ea0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:20.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.082+0000 7f3eb4f9b700 1 --2- 172.21.15.37:0/2324749521 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3eb00b85f0 0x7f3ea0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.082+0000 7f3eb4f9b700 1 -- 172.21.15.37:0/2324749521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ea0004d90 msgr2=0x7f3ea0005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:20.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.082+0000 7f3eb4f9b700 1 --2- 172.21.15.37:0/2324749521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ea0004d90 0x7f3ea0005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.082+0000 7f3eb4f9b700 1 -- 172.21.15.37:0/2324749521 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea00035b0 con 0x7f3ea0003a30 2023-07-14T15:56:20.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.082+0000 7f3eb579c700 1 --2- 172.21.15.37:0/2324749521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ea0004d90 0x7f3ea0005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:56:20.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.082+0000 7f3eb4f9b700 1 --2- 172.21.15.37:0/2324749521 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ea0003a30 0x7f3ea0003e00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4009b30 tx=0x7f3ea0005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6b5fee6120ebccd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:20.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.083+0000 7f3eaf7fe700 1 -- 172.21.15.37:0/2324749521 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea400e6c0 con 0x7f3ea0003a30 2023-07-14T15:56:20.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.083+0000 7f3eaf7fe700 1 -- 172.21.15.37:0/2324749521 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea400e820 con 0x7f3ea0003a30 2023-07-14T15:56:20.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.083+0000 7f3eaf7fe700 1 -- 172.21.15.37:0/2324749521 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea400eb90 con 0x7f3ea0003a30 2023-07-14T15:56:20.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.083+0000 7f3eb71ff700 1 -- 172.21.15.37:0/2324749521 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ea0003a30 msgr2=0x7f3ea0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.083+0000 7f3eb71ff700 1 --2- 172.21.15.37:0/2324749521 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ea0003a30 0x7f3ea0003e00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4009b30 tx=0x7f3ea0005880 comp rx=0 tx=0).stop 2023-07-14T15:56:20.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.083+0000 7f3eb579c700 1 -- 172.21.15.37:0/2324749521 reap_dead start 2023-07-14T15:56:20.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.083+0000 7f3eb71ff700 1 -- 172.21.15.37:0/2324749521 shutdown_connections 2023-07-14T15:56:20.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.083+0000 7f3eb71ff700 1 -- 172.21.15.37:0/2324749521 >> 172.21.15.37:0/2324749521 conn(0x7f3eb006a580 msgr2=0x7f3eb006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:20.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.083+0000 7f3eb71ff700 1 -- 172.21.15.37:0/2324749521 shutdown_connections 2023-07-14T15:56:20.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.083+0000 7f3eb71ff700 1 -- 172.21.15.37:0/2324749521 wait complete. 2023-07-14T15:56:20.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.086+0000 7f3eb71ff700 1 Processor -- start 2023-07-14T15:56:20.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.086+0000 7f3eb71ff700 1 -- start start 2023-07-14T15:56:20.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.087+0000 7f3eb71ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ea0003a30 0x7f3eb00aa8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.087+0000 7f3eb71ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3eb00c8b70 0x7f3eb00c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.087+0000 7f3eb71ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3eb01f2610 0x7f3eb01f2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.087+0000 7f3eb71ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb00aae00 con 0x7f3ea0003a30 2023-07-14T15:56:20.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.087+0000 7f3eb71ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb00c9520 con 0x7f3eb00c8b70 2023-07-14T15:56:20.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.087+0000 7f3eb71ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb00c9f60 con 0x7f3eb01f2610 2023-07-14T15:56:20.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.087+0000 7f3eb4f9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ea0003a30 0x7f3eb00aa8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.087+0000 7f3eb4f9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ea0003a30 0x7f3eb00aa8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33468/0 (socket says 172.21.15.37:33468) 2023-07-14T15:56:20.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.087+0000 7f3eb4f9b700 1 -- 172.21.15.37:0/701676365 learned_addr learned my addr 172.21.15.37:0/701676365 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:20.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.088+0000 7f3eb579c700 1 --2- 172.21.15.37:0/701676365 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3eb01f2610 0x7f3eb01f2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.088+0000 7f3eaffff700 1 --2- 172.21.15.37:0/701676365 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3eb00c8b70 0x7f3eb00c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.088+0000 7f3eb4f9b700 1 -- 172.21.15.37:0/701676365 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3eb01f2610 msgr2=0x7f3eb01f2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.088+0000 7f3eb4f9b700 1 --2- 172.21.15.37:0/701676365 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3eb01f2610 0x7f3eb01f2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.088+0000 7f3eb4f9b700 1 -- 172.21.15.37:0/701676365 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3eb00c8b70 msgr2=0x7f3eb00c8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.088+0000 7f3eb4f9b700 1 --2- 172.21.15.37:0/701676365 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3eb00c8b70 0x7f3eb00c8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.088+0000 7f3eb4f9b700 1 -- 172.21.15.37:0/701676365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb00caf70 con 0x7f3ea0003a30 2023-07-14T15:56:20.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.088+0000 7f3eb4f9b700 1 --2- 172.21.15.37:0/701676365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ea0003a30 0x7f3eb00aa8c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3ea400e4b0 tx=0x7f3ea40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:20.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.088+0000 7f3ead7fa700 1 -- 172.21.15.37:0/701676365 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea400e6c0 con 0x7f3ea0003a30 2023-07-14T15:56:20.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.088+0000 7f3ead7fa700 1 -- 172.21.15.37:0/701676365 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea40038c0 con 0x7f3ea0003a30 2023-07-14T15:56:20.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.088+0000 7f3ead7fa700 1 -- 172.21.15.37:0/701676365 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4003c70 con 0x7f3ea0003a30 2023-07-14T15:56:20.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.088+0000 7f3eb71ff700 1 -- 172.21.15.37:0/701676365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eb00ca1b0 con 0x7f3ea0003a30 2023-07-14T15:56:20.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.089+0000 7f3eb71ff700 1 -- 172.21.15.37:0/701676365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eb00ca770 con 0x7f3ea0003a30 2023-07-14T15:56:20.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.090+0000 7f3eb71ff700 1 -- 172.21.15.37:0/701676365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eb0067840 con 0x7f3ea0003a30 2023-07-14T15:56:20.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.090+0000 7f3ead7fa700 1 -- 172.21.15.37:0/701676365 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3ea4013470 con 0x7f3ea0003a30 2023-07-14T15:56:20.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.092+0000 7f3ead7fa700 1 --2- 172.21.15.37:0/701676365 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f3e9406ace0 0x7f3e9406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.092+0000 7f3ead7fa700 1 -- 172.21.15.37:0/701676365 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3ea408ab00 con 0x7f3ea0003a30 2023-07-14T15:56:20.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.092+0000 7f3eaffff700 1 --2- 172.21.15.37:0/701676365 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f3e9406ace0 0x7f3e9406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.093+0000 7f3eaffff700 1 --2- 172.21.15.37:0/701676365 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f3e9406ace0 0x7f3e9406d190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c007fd0 tx=0x7f3e9c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:20.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.096+0000 7f3ead7fa700 1 -- 172.21.15.37:0/701676365 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3ea408ce60 con 0x7f3ea0003a30 2023-07-14T15:56:20.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.306+0000 7f3eb71ff700 1 -- 172.21.15.37:0/701676365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3eb015ba40 con 0x7f3ea0003a30 2023-07-14T15:56:20.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.307+0000 7f3ead7fa700 1 -- 172.21.15.37:0/701676365 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18341 (secure 0 0 0) 0x7f3ea4017090 con 0x7f3ea0003a30 2023-07-14T15:56:20.295 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:56:20.295 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"fsid":"9da30401-a779-4e46-aba6-00c2494c6c67","created":"2023-07-14T15:55:39.898867+0000","modified":"2023-07-14T15:56:09.959850+0000","last_up_change":"2023-07-14T15:55:53.025696+0000","last_in_change":"2023-07-14T15:55:43.388192+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T15:55:52.907261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T15:55:59.992839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T15:56:06.091064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T15:56:07.448694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d049535-7b87-4276-8fe5-0f74ba422d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6801","nonce":2783032392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6803","nonce":2783032392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6807","nonce":2783032392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6805","nonce":2783032392}]},"public_addr":"172.21.15.37:6801/2783032392","cluster_addr":"172.21.15.37:6803/2783032392","heartbeat_back_addr":"172.21.15.37:6807/2783032392","heartbeat_front_addr":"172.21.15.37:6805/2783032392","state":["exists","up"]},{"osd":1,"uuid":"79ec948d-ead2-4c2d-923a-dd6eeaac9dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6823","nonce":1190059746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6826","nonce":1190059746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6831","nonce":1190059746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6829","nonce":1190059746}]},"public_addr":"172.21.15.37:6823/1190059746","cluster_addr":"172.21.15.37:6826/1190059746","heartbeat_back_addr":"172.21.15.37:6831/1190059746","heartbeat_front_addr":"172.21.15.37:6829/1190059746","state":["exists","up"]},{"osd":2,"uuid":"a1db6690-c160-4366-9c82-2cca17e4bba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6809","nonce":2266223499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6813","nonce":2266223499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6820","nonce":2266223499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6816","nonce":2266223499}]},"public_addr":"172.21.15.37:6809/2266223499","cluster_addr":"172.21.15.37:6813/2266223499","heartbeat_back_addr":"172.21.15.37:6820/2266223499","heartbeat_front_addr":"172.21.15.37:6816/2266223499","state":["exists","up"]},{"osd":3,"uuid":"767b8220-e79a-4a86-a162-6b3b73198379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6812","nonce":4166694594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6817","nonce":4166694594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6828","nonce":4166694594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6822","nonce":4166694594}]},"public_addr":"172.21.15.37:6812/4166694594","cluster_addr":"172.21.15.37:6817/4166694594","heartbeat_back_addr":"172.21.15.37:6828/4166694594","heartbeat_front_addr":"172.21.15.37:6822/4166694594","state":["exists","up"]},{"osd":4,"uuid":"717bd773-ae7e-4236-ac79-900cf99a37c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6801","nonce":3529020407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6803","nonce":3529020407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6807","nonce":3529020407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6805","nonce":3529020407}]},"public_addr":"172.21.15.98:6801/3529020407","cluster_addr":"172.21.15.98:6803/3529020407","heartbeat_back_addr":"172.21.15.98:6807/3529020407","heartbeat_front_addr":"172.21.15.98:6805/3529020407","state":["exists","up"]},{"osd":5,"uuid":"a941d358-0f03-4136-a9b2-3a1c2e9358cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6817","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6819","nonce":2311501838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6821","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6823","nonce":2311501838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6829","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6831","nonce":2311501838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6825","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6827","nonce":2311501838}]},"public_addr":"172.21.15.98:6819/2311501838","cluster_addr":"172.21.15.98:6823/2311501838","heartbeat_back_addr":"172.21.15.98:6831/2311501838","heartbeat_front_addr":"172.21.15.98:6827/2311501838","state":["exists","up"]},{"osd":6,"uuid":"27153772-6d4b-479d-9953-0582e7b96743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6809","nonce":1144224691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6811","nonce":1144224691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6815","nonce":1144224691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6813","nonce":1144224691}]},"public_addr":"172.21.15.98:6809/1144224691","cluster_addr":"172.21.15.98:6811/1144224691","heartbeat_back_addr":"172.21.15.98:6815/1144224691","heartbeat_front_addr":"172.21.15.98:6813/1144224691","state":["exists","up"]},{"osd":7,"uuid":"d21ffc8e-40bb-47eb-af2c-e3e730d3fb76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6818","nonce":1144470927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6822","nonce":1144470927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6830","nonce":1144470927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6826","nonce":1144470927}]},"public_addr":"172.21.15.98:6818/1144470927","cluster_addr":"172.21.15.98:6822/1144470927","heartbeat_back_addr":"172.21.15.98:6830/1144470927","heartbeat_front_addr":"172.21.15.98:6826/1144470927","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.921114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.739210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.024016+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.002527+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.698127+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.813416+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.709351+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.815457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T15:56:20.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.309+0000 7f3eb71ff700 1 -- 172.21.15.37:0/701676365 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f3e9406ace0 msgr2=0x7f3e9406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.309+0000 7f3eb71ff700 1 --2- 172.21.15.37:0/701676365 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f3e9406ace0 0x7f3e9406d190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c007fd0 tx=0x7f3e9c009040 comp rx=0 tx=0).stop 2023-07-14T15:56:20.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.309+0000 7f3eb71ff700 1 -- 172.21.15.37:0/701676365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ea0003a30 msgr2=0x7f3eb00aa8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.309+0000 7f3eb71ff700 1 --2- 172.21.15.37:0/701676365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ea0003a30 0x7f3eb00aa8c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3ea400e4b0 tx=0x7f3ea40047c0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.310+0000 7f3eb71ff700 1 -- 172.21.15.37:0/701676365 shutdown_connections 2023-07-14T15:56:20.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.310+0000 7f3eb71ff700 1 --2- 172.21.15.37:0/701676365 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f3e9406ace0 0x7f3e9406d190 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.310+0000 7f3eb71ff700 1 --2- 172.21.15.37:0/701676365 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3eb01f2610 0x7f3eb01f2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.310+0000 7f3eb71ff700 1 --2- 172.21.15.37:0/701676365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ea0003a30 0x7f3eb00aa8c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.310+0000 7f3eb71ff700 1 --2- 172.21.15.37:0/701676365 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3eb00c8b70 0x7f3eb00c8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.310+0000 7f3eb71ff700 1 -- 172.21.15.37:0/701676365 >> 172.21.15.37:0/701676365 conn(0x7f3eb006a580 msgr2=0x7f3eb01601d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:20.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.310+0000 7f3eb71ff700 1 -- 172.21.15.37:0/701676365 shutdown_connections 2023-07-14T15:56:20.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.310+0000 7f3eb71ff700 1 -- 172.21.15.37:0/701676365 wait complete. 2023-07-14T15:56:20.315 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-07-14T15:56:20.315 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-07-14T15:56:20.316 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-07-14T15:56:20.316 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-07-14T15:56:20.317 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-07-14T15:56:20.317 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-07-14T15:56:20.318 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-07-14T15:56:20.318 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-07-14T15:56:20.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.693+0000 7f219abff700 1 Processor -- start 2023-07-14T15:56:20.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.694+0000 7fa3e1dff700 1 Processor -- start 2023-07-14T15:56:20.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.695+0000 7fa3e1dff700 1 -- start start 2023-07-14T15:56:20.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.694+0000 7f219abff700 1 -- start start 2023-07-14T15:56:20.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.695+0000 7f219abff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f21940d11c0 0x7f21940b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.696+0000 7f219abff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f21940b1f20 0x7f21940b30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.696+0000 7f219abff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f219415cd30 con 0x7f219415c960 2023-07-14T15:56:20.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.696+0000 7f219abff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21940b1da0 con 0x7f21940b1f20 2023-07-14T15:56:20.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.696+0000 7f219abff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21940b2c60 con 0x7f21940d11c0 2023-07-14T15:56:20.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.697+0000 7f2193fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f21940d11c0 0x7f21940b14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.697+0000 7f219899b700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f219415c960 0x7f21940d0ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.37:51782/0 (socket says 172.21.15.37:51782) 2023-07-14T15:56:20.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.697+0000 7f219899b700 1 -- 172.21.15.37:0/1078613974 learned_addr learned my addr 172.21.15.37:0/1078613974 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:20.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.697+0000 7f21937fe700 1 -- 172.21.15.37:0/1078613974 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2629612389 0 0) 0x7f2180001110 con 0x7f219415c960 2023-07-14T15:56:20.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.698+0000 7f21937fe700 1 -- 172.21.15.37:0/1078613974 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21840035b0 con 0x7f219415c960 2023-07-14T15:56:20.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.698+0000 7f219919c700 1 --2- 172.21.15.37:0/1078613974 >> v2:172.21.15.37:3300/0 conn(0x7f21940b1f20 0x7f21940b30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.698+0000 7f2193fff700 1 -- 172.21.15.37:0/1078613974 >> v2:172.21.15.37:3300/0 conn(0x7f21940b1f20 msgr2=0x7f21940b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:20.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.698+0000 7f2193fff700 1 --2- 172.21.15.37:0/1078613974 >> v2:172.21.15.37:3300/0 conn(0x7f21940b1f20 0x7f21940b30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.698+0000 7f2193fff700 1 -- 172.21.15.37:0/1078613974 >> v1:172.21.15.98:6789/0 conn(0x7f219415c960 legacy=0x7f21940d0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.698+0000 7f2193fff700 1 -- 172.21.15.37:0/1078613974 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21940b1ac0 con 0x7f21940d11c0 2023-07-14T15:56:20.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.698+0000 7f02179ff700 1 Processor -- start 2023-07-14T15:56:20.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.700+0000 7f2193fff700 1 --2- 172.21.15.37:0/1078613974 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21940d11c0 0x7f21940b14e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f21940739f0 tx=0x7f2188009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7c758c3420ecec7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:20.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.699+0000 7f02179ff700 1 -- start start 2023-07-14T15:56:20.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.701+0000 7f02179ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f0210160de0 0x7f02100ca160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.701+0000 7f02179ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f021006b120 0x7f021006c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.701+0000 7f02179ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02100ce680 con 0x7f0210160a10 2023-07-14T15:56:20.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.701+0000 7f02179ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02100c2430 con 0x7f021006b120 2023-07-14T15:56:20.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.701+0000 7f02179ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f021006b5b0 con 0x7f0210160de0 2023-07-14T15:56:20.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.702+0000 7fa3e1dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa3dc0d15c0 0x7fa3dc0cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.702+0000 7fa3e1dff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3dc0cdb50 con 0x7fa3dc0b8900 2023-07-14T15:56:20.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.702+0000 7fa3e1dff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3dc0cde30 con 0x7fa3dc0b0ae0 2023-07-14T15:56:20.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.702+0000 7fa3e1dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3dc15d030 con 0x7fa3dc0d15c0 2023-07-14T15:56:20.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.702+0000 7f021579b700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f0210160a10 0x7f02100c1d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.37:51784/0 (socket says 172.21.15.37:51784) 2023-07-14T15:56:20.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.702+0000 7f021579b700 1 -- 172.21.15.37:0/2588267113 learned_addr learned my addr 172.21.15.37:0/2588267113 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:20.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.702+0000 7fa3dbfff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fa3dc0b0ae0 0x7fa3dc0cebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.37:51786/0 (socket says 172.21.15.37:51786) 2023-07-14T15:56:20.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.703+0000 7fa3dbfff700 1 -- 172.21.15.37:0/1965153350 learned_addr learned my addr 172.21.15.37:0/1965153350 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:20.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.704+0000 7fa3daffd700 1 --2- 172.21.15.37:0/1965153350 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa3dc0d15c0 0x7fa3dc0cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.704+0000 7f0214f9a700 1 --2- 172.21.15.37:0/2588267113 >> v2:172.21.15.98:3300/0 conn(0x7f0210160de0 0x7f02100ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.703+0000 7fa3da7fc700 1 -- 172.21.15.37:0/1965153350 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1055111753 0 0) 0x7fa3dc0cdb50 con 0x7fa3dc0b8900 2023-07-14T15:56:20.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.704+0000 7fa3da7fc700 1 -- 172.21.15.37:0/1965153350 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3c40035b0 con 0x7fa3dc0b8900 2023-07-14T15:56:20.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.704+0000 7fa3da7fc700 1 -- 172.21.15.37:0/1965153350 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 550333810 0 0) 0x7fa3dc0cde30 con 0x7fa3dc0b0ae0 2023-07-14T15:56:20.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.704+0000 7fa3da7fc700 1 -- 172.21.15.37:0/1965153350 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3dc0cdb50 con 0x7fa3dc0b0ae0 2023-07-14T15:56:20.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.702+0000 7f21937fe700 1 -- 172.21.15.37:0/1078613974 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2188011830 con 0x7f21940d11c0 2023-07-14T15:56:20.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.702+0000 7f21937fe700 1 -- 172.21.15.37:0/1078613974 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2188011990 con 0x7f21940d11c0 2023-07-14T15:56:20.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.702+0000 7f21937fe700 1 -- 172.21.15.37:0/1078613974 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2188011d20 con 0x7f21940d11c0 2023-07-14T15:56:20.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.704+0000 7f219abff700 1 -- 172.21.15.37:0/1078613974 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21940d11c0 msgr2=0x7f21940b14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.704+0000 7f219abff700 1 --2- 172.21.15.37:0/1078613974 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21940d11c0 0x7f21940b14e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f21940739f0 tx=0x7f2188009b20 comp rx=0 tx=0).stop 2023-07-14T15:56:20.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.704+0000 7f0207fff700 1 -- 172.21.15.37:0/2588267113 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2715893074 0 0) 0x7f02100ce680 con 0x7f0210160a10 2023-07-14T15:56:20.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.704+0000 7f0207fff700 1 -- 172.21.15.37:0/2588267113 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01fc0035b0 con 0x7f0210160a10 2023-07-14T15:56:20.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.704+0000 7f219abff700 1 -- 172.21.15.37:0/1078613974 shutdown_connections 2023-07-14T15:56:20.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.704+0000 7f219abff700 1 --2- 172.21.15.37:0/1078613974 >> v2:172.21.15.37:3300/0 conn(0x7f21940b1f20 0x7f21940b30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.704+0000 7f219abff700 1 --2- 172.21.15.37:0/1078613974 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21940d11c0 0x7f21940b14e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.705+0000 7f219abff700 1 -- 172.21.15.37:0/1078613974 >> 172.21.15.37:0/1078613974 conn(0x7f219409c1d0 msgr2=0x7f21940d2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:20.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.704+0000 7f0215f9c700 1 --2- 172.21.15.37:0/2588267113 >> v2:172.21.15.37:3300/0 conn(0x7f021006b120 0x7f021006c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.705+0000 7fa3da7fc700 1 -- 172.21.15.37:0/1965153350 <== mon.1 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3463735778 0 0) 0x7fa3dc0cdb50 con 0x7fa3dc0b0ae0 2023-07-14T15:56:20.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.705+0000 7fa3da7fc700 1 -- 172.21.15.37:0/1965153350 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa3dc0d15c0 msgr2=0x7fa3dc0cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:20.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.705+0000 7fa3da7fc700 1 --2- 172.21.15.37:0/1965153350 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa3dc0d15c0 0x7fa3dc0cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.705+0000 7fa3da7fc700 1 -- 172.21.15.37:0/1965153350 >> v1:172.21.15.37:6789/0 conn(0x7fa3dc0b8900 legacy=0x7fa3dc0d0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.705+0000 7fa3da7fc700 1 -- 172.21.15.37:0/1965153350 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3dc0ce110 con 0x7fa3dc0b0ae0 2023-07-14T15:56:20.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.705+0000 7fa3da7fc700 1 -- 172.21.15.37:0/1965153350 <== mon.1 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48633207 0 0) 0x7fa3d4001a30 con 0x7fa3dc0b0ae0 2023-07-14T15:56:20.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.705+0000 7fa3da7fc700 1 -- 172.21.15.37:0/1965153350 >> v1:172.21.15.98:6789/0 conn(0x7fa3dc0b0ae0 legacy=0x7fa3dc0cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.705+0000 7fa3da7fc700 1 --2- 172.21.15.37:0/1965153350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3c4003b90 0x7fa3c4003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.705+0000 7fa3da7fc700 1 --2- 172.21.15.37:0/1965153350 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3c4004850 0x7fa3c4004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.705+0000 7fa3da7fc700 1 --2- 172.21.15.37:0/1965153350 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa3dc0d15c0 0x7fa3c4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.705+0000 7fa3da7fc700 1 -- 172.21.15.37:0/1965153350 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3dc15d030 con 0x7fa3c4003b90 2023-07-14T15:56:20.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.705+0000 7fa3da7fc700 1 -- 172.21.15.37:0/1965153350 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c400ba40 con 0x7fa3c4004850 2023-07-14T15:56:20.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.705+0000 7fa3da7fc700 1 -- 172.21.15.37:0/1965153350 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c400bc00 con 0x7fa3dc0d15c0 2023-07-14T15:56:20.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.705+0000 7fa3dbfff700 1 --2- 172.21.15.37:0/1965153350 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa3dc0d15c0 0x7fa3c4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.705+0000 7f0207fff700 1 -- 172.21.15.37:0/2588267113 <== mon.1 v1:172.21.15.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2550790141 0 0) 0x7f01fc0035b0 con 0x7f0210160a10 2023-07-14T15:56:20.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.705+0000 7f0207fff700 1 -- 172.21.15.37:0/2588267113 >> v2:172.21.15.98:3300/0 conn(0x7f0210160de0 msgr2=0x7f02100ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:20.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.705+0000 7f0207fff700 1 --2- 172.21.15.37:0/2588267113 >> v2:172.21.15.98:3300/0 conn(0x7f0210160de0 0x7f02100ca160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.705+0000 7f0207fff700 1 -- 172.21.15.37:0/2588267113 >> v2:172.21.15.37:3300/0 conn(0x7f021006b120 msgr2=0x7f021006c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:20.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.705+0000 7f0207fff700 1 --2- 172.21.15.37:0/2588267113 >> v2:172.21.15.37:3300/0 conn(0x7f021006b120 0x7f021006c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.705+0000 7f0207fff700 1 -- 172.21.15.37:0/2588267113 --> v1:172.21.15.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021006b890 con 0x7f0210160a10 2023-07-14T15:56:20.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.705+0000 7f0207fff700 1 -- 172.21.15.37:0/2588267113 <== mon.1 v1:172.21.15.98:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48633207 0 0) 0x7f02080019f0 con 0x7f0210160a10 2023-07-14T15:56:20.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.705+0000 7f0207fff700 1 -- 172.21.15.37:0/2588267113 >> v1:172.21.15.98:6789/0 conn(0x7f0210160a10 legacy=0x7f02100c1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.705+0000 7f0207fff700 1 --2- 172.21.15.37:0/2588267113 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01fc003a00 0x7f01fc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.705+0000 7f0207fff700 1 --2- 172.21.15.37:0/2588267113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01fc004850 0x7f01fc004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.705+0000 7f0207fff700 1 --2- 172.21.15.37:0/2588267113 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f01fc005200 0x7f01fc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.705+0000 7f0207fff700 1 -- 172.21.15.37:0/2588267113 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02100c2430 con 0x7f01fc004850 2023-07-14T15:56:20.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.705+0000 7f0207fff700 1 -- 172.21.15.37:0/2588267113 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021006b5b0 con 0x7f01fc003a00 2023-07-14T15:56:20.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.705+0000 7f0207fff700 1 -- 172.21.15.37:0/2588267113 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01fc00c0e0 con 0x7f01fc005200 2023-07-14T15:56:20.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.706+0000 7fa3db7fe700 1 --2- 172.21.15.37:0/1965153350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3c4003b90 0x7fa3c4003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.706+0000 7fa3dbfff700 1 -- 172.21.15.37:0/1965153350 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3c4004850 msgr2=0x7fa3c4004cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T15:56:20.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.706+0000 7fa3dbfff700 1 --2- 172.21.15.37:0/1965153350 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3c4004850 0x7fa3c4004cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.706+0000 7fa3dbfff700 1 -- 172.21.15.37:0/1965153350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3c4003b90 msgr2=0x7fa3c4003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:20.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.706+0000 7fa3dbfff700 1 --2- 172.21.15.37:0/1965153350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3c4003b90 0x7fa3c4003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.706+0000 7fa3dbfff700 1 -- 172.21.15.37:0/1965153350 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3dc0ce110 con 0x7fa3dc0d15c0 2023-07-14T15:56:20.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.706+0000 7f0214f9a700 1 --2- 172.21.15.37:0/2588267113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01fc004850 0x7f01fc004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.707+0000 7f219abff700 1 -- 172.21.15.37:0/1078613974 shutdown_connections 2023-07-14T15:56:20.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.707+0000 7f021579b700 1 --2- 172.21.15.37:0/2588267113 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01fc003a00 0x7f01fc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.707+0000 7f0215f9c700 1 --2- 172.21.15.37:0/2588267113 >> v2:172.21.15.37:3300/0 conn(0x7f021006b120 0x7f021006c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:56:20.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.707+0000 7fa3dbfff700 1 --2- 172.21.15.37:0/1965153350 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa3dc0d15c0 0x7fa3c4005200 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa3d40013d0 tx=0x7fa3c4005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23f1a2a00a118a6b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:20.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.707+0000 7f0214f9a700 1 -- 172.21.15.37:0/2588267113 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f01fc005200 msgr2=0x7f01fc00ba10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T15:56:20.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.707+0000 7fa3da7fc700 1 -- 172.21.15.37:0/1965153350 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d40072d0 con 0x7fa3dc0d15c0 2023-07-14T15:56:20.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.707+0000 7fa3da7fc700 1 -- 172.21.15.37:0/1965153350 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d4007430 con 0x7fa3dc0d15c0 2023-07-14T15:56:20.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.707+0000 7fa3da7fc700 1 -- 172.21.15.37:0/1965153350 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d40077e0 con 0x7fa3dc0d15c0 2023-07-14T15:56:20.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.707+0000 7f219abff700 1 -- 172.21.15.37:0/1078613974 wait complete. 2023-07-14T15:56:20.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.707+0000 7f0214f9a700 1 --2- 172.21.15.37:0/2588267113 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f01fc005200 0x7f01fc00ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.707+0000 7f0214f9a700 1 -- 172.21.15.37:0/2588267113 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01fc003a00 msgr2=0x7f01fc003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:20.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.707+0000 7f0214f9a700 1 --2- 172.21.15.37:0/2588267113 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01fc003a00 0x7f01fc003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.707+0000 7f0214f9a700 1 -- 172.21.15.37:0/2588267113 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021006b890 con 0x7f01fc004850 2023-07-14T15:56:20.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.707+0000 7f0215f9c700 1 -- 172.21.15.37:0/2588267113 reap_dead start 2023-07-14T15:56:20.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.708+0000 7f021579b700 1 --2- 172.21.15.37:0/2588267113 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01fc003a00 0x7f01fc003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:56:20.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.708+0000 7f0214f9a700 1 --2- 172.21.15.37:0/2588267113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01fc004850 0x7f01fc004cc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f021006d6b0 tx=0x7f01fc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6260729bca89674 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:20.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.708+0000 7fa3e1dff700 1 -- 172.21.15.37:0/1965153350 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa3dc0d15c0 msgr2=0x7fa3c4005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.708+0000 7fa3e1dff700 1 --2- 172.21.15.37:0/1965153350 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa3dc0d15c0 0x7fa3c4005200 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa3d40013d0 tx=0x7fa3c4005880 comp rx=0 tx=0).stop 2023-07-14T15:56:20.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.708+0000 7f22439ff700 1 Processor -- start 2023-07-14T15:56:20.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.709+0000 7f92931ff700 1 Processor -- start 2023-07-14T15:56:20.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.709+0000 7f0207fff700 1 -- 172.21.15.37:0/2588267113 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020c004020 con 0x7f01fc004850 2023-07-14T15:56:20.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.709+0000 7f0207fff700 1 -- 172.21.15.37:0/2588267113 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f020c004180 con 0x7f01fc004850 2023-07-14T15:56:20.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.709+0000 7f0207fff700 1 -- 172.21.15.37:0/2588267113 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020c004510 con 0x7f01fc004850 2023-07-14T15:56:20.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.709+0000 7fa3dbfff700 1 -- 172.21.15.37:0/1965153350 reap_dead start 2023-07-14T15:56:20.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.709+0000 7fa3e1dff700 1 -- 172.21.15.37:0/1965153350 shutdown_connections 2023-07-14T15:56:20.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.709+0000 7fa3e1dff700 1 -- 172.21.15.37:0/1965153350 >> 172.21.15.37:0/1965153350 conn(0x7fa3dc09c1e0 msgr2=0x7fa3dc0d2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:20.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.710+0000 7fa3e1dff700 1 -- 172.21.15.37:0/1965153350 shutdown_connections 2023-07-14T15:56:20.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.710+0000 7f02179ff700 1 -- 172.21.15.37:0/2588267113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01fc004850 msgr2=0x7f01fc004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.710+0000 7f02179ff700 1 --2- 172.21.15.37:0/2588267113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01fc004850 0x7f01fc004cc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f021006d6b0 tx=0x7f01fc005880 comp rx=0 tx=0).stop 2023-07-14T15:56:20.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.710+0000 7f02179ff700 1 -- 172.21.15.37:0/2588267113 shutdown_connections 2023-07-14T15:56:20.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.710+0000 7f02179ff700 1 --2- 172.21.15.37:0/2588267113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01fc004850 0x7f01fc004cc0 secure :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f021006d6b0 tx=0x7f01fc005880 comp rx=0 tx=0).stop 2023-07-14T15:56:20.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.710+0000 7f02179ff700 1 -- 172.21.15.37:0/2588267113 >> 172.21.15.37:0/2588267113 conn(0x7f02100b0620 msgr2=0x7f02100b0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:20.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.709+0000 7f22439ff700 1 -- start start 2023-07-14T15:56:20.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.711+0000 7f22439ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f223c0af4b0 0x7f223c0ce890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.711+0000 7f22439ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f223c0cedd0 0x7f223c15e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.711+0000 7f22439ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f223c0cf220 con 0x7f223c15e620 2023-07-14T15:56:20.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.711+0000 7f22439ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f223c15a980 con 0x7f223c0cedd0 2023-07-14T15:56:20.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.711+0000 7f22439ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f223c15ee50 con 0x7f223c0af4b0 2023-07-14T15:56:20.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.709+0000 7f92931ff700 1 -- start start 2023-07-14T15:56:20.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.711+0000 7f92931ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f928c160a10 0x7f928c0c1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.711+0000 7f92931ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f928c160de0 0x7f928c0ca160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.711+0000 7f92931ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f928c0ce680 con 0x7f928c06b120 2023-07-14T15:56:20.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.711+0000 7f92931ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f928c06b5b0 con 0x7f928c160de0 2023-07-14T15:56:20.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.711+0000 7f92931ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f928c06b890 con 0x7f928c160a10 2023-07-14T15:56:20.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.712+0000 7f2241f9c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f223c15e620 0x7f223c0cd6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37272/0 (socket says 172.21.15.37:37272) 2023-07-14T15:56:20.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.712+0000 7f2241f9c700 1 -- 172.21.15.37:0/2107401303 learned_addr learned my addr 172.21.15.37:0/2107401303 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:20.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.712+0000 7f929179c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f928c06b120 0x7f928c06c250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37276/0 (socket says 172.21.15.37:37276) 2023-07-14T15:56:20.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.712+0000 7f929179c700 1 -- 172.21.15.37:0/2764430811 learned_addr learned my addr 172.21.15.37:0/2764430811 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:20.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.712+0000 7f928bfff700 1 --2- 172.21.15.37:0/2764430811 >> v2:172.21.15.37:3300/0 conn(0x7f928c160de0 0x7f928c0ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.712+0000 7f9290f9b700 1 --2- 172.21.15.37:0/2764430811 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f928c160a10 0x7f928c0c1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.713+0000 7f928b7fe700 1 -- 172.21.15.37:0/2764430811 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 884461026 0 0) 0x7f928c0ce680 con 0x7f928c06b120 2023-07-14T15:56:20.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.713+0000 7f928b7fe700 1 -- 172.21.15.37:0/2764430811 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f927c0035b0 con 0x7f928c06b120 2023-07-14T15:56:20.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.710+0000 7fa3e1dff700 1 -- 172.21.15.37:0/1965153350 wait complete. 2023-07-14T15:56:20.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.713+0000 7f02179ff700 1 -- 172.21.15.37:0/2588267113 shutdown_connections 2023-07-14T15:56:20.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.713+0000 7fa3e1dff700 1 Processor -- start 2023-07-14T15:56:20.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.713+0000 7f928b7fe700 1 -- 172.21.15.37:0/2764430811 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 438836923 0 0) 0x7f927c0035b0 con 0x7f928c06b120 2023-07-14T15:56:20.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.713+0000 7f928b7fe700 1 -- 172.21.15.37:0/2764430811 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f928c160a10 msgr2=0x7f928c0c1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:20.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.713+0000 7f928b7fe700 1 --2- 172.21.15.37:0/2764430811 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f928c160a10 0x7f928c0c1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.713+0000 7f928b7fe700 1 -- 172.21.15.37:0/2764430811 >> v2:172.21.15.37:3300/0 conn(0x7f928c160de0 msgr2=0x7f928c0ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:20.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.713+0000 7f928b7fe700 1 --2- 172.21.15.37:0/2764430811 >> v2:172.21.15.37:3300/0 conn(0x7f928c160de0 0x7f928c0ca160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.713+0000 7f928b7fe700 1 -- 172.21.15.37:0/2764430811 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f928c06bb70 con 0x7f928c06b120 2023-07-14T15:56:20.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.713+0000 7f928b7fe700 1 -- 172.21.15.37:0/2764430811 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48633207 0 0) 0x7f92840019f0 con 0x7f928c06b120 2023-07-14T15:56:20.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.713+0000 7f928b7fe700 1 -- 172.21.15.37:0/2764430811 >> v1:172.21.15.37:6789/0 conn(0x7f928c06b120 legacy=0x7f928c06c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.713+0000 7f928b7fe700 1 --2- 172.21.15.37:0/2764430811 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f927c003a00 0x7f927c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.713+0000 7f928b7fe700 1 --2- 172.21.15.37:0/2764430811 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f927c004430 0x7f927c0048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.713+0000 7f928b7fe700 1 --2- 172.21.15.37:0/2764430811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f927c004fc0 0x7f927c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.714+0000 7f928b7fe700 1 -- 172.21.15.37:0/2764430811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928c06b5b0 con 0x7f927c004fc0 2023-07-14T15:56:20.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.714+0000 7f928b7fe700 1 -- 172.21.15.37:0/2764430811 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928c06b890 con 0x7f927c003a00 2023-07-14T15:56:20.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.714+0000 7f928b7fe700 1 -- 172.21.15.37:0/2764430811 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f927c00bf50 con 0x7f927c004430 2023-07-14T15:56:20.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.714+0000 7f929179c700 1 --2- 172.21.15.37:0/2764430811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f927c004fc0 0x7f927c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.714+0000 7f2233fff700 1 -- 172.21.15.37:0/2107401303 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 867242603 0 0) 0x7f2238001110 con 0x7f223c15e620 2023-07-14T15:56:20.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.715+0000 7f2233fff700 1 -- 172.21.15.37:0/2107401303 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22280035b0 con 0x7f223c15e620 2023-07-14T15:56:20.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.715+0000 7f2240f9a700 1 --2- 172.21.15.37:0/2107401303 >> v2:172.21.15.37:3300/0 conn(0x7f223c0cedd0 0x7f223c15e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.713+0000 7fa3e1dff700 1 -- start start 2023-07-14T15:56:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.713+0000 7f02179ff700 1 -- 172.21.15.37:0/2588267113 wait complete. 2023-07-14T15:56:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.715+0000 7fa3e1dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa3dc0b2320 0x7fa3dc0b1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.715+0000 7fa3e1dff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3dc0b41d0 0x7fa3dc0b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.715+0000 7fa3e1dff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3dc0b2c30 0x7fa3dc0cb840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.715+0000 7fa3e1dff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3dc06e340 con 0x7fa3dc0b41d0 2023-07-14T15:56:20.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.715+0000 7fa3e1dff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3dc0b1ed0 con 0x7fa3dc0b2c30 2023-07-14T15:56:20.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.715+0000 7fa3e1dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3dc0b4720 con 0x7fa3dc0b2320 2023-07-14T15:56:20.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.716+0000 7f2240f9a700 1 -- 172.21.15.37:0/2107401303 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f223c0af4b0 msgr2=0x7f223c0ce890 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T15:56:20.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.716+0000 7f2240f9a700 1 --2- 172.21.15.37:0/2107401303 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f223c0af4b0 0x7f223c0ce890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.716+0000 7f2240f9a700 1 -- 172.21.15.37:0/2107401303 >> v1:172.21.15.37:6789/0 conn(0x7f223c15e620 legacy=0x7f223c0cd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.716+0000 7f2240f9a700 1 -- 172.21.15.37:0/2107401303 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f223c15b490 con 0x7f223c0cedd0 2023-07-14T15:56:20.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.716+0000 7fa3daffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3dc0b41d0 0x7fa3dc0b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.716+0000 7fa3daffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3dc0b41d0 0x7fa3dc0b26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33542/0 (socket says 172.21.15.37:33542) 2023-07-14T15:56:20.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.716+0000 7fa3daffd700 1 -- 172.21.15.37:0/3603881842 learned_addr learned my addr 172.21.15.37:0/3603881842 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:20.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.716+0000 7fa3db7fe700 1 --2- 172.21.15.37:0/3603881842 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa3dc0b2320 0x7fa3dc0b1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.716+0000 7fa3dbfff700 1 --2- 172.21.15.37:0/3603881842 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3dc0b2c30 0x7fa3dc0cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.716+0000 7f02179ff700 1 Processor -- start 2023-07-14T15:56:20.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.716+0000 7f929179c700 1 -- 172.21.15.37:0/2764430811 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f927c004430 msgr2=0x7f927c0048f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T15:56:20.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.716+0000 7f929179c700 1 --2- 172.21.15.37:0/2764430811 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f927c004430 0x7f927c0048f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.716+0000 7f929179c700 1 -- 172.21.15.37:0/2764430811 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f927c003a00 msgr2=0x7f927c003e10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T15:56:20.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.716+0000 7f929179c700 1 --2- 172.21.15.37:0/2764430811 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f927c003a00 0x7f927c003e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.716+0000 7f929179c700 1 -- 172.21.15.37:0/2764430811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f928c06bb70 con 0x7f927c004fc0 2023-07-14T15:56:20.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.716+0000 7f2240f9a700 1 --2- 172.21.15.37:0/2107401303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f223c0cedd0 0x7f223c15e0e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f222c009840 tx=0x7f222c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f3447ffc5f531a9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:20.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.716+0000 7f929179c700 1 --2- 172.21.15.37:0/2764430811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f927c004fc0 0x7f927c00ba10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f928400a8f0 tx=0x7f927c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be4fbc4050643c8c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:20.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.717+0000 7fa3dbfff700 1 -- 172.21.15.37:0/3603881842 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa3dc0b2320 msgr2=0x7fa3dc0b1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.717+0000 7fa3dbfff700 1 --2- 172.21.15.37:0/3603881842 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa3dc0b2320 0x7fa3dc0b1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.717+0000 7fa3dbfff700 1 -- 172.21.15.37:0/3603881842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3dc0b41d0 msgr2=0x7fa3dc0b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.717+0000 7fa3dbfff700 1 --2- 172.21.15.37:0/3603881842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3dc0b41d0 0x7fa3dc0b26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.717+0000 7fa3dbfff700 1 -- 172.21.15.37:0/3603881842 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3dc0b4a00 con 0x7fa3dc0b2c30 2023-07-14T15:56:20.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.716+0000 7f02179ff700 1 -- start start 2023-07-14T15:56:20.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.717+0000 7f2233fff700 1 -- 172.21.15.37:0/2107401303 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222c011830 con 0x7f223c0cedd0 2023-07-14T15:56:20.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.717+0000 7f2233fff700 1 -- 172.21.15.37:0/2107401303 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f222c011990 con 0x7f223c0cedd0 2023-07-14T15:56:20.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.717+0000 7f2233fff700 1 -- 172.21.15.37:0/2107401303 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222c011d20 con 0x7f223c0cedd0 2023-07-14T15:56:20.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.717+0000 7f928b7fe700 1 -- 172.21.15.37:0/2764430811 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9284012600 con 0x7f927c004fc0 2023-07-14T15:56:20.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.717+0000 7f928b7fe700 1 -- 172.21.15.37:0/2764430811 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9284012760 con 0x7f927c004fc0 2023-07-14T15:56:20.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.717+0000 7f928b7fe700 1 -- 172.21.15.37:0/2764430811 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9284012af0 con 0x7f927c004fc0 2023-07-14T15:56:20.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.718+0000 7f02179ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f021014dd50 0x7f02100707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.718+0000 7f02179ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f021014e120 0x7f02100715d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.718+0000 7f02179ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f021006f6c0 0x7f021006fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.718+0000 7f02179ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0210071b10 con 0x7f021006f6c0 2023-07-14T15:56:20.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.718+0000 7f02179ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0210161ae0 con 0x7f021014e120 2023-07-14T15:56:20.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.718+0000 7f02179ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0210070ed0 con 0x7f021014dd50 2023-07-14T15:56:20.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.718+0000 7f22439ff700 1 -- 172.21.15.37:0/2107401303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f223c0cedd0 msgr2=0x7f223c15e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.718+0000 7f22439ff700 1 --2- 172.21.15.37:0/2107401303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f223c0cedd0 0x7f223c15e0e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f222c009840 tx=0x7f222c009b50 comp rx=0 tx=0).stop 2023-07-14T15:56:20.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.718+0000 7f92931ff700 1 -- 172.21.15.37:0/2764430811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f927c004fc0 msgr2=0x7f927c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.718+0000 7f92931ff700 1 --2- 172.21.15.37:0/2764430811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f927c004fc0 0x7f927c00ba10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f928400a8f0 tx=0x7f927c005880 comp rx=0 tx=0).stop 2023-07-14T15:56:20.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.718+0000 7f219abff700 1 Processor -- start 2023-07-14T15:56:20.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.718+0000 7fa3dbfff700 1 --2- 172.21.15.37:0/3603881842 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3dc0b2c30 0x7fa3dc0cb840 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4015000 tx=0x7fa3d4001360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:20.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.718+0000 7f929179c700 1 -- 172.21.15.37:0/2764430811 reap_dead start 2023-07-14T15:56:20.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.719+0000 7f219abff700 1 -- start start 2023-07-14T15:56:20.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.719+0000 7f021579b700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f021014dd50 0x7f02100707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.719+0000 7f92931ff700 1 -- 172.21.15.37:0/2764430811 shutdown_connections 2023-07-14T15:56:20.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.719+0000 7f92931ff700 1 -- 172.21.15.37:0/2764430811 >> 172.21.15.37:0/2764430811 conn(0x7f928c0b0620 msgr2=0x7f928c0b0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:20.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.719+0000 7f0214f9a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f021014e120 0x7f02100715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.719+0000 7f0214f9a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f021014e120 0x7f02100715d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.37:42856/0 (socket says 172.21.15.37:42856) 2023-07-14T15:56:20.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.719+0000 7f0214f9a700 1 -- 172.21.15.37:0/1193863944 learned_addr learned my addr 172.21.15.37:0/1193863944 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:20.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.719+0000 7f22439ff700 1 -- 172.21.15.37:0/2107401303 shutdown_connections 2023-07-14T15:56:20.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.719+0000 7f22439ff700 1 --2- 172.21.15.37:0/2107401303 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f223c0af4b0 0x7f223c0ce890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.719+0000 7f22439ff700 1 --2- 172.21.15.37:0/2107401303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f223c0cedd0 0x7f223c15e0e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.719+0000 7f22439ff700 1 -- 172.21.15.37:0/2107401303 >> 172.21.15.37:0/2107401303 conn(0x7f223c0664f0 msgr2=0x7f223c09a030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:20.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.720+0000 7f22439ff700 1 -- 172.21.15.37:0/2107401303 shutdown_connections 2023-07-14T15:56:20.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.719+0000 7fa3c3fff700 1 -- 172.21.15.37:0/3603881842 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d4026070 con 0x7fa3dc0b2c30 2023-07-14T15:56:20.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.720+0000 7fa3c3fff700 1 -- 172.21.15.37:0/3603881842 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d4001a00 con 0x7fa3dc0b2c30 2023-07-14T15:56:20.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.720+0000 7fa3c3fff700 1 -- 172.21.15.37:0/3603881842 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d4001f80 con 0x7fa3dc0b2c30 2023-07-14T15:56:20.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.720+0000 7f22439ff700 1 -- 172.21.15.37:0/2107401303 wait complete. 2023-07-14T15:56:20.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.720+0000 7f0215f9c700 1 --2- 172.21.15.37:0/1193863944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f021006f6c0 0x7f021006fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.720+0000 7f0215f9c700 1 -- 172.21.15.37:0/1193863944 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f021014dd50 msgr2=0x7f02100707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.720+0000 7f0215f9c700 1 --2- 172.21.15.37:0/1193863944 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f021014dd50 0x7f02100707f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.720+0000 7f0215f9c700 1 -- 172.21.15.37:0/1193863944 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f021014e120 msgr2=0x7f02100715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.720+0000 7f0215f9c700 1 --2- 172.21.15.37:0/1193863944 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f021014e120 0x7f02100715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.720+0000 7f0215f9c700 1 -- 172.21.15.37:0/1193863944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02101611b0 con 0x7f021006f6c0 2023-07-14T15:56:20.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.721+0000 7f0215f9c700 1 --2- 172.21.15.37:0/1193863944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f021006f6c0 0x7f021006fb60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0210072010 tx=0x7f020000e7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:20.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.720+0000 7f219abff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21940b1f20 0x7f21940c8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.720+0000 7f219abff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f21940d11c0 0x7f219406aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.720+0000 7f219abff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f219415c960 0x7f21940cef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.720+0000 7f219abff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21940c7f80 con 0x7f219415c960 2023-07-14T15:56:20.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.720+0000 7f219abff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21940c73d0 con 0x7f21940b1f20 2023-07-14T15:56:20.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.720+0000 7f219abff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21940c7650 con 0x7f21940d11c0 2023-07-14T15:56:20.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.720+0000 7f2193fff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f21940d11c0 0x7f219406aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.721+0000 7f2193fff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f21940d11c0 0x7f219406aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3301/0 says I am v2:172.21.15.37:44474/0 (socket says 172.21.15.37:44474) 2023-07-14T15:56:20.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.721+0000 7f2193fff700 1 -- 172.21.15.37:0/2226246151 learned_addr learned my addr 172.21.15.37:0/2226246151 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:20.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.721+0000 7f219919c700 1 --2- 172.21.15.37:0/2226246151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f219415c960 0x7f21940cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.722+0000 7f219919c700 1 -- 172.21.15.37:0/2226246151 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f21940d11c0 msgr2=0x7f219406aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.722+0000 7f219919c700 1 --2- 172.21.15.37:0/2226246151 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f21940d11c0 0x7f219406aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.722+0000 7f219919c700 1 -- 172.21.15.37:0/2226246151 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21940b1f20 msgr2=0x7f21940c8710 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T15:56:20.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.722+0000 7f219919c700 1 --2- 172.21.15.37:0/2226246151 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21940b1f20 0x7f21940c8710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.722+0000 7f219919c700 1 -- 172.21.15.37:0/2226246151 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21880094a0 con 0x7f219415c960 2023-07-14T15:56:20.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.721+0000 7f0205ffb700 1 -- 172.21.15.37:0/1193863944 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020000c070 con 0x7f021006f6c0 2023-07-14T15:56:20.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.721+0000 7f02179ff700 1 -- 172.21.15.37:0/1193863944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0210161490 con 0x7f021006f6c0 2023-07-14T15:56:20.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.721+0000 7f0205ffb700 1 -- 172.21.15.37:0/1193863944 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f020000ed90 con 0x7f021006f6c0 2023-07-14T15:56:20.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.721+0000 7f0205ffb700 1 -- 172.21.15.37:0/1193863944 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0200004240 con 0x7f021006f6c0 2023-07-14T15:56:20.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.721+0000 7f02179ff700 1 -- 172.21.15.37:0/1193863944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0210161f70 con 0x7f021006f6c0 2023-07-14T15:56:20.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.722+0000 7f219919c700 1 --2- 172.21.15.37:0/2226246151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f219415c960 0x7f21940cef70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f218c00eba0 tx=0x7f218c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:20.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.722+0000 7f22439ff700 1 Processor -- start 2023-07-14T15:56:20.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.722+0000 7f92931ff700 1 -- 172.21.15.37:0/2764430811 shutdown_connections 2023-07-14T15:56:20.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.723+0000 7fa3e1dff700 1 -- 172.21.15.37:0/3603881842 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3dc0b4ce0 con 0x7fa3dc0b2c30 2023-07-14T15:56:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.723+0000 7fa3e1dff700 1 -- 172.21.15.37:0/3603881842 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3dc0cb320 con 0x7fa3dc0b2c30 2023-07-14T15:56:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.722+0000 7fcb72bff700 1 Processor -- start 2023-07-14T15:56:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.722+0000 7fcb72bff700 1 -- start start 2023-07-14T15:56:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.724+0000 7f21917fa700 1 -- 172.21.15.37:0/2226246151 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218c00ca30 con 0x7f219415c960 2023-07-14T15:56:20.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.724+0000 7f21917fa700 1 -- 172.21.15.37:0/2226246151 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218c00f040 con 0x7f219415c960 2023-07-14T15:56:20.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.724+0000 7f21917fa700 1 -- 172.21.15.37:0/2226246151 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218c00cdb0 con 0x7f219415c960 2023-07-14T15:56:20.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.723+0000 7f92931ff700 1 -- 172.21.15.37:0/2764430811 wait complete. 2023-07-14T15:56:20.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.725+0000 7f92931ff700 1 Processor -- start 2023-07-14T15:56:20.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.725+0000 7f219abff700 1 -- 172.21.15.37:0/2226246151 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21940c7930 con 0x7f219415c960 2023-07-14T15:56:20.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.725+0000 7f219abff700 1 -- 172.21.15.37:0/2226246151 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21940c8c50 con 0x7f219415c960 2023-07-14T15:56:20.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.727+0000 7f219abff700 1 -- 172.21.15.37:0/2226246151 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f21940b28f0 con 0x7f219415c960 2023-07-14T15:56:20.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.725+0000 7f02179ff700 1 -- 172.21.15.37:0/1193863944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f021006be50 con 0x7f021006f6c0 2023-07-14T15:56:20.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.725+0000 7f0205ffb700 1 -- 172.21.15.37:0/1193863944 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f02000043a0 con 0x7f021006f6c0 2023-07-14T15:56:20.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.727+0000 7f0205ffb700 1 --2- 172.21.15.37:0/1193863944 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f01f406ace0 0x7f01f406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.727+0000 7f0205ffb700 1 -- 172.21.15.37:0/1193863944 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0200088460 con 0x7f021006f6c0 2023-07-14T15:56:20.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.727+0000 7f0205ffb700 1 --2- 172.21.15.37:0/1193863944 >> [v2:172.21.15.37:6808/2266223499,v1:172.21.15.37:6809/2266223499] conn(0x7f01f4073590 0x7f01f40759a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.727+0000 7f0205ffb700 1 -- 172.21.15.37:0/1193863944 --> [v2:172.21.15.37:6808/2266223499,v1:172.21.15.37:6809/2266223499] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f01f4076050 con 0x7f01f4073590 2023-07-14T15:56:20.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.727+0000 7f0205ffb700 1 -- 172.21.15.37:0/1193863944 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f020008a9e0 con 0x7f021006f6c0 2023-07-14T15:56:20.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.727+0000 7f021579b700 1 --2- 172.21.15.37:0/1193863944 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f01f406ace0 0x7f01f406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.724+0000 7f22439ff700 1 -- start start 2023-07-14T15:56:20.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.725+0000 7f22439ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f223c0af4b0 0x7f223c15d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.725+0000 7f22439ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f223c0cedd0 0x7f223c1f92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.725+0000 7f22439ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f223c15e620 0x7f223c09c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.725+0000 7f22439ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223c1446d0 con 0x7f223c0af4b0 2023-07-14T15:56:20.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.726+0000 7f22439ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223c1449b0 con 0x7f223c15e620 2023-07-14T15:56:20.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.726+0000 7f22439ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f223c144c90 con 0x7f223c0cedd0 2023-07-14T15:56:20.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.727+0000 7f224179b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f223c0af4b0 0x7f223c15d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.727+0000 7f224179b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f223c0af4b0 0x7f223c15d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33578/0 (socket says 172.21.15.37:33578) 2023-07-14T15:56:20.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.727+0000 7f224179b700 1 -- 172.21.15.37:0/2654052073 learned_addr learned my addr 172.21.15.37:0/2654052073 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:20.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.725+0000 7f92931ff700 1 -- start start 2023-07-14T15:56:20.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.727+0000 7f92931ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f928c147280 0x7f928c14f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.727+0000 7f92931ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f928c0b34d0 0x7f928c1635c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.727+0000 7f92931ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f928c0b3940 0x7f928c163b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.727+0000 7f92931ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928c0b3eb0 con 0x7f928c0b34d0 2023-07-14T15:56:20.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.727+0000 7f92931ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928c14e590 con 0x7f928c0b3940 2023-07-14T15:56:20.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.727+0000 7f92931ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f928c14e870 con 0x7f928c147280 2023-07-14T15:56:20.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.724+0000 7fcb72bff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fcb6c0ce5b0 0x7fcb6c1636a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.725+0000 7fcb72bff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb6c06cea0 con 0x7fcb6c0adb40 2023-07-14T15:56:20.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.725+0000 7fcb72bff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb6c06b600 con 0x7fcb6c06b120 2023-07-14T15:56:20.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.725+0000 7fcb72bff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb6c06b8e0 con 0x7fcb6c0ce5b0 2023-07-14T15:56:20.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.726+0000 7fcb6bfff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fcb6c06b120 0x7fcb6c0cdea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.37:51792/0 (socket says 172.21.15.37:51792) 2023-07-14T15:56:20.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.726+0000 7fcb6bfff700 1 -- 172.21.15.37:0/2182755119 learned_addr learned my addr 172.21.15.37:0/2182755119 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:20.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.727+0000 7fcb7119c700 1 --2- 172.21.15.37:0/2182755119 >> v2:172.21.15.98:3300/0 conn(0x7fcb6c0ce5b0 0x7fcb6c1636a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.728+0000 7f0214f9a700 1 --2- 172.21.15.37:0/1193863944 >> [v2:172.21.15.37:6808/2266223499,v1:172.21.15.37:6809/2266223499] conn(0x7f01f4073590 0x7f01f40759a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.728+0000 7f2240f9a700 1 --2- 172.21.15.37:0/2654052073 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f223c0cedd0 0x7f223c1f92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.728+0000 7f2241f9c700 1 --2- 172.21.15.37:0/2654052073 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f223c15e620 0x7f223c09c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.728+0000 7f9290f9b700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f928c147280 0x7f928c14f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.728+0000 7f9290f9b700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f928c147280 0x7f928c14f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3301/0 says I am v2:172.21.15.37:44476/0 (socket says 172.21.15.37:44476) 2023-07-14T15:56:20.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.728+0000 7f9290f9b700 1 -- 172.21.15.37:0/2261423753 learned_addr learned my addr 172.21.15.37:0/2261423753 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:20.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.728+0000 7fa3c3fff700 1 -- 172.21.15.37:0/3603881842 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa3d4020650 con 0x7fa3dc0b2c30 2023-07-14T15:56:20.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.728+0000 7fa3e1dff700 1 -- 172.21.15.37:0/3603881842 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa3dc0ce6d0 con 0x7fa3dc0b2c30 2023-07-14T15:56:20.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.728+0000 7f928bfff700 1 --2- 172.21.15.37:0/2261423753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f928c0b34d0 0x7f928c1635c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.728+0000 7f929179c700 1 --2- 172.21.15.37:0/2261423753 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f928c0b3940 0x7f928c163b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.728+0000 7f2240f9a700 1 -- 172.21.15.37:0/2654052073 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f223c15e620 msgr2=0x7f223c09c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.728+0000 7f2240f9a700 1 --2- 172.21.15.37:0/2654052073 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f223c15e620 0x7f223c09c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.728+0000 7f2240f9a700 1 -- 172.21.15.37:0/2654052073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f223c0af4b0 msgr2=0x7f223c15d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.728+0000 7f2240f9a700 1 --2- 172.21.15.37:0/2654052073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f223c0af4b0 0x7f223c15d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.728+0000 7f2240f9a700 1 -- 172.21.15.37:0/2654052073 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f222c0094a0 con 0x7f223c0cedd0 2023-07-14T15:56:20.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.729+0000 7f2240f9a700 1 --2- 172.21.15.37:0/2654052073 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f223c0cedd0 0x7f223c1f92b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f222c016000 tx=0x7f222c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:20.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.729+0000 7f9290f9b700 1 -- 172.21.15.37:0/2261423753 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f928c0b3940 msgr2=0x7f928c163b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.729+0000 7f9290f9b700 1 --2- 172.21.15.37:0/2261423753 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f928c0b3940 0x7f928c163b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.729+0000 7f9290f9b700 1 -- 172.21.15.37:0/2261423753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f928c0b34d0 msgr2=0x7f928c1635c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.729+0000 7f9290f9b700 1 --2- 172.21.15.37:0/2261423753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f928c0b34d0 0x7f928c1635c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.729+0000 7f9290f9b700 1 -- 172.21.15.37:0/2261423753 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f928c14eb50 con 0x7f928c147280 2023-07-14T15:56:20.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.729+0000 7f928bfff700 1 --2- 172.21.15.37:0/2261423753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f928c0b34d0 0x7f928c1635c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:56:20.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.729+0000 7f9290f9b700 1 --2- 172.21.15.37:0/2261423753 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f928c147280 0x7f928c14f070 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f928000e560 tx=0x7f928000e920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:20.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.729+0000 7f2231ffb700 1 -- 172.21.15.37:0/2654052073 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222c004510 con 0x7f223c0cedd0 2023-07-14T15:56:20.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.730+0000 7f2231ffb700 1 -- 172.21.15.37:0/2654052073 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f222c01f070 con 0x7f223c0cedd0 2023-07-14T15:56:20.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.730+0000 7f2231ffb700 1 -- 172.21.15.37:0/2654052073 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222c0038a0 con 0x7f223c0cedd0 2023-07-14T15:56:20.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.730+0000 7f21917fa700 1 -- 172.21.15.37:0/2226246151 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f218c014480 con 0x7f219415c960 2023-07-14T15:56:20.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.730+0000 7f22439ff700 1 -- 172.21.15.37:0/2654052073 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f223c144f70 con 0x7f223c0cedd0 2023-07-14T15:56:20.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.730+0000 7f22439ff700 1 -- 172.21.15.37:0/2654052073 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f223c15db00 con 0x7f223c0cedd0 2023-07-14T15:56:20.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.730+0000 7f92897fa700 1 -- 172.21.15.37:0/2261423753 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928000c070 con 0x7f928c147280 2023-07-14T15:56:20.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.730+0000 7f92897fa700 1 -- 172.21.15.37:0/2261423753 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9280013610 con 0x7f928c147280 2023-07-14T15:56:20.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.730+0000 7f92897fa700 1 -- 172.21.15.37:0/2261423753 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92800139a0 con 0x7f928c147280 2023-07-14T15:56:20.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.728+0000 7fcb6b7fe700 1 -- 172.21.15.37:0/2182755119 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1411739924 0 0) 0x7fcb6c06cea0 con 0x7fcb6c0adb40 2023-07-14T15:56:20.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.728+0000 7fcb6b7fe700 1 -- 172.21.15.37:0/2182755119 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb540035b0 con 0x7fcb6c0adb40 2023-07-14T15:56:20.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.729+0000 7fcb6b7fe700 1 -- 172.21.15.37:0/2182755119 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2779624237 0 0) 0x7fcb540035b0 con 0x7fcb6c0adb40 2023-07-14T15:56:20.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.729+0000 7fcb6b7fe700 1 -- 172.21.15.37:0/2182755119 >> v2:172.21.15.98:3300/0 conn(0x7fcb6c0ce5b0 msgr2=0x7fcb6c1636a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:20.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.729+0000 7fcb6b7fe700 1 --2- 172.21.15.37:0/2182755119 >> v2:172.21.15.98:3300/0 conn(0x7fcb6c0ce5b0 0x7fcb6c1636a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.729+0000 7fcb6b7fe700 1 -- 172.21.15.37:0/2182755119 >> v1:172.21.15.98:6789/0 conn(0x7fcb6c06b120 legacy=0x7fcb6c0cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.729+0000 7fcb6b7fe700 1 -- 172.21.15.37:0/2182755119 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb6c06bbc0 con 0x7fcb6c0adb40 2023-07-14T15:56:20.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.729+0000 7fcb6b7fe700 1 -- 172.21.15.37:0/2182755119 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48633207 0 0) 0x7fcb5c0015a0 con 0x7fcb6c0adb40 2023-07-14T15:56:20.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.729+0000 7fcb6b7fe700 1 -- 172.21.15.37:0/2182755119 >> v1:172.21.15.37:6789/0 conn(0x7fcb6c0adb40 legacy=0x7fcb6c15cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.729+0000 7fcb6b7fe700 1 --2- 172.21.15.37:0/2182755119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb54003a50 0x7fcb54003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.729+0000 7fcb6b7fe700 1 --2- 172.21.15.37:0/2182755119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb54004850 0x7fcb54004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.729+0000 7fcb6b7fe700 1 --2- 172.21.15.37:0/2182755119 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcb54005400 0x7fcb5400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.729+0000 7fcb6b7fe700 1 -- 172.21.15.37:0/2182755119 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6c06b8e0 con 0x7fcb54004850 2023-07-14T15:56:20.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.729+0000 7fcb6b7fe700 1 -- 172.21.15.37:0/2182755119 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5400c2f0 con 0x7fcb54003a50 2023-07-14T15:56:20.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.729+0000 7fcb6b7fe700 1 -- 172.21.15.37:0/2182755119 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5400c4b0 con 0x7fcb54005400 2023-07-14T15:56:20.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.730+0000 7fcb7119c700 1 --2- 172.21.15.37:0/2182755119 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcb54005400 0x7fcb5400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.730+0000 7fcb7099b700 1 --2- 172.21.15.37:0/2182755119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb54003a50 0x7fcb54003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.731+0000 7fcb7099b700 1 -- 172.21.15.37:0/2182755119 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcb54005400 msgr2=0x7fcb5400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:20.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.731+0000 7fcb7099b700 1 --2- 172.21.15.37:0/2182755119 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcb54005400 0x7fcb5400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.731+0000 7fcb7099b700 1 -- 172.21.15.37:0/2182755119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb54004850 msgr2=0x7fcb54004cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T15:56:20.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.731+0000 7fcb7099b700 1 --2- 172.21.15.37:0/2182755119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb54004850 0x7fcb54004cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.731+0000 7fcb7099b700 1 -- 172.21.15.37:0/2182755119 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb6c06bbc0 con 0x7fcb54003a50 2023-07-14T15:56:20.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.731+0000 7f22439ff700 1 -- 172.21.15.37:0/2654052073 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f223c15ab60 con 0x7f223c0cedd0 2023-07-14T15:56:20.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.731+0000 7fcb7119c700 1 -- 172.21.15.37:0/2182755119 reap_dead start 2023-07-14T15:56:20.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.729+0000 7fa3c3fff700 1 --2- 172.21.15.37:0/3603881842 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa3c806adb0 0x7fa3c806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.730+0000 7fa3c3fff700 1 -- 172.21.15.37:0/3603881842 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa3d408a780 con 0x7fa3dc0b2c30 2023-07-14T15:56:20.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.730+0000 7fa3c3fff700 1 --2- 172.21.15.37:0/3603881842 >> [v2:172.21.15.37:6800/2783032392,v1:172.21.15.37:6801/2783032392] conn(0x7fa3c80735e0 0x7fa3c80759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.730+0000 7fa3c3fff700 1 -- 172.21.15.37:0/3603881842 --> [v2:172.21.15.37:6800/2783032392,v1:172.21.15.37:6801/2783032392] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa3c80760a0 con 0x7fa3c80735e0 2023-07-14T15:56:20.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.731+0000 7f92931ff700 1 -- 172.21.15.37:0/2261423753 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f928c0b4190 con 0x7f928c147280 2023-07-14T15:56:20.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.731+0000 7f92931ff700 1 -- 172.21.15.37:0/2261423753 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f928c0c53e0 con 0x7f928c147280 2023-07-14T15:56:20.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.731+0000 7fcb7099b700 1 --2- 172.21.15.37:0/2182755119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb54003a50 0x7fcb54003e60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c007920 tx=0x7fcb54005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e1e6e33c732e4c4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:20.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.731+0000 7f021579b700 1 --2- 172.21.15.37:0/1193863944 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f01f406ace0 0x7f01f406d190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0208002060 tx=0x7f0208001890 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:20.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.731+0000 7f0214f9a700 1 --2- 172.21.15.37:0/1193863944 >> [v2:172.21.15.37:6808/2266223499,v1:172.21.15.37:6809/2266223499] conn(0x7f01f4073590 0x7f01f40759a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:20.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.732+0000 7fa3db7fe700 1 --2- 172.21.15.37:0/3603881842 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa3c806adb0 0x7fa3c806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.732+0000 7fa3c3fff700 1 -- 172.21.15.37:0/3603881842 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa3d4020ea0 con 0x7fa3dc0b2c30 2023-07-14T15:56:20.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.732+0000 7fa3daffd700 1 --2- 172.21.15.37:0/3603881842 >> [v2:172.21.15.37:6800/2783032392,v1:172.21.15.37:6801/2783032392] conn(0x7fa3c80735e0 0x7fa3c80759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.732+0000 7fcb6b7fe700 1 -- 172.21.15.37:0/2182755119 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c00aae0 con 0x7fcb54003a50 2023-07-14T15:56:20.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.732+0000 7fcb6b7fe700 1 -- 172.21.15.37:0/2182755119 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb5c00a4e0 con 0x7fcb54003a50 2023-07-14T15:56:20.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.732+0000 7fcb6b7fe700 1 -- 172.21.15.37:0/2182755119 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c019400 con 0x7fcb54003a50 2023-07-14T15:56:20.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.733+0000 7fa3db7fe700 1 --2- 172.21.15.37:0/3603881842 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa3c806adb0 0x7fa3c806d260 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0000fb0 tx=0x7fa3d0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:20.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.733+0000 7fa3daffd700 1 --2- 172.21.15.37:0/3603881842 >> [v2:172.21.15.37:6800/2783032392,v1:172.21.15.37:6801/2783032392] conn(0x7fa3c80735e0 0x7fa3c80759f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:20.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.732+0000 7f21917fa700 1 --2- 172.21.15.37:0/2226246151 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f217806ad80 0x7f217806d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.733+0000 7f21917fa700 1 -- 172.21.15.37:0/2226246151 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f218c08a850 con 0x7f219415c960 2023-07-14T15:56:20.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.733+0000 7f21917fa700 1 --2- 172.21.15.37:0/2226246151 >> [v2:172.21.15.37:6821/1190059746,v1:172.21.15.37:6823/1190059746] conn(0x7f2178073630 0x7f2178075a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.733+0000 7f21917fa700 1 -- 172.21.15.37:0/2226246151 --> [v2:172.21.15.37:6821/1190059746,v1:172.21.15.37:6823/1190059746] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f21780760f0 con 0x7f2178073630 2023-07-14T15:56:20.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.733+0000 7f21917fa700 1 -- 172.21.15.37:0/2226246151 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f218c08ac00 con 0x7f219415c960 2023-07-14T15:56:20.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.733+0000 7f219899b700 1 --2- 172.21.15.37:0/2226246151 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f217806ad80 0x7f217806d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.733+0000 7f0205ffb700 1 -- 172.21.15.37:0/1193863944 <== osd.2 v2:172.21.15.37:6808/2266223499 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f01f4076050 con 0x7f01f4073590 2023-07-14T15:56:20.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.733+0000 7efeb9bff700 1 Processor -- start 2023-07-14T15:56:20.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.733+0000 7fcb72bff700 1 -- 172.21.15.37:0/2182755119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb54003a50 msgr2=0x7fcb54003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.733+0000 7fcb72bff700 1 --2- 172.21.15.37:0/2182755119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb54003a50 0x7fcb54003e60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c007920 tx=0x7fcb54005880 comp rx=0 tx=0).stop 2023-07-14T15:56:20.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.733+0000 7fcb72bff700 1 -- 172.21.15.37:0/2182755119 shutdown_connections 2023-07-14T15:56:20.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.733+0000 7fcb72bff700 1 --2- 172.21.15.37:0/2182755119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb54003a50 0x7fcb54003e60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.733+0000 7fcb72bff700 1 -- 172.21.15.37:0/2182755119 >> 172.21.15.37:0/2182755119 conn(0x7fcb6c0b0620 msgr2=0x7fcb6c0b0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:20.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.734+0000 7f2193fff700 1 --2- 172.21.15.37:0/2226246151 >> [v2:172.21.15.37:6821/1190059746,v1:172.21.15.37:6823/1190059746] conn(0x7f2178073630 0x7f2178075a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.733+0000 7f92931ff700 1 -- 172.21.15.37:0/2261423753 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f928c06be50 con 0x7f928c147280 2023-07-14T15:56:20.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.734+0000 7f2231ffb700 1 -- 172.21.15.37:0/2654052073 <== mon.2 v2:172.21.15.98:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f222c003a00 con 0x7f223c0cedd0 2023-07-14T15:56:20.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.734+0000 7efeb9bff700 1 -- start start 2023-07-14T15:56:20.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.735+0000 7fcb72bff700 1 -- 172.21.15.37:0/2182755119 shutdown_connections 2023-07-14T15:56:20.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.735+0000 7f2193fff700 1 --2- 172.21.15.37:0/2226246151 >> [v2:172.21.15.37:6821/1190059746,v1:172.21.15.37:6823/1190059746] conn(0x7f2178073630 0x7f2178075a40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:20.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.735+0000 7fa3c3fff700 1 -- 172.21.15.37:0/3603881842 <== osd.0 v2:172.21.15.37:6800/2783032392 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fa3c80760a0 con 0x7fa3c80735e0 2023-07-14T15:56:20.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.736+0000 7f92897fa700 1 -- 172.21.15.37:0/2261423753 <== mon.2 v2:172.21.15.98:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9280013b00 con 0x7f928c147280 2023-07-14T15:56:20.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.736+0000 7efeb9bff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7efeb415c960 0x7efeb40b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.736+0000 7efeb9bff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efeb40b1f20 0x7efeb40d0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.736+0000 7efeb9bff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb415cd30 con 0x7efeb40d0ff0 2023-07-14T15:56:20.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.736+0000 7f2231ffb700 1 --2- 172.21.15.37:0/2654052073 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f222006adb0 0x7f222006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.736+0000 7f2231ffb700 1 -- 172.21.15.37:0/2654052073 <== mon.2 v2:172.21.15.98:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f222c021070 con 0x7f223c0cedd0 2023-07-14T15:56:20.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.736+0000 7f2231ffb700 1 --2- 172.21.15.37:0/2654052073 >> [v2:172.21.15.37:6810/4166694594,v1:172.21.15.37:6812/4166694594] conn(0x7f2220073660 0x7f2220075a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.736+0000 7f2231ffb700 1 -- 172.21.15.37:0/2654052073 --> [v2:172.21.15.37:6810/4166694594,v1:172.21.15.37:6812/4166694594] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2220076120 con 0x7f2220073660 2023-07-14T15:56:20.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.736+0000 7f2231ffb700 1 -- 172.21.15.37:0/2654052073 <== mon.2 v2:172.21.15.98:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f222c08b200 con 0x7f223c0cedd0 2023-07-14T15:56:20.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.736+0000 7efeb9bff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeb40b1da0 con 0x7efeb40b1f20 2023-07-14T15:56:20.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.736+0000 7efeb9bff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb40d1470 con 0x7efeb415c960 2023-07-14T15:56:20.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.736+0000 7fcb72bff700 1 -- 172.21.15.37:0/2182755119 wait complete. 2023-07-14T15:56:20.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.737+0000 7f21917fa700 1 -- 172.21.15.37:0/2226246151 <== osd.1 v2:172.21.15.37:6821/1190059746 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f21780760f0 con 0x7f2178073630 2023-07-14T15:56:20.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.737+0000 7efeaaffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efeb40b1f20 0x7efeb40d0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.737+0000 7efeaaffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efeb40b1f20 0x7efeb40d0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33596/0 (socket says 172.21.15.37:33596) 2023-07-14T15:56:20.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.737+0000 7efeaaffd700 1 -- 172.21.15.37:0/690905797 learned_addr learned my addr 172.21.15.37:0/690905797 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:20.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.737+0000 7f33d4bff700 1 Processor -- start 2023-07-14T15:56:20.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.738+0000 7f224179b700 1 --2- 172.21.15.37:0/2654052073 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f222006adb0 0x7f222006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.738+0000 7efeaaffd700 1 -- 172.21.15.37:0/690905797 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7efeb415c960 msgr2=0x7efeb40b14e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T15:56:20.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.738+0000 7efeaaffd700 1 --2- 172.21.15.37:0/690905797 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7efeb415c960 0x7efeb40b14e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.738+0000 7efeaaffd700 1 -- 172.21.15.37:0/690905797 >> v1:172.21.15.98:6789/0 conn(0x7efeb40d0ff0 legacy=0x7efeb40afac0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T15:56:20.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.738+0000 7efeaaffd700 1 -- 172.21.15.37:0/690905797 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb40b2c60 con 0x7efeb40b1f20 2023-07-14T15:56:20.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.738+0000 7f92897fa700 1 --2- 172.21.15.37:0/2261423753 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f927006ad30 0x7f927006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.738+0000 7f92897fa700 1 -- 172.21.15.37:0/2261423753 <== mon.2 v2:172.21.15.98:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f92800892c0 con 0x7f928c147280 2023-07-14T15:56:20.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.738+0000 7f33d4bff700 1 -- start start 2023-07-14T15:56:20.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.739+0000 7efeaaffd700 1 --2- 172.21.15.37:0/690905797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efeb40b1f20 0x7efeb40d0ab0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7efea4009e50 tx=0x7efea400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88ddef6da1ae9616 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:20.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.739+0000 7f92897fa700 1 --2- 172.21.15.37:0/2261423753 >> [v2:172.21.15.98:6800/3529020407,v1:172.21.15.98:6801/3529020407] conn(0x7f92700735e0 0x7f92700759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.739+0000 7f92897fa700 1 -- 172.21.15.37:0/2261423753 --> [v2:172.21.15.98:6800/3529020407,v1:172.21.15.98:6801/3529020407] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f92700760a0 con 0x7f92700735e0 2023-07-14T15:56:20.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.739+0000 7f92897fa700 1 -- 172.21.15.37:0/2261423753 <== mon.2 v2:172.21.15.98:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9280089630 con 0x7f928c147280 2023-07-14T15:56:20.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.739+0000 7f928bfff700 1 --2- 172.21.15.37:0/2261423753 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f927006ad30 0x7f927006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.739+0000 7fcb72bff700 1 Processor -- start 2023-07-14T15:56:20.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.740+0000 7f224179b700 1 --2- 172.21.15.37:0/2654052073 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f222006adb0 0x7f222006d260 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2234009fd0 tx=0x7f223400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:20.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.739+0000 7efeb2ffd700 1 -- 172.21.15.37:0/690905797 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea400e070 con 0x7efeb40b1f20 2023-07-14T15:56:20.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.740+0000 7efeb2ffd700 1 -- 172.21.15.37:0/690905797 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea4003a20 con 0x7efeb40b1f20 2023-07-14T15:56:20.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.740+0000 7efeb2ffd700 1 -- 172.21.15.37:0/690905797 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea4003dd0 con 0x7efeb40b1f20 2023-07-14T15:56:20.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.740+0000 7f219899b700 1 --2- 172.21.15.37:0/2226246151 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f217806ad80 0x7f217806d230 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2180001620 tx=0x7f21800010d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:20.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.739+0000 7fcb72bff700 1 -- start start 2023-07-14T15:56:20.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.740+0000 7f928bfff700 1 --2- 172.21.15.37:0/2261423753 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f927006ad30 0x7f927006d1e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f928c160770 tx=0x7f9278008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:20.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.740+0000 7f33d4bff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f33d006c2e0 0x7f33d0158720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.740+0000 7f33d4bff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f33d00cd3f0 0x7f33d00cdf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.740+0000 7f33d4bff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33d00cc6a0 con 0x7f33d00b0d30 2023-07-14T15:56:20.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.740+0000 7f33d4bff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33d00ae0f0 con 0x7f33d006c2e0 2023-07-14T15:56:20.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.740+0000 7f33d4bff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d0158c60 con 0x7f33d00cd3f0 2023-07-14T15:56:20.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.741+0000 7efeb9bff700 1 -- 172.21.15.37:0/690905797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efeb40b1f20 msgr2=0x7efeb40d0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.741+0000 7efeb9bff700 1 --2- 172.21.15.37:0/690905797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efeb40b1f20 0x7efeb40d0ab0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7efea4009e50 tx=0x7efea400b330 comp rx=0 tx=0).stop 2023-07-14T15:56:20.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.741+0000 7fcb72bff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb54003a50 0x7fcb6c0c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.741+0000 7fcb72bff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcb6c1f2d60 0x7fcb6c1f1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.741+0000 7fcb72bff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb6c0b4320 0x7fcb6c0b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.741+0000 7f33cdd9b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f33d00b0d30 0x7f33d006bb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37292/0 (socket says 172.21.15.37:37292) 2023-07-14T15:56:20.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.741+0000 7f33cdd9b700 1 -- 172.21.15.37:0/2298211016 learned_addr learned my addr 172.21.15.37:0/2298211016 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:20.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.741+0000 7fcb72bff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6c0c81b0 con 0x7fcb6c0b4320 2023-07-14T15:56:20.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.741+0000 7fcb72bff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6c0c75c0 con 0x7fcb54003a50 2023-07-14T15:56:20.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.741+0000 7fcb72bff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6c1f31d0 con 0x7fcb6c1f2d60 2023-07-14T15:56:20.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.742+0000 7f33cd59a700 1 -- 172.21.15.37:0/2298211016 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1997078896 0 0) 0x7f33d00cc6a0 con 0x7f33d00b0d30 2023-07-14T15:56:20.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.742+0000 7f33cd59a700 1 -- 172.21.15.37:0/2298211016 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33b80035b0 con 0x7f33d00b0d30 2023-07-14T15:56:20.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.742+0000 7efeb9bff700 1 -- 172.21.15.37:0/690905797 shutdown_connections 2023-07-14T15:56:20.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.742+0000 7efeb9bff700 1 --2- 172.21.15.37:0/690905797 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7efeb415c960 0x7efeb40b14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.742+0000 7efeb9bff700 1 --2- 172.21.15.37:0/690905797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efeb40b1f20 0x7efeb40d0ab0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.742+0000 7efeb9bff700 1 -- 172.21.15.37:0/690905797 >> 172.21.15.37:0/690905797 conn(0x7efeb409c1d0 msgr2=0x7efeb40d2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:20.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.742+0000 7fcb7099b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb54003a50 0x7fcb6c0c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.742+0000 7fcb7099b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb54003a50 0x7fcb6c0c85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.37:42908/0 (socket says 172.21.15.37:42908) 2023-07-14T15:56:20.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.742+0000 7fcb7099b700 1 -- 172.21.15.37:0/829741697 learned_addr learned my addr 172.21.15.37:0/829741697 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:20.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.742+0000 7fcb7119c700 1 --2- 172.21.15.37:0/829741697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb6c0b4320 0x7fcb6c0b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.742+0000 7fcb7099b700 1 -- 172.21.15.37:0/829741697 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcb6c1f2d60 msgr2=0x7fcb6c1f1930 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-14T15:56:20.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.742+0000 7fcb7099b700 1 --2- 172.21.15.37:0/829741697 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcb6c1f2d60 0x7fcb6c1f1930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.742+0000 7fcb7099b700 1 -- 172.21.15.37:0/829741697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb6c0b4320 msgr2=0x7fcb6c0b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.742+0000 7fcb7099b700 1 --2- 172.21.15.37:0/829741697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb6c0b4320 0x7fcb6c0b1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.742+0000 7fcb7099b700 1 -- 172.21.15.37:0/829741697 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb6c0c7810 con 0x7fcb54003a50 2023-07-14T15:56:20.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.743+0000 7fcb7099b700 1 --2- 172.21.15.37:0/829741697 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb54003a50 0x7fcb6c0c85d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c005280 tx=0x7fcb5c010000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:20.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.743+0000 7f33cd59a700 1 -- 172.21.15.37:0/2298211016 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3808522916 0 0) 0x7f33b80035b0 con 0x7f33d00b0d30 2023-07-14T15:56:20.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.743+0000 7f33cd59a700 1 -- 172.21.15.37:0/2298211016 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f33d00cd3f0 msgr2=0x7f33d00cdf20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T15:56:20.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.743+0000 7f33cd59a700 1 --2- 172.21.15.37:0/2298211016 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f33d00cd3f0 0x7f33d00cdf20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.743+0000 7f33cd59a700 1 -- 172.21.15.37:0/2298211016 >> v2:172.21.15.98:3300/0 conn(0x7f33d006c2e0 msgr2=0x7f33d0158720 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T15:56:20.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.743+0000 7f33cd59a700 1 --2- 172.21.15.37:0/2298211016 >> v2:172.21.15.98:3300/0 conn(0x7f33d006c2e0 0x7f33d0158720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.743+0000 7f33cd59a700 1 -- 172.21.15.37:0/2298211016 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d00cc910 con 0x7f33d00b0d30 2023-07-14T15:56:20.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.743+0000 7f33cd59a700 1 -- 172.21.15.37:0/2298211016 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48633207 0 0) 0x7f33c4001670 con 0x7f33d00b0d30 2023-07-14T15:56:20.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.743+0000 7f929179c700 1 --2- 172.21.15.37:0/2261423753 >> [v2:172.21.15.98:6800/3529020407,v1:172.21.15.98:6801/3529020407] conn(0x7f92700735e0 0x7f92700759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.743+0000 7f33cd59a700 1 -- 172.21.15.37:0/2298211016 >> v1:172.21.15.37:6789/0 conn(0x7f33d00b0d30 legacy=0x7f33d006bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.743+0000 7f33cd59a700 1 --2- 172.21.15.37:0/2298211016 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f33b8003a00 0x7f33b8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.743+0000 7f33cd59a700 1 --2- 172.21.15.37:0/2298211016 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33b8004850 0x7f33b8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.743+0000 7f33cd59a700 1 --2- 172.21.15.37:0/2298211016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33b8005250 0x7f33b800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.743+0000 7f33cd59a700 1 -- 172.21.15.37:0/2298211016 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d00ae0f0 con 0x7f33b8005250 2023-07-14T15:56:20.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.743+0000 7f33cd59a700 1 -- 172.21.15.37:0/2298211016 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d0158c60 con 0x7f33b8004850 2023-07-14T15:56:20.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.743+0000 7f33cd59a700 1 -- 172.21.15.37:0/2298211016 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b800c1a0 con 0x7f33b8003a00 2023-07-14T15:56:20.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.743+0000 7fcb697fa700 1 -- 172.21.15.37:0/829741697 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c00aae0 con 0x7fcb54003a50 2023-07-14T15:56:20.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.743+0000 7fcb697fa700 1 -- 172.21.15.37:0/829741697 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb5c01e040 con 0x7fcb54003a50 2023-07-14T15:56:20.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.743+0000 7fcb697fa700 1 -- 172.21.15.37:0/829741697 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c003ab0 con 0x7fcb54003a50 2023-07-14T15:56:20.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.743+0000 7efeb9bff700 1 -- 172.21.15.37:0/690905797 shutdown_connections 2023-07-14T15:56:20.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.743+0000 7f33cdd9b700 1 --2- 172.21.15.37:0/2298211016 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33b8004850 0x7f33b8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.744+0000 7f2241f9c700 1 --2- 172.21.15.37:0/2654052073 >> [v2:172.21.15.37:6810/4166694594,v1:172.21.15.37:6812/4166694594] conn(0x7f2220073660 0x7f2220075a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.744+0000 7f33cdd9b700 1 -- 172.21.15.37:0/2298211016 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f33b8003a00 msgr2=0x7f33b8003e10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T15:56:20.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.744+0000 7f33cdd9b700 1 --2- 172.21.15.37:0/2298211016 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f33b8003a00 0x7f33b8003e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.744+0000 7f33cdd9b700 1 -- 172.21.15.37:0/2298211016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33b8005250 msgr2=0x7f33b800ba10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T15:56:20.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.744+0000 7f33cdd9b700 1 --2- 172.21.15.37:0/2298211016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33b8005250 0x7f33b800ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.744+0000 7f33cdd9b700 1 -- 172.21.15.37:0/2298211016 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d00cc910 con 0x7f33b8004850 2023-07-14T15:56:20.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.744+0000 7f33cdd9b700 1 --2- 172.21.15.37:0/2298211016 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33b8004850 0x7f33b8004cc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f33c400c3f0 tx=0x7f33b8005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6d7a492b38f943c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:20.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.743+0000 7fcb72bff700 1 -- 172.21.15.37:0/829741697 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb6c0c7af0 con 0x7fcb54003a50 2023-07-14T15:56:20.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.744+0000 7fcb72bff700 1 -- 172.21.15.37:0/829741697 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb6c0b47c0 con 0x7fcb54003a50 2023-07-14T15:56:20.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.745+0000 7fcb72bff700 1 -- 172.21.15.37:0/829741697 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcb6c0ca700 con 0x7fcb54003a50 2023-07-14T15:56:20.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.745+0000 7f2241f9c700 1 --2- 172.21.15.37:0/2654052073 >> [v2:172.21.15.37:6810/4166694594,v1:172.21.15.37:6812/4166694594] conn(0x7f2220073660 0x7f2220075a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:20.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.745+0000 7f33cd59a700 1 -- 172.21.15.37:0/2298211016 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c4005960 con 0x7f33b8004850 2023-07-14T15:56:20.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.745+0000 7f33cd59a700 1 -- 172.21.15.37:0/2298211016 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c4005ae0 con 0x7f33b8004850 2023-07-14T15:56:20.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.745+0000 7f33cd59a700 1 -- 172.21.15.37:0/2298211016 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c4005e90 con 0x7f33b8004850 2023-07-14T15:56:20.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.743+0000 7efeb9bff700 1 -- 172.21.15.37:0/690905797 wait complete. 2023-07-14T15:56:20.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.746+0000 7f33d4bff700 1 -- 172.21.15.37:0/2298211016 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33b8004850 msgr2=0x7f33b8004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.746+0000 7f33d4bff700 1 --2- 172.21.15.37:0/2298211016 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33b8004850 0x7f33b8004cc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f33c400c3f0 tx=0x7f33b8005880 comp rx=0 tx=0).stop 2023-07-14T15:56:20.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.746+0000 7f33ced9d700 1 -- 172.21.15.37:0/2298211016 reap_dead start 2023-07-14T15:56:20.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.746+0000 7efeb9bff700 1 Processor -- start 2023-07-14T15:56:20.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.746+0000 7f2231ffb700 1 -- 172.21.15.37:0/2654052073 <== osd.3 v2:172.21.15.37:6810/4166694594 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f2220076120 con 0x7f2220073660 2023-07-14T15:56:20.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.746+0000 7efeb9bff700 1 -- start start 2023-07-14T15:56:20.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.747+0000 7fcb697fa700 1 -- 172.21.15.37:0/829741697 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcb5c003c10 con 0x7fcb54003a50 2023-07-14T15:56:20.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.748+0000 7f33d4bff700 1 -- 172.21.15.37:0/2298211016 shutdown_connections 2023-07-14T15:56:20.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.748+0000 7f33d4bff700 1 -- 172.21.15.37:0/2298211016 >> 172.21.15.37:0/2298211016 conn(0x7f33d006aaa0 msgr2=0x7f33d00b0620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:20.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.748+0000 7efeb9bff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efeb40b1f20 0x7efeb40b6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.748+0000 7efeb9bff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efeb40d0ff0 0x7efeb41557c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.748+0000 7efeb9bff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7efeb415c960 0x7efeb40c6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.748+0000 7efeb9bff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb40b6c80 con 0x7efeb40b1f20 2023-07-14T15:56:20.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.748+0000 7efeb9bff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb4155d00 con 0x7efeb40d0ff0 2023-07-14T15:56:20.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.748+0000 7efeb9bff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb40b6eb0 con 0x7efeb415c960 2023-07-14T15:56:20.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.748+0000 7fcb697fa700 1 --2- 172.21.15.37:0/829741697 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fcb5806ad20 0x7fcb5806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.749+0000 7f33d4bff700 1 -- 172.21.15.37:0/2298211016 shutdown_connections 2023-07-14T15:56:20.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.749+0000 7fcb697fa700 1 -- 172.21.15.37:0/829741697 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcb5c08ac90 con 0x7fcb54003a50 2023-07-14T15:56:20.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.749+0000 7efeaaffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efeb40d0ff0 0x7efeb41557c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.749+0000 7efeb3fff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7efeb415c960 0x7efeb40c6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.749+0000 7efeaaffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efeb40d0ff0 0x7efeb41557c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.37:42920/0 (socket says 172.21.15.37:42920) 2023-07-14T15:56:20.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.749+0000 7efeaaffd700 1 -- 172.21.15.37:0/3801318170 learned_addr learned my addr 172.21.15.37:0/3801318170 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:20.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.749+0000 7fcb697fa700 1 --2- 172.21.15.37:0/829741697 >> [v2:172.21.15.98:6816/1144470927,v1:172.21.15.98:6818/1144470927] conn(0x7fcb580735d0 0x7fcb580759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.749+0000 7fcb697fa700 1 -- 172.21.15.37:0/829741697 --> [v2:172.21.15.98:6816/1144470927,v1:172.21.15.98:6818/1144470927] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcb58076090 con 0x7fcb580735d0 2023-07-14T15:56:20.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.749+0000 7fcb697fa700 1 -- 172.21.15.37:0/829741697 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb5c08b000 con 0x7fcb54003a50 2023-07-14T15:56:20.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.749+0000 7efeb3fff700 1 -- 172.21.15.37:0/3801318170 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efeb40d0ff0 msgr2=0x7efeb41557c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.749+0000 7efeb3fff700 1 --2- 172.21.15.37:0/3801318170 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efeb40d0ff0 0x7efeb41557c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.749+0000 7efeb3fff700 1 -- 172.21.15.37:0/3801318170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efeb40b1f20 msgr2=0x7efeb40b6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.750+0000 7efeb3fff700 1 --2- 172.21.15.37:0/3801318170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efeb40b1f20 0x7efeb40b6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.750+0000 7efeb3fff700 1 -- 172.21.15.37:0/3801318170 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea4009b30 con 0x7efeb415c960 2023-07-14T15:56:20.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.749+0000 7f33d4bff700 1 -- 172.21.15.37:0/2298211016 wait complete. 2023-07-14T15:56:20.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.750+0000 7fcb7119c700 1 --2- 172.21.15.37:0/829741697 >> [v2:172.21.15.98:6816/1144470927,v1:172.21.15.98:6818/1144470927] conn(0x7fcb580735d0 0x7fcb580759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.750+0000 7efeb3fff700 1 --2- 172.21.15.37:0/3801318170 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7efeb415c960 0x7efeb40c6a10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efeac00b3f0 tx=0x7efeac00b700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:20.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.751+0000 7fcb7119c700 1 --2- 172.21.15.37:0/829741697 >> [v2:172.21.15.98:6816/1144470927,v1:172.21.15.98:6818/1144470927] conn(0x7fcb580735d0 0x7fcb580759e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:20.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.751+0000 7f33d4bff700 1 Processor -- start 2023-07-14T15:56:20.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.751+0000 7f33d4bff700 1 -- start start 2023-07-14T15:56:20.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.752+0000 7fcb697fa700 1 -- 172.21.15.37:0/829741697 <== osd.7 v2:172.21.15.98:6816/1144470927 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fcb58076090 con 0x7fcb580735d0 2023-07-14T15:56:20.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.748+0000 7f929179c700 1 --2- 172.21.15.37:0/2261423753 >> [v2:172.21.15.98:6800/3529020407,v1:172.21.15.98:6801/3529020407] conn(0x7f92700735e0 0x7f92700759f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:20.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.752+0000 7f92897fa700 1 -- 172.21.15.37:0/2261423753 <== osd.4 v2:172.21.15.98:6800/3529020407 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f92700760a0 con 0x7f92700735e0 2023-07-14T15:56:20.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.752+0000 7efeb0ff9700 1 -- 172.21.15.37:0/3801318170 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac011830 con 0x7efeb415c960 2023-07-14T15:56:20.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.752+0000 7efeb0ff9700 1 -- 172.21.15.37:0/3801318170 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeac0119b0 con 0x7efeb415c960 2023-07-14T15:56:20.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.752+0000 7efeb0ff9700 1 -- 172.21.15.37:0/3801318170 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac011d60 con 0x7efeb415c960 2023-07-14T15:56:20.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.753+0000 7efeb9bff700 1 -- 172.21.15.37:0/3801318170 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeb40b7190 con 0x7efeb415c960 2023-07-14T15:56:20.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.753+0000 7efeb9bff700 1 -- 172.21.15.37:0/3801318170 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb40b7750 con 0x7efeb415c960 2023-07-14T15:56:20.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.753+0000 7f33d4bff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f33b8004850 0x7f33d0145e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.753+0000 7f33d4bff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33d0151140 0x7f33d00c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.753+0000 7f33d4bff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33d00b4620 0x7f33d00b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.753+0000 7f33d4bff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d0159f50 con 0x7f33d00b4620 2023-07-14T15:56:20.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.753+0000 7f33d4bff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d015b560 con 0x7f33d0151140 2023-07-14T15:56:20.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.753+0000 7f33d4bff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d01463a0 con 0x7f33b8004850 2023-07-14T15:56:20.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.753+0000 7f33cdd9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33d0151140 0x7f33d00c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.753+0000 7f33ce59c700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f33b8004850 0x7f33d0145e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.753+0000 7f33cdd9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33d0151140 0x7f33d00c7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.37:42924/0 (socket says 172.21.15.37:42924) 2023-07-14T15:56:20.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.753+0000 7f33cdd9b700 1 -- 172.21.15.37:0/4091377526 learned_addr learned my addr 172.21.15.37:0/4091377526 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:20.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.753+0000 7f33ced9d700 1 --2- 172.21.15.37:0/4091377526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33d00b4620 0x7f33d00b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.754+0000 7f33cdd9b700 1 -- 172.21.15.37:0/4091377526 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f33b8004850 msgr2=0x7f33d0145e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.754+0000 7f33cdd9b700 1 --2- 172.21.15.37:0/4091377526 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f33b8004850 0x7f33d0145e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.754+0000 7f33cdd9b700 1 -- 172.21.15.37:0/4091377526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33d00b4620 msgr2=0x7f33d00b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.754+0000 7f33cdd9b700 1 --2- 172.21.15.37:0/4091377526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33d00b4620 0x7f33d00b1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.754+0000 7f33cdd9b700 1 -- 172.21.15.37:0/4091377526 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d015af10 con 0x7f33d0151140 2023-07-14T15:56:20.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.754+0000 7f33cdd9b700 1 --2- 172.21.15.37:0/4091377526 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33d0151140 0x7f33d00c7d90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f33b800c170 tx=0x7f33c4001930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:20.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.755+0000 7fcb6bfff700 1 --2- 172.21.15.37:0/829741697 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fcb5806ad20 0x7fcb5806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.755+0000 7f33beffd700 1 -- 172.21.15.37:0/4091377526 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c40072d0 con 0x7f33d0151140 2023-07-14T15:56:20.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.755+0000 7f33beffd700 1 -- 172.21.15.37:0/4091377526 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c4007450 con 0x7f33d0151140 2023-07-14T15:56:20.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.755+0000 7f33beffd700 1 -- 172.21.15.37:0/4091377526 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c4007800 con 0x7f33d0151140 2023-07-14T15:56:20.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.755+0000 7f33d4bff700 1 -- 172.21.15.37:0/4091377526 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33d015b1f0 con 0x7f33d0151140 2023-07-14T15:56:20.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.755+0000 7f33d4bff700 1 -- 172.21.15.37:0/4091377526 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33d00c82d0 con 0x7f33d0151140 2023-07-14T15:56:20.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.756+0000 7efeb0ff9700 1 -- 172.21.15.37:0/3801318170 <== mon.2 v2:172.21.15.98:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efeac01a400 con 0x7efeb415c960 2023-07-14T15:56:20.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.757+0000 7f33d4bff700 1 -- 172.21.15.37:0/4091377526 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f33d00cced0 con 0x7f33d0151140 2023-07-14T15:56:20.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.757+0000 7efeb0ff9700 1 --2- 172.21.15.37:0/3801318170 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7efe9406ad30 0x7efe9406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.757+0000 7efeb0ff9700 1 -- 172.21.15.37:0/3801318170 <== mon.2 v2:172.21.15.98:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efeac089370 con 0x7efeb415c960 2023-07-14T15:56:20.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.758+0000 7efeb37fe700 1 --2- 172.21.15.37:0/3801318170 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7efe9406ad30 0x7efe9406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.759+0000 7efeb9bff700 1 --2- 172.21.15.37:0/3801318170 >> [v2:172.21.15.98:6817/2311501838,v1:172.21.15.98:6819/2311501838] conn(0x7efe980015e0 0x7efe98003a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.759+0000 7efeb9bff700 1 -- 172.21.15.37:0/3801318170 --> [v2:172.21.15.98:6817/2311501838,v1:172.21.15.98:6819/2311501838] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efe98006bc0 con 0x7efe980015e0 2023-07-14T15:56:20.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.759+0000 7f33beffd700 1 -- 172.21.15.37:0/4091377526 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f33c401f410 con 0x7f33d0151140 2023-07-14T15:56:20.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.760+0000 7efeaaffd700 1 --2- 172.21.15.37:0/3801318170 >> [v2:172.21.15.98:6817/2311501838,v1:172.21.15.98:6819/2311501838] conn(0x7efe980015e0 0x7efe98003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.760+0000 7efeaaffd700 1 --2- 172.21.15.37:0/3801318170 >> [v2:172.21.15.98:6817/2311501838,v1:172.21.15.98:6819/2311501838] conn(0x7efe980015e0 0x7efe98003a90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:20.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.761+0000 7f33beffd700 1 --2- 172.21.15.37:0/4091377526 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f33b006ad30 0x7f33b006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.761+0000 7efeb37fe700 1 --2- 172.21.15.37:0/3801318170 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7efe9406ad30 0x7efe9406d1e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efe9c0096d0 tx=0x7efe9c006c30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:20.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.761+0000 7f33beffd700 1 -- 172.21.15.37:0/4091377526 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f33c408b830 con 0x7f33d0151140 2023-07-14T15:56:20.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.761+0000 7f33beffd700 1 --2- 172.21.15.37:0/4091377526 >> [v2:172.21.15.98:6808/1144224691,v1:172.21.15.98:6809/1144224691] conn(0x7f33b00735e0 0x7f33b00759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:20.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.761+0000 7f33beffd700 1 -- 172.21.15.37:0/4091377526 --> [v2:172.21.15.98:6808/1144224691,v1:172.21.15.98:6809/1144224691] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f33b00760a0 con 0x7f33b00735e0 2023-07-14T15:56:20.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.761+0000 7f33beffd700 1 -- 172.21.15.37:0/4091377526 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f33c408bba0 con 0x7f33d0151140 2023-07-14T15:56:20.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.761+0000 7efeb0ff9700 1 -- 172.21.15.37:0/3801318170 <== osd.5 v2:172.21.15.98:6817/2311501838 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7efe98006bc0 con 0x7efe980015e0 2023-07-14T15:56:20.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.762+0000 7f33ce59c700 1 --2- 172.21.15.37:0/4091377526 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f33b006ad30 0x7f33b006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.762+0000 7f33ced9d700 1 --2- 172.21.15.37:0/4091377526 >> [v2:172.21.15.98:6808/1144224691,v1:172.21.15.98:6809/1144224691] conn(0x7f33b00735e0 0x7f33b00759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:20.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.762+0000 7f33ce59c700 1 --2- 172.21.15.37:0/4091377526 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f33b006ad30 0x7f33b006d1e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f33c0009980 tx=0x7f33c00090e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:20.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.763+0000 7f33ced9d700 1 --2- 172.21.15.37:0/4091377526 >> [v2:172.21.15.98:6808/1144224691,v1:172.21.15.98:6809/1144224691] conn(0x7f33b00735e0 0x7f33b00759f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:20.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.764+0000 7f33beffd700 1 -- 172.21.15.37:0/4091377526 <== osd.6 v2:172.21.15.98:6808/1144224691 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f33b00760a0 con 0x7f33b00735e0 2023-07-14T15:56:20.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.768+0000 7fa3e1dff700 1 -- 172.21.15.37:0/3603881842 --> [v2:172.21.15.37:6800/2783032392,v1:172.21.15.37:6801/2783032392] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa3dc0ce3f0 con 0x7fa3c80735e0 2023-07-14T15:56:20.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.768+0000 7fcb6bfff700 1 --2- 172.21.15.37:0/829741697 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fcb5806ad20 0x7fcb5806d1d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c0b1b20 tx=0x7fcb60007af0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:20.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.768+0000 7f02179ff700 1 -- 172.21.15.37:0/1193863944 --> [v2:172.21.15.37:6808/2266223499,v1:172.21.15.37:6809/2266223499] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f021006bb70 con 0x7f01f4073590 2023-07-14T15:56:20.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.769+0000 7f0205ffb700 1 -- 172.21.15.37:0/1193863944 <== osd.2 v2:172.21.15.37:6808/2266223499 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f020c022040 con 0x7f01f4073590 2023-07-14T15:56:20.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.770+0000 7fa3c3fff700 1 -- 172.21.15.37:0/3603881842 <== osd.0 v2:172.21.15.37:6800/2783032392 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa3cc009950 con 0x7fa3c80735e0 2023-07-14T15:56:20.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.770+0000 7f02179ff700 1 -- 172.21.15.37:0/1193863944 >> [v2:172.21.15.37:6808/2266223499,v1:172.21.15.37:6809/2266223499] conn(0x7f01f4073590 msgr2=0x7f01f40759a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.770+0000 7f02179ff700 1 --2- 172.21.15.37:0/1193863944 >> [v2:172.21.15.37:6808/2266223499,v1:172.21.15.37:6809/2266223499] conn(0x7f01f4073590 0x7f01f40759a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.771+0000 7fa3e1dff700 1 -- 172.21.15.37:0/3603881842 >> [v2:172.21.15.37:6800/2783032392,v1:172.21.15.37:6801/2783032392] conn(0x7fa3c80735e0 msgr2=0x7fa3c80759f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.771+0000 7fa3e1dff700 1 --2- 172.21.15.37:0/3603881842 >> [v2:172.21.15.37:6800/2783032392,v1:172.21.15.37:6801/2783032392] conn(0x7fa3c80735e0 0x7fa3c80759f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.771+0000 7fa3e1dff700 1 -- 172.21.15.37:0/3603881842 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa3c806adb0 msgr2=0x7fa3c806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.771+0000 7fa3e1dff700 1 --2- 172.21.15.37:0/3603881842 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa3c806adb0 0x7fa3c806d260 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0000fb0 tx=0x7fa3d0009040 comp rx=0 tx=0).stop 2023-07-14T15:56:20.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.771+0000 7fa3e1dff700 1 -- 172.21.15.37:0/3603881842 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3dc0b2c30 msgr2=0x7fa3dc0cb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.771+0000 7fa3e1dff700 1 --2- 172.21.15.37:0/3603881842 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3dc0b2c30 0x7fa3dc0cb840 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4015000 tx=0x7fa3d4001360 comp rx=0 tx=0).stop 2023-07-14T15:56:20.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.771+0000 7fa3dbfff700 1 -- 172.21.15.37:0/3603881842 reap_dead start 2023-07-14T15:56:20.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.772+0000 7fa3e1dff700 1 -- 172.21.15.37:0/3603881842 shutdown_connections 2023-07-14T15:56:20.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.772+0000 7fa3e1dff700 1 -- 172.21.15.37:0/3603881842 >> 172.21.15.37:0/3603881842 conn(0x7fa3dc09c1e0 msgr2=0x7fa3dc0cfe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:20.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.772+0000 7fa3e1dff700 1 -- 172.21.15.37:0/3603881842 shutdown_connections 2023-07-14T15:56:20.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.772+0000 7fa3e1dff700 1 -- 172.21.15.37:0/3603881842 wait complete. 2023-07-14T15:56:20.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.777+0000 7f02179ff700 1 -- 172.21.15.37:0/1193863944 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f01f406ace0 msgr2=0x7f01f406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.777+0000 7f02179ff700 1 --2- 172.21.15.37:0/1193863944 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f01f406ace0 0x7f01f406d190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0208002060 tx=0x7f0208001890 comp rx=0 tx=0).stop 2023-07-14T15:56:20.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.777+0000 7f02179ff700 1 -- 172.21.15.37:0/1193863944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f021006f6c0 msgr2=0x7f021006fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.777+0000 7f02179ff700 1 --2- 172.21.15.37:0/1193863944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f021006f6c0 0x7f021006fb60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0210072010 tx=0x7f020000e7c0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.777+0000 7f0215f9c700 1 -- 172.21.15.37:0/1193863944 reap_dead start 2023-07-14T15:56:20.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.778+0000 7f02179ff700 1 -- 172.21.15.37:0/1193863944 shutdown_connections 2023-07-14T15:56:20.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.778+0000 7f02179ff700 1 -- 172.21.15.37:0/1193863944 >> 172.21.15.37:0/1193863944 conn(0x7f02100b0620 msgr2=0x7f02100cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:20.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.778+0000 7f02179ff700 1 -- 172.21.15.37:0/1193863944 shutdown_connections 2023-07-14T15:56:20.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.778+0000 7f02179ff700 1 -- 172.21.15.37:0/1193863944 wait complete. 2023-07-14T15:56:20.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.782+0000 7f219abff700 1 -- 172.21.15.37:0/2226246151 --> [v2:172.21.15.37:6821/1190059746,v1:172.21.15.37:6823/1190059746] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f21940b2610 con 0x7f2178073630 2023-07-14T15:56:20.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.783+0000 7f21917fa700 1 -- 172.21.15.37:0/2226246151 <== osd.1 v2:172.21.15.37:6821/1190059746 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2188022040 con 0x7f2178073630 2023-07-14T15:56:20.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.784+0000 7f219abff700 1 -- 172.21.15.37:0/2226246151 >> [v2:172.21.15.37:6821/1190059746,v1:172.21.15.37:6823/1190059746] conn(0x7f2178073630 msgr2=0x7f2178075a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.784+0000 7f219abff700 1 --2- 172.21.15.37:0/2226246151 >> [v2:172.21.15.37:6821/1190059746,v1:172.21.15.37:6823/1190059746] conn(0x7f2178073630 0x7f2178075a40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.786+0000 7f219abff700 1 -- 172.21.15.37:0/2226246151 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f217806ad80 msgr2=0x7f217806d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.786+0000 7f219abff700 1 --2- 172.21.15.37:0/2226246151 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f217806ad80 0x7f217806d230 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2180001620 tx=0x7f21800010d0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.786+0000 7f219abff700 1 -- 172.21.15.37:0/2226246151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f219415c960 msgr2=0x7f21940cef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.786+0000 7f219abff700 1 --2- 172.21.15.37:0/2226246151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f219415c960 0x7f21940cef70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f218c00eba0 tx=0x7f218c00eeb0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.786+0000 7f22439ff700 1 -- 172.21.15.37:0/2654052073 --> [v2:172.21.15.37:6810/4166694594,v1:172.21.15.37:6812/4166694594] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f223c15ae40 con 0x7f2220073660 2023-07-14T15:56:20.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.786+0000 7f219919c700 1 -- 172.21.15.37:0/2226246151 reap_dead start 2023-07-14T15:56:20.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.786+0000 7fcb72bff700 1 -- 172.21.15.37:0/829741697 --> [v2:172.21.15.98:6816/1144470927,v1:172.21.15.98:6818/1144470927] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcb6c06bea0 con 0x7fcb580735d0 2023-07-14T15:56:20.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.787+0000 7f219abff700 1 -- 172.21.15.37:0/2226246151 shutdown_connections 2023-07-14T15:56:20.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.787+0000 7f219abff700 1 -- 172.21.15.37:0/2226246151 >> 172.21.15.37:0/2226246151 conn(0x7f219409c1d0 msgr2=0x7f21940b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:20.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.787+0000 7f219abff700 1 -- 172.21.15.37:0/2226246151 shutdown_connections 2023-07-14T15:56:20.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.787+0000 7f2231ffb700 1 -- 172.21.15.37:0/2654052073 <== osd.3 v2:172.21.15.37:6810/4166694594 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2238007e50 con 0x7f2220073660 2023-07-14T15:56:20.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.787+0000 7fcb697fa700 1 -- 172.21.15.37:0/829741697 <== osd.7 v2:172.21.15.98:6816/1144470927 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcb64007eb0 con 0x7fcb580735d0 2023-07-14T15:56:20.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.788+0000 7f219abff700 1 -- 172.21.15.37:0/2226246151 wait complete. 2023-07-14T15:56:20.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.788+0000 7fcb72bff700 1 -- 172.21.15.37:0/829741697 >> [v2:172.21.15.98:6816/1144470927,v1:172.21.15.98:6818/1144470927] conn(0x7fcb580735d0 msgr2=0x7fcb580759e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.788+0000 7fcb72bff700 1 --2- 172.21.15.37:0/829741697 >> [v2:172.21.15.98:6816/1144470927,v1:172.21.15.98:6818/1144470927] conn(0x7fcb580735d0 0x7fcb580759e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.788+0000 7f22439ff700 1 -- 172.21.15.37:0/2654052073 >> [v2:172.21.15.37:6810/4166694594,v1:172.21.15.37:6812/4166694594] conn(0x7f2220073660 msgr2=0x7f2220075a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.788+0000 7f22439ff700 1 --2- 172.21.15.37:0/2654052073 >> [v2:172.21.15.37:6810/4166694594,v1:172.21.15.37:6812/4166694594] conn(0x7f2220073660 0x7f2220075a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.788+0000 7fcb72bff700 1 -- 172.21.15.37:0/829741697 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fcb5806ad20 msgr2=0x7fcb5806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.788+0000 7fcb72bff700 1 --2- 172.21.15.37:0/829741697 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fcb5806ad20 0x7fcb5806d1d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c0b1b20 tx=0x7fcb60007af0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.788+0000 7fcb72bff700 1 -- 172.21.15.37:0/829741697 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb54003a50 msgr2=0x7fcb6c0c85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.788+0000 7fcb72bff700 1 --2- 172.21.15.37:0/829741697 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb54003a50 0x7fcb6c0c85d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c005280 tx=0x7fcb5c010000 comp rx=0 tx=0).stop 2023-07-14T15:56:20.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.789+0000 7fcb7119c700 1 -- 172.21.15.37:0/829741697 reap_dead start 2023-07-14T15:56:20.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.789+0000 7fcb72bff700 1 -- 172.21.15.37:0/829741697 shutdown_connections 2023-07-14T15:56:20.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.789+0000 7fcb72bff700 1 -- 172.21.15.37:0/829741697 >> 172.21.15.37:0/829741697 conn(0x7fcb6c0b0620 msgr2=0x7fcb6c071020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:20.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.789+0000 7fcb72bff700 1 -- 172.21.15.37:0/829741697 shutdown_connections 2023-07-14T15:56:20.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.789+0000 7fcb72bff700 1 -- 172.21.15.37:0/829741697 wait complete. 2023-07-14T15:56:20.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.791+0000 7f92931ff700 1 -- 172.21.15.37:0/2261423753 --> [v2:172.21.15.98:6800/3529020407,v1:172.21.15.98:6801/3529020407] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f928c14e9b0 con 0x7f92700735e0 2023-07-14T15:56:20.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.795+0000 7f92897fa700 1 -- 172.21.15.37:0/2261423753 <== osd.4 v2:172.21.15.98:6800/3529020407 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f928c14e9b0 con 0x7f92700735e0 2023-07-14T15:56:20.823 INFO:teuthology.orchestra.run.smithi037.stdout:68719476746 2023-07-14T15:56:20.824 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-14T15:56:20.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.793+0000 7f22439ff700 1 -- 172.21.15.37:0/2654052073 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f222006adb0 msgr2=0x7f222006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.793+0000 7f22439ff700 1 --2- 172.21.15.37:0/2654052073 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f222006adb0 0x7f222006d260 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2234009fd0 tx=0x7f223400b040 comp rx=0 tx=0).stop 2023-07-14T15:56:20.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.793+0000 7f22439ff700 1 -- 172.21.15.37:0/2654052073 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f223c0cedd0 msgr2=0x7f223c1f92b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.793+0000 7f22439ff700 1 --2- 172.21.15.37:0/2654052073 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f223c0cedd0 0x7f223c1f92b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f222c016000 tx=0x7f222c004750 comp rx=0 tx=0).stop 2023-07-14T15:56:20.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.793+0000 7f2241f9c700 1 -- 172.21.15.37:0/2654052073 reap_dead start 2023-07-14T15:56:20.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.798+0000 7efeb9bff700 1 -- 172.21.15.37:0/3801318170 --> [v2:172.21.15.98:6817/2311501838,v1:172.21.15.98:6819/2311501838] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efe98005c40 con 0x7efe980015e0 2023-07-14T15:56:20.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.798+0000 7f22439ff700 1 -- 172.21.15.37:0/2654052073 shutdown_connections 2023-07-14T15:56:20.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.798+0000 7f22439ff700 1 -- 172.21.15.37:0/2654052073 >> 172.21.15.37:0/2654052073 conn(0x7f223c0664f0 msgr2=0x7f223c06dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:20.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.799+0000 7f33d4bff700 1 -- 172.21.15.37:0/4091377526 --> [v2:172.21.15.98:6808/1144224691,v1:172.21.15.98:6809/1144224691] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f33d00ccbf0 con 0x7f33b00735e0 2023-07-14T15:56:20.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.799+0000 7efeb0ff9700 1 -- 172.21.15.37:0/3801318170 <== osd.5 v2:172.21.15.98:6817/2311501838 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efe98005c40 con 0x7efe980015e0 2023-07-14T15:56:20.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.799+0000 7f22439ff700 1 -- 172.21.15.37:0/2654052073 shutdown_connections 2023-07-14T15:56:20.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.799+0000 7f22439ff700 1 -- 172.21.15.37:0/2654052073 wait complete. 2023-07-14T15:56:20.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.799+0000 7f92931ff700 1 -- 172.21.15.37:0/2261423753 >> [v2:172.21.15.98:6800/3529020407,v1:172.21.15.98:6801/3529020407] conn(0x7f92700735e0 msgr2=0x7f92700759f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.799+0000 7f92931ff700 1 --2- 172.21.15.37:0/2261423753 >> [v2:172.21.15.98:6800/3529020407,v1:172.21.15.98:6801/3529020407] conn(0x7f92700735e0 0x7f92700759f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.799+0000 7efeb9bff700 1 -- 172.21.15.37:0/3801318170 >> [v2:172.21.15.98:6817/2311501838,v1:172.21.15.98:6819/2311501838] conn(0x7efe980015e0 msgr2=0x7efe98003a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.799+0000 7efeb9bff700 1 --2- 172.21.15.37:0/3801318170 >> [v2:172.21.15.98:6817/2311501838,v1:172.21.15.98:6819/2311501838] conn(0x7efe980015e0 0x7efe98003a90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.799+0000 7f92931ff700 1 -- 172.21.15.37:0/2261423753 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f927006ad30 msgr2=0x7f927006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.799+0000 7f92931ff700 1 --2- 172.21.15.37:0/2261423753 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f927006ad30 0x7f927006d1e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f928c160770 tx=0x7f9278008040 comp rx=0 tx=0).stop 2023-07-14T15:56:20.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.799+0000 7f92931ff700 1 -- 172.21.15.37:0/2261423753 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f928c147280 msgr2=0x7f928c14f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.799+0000 7f92931ff700 1 --2- 172.21.15.37:0/2261423753 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f928c147280 0x7f928c14f070 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f928000e560 tx=0x7f928000e920 comp rx=0 tx=0).stop 2023-07-14T15:56:20.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.800+0000 7f929179c700 1 -- 172.21.15.37:0/2261423753 reap_dead start 2023-07-14T15:56:20.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.799+0000 7efeb9bff700 1 -- 172.21.15.37:0/3801318170 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7efe9406ad30 msgr2=0x7efe9406d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.799+0000 7efeb9bff700 1 --2- 172.21.15.37:0/3801318170 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7efe9406ad30 0x7efe9406d1e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efe9c0096d0 tx=0x7efe9c006c30 comp rx=0 tx=0).stop 2023-07-14T15:56:20.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.800+0000 7efeb9bff700 1 -- 172.21.15.37:0/3801318170 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7efeb415c960 msgr2=0x7efeb40c6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.800+0000 7efeb9bff700 1 --2- 172.21.15.37:0/3801318170 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7efeb415c960 0x7efeb40c6a10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efeac00b3f0 tx=0x7efeac00b700 comp rx=0 tx=0).stop 2023-07-14T15:56:20.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.800+0000 7efeb3fff700 1 -- 172.21.15.37:0/3801318170 reap_dead start 2023-07-14T15:56:20.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.800+0000 7f33beffd700 1 -- 172.21.15.37:0/4091377526 <== osd.6 v2:172.21.15.98:6808/1144224691 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f33c8009bd0 con 0x7f33b00735e0 2023-07-14T15:56:20.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.800+0000 7f92931ff700 1 -- 172.21.15.37:0/2261423753 shutdown_connections 2023-07-14T15:56:20.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.800+0000 7f92931ff700 1 -- 172.21.15.37:0/2261423753 >> 172.21.15.37:0/2261423753 conn(0x7f928c0b0620 msgr2=0x7f928c0cb710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:20.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.800+0000 7efeb9bff700 1 -- 172.21.15.37:0/3801318170 shutdown_connections 2023-07-14T15:56:20.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.800+0000 7efeb9bff700 1 -- 172.21.15.37:0/3801318170 >> 172.21.15.37:0/3801318170 conn(0x7efeb409c1d0 msgr2=0x7efeb40b3980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:20.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.800+0000 7f92931ff700 1 -- 172.21.15.37:0/2261423753 shutdown_connections 2023-07-14T15:56:20.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.800+0000 7f92931ff700 1 -- 172.21.15.37:0/2261423753 wait complete. 2023-07-14T15:56:20.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.800+0000 7efeb9bff700 1 -- 172.21.15.37:0/3801318170 shutdown_connections 2023-07-14T15:56:20.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.800+0000 7efeb9bff700 1 -- 172.21.15.37:0/3801318170 wait complete. 2023-07-14T15:56:20.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.800+0000 7f33d4bff700 1 -- 172.21.15.37:0/4091377526 >> [v2:172.21.15.98:6808/1144224691,v1:172.21.15.98:6809/1144224691] conn(0x7f33b00735e0 msgr2=0x7f33b00759f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.800+0000 7f33d4bff700 1 --2- 172.21.15.37:0/4091377526 >> [v2:172.21.15.98:6808/1144224691,v1:172.21.15.98:6809/1144224691] conn(0x7f33b00735e0 0x7f33b00759f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.801+0000 7f33d4bff700 1 -- 172.21.15.37:0/4091377526 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f33b006ad30 msgr2=0x7f33b006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.801+0000 7f33d4bff700 1 --2- 172.21.15.37:0/4091377526 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f33b006ad30 0x7f33b006d1e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f33c0009980 tx=0x7f33c00090e0 comp rx=0 tx=0).stop 2023-07-14T15:56:20.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.801+0000 7f33d4bff700 1 -- 172.21.15.37:0/4091377526 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33d0151140 msgr2=0x7f33d00c7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:20.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.801+0000 7f33d4bff700 1 --2- 172.21.15.37:0/4091377526 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33d0151140 0x7f33d00c7d90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f33b800c170 tx=0x7f33c4001930 comp rx=0 tx=0).stop 2023-07-14T15:56:20.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.801+0000 7f33ced9d700 1 -- 172.21.15.37:0/4091377526 reap_dead start 2023-07-14T15:56:20.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.801+0000 7f33d4bff700 1 -- 172.21.15.37:0/4091377526 shutdown_connections 2023-07-14T15:56:20.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.801+0000 7f33d4bff700 1 -- 172.21.15.37:0/4091377526 >> 172.21.15.37:0/4091377526 conn(0x7f33d006aaa0 msgr2=0x7f33d00afad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:20.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.802+0000 7f33d4bff700 1 -- 172.21.15.37:0/4091377526 shutdown_connections 2023-07-14T15:56:20.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:20.802+0000 7f33d4bff700 1 -- 172.21.15.37:0/4091377526 wait complete. 2023-07-14T15:56:20.835 INFO:teuthology.orchestra.run.smithi037.stdout:64424509449 2023-07-14T15:56:20.836 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-14T15:56:20.837 INFO:teuthology.orchestra.run.smithi037.stdout:60129542151 2023-07-14T15:56:20.837 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-14T15:56:20.838 INFO:teuthology.orchestra.run.smithi037.stdout:64424509449 2023-07-14T15:56:20.838 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-14T15:56:20.839 INFO:teuthology.orchestra.run.smithi037.stdout:68719476745 2023-07-14T15:56:20.839 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-14T15:56:20.840 INFO:teuthology.orchestra.run.smithi037.stdout:64424509448 2023-07-14T15:56:20.840 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-14T15:56:20.841 INFO:teuthology.orchestra.run.smithi037.stdout:60129542152 2023-07-14T15:56:20.841 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-14T15:56:20.842 INFO:teuthology.orchestra.run.smithi037.stdout:64424509450 2023-07-14T15:56:20.843 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-14T15:56:21.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.251+0000 7fe8543ff700 1 Processor -- start 2023-07-14T15:56:21.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.251+0000 7fe8543ff700 1 -- start start 2023-07-14T15:56:21.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.253+0000 7fe8543ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe84c0b0d30 0x7fe84c06bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.253+0000 7fe8543ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe84c0cd3f0 0x7fe84c0cdf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.253+0000 7fe8543ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe84c0cc6a0 con 0x7fe84c06c2e0 2023-07-14T15:56:21.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.253+0000 7fe8543ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe84c0ae0f0 con 0x7fe84c0b0d30 2023-07-14T15:56:21.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.253+0000 7fe8543ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe84c06c070 con 0x7fe84c0cd3f0 2023-07-14T15:56:21.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.254+0000 7fe85299c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe84c0cd3f0 0x7fe84c0cdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:21.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.254+0000 7fe85299c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe84c0cd3f0 0x7fe84c0cdf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.37:42936/0 (socket says 172.21.15.37:42936) 2023-07-14T15:56:21.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.254+0000 7fe85299c700 1 -- 172.21.15.37:0/2327553594 learned_addr learned my addr 172.21.15.37:0/2327553594 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:21.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.255+0000 7fe85299c700 1 -- 172.21.15.37:0/2327553594 >> v2:172.21.15.37:3300/0 conn(0x7fe84c0b0d30 msgr2=0x7fe84c06bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:21.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.255+0000 7fe85299c700 1 --2- 172.21.15.37:0/2327553594 >> v2:172.21.15.37:3300/0 conn(0x7fe84c0b0d30 0x7fe84c06bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.255+0000 7fe85299c700 1 -- 172.21.15.37:0/2327553594 >> v1:172.21.15.37:6789/0 conn(0x7fe84c06c2e0 legacy=0x7fe84c158720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:21.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.255+0000 7fe85299c700 1 -- 172.21.15.37:0/2327553594 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe84c06c7a0 con 0x7fe84c0cd3f0 2023-07-14T15:56:21.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.256+0000 7f4af99ff700 1 Processor -- start 2023-07-14T15:56:21.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.256+0000 7fe85299c700 1 --2- 172.21.15.37:0/2327553594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe84c0cd3f0 0x7fe84c0cdf20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe84c06c6b0 tx=0x7fe844009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da036a58446b7733 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:21.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.256+0000 7f4af99ff700 1 -- start start 2023-07-14T15:56:21.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.257+0000 7f9295dff700 1 Processor -- start 2023-07-14T15:56:21.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.257+0000 7f9295dff700 1 -- start start 2023-07-14T15:56:21.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.257+0000 7fe851199700 1 -- 172.21.15.37:0/2327553594 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe844004230 con 0x7fe84c0cd3f0 2023-07-14T15:56:21.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.257+0000 7fe851199700 1 -- 172.21.15.37:0/2327553594 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe844004390 con 0x7fe84c0cd3f0 2023-07-14T15:56:21.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.257+0000 7fe851199700 1 -- 172.21.15.37:0/2327553594 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8440036a0 con 0x7fe84c0cd3f0 2023-07-14T15:56:21.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.259+0000 7fe8543ff700 1 -- 172.21.15.37:0/2327553594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe84c0cd3f0 msgr2=0x7fe84c0cdf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:21.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.259+0000 7fe8543ff700 1 --2- 172.21.15.37:0/2327553594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe84c0cd3f0 0x7fe84c0cdf20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe84c06c6b0 tx=0x7fe844009bd0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.259+0000 7fe8543ff700 1 -- 172.21.15.37:0/2327553594 shutdown_connections 2023-07-14T15:56:21.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.259+0000 7fe8543ff700 1 --2- 172.21.15.37:0/2327553594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe84c0cd3f0 0x7fe84c0cdf20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.259+0000 7fe8543ff700 1 --2- 172.21.15.37:0/2327553594 >> v2:172.21.15.37:3300/0 conn(0x7fe84c0b0d30 0x7fe84c06bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.259+0000 7fe8543ff700 1 -- 172.21.15.37:0/2327553594 >> 172.21.15.37:0/2327553594 conn(0x7fe84c06aaa0 msgr2=0x7fe84c0b0620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:21.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.259+0000 7f9295dff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9290158720 0x7f929006bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.259+0000 7f9295dff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f929006c2e0 0x7f92900cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.259+0000 7f9295dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f92900cd930 0x7f92900cdf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.259+0000 7f9295dff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92900ae0f0 con 0x7f929006c2e0 2023-07-14T15:56:21.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.259+0000 7f9295dff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92900cc6a0 con 0x7f9290158720 2023-07-14T15:56:21.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.259+0000 7f9295dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f929006c070 con 0x7f92900cd930 2023-07-14T15:56:21.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.259+0000 7fe8543ff700 1 -- 172.21.15.37:0/2327553594 shutdown_connections 2023-07-14T15:56:21.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.259+0000 7fe8543ff700 1 -- 172.21.15.37:0/2327553594 wait complete. 2023-07-14T15:56:21.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.260+0000 7f928f7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9290158720 0x7f929006bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:21.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.260+0000 7f928ffff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f92900cd930 0x7f92900cdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:21.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.260+0000 7f928f7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f9290158720 0x7f929006bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.37:42950/0 (socket says 172.21.15.37:42950) 2023-07-14T15:56:21.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.260+0000 7f928ffff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f92900cd930 0x7f92900cdf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3301/0 says I am v2:172.21.15.37:44552/0 (socket says 172.21.15.37:44552) 2023-07-14T15:56:21.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.260+0000 7f928f7fe700 1 -- 172.21.15.37:0/3158605855 learned_addr learned my addr 172.21.15.37:0/3158605855 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:21.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.260+0000 7f4af99ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4af406c2e0 0x7f4af4158720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.260+0000 7f4af99ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4af40cdf20 0x7f4af40ce3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.260+0000 7f4af99ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4af40cc6a0 con 0x7f4af40b0d30 2023-07-14T15:56:21.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.260+0000 7f4af99ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4af40ce900 con 0x7f4af40cdf20 2023-07-14T15:56:21.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.260+0000 7f4af99ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af40ae0f0 con 0x7f4af406c2e0 2023-07-14T15:56:21.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.261+0000 7f4af2ffd700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4af406c2e0 0x7f4af4158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:21.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.261+0000 7f4af2ffd700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4af406c2e0 0x7f4af4158720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3301/0 says I am v2:172.21.15.37:44558/0 (socket says 172.21.15.37:44558) 2023-07-14T15:56:21.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.261+0000 7f4af2ffd700 1 -- 172.21.15.37:0/1048590729 learned_addr learned my addr 172.21.15.37:0/1048590729 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:21.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.262+0000 7f4af37fe700 1 --2- 172.21.15.37:0/1048590729 >> v2:172.21.15.37:3300/0 conn(0x7f4af40cdf20 0x7f4af40ce3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:21.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.260+0000 7f928effd700 1 --2- 172.21.15.37:0/3158605855 >> v2:172.21.15.37:3300/0 conn(0x7f929006c2e0 0x7f92900cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:21.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.261+0000 7f928effd700 1 -- 172.21.15.37:0/3158605855 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f92900cd930 msgr2=0x7f92900cdf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:21.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.261+0000 7f928effd700 1 --2- 172.21.15.37:0/3158605855 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f92900cd930 0x7f92900cdf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.261+0000 7f928effd700 1 -- 172.21.15.37:0/3158605855 >> v2:172.21.15.98:3300/0 conn(0x7f9290158720 msgr2=0x7f929006bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:21.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.261+0000 7f928effd700 1 --2- 172.21.15.37:0/3158605855 >> v2:172.21.15.98:3300/0 conn(0x7f9290158720 0x7f929006bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.261+0000 7f928effd700 1 -- 172.21.15.37:0/3158605855 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f929006c7a0 con 0x7f929006c2e0 2023-07-14T15:56:21.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.262+0000 7f928effd700 1 --2- 172.21.15.37:0/3158605855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f929006c2e0 0x7f92900cd3f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f92900b16b0 tx=0x7f9280009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=798eb970ac283299 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:21.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.262+0000 7f4af2ffd700 1 -- 172.21.15.37:0/1048590729 >> v2:172.21.15.37:3300/0 conn(0x7f4af40cdf20 msgr2=0x7f4af40ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:21.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.262+0000 7f4af2ffd700 1 --2- 172.21.15.37:0/1048590729 >> v2:172.21.15.37:3300/0 conn(0x7f4af40cdf20 0x7f4af40ce3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.262+0000 7f4af2ffd700 1 -- 172.21.15.37:0/1048590729 >> v1:172.21.15.37:6789/0 conn(0x7f4af40b0d30 legacy=0x7f4af406bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:21.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.262+0000 7f4af2ffd700 1 -- 172.21.15.37:0/1048590729 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af4158c60 con 0x7f4af406c2e0 2023-07-14T15:56:21.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.263+0000 7fe8543ff700 1 Processor -- start 2023-07-14T15:56:21.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.263+0000 7f4af2ffd700 1 --2- 172.21.15.37:0/1048590729 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4af406c2e0 0x7f4af4158720 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4aec00d150 tx=0x7f4aec00d460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=132180eb2ca7da34 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:21.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.263+0000 7f4af37fe700 1 --2- 172.21.15.37:0/1048590729 >> v2:172.21.15.37:3300/0 conn(0x7f4af40cdf20 0x7f4af40ce3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:56:21.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.263+0000 7fdcc65ff700 1 Processor -- start 2023-07-14T15:56:21.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.263+0000 7f928e7fc700 1 -- 172.21.15.37:0/3158605855 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9280011830 con 0x7f929006c2e0 2023-07-14T15:56:21.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.264+0000 7f928e7fc700 1 -- 172.21.15.37:0/3158605855 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9280011990 con 0x7f929006c2e0 2023-07-14T15:56:21.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.264+0000 7f928e7fc700 1 -- 172.21.15.37:0/3158605855 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9280011d00 con 0x7f929006c2e0 2023-07-14T15:56:21.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.263+0000 7fe8543ff700 1 -- start start 2023-07-14T15:56:21.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.263+0000 7fdcc65ff700 1 -- start start 2023-07-14T15:56:21.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.264+0000 7f4af1ffb700 1 -- 172.21.15.37:0/1048590729 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aec010070 con 0x7f4af406c2e0 2023-07-14T15:56:21.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.264+0000 7f4af1ffb700 1 -- 172.21.15.37:0/1048590729 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aec00db70 con 0x7f4af406c2e0 2023-07-14T15:56:21.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.264+0000 7f4af1ffb700 1 -- 172.21.15.37:0/1048590729 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aec003a20 con 0x7f4af406c2e0 2023-07-14T15:56:21.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.265+0000 7f9295dff700 1 -- 172.21.15.37:0/3158605855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f929006c2e0 msgr2=0x7f92900cd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:21.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.265+0000 7f9295dff700 1 --2- 172.21.15.37:0/3158605855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f929006c2e0 0x7f92900cd3f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f92900b16b0 tx=0x7f9280009b50 comp rx=0 tx=0).stop 2023-07-14T15:56:21.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.265+0000 7f4af99ff700 1 -- 172.21.15.37:0/1048590729 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4af406c2e0 msgr2=0x7f4af4158720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:21.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.265+0000 7f4af99ff700 1 --2- 172.21.15.37:0/1048590729 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4af406c2e0 0x7f4af4158720 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4aec00d150 tx=0x7f4aec00d460 comp rx=0 tx=0).stop 2023-07-14T15:56:21.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.265+0000 7f4af99ff700 1 -- 172.21.15.37:0/1048590729 shutdown_connections 2023-07-14T15:56:21.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.265+0000 7f4af99ff700 1 --2- 172.21.15.37:0/1048590729 >> v2:172.21.15.37:3300/0 conn(0x7f4af40cdf20 0x7f4af40ce3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.265+0000 7f4af99ff700 1 --2- 172.21.15.37:0/1048590729 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4af406c2e0 0x7f4af4158720 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.265+0000 7f4af99ff700 1 -- 172.21.15.37:0/1048590729 >> 172.21.15.37:0/1048590729 conn(0x7f4af406aaa0 msgr2=0x7f4af40b0620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:21.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.266+0000 7f4af99ff700 1 -- 172.21.15.37:0/1048590729 shutdown_connections 2023-07-14T15:56:21.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.266+0000 7f4af99ff700 1 -- 172.21.15.37:0/1048590729 wait complete. 2023-07-14T15:56:21.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.265+0000 7fdcc65ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdcc006c2e0 0x7fdcc0158720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.265+0000 7fdcc65ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fdcc00cd3f0 0x7fdcc00cdf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.265+0000 7fdcc65ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcc00cc6a0 con 0x7fdcc00b0d30 2023-07-14T15:56:21.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.265+0000 7fdcc65ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcc00ae0f0 con 0x7fdcc00cd3f0 2023-07-14T15:56:21.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.265+0000 7fdcc65ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc0158c60 con 0x7fdcc006c2e0 2023-07-14T15:56:21.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.266+0000 7fdcbf7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fdcc00b0d30 0x7fdcc006bb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37308/0 (socket says 172.21.15.37:37308) 2023-07-14T15:56:21.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.266+0000 7fdcbf7fe700 1 -- 172.21.15.37:0/4167191546 learned_addr learned my addr 172.21.15.37:0/4167191546 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:21.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.267+0000 7fdcbeffd700 1 -- 172.21.15.37:0/4167191546 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1194569795 0 0) 0x7fdcc00cc6a0 con 0x7fdcc00b0d30 2023-07-14T15:56:21.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.267+0000 7fdcbeffd700 1 -- 172.21.15.37:0/4167191546 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcac0035b0 con 0x7fdcc00b0d30 2023-07-14T15:56:21.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.267+0000 7fdcbeffd700 1 -- 172.21.15.37:0/4167191546 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2225645273 0 0) 0x7fdcac0035b0 con 0x7fdcc00b0d30 2023-07-14T15:56:21.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.267+0000 7fdcbeffd700 1 -- 172.21.15.37:0/4167191546 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdcc006c2e0 msgr2=0x7fdcc0158720 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T15:56:21.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.267+0000 7fdcbeffd700 1 --2- 172.21.15.37:0/4167191546 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdcc006c2e0 0x7fdcc0158720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.267+0000 7fdcbeffd700 1 -- 172.21.15.37:0/4167191546 >> v2:172.21.15.98:3300/0 conn(0x7fdcc00cd3f0 msgr2=0x7fdcc00cdf20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T15:56:21.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.267+0000 7fdcbeffd700 1 --2- 172.21.15.37:0/4167191546 >> v2:172.21.15.98:3300/0 conn(0x7fdcc00cd3f0 0x7fdcc00cdf20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.267+0000 7fdcbeffd700 1 -- 172.21.15.37:0/4167191546 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc00cc910 con 0x7fdcc00b0d30 2023-07-14T15:56:21.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.267+0000 7fdcbeffd700 1 -- 172.21.15.37:0/4167191546 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48633207 0 0) 0x7fdca8001670 con 0x7fdcc00b0d30 2023-07-14T15:56:21.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.267+0000 7fdcbeffd700 1 -- 172.21.15.37:0/4167191546 >> v1:172.21.15.37:6789/0 conn(0x7fdcc00b0d30 legacy=0x7fdcc006bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:21.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.267+0000 7fdcbeffd700 1 --2- 172.21.15.37:0/4167191546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcac003a00 0x7fdcac003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.268+0000 7fdcbeffd700 1 --2- 172.21.15.37:0/4167191546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcac004850 0x7fdcac004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.269+0000 7f4af99ff700 1 Processor -- start 2023-07-14T15:56:21.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.269+0000 7f4af99ff700 1 -- start start 2023-07-14T15:56:21.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.270+0000 7fe8543ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe84c06c2e0 0x7fe84c0c7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.270+0000 7fe8543ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe84c0b0d30 0x7fe84c0b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.270+0000 7fe8543ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe84c0cd3f0 0x7fe84c0b33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.270+0000 7fe8543ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84c0c5680 con 0x7fe84c0cd3f0 2023-07-14T15:56:21.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.270+0000 7fe8543ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84c0c2c70 con 0x7fe84c0b0d30 2023-07-14T15:56:21.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.270+0000 7fe8543ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe84c0c2f30 con 0x7fe84c06c2e0 2023-07-14T15:56:21.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.270+0000 7fe85219b700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe84c06c2e0 0x7fe84c0c7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:21.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.270+0000 7fe85219b700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe84c06c2e0 0x7fe84c0c7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3301/0 says I am v2:172.21.15.37:44572/0 (socket says 172.21.15.37:44572) 2023-07-14T15:56:21.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.270+0000 7fe85219b700 1 -- 172.21.15.37:0/3885585859 learned_addr learned my addr 172.21.15.37:0/3885585859 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:21.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.271+0000 7f4af99ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4af406c2e0 0x7f4af4157d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.271+0000 7f4af99ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4af40b0d30 0x7f4af40b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.271+0000 7fe85199a700 1 --2- 172.21.15.37:0/3885585859 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe84c0b0d30 0x7fe84c0b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:21.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.271+0000 7f4af99ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4af40cdf20 0x7f4af41e2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.271+0000 7f4af99ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af40b2ca0 con 0x7f4af40b0d30 2023-07-14T15:56:21.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.271+0000 7f4af99ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af415ba70 con 0x7f4af406c2e0 2023-07-14T15:56:21.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.271+0000 7f4af99ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af40b1920 con 0x7f4af40cdf20 2023-07-14T15:56:21.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.271+0000 7f9295dff700 1 -- 172.21.15.37:0/3158605855 shutdown_connections 2023-07-14T15:56:21.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.271+0000 7f9295dff700 1 --2- 172.21.15.37:0/3158605855 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f92900cd930 0x7f92900cdf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.271+0000 7f9295dff700 1 --2- 172.21.15.37:0/3158605855 >> v2:172.21.15.98:3300/0 conn(0x7f9290158720 0x7f929006bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.271+0000 7f9295dff700 1 --2- 172.21.15.37:0/3158605855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f929006c2e0 0x7f92900cd3f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.271+0000 7f9295dff700 1 -- 172.21.15.37:0/3158605855 >> 172.21.15.37:0/3158605855 conn(0x7f929006aaa0 msgr2=0x7f92900b0620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:21.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.272+0000 7fe85299c700 1 --2- 172.21.15.37:0/3885585859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe84c0cd3f0 0x7fe84c0b33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:21.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.272+0000 7fe85199a700 1 -- 172.21.15.37:0/3885585859 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe84c06c2e0 msgr2=0x7fe84c0c7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:21.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.272+0000 7fe85199a700 1 --2- 172.21.15.37:0/3885585859 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe84c06c2e0 0x7fe84c0c7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.272+0000 7fe85199a700 1 -- 172.21.15.37:0/3885585859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe84c0cd3f0 msgr2=0x7fe84c0b33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:21.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.272+0000 7fe85199a700 1 --2- 172.21.15.37:0/3885585859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe84c0cd3f0 0x7fe84c0b33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.272+0000 7fe85199a700 1 -- 172.21.15.37:0/3885585859 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe844009550 con 0x7fe84c0b0d30 2023-07-14T15:56:21.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.271+0000 7f4af2ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4af406c2e0 0x7f4af4157d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:21.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.271+0000 7f4af2ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4af406c2e0 0x7f4af4157d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.37:42976/0 (socket says 172.21.15.37:42976) 2023-07-14T15:56:21.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.271+0000 7f4af2ffd700 1 -- 172.21.15.37:0/2272671769 learned_addr learned my addr 172.21.15.37:0/2272671769 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:21.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.271+0000 7f4af37fe700 1 --2- 172.21.15.37:0/2272671769 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4af40cdf20 0x7f4af41e2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:21.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.272+0000 7f4af2ffd700 1 -- 172.21.15.37:0/2272671769 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4af40cdf20 msgr2=0x7f4af41e2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:21.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.272+0000 7f4af2ffd700 1 --2- 172.21.15.37:0/2272671769 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4af40cdf20 0x7f4af41e2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.272+0000 7f4af2ffd700 1 -- 172.21.15.37:0/2272671769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4af40b0d30 msgr2=0x7f4af40b3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:21.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.272+0000 7f4af2ffd700 1 --2- 172.21.15.37:0/2272671769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4af40b0d30 0x7f4af40b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.272+0000 7f4af2ffd700 1 -- 172.21.15.37:0/2272671769 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aec00bd40 con 0x7f4af406c2e0 2023-07-14T15:56:21.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.268+0000 7fdcbeffd700 1 --2- 172.21.15.37:0/4167191546 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdcac005320 0x7fdcac00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.268+0000 7fdcbeffd700 1 -- 172.21.15.37:0/4167191546 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc00ae0f0 con 0x7fdcac004850 2023-07-14T15:56:21.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.268+0000 7fdcbeffd700 1 -- 172.21.15.37:0/4167191546 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc0158c60 con 0x7fdcac003a00 2023-07-14T15:56:21.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.268+0000 7fdcbeffd700 1 -- 172.21.15.37:0/4167191546 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac00c1a0 con 0x7fdcac005320 2023-07-14T15:56:21.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.268+0000 7fdcbf7fe700 1 --2- 172.21.15.37:0/4167191546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcac004850 0x7fdcac004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:21.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.269+0000 7fdcbf7fe700 1 -- 172.21.15.37:0/4167191546 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdcac005320 msgr2=0x7fdcac00ba10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T15:56:21.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.269+0000 7fdcbf7fe700 1 --2- 172.21.15.37:0/4167191546 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdcac005320 0x7fdcac00ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.269+0000 7fdcbf7fe700 1 -- 172.21.15.37:0/4167191546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcac003a00 msgr2=0x7fdcac003e10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T15:56:21.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.269+0000 7fdcbf7fe700 1 --2- 172.21.15.37:0/4167191546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcac003a00 0x7fdcac003e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.269+0000 7fdcbf7fe700 1 -- 172.21.15.37:0/4167191546 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc00cc910 con 0x7fdcac004850 2023-07-14T15:56:21.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.269+0000 7fdcbf7fe700 1 --2- 172.21.15.37:0/4167191546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcac004850 0x7fdcac004cc0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdca800c3f0 tx=0x7fdcac005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea3b3e3f85fe3f41 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:21.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.270+0000 7fdcbeffd700 1 -- 172.21.15.37:0/4167191546 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca8005960 con 0x7fdcac004850 2023-07-14T15:56:21.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.270+0000 7fdcbeffd700 1 -- 172.21.15.37:0/4167191546 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca8005ac0 con 0x7fdcac004850 2023-07-14T15:56:21.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.270+0000 7fdcbeffd700 1 -- 172.21.15.37:0/4167191546 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca8005e50 con 0x7fdcac004850 2023-07-14T15:56:21.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.271+0000 7fdcc65ff700 1 -- 172.21.15.37:0/4167191546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcac004850 msgr2=0x7fdcac004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:21.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.271+0000 7fdcc65ff700 1 --2- 172.21.15.37:0/4167191546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcac004850 0x7fdcac004cc0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdca800c3f0 tx=0x7fdcac005880 comp rx=0 tx=0).stop 2023-07-14T15:56:21.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.271+0000 7fdcc4b9c700 1 -- 172.21.15.37:0/4167191546 reap_dead start 2023-07-14T15:56:21.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.272+0000 7fdcc65ff700 1 -- 172.21.15.37:0/4167191546 shutdown_connections 2023-07-14T15:56:21.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.272+0000 7fdcc65ff700 1 -- 172.21.15.37:0/4167191546 >> 172.21.15.37:0/4167191546 conn(0x7fdcc006aaa0 msgr2=0x7fdcc00b0620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:21.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.272+0000 7fdcc65ff700 1 -- 172.21.15.37:0/4167191546 shutdown_connections 2023-07-14T15:56:21.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.272+0000 7f4af2ffd700 1 --2- 172.21.15.37:0/2272671769 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4af406c2e0 0x7f4af4157d40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4aec00d860 tx=0x7f4aec004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:21.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.272+0000 7fe85199a700 1 --2- 172.21.15.37:0/3885585859 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe84c0b0d30 0x7fe84c0b2e80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe83c00b450 tx=0x7fe83c00b760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:21.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.272+0000 7f4adbfff700 1 -- 172.21.15.37:0/2272671769 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aec0041f0 con 0x7f4af406c2e0 2023-07-14T15:56:21.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.273+0000 7f4adbfff700 1 -- 172.21.15.37:0/2272671769 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aec004350 con 0x7f4af406c2e0 2023-07-14T15:56:21.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.273+0000 7f4adbfff700 1 -- 172.21.15.37:0/2272671769 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aec004700 con 0x7f4af406c2e0 2023-07-14T15:56:21.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.273+0000 7fe842ffd700 1 -- 172.21.15.37:0/3885585859 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83c011830 con 0x7fe84c0b0d30 2023-07-14T15:56:21.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.273+0000 7fe842ffd700 1 -- 172.21.15.37:0/3885585859 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe83c011990 con 0x7fe84c0b0d30 2023-07-14T15:56:21.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.273+0000 7fe842ffd700 1 -- 172.21.15.37:0/3885585859 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83c011d40 con 0x7fe84c0b0d30 2023-07-14T15:56:21.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.273+0000 7fe8543ff700 1 -- 172.21.15.37:0/3885585859 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe84c0ce330 con 0x7fe84c0b0d30 2023-07-14T15:56:21.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.273+0000 7fe8543ff700 1 -- 172.21.15.37:0/3885585859 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe84c0c7d00 con 0x7fe84c0b0d30 2023-07-14T15:56:21.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.272+0000 7fdcc65ff700 1 -- 172.21.15.37:0/4167191546 wait complete. 2023-07-14T15:56:21.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.273+0000 7f4af99ff700 1 -- 172.21.15.37:0/2272671769 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4af40b1c00 con 0x7f4af406c2e0 2023-07-14T15:56:21.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.273+0000 7f4af99ff700 1 -- 172.21.15.37:0/2272671769 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af40b21c0 con 0x7f4af406c2e0 2023-07-14T15:56:21.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.277+0000 7fe842ffd700 1 -- 172.21.15.37:0/3885585859 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe83c01a400 con 0x7fe84c0b0d30 2023-07-14T15:56:21.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.275+0000 7f4af99ff700 1 -- 172.21.15.37:0/2272671769 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4af404e210 con 0x7f4af406c2e0 2023-07-14T15:56:21.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.277+0000 7f4adbfff700 1 -- 172.21.15.37:0/2272671769 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4aec016440 con 0x7f4af406c2e0 2023-07-14T15:56:21.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.275+0000 7fdcc65ff700 1 Processor -- start 2023-07-14T15:56:21.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.276+0000 7fdcc65ff700 1 -- start start 2023-07-14T15:56:21.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.278+0000 7fdcc65ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcc0145d40 0x7fdcc01ee3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.278+0000 7fdcc65ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcc0146110 0x7fdcc00b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.278+0000 7fdcc65ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdcc0159e90 0x7fdcc01f1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.278+0000 7fdcc65ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc01f1ba0 con 0x7fdcc0145d40 2023-07-14T15:56:21.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.278+0000 7fdcc65ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc01ee8e0 con 0x7fdcc0146110 2023-07-14T15:56:21.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.278+0000 7fdcc65ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc00b2080 con 0x7fdcc0159e90 2023-07-14T15:56:21.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.274+0000 7f9295dff700 1 -- 172.21.15.37:0/3158605855 shutdown_connections 2023-07-14T15:56:21.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.275+0000 7f9295dff700 1 -- 172.21.15.37:0/3158605855 wait complete. 2023-07-14T15:56:21.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.277+0000 7fdda7dff700 1 Processor -- start 2023-07-14T15:56:21.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.279+0000 7fe842ffd700 1 --2- 172.21.15.37:0/3885585859 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe83006adb0 0x7fe83006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.279+0000 7fe842ffd700 1 -- 172.21.15.37:0/3885585859 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe83c0893f0 con 0x7fe84c0b0d30 2023-07-14T15:56:21.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.279+0000 7fdcbffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcc0145d40 0x7fdcc01ee3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:21.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.279+0000 7fdcbffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcc0145d40 0x7fdcc01ee3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33688/0 (socket says 172.21.15.37:33688) 2023-07-14T15:56:21.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.279+0000 7fdcbffff700 1 -- 172.21.15.37:0/1495689649 learned_addr learned my addr 172.21.15.37:0/1495689649 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:21.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.280+0000 7f9295dff700 1 Processor -- start 2023-07-14T15:56:21.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.277+0000 7fdda7dff700 1 -- start start 2023-07-14T15:56:21.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.279+0000 7f4adbfff700 1 --2- 172.21.15.37:0/2272671769 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4ae006adb0 0x7f4ae006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.279+0000 7f4adbfff700 1 -- 172.21.15.37:0/2272671769 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4aec08a4e0 con 0x7f4af406c2e0 2023-07-14T15:56:21.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.280+0000 7fdcc4b9c700 1 --2- 172.21.15.37:0/1495689649 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdcc0159e90 0x7fdcc01f1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:21.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.280+0000 7fdcbffff700 1 -- 172.21.15.37:0/1495689649 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdcc0159e90 msgr2=0x7fdcc01f1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:21.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.280+0000 7fdcbffff700 1 --2- 172.21.15.37:0/1495689649 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdcc0159e90 0x7fdcc01f1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.280+0000 7fdcbffff700 1 -- 172.21.15.37:0/1495689649 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcc0146110 msgr2=0x7fdcc00b1b40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T15:56:21.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.280+0000 7fdcbffff700 1 --2- 172.21.15.37:0/1495689649 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcc0146110 0x7fdcc00b1b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.280+0000 7fdcbffff700 1 -- 172.21.15.37:0/1495689649 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc01ef370 con 0x7fdcc0145d40 2023-07-14T15:56:21.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.280+0000 7fdda7dff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdda00b0ae0 0x7fdda00cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.280+0000 7fdda7dff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdda00cdb50 con 0x7fdda00b8900 2023-07-14T15:56:21.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.280+0000 7fdda7dff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdda00cde30 con 0x7fdda00d15c0 2023-07-14T15:56:21.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.280+0000 7fdda7dff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdda015d030 con 0x7fdda00b0ae0 2023-07-14T15:56:21.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.280+0000 7fe85219b700 1 --2- 172.21.15.37:0/3885585859 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe83006adb0 0x7fe83006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:21.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.280+0000 7fe8543ff700 1 -- 172.21.15.37:0/3885585859 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8340052f0 con 0x7fe84c0b0d30 2023-07-14T15:56:21.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.282+0000 7fe85219b700 1 --2- 172.21.15.37:0/3885585859 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe83006adb0 0x7fe83006d260 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe848002040 tx=0x7fe848009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:21.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.281+0000 7f4af27fc700 1 --2- 172.21.15.37:0/2272671769 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4ae006adb0 0x7f4ae006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:21.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.282+0000 7f4af27fc700 1 --2- 172.21.15.37:0/2272671769 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4ae006adb0 0x7f4ae006d260 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4af415b760 tx=0x7f4ae8007a20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:21.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.281+0000 7fdcbffff700 1 --2- 172.21.15.37:0/1495689649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcc0145d40 0x7fdcc01ee3a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdcb000b460 tx=0x7fdcb000b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:21.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.280+0000 7f9295dff700 1 -- start start 2023-07-14T15:56:21.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.282+0000 7f9295dff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f929006c2e0 0x7f9290153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.282+0000 7f9295dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f92900cd930 0x7f92900afa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.282+0000 7f9295dff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9290158720 0x7f9290157a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.282+0000 7f9295dff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92901543d0 con 0x7f929006c2e0 2023-07-14T15:56:21.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.282+0000 7f9295dff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92900c7ca0 con 0x7f9290158720 2023-07-14T15:56:21.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.282+0000 7f9295dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92900c7f40 con 0x7f92900cd930 2023-07-14T15:56:21.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.280+0000 7fdda539a700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fdda00d15c0 0x7fdda00cebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.37:51818/0 (socket says 172.21.15.37:51818) 2023-07-14T15:56:21.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.280+0000 7fdda539a700 1 -- 172.21.15.37:0/2760674704 learned_addr learned my addr 172.21.15.37:0/2760674704 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:21.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.281+0000 7fdda639c700 1 --2- 172.21.15.37:0/2760674704 >> v2:172.21.15.37:3300/0 conn(0x7fdda00b0ae0 0x7fdda00cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:21.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.282+0000 7fdda639c700 1 -- 172.21.15.37:0/2760674704 >> v1:172.21.15.98:6789/0 conn(0x7fdda00d15c0 legacy=0x7fdda00cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:21.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.282+0000 7fdda639c700 1 -- 172.21.15.37:0/2760674704 >> v1:172.21.15.37:6789/0 conn(0x7fdda00b8900 legacy=0x7fdda00d0eb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T15:56:21.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.282+0000 7fdda639c700 1 -- 172.21.15.37:0/2760674704 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda00ce110 con 0x7fdda00b0ae0 2023-07-14T15:56:21.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.282+0000 7fdda639c700 1 --2- 172.21.15.37:0/2760674704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdda00b0ae0 0x7fdda00cd570 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdd98009d90 tx=0x7fdd9800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f48a430b705f180 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:21.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.279+0000 7fdfc67ff700 1 Processor -- start 2023-07-14T15:56:21.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.280+0000 7fdfc67ff700 1 -- start start 2023-07-14T15:56:21.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.282+0000 7fdfc67ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdfc01607a0 0x7fdfc006b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.282+0000 7fdfc67ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fdfc006c7a0 0x7fdfc0160b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.282+0000 7fdfc67ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc006cbf0 con 0x7fdfc0165130 2023-07-14T15:56:21.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.282+0000 7fdfc67ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfc01610b0 con 0x7fdfc006c7a0 2023-07-14T15:56:21.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.282+0000 7fdfc67ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc006b700 con 0x7fdfc01607a0 2023-07-14T15:56:21.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.283+0000 7f4adbfff700 1 -- 172.21.15.37:0/2272671769 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4aec055600 con 0x7f4af406c2e0 2023-07-14T15:56:21.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.283+0000 7fdfbf7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fdfc006c7a0 0x7fdfc0160b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:21.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.283+0000 7fdfbffff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdfc01607a0 0x7fdfc006b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:21.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.283+0000 7fdfbf7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fdfc006c7a0 0x7fdfc0160b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.37:42978/0 (socket says 172.21.15.37:42978) 2023-07-14T15:56:21.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.283+0000 7fdfbf7fe700 1 -- 172.21.15.37:0/3188756583 learned_addr learned my addr 172.21.15.37:0/3188756583 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:21.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.283+0000 7f928effd700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f92900cd930 0x7f92900afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:21.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.283+0000 7f928effd700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f92900cd930 0x7f92900afa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3301/0 says I am v2:172.21.15.37:44596/0 (socket says 172.21.15.37:44596) 2023-07-14T15:56:21.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.283+0000 7f928effd700 1 -- 172.21.15.37:0/1571898161 learned_addr learned my addr 172.21.15.37:0/1571898161 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:21.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.283+0000 7f928ffff700 1 --2- 172.21.15.37:0/1571898161 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9290158720 0x7f9290157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:21.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.283+0000 7fdda4b99700 1 -- 172.21.15.37:0/2760674704 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9800e070 con 0x7fdda00b0ae0 2023-07-14T15:56:21.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.283+0000 7fdda4b99700 1 -- 172.21.15.37:0/2760674704 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd9800bb90 con 0x7fdda00b0ae0 2023-07-14T15:56:21.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.283+0000 7fdda4b99700 1 -- 172.21.15.37:0/2760674704 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd98003a20 con 0x7fdda00b0ae0 2023-07-14T15:56:21.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.283+0000 7fdfbffff700 1 -- 172.21.15.37:0/3188756583 >> v2:172.21.15.98:3300/0 conn(0x7fdfc006c7a0 msgr2=0x7fdfc0160b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:21.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.283+0000 7fdfbffff700 1 --2- 172.21.15.37:0/3188756583 >> v2:172.21.15.98:3300/0 conn(0x7fdfc006c7a0 0x7fdfc0160b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.283+0000 7fdfbffff700 1 -- 172.21.15.37:0/3188756583 >> v1:172.21.15.37:6789/0 conn(0x7fdfc0165130 legacy=0x7fdfc00cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:21.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.283+0000 7fdfbffff700 1 -- 172.21.15.37:0/3188756583 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc006b9e0 con 0x7fdfc01607a0 2023-07-14T15:56:21.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.283+0000 7f928f7fe700 1 --2- 172.21.15.37:0/1571898161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f929006c2e0 0x7f9290153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:21.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.283+0000 7f928effd700 1 -- 172.21.15.37:0/1571898161 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9290158720 msgr2=0x7f9290157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:21.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.283+0000 7f928effd700 1 --2- 172.21.15.37:0/1571898161 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9290158720 0x7f9290157a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.283+0000 7f928effd700 1 -- 172.21.15.37:0/1571898161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f929006c2e0 msgr2=0x7f9290153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:21.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.283+0000 7f928effd700 1 --2- 172.21.15.37:0/1571898161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f929006c2e0 0x7f9290153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.283+0000 7f928effd700 1 -- 172.21.15.37:0/1571898161 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92800094a0 con 0x7f92900cd930 2023-07-14T15:56:21.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.284+0000 7fdfbffff700 1 --2- 172.21.15.37:0/3188756583 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdfc01607a0 0x7fdfc006b120 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdfb4009840 tx=0x7fdfb4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6926abfeaf32a72b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:21.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.284+0000 7f928effd700 1 --2- 172.21.15.37:0/1571898161 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f92900cd930 0x7f92900afa80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9280012000 tx=0x7f9280004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:21.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.284+0000 7fdda7dff700 1 -- 172.21.15.37:0/2760674704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdda00b0ae0 msgr2=0x7fdda00cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:21.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.284+0000 7fdda7dff700 1 --2- 172.21.15.37:0/2760674704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdda00b0ae0 0x7fdda00cd570 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdd98009d90 tx=0x7fdd9800b330 comp rx=0 tx=0).stop 2023-07-14T15:56:21.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.284+0000 7fdfbeffd700 1 -- 172.21.15.37:0/3188756583 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb4004230 con 0x7fdfc01607a0 2023-07-14T15:56:21.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.284+0000 7fdfbeffd700 1 -- 172.21.15.37:0/3188756583 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb4004390 con 0x7fdfc01607a0 2023-07-14T15:56:21.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.284+0000 7fdcbcff9700 1 -- 172.21.15.37:0/1495689649 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb0011830 con 0x7fdcc0145d40 2023-07-14T15:56:21.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.284+0000 7fdfbeffd700 1 -- 172.21.15.37:0/3188756583 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb40036a0 con 0x7fdfc01607a0 2023-07-14T15:56:21.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.284+0000 7fdcbcff9700 1 -- 172.21.15.37:0/1495689649 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb00119b0 con 0x7fdcc0145d40 2023-07-14T15:56:21.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.284+0000 7fdcbcff9700 1 -- 172.21.15.37:0/1495689649 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb0011d60 con 0x7fdcc0145d40 2023-07-14T15:56:21.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.284+0000 7fdcc65ff700 1 -- 172.21.15.37:0/1495689649 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcc01eead0 con 0x7fdcc0145d40 2023-07-14T15:56:21.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.284+0000 7fdcc65ff700 1 -- 172.21.15.37:0/1495689649 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcc01ef090 con 0x7fdcc0145d40 2023-07-14T15:56:21.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.284+0000 7fdda7dff700 1 -- 172.21.15.37:0/2760674704 shutdown_connections 2023-07-14T15:56:21.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.284+0000 7fdda7dff700 1 --2- 172.21.15.37:0/2760674704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdda00b0ae0 0x7fdda00cd570 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.285+0000 7fdda7dff700 1 -- 172.21.15.37:0/2760674704 >> 172.21.15.37:0/2760674704 conn(0x7fdda009c1e0 msgr2=0x7fdda00d2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:21.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.285+0000 7fdda7dff700 1 -- 172.21.15.37:0/2760674704 shutdown_connections 2023-07-14T15:56:21.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.284+0000 7f9277fff700 1 -- 172.21.15.37:0/1571898161 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9280004230 con 0x7f92900cd930 2023-07-14T15:56:21.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.285+0000 7f9277fff700 1 -- 172.21.15.37:0/1571898161 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9280004390 con 0x7f92900cd930 2023-07-14T15:56:21.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.285+0000 7f9277fff700 1 -- 172.21.15.37:0/1571898161 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92800036a0 con 0x7f92900cd930 2023-07-14T15:56:21.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.285+0000 7f9295dff700 1 -- 172.21.15.37:0/1571898161 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92900c8220 con 0x7f92900cd930 2023-07-14T15:56:21.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.285+0000 7f9295dff700 1 -- 172.21.15.37:0/1571898161 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92900c87e0 con 0x7f92900cd930 2023-07-14T15:56:21.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.285+0000 7fdda7dff700 1 -- 172.21.15.37:0/2760674704 wait complete. 2023-07-14T15:56:21.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.285+0000 7fdfc67ff700 1 -- 172.21.15.37:0/3188756583 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdfc01607a0 msgr2=0x7fdfc006b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:21.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.285+0000 7fdfc67ff700 1 --2- 172.21.15.37:0/3188756583 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdfc01607a0 0x7fdfc006b120 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdfb4009840 tx=0x7fdfb4009b50 comp rx=0 tx=0).stop 2023-07-14T15:56:21.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.286+0000 7fdfc67ff700 1 -- 172.21.15.37:0/3188756583 shutdown_connections 2023-07-14T15:56:21.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.286+0000 7fdfc67ff700 1 --2- 172.21.15.37:0/3188756583 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdfc01607a0 0x7fdfc006b120 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.286+0000 7fdfc67ff700 1 --2- 172.21.15.37:0/3188756583 >> v2:172.21.15.98:3300/0 conn(0x7fdfc006c7a0 0x7fdfc0160b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.286+0000 7fdfc67ff700 1 -- 172.21.15.37:0/3188756583 >> 172.21.15.37:0/3188756583 conn(0x7fdfc006aaa0 msgr2=0x7fdfc00b0620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:21.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.286+0000 7fdfc67ff700 1 -- 172.21.15.37:0/3188756583 shutdown_connections 2023-07-14T15:56:21.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.286+0000 7fdfc67ff700 1 -- 172.21.15.37:0/3188756583 wait complete. 2023-07-14T15:56:21.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.286+0000 7fdcc65ff700 1 -- 172.21.15.37:0/1495689649 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcc004e210 con 0x7fdcc0145d40 2023-07-14T15:56:21.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.287+0000 7f9275ffb700 1 -- 172.21.15.37:0/1571898161 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92900c89d0 con 0x7f92900cd930 2023-07-14T15:56:21.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.288+0000 7fdda7dff700 1 Processor -- start 2023-07-14T15:56:21.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.289+0000 7fe842ffd700 1 -- 172.21.15.37:0/3885585859 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe83c054480 con 0x7fe84c0b0d30 2023-07-14T15:56:21.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.288+0000 7fdda7dff700 1 -- start start 2023-07-14T15:56:21.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.290+0000 7fdda7dff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdda00b0ae0 0x7fdda01f98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.290+0000 7fdda7dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdda00b8900 0x7fdda015ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.290+0000 7fdda7dff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdda00d15c0 0x7fdda006af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.290+0000 7fdda7dff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda00c77c0 con 0x7fdda00d15c0 2023-07-14T15:56:21.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.290+0000 7fdda7dff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda00c9ff0 con 0x7fdda00b0ae0 2023-07-14T15:56:21.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.290+0000 7fdda7dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdda01f9e20 con 0x7fdda00b8900 2023-07-14T15:56:21.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.290+0000 7f9277fff700 1 -- 172.21.15.37:0/1571898161 <== mon.2 v2:172.21.15.98:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9280022070 con 0x7f92900cd930 2023-07-14T15:56:21.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.291+0000 7f9277fff700 1 --2- 172.21.15.37:0/1571898161 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f927c06ace0 0x7f927c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.291+0000 7f9277fff700 1 -- 172.21.15.37:0/1571898161 <== mon.2 v2:172.21.15.98:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f928008a860 con 0x7f92900cd930 2023-07-14T15:56:21.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.289+0000 7fdfc67ff700 1 Processor -- start 2023-07-14T15:56:21.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.290+0000 7fdfc67ff700 1 -- start start 2023-07-14T15:56:21.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.291+0000 7fdfc67ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdfc01607a0 0x7fdfc00c6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.291+0000 7fdfc67ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdfc0165130 0x7fdfc00c75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.291+0000 7fdfc67ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfc00b4460 0x7fdfc0158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.291+0000 7fdfc67ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc00c7b30 con 0x7fdfc00b4460 2023-07-14T15:56:21.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.291+0000 7fdfc67ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc015e180 con 0x7fdfc01607a0 2023-07-14T15:56:21.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.291+0000 7fdfc67ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc00c7d60 con 0x7fdfc0165130 2023-07-14T15:56:21.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.292+0000 7fdfbffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdfc01607a0 0x7fdfc00c6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:21.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.292+0000 7f928f7fe700 1 --2- 172.21.15.37:0/1571898161 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f927c06ace0 0x7f927c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:21.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.292+0000 7fdfbffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdfc01607a0 0x7fdfc00c6a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.37:43002/0 (socket says 172.21.15.37:43002) 2023-07-14T15:56:21.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.292+0000 7fdfbffff700 1 -- 172.21.15.37:0/3695333389 learned_addr learned my addr 172.21.15.37:0/3695333389 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:21.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.292+0000 7fdfbf7fe700 1 --2- 172.21.15.37:0/3695333389 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdfc0165130 0x7fdfc00c75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:21.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.293+0000 7fdfbffff700 1 -- 172.21.15.37:0/3695333389 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdfc0165130 msgr2=0x7fdfc00c75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:21.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.293+0000 7fdfbffff700 1 --2- 172.21.15.37:0/3695333389 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdfc0165130 0x7fdfc00c75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.293+0000 7fdfbffff700 1 -- 172.21.15.37:0/3695333389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfc00b4460 msgr2=0x7fdfc0158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:21.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.293+0000 7fdfbffff700 1 --2- 172.21.15.37:0/3695333389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfc00b4460 0x7fdfc0158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.293+0000 7fdfbffff700 1 -- 172.21.15.37:0/3695333389 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb40094a0 con 0x7fdfc01607a0 2023-07-14T15:56:21.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.293+0000 7f928f7fe700 1 --2- 172.21.15.37:0/1571898161 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f927c06ace0 0x7f927c06d190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f928800d5a0 tx=0x7f928800f040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:21.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.294+0000 7fdfbffff700 1 --2- 172.21.15.37:0/3695333389 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdfc01607a0 0x7fdfc00c6a90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdfb4000c00 tx=0x7fdfb4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:21.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.294+0000 7f9277fff700 1 -- 172.21.15.37:0/1571898161 <== mon.2 v2:172.21.15.98:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f92800594a0 con 0x7f92900cd930 2023-07-14T15:56:21.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.294+0000 7fdfbcff9700 1 -- 172.21.15.37:0/3695333389 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb4003e60 con 0x7fdfc01607a0 2023-07-14T15:56:21.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.294+0000 7fdfbcff9700 1 -- 172.21.15.37:0/3695333389 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb401e070 con 0x7fdfc01607a0 2023-07-14T15:56:21.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.294+0000 7fdfbcff9700 1 -- 172.21.15.37:0/3695333389 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb4011850 con 0x7fdfc01607a0 2023-07-14T15:56:21.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.295+0000 7fdfc67ff700 1 -- 172.21.15.37:0/3695333389 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc00c5cd0 con 0x7fdfc01607a0 2023-07-14T15:56:21.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.295+0000 7fdfc67ff700 1 -- 172.21.15.37:0/3695333389 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc00c6290 con 0x7fdfc01607a0 2023-07-14T15:56:21.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.296+0000 7fa16a9ff700 1 Processor -- start 2023-07-14T15:56:21.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.296+0000 7fdfc67ff700 1 -- 172.21.15.37:0/3695333389 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfc004e210 con 0x7fdfc01607a0 2023-07-14T15:56:21.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.297+0000 7fa16a9ff700 1 -- start start 2023-07-14T15:56:21.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.292+0000 7fdcbcff9700 1 -- 172.21.15.37:0/1495689649 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdcb001a400 con 0x7fdcc0145d40 2023-07-14T15:56:21.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.294+0000 7fdcbcff9700 1 --2- 172.21.15.37:0/1495689649 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fdca006adb0 0x7fdca006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.294+0000 7fdcbcff9700 1 -- 172.21.15.37:0/1495689649 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdcb0089a30 con 0x7fdcc0145d40 2023-07-14T15:56:21.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.295+0000 7fdcbf7fe700 1 --2- 172.21.15.37:0/1495689649 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fdca006adb0 0x7fdca006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:21.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.297+0000 7fdcbf7fe700 1 --2- 172.21.15.37:0/1495689649 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fdca006adb0 0x7fdca006d260 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0063c00 tx=0x7fdca800a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:21.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.299+0000 7fdfbcff9700 1 -- 172.21.15.37:0/3695333389 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdfb40119b0 con 0x7fdfc01607a0 2023-07-14T15:56:21.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.299+0000 7fa16a9ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa1640d15c0 0x7fa1640cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.299+0000 7fa16a9ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1640cdb50 con 0x7fa1640b0ae0 2023-07-14T15:56:21.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.299+0000 7fa16a9ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1640cde30 con 0x7fa1640b8900 2023-07-14T15:56:21.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.299+0000 7fa16a9ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa16415d030 con 0x7fa1640d15c0 2023-07-14T15:56:21.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.300+0000 7fa163fff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fa1640b8900 0x7fa1640d0eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.37:51826/0 (socket says 172.21.15.37:51826) 2023-07-14T15:56:21.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.300+0000 7fa163fff700 1 -- 172.21.15.37:0/3308991748 learned_addr learned my addr 172.21.15.37:0/3308991748 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:21.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.300+0000 7fdcbcff9700 1 -- 172.21.15.37:0/1495689649 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fdcb0054ac0 con 0x7fdcc0145d40 2023-07-14T15:56:21.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.300+0000 7fa15bfff700 1 --2- 172.21.15.37:0/3308991748 >> v2:172.21.15.37:3300/0 conn(0x7fa1640d15c0 0x7fa1640cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:21.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.300+0000 7fdfbcff9700 1 --2- 172.21.15.37:0/3695333389 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fdfac06ad00 0x7fdfac06d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.301+0000 7fdfbcff9700 1 -- 172.21.15.37:0/3695333389 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdfb408a6a0 con 0x7fdfc01607a0 2023-07-14T15:56:21.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.291+0000 7fdda539a700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdda00b8900 0x7fdda015ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:21.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.291+0000 7fdda539a700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdda00b8900 0x7fdda015ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3301/0 says I am v2:172.21.15.37:44612/0 (socket says 172.21.15.37:44612) 2023-07-14T15:56:21.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.291+0000 7fdda539a700 1 -- 172.21.15.37:0/3608604349 learned_addr learned my addr 172.21.15.37:0/3608604349 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:21.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.292+0000 7fdda539a700 1 -- 172.21.15.37:0/3608604349 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdda00b0ae0 msgr2=0x7fdda01f98e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T15:56:21.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.292+0000 7fdda539a700 1 --2- 172.21.15.37:0/3608604349 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdda00b0ae0 0x7fdda01f98e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.292+0000 7fdda539a700 1 -- 172.21.15.37:0/3608604349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdda00d15c0 msgr2=0x7fdda006af80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T15:56:21.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.292+0000 7fdda539a700 1 --2- 172.21.15.37:0/3608604349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdda00d15c0 0x7fdda006af80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.292+0000 7fdda539a700 1 -- 172.21.15.37:0/3608604349 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd98009a70 con 0x7fdda00b8900 2023-07-14T15:56:21.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.292+0000 7fdda539a700 1 --2- 172.21.15.37:0/3608604349 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdda00b8900 0x7fdda015ebe0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c00c500 tx=0x7fdd9c00c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:21.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.293+0000 7fdd967fc700 1 -- 172.21.15.37:0/3608604349 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c005d70 con 0x7fdda00b8900 2023-07-14T15:56:21.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.293+0000 7fdd967fc700 1 -- 172.21.15.37:0/3608604349 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd9c0070d0 con 0x7fdda00b8900 2023-07-14T15:56:21.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.293+0000 7fdd967fc700 1 -- 172.21.15.37:0/3608604349 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c007440 con 0x7fdda00b8900 2023-07-14T15:56:21.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.301+0000 7fdfbf7fe700 1 --2- 172.21.15.37:0/3695333389 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fdfac06ad00 0x7fdfac06d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:21.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.301+0000 7fa15bfff700 1 -- 172.21.15.37:0/3308991748 >> v1:172.21.15.98:6789/0 conn(0x7fa1640b8900 legacy=0x7fa1640d0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:21.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.301+0000 7fa15bfff700 1 -- 172.21.15.37:0/3308991748 >> v1:172.21.15.37:6789/0 conn(0x7fa1640b0ae0 legacy=0x7fa1640cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:21.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.302+0000 7fa15bfff700 1 -- 172.21.15.37:0/3308991748 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1640ce110 con 0x7fa1640d15c0 2023-07-14T15:56:21.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.302+0000 7fdda7dff700 1 -- 172.21.15.37:0/3608604349 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdda00c6b80 con 0x7fdda00b8900 2023-07-14T15:56:21.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.302+0000 7fdda7dff700 1 -- 172.21.15.37:0/3608604349 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdda00c7100 con 0x7fdda00b8900 2023-07-14T15:56:21.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.302+0000 7fa15bfff700 1 --2- 172.21.15.37:0/3308991748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1640d15c0 0x7fa1640cd570 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa14c009840 tx=0x7fa14c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f24318f85d36539 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:21.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.303+0000 7fa1637fe700 1 -- 172.21.15.37:0/3308991748 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14c004230 con 0x7fa1640d15c0 2023-07-14T15:56:21.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.303+0000 7fa1637fe700 1 -- 172.21.15.37:0/3308991748 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14c004390 con 0x7fa1640d15c0 2023-07-14T15:56:21.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.303+0000 7fa1637fe700 1 -- 172.21.15.37:0/3308991748 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14c0036a0 con 0x7fa1640d15c0 2023-07-14T15:56:21.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.303+0000 7fbc231ff700 1 Processor -- start 2023-07-14T15:56:21.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.303+0000 7fdda7dff700 1 -- 172.21.15.37:0/3608604349 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdda00b58f0 con 0x7fdda00b8900 2023-07-14T15:56:21.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.303+0000 7fbc231ff700 1 -- start start 2023-07-14T15:56:21.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.304+0000 7fa16a9ff700 1 -- 172.21.15.37:0/3308991748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1640d15c0 msgr2=0x7fa1640cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:21.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.304+0000 7fa16a9ff700 1 --2- 172.21.15.37:0/3308991748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1640d15c0 0x7fa1640cd570 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa14c009840 tx=0x7fa14c009b50 comp rx=0 tx=0).stop 2023-07-14T15:56:21.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.305+0000 7fa16a9ff700 1 -- 172.21.15.37:0/3308991748 shutdown_connections 2023-07-14T15:56:21.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.305+0000 7fa16a9ff700 1 --2- 172.21.15.37:0/3308991748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1640d15c0 0x7fa1640cd570 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.305+0000 7fa16a9ff700 1 -- 172.21.15.37:0/3308991748 >> 172.21.15.37:0/3308991748 conn(0x7fa16409c1e0 msgr2=0x7fa1640d2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:21.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.305+0000 7fdfbf7fe700 1 --2- 172.21.15.37:0/3695333389 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fdfac06ad00 0x7fdfac06d1b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdfc00b4a20 tx=0x7fdfb8009130 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:21.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.305+0000 7fbc231ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbc1c06c2e0 0x7fbc1c158720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.305+0000 7fbc231ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbc1c0cd3f0 0x7fbc1c0cdf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.306+0000 7fbc231ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc1c0cc6a0 con 0x7fbc1c0b0d30 2023-07-14T15:56:21.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.306+0000 7fbc231ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc1c0ae0f0 con 0x7fbc1c06c2e0 2023-07-14T15:56:21.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.306+0000 7fbc231ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc1c158c60 con 0x7fbc1c0cd3f0 2023-07-14T15:56:21.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.306+0000 7fdd967fc700 1 -- 172.21.15.37:0/3608604349 <== mon.2 v2:172.21.15.98:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdd9c0075a0 con 0x7fdda00b8900 2023-07-14T15:56:21.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.306+0000 7fbc2179c700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbc1c0cd3f0 0x7fbc1c0cdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:21.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.306+0000 7fbc20f9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbc1c06c2e0 0x7fbc1c158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:21.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.306+0000 7fbc2179c700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbc1c0cd3f0 0x7fbc1c0cdf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3301/0 says I am v2:172.21.15.37:44636/0 (socket says 172.21.15.37:44636) 2023-07-14T15:56:21.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.306+0000 7fbc2179c700 1 -- 172.21.15.37:0/164000946 learned_addr learned my addr 172.21.15.37:0/164000946 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:21.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.307+0000 7fbc20f9b700 1 -- 172.21.15.37:0/164000946 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbc1c0cd3f0 msgr2=0x7fbc1c0cdf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:21.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.307+0000 7fbc20f9b700 1 --2- 172.21.15.37:0/164000946 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbc1c0cd3f0 0x7fbc1c0cdf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.307+0000 7fbc20f9b700 1 -- 172.21.15.37:0/164000946 >> v1:172.21.15.98:6789/0 conn(0x7fbc1c0b0d30 legacy=0x7fbc1c06bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:21.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.307+0000 7fbc20f9b700 1 -- 172.21.15.37:0/164000946 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc1c06c7a0 con 0x7fbc1c06c2e0 2023-07-14T15:56:21.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.307+0000 7fdfbcff9700 1 -- 172.21.15.37:0/3695333389 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fdfb40557c0 con 0x7fdfc01607a0 2023-07-14T15:56:21.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.308+0000 7fbc20f9b700 1 --2- 172.21.15.37:0/164000946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc1c06c2e0 0x7fbc1c158720 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbc10009d90 tx=0x7fbc1000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce973a7e9aa90877 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:21.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.308+0000 7fdd967fc700 1 --2- 172.21.15.37:0/3608604349 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fdd8406ade0 0x7fdd8406d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.308+0000 7fdd967fc700 1 -- 172.21.15.37:0/3608604349 <== mon.2 v2:172.21.15.98:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdd9c088aa0 con 0x7fdda00b8900 2023-07-14T15:56:21.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.308+0000 7fbc1b7fe700 1 -- 172.21.15.37:0/164000946 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1000e070 con 0x7fbc1c06c2e0 2023-07-14T15:56:21.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.308+0000 7fbc1b7fe700 1 -- 172.21.15.37:0/164000946 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc1000bb20 con 0x7fbc1c06c2e0 2023-07-14T15:56:21.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.308+0000 7fbc1b7fe700 1 -- 172.21.15.37:0/164000946 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc10012430 con 0x7fbc1c06c2e0 2023-07-14T15:56:21.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.309+0000 7fdda5b9b700 1 --2- 172.21.15.37:0/3608604349 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fdd8406ade0 0x7fdd8406d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:21.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.309+0000 7fa16a9ff700 1 -- 172.21.15.37:0/3308991748 shutdown_connections 2023-07-14T15:56:21.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.309+0000 7fa16a9ff700 1 -- 172.21.15.37:0/3308991748 wait complete. 2023-07-14T15:56:21.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.310+0000 7fdd967fc700 1 -- 172.21.15.37:0/3608604349 <== mon.2 v2:172.21.15.98:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fdd9c053be0 con 0x7fdda00b8900 2023-07-14T15:56:21.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.312+0000 7fdda5b9b700 1 --2- 172.21.15.37:0/3608604349 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fdd8406ade0 0x7fdd8406d290 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdd900096f0 tx=0x7fdd90006c50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:21.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.309+0000 7fbc231ff700 1 -- 172.21.15.37:0/164000946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc1c06c2e0 msgr2=0x7fbc1c158720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:21.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.309+0000 7fbc231ff700 1 --2- 172.21.15.37:0/164000946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc1c06c2e0 0x7fbc1c158720 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbc10009d90 tx=0x7fbc1000b330 comp rx=0 tx=0).stop 2023-07-14T15:56:21.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.310+0000 7fbc231ff700 1 -- 172.21.15.37:0/164000946 shutdown_connections 2023-07-14T15:56:21.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.310+0000 7fbc231ff700 1 --2- 172.21.15.37:0/164000946 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbc1c0cd3f0 0x7fbc1c0cdf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.310+0000 7fbc231ff700 1 --2- 172.21.15.37:0/164000946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc1c06c2e0 0x7fbc1c158720 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.310+0000 7fbc231ff700 1 -- 172.21.15.37:0/164000946 >> 172.21.15.37:0/164000946 conn(0x7fbc1c06aaa0 msgr2=0x7fbc1c0b0620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:21.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.310+0000 7fbc231ff700 1 -- 172.21.15.37:0/164000946 shutdown_connections 2023-07-14T15:56:21.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.310+0000 7fbc231ff700 1 -- 172.21.15.37:0/164000946 wait complete. 2023-07-14T15:56:21.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.313+0000 7fa16a9ff700 1 Processor -- start 2023-07-14T15:56:21.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.313+0000 7fbc231ff700 1 Processor -- start 2023-07-14T15:56:21.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.313+0000 7fa16a9ff700 1 -- start start 2023-07-14T15:56:21.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.315+0000 7fa16a9ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1640b0ae0 0x7fa16415fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.315+0000 7fa16a9ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1640b8900 0x7fa16415b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.315+0000 7fa16a9ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa1640d15c0 0x7fa1641f37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.315+0000 7fa16a9ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa164160040 con 0x7fa1640b8900 2023-07-14T15:56:21.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.315+0000 7fa16a9ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1640c6d60 con 0x7fa1640b0ae0 2023-07-14T15:56:21.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.315+0000 7fa16a9ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1640c6a30 con 0x7fa1640d15c0 2023-07-14T15:56:21.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.315+0000 7fa15bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1640b8900 0x7fa16415b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:21.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.315+0000 7fa15bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1640b8900 0x7fa16415b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33780/0 (socket says 172.21.15.37:33780) 2023-07-14T15:56:21.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.315+0000 7fa15bfff700 1 -- 172.21.15.37:0/3481994916 learned_addr learned my addr 172.21.15.37:0/3481994916 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:21.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.316+0000 7fa168f9c700 1 --2- 172.21.15.37:0/3481994916 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa1640d15c0 0x7fa1641f37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:21.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.316+0000 7fa163fff700 1 --2- 172.21.15.37:0/3481994916 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1640b0ae0 0x7fa16415fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:21.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.316+0000 7fa168f9c700 1 -- 172.21.15.37:0/3481994916 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1640b0ae0 msgr2=0x7fa16415fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:21.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.316+0000 7fa168f9c700 1 --2- 172.21.15.37:0/3481994916 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1640b0ae0 0x7fa16415fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.316+0000 7fa168f9c700 1 -- 172.21.15.37:0/3481994916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1640b8900 msgr2=0x7fa16415b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:21.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.316+0000 7fa168f9c700 1 --2- 172.21.15.37:0/3481994916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1640b8900 0x7fa16415b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.316+0000 7fa168f9c700 1 -- 172.21.15.37:0/3481994916 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa14c0094a0 con 0x7fa1640d15c0 2023-07-14T15:56:21.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.316+0000 7fa15bfff700 1 --2- 172.21.15.37:0/3481994916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1640b8900 0x7fa16415b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:56:21.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.316+0000 7fa168f9c700 1 --2- 172.21.15.37:0/3481994916 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa1640d15c0 0x7fa1641f37b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa15c00b410 tx=0x7fa15c00b7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:21.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.313+0000 7fbc231ff700 1 -- start start 2023-07-14T15:56:21.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.314+0000 7fbc231ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbc1c06c2e0 0x7fbc1c15b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.315+0000 7fbc231ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc1c0b0d30 0x7fbc1c0b4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.315+0000 7fbc231ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc1c0cd3f0 0x7fbc1c158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.315+0000 7fbc231ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc1c0b3250 con 0x7fbc1c0cd3f0 2023-07-14T15:56:21.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.315+0000 7fbc231ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc1c0b3530 con 0x7fbc1c0b0d30 2023-07-14T15:56:21.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.315+0000 7fbc231ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc1c0b3810 con 0x7fbc1c06c2e0 2023-07-14T15:56:21.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.315+0000 7fbc2179c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc1c0cd3f0 0x7fbc1c158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:21.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.315+0000 7fbc2179c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc1c0cd3f0 0x7fbc1c158dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33774/0 (socket says 172.21.15.37:33774) 2023-07-14T15:56:21.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.315+0000 7fbc2179c700 1 -- 172.21.15.37:0/185901270 learned_addr learned my addr 172.21.15.37:0/185901270 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:21.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.318+0000 7fbc1bfff700 1 --2- 172.21.15.37:0/185901270 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc1c0b0d30 0x7fbc1c0b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:21.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.318+0000 7fbc1bfff700 1 -- 172.21.15.37:0/185901270 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbc1c06c2e0 msgr2=0x7fbc1c15b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:21.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.318+0000 7fbc1bfff700 1 --2- 172.21.15.37:0/185901270 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbc1c06c2e0 0x7fbc1c15b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.318+0000 7fbc1bfff700 1 -- 172.21.15.37:0/185901270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc1c0cd3f0 msgr2=0x7fbc1c158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:21.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.318+0000 7fbc1bfff700 1 --2- 172.21.15.37:0/185901270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc1c0cd3f0 0x7fbc1c158dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.318+0000 7fbc1bfff700 1 -- 172.21.15.37:0/185901270 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc10009a70 con 0x7fbc1c0b0d30 2023-07-14T15:56:21.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.319+0000 7fbc1bfff700 1 --2- 172.21.15.37:0/185901270 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc1c0b0d30 0x7fbc1c0b4010 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbc08000f60 tx=0x7fbc0800c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:21.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.319+0000 7fbc197fa700 1 -- 172.21.15.37:0/185901270 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc080052d0 con 0x7fbc1c0b0d30 2023-07-14T15:56:21.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.319+0000 7fbc197fa700 1 -- 172.21.15.37:0/185901270 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc08005430 con 0x7fbc1c0b0d30 2023-07-14T15:56:21.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.319+0000 7fbc197fa700 1 -- 172.21.15.37:0/185901270 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc080038c0 con 0x7fbc1c0b0d30 2023-07-14T15:56:21.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.321+0000 7fbc231ff700 1 -- 172.21.15.37:0/185901270 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc1c0b3af0 con 0x7fbc1c0b0d30 2023-07-14T15:56:21.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.321+0000 7fbc231ff700 1 -- 172.21.15.37:0/185901270 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc1c15baf0 con 0x7fbc1c0b0d30 2023-07-14T15:56:21.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.323+0000 7fbc231ff700 1 -- 172.21.15.37:0/185901270 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc1c04e210 con 0x7fbc1c0b0d30 2023-07-14T15:56:21.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.325+0000 7fbc197fa700 1 -- 172.21.15.37:0/185901270 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbc08003a20 con 0x7fbc1c0b0d30 2023-07-14T15:56:21.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.327+0000 7fa1617fa700 1 -- 172.21.15.37:0/3481994916 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15c011830 con 0x7fa1640d15c0 2023-07-14T15:56:21.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.327+0000 7fa1617fa700 1 -- 172.21.15.37:0/3481994916 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa15c011990 con 0x7fa1640d15c0 2023-07-14T15:56:21.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.327+0000 7fa1617fa700 1 -- 172.21.15.37:0/3481994916 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15c011d20 con 0x7fa1640d15c0 2023-07-14T15:56:21.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.327+0000 7fa16a9ff700 1 -- 172.21.15.37:0/3481994916 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1641f4760 con 0x7fa1640d15c0 2023-07-14T15:56:21.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.327+0000 7fa16a9ff700 1 -- 172.21.15.37:0/3481994916 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1641f4d20 con 0x7fa1640d15c0 2023-07-14T15:56:21.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.328+0000 7fbc197fa700 1 --2- 172.21.15.37:0/185901270 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbc0006ad30 0x7fbc0006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.328+0000 7fbc197fa700 1 -- 172.21.15.37:0/185901270 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbc080888b0 con 0x7fbc1c0b0d30 2023-07-14T15:56:21.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.330+0000 7fbc20f9b700 1 --2- 172.21.15.37:0/185901270 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbc0006ad30 0x7fbc0006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:21.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.330+0000 7fa16a9ff700 1 -- 172.21.15.37:0/3481994916 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1480052f0 con 0x7fa1640d15c0 2023-07-14T15:56:21.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.332+0000 7fa1617fa700 1 -- 172.21.15.37:0/3481994916 <== mon.2 v2:172.21.15.98:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa15c01a400 con 0x7fa1640d15c0 2023-07-14T15:56:21.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.334+0000 7fa1617fa700 1 --2- 172.21.15.37:0/3481994916 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa14406adb0 0x7fa14406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:21.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.334+0000 7fa1617fa700 1 -- 172.21.15.37:0/3481994916 <== mon.2 v2:172.21.15.98:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa15c089330 con 0x7fa1640d15c0 2023-07-14T15:56:21.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.335+0000 7fa163fff700 1 --2- 172.21.15.37:0/3481994916 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa14406adb0 0x7fa14406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:21.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.335+0000 7fa163fff700 1 --2- 172.21.15.37:0/3481994916 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa14406adb0 0x7fa14406d260 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa1540017d0 tx=0x7fa154009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:21.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.332+0000 7fbc197fa700 1 -- 172.21.15.37:0/185901270 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fbc080539d0 con 0x7fbc1c0b0d30 2023-07-14T15:56:21.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.338+0000 7fa1617fa700 1 -- 172.21.15.37:0/3481994916 <== mon.2 v2:172.21.15.98:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa15c0543c0 con 0x7fa1640d15c0 2023-07-14T15:56:21.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.349+0000 7fbc20f9b700 1 --2- 172.21.15.37:0/185901270 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbc0006ad30 0x7fbc0006d1e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbc10014040 tx=0x7fbc10010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:21.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.756+0000 7f4af99ff700 1 -- 172.21.15.37:0/2272671769 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4af40b4a50 con 0x7f4af406c2e0 2023-07-14T15:56:21.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.757+0000 7f4adbfff700 1 -- 172.21.15.37:0/2272671769 <== mon.1 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4aec058c20 con 0x7f4af406c2e0 2023-07-14T15:56:21.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.757+0000 7f9275ffb700 1 -- 172.21.15.37:0/1571898161 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f92900c8080 con 0x7f92900cd930 2023-07-14T15:56:21.744 INFO:teuthology.orchestra.run.smithi037.stdout:64424509449 2023-07-14T15:56:21.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.757+0000 7fe8543ff700 1 -- 172.21.15.37:0/3885585859 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe8340055a0 con 0x7fe84c0b0d30 2023-07-14T15:56:21.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.758+0000 7f9277fff700 1 -- 172.21.15.37:0/1571898161 <== mon.2 v2:172.21.15.98:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f92900c8080 con 0x7f92900cd930 2023-07-14T15:56:21.745 INFO:teuthology.orchestra.run.smithi037.stdout:64424509449 2023-07-14T15:56:21.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.759+0000 7f4af99ff700 1 -- 172.21.15.37:0/2272671769 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4ae006adb0 msgr2=0x7f4ae006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:21.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.759+0000 7f4af99ff700 1 --2- 172.21.15.37:0/2272671769 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4ae006adb0 0x7f4ae006d260 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4af415b760 tx=0x7f4ae8007a20 comp rx=0 tx=0).stop 2023-07-14T15:56:21.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.760+0000 7f4af99ff700 1 -- 172.21.15.37:0/2272671769 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4af406c2e0 msgr2=0x7f4af4157d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:21.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.760+0000 7f4af99ff700 1 --2- 172.21.15.37:0/2272671769 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4af406c2e0 0x7f4af4157d40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4aec00d860 tx=0x7f4aec004ad0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.760+0000 7fe842ffd700 1 -- 172.21.15.37:0/3885585859 <== mon.1 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe83c015030 con 0x7fe84c0b0d30 2023-07-14T15:56:21.747 INFO:teuthology.orchestra.run.smithi037.stdout:68719476746 2023-07-14T15:56:21.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.760+0000 7f4af99ff700 1 -- 172.21.15.37:0/2272671769 shutdown_connections 2023-07-14T15:56:21.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.760+0000 7f4af99ff700 1 --2- 172.21.15.37:0/2272671769 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4af406c2e0 0x7f4af4157d40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.760+0000 7f4af99ff700 1 --2- 172.21.15.37:0/2272671769 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4ae006adb0 0x7f4ae006d260 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.760+0000 7f4af99ff700 1 --2- 172.21.15.37:0/2272671769 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4af40cdf20 0x7f4af41e2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.760+0000 7f4af99ff700 1 --2- 172.21.15.37:0/2272671769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4af40b0d30 0x7f4af40b3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.760+0000 7f4af99ff700 1 -- 172.21.15.37:0/2272671769 >> 172.21.15.37:0/2272671769 conn(0x7f4af406aaa0 msgr2=0x7f4af40ad7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:21.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.761+0000 7f4af99ff700 1 -- 172.21.15.37:0/2272671769 shutdown_connections 2023-07-14T15:56:21.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.761+0000 7f4af99ff700 1 -- 172.21.15.37:0/2272671769 wait complete. 2023-07-14T15:56:21.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.761+0000 7f9275ffb700 1 -- 172.21.15.37:0/1571898161 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f927c06ace0 msgr2=0x7f927c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:21.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.761+0000 7f9275ffb700 1 --2- 172.21.15.37:0/1571898161 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f927c06ace0 0x7f927c06d190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f928800d5a0 tx=0x7f928800f040 comp rx=0 tx=0).stop 2023-07-14T15:56:21.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.761+0000 7f9275ffb700 1 -- 172.21.15.37:0/1571898161 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f92900cd930 msgr2=0x7f92900afa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:21.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.761+0000 7f9275ffb700 1 --2- 172.21.15.37:0/1571898161 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f92900cd930 0x7f92900afa80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9280012000 tx=0x7f9280004750 comp rx=0 tx=0).stop 2023-07-14T15:56:21.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.763+0000 7f9275ffb700 1 -- 172.21.15.37:0/1571898161 shutdown_connections 2023-07-14T15:56:21.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.763+0000 7f9275ffb700 1 --2- 172.21.15.37:0/1571898161 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9290158720 0x7f9290157a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.763+0000 7f9275ffb700 1 --2- 172.21.15.37:0/1571898161 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f927c06ace0 0x7f927c06d190 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.763+0000 7f9275ffb700 1 --2- 172.21.15.37:0/1571898161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f929006c2e0 0x7f9290153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.763+0000 7f9275ffb700 1 --2- 172.21.15.37:0/1571898161 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f92900cd930 0x7f92900afa80 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.763+0000 7f9275ffb700 1 -- 172.21.15.37:0/1571898161 >> 172.21.15.37:0/1571898161 conn(0x7f929006aaa0 msgr2=0x7f92900ca690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:21.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.764+0000 7fe8543ff700 1 -- 172.21.15.37:0/3885585859 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe83006adb0 msgr2=0x7fe83006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:21.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.764+0000 7fe8543ff700 1 --2- 172.21.15.37:0/3885585859 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe83006adb0 0x7fe83006d260 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe848002040 tx=0x7fe848009040 comp rx=0 tx=0).stop 2023-07-14T15:56:21.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.764+0000 7fe8543ff700 1 -- 172.21.15.37:0/3885585859 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe84c0b0d30 msgr2=0x7fe84c0b2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:21.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.764+0000 7fe8543ff700 1 --2- 172.21.15.37:0/3885585859 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe84c0b0d30 0x7fe84c0b2e80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe83c00b450 tx=0x7fe83c00b760 comp rx=0 tx=0).stop 2023-07-14T15:56:21.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.764+0000 7fe8543ff700 1 -- 172.21.15.37:0/3885585859 shutdown_connections 2023-07-14T15:56:21.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.764+0000 7fe8543ff700 1 --2- 172.21.15.37:0/3885585859 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe83006adb0 0x7fe83006d260 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.764+0000 7fe8543ff700 1 --2- 172.21.15.37:0/3885585859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe84c0cd3f0 0x7fe84c0b33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.764+0000 7fe8543ff700 1 --2- 172.21.15.37:0/3885585859 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe84c06c2e0 0x7fe84c0c7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.764+0000 7fe8543ff700 1 --2- 172.21.15.37:0/3885585859 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe84c0b0d30 0x7fe84c0b2e80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.764+0000 7fe8543ff700 1 -- 172.21.15.37:0/3885585859 >> 172.21.15.37:0/3885585859 conn(0x7fe84c06aaa0 msgr2=0x7fe84c0af990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:21.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.764+0000 7f9275ffb700 1 -- 172.21.15.37:0/1571898161 shutdown_connections 2023-07-14T15:56:21.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.765+0000 7f9275ffb700 1 -- 172.21.15.37:0/1571898161 wait complete. 2023-07-14T15:56:21.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.765+0000 7fe8543ff700 1 -- 172.21.15.37:0/3885585859 shutdown_connections 2023-07-14T15:56:21.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.765+0000 7fe8543ff700 1 -- 172.21.15.37:0/3885585859 wait complete. 2023-07-14T15:56:21.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.772+0000 7fdfc67ff700 1 -- 172.21.15.37:0/3695333389 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fdfc00c18e0 con 0x7fdfc01607a0 2023-07-14T15:56:21.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.772+0000 7fdda7dff700 1 -- 172.21.15.37:0/3608604349 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdda004e210 con 0x7fdda00b8900 2023-07-14T15:56:21.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.773+0000 7fdfbcff9700 1 -- 172.21.15.37:0/3695333389 <== mon.1 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdfb4058de0 con 0x7fdfc01607a0 2023-07-14T15:56:21.763 INFO:teuthology.orchestra.run.smithi037.stdout:68719476745 2023-07-14T15:56:21.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.773+0000 7fdd967fc700 1 -- 172.21.15.37:0/3608604349 <== mon.2 v2:172.21.15.98:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdd9c057200 con 0x7fdda00b8900 2023-07-14T15:56:21.764 INFO:teuthology.orchestra.run.smithi037.stdout:64424509448 2023-07-14T15:56:21.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.777+0000 7fdcc65ff700 1 -- 172.21.15.37:0/1495689649 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdcc015bc50 con 0x7fdcc0145d40 2023-07-14T15:56:21.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.777+0000 7fdda7dff700 1 -- 172.21.15.37:0/3608604349 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fdd8406ade0 msgr2=0x7fdd8406d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:21.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.777+0000 7fdda7dff700 1 --2- 172.21.15.37:0/3608604349 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fdd8406ade0 0x7fdd8406d290 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdd900096f0 tx=0x7fdd90006c50 comp rx=0 tx=0).stop 2023-07-14T15:56:21.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.778+0000 7fdda7dff700 1 -- 172.21.15.37:0/3608604349 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdda00b8900 msgr2=0x7fdda015ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:21.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.778+0000 7fdda7dff700 1 --2- 172.21.15.37:0/3608604349 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdda00b8900 0x7fdda015ebe0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c00c500 tx=0x7fdd9c00c8c0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.778+0000 7fdcbcff9700 1 -- 172.21.15.37:0/1495689649 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdcb0015020 con 0x7fdcc0145d40 2023-07-14T15:56:21.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.778+0000 7fdda7dff700 1 -- 172.21.15.37:0/3608604349 shutdown_connections 2023-07-14T15:56:21.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.778+0000 7fdda7dff700 1 --2- 172.21.15.37:0/3608604349 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdda00b0ae0 0x7fdda01f98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.778+0000 7fdda7dff700 1 --2- 172.21.15.37:0/3608604349 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fdd8406ade0 0x7fdd8406d290 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.778+0000 7fdda7dff700 1 --2- 172.21.15.37:0/3608604349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdda00d15c0 0x7fdda006af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.778+0000 7fdda7dff700 1 --2- 172.21.15.37:0/3608604349 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdda00b8900 0x7fdda015ebe0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.778+0000 7fdda7dff700 1 -- 172.21.15.37:0/3608604349 >> 172.21.15.37:0/3608604349 conn(0x7fdda009c1e0 msgr2=0x7fdda00d0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:21.767 INFO:teuthology.orchestra.run.smithi037.stdout:60129542151 2023-07-14T15:56:21.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.779+0000 7fdda7dff700 1 -- 172.21.15.37:0/3608604349 shutdown_connections 2023-07-14T15:56:21.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.779+0000 7fdda7dff700 1 -- 172.21.15.37:0/3608604349 wait complete. 2023-07-14T15:56:21.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.782+0000 7fdfc67ff700 1 -- 172.21.15.37:0/3695333389 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fdfac06ad00 msgr2=0x7fdfac06d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:21.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.782+0000 7fdfc67ff700 1 --2- 172.21.15.37:0/3695333389 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fdfac06ad00 0x7fdfac06d1b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdfc00b4a20 tx=0x7fdfb8009130 comp rx=0 tx=0).stop 2023-07-14T15:56:21.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.782+0000 7fdfc67ff700 1 -- 172.21.15.37:0/3695333389 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdfc01607a0 msgr2=0x7fdfc00c6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:21.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.782+0000 7fdfc67ff700 1 --2- 172.21.15.37:0/3695333389 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdfc01607a0 0x7fdfc00c6a90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdfb4000c00 tx=0x7fdfb4004750 comp rx=0 tx=0).stop 2023-07-14T15:56:21.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.783+0000 7fdfc67ff700 1 -- 172.21.15.37:0/3695333389 shutdown_connections 2023-07-14T15:56:21.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.783+0000 7fdfc67ff700 1 --2- 172.21.15.37:0/3695333389 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdfc01607a0 0x7fdfc00c6a90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.783+0000 7fdfc67ff700 1 --2- 172.21.15.37:0/3695333389 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fdfac06ad00 0x7fdfac06d1b0 secure :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdfc00b4a20 tx=0x7fdfb8009130 comp rx=0 tx=0).stop 2023-07-14T15:56:21.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.783+0000 7fdfc67ff700 1 --2- 172.21.15.37:0/3695333389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfc00b4460 0x7fdfc0158c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.783+0000 7fdfc67ff700 1 --2- 172.21.15.37:0/3695333389 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdfc0165130 0x7fdfc00c75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.783+0000 7fdfc67ff700 1 -- 172.21.15.37:0/3695333389 >> 172.21.15.37:0/3695333389 conn(0x7fdfc006aaa0 msgr2=0x7fdfc01639b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:21.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.787+0000 7fdfc67ff700 1 -- 172.21.15.37:0/3695333389 shutdown_connections 2023-07-14T15:56:21.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.783+0000 7fdcc65ff700 1 -- 172.21.15.37:0/1495689649 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fdca006adb0 msgr2=0x7fdca006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:21.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.783+0000 7fdcc65ff700 1 --2- 172.21.15.37:0/1495689649 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fdca006adb0 0x7fdca006d260 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0063c00 tx=0x7fdca800a000 comp rx=0 tx=0).stop 2023-07-14T15:56:21.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.783+0000 7fdcc65ff700 1 -- 172.21.15.37:0/1495689649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcc0145d40 msgr2=0x7fdcc01ee3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:21.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.783+0000 7fdcc65ff700 1 --2- 172.21.15.37:0/1495689649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcc0145d40 0x7fdcc01ee3a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdcb000b460 tx=0x7fdcb000b820 comp rx=0 tx=0).stop 2023-07-14T15:56:21.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.784+0000 7fdcc65ff700 1 -- 172.21.15.37:0/1495689649 shutdown_connections 2023-07-14T15:56:21.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.784+0000 7fdcc65ff700 1 --2- 172.21.15.37:0/1495689649 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fdca006adb0 0x7fdca006d260 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.784+0000 7fdcc65ff700 1 --2- 172.21.15.37:0/1495689649 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdcc0159e90 0x7fdcc01f1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.784+0000 7fdcc65ff700 1 --2- 172.21.15.37:0/1495689649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcc0145d40 0x7fdcc01ee3a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.784+0000 7fdcc65ff700 1 --2- 172.21.15.37:0/1495689649 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcc0146110 0x7fdcc00b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.784+0000 7fdcc65ff700 1 -- 172.21.15.37:0/1495689649 >> 172.21.15.37:0/1495689649 conn(0x7fdcc006aaa0 msgr2=0x7fdcc00afa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:21.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.784+0000 7fdcc65ff700 1 -- 172.21.15.37:0/1495689649 shutdown_connections 2023-07-14T15:56:21.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.784+0000 7fdcc65ff700 1 -- 172.21.15.37:0/1495689649 wait complete. 2023-07-14T15:56:21.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.789+0000 7fdfc67ff700 1 -- 172.21.15.37:0/3695333389 wait complete. 2023-07-14T15:56:21.778 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.2 2023-07-14T15:56:21.778 DEBUG:teuthology.parallel:result is None 2023-07-14T15:56:21.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.792+0000 7fa16a9ff700 1 -- 172.21.15.37:0/3481994916 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fa1480055a0 con 0x7fa1640d15c0 2023-07-14T15:56:21.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.793+0000 7fa1617fa700 1 -- 172.21.15.37:0/3481994916 <== mon.2 v2:172.21.15.98:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa15c0579e0 con 0x7fa1640d15c0 2023-07-14T15:56:21.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.793+0000 7fbc231ff700 1 -- 172.21.15.37:0/185901270 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fbc1c0b3670 con 0x7fbc1c0b0d30 2023-07-14T15:56:21.780 INFO:teuthology.orchestra.run.smithi037.stdout:64424509450 2023-07-14T15:56:21.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.794+0000 7fbc197fa700 1 -- 172.21.15.37:0/185901270 <== mon.1 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbc1c0b3670 con 0x7fbc1c0b0d30 2023-07-14T15:56:21.781 INFO:teuthology.orchestra.run.smithi037.stdout:60129542152 2023-07-14T15:56:21.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.796+0000 7fa16a9ff700 1 -- 172.21.15.37:0/3481994916 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa14406adb0 msgr2=0x7fa14406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:21.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.796+0000 7fa16a9ff700 1 --2- 172.21.15.37:0/3481994916 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa14406adb0 0x7fa14406d260 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa1540017d0 tx=0x7fa154009040 comp rx=0 tx=0).stop 2023-07-14T15:56:21.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.796+0000 7fa16a9ff700 1 -- 172.21.15.37:0/3481994916 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa1640d15c0 msgr2=0x7fa1641f37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:21.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.796+0000 7fa16a9ff700 1 --2- 172.21.15.37:0/3481994916 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa1640d15c0 0x7fa1641f37b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa15c00b410 tx=0x7fa15c00b7d0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.798+0000 7fa16a9ff700 1 -- 172.21.15.37:0/3481994916 shutdown_connections 2023-07-14T15:56:21.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.798+0000 7fa16a9ff700 1 --2- 172.21.15.37:0/3481994916 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1640b0ae0 0x7fa16415fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.798+0000 7fa16a9ff700 1 --2- 172.21.15.37:0/3481994916 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa14406adb0 0x7fa14406d260 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.798+0000 7fa16a9ff700 1 --2- 172.21.15.37:0/3481994916 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa1640d15c0 0x7fa1641f37b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.798+0000 7fa16a9ff700 1 --2- 172.21.15.37:0/3481994916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1640b8900 0x7fa16415b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.798+0000 7fa16a9ff700 1 -- 172.21.15.37:0/3481994916 >> 172.21.15.37:0/3481994916 conn(0x7fa16409c1e0 msgr2=0x7fa16406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:21.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.798+0000 7fa16a9ff700 1 -- 172.21.15.37:0/3481994916 shutdown_connections 2023-07-14T15:56:21.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.798+0000 7fa16a9ff700 1 -- 172.21.15.37:0/3481994916 wait complete. 2023-07-14T15:56:21.788 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476746 got 68719476746 for osd.0 2023-07-14T15:56:21.788 DEBUG:teuthology.parallel:result is None 2023-07-14T15:56:21.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.800+0000 7fbc231ff700 1 -- 172.21.15.37:0/185901270 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbc0006ad30 msgr2=0x7fbc0006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:21.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.800+0000 7fbc231ff700 1 --2- 172.21.15.37:0/185901270 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbc0006ad30 0x7fbc0006d1e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbc10014040 tx=0x7fbc10010000 comp rx=0 tx=0).stop 2023-07-14T15:56:21.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.800+0000 7fbc231ff700 1 -- 172.21.15.37:0/185901270 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc1c0b0d30 msgr2=0x7fbc1c0b4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:21.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.800+0000 7fbc231ff700 1 --2- 172.21.15.37:0/185901270 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc1c0b0d30 0x7fbc1c0b4010 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbc08000f60 tx=0x7fbc0800c7e0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.800+0000 7fbc231ff700 1 -- 172.21.15.37:0/185901270 shutdown_connections 2023-07-14T15:56:21.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.800+0000 7fbc231ff700 1 --2- 172.21.15.37:0/185901270 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbc0006ad30 0x7fbc0006d1e0 secure :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbc10014040 tx=0x7fbc10010000 comp rx=0 tx=0).stop 2023-07-14T15:56:21.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.800+0000 7fbc231ff700 1 --2- 172.21.15.37:0/185901270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc1c0cd3f0 0x7fbc1c158dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.800+0000 7fbc231ff700 1 --2- 172.21.15.37:0/185901270 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbc1c06c2e0 0x7fbc1c15b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.800+0000 7fbc231ff700 1 --2- 172.21.15.37:0/185901270 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbc1c0b0d30 0x7fbc1c0b4010 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:21.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.800+0000 7fbc231ff700 1 -- 172.21.15.37:0/185901270 >> 172.21.15.37:0/185901270 conn(0x7fbc1c06aaa0 msgr2=0x7fbc1c070de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:21.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.801+0000 7fbc231ff700 1 -- 172.21.15.37:0/185901270 shutdown_connections 2023-07-14T15:56:21.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:21.801+0000 7fbc231ff700 1 -- 172.21.15.37:0/185901270 wait complete. 2023-07-14T15:56:21.791 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.7 2023-07-14T15:56:21.791 DEBUG:teuthology.parallel:result is None 2023-07-14T15:56:21.800 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476745 got 68719476745 for osd.3 2023-07-14T15:56:21.800 DEBUG:teuthology.parallel:result is None 2023-07-14T15:56:21.802 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.1 2023-07-14T15:56:21.802 DEBUG:teuthology.parallel:result is None 2023-07-14T15:56:21.810 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.5 2023-07-14T15:56:21.810 DEBUG:teuthology.parallel:result is None 2023-07-14T15:56:21.811 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.4 2023-07-14T15:56:21.811 DEBUG:teuthology.parallel:result is None 2023-07-14T15:56:21.817 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.6 2023-07-14T15:56:21.817 DEBUG:teuthology.parallel:result is None 2023-07-14T15:56:21.817 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-14T15:56:21.818 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T15:56:22.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.073+0000 7f53d61ff700 1 Processor -- start 2023-07-14T15:56:22.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.073+0000 7f53d61ff700 1 -- start start 2023-07-14T15:56:22.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.074+0000 7f53d61ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f53d00b85f0 0x7f53d015d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:22.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.075+0000 7f53d61ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f53d00b4910 0x7f53d00b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:22.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.075+0000 7f53d61ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d00cf6b0 con 0x7f53d00b54b0 2023-07-14T15:56:22.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.075+0000 7f53d61ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53d00b5270 con 0x7f53d00b4910 2023-07-14T15:56:22.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.075+0000 7f53d61ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53d00cdc40 con 0x7f53d00b85f0 2023-07-14T15:56:22.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.075+0000 7f53ceffd700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f53d00b54b0 0x7f53d00cfb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37322/0 (socket says 172.21.15.37:37322) 2023-07-14T15:56:22.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.075+0000 7f53ceffd700 1 -- 172.21.15.37:0/2999770714 learned_addr learned my addr 172.21.15.37:0/2999770714 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:22.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.075+0000 7f53cffff700 1 --2- 172.21.15.37:0/2999770714 >> v2:172.21.15.37:3300/0 conn(0x7f53d00b4910 0x7f53d00b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:22.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.075+0000 7f53cf7fe700 1 --2- 172.21.15.37:0/2999770714 >> v2:172.21.15.98:3300/0 conn(0x7f53d00b85f0 0x7f53d015d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:22.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.075+0000 7f53ce7fc700 1 -- 172.21.15.37:0/2999770714 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 886236577 0 0) 0x7f53d00cf6b0 con 0x7f53d00b54b0 2023-07-14T15:56:22.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.075+0000 7f53ce7fc700 1 -- 172.21.15.37:0/2999770714 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53b80035b0 con 0x7f53d00b54b0 2023-07-14T15:56:22.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.075+0000 7f53cffff700 1 -- 172.21.15.37:0/2999770714 >> v2:172.21.15.98:3300/0 conn(0x7f53d00b85f0 msgr2=0x7f53d015d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:22.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.075+0000 7f53cffff700 1 --2- 172.21.15.37:0/2999770714 >> v2:172.21.15.98:3300/0 conn(0x7f53d00b85f0 0x7f53d015d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:22.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.075+0000 7f53cffff700 1 -- 172.21.15.37:0/2999770714 >> v1:172.21.15.37:6789/0 conn(0x7f53d00b54b0 legacy=0x7f53d00cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:22.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.075+0000 7f53cffff700 1 -- 172.21.15.37:0/2999770714 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d015dba0 con 0x7f53d00b4910 2023-07-14T15:56:22.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.076+0000 7f53cffff700 1 --2- 172.21.15.37:0/2999770714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53d00b4910 0x7f53d00b4d30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f53d006a110 tx=0x7f53c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=226c703f70c955e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:22.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.076+0000 7f53ce7fc700 1 -- 172.21.15.37:0/2999770714 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c800e070 con 0x7f53d00b4910 2023-07-14T15:56:22.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.076+0000 7f53ce7fc700 1 -- 172.21.15.37:0/2999770714 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c800bb20 con 0x7f53d00b4910 2023-07-14T15:56:22.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.076+0000 7f53ce7fc700 1 -- 172.21.15.37:0/2999770714 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c8012430 con 0x7f53d00b4910 2023-07-14T15:56:22.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.076+0000 7f53d61ff700 1 -- 172.21.15.37:0/2999770714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53d00b4910 msgr2=0x7f53d00b4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:22.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.076+0000 7f53d61ff700 1 --2- 172.21.15.37:0/2999770714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53d00b4910 0x7f53d00b4d30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f53d006a110 tx=0x7f53c800b330 comp rx=0 tx=0).stop 2023-07-14T15:56:22.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.077+0000 7f53d61ff700 1 -- 172.21.15.37:0/2999770714 shutdown_connections 2023-07-14T15:56:22.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.077+0000 7f53d61ff700 1 --2- 172.21.15.37:0/2999770714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53d00b4910 0x7f53d00b4d30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:22.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.077+0000 7f53d61ff700 1 --2- 172.21.15.37:0/2999770714 >> v2:172.21.15.98:3300/0 conn(0x7f53d00b85f0 0x7f53d015d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:22.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.077+0000 7f53d61ff700 1 -- 172.21.15.37:0/2999770714 >> 172.21.15.37:0/2999770714 conn(0x7f53d006a580 msgr2=0x7f53d006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:22.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.077+0000 7f53d61ff700 1 -- 172.21.15.37:0/2999770714 shutdown_connections 2023-07-14T15:56:22.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.077+0000 7f53d61ff700 1 -- 172.21.15.37:0/2999770714 wait complete. 2023-07-14T15:56:22.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.078+0000 7f53d61ff700 1 Processor -- start 2023-07-14T15:56:22.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.078+0000 7f53d61ff700 1 -- start start 2023-07-14T15:56:22.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.079+0000 7f53d61ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53d00b4910 0x7f53d00c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:22.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.079+0000 7f53d61ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53d00b54b0 0x7f53d015c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:22.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.079+0000 7f53d61ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f53d00b85f0 0x7f53d015c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:22.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.079+0000 7f53d61ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d014bad0 con 0x7f53d00b54b0 2023-07-14T15:56:22.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.079+0000 7f53d61ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d00c79d0 con 0x7f53d00b4910 2023-07-14T15:56:22.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.079+0000 7f53d61ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d00ca8d0 con 0x7f53d00b85f0 2023-07-14T15:56:22.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.080+0000 7f53ceffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53d00b54b0 0x7f53d015c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:22.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.080+0000 7f53ceffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53d00b54b0 0x7f53d015c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33796/0 (socket says 172.21.15.37:33796) 2023-07-14T15:56:22.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.080+0000 7f53ceffd700 1 -- 172.21.15.37:0/1805547521 learned_addr learned my addr 172.21.15.37:0/1805547521 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:22.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.080+0000 7f53cf7fe700 1 --2- 172.21.15.37:0/1805547521 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53d00b4910 0x7f53d00c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:22.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.080+0000 7f53cffff700 1 --2- 172.21.15.37:0/1805547521 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f53d00b85f0 0x7f53d015c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:22.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.080+0000 7f53ceffd700 1 -- 172.21.15.37:0/1805547521 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f53d00b85f0 msgr2=0x7f53d015c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:22.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.080+0000 7f53ceffd700 1 --2- 172.21.15.37:0/1805547521 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f53d00b85f0 0x7f53d015c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:22.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.080+0000 7f53ceffd700 1 -- 172.21.15.37:0/1805547521 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53d00b4910 msgr2=0x7f53d00c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:22.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.080+0000 7f53ceffd700 1 --2- 172.21.15.37:0/1805547521 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53d00b4910 0x7f53d00c9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:22.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.080+0000 7f53ceffd700 1 -- 172.21.15.37:0/1805547521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c8009a70 con 0x7f53d00b54b0 2023-07-14T15:56:22.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.080+0000 7f53ceffd700 1 --2- 172.21.15.37:0/1805547521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53d00b54b0 0x7f53d015c140 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f53c400c700 tx=0x7f53c400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:22.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.080+0000 7f53b7fff700 1 -- 172.21.15.37:0/1805547521 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c4005d70 con 0x7f53d00b54b0 2023-07-14T15:56:22.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.080+0000 7f53b7fff700 1 -- 172.21.15.37:0/1805547521 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c40070d0 con 0x7f53d00b54b0 2023-07-14T15:56:22.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.081+0000 7f53b7fff700 1 -- 172.21.15.37:0/1805547521 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c4007460 con 0x7f53d00b54b0 2023-07-14T15:56:22.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.081+0000 7f53d61ff700 1 -- 172.21.15.37:0/1805547521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53d00cabb0 con 0x7f53d00b54b0 2023-07-14T15:56:22.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.081+0000 7f53d61ff700 1 -- 172.21.15.37:0/1805547521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d00c7be0 con 0x7f53d00b54b0 2023-07-14T15:56:22.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.082+0000 7f53d61ff700 1 -- 172.21.15.37:0/1805547521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53d00c7e00 con 0x7f53d00b54b0 2023-07-14T15:56:22.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.083+0000 7f53b7fff700 1 -- 172.21.15.37:0/1805547521 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f53c40075c0 con 0x7f53d00b54b0 2023-07-14T15:56:22.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.084+0000 7f53b7fff700 1 --2- 172.21.15.37:0/1805547521 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f53bc06ace0 0x7f53bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:22.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.084+0000 7f53b7fff700 1 -- 172.21.15.37:0/1805547521 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f53c4088840 con 0x7f53d00b54b0 2023-07-14T15:56:22.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.084+0000 7f53cf7fe700 1 --2- 172.21.15.37:0/1805547521 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f53bc06ace0 0x7f53bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:22.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.085+0000 7f53cf7fe700 1 --2- 172.21.15.37:0/1805547521 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f53bc06ace0 0x7f53bc06d190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f53c0009b40 tx=0x7f53c0009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:22.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.088+0000 7f53b7fff700 1 -- 172.21.15.37:0/1805547521 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f53c4053980 con 0x7f53d00b54b0 2023-07-14T15:56:22.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.296+0000 7f53d61ff700 1 -- 172.21.15.37:0/1805547521 --> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f53d00cf0a0 con 0x7f53bc06ace0 2023-07-14T15:56:22.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.305+0000 7f53b7fff700 1 -- 172.21.15.37:0/1805547521 <== mgr.4100 v2:172.21.15.98:6832/3163748069 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286622 (secure 0 0 0) 0x7f53c0011810 con 0x7f53bc06ace0 2023-07-14T15:56:22.295 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:56:22.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.309+0000 7f53d61ff700 1 -- 172.21.15.37:0/1805547521 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f53bc06ace0 msgr2=0x7f53bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:22.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.309+0000 7f53d61ff700 1 --2- 172.21.15.37:0/1805547521 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f53bc06ace0 0x7f53bc06d190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f53c0009b40 tx=0x7f53c0009210 comp rx=0 tx=0).stop 2023-07-14T15:56:22.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.309+0000 7f53d61ff700 1 -- 172.21.15.37:0/1805547521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53d00b54b0 msgr2=0x7f53d015c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:22.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.309+0000 7f53d61ff700 1 --2- 172.21.15.37:0/1805547521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53d00b54b0 0x7f53d015c140 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f53c400c700 tx=0x7f53c400ca10 comp rx=0 tx=0).stop 2023-07-14T15:56:22.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.309+0000 7f53d61ff700 1 -- 172.21.15.37:0/1805547521 shutdown_connections 2023-07-14T15:56:22.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.309+0000 7f53d61ff700 1 --2- 172.21.15.37:0/1805547521 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53d00b4910 0x7f53d00c9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:22.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.309+0000 7f53d61ff700 1 --2- 172.21.15.37:0/1805547521 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f53bc06ace0 0x7f53bc06d190 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:22.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.309+0000 7f53d61ff700 1 --2- 172.21.15.37:0/1805547521 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f53d00b85f0 0x7f53d015c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:22.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.309+0000 7f53d61ff700 1 --2- 172.21.15.37:0/1805547521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53d00b54b0 0x7f53d015c140 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:22.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.309+0000 7f53d61ff700 1 -- 172.21.15.37:0/1805547521 >> 172.21.15.37:0/1805547521 conn(0x7f53d006a580 msgr2=0x7f53d00cfa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:22.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.309+0000 7f53d61ff700 1 -- 172.21.15.37:0/1805547521 shutdown_connections 2023-07-14T15:56:22.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.309+0000 7f53d61ff700 1 -- 172.21.15.37:0/1805547521 wait complete. 2023-07-14T15:56:22.299 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-14T15:56:22.314 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2023-07-14T15:56:20.856906+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218824,"kb_used_data":3208,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755896,"statfs":{"total":773094113280,"available":772870037504,"internally_reserved":0,"allocated":3284992,"data_stored":1946876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2250,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.890112"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969224+0000","last_change":"2023-07-14T15:56:08.983100+0000","last_active":"2023-07-14T15:56:09.969224+0000","last_peered":"2023-07-14T15:56:09.969224+0000","last_clean":"2023-07-14T15:56:09.969224+0000","last_became_active":"2023-07-14T15:56:08.982847+0000","last_became_peered":"2023-07-14T15:56:08.982847+0000","last_unstale":"2023-07-14T15:56:09.969224+0000","last_undegraded":"2023-07-14T15:56:09.969224+0000","last_fullsized":"2023-07-14T15:56:09.969224+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:52:49.596576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489972+0000","last_change":"2023-07-14T15:56:08.961552+0000","last_active":"2023-07-14T15:56:10.489972+0000","last_peered":"2023-07-14T15:56:10.489972+0000","last_clean":"2023-07-14T15:56:10.489972+0000","last_became_active":"2023-07-14T15:56:08.960866+0000","last_became_peered":"2023-07-14T15:56:08.960866+0000","last_unstale":"2023-07-14T15:56:10.489972+0000","last_undegraded":"2023-07-14T15:56:10.489972+0000","last_fullsized":"2023-07-14T15:56:10.489972+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:30:24.180248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968575+0000","last_change":"2023-07-14T15:56:08.984210+0000","last_active":"2023-07-14T15:56:09.968575+0000","last_peered":"2023-07-14T15:56:09.968575+0000","last_clean":"2023-07-14T15:56:09.968575+0000","last_became_active":"2023-07-14T15:56:08.983924+0000","last_became_peered":"2023-07-14T15:56:08.983924+0000","last_unstale":"2023-07-14T15:56:09.968575+0000","last_undegraded":"2023-07-14T15:56:09.968575+0000","last_fullsized":"2023-07-14T15:56:09.968575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:51:26.834028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968877+0000","last_change":"2023-07-14T15:56:08.968523+0000","last_active":"2023-07-14T15:56:09.968877+0000","last_peered":"2023-07-14T15:56:09.968877+0000","last_clean":"2023-07-14T15:56:09.968877+0000","last_became_active":"2023-07-14T15:56:08.968214+0000","last_became_peered":"2023-07-14T15:56:08.968214+0000","last_unstale":"2023-07-14T15:56:09.968877+0000","last_undegraded":"2023-07-14T15:56:09.968877+0000","last_fullsized":"2023-07-14T15:56:09.968877+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:28:16.724128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.317844+0000","last_change":"2023-07-14T15:56:08.960575+0000","last_active":"2023-07-14T15:56:10.317844+0000","last_peered":"2023-07-14T15:56:10.317844+0000","last_clean":"2023-07-14T15:56:10.317844+0000","last_became_active":"2023-07-14T15:56:08.959986+0000","last_became_peered":"2023-07-14T15:56:08.959986+0000","last_unstale":"2023-07-14T15:56:10.317844+0000","last_undegraded":"2023-07-14T15:56:10.317844+0000","last_fullsized":"2023-07-14T15:56:10.317844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:36:15.019527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968975+0000","last_change":"2023-07-14T15:56:08.970285+0000","last_active":"2023-07-14T15:56:09.968975+0000","last_peered":"2023-07-14T15:56:09.968975+0000","last_clean":"2023-07-14T15:56:09.968975+0000","last_became_active":"2023-07-14T15:56:08.969969+0000","last_became_peered":"2023-07-14T15:56:08.969969+0000","last_unstale":"2023-07-14T15:56:09.968975+0000","last_undegraded":"2023-07-14T15:56:09.968975+0000","last_fullsized":"2023-07-14T15:56:09.968975+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:04:03.590683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968616+0000","last_change":"2023-07-14T15:56:08.964590+0000","last_active":"2023-07-14T15:56:09.968616+0000","last_peered":"2023-07-14T15:56:09.968616+0000","last_clean":"2023-07-14T15:56:09.968616+0000","last_became_active":"2023-07-14T15:56:08.963896+0000","last_became_peered":"2023-07-14T15:56:08.963896+0000","last_unstale":"2023-07-14T15:56:09.968616+0000","last_undegraded":"2023-07-14T15:56:09.968616+0000","last_fullsized":"2023-07-14T15:56:09.968616+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:31:53.434325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489987+0000","last_change":"2023-07-14T15:56:08.963001+0000","last_active":"2023-07-14T15:56:10.489987+0000","last_peered":"2023-07-14T15:56:10.489987+0000","last_clean":"2023-07-14T15:56:10.489987+0000","last_became_active":"2023-07-14T15:56:08.962689+0000","last_became_peered":"2023-07-14T15:56:08.962689+0000","last_unstale":"2023-07-14T15:56:10.489987+0000","last_undegraded":"2023-07-14T15:56:10.489987+0000","last_fullsized":"2023-07-14T15:56:10.489987+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:54:19.293355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.318103+0000","last_change":"2023-07-14T15:56:08.982014+0000","last_active":"2023-07-14T15:56:10.318103+0000","last_peered":"2023-07-14T15:56:10.318103+0000","last_clean":"2023-07-14T15:56:10.318103+0000","last_became_active":"2023-07-14T15:56:08.981754+0000","last_became_peered":"2023-07-14T15:56:08.981754+0000","last_unstale":"2023-07-14T15:56:10.318103+0000","last_undegraded":"2023-07-14T15:56:10.318103+0000","last_fullsized":"2023-07-14T15:56:10.318103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:12:09.498134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489747+0000","last_change":"2023-07-14T15:56:08.974509+0000","last_active":"2023-07-14T15:56:10.489747+0000","last_peered":"2023-07-14T15:56:10.489747+0000","last_clean":"2023-07-14T15:56:10.489747+0000","last_became_active":"2023-07-14T15:56:08.974197+0000","last_became_peered":"2023-07-14T15:56:08.974197+0000","last_unstale":"2023-07-14T15:56:10.489747+0000","last_undegraded":"2023-07-14T15:56:10.489747+0000","last_fullsized":"2023-07-14T15:56:10.489747+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:59:57.661468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489832+0000","last_change":"2023-07-14T15:56:08.965378+0000","last_active":"2023-07-14T15:56:10.489832+0000","last_peered":"2023-07-14T15:56:10.489832+0000","last_clean":"2023-07-14T15:56:10.489832+0000","last_became_active":"2023-07-14T15:56:08.965029+0000","last_became_peered":"2023-07-14T15:56:08.965029+0000","last_unstale":"2023-07-14T15:56:10.489832+0000","last_undegraded":"2023-07-14T15:56:10.489832+0000","last_fullsized":"2023-07-14T15:56:10.489832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:11:49.645623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969340+0000","last_change":"2023-07-14T15:56:08.979271+0000","last_active":"2023-07-14T15:56:09.969340+0000","last_peered":"2023-07-14T15:56:09.969340+0000","last_clean":"2023-07-14T15:56:09.969340+0000","last_became_active":"2023-07-14T15:56:08.978838+0000","last_became_peered":"2023-07-14T15:56:08.978838+0000","last_unstale":"2023-07-14T15:56:09.969340+0000","last_undegraded":"2023-07-14T15:56:09.969340+0000","last_fullsized":"2023-07-14T15:56:09.969340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:24:33.248717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489209+0000","last_change":"2023-07-14T15:56:08.990555+0000","last_active":"2023-07-14T15:56:10.489209+0000","last_peered":"2023-07-14T15:56:10.489209+0000","last_clean":"2023-07-14T15:56:10.489209+0000","last_became_active":"2023-07-14T15:56:08.990204+0000","last_became_peered":"2023-07-14T15:56:08.990204+0000","last_unstale":"2023-07-14T15:56:10.489209+0000","last_undegraded":"2023-07-14T15:56:10.489209+0000","last_fullsized":"2023-07-14T15:56:10.489209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:53:14.967321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489549+0000","last_change":"2023-07-14T15:56:08.986185+0000","last_active":"2023-07-14T15:56:10.489549+0000","last_peered":"2023-07-14T15:56:10.489549+0000","last_clean":"2023-07-14T15:56:10.489549+0000","last_became_active":"2023-07-14T15:56:08.985934+0000","last_became_peered":"2023-07-14T15:56:08.985934+0000","last_unstale":"2023-07-14T15:56:10.489549+0000","last_undegraded":"2023-07-14T15:56:10.489549+0000","last_fullsized":"2023-07-14T15:56:10.489549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:22:06.842480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968260+0000","last_change":"2023-07-14T15:56:08.962497+0000","last_active":"2023-07-14T15:56:09.968260+0000","last_peered":"2023-07-14T15:56:09.968260+0000","last_clean":"2023-07-14T15:56:09.968260+0000","last_became_active":"2023-07-14T15:56:08.962200+0000","last_became_peered":"2023-07-14T15:56:08.962200+0000","last_unstale":"2023-07-14T15:56:09.968260+0000","last_undegraded":"2023-07-14T15:56:09.968260+0000","last_fullsized":"2023-07-14T15:56:09.968260+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:51:55.348364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968662+0000","last_change":"2023-07-14T15:56:08.967526+0000","last_active":"2023-07-14T15:56:09.968662+0000","last_peered":"2023-07-14T15:56:09.968662+0000","last_clean":"2023-07-14T15:56:09.968662+0000","last_became_active":"2023-07-14T15:56:08.967220+0000","last_became_peered":"2023-07-14T15:56:08.967220+0000","last_unstale":"2023-07-14T15:56:09.968662+0000","last_undegraded":"2023-07-14T15:56:09.968662+0000","last_fullsized":"2023-07-14T15:56:09.968662+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:38:26.539859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489384+0000","last_change":"2023-07-14T15:56:08.973815+0000","last_active":"2023-07-14T15:56:10.489384+0000","last_peered":"2023-07-14T15:56:10.489384+0000","last_clean":"2023-07-14T15:56:10.489384+0000","last_became_active":"2023-07-14T15:56:08.973497+0000","last_became_peered":"2023-07-14T15:56:08.973497+0000","last_unstale":"2023-07-14T15:56:10.489384+0000","last_undegraded":"2023-07-14T15:56:10.489384+0000","last_fullsized":"2023-07-14T15:56:10.489384+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:18:49.883894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969348+0000","last_change":"2023-07-14T15:56:08.967374+0000","last_active":"2023-07-14T15:56:09.969348+0000","last_peered":"2023-07-14T15:56:09.969348+0000","last_clean":"2023-07-14T15:56:09.969348+0000","last_became_active":"2023-07-14T15:56:08.967057+0000","last_became_peered":"2023-07-14T15:56:08.967057+0000","last_unstale":"2023-07-14T15:56:09.969348+0000","last_undegraded":"2023-07-14T15:56:09.969348+0000","last_fullsized":"2023-07-14T15:56:09.969348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:12:21.171093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969523+0000","last_change":"2023-07-14T15:56:08.980915+0000","last_active":"2023-07-14T15:56:09.969523+0000","last_peered":"2023-07-14T15:56:09.969523+0000","last_clean":"2023-07-14T15:56:09.969523+0000","last_became_active":"2023-07-14T15:56:08.971846+0000","last_became_peered":"2023-07-14T15:56:08.971846+0000","last_unstale":"2023-07-14T15:56:09.969523+0000","last_undegraded":"2023-07-14T15:56:09.969523+0000","last_fullsized":"2023-07-14T15:56:09.969523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:09:13.220323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.490060+0000","last_change":"2023-07-14T15:56:08.961701+0000","last_active":"2023-07-14T15:56:10.490060+0000","last_peered":"2023-07-14T15:56:10.490060+0000","last_clean":"2023-07-14T15:56:10.490060+0000","last_became_active":"2023-07-14T15:56:08.961444+0000","last_became_peered":"2023-07-14T15:56:08.961444+0000","last_unstale":"2023-07-14T15:56:10.490060+0000","last_undegraded":"2023-07-14T15:56:10.490060+0000","last_fullsized":"2023-07-14T15:56:10.490060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:23:33.554098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489929+0000","last_change":"2023-07-14T15:56:08.985138+0000","last_active":"2023-07-14T15:56:10.489929+0000","last_peered":"2023-07-14T15:56:10.489929+0000","last_clean":"2023-07-14T15:56:10.489929+0000","last_became_active":"2023-07-14T15:56:08.984870+0000","last_became_peered":"2023-07-14T15:56:08.984870+0000","last_unstale":"2023-07-14T15:56:10.489929+0000","last_undegraded":"2023-07-14T15:56:10.489929+0000","last_fullsized":"2023-07-14T15:56:10.489929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:09:13.220323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489967+0000","last_change":"2023-07-14T15:56:08.977755+0000","last_active":"2023-07-14T15:56:10.489967+0000","last_peered":"2023-07-14T15:56:10.489967+0000","last_clean":"2023-07-14T15:56:10.489967+0000","last_became_active":"2023-07-14T15:56:08.977492+0000","last_became_peered":"2023-07-14T15:56:08.977492+0000","last_unstale":"2023-07-14T15:56:10.489967+0000","last_undegraded":"2023-07-14T15:56:10.489967+0000","last_fullsized":"2023-07-14T15:56:10.489967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:09:43.406898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.317997+0000","last_change":"2023-07-14T15:56:08.963406+0000","last_active":"2023-07-14T15:56:10.317997+0000","last_peered":"2023-07-14T15:56:10.317997+0000","last_clean":"2023-07-14T15:56:10.317997+0000","last_became_active":"2023-07-14T15:56:08.961612+0000","last_became_peered":"2023-07-14T15:56:08.961612+0000","last_unstale":"2023-07-14T15:56:10.317997+0000","last_undegraded":"2023-07-14T15:56:10.317997+0000","last_fullsized":"2023-07-14T15:56:10.317997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:09:13.220323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489843+0000","last_change":"2023-07-14T15:56:08.985164+0000","last_active":"2023-07-14T15:56:10.489843+0000","last_peered":"2023-07-14T15:56:10.489843+0000","last_clean":"2023-07-14T15:56:10.489843+0000","last_became_active":"2023-07-14T15:56:08.984883+0000","last_became_peered":"2023-07-14T15:56:08.984883+0000","last_unstale":"2023-07-14T15:56:10.489843+0000","last_undegraded":"2023-07-14T15:56:10.489843+0000","last_fullsized":"2023-07-14T15:56:10.489843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:36:15.019527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.318240+0000","last_change":"2023-07-14T15:56:08.970245+0000","last_active":"2023-07-14T15:56:10.318240+0000","last_peered":"2023-07-14T15:56:10.318240+0000","last_clean":"2023-07-14T15:56:10.318240+0000","last_became_active":"2023-07-14T15:56:08.969945+0000","last_became_peered":"2023-07-14T15:56:08.969945+0000","last_unstale":"2023-07-14T15:56:10.318240+0000","last_undegraded":"2023-07-14T15:56:10.318240+0000","last_fullsized":"2023-07-14T15:56:10.318240+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:11:26.760684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489912+0000","last_change":"2023-07-14T15:56:08.986579+0000","last_active":"2023-07-14T15:56:10.489912+0000","last_peered":"2023-07-14T15:56:10.489912+0000","last_clean":"2023-07-14T15:56:10.489912+0000","last_became_active":"2023-07-14T15:56:08.986128+0000","last_became_peered":"2023-07-14T15:56:08.986128+0000","last_unstale":"2023-07-14T15:56:10.489912+0000","last_undegraded":"2023-07-14T15:56:10.489912+0000","last_fullsized":"2023-07-14T15:56:10.489912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:10:08.144011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969597+0000","last_change":"2023-07-14T15:56:08.971097+0000","last_active":"2023-07-14T15:56:09.969597+0000","last_peered":"2023-07-14T15:56:09.969597+0000","last_clean":"2023-07-14T15:56:09.969597+0000","last_became_active":"2023-07-14T15:56:08.970763+0000","last_became_peered":"2023-07-14T15:56:08.970763+0000","last_unstale":"2023-07-14T15:56:09.969597+0000","last_undegraded":"2023-07-14T15:56:09.969597+0000","last_fullsized":"2023-07-14T15:56:09.969597+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:16:10.020252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"24'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489692+0000","last_change":"2023-07-14T15:56:07.968145+0000","last_active":"2023-07-14T15:56:10.489692+0000","last_peered":"2023-07-14T15:56:10.489692+0000","last_clean":"2023-07-14T15:56:10.489692+0000","last_became_active":"2023-07-14T15:56:07.967843+0000","last_became_peered":"2023-07-14T15:56:07.967843+0000","last_unstale":"2023-07-14T15:56:10.489692+0000","last_undegraded":"2023-07-14T15:56:10.489692+0000","last_fullsized":"2023-07-14T15:56:10.489692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:24:32.242091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489357+0000","last_change":"2023-07-14T15:56:08.985388+0000","last_active":"2023-07-14T15:56:10.489357+0000","last_peered":"2023-07-14T15:56:10.489357+0000","last_clean":"2023-07-14T15:56:10.489357+0000","last_became_active":"2023-07-14T15:56:08.985075+0000","last_became_peered":"2023-07-14T15:56:08.985075+0000","last_unstale":"2023-07-14T15:56:10.489357+0000","last_undegraded":"2023-07-14T15:56:10.489357+0000","last_fullsized":"2023-07-14T15:56:10.489357+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:53:14.967321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.317657+0000","last_change":"2023-07-14T15:56:07.965016+0000","last_active":"2023-07-14T15:56:10.317657+0000","last_peered":"2023-07-14T15:56:10.317657+0000","last_clean":"2023-07-14T15:56:10.317657+0000","last_became_active":"2023-07-14T15:56:07.964727+0000","last_became_peered":"2023-07-14T15:56:07.964727+0000","last_unstale":"2023-07-14T15:56:10.317657+0000","last_undegraded":"2023-07-14T15:56:10.317657+0000","last_fullsized":"2023-07-14T15:56:10.317657+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:24:32.242091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.318283+0000","last_change":"2023-07-14T15:56:08.962222+0000","last_active":"2023-07-14T15:56:10.318283+0000","last_peered":"2023-07-14T15:56:10.318283+0000","last_clean":"2023-07-14T15:56:10.318283+0000","last_became_active":"2023-07-14T15:56:08.960614+0000","last_became_peered":"2023-07-14T15:56:08.960614+0000","last_unstale":"2023-07-14T15:56:10.318283+0000","last_undegraded":"2023-07-14T15:56:10.318283+0000","last_fullsized":"2023-07-14T15:56:10.318283+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:47:05.132046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968718+0000","last_change":"2023-07-14T15:56:07.963140+0000","last_active":"2023-07-14T15:56:09.968718+0000","last_peered":"2023-07-14T15:56:09.968718+0000","last_clean":"2023-07-14T15:56:09.968718+0000","last_became_active":"2023-07-14T15:56:07.962450+0000","last_became_peered":"2023-07-14T15:56:07.962450+0000","last_unstale":"2023-07-14T15:56:09.968718+0000","last_undegraded":"2023-07-14T15:56:09.968718+0000","last_fullsized":"2023-07-14T15:56:09.968718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:16:19.549915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.970237+0000","last_change":"2023-07-14T15:56:08.982827+0000","last_active":"2023-07-14T15:56:09.970237+0000","last_peered":"2023-07-14T15:56:09.970237+0000","last_clean":"2023-07-14T15:56:09.970237+0000","last_became_active":"2023-07-14T15:56:08.982548+0000","last_became_peered":"2023-07-14T15:56:08.982548+0000","last_unstale":"2023-07-14T15:56:09.970237+0000","last_undegraded":"2023-07-14T15:56:09.970237+0000","last_fullsized":"2023-07-14T15:56:09.970237+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:11:32.675035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969543+0000","last_change":"2023-07-14T15:56:07.974534+0000","last_active":"2023-07-14T15:56:09.969543+0000","last_peered":"2023-07-14T15:56:09.969543+0000","last_clean":"2023-07-14T15:56:09.969543+0000","last_became_active":"2023-07-14T15:56:07.974303+0000","last_became_peered":"2023-07-14T15:56:07.974303+0000","last_unstale":"2023-07-14T15:56:09.969543+0000","last_undegraded":"2023-07-14T15:56:09.969543+0000","last_fullsized":"2023-07-14T15:56:09.969543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:12:08.491508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489120+0000","last_change":"2023-07-14T15:56:08.972999+0000","last_active":"2023-07-14T15:56:10.489120+0000","last_peered":"2023-07-14T15:56:10.489120+0000","last_clean":"2023-07-14T15:56:10.489120+0000","last_became_active":"2023-07-14T15:56:08.972737+0000","last_became_peered":"2023-07-14T15:56:08.972737+0000","last_unstale":"2023-07-14T15:56:10.489120+0000","last_undegraded":"2023-07-14T15:56:10.489120+0000","last_fullsized":"2023-07-14T15:56:10.489120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:31:46.923553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.490157+0000","last_change":"2023-07-14T15:56:07.970831+0000","last_active":"2023-07-14T15:56:10.490157+0000","last_peered":"2023-07-14T15:56:10.490157+0000","last_clean":"2023-07-14T15:56:10.490157+0000","last_became_active":"2023-07-14T15:56:07.970450+0000","last_became_peered":"2023-07-14T15:56:07.970450+0000","last_unstale":"2023-07-14T15:56:10.490157+0000","last_undegraded":"2023-07-14T15:56:10.490157+0000","last_fullsized":"2023-07-14T15:56:10.490157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:20:57.146500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.317671+0000","last_change":"2023-07-14T15:56:08.969440+0000","last_active":"2023-07-14T15:56:10.317671+0000","last_peered":"2023-07-14T15:56:10.317671+0000","last_clean":"2023-07-14T15:56:10.317671+0000","last_became_active":"2023-07-14T15:56:08.966859+0000","last_became_peered":"2023-07-14T15:56:08.966859+0000","last_unstale":"2023-07-14T15:56:10.317671+0000","last_undegraded":"2023-07-14T15:56:10.317671+0000","last_fullsized":"2023-07-14T15:56:10.317671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:22:06.842480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"24'3","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968598+0000","last_change":"2023-07-14T15:56:07.964545+0000","last_active":"2023-07-14T15:56:09.968598+0000","last_peered":"2023-07-14T15:56:09.968598+0000","last_clean":"2023-07-14T15:56:09.968598+0000","last_became_active":"2023-07-14T15:56:07.963768+0000","last_became_peered":"2023-07-14T15:56:07.963768+0000","last_unstale":"2023-07-14T15:56:09.968598+0000","last_undegraded":"2023-07-14T15:56:09.968598+0000","last_fullsized":"2023-07-14T15:56:09.968598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:47:20.344379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.318158+0000","last_change":"2023-07-14T15:56:08.970241+0000","last_active":"2023-07-14T15:56:10.318158+0000","last_peered":"2023-07-14T15:56:10.318158+0000","last_clean":"2023-07-14T15:56:10.318158+0000","last_became_active":"2023-07-14T15:56:08.969947+0000","last_became_peered":"2023-07-14T15:56:08.969947+0000","last_unstale":"2023-07-14T15:56:10.318158+0000","last_undegraded":"2023-07-14T15:56:10.318158+0000","last_fullsized":"2023-07-14T15:56:10.318158+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:10:40.403063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"24'6","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969540+0000","last_change":"2023-07-14T15:56:07.970523+0000","last_active":"2023-07-14T15:56:09.969540+0000","last_peered":"2023-07-14T15:56:09.969540+0000","last_clean":"2023-07-14T15:56:09.969540+0000","last_became_active":"2023-07-14T15:56:07.970142+0000","last_became_peered":"2023-07-14T15:56:07.970142+0000","last_unstale":"2023-07-14T15:56:09.969540+0000","last_undegraded":"2023-07-14T15:56:09.969540+0000","last_fullsized":"2023-07-14T15:56:09.969540+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:47:08.966111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489691+0000","last_change":"2023-07-14T15:56:08.969130+0000","last_active":"2023-07-14T15:56:10.489691+0000","last_peered":"2023-07-14T15:56:10.489691+0000","last_clean":"2023-07-14T15:56:10.489691+0000","last_became_active":"2023-07-14T15:56:08.968814+0000","last_became_peered":"2023-07-14T15:56:08.968814+0000","last_unstale":"2023-07-14T15:56:10.489691+0000","last_undegraded":"2023-07-14T15:56:10.489691+0000","last_fullsized":"2023-07-14T15:56:10.489691+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:28:16.724128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969426+0000","last_change":"2023-07-14T15:56:07.970235+0000","last_active":"2023-07-14T15:56:09.969426+0000","last_peered":"2023-07-14T15:56:09.969426+0000","last_clean":"2023-07-14T15:56:09.969426+0000","last_became_active":"2023-07-14T15:56:07.969938+0000","last_became_peered":"2023-07-14T15:56:07.969938+0000","last_unstale":"2023-07-14T15:56:09.969426+0000","last_undegraded":"2023-07-14T15:56:09.969426+0000","last_fullsized":"2023-07-14T15:56:09.969426+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:03:38.271024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489380+0000","last_change":"2023-07-14T15:56:08.980388+0000","last_active":"2023-07-14T15:56:10.489380+0000","last_peered":"2023-07-14T15:56:10.489380+0000","last_clean":"2023-07-14T15:56:10.489380+0000","last_became_active":"2023-07-14T15:56:08.980080+0000","last_became_peered":"2023-07-14T15:56:08.980080+0000","last_unstale":"2023-07-14T15:56:10.489380+0000","last_undegraded":"2023-07-14T15:56:10.489380+0000","last_fullsized":"2023-07-14T15:56:10.489380+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:20:12.345478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489365+0000","last_change":"2023-07-14T15:56:07.975515+0000","last_active":"2023-07-14T15:56:10.489365+0000","last_peered":"2023-07-14T15:56:10.489365+0000","last_clean":"2023-07-14T15:56:10.489365+0000","last_became_active":"2023-07-14T15:56:07.975155+0000","last_became_peered":"2023-07-14T15:56:07.975155+0000","last_unstale":"2023-07-14T15:56:10.489365+0000","last_undegraded":"2023-07-14T15:56:10.489365+0000","last_fullsized":"2023-07-14T15:56:10.489365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:33:36.247286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.970018+0000","last_change":"2023-07-14T15:56:08.970329+0000","last_active":"2023-07-14T15:56:09.970018+0000","last_peered":"2023-07-14T15:56:09.970018+0000","last_clean":"2023-07-14T15:56:09.970018+0000","last_became_active":"2023-07-14T15:56:08.970021+0000","last_became_peered":"2023-07-14T15:56:08.970021+0000","last_unstale":"2023-07-14T15:56:09.970018+0000","last_undegraded":"2023-07-14T15:56:09.970018+0000","last_fullsized":"2023-07-14T15:56:09.970018+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:59:48.587072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968889+0000","last_change":"2023-07-14T15:56:07.970580+0000","last_active":"2023-07-14T15:56:09.968889+0000","last_peered":"2023-07-14T15:56:09.968889+0000","last_clean":"2023-07-14T15:56:09.968889+0000","last_became_active":"2023-07-14T15:56:07.970015+0000","last_became_peered":"2023-07-14T15:56:07.970015+0000","last_unstale":"2023-07-14T15:56:09.968889+0000","last_undegraded":"2023-07-14T15:56:09.968889+0000","last_fullsized":"2023-07-14T15:56:09.968889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:14:44.479408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969220+0000","last_change":"2023-07-14T15:56:08.980174+0000","last_active":"2023-07-14T15:56:09.969220+0000","last_peered":"2023-07-14T15:56:09.969220+0000","last_clean":"2023-07-14T15:56:09.969220+0000","last_became_active":"2023-07-14T15:56:08.979596+0000","last_became_peered":"2023-07-14T15:56:08.979596+0000","last_unstale":"2023-07-14T15:56:09.969220+0000","last_undegraded":"2023-07-14T15:56:09.969220+0000","last_fullsized":"2023-07-14T15:56:09.969220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:15:28.458174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"24'8","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489443+0000","last_change":"2023-07-14T15:56:07.968155+0000","last_active":"2023-07-14T15:56:10.489443+0000","last_peered":"2023-07-14T15:56:10.489443+0000","last_clean":"2023-07-14T15:56:10.489443+0000","last_became_active":"2023-07-14T15:56:07.967859+0000","last_became_peered":"2023-07-14T15:56:07.967859+0000","last_unstale":"2023-07-14T15:56:10.489443+0000","last_undegraded":"2023-07-14T15:56:10.489443+0000","last_fullsized":"2023-07-14T15:56:10.489443+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:15:27.451548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969509+0000","last_change":"2023-07-14T15:56:08.977704+0000","last_active":"2023-07-14T15:56:09.969509+0000","last_peered":"2023-07-14T15:56:09.969509+0000","last_clean":"2023-07-14T15:56:09.969509+0000","last_became_active":"2023-07-14T15:56:08.977428+0000","last_became_peered":"2023-07-14T15:56:08.977428+0000","last_unstale":"2023-07-14T15:56:09.969509+0000","last_undegraded":"2023-07-14T15:56:09.969509+0000","last_fullsized":"2023-07-14T15:56:09.969509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:32:30.477405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"24'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969149+0000","last_change":"2023-07-14T15:56:07.967243+0000","last_active":"2023-07-14T15:56:09.969149+0000","last_peered":"2023-07-14T15:56:09.969149+0000","last_clean":"2023-07-14T15:56:09.969149+0000","last_became_active":"2023-07-14T15:56:07.966979+0000","last_became_peered":"2023-07-14T15:56:07.966979+0000","last_unstale":"2023-07-14T15:56:09.969149+0000","last_undegraded":"2023-07-14T15:56:09.969149+0000","last_fullsized":"2023-07-14T15:56:09.969149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:01:03.734490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969353+0000","last_change":"2023-07-14T15:56:08.972023+0000","last_active":"2023-07-14T15:56:09.969353+0000","last_peered":"2023-07-14T15:56:09.969353+0000","last_clean":"2023-07-14T15:56:09.969353+0000","last_became_active":"2023-07-14T15:56:08.971728+0000","last_became_peered":"2023-07-14T15:56:08.971728+0000","last_unstale":"2023-07-14T15:56:09.969353+0000","last_undegraded":"2023-07-14T15:56:09.969353+0000","last_fullsized":"2023-07-14T15:56:09.969353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:28:39.134928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.490181+0000","last_change":"2023-07-14T15:56:07.968894+0000","last_active":"2023-07-14T15:56:10.490181+0000","last_peered":"2023-07-14T15:56:10.490181+0000","last_clean":"2023-07-14T15:56:10.490181+0000","last_became_active":"2023-07-14T15:56:07.968577+0000","last_became_peered":"2023-07-14T15:56:07.968577+0000","last_unstale":"2023-07-14T15:56:10.490181+0000","last_undegraded":"2023-07-14T15:56:10.490181+0000","last_fullsized":"2023-07-14T15:56:10.490181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:45:38.253764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489497+0000","last_change":"2023-07-14T15:56:08.985023+0000","last_active":"2023-07-14T15:56:10.489497+0000","last_peered":"2023-07-14T15:56:10.489497+0000","last_clean":"2023-07-14T15:56:10.489497+0000","last_became_active":"2023-07-14T15:56:08.984743+0000","last_became_peered":"2023-07-14T15:56:08.984743+0000","last_unstale":"2023-07-14T15:56:10.489497+0000","last_undegraded":"2023-07-14T15:56:10.489497+0000","last_fullsized":"2023-07-14T15:56:10.489497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:52:49.596576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"24'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969616+0000","last_change":"2023-07-14T15:56:07.975480+0000","last_active":"2023-07-14T15:56:09.969616+0000","last_peered":"2023-07-14T15:56:09.969616+0000","last_clean":"2023-07-14T15:56:09.969616+0000","last_became_active":"2023-07-14T15:56:07.975128+0000","last_became_peered":"2023-07-14T15:56:07.975128+0000","last_unstale":"2023-07-14T15:56:09.969616+0000","last_undegraded":"2023-07-14T15:56:09.969616+0000","last_fullsized":"2023-07-14T15:56:09.969616+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:35:54.302044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489485+0000","last_change":"2023-07-14T15:56:08.971193+0000","last_active":"2023-07-14T15:56:10.489485+0000","last_peered":"2023-07-14T15:56:10.489485+0000","last_clean":"2023-07-14T15:56:10.489485+0000","last_became_active":"2023-07-14T15:56:08.970747+0000","last_became_peered":"2023-07-14T15:56:08.970747+0000","last_unstale":"2023-07-14T15:56:10.489485+0000","last_undegraded":"2023-07-14T15:56:10.489485+0000","last_fullsized":"2023-07-14T15:56:10.489485+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:47:21.351005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968901+0000","last_change":"2023-07-14T15:56:07.973033+0000","last_active":"2023-07-14T15:56:09.968901+0000","last_peered":"2023-07-14T15:56:09.968901+0000","last_clean":"2023-07-14T15:56:09.968901+0000","last_became_active":"2023-07-14T15:56:07.972707+0000","last_became_peered":"2023-07-14T15:56:07.972707+0000","last_unstale":"2023-07-14T15:56:09.968901+0000","last_undegraded":"2023-07-14T15:56:09.968901+0000","last_fullsized":"2023-07-14T15:56:09.968901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:30:23.173622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969628+0000","last_change":"2023-07-14T15:56:08.983804+0000","last_active":"2023-07-14T15:56:09.969628+0000","last_peered":"2023-07-14T15:56:09.969628+0000","last_clean":"2023-07-14T15:56:09.969628+0000","last_became_active":"2023-07-14T15:56:08.983565+0000","last_became_peered":"2023-07-14T15:56:08.983565+0000","last_unstale":"2023-07-14T15:56:09.969628+0000","last_undegraded":"2023-07-14T15:56:09.969628+0000","last_fullsized":"2023-07-14T15:56:09.969628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:23:33.554098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.b","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489252+0000","last_change":"2023-07-14T15:56:07.973408+0000","last_active":"2023-07-14T15:56:10.489252+0000","last_peered":"2023-07-14T15:56:10.489252+0000","last_clean":"2023-07-14T15:56:10.489252+0000","last_became_active":"2023-07-14T15:56:07.973090+0000","last_became_peered":"2023-07-14T15:56:07.973090+0000","last_unstale":"2023-07-14T15:56:10.489252+0000","last_undegraded":"2023-07-14T15:56:10.489252+0000","last_fullsized":"2023-07-14T15:56:10.489252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:10:08.601895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968784+0000","last_change":"2023-07-14T15:56:08.963200+0000","last_active":"2023-07-14T15:56:09.968784+0000","last_peered":"2023-07-14T15:56:09.968784+0000","last_clean":"2023-07-14T15:56:09.968784+0000","last_became_active":"2023-07-14T15:56:08.962998+0000","last_became_peered":"2023-07-14T15:56:08.962998+0000","last_unstale":"2023-07-14T15:56:09.968784+0000","last_undegraded":"2023-07-14T15:56:09.968784+0000","last_fullsized":"2023-07-14T15:56:09.968784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:38:45.760463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969028+0000","last_change":"2023-07-14T15:56:07.976310+0000","last_active":"2023-07-14T15:56:09.969028+0000","last_peered":"2023-07-14T15:56:09.969028+0000","last_clean":"2023-07-14T15:56:09.969028+0000","last_became_active":"2023-07-14T15:56:07.975997+0000","last_became_peered":"2023-07-14T15:56:07.975997+0000","last_unstale":"2023-07-14T15:56:09.969028+0000","last_undegraded":"2023-07-14T15:56:09.969028+0000","last_fullsized":"2023-07-14T15:56:09.969028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:58:04.257883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969893+0000","last_change":"2023-07-14T15:56:08.975038+0000","last_active":"2023-07-14T15:56:09.969893+0000","last_peered":"2023-07-14T15:56:09.969893+0000","last_clean":"2023-07-14T15:56:09.969893+0000","last_became_active":"2023-07-14T15:56:08.974739+0000","last_became_peered":"2023-07-14T15:56:08.974739+0000","last_unstale":"2023-07-14T15:56:09.969893+0000","last_undegraded":"2023-07-14T15:56:09.969893+0000","last_fullsized":"2023-07-14T15:56:09.969893+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:11:18.956807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968825+0000","last_change":"2023-07-14T15:56:07.969636+0000","last_active":"2023-07-14T15:56:09.968825+0000","last_peered":"2023-07-14T15:56:09.968825+0000","last_clean":"2023-07-14T15:56:09.968825+0000","last_became_active":"2023-07-14T15:56:07.969277+0000","last_became_peered":"2023-07-14T15:56:07.969277+0000","last_unstale":"2023-07-14T15:56:09.968825+0000","last_undegraded":"2023-07-14T15:56:09.968825+0000","last_fullsized":"2023-07-14T15:56:09.968825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:16:33.190367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.490104+0000","last_change":"2023-07-14T15:56:08.961767+0000","last_active":"2023-07-14T15:56:10.490104+0000","last_peered":"2023-07-14T15:56:10.490104+0000","last_clean":"2023-07-14T15:56:10.490104+0000","last_became_active":"2023-07-14T15:56:08.961258+0000","last_became_peered":"2023-07-14T15:56:08.961258+0000","last_unstale":"2023-07-14T15:56:10.490104+0000","last_undegraded":"2023-07-14T15:56:10.490104+0000","last_fullsized":"2023-07-14T15:56:10.490104+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:12:21.171093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.317923+0000","last_change":"2023-07-14T15:56:07.971828+0000","last_active":"2023-07-14T15:56:10.317923+0000","last_peered":"2023-07-14T15:56:10.317923+0000","last_clean":"2023-07-14T15:56:10.317923+0000","last_became_active":"2023-07-14T15:56:07.971500+0000","last_became_peered":"2023-07-14T15:56:07.971500+0000","last_unstale":"2023-07-14T15:56:10.317923+0000","last_undegraded":"2023-07-14T15:56:10.317923+0000","last_fullsized":"2023-07-14T15:56:10.317923+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:54:18.286729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489687+0000","last_change":"2023-07-14T15:56:08.978423+0000","last_active":"2023-07-14T15:56:10.489687+0000","last_peered":"2023-07-14T15:56:10.489687+0000","last_clean":"2023-07-14T15:56:10.489687+0000","last_became_active":"2023-07-14T15:56:08.978126+0000","last_became_peered":"2023-07-14T15:56:08.978126+0000","last_unstale":"2023-07-14T15:56:10.489687+0000","last_undegraded":"2023-07-14T15:56:10.489687+0000","last_fullsized":"2023-07-14T15:56:10.489687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:29:32.279704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969494+0000","last_change":"2023-07-14T15:56:02.621850+0000","last_active":"2023-07-14T15:56:09.969494+0000","last_peered":"2023-07-14T15:56:09.969494+0000","last_clean":"2023-07-14T15:56:09.969494+0000","last_became_active":"2023-07-14T15:56:02.621471+0000","last_became_peered":"2023-07-14T15:56:02.621471+0000","last_unstale":"2023-07-14T15:56:09.969494+0000","last_undegraded":"2023-07-14T15:56:09.969494+0000","last_fullsized":"2023-07-14T15:56:09.969494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:54:12.263158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.490008+0000","last_change":"2023-07-14T15:56:07.965851+0000","last_active":"2023-07-14T15:56:10.490008+0000","last_peered":"2023-07-14T15:56:10.490008+0000","last_clean":"2023-07-14T15:56:10.490008+0000","last_became_active":"2023-07-14T15:56:07.965312+0000","last_became_peered":"2023-07-14T15:56:07.965312+0000","last_unstale":"2023-07-14T15:56:10.490008+0000","last_undegraded":"2023-07-14T15:56:10.490008+0000","last_fullsized":"2023-07-14T15:56:10.490008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:01:03.734490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.488879+0000","last_change":"2023-07-14T15:56:08.974753+0000","last_active":"2023-07-14T15:56:10.488879+0000","last_peered":"2023-07-14T15:56:10.488879+0000","last_clean":"2023-07-14T15:56:10.488879+0000","last_became_active":"2023-07-14T15:56:08.974482+0000","last_became_peered":"2023-07-14T15:56:08.974482+0000","last_unstale":"2023-07-14T15:56:10.488879+0000","last_undegraded":"2023-07-14T15:56:10.488879+0000","last_fullsized":"2023-07-14T15:56:10.488879+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:22:21.802038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969169+0000","last_change":"2023-07-14T15:56:02.621963+0000","last_active":"2023-07-14T15:56:09.969169+0000","last_peered":"2023-07-14T15:56:09.969169+0000","last_clean":"2023-07-14T15:56:09.969169+0000","last_became_active":"2023-07-14T15:56:02.621678+0000","last_became_peered":"2023-07-14T15:56:02.621678+0000","last_unstale":"2023-07-14T15:56:09.969169+0000","last_undegraded":"2023-07-14T15:56:09.969169+0000","last_fullsized":"2023-07-14T15:56:09.969169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:42:28.210730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968484+0000","last_change":"2023-07-14T15:56:07.970834+0000","last_active":"2023-07-14T15:56:09.968484+0000","last_peered":"2023-07-14T15:56:09.968484+0000","last_clean":"2023-07-14T15:56:09.968484+0000","last_became_active":"2023-07-14T15:56:07.970464+0000","last_became_peered":"2023-07-14T15:56:07.970464+0000","last_unstale":"2023-07-14T15:56:09.968484+0000","last_undegraded":"2023-07-14T15:56:09.968484+0000","last_fullsized":"2023-07-14T15:56:09.968484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:00:38.398401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489620+0000","last_change":"2023-07-14T15:56:08.974479+0000","last_active":"2023-07-14T15:56:10.489620+0000","last_peered":"2023-07-14T15:56:10.489620+0000","last_clean":"2023-07-14T15:56:10.489620+0000","last_became_active":"2023-07-14T15:56:08.974197+0000","last_became_peered":"2023-07-14T15:56:08.974197+0000","last_unstale":"2023-07-14T15:56:10.489620+0000","last_undegraded":"2023-07-14T15:56:10.489620+0000","last_fullsized":"2023-07-14T15:56:10.489620+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:10:08.144011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489381+0000","last_change":"2023-07-14T15:56:01.925110+0000","last_active":"2023-07-14T15:56:10.489381+0000","last_peered":"2023-07-14T15:56:10.489381+0000","last_clean":"2023-07-14T15:56:10.489381+0000","last_became_active":"2023-07-14T15:56:01.924723+0000","last_became_peered":"2023-07-14T15:56:01.924723+0000","last_unstale":"2023-07-14T15:56:10.489381+0000","last_undegraded":"2023-07-14T15:56:10.489381+0000","last_fullsized":"2023-07-14T15:56:10.489381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:33:30.223715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968791+0000","last_change":"2023-07-14T15:56:07.971753+0000","last_active":"2023-07-14T15:56:09.968791+0000","last_peered":"2023-07-14T15:56:09.968791+0000","last_clean":"2023-07-14T15:56:09.968791+0000","last_became_active":"2023-07-14T15:56:07.971447+0000","last_became_peered":"2023-07-14T15:56:07.971447+0000","last_unstale":"2023-07-14T15:56:09.968791+0000","last_undegraded":"2023-07-14T15:56:09.968791+0000","last_fullsized":"2023-07-14T15:56:09.968791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:14:57.078074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489621+0000","last_change":"2023-07-14T15:56:08.981489+0000","last_active":"2023-07-14T15:56:10.489621+0000","last_peered":"2023-07-14T15:56:10.489621+0000","last_clean":"2023-07-14T15:56:10.489621+0000","last_became_active":"2023-07-14T15:56:08.981064+0000","last_became_peered":"2023-07-14T15:56:08.981064+0000","last_unstale":"2023-07-14T15:56:10.489621+0000","last_undegraded":"2023-07-14T15:56:10.489621+0000","last_fullsized":"2023-07-14T15:56:10.489621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:09:43.406898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968541+0000","last_change":"2023-07-14T15:56:01.923465+0000","last_active":"2023-07-14T15:56:09.968541+0000","last_peered":"2023-07-14T15:56:09.968541+0000","last_clean":"2023-07-14T15:56:09.968541+0000","last_became_active":"2023-07-14T15:56:01.923160+0000","last_became_peered":"2023-07-14T15:56:01.923160+0000","last_unstale":"2023-07-14T15:56:09.968541+0000","last_undegraded":"2023-07-14T15:56:09.968541+0000","last_fullsized":"2023-07-14T15:56:09.968541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:50:40.374649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":175,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489184+0000","last_change":"2023-07-14T15:55:54.040065+0000","last_active":"2023-07-14T15:56:10.489184+0000","last_peered":"2023-07-14T15:56:10.489184+0000","last_clean":"2023-07-14T15:56:10.489184+0000","last_became_active":"2023-07-14T15:55:54.038885+0000","last_became_peered":"2023-07-14T15:55:54.038885+0000","last_unstale":"2023-07-14T15:56:10.489184+0000","last_undegraded":"2023-07-14T15:56:10.489184+0000","last_fullsized":"2023-07-14T15:56:10.489184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:55:53.025696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:55:53.025696+0000","last_clean_scrub_stamp":"2023-07-14T15:55:53.025696+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:14:43.173657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.317859+0000","last_change":"2023-07-14T15:56:07.970931+0000","last_active":"2023-07-14T15:56:10.317859+0000","last_peered":"2023-07-14T15:56:10.317859+0000","last_clean":"2023-07-14T15:56:10.317859+0000","last_became_active":"2023-07-14T15:56:07.970576+0000","last_became_peered":"2023-07-14T15:56:07.970576+0000","last_unstale":"2023-07-14T15:56:10.317859+0000","last_undegraded":"2023-07-14T15:56:10.317859+0000","last_fullsized":"2023-07-14T15:56:10.317859+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:32:29.470779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969965+0000","last_change":"2023-07-14T15:56:08.972039+0000","last_active":"2023-07-14T15:56:09.969965+0000","last_peered":"2023-07-14T15:56:09.969965+0000","last_clean":"2023-07-14T15:56:09.969965+0000","last_became_active":"2023-07-14T15:56:08.971718+0000","last_became_peered":"2023-07-14T15:56:08.971718+0000","last_unstale":"2023-07-14T15:56:09.969965+0000","last_undegraded":"2023-07-14T15:56:09.969965+0000","last_fullsized":"2023-07-14T15:56:09.969965+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:31:57.408531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968778+0000","last_change":"2023-07-14T15:56:01.920714+0000","last_active":"2023-07-14T15:56:09.968778+0000","last_peered":"2023-07-14T15:56:09.968778+0000","last_clean":"2023-07-14T15:56:09.968778+0000","last_became_active":"2023-07-14T15:56:01.920325+0000","last_became_peered":"2023-07-14T15:56:01.920325+0000","last_unstale":"2023-07-14T15:56:09.968778+0000","last_undegraded":"2023-07-14T15:56:09.968778+0000","last_fullsized":"2023-07-14T15:56:09.968778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:03:08.403097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.488883+0000","last_change":"2023-07-14T15:56:07.970542+0000","last_active":"2023-07-14T15:56:10.488883+0000","last_peered":"2023-07-14T15:56:10.488883+0000","last_clean":"2023-07-14T15:56:10.488883+0000","last_became_active":"2023-07-14T15:56:07.970172+0000","last_became_peered":"2023-07-14T15:56:07.970172+0000","last_unstale":"2023-07-14T15:56:10.488883+0000","last_undegraded":"2023-07-14T15:56:10.488883+0000","last_fullsized":"2023-07-14T15:56:10.488883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:31:45.916927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969443+0000","last_change":"2023-07-14T15:56:08.980388+0000","last_active":"2023-07-14T15:56:09.969443+0000","last_peered":"2023-07-14T15:56:09.969443+0000","last_clean":"2023-07-14T15:56:09.969443+0000","last_became_active":"2023-07-14T15:56:08.979897+0000","last_became_peered":"2023-07-14T15:56:08.979897+0000","last_unstale":"2023-07-14T15:56:09.969443+0000","last_undegraded":"2023-07-14T15:56:09.969443+0000","last_fullsized":"2023-07-14T15:56:09.969443+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:11:49.645623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969752+0000","last_change":"2023-07-14T15:56:01.923631+0000","last_active":"2023-07-14T15:56:09.969752+0000","last_peered":"2023-07-14T15:56:09.969752+0000","last_clean":"2023-07-14T15:56:09.969752+0000","last_became_active":"2023-07-14T15:56:01.922783+0000","last_became_peered":"2023-07-14T15:56:01.922783+0000","last_unstale":"2023-07-14T15:56:09.969752+0000","last_undegraded":"2023-07-14T15:56:09.969752+0000","last_fullsized":"2023-07-14T15:56:09.969752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:27:47.642533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489594+0000","last_change":"2023-07-14T15:56:07.967762+0000","last_active":"2023-07-14T15:56:10.489594+0000","last_peered":"2023-07-14T15:56:10.489594+0000","last_clean":"2023-07-14T15:56:10.489594+0000","last_became_active":"2023-07-14T15:56:07.967471+0000","last_became_peered":"2023-07-14T15:56:07.967471+0000","last_unstale":"2023-07-14T15:56:10.489594+0000","last_undegraded":"2023-07-14T15:56:10.489594+0000","last_fullsized":"2023-07-14T15:56:10.489594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:29:31.273078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489319+0000","last_change":"2023-07-14T15:56:08.976758+0000","last_active":"2023-07-14T15:56:10.489319+0000","last_peered":"2023-07-14T15:56:10.489319+0000","last_clean":"2023-07-14T15:56:10.489319+0000","last_became_active":"2023-07-14T15:56:08.976318+0000","last_became_peered":"2023-07-14T15:56:08.976318+0000","last_unstale":"2023-07-14T15:56:10.489319+0000","last_undegraded":"2023-07-14T15:56:10.489319+0000","last_fullsized":"2023-07-14T15:56:10.489319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:18:49.883894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.318181+0000","last_change":"2023-07-14T15:56:07.967060+0000","last_active":"2023-07-14T15:56:10.318181+0000","last_peered":"2023-07-14T15:56:10.318181+0000","last_clean":"2023-07-14T15:56:10.318181+0000","last_became_active":"2023-07-14T15:56:07.966852+0000","last_became_peered":"2023-07-14T15:56:07.966852+0000","last_unstale":"2023-07-14T15:56:10.318181+0000","last_undegraded":"2023-07-14T15:56:10.318181+0000","last_fullsized":"2023-07-14T15:56:10.318181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:58:00.742453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.318071+0000","last_change":"2023-07-14T15:56:01.965649+0000","last_active":"2023-07-14T15:56:10.318071+0000","last_peered":"2023-07-14T15:56:10.318071+0000","last_clean":"2023-07-14T15:56:10.318071+0000","last_became_active":"2023-07-14T15:56:01.965344+0000","last_became_peered":"2023-07-14T15:56:01.965344+0000","last_unstale":"2023-07-14T15:56:10.318071+0000","last_undegraded":"2023-07-14T15:56:10.318071+0000","last_fullsized":"2023-07-14T15:56:10.318071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:23:26.523901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.317808+0000","last_change":"2023-07-14T15:56:08.961123+0000","last_active":"2023-07-14T15:56:10.317808+0000","last_peered":"2023-07-14T15:56:10.317808+0000","last_clean":"2023-07-14T15:56:10.317808+0000","last_became_active":"2023-07-14T15:56:08.960675+0000","last_became_peered":"2023-07-14T15:56:08.960675+0000","last_unstale":"2023-07-14T15:56:10.317808+0000","last_undegraded":"2023-07-14T15:56:10.317808+0000","last_fullsized":"2023-07-14T15:56:10.317808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:11:49.645623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.970285+0000","last_change":"2023-07-14T15:56:01.966578+0000","last_active":"2023-07-14T15:56:09.970285+0000","last_peered":"2023-07-14T15:56:09.970285+0000","last_clean":"2023-07-14T15:56:09.970285+0000","last_became_active":"2023-07-14T15:56:01.966216+0000","last_became_peered":"2023-07-14T15:56:01.966216+0000","last_unstale":"2023-07-14T15:56:09.970285+0000","last_undegraded":"2023-07-14T15:56:09.970285+0000","last_fullsized":"2023-07-14T15:56:09.970285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:16:28.116727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.318279+0000","last_change":"2023-07-14T15:56:07.970881+0000","last_active":"2023-07-14T15:56:10.318279+0000","last_peered":"2023-07-14T15:56:10.318279+0000","last_clean":"2023-07-14T15:56:10.318279+0000","last_became_active":"2023-07-14T15:56:07.970596+0000","last_became_peered":"2023-07-14T15:56:07.970596+0000","last_unstale":"2023-07-14T15:56:10.318279+0000","last_undegraded":"2023-07-14T15:56:10.318279+0000","last_fullsized":"2023-07-14T15:56:10.318279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:29:12.393151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489389+0000","last_change":"2023-07-14T15:56:08.964323+0000","last_active":"2023-07-14T15:56:10.489389+0000","last_peered":"2023-07-14T15:56:10.489389+0000","last_clean":"2023-07-14T15:56:10.489389+0000","last_became_active":"2023-07-14T15:56:08.964024+0000","last_became_peered":"2023-07-14T15:56:08.964024+0000","last_unstale":"2023-07-14T15:56:10.489389+0000","last_undegraded":"2023-07-14T15:56:10.489389+0000","last_fullsized":"2023-07-14T15:56:10.489389+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:00:39.405027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"24'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.317703+0000","last_change":"2023-07-14T15:56:07.965044+0000","last_active":"2023-07-14T15:56:10.317703+0000","last_peered":"2023-07-14T15:56:10.317703+0000","last_clean":"2023-07-14T15:56:10.317703+0000","last_became_active":"2023-07-14T15:56:07.964585+0000","last_became_peered":"2023-07-14T15:56:07.964585+0000","last_unstale":"2023-07-14T15:56:10.317703+0000","last_undegraded":"2023-07-14T15:56:10.317703+0000","last_fullsized":"2023-07-14T15:56:10.317703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:59:56.654841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.318165+0000","last_change":"2023-07-14T15:56:08.972801+0000","last_active":"2023-07-14T15:56:10.318165+0000","last_peered":"2023-07-14T15:56:10.318165+0000","last_clean":"2023-07-14T15:56:10.318165+0000","last_became_active":"2023-07-14T15:56:08.972481+0000","last_became_peered":"2023-07-14T15:56:08.972481+0000","last_unstale":"2023-07-14T15:56:10.318165+0000","last_undegraded":"2023-07-14T15:56:10.318165+0000","last_fullsized":"2023-07-14T15:56:10.318165+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:35:57.456677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.490013+0000","last_change":"2023-07-14T15:56:07.968681+0000","last_active":"2023-07-14T15:56:10.490013+0000","last_peered":"2023-07-14T15:56:10.490013+0000","last_clean":"2023-07-14T15:56:10.490013+0000","last_became_active":"2023-07-14T15:56:07.968350+0000","last_became_peered":"2023-07-14T15:56:07.968350+0000","last_unstale":"2023-07-14T15:56:10.490013+0000","last_undegraded":"2023-07-14T15:56:10.490013+0000","last_fullsized":"2023-07-14T15:56:10.490013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:12:08.491508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489567+0000","last_change":"2023-07-14T15:56:08.987218+0000","last_active":"2023-07-14T15:56:10.489567+0000","last_peered":"2023-07-14T15:56:10.489567+0000","last_clean":"2023-07-14T15:56:10.489567+0000","last_became_active":"2023-07-14T15:56:08.986928+0000","last_became_peered":"2023-07-14T15:56:08.986928+0000","last_unstale":"2023-07-14T15:56:10.489567+0000","last_undegraded":"2023-07-14T15:56:10.489567+0000","last_fullsized":"2023-07-14T15:56:10.489567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:38:45.760463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969829+0000","last_change":"2023-07-14T15:56:07.971194+0000","last_active":"2023-07-14T15:56:09.969829+0000","last_peered":"2023-07-14T15:56:09.969829+0000","last_clean":"2023-07-14T15:56:09.969829+0000","last_became_active":"2023-07-14T15:56:07.970215+0000","last_became_peered":"2023-07-14T15:56:07.970215+0000","last_unstale":"2023-07-14T15:56:09.969829+0000","last_undegraded":"2023-07-14T15:56:09.969829+0000","last_fullsized":"2023-07-14T15:56:09.969829+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:57:28.541870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489443+0000","last_change":"2023-07-14T15:56:08.976795+0000","last_active":"2023-07-14T15:56:10.489443+0000","last_peered":"2023-07-14T15:56:10.489443+0000","last_clean":"2023-07-14T15:56:10.489443+0000","last_became_active":"2023-07-14T15:56:08.976405+0000","last_became_peered":"2023-07-14T15:56:08.976405+0000","last_unstale":"2023-07-14T15:56:10.489443+0000","last_undegraded":"2023-07-14T15:56:10.489443+0000","last_fullsized":"2023-07-14T15:56:10.489443+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:51:26.834028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"24'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969185+0000","last_change":"2023-07-14T15:56:07.977048+0000","last_active":"2023-07-14T15:56:09.969185+0000","last_peered":"2023-07-14T15:56:09.969185+0000","last_clean":"2023-07-14T15:56:09.969185+0000","last_became_active":"2023-07-14T15:56:07.976771+0000","last_became_peered":"2023-07-14T15:56:07.976771+0000","last_unstale":"2023-07-14T15:56:09.969185+0000","last_undegraded":"2023-07-14T15:56:09.969185+0000","last_fullsized":"2023-07-14T15:56:09.969185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:22:05.835854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489537+0000","last_change":"2023-07-14T15:56:08.976062+0000","last_active":"2023-07-14T15:56:10.489537+0000","last_peered":"2023-07-14T15:56:10.489537+0000","last_clean":"2023-07-14T15:56:10.489537+0000","last_became_active":"2023-07-14T15:56:08.975745+0000","last_became_peered":"2023-07-14T15:56:08.975745+0000","last_unstale":"2023-07-14T15:56:10.489537+0000","last_undegraded":"2023-07-14T15:56:10.489537+0000","last_fullsized":"2023-07-14T15:56:10.489537+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:20:12.345478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"24'4","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969619+0000","last_change":"2023-07-14T15:56:07.974964+0000","last_active":"2023-07-14T15:56:09.969619+0000","last_peered":"2023-07-14T15:56:09.969619+0000","last_clean":"2023-07-14T15:56:09.969619+0000","last_became_active":"2023-07-14T15:56:07.974696+0000","last_became_peered":"2023-07-14T15:56:07.974696+0000","last_unstale":"2023-07-14T15:56:09.969619+0000","last_undegraded":"2023-07-14T15:56:09.969619+0000","last_fullsized":"2023-07-14T15:56:09.969619+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:10:39.396437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489229+0000","last_change":"2023-07-14T15:56:08.962402+0000","last_active":"2023-07-14T15:56:10.489229+0000","last_peered":"2023-07-14T15:56:10.489229+0000","last_clean":"2023-07-14T15:56:10.489229+0000","last_became_active":"2023-07-14T15:56:08.962087+0000","last_became_peered":"2023-07-14T15:56:08.962087+0000","last_unstale":"2023-07-14T15:56:10.489229+0000","last_undegraded":"2023-07-14T15:56:10.489229+0000","last_fullsized":"2023-07-14T15:56:10.489229+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:51:55.348364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489873+0000","last_change":"2023-07-14T15:56:08.962047+0000","last_active":"2023-07-14T15:56:10.489873+0000","last_peered":"2023-07-14T15:56:10.489873+0000","last_clean":"2023-07-14T15:56:10.489873+0000","last_became_active":"2023-07-14T15:56:08.961657+0000","last_became_peered":"2023-07-14T15:56:08.961657+0000","last_unstale":"2023-07-14T15:56:10.489873+0000","last_undegraded":"2023-07-14T15:56:10.489873+0000","last_fullsized":"2023-07-14T15:56:10.489873+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:32:30.477405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.488979+0000","last_change":"2023-07-14T15:56:08.979917+0000","last_active":"2023-07-14T15:56:10.488979+0000","last_peered":"2023-07-14T15:56:10.488979+0000","last_clean":"2023-07-14T15:56:10.488979+0000","last_became_active":"2023-07-14T15:56:08.979617+0000","last_became_peered":"2023-07-14T15:56:08.979617+0000","last_unstale":"2023-07-14T15:56:10.488979+0000","last_undegraded":"2023-07-14T15:56:10.488979+0000","last_fullsized":"2023-07-14T15:56:10.488979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:10:09.608521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968216+0000","last_change":"2023-07-14T15:56:08.971350+0000","last_active":"2023-07-14T15:56:09.968216+0000","last_peered":"2023-07-14T15:56:09.968216+0000","last_clean":"2023-07-14T15:56:09.968216+0000","last_became_active":"2023-07-14T15:56:08.970957+0000","last_became_peered":"2023-07-14T15:56:08.970957+0000","last_unstale":"2023-07-14T15:56:09.968216+0000","last_undegraded":"2023-07-14T15:56:09.968216+0000","last_fullsized":"2023-07-14T15:56:09.968216+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:02:13.093743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969481+0000","last_change":"2023-07-14T15:56:08.968381+0000","last_active":"2023-07-14T15:56:09.969481+0000","last_peered":"2023-07-14T15:56:09.969481+0000","last_clean":"2023-07-14T15:56:09.969481+0000","last_became_active":"2023-07-14T15:56:08.968037+0000","last_became_peered":"2023-07-14T15:56:08.968037+0000","last_unstale":"2023-07-14T15:56:09.969481+0000","last_undegraded":"2023-07-14T15:56:09.969481+0000","last_fullsized":"2023-07-14T15:56:09.969481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:36:15.019527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969340+0000","last_change":"2023-07-14T15:56:08.960651+0000","last_active":"2023-07-14T15:56:09.969340+0000","last_peered":"2023-07-14T15:56:09.969340+0000","last_clean":"2023-07-14T15:56:09.969340+0000","last_became_active":"2023-07-14T15:56:08.960387+0000","last_became_peered":"2023-07-14T15:56:08.960387+0000","last_unstale":"2023-07-14T15:56:09.969340+0000","last_undegraded":"2023-07-14T15:56:09.969340+0000","last_fullsized":"2023-07-14T15:56:09.969340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:59:57.661468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476745,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":96845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]}]},{"osd":0,"up_from":16,"seq":68719476746,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":95323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":258048,"data_stored":95267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":860160,"data_stored":686219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]}]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":96741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]}]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":253952,"data_stored":95177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":851968,"data_stored":686127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]}]},{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":253952,"data_stored":95177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1240000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T15:56:22.324 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T15:56:22.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.568+0000 7ff586dff700 1 Processor -- start 2023-07-14T15:56:22.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.568+0000 7ff586dff700 1 -- start start 2023-07-14T15:56:22.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.570+0000 7ff586dff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff5800b4910 0x7ff5800b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:22.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.570+0000 7ff586dff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5800cf6b0 con 0x7ff5800b54b0 2023-07-14T15:56:22.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.570+0000 7ff586dff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5800b5270 con 0x7ff5800b85f0 2023-07-14T15:56:22.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.570+0000 7ff586dff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5800cdc40 con 0x7ff5800b4910 2023-07-14T15:56:22.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.570+0000 7ff57ffff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff5800b54b0 0x7ff5800cfb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37330/0 (socket says 172.21.15.37:37330) 2023-07-14T15:56:22.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.570+0000 7ff57ffff700 1 -- 172.21.15.37:0/1128000622 learned_addr learned my addr 172.21.15.37:0/1128000622 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:22.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.570+0000 7ff58539c700 1 --2- 172.21.15.37:0/1128000622 >> v2:172.21.15.98:3300/0 conn(0x7ff5800b4910 0x7ff5800b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:22.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.570+0000 7ff57f7fe700 1 -- 172.21.15.37:0/1128000622 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2567253177 0 0) 0x7ff5800cf6b0 con 0x7ff5800b54b0 2023-07-14T15:56:22.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.570+0000 7ff57f7fe700 1 -- 172.21.15.37:0/1128000622 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5700035b0 con 0x7ff5800b54b0 2023-07-14T15:56:22.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.570+0000 7ff58539c700 1 -- 172.21.15.37:0/1128000622 >> v1:172.21.15.98:6789/0 conn(0x7ff5800b85f0 legacy=0x7ff58015d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:22.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.571+0000 7ff58539c700 1 -- 172.21.15.37:0/1128000622 >> v1:172.21.15.37:6789/0 conn(0x7ff5800b54b0 legacy=0x7ff5800cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:22.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.571+0000 7ff58539c700 1 -- 172.21.15.37:0/1128000622 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5800d0250 con 0x7ff5800b4910 2023-07-14T15:56:22.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.571+0000 7ff58539c700 1 --2- 172.21.15.37:0/1128000622 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff5800b4910 0x7ff5800b4d30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff578009d90 tx=0x7ff57800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3ba07348578a7cf server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:22.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.571+0000 7ff57f7fe700 1 -- 172.21.15.37:0/1128000622 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57800e070 con 0x7ff5800b4910 2023-07-14T15:56:22.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.571+0000 7ff57f7fe700 1 -- 172.21.15.37:0/1128000622 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff57800bb20 con 0x7ff5800b4910 2023-07-14T15:56:22.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.571+0000 7ff57f7fe700 1 -- 172.21.15.37:0/1128000622 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff578012430 con 0x7ff5800b4910 2023-07-14T15:56:22.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.572+0000 7ff586dff700 1 -- 172.21.15.37:0/1128000622 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff5800b4910 msgr2=0x7ff5800b4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:22.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.572+0000 7ff586dff700 1 --2- 172.21.15.37:0/1128000622 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff5800b4910 0x7ff5800b4d30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff578009d90 tx=0x7ff57800b330 comp rx=0 tx=0).stop 2023-07-14T15:56:22.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.572+0000 7ff586dff700 1 -- 172.21.15.37:0/1128000622 shutdown_connections 2023-07-14T15:56:22.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.572+0000 7ff586dff700 1 --2- 172.21.15.37:0/1128000622 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff5800b4910 0x7ff5800b4d30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:22.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.572+0000 7ff586dff700 1 -- 172.21.15.37:0/1128000622 >> 172.21.15.37:0/1128000622 conn(0x7ff58006a580 msgr2=0x7ff58006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:22.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.572+0000 7ff586dff700 1 -- 172.21.15.37:0/1128000622 shutdown_connections 2023-07-14T15:56:22.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.572+0000 7ff586dff700 1 -- 172.21.15.37:0/1128000622 wait complete. 2023-07-14T15:56:22.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.573+0000 7ff586dff700 1 Processor -- start 2023-07-14T15:56:22.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.574+0000 7ff586dff700 1 -- start start 2023-07-14T15:56:22.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.574+0000 7ff586dff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff5800b4910 0x7ff5800b4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:22.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.575+0000 7ff586dff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5800b54b0 0x7ff58014c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:22.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.575+0000 7ff586dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff5800b85f0 0x7ff5800b5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:22.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.575+0000 7ff586dff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58014a4a0 con 0x7ff5800b54b0 2023-07-14T15:56:22.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.575+0000 7ff586dff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58014d030 con 0x7ff5800b4910 2023-07-14T15:56:22.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.575+0000 7ff586dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff58014ca70 con 0x7ff5800b85f0 2023-07-14T15:56:22.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.575+0000 7ff57ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5800b54b0 0x7ff58014c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:22.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.575+0000 7ff57ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5800b54b0 0x7ff58014c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33804/0 (socket says 172.21.15.37:33804) 2023-07-14T15:56:22.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.575+0000 7ff57ffff700 1 -- 172.21.15.37:0/334345863 learned_addr learned my addr 172.21.15.37:0/334345863 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:22.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.575+0000 7ff584b9b700 1 --2- 172.21.15.37:0/334345863 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff5800b4910 0x7ff5800b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:22.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.575+0000 7ff58539c700 1 --2- 172.21.15.37:0/334345863 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff5800b85f0 0x7ff5800b5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:22.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.575+0000 7ff57ffff700 1 -- 172.21.15.37:0/334345863 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff5800b85f0 msgr2=0x7ff5800b5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:22.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.575+0000 7ff57ffff700 1 --2- 172.21.15.37:0/334345863 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff5800b85f0 0x7ff5800b5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:22.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.575+0000 7ff57ffff700 1 -- 172.21.15.37:0/334345863 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff5800b4910 msgr2=0x7ff5800b4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:22.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.575+0000 7ff57ffff700 1 --2- 172.21.15.37:0/334345863 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff5800b4910 0x7ff5800b4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:22.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.575+0000 7ff57ffff700 1 -- 172.21.15.37:0/334345863 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff578009a70 con 0x7ff5800b54b0 2023-07-14T15:56:22.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.576+0000 7ff57ffff700 1 --2- 172.21.15.37:0/334345863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5800b54b0 0x7ff58014c120 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff56c00c700 tx=0x7ff56c00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:22.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.576+0000 7ff57d7fa700 1 -- 172.21.15.37:0/334345863 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56c005d70 con 0x7ff5800b54b0 2023-07-14T15:56:22.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.576+0000 7ff57d7fa700 1 -- 172.21.15.37:0/334345863 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56c0070d0 con 0x7ff5800b54b0 2023-07-14T15:56:22.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.576+0000 7ff586dff700 1 -- 172.21.15.37:0/334345863 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff58014cd50 con 0x7ff5800b54b0 2023-07-14T15:56:22.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.576+0000 7ff57d7fa700 1 -- 172.21.15.37:0/334345863 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56c007460 con 0x7ff5800b54b0 2023-07-14T15:56:22.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.576+0000 7ff586dff700 1 -- 172.21.15.37:0/334345863 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5800b4590 con 0x7ff5800b54b0 2023-07-14T15:56:22.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.577+0000 7ff586dff700 1 -- 172.21.15.37:0/334345863 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff580067840 con 0x7ff5800b54b0 2023-07-14T15:56:22.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.578+0000 7ff57d7fa700 1 -- 172.21.15.37:0/334345863 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff56c0075c0 con 0x7ff5800b54b0 2023-07-14T15:56:22.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.579+0000 7ff57d7fa700 1 --2- 172.21.15.37:0/334345863 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff56406ace0 0x7ff56406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:22.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.579+0000 7ff57d7fa700 1 -- 172.21.15.37:0/334345863 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff56c088af0 con 0x7ff5800b54b0 2023-07-14T15:56:22.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.579+0000 7ff584b9b700 1 --2- 172.21.15.37:0/334345863 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff56406ace0 0x7ff56406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:22.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.580+0000 7ff584b9b700 1 --2- 172.21.15.37:0/334345863 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff56406ace0 0x7ff56406d190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff574000f60 tx=0x7ff574009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:22.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.583+0000 7ff57d7fa700 1 -- 172.21.15.37:0/334345863 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff56c053b10 con 0x7ff5800b54b0 2023-07-14T15:56:22.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.789+0000 7ff586dff700 1 -- 172.21.15.37:0/334345863 --> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff5800b4750 con 0x7ff56406ace0 2023-07-14T15:56:22.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.797+0000 7ff57d7fa700 1 -- 172.21.15.37:0/334345863 <== mgr.4100 v2:172.21.15.98:6832/3163748069 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286622 (secure 0 0 0) 0x7ff5740013f0 con 0x7ff56406ace0 2023-07-14T15:56:22.788 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:56:22.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.801+0000 7ff586dff700 1 -- 172.21.15.37:0/334345863 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff56406ace0 msgr2=0x7ff56406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:22.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.801+0000 7ff586dff700 1 --2- 172.21.15.37:0/334345863 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff56406ace0 0x7ff56406d190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff574000f60 tx=0x7ff574009040 comp rx=0 tx=0).stop 2023-07-14T15:56:22.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.801+0000 7ff586dff700 1 -- 172.21.15.37:0/334345863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5800b54b0 msgr2=0x7ff58014c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:22.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.801+0000 7ff586dff700 1 --2- 172.21.15.37:0/334345863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5800b54b0 0x7ff58014c120 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff56c00c700 tx=0x7ff56c00cac0 comp rx=0 tx=0).stop 2023-07-14T15:56:22.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.802+0000 7ff586dff700 1 -- 172.21.15.37:0/334345863 shutdown_connections 2023-07-14T15:56:22.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.802+0000 7ff586dff700 1 --2- 172.21.15.37:0/334345863 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff5800b4910 0x7ff5800b4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:22.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.802+0000 7ff586dff700 1 --2- 172.21.15.37:0/334345863 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff56406ace0 0x7ff56406d190 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:22.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.802+0000 7ff586dff700 1 --2- 172.21.15.37:0/334345863 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff5800b85f0 0x7ff5800b5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:22.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.802+0000 7ff586dff700 1 --2- 172.21.15.37:0/334345863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5800b54b0 0x7ff58014c120 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:22.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.802+0000 7ff586dff700 1 -- 172.21.15.37:0/334345863 >> 172.21.15.37:0/334345863 conn(0x7ff58006a580 msgr2=0x7ff5800b7680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:22.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.802+0000 7ff586dff700 1 -- 172.21.15.37:0/334345863 shutdown_connections 2023-07-14T15:56:22.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:22.802+0000 7ff586dff700 1 -- 172.21.15.37:0/334345863 wait complete. 2023-07-14T15:56:22.792 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-14T15:56:22.807 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2023-07-14T15:56:20.856906+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218824,"kb_used_data":3208,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755896,"statfs":{"total":773094113280,"available":772870037504,"internally_reserved":0,"allocated":3284992,"data_stored":1946876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2250,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.890112"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969224+0000","last_change":"2023-07-14T15:56:08.983100+0000","last_active":"2023-07-14T15:56:09.969224+0000","last_peered":"2023-07-14T15:56:09.969224+0000","last_clean":"2023-07-14T15:56:09.969224+0000","last_became_active":"2023-07-14T15:56:08.982847+0000","last_became_peered":"2023-07-14T15:56:08.982847+0000","last_unstale":"2023-07-14T15:56:09.969224+0000","last_undegraded":"2023-07-14T15:56:09.969224+0000","last_fullsized":"2023-07-14T15:56:09.969224+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:52:49.596576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489972+0000","last_change":"2023-07-14T15:56:08.961552+0000","last_active":"2023-07-14T15:56:10.489972+0000","last_peered":"2023-07-14T15:56:10.489972+0000","last_clean":"2023-07-14T15:56:10.489972+0000","last_became_active":"2023-07-14T15:56:08.960866+0000","last_became_peered":"2023-07-14T15:56:08.960866+0000","last_unstale":"2023-07-14T15:56:10.489972+0000","last_undegraded":"2023-07-14T15:56:10.489972+0000","last_fullsized":"2023-07-14T15:56:10.489972+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:30:24.180248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968575+0000","last_change":"2023-07-14T15:56:08.984210+0000","last_active":"2023-07-14T15:56:09.968575+0000","last_peered":"2023-07-14T15:56:09.968575+0000","last_clean":"2023-07-14T15:56:09.968575+0000","last_became_active":"2023-07-14T15:56:08.983924+0000","last_became_peered":"2023-07-14T15:56:08.983924+0000","last_unstale":"2023-07-14T15:56:09.968575+0000","last_undegraded":"2023-07-14T15:56:09.968575+0000","last_fullsized":"2023-07-14T15:56:09.968575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:51:26.834028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968877+0000","last_change":"2023-07-14T15:56:08.968523+0000","last_active":"2023-07-14T15:56:09.968877+0000","last_peered":"2023-07-14T15:56:09.968877+0000","last_clean":"2023-07-14T15:56:09.968877+0000","last_became_active":"2023-07-14T15:56:08.968214+0000","last_became_peered":"2023-07-14T15:56:08.968214+0000","last_unstale":"2023-07-14T15:56:09.968877+0000","last_undegraded":"2023-07-14T15:56:09.968877+0000","last_fullsized":"2023-07-14T15:56:09.968877+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:28:16.724128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.317844+0000","last_change":"2023-07-14T15:56:08.960575+0000","last_active":"2023-07-14T15:56:10.317844+0000","last_peered":"2023-07-14T15:56:10.317844+0000","last_clean":"2023-07-14T15:56:10.317844+0000","last_became_active":"2023-07-14T15:56:08.959986+0000","last_became_peered":"2023-07-14T15:56:08.959986+0000","last_unstale":"2023-07-14T15:56:10.317844+0000","last_undegraded":"2023-07-14T15:56:10.317844+0000","last_fullsized":"2023-07-14T15:56:10.317844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:36:15.019527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968975+0000","last_change":"2023-07-14T15:56:08.970285+0000","last_active":"2023-07-14T15:56:09.968975+0000","last_peered":"2023-07-14T15:56:09.968975+0000","last_clean":"2023-07-14T15:56:09.968975+0000","last_became_active":"2023-07-14T15:56:08.969969+0000","last_became_peered":"2023-07-14T15:56:08.969969+0000","last_unstale":"2023-07-14T15:56:09.968975+0000","last_undegraded":"2023-07-14T15:56:09.968975+0000","last_fullsized":"2023-07-14T15:56:09.968975+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:04:03.590683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968616+0000","last_change":"2023-07-14T15:56:08.964590+0000","last_active":"2023-07-14T15:56:09.968616+0000","last_peered":"2023-07-14T15:56:09.968616+0000","last_clean":"2023-07-14T15:56:09.968616+0000","last_became_active":"2023-07-14T15:56:08.963896+0000","last_became_peered":"2023-07-14T15:56:08.963896+0000","last_unstale":"2023-07-14T15:56:09.968616+0000","last_undegraded":"2023-07-14T15:56:09.968616+0000","last_fullsized":"2023-07-14T15:56:09.968616+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:31:53.434325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489987+0000","last_change":"2023-07-14T15:56:08.963001+0000","last_active":"2023-07-14T15:56:10.489987+0000","last_peered":"2023-07-14T15:56:10.489987+0000","last_clean":"2023-07-14T15:56:10.489987+0000","last_became_active":"2023-07-14T15:56:08.962689+0000","last_became_peered":"2023-07-14T15:56:08.962689+0000","last_unstale":"2023-07-14T15:56:10.489987+0000","last_undegraded":"2023-07-14T15:56:10.489987+0000","last_fullsized":"2023-07-14T15:56:10.489987+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:54:19.293355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.318103+0000","last_change":"2023-07-14T15:56:08.982014+0000","last_active":"2023-07-14T15:56:10.318103+0000","last_peered":"2023-07-14T15:56:10.318103+0000","last_clean":"2023-07-14T15:56:10.318103+0000","last_became_active":"2023-07-14T15:56:08.981754+0000","last_became_peered":"2023-07-14T15:56:08.981754+0000","last_unstale":"2023-07-14T15:56:10.318103+0000","last_undegraded":"2023-07-14T15:56:10.318103+0000","last_fullsized":"2023-07-14T15:56:10.318103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:12:09.498134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489747+0000","last_change":"2023-07-14T15:56:08.974509+0000","last_active":"2023-07-14T15:56:10.489747+0000","last_peered":"2023-07-14T15:56:10.489747+0000","last_clean":"2023-07-14T15:56:10.489747+0000","last_became_active":"2023-07-14T15:56:08.974197+0000","last_became_peered":"2023-07-14T15:56:08.974197+0000","last_unstale":"2023-07-14T15:56:10.489747+0000","last_undegraded":"2023-07-14T15:56:10.489747+0000","last_fullsized":"2023-07-14T15:56:10.489747+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:59:57.661468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489832+0000","last_change":"2023-07-14T15:56:08.965378+0000","last_active":"2023-07-14T15:56:10.489832+0000","last_peered":"2023-07-14T15:56:10.489832+0000","last_clean":"2023-07-14T15:56:10.489832+0000","last_became_active":"2023-07-14T15:56:08.965029+0000","last_became_peered":"2023-07-14T15:56:08.965029+0000","last_unstale":"2023-07-14T15:56:10.489832+0000","last_undegraded":"2023-07-14T15:56:10.489832+0000","last_fullsized":"2023-07-14T15:56:10.489832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:11:49.645623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969340+0000","last_change":"2023-07-14T15:56:08.979271+0000","last_active":"2023-07-14T15:56:09.969340+0000","last_peered":"2023-07-14T15:56:09.969340+0000","last_clean":"2023-07-14T15:56:09.969340+0000","last_became_active":"2023-07-14T15:56:08.978838+0000","last_became_peered":"2023-07-14T15:56:08.978838+0000","last_unstale":"2023-07-14T15:56:09.969340+0000","last_undegraded":"2023-07-14T15:56:09.969340+0000","last_fullsized":"2023-07-14T15:56:09.969340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:24:33.248717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489209+0000","last_change":"2023-07-14T15:56:08.990555+0000","last_active":"2023-07-14T15:56:10.489209+0000","last_peered":"2023-07-14T15:56:10.489209+0000","last_clean":"2023-07-14T15:56:10.489209+0000","last_became_active":"2023-07-14T15:56:08.990204+0000","last_became_peered":"2023-07-14T15:56:08.990204+0000","last_unstale":"2023-07-14T15:56:10.489209+0000","last_undegraded":"2023-07-14T15:56:10.489209+0000","last_fullsized":"2023-07-14T15:56:10.489209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:53:14.967321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489549+0000","last_change":"2023-07-14T15:56:08.986185+0000","last_active":"2023-07-14T15:56:10.489549+0000","last_peered":"2023-07-14T15:56:10.489549+0000","last_clean":"2023-07-14T15:56:10.489549+0000","last_became_active":"2023-07-14T15:56:08.985934+0000","last_became_peered":"2023-07-14T15:56:08.985934+0000","last_unstale":"2023-07-14T15:56:10.489549+0000","last_undegraded":"2023-07-14T15:56:10.489549+0000","last_fullsized":"2023-07-14T15:56:10.489549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:22:06.842480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968260+0000","last_change":"2023-07-14T15:56:08.962497+0000","last_active":"2023-07-14T15:56:09.968260+0000","last_peered":"2023-07-14T15:56:09.968260+0000","last_clean":"2023-07-14T15:56:09.968260+0000","last_became_active":"2023-07-14T15:56:08.962200+0000","last_became_peered":"2023-07-14T15:56:08.962200+0000","last_unstale":"2023-07-14T15:56:09.968260+0000","last_undegraded":"2023-07-14T15:56:09.968260+0000","last_fullsized":"2023-07-14T15:56:09.968260+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:51:55.348364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968662+0000","last_change":"2023-07-14T15:56:08.967526+0000","last_active":"2023-07-14T15:56:09.968662+0000","last_peered":"2023-07-14T15:56:09.968662+0000","last_clean":"2023-07-14T15:56:09.968662+0000","last_became_active":"2023-07-14T15:56:08.967220+0000","last_became_peered":"2023-07-14T15:56:08.967220+0000","last_unstale":"2023-07-14T15:56:09.968662+0000","last_undegraded":"2023-07-14T15:56:09.968662+0000","last_fullsized":"2023-07-14T15:56:09.968662+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:38:26.539859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489384+0000","last_change":"2023-07-14T15:56:08.973815+0000","last_active":"2023-07-14T15:56:10.489384+0000","last_peered":"2023-07-14T15:56:10.489384+0000","last_clean":"2023-07-14T15:56:10.489384+0000","last_became_active":"2023-07-14T15:56:08.973497+0000","last_became_peered":"2023-07-14T15:56:08.973497+0000","last_unstale":"2023-07-14T15:56:10.489384+0000","last_undegraded":"2023-07-14T15:56:10.489384+0000","last_fullsized":"2023-07-14T15:56:10.489384+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:18:49.883894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969348+0000","last_change":"2023-07-14T15:56:08.967374+0000","last_active":"2023-07-14T15:56:09.969348+0000","last_peered":"2023-07-14T15:56:09.969348+0000","last_clean":"2023-07-14T15:56:09.969348+0000","last_became_active":"2023-07-14T15:56:08.967057+0000","last_became_peered":"2023-07-14T15:56:08.967057+0000","last_unstale":"2023-07-14T15:56:09.969348+0000","last_undegraded":"2023-07-14T15:56:09.969348+0000","last_fullsized":"2023-07-14T15:56:09.969348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:12:21.171093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969523+0000","last_change":"2023-07-14T15:56:08.980915+0000","last_active":"2023-07-14T15:56:09.969523+0000","last_peered":"2023-07-14T15:56:09.969523+0000","last_clean":"2023-07-14T15:56:09.969523+0000","last_became_active":"2023-07-14T15:56:08.971846+0000","last_became_peered":"2023-07-14T15:56:08.971846+0000","last_unstale":"2023-07-14T15:56:09.969523+0000","last_undegraded":"2023-07-14T15:56:09.969523+0000","last_fullsized":"2023-07-14T15:56:09.969523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:09:13.220323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.490060+0000","last_change":"2023-07-14T15:56:08.961701+0000","last_active":"2023-07-14T15:56:10.490060+0000","last_peered":"2023-07-14T15:56:10.490060+0000","last_clean":"2023-07-14T15:56:10.490060+0000","last_became_active":"2023-07-14T15:56:08.961444+0000","last_became_peered":"2023-07-14T15:56:08.961444+0000","last_unstale":"2023-07-14T15:56:10.490060+0000","last_undegraded":"2023-07-14T15:56:10.490060+0000","last_fullsized":"2023-07-14T15:56:10.490060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:23:33.554098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489929+0000","last_change":"2023-07-14T15:56:08.985138+0000","last_active":"2023-07-14T15:56:10.489929+0000","last_peered":"2023-07-14T15:56:10.489929+0000","last_clean":"2023-07-14T15:56:10.489929+0000","last_became_active":"2023-07-14T15:56:08.984870+0000","last_became_peered":"2023-07-14T15:56:08.984870+0000","last_unstale":"2023-07-14T15:56:10.489929+0000","last_undegraded":"2023-07-14T15:56:10.489929+0000","last_fullsized":"2023-07-14T15:56:10.489929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:09:13.220323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489967+0000","last_change":"2023-07-14T15:56:08.977755+0000","last_active":"2023-07-14T15:56:10.489967+0000","last_peered":"2023-07-14T15:56:10.489967+0000","last_clean":"2023-07-14T15:56:10.489967+0000","last_became_active":"2023-07-14T15:56:08.977492+0000","last_became_peered":"2023-07-14T15:56:08.977492+0000","last_unstale":"2023-07-14T15:56:10.489967+0000","last_undegraded":"2023-07-14T15:56:10.489967+0000","last_fullsized":"2023-07-14T15:56:10.489967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:09:43.406898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.317997+0000","last_change":"2023-07-14T15:56:08.963406+0000","last_active":"2023-07-14T15:56:10.317997+0000","last_peered":"2023-07-14T15:56:10.317997+0000","last_clean":"2023-07-14T15:56:10.317997+0000","last_became_active":"2023-07-14T15:56:08.961612+0000","last_became_peered":"2023-07-14T15:56:08.961612+0000","last_unstale":"2023-07-14T15:56:10.317997+0000","last_undegraded":"2023-07-14T15:56:10.317997+0000","last_fullsized":"2023-07-14T15:56:10.317997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:09:13.220323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489843+0000","last_change":"2023-07-14T15:56:08.985164+0000","last_active":"2023-07-14T15:56:10.489843+0000","last_peered":"2023-07-14T15:56:10.489843+0000","last_clean":"2023-07-14T15:56:10.489843+0000","last_became_active":"2023-07-14T15:56:08.984883+0000","last_became_peered":"2023-07-14T15:56:08.984883+0000","last_unstale":"2023-07-14T15:56:10.489843+0000","last_undegraded":"2023-07-14T15:56:10.489843+0000","last_fullsized":"2023-07-14T15:56:10.489843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:36:15.019527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.318240+0000","last_change":"2023-07-14T15:56:08.970245+0000","last_active":"2023-07-14T15:56:10.318240+0000","last_peered":"2023-07-14T15:56:10.318240+0000","last_clean":"2023-07-14T15:56:10.318240+0000","last_became_active":"2023-07-14T15:56:08.969945+0000","last_became_peered":"2023-07-14T15:56:08.969945+0000","last_unstale":"2023-07-14T15:56:10.318240+0000","last_undegraded":"2023-07-14T15:56:10.318240+0000","last_fullsized":"2023-07-14T15:56:10.318240+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:11:26.760684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489912+0000","last_change":"2023-07-14T15:56:08.986579+0000","last_active":"2023-07-14T15:56:10.489912+0000","last_peered":"2023-07-14T15:56:10.489912+0000","last_clean":"2023-07-14T15:56:10.489912+0000","last_became_active":"2023-07-14T15:56:08.986128+0000","last_became_peered":"2023-07-14T15:56:08.986128+0000","last_unstale":"2023-07-14T15:56:10.489912+0000","last_undegraded":"2023-07-14T15:56:10.489912+0000","last_fullsized":"2023-07-14T15:56:10.489912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:10:08.144011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969597+0000","last_change":"2023-07-14T15:56:08.971097+0000","last_active":"2023-07-14T15:56:09.969597+0000","last_peered":"2023-07-14T15:56:09.969597+0000","last_clean":"2023-07-14T15:56:09.969597+0000","last_became_active":"2023-07-14T15:56:08.970763+0000","last_became_peered":"2023-07-14T15:56:08.970763+0000","last_unstale":"2023-07-14T15:56:09.969597+0000","last_undegraded":"2023-07-14T15:56:09.969597+0000","last_fullsized":"2023-07-14T15:56:09.969597+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:16:10.020252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"24'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489692+0000","last_change":"2023-07-14T15:56:07.968145+0000","last_active":"2023-07-14T15:56:10.489692+0000","last_peered":"2023-07-14T15:56:10.489692+0000","last_clean":"2023-07-14T15:56:10.489692+0000","last_became_active":"2023-07-14T15:56:07.967843+0000","last_became_peered":"2023-07-14T15:56:07.967843+0000","last_unstale":"2023-07-14T15:56:10.489692+0000","last_undegraded":"2023-07-14T15:56:10.489692+0000","last_fullsized":"2023-07-14T15:56:10.489692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:24:32.242091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489357+0000","last_change":"2023-07-14T15:56:08.985388+0000","last_active":"2023-07-14T15:56:10.489357+0000","last_peered":"2023-07-14T15:56:10.489357+0000","last_clean":"2023-07-14T15:56:10.489357+0000","last_became_active":"2023-07-14T15:56:08.985075+0000","last_became_peered":"2023-07-14T15:56:08.985075+0000","last_unstale":"2023-07-14T15:56:10.489357+0000","last_undegraded":"2023-07-14T15:56:10.489357+0000","last_fullsized":"2023-07-14T15:56:10.489357+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:53:14.967321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.317657+0000","last_change":"2023-07-14T15:56:07.965016+0000","last_active":"2023-07-14T15:56:10.317657+0000","last_peered":"2023-07-14T15:56:10.317657+0000","last_clean":"2023-07-14T15:56:10.317657+0000","last_became_active":"2023-07-14T15:56:07.964727+0000","last_became_peered":"2023-07-14T15:56:07.964727+0000","last_unstale":"2023-07-14T15:56:10.317657+0000","last_undegraded":"2023-07-14T15:56:10.317657+0000","last_fullsized":"2023-07-14T15:56:10.317657+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:24:32.242091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.318283+0000","last_change":"2023-07-14T15:56:08.962222+0000","last_active":"2023-07-14T15:56:10.318283+0000","last_peered":"2023-07-14T15:56:10.318283+0000","last_clean":"2023-07-14T15:56:10.318283+0000","last_became_active":"2023-07-14T15:56:08.960614+0000","last_became_peered":"2023-07-14T15:56:08.960614+0000","last_unstale":"2023-07-14T15:56:10.318283+0000","last_undegraded":"2023-07-14T15:56:10.318283+0000","last_fullsized":"2023-07-14T15:56:10.318283+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:47:05.132046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968718+0000","last_change":"2023-07-14T15:56:07.963140+0000","last_active":"2023-07-14T15:56:09.968718+0000","last_peered":"2023-07-14T15:56:09.968718+0000","last_clean":"2023-07-14T15:56:09.968718+0000","last_became_active":"2023-07-14T15:56:07.962450+0000","last_became_peered":"2023-07-14T15:56:07.962450+0000","last_unstale":"2023-07-14T15:56:09.968718+0000","last_undegraded":"2023-07-14T15:56:09.968718+0000","last_fullsized":"2023-07-14T15:56:09.968718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:16:19.549915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.970237+0000","last_change":"2023-07-14T15:56:08.982827+0000","last_active":"2023-07-14T15:56:09.970237+0000","last_peered":"2023-07-14T15:56:09.970237+0000","last_clean":"2023-07-14T15:56:09.970237+0000","last_became_active":"2023-07-14T15:56:08.982548+0000","last_became_peered":"2023-07-14T15:56:08.982548+0000","last_unstale":"2023-07-14T15:56:09.970237+0000","last_undegraded":"2023-07-14T15:56:09.970237+0000","last_fullsized":"2023-07-14T15:56:09.970237+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:11:32.675035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969543+0000","last_change":"2023-07-14T15:56:07.974534+0000","last_active":"2023-07-14T15:56:09.969543+0000","last_peered":"2023-07-14T15:56:09.969543+0000","last_clean":"2023-07-14T15:56:09.969543+0000","last_became_active":"2023-07-14T15:56:07.974303+0000","last_became_peered":"2023-07-14T15:56:07.974303+0000","last_unstale":"2023-07-14T15:56:09.969543+0000","last_undegraded":"2023-07-14T15:56:09.969543+0000","last_fullsized":"2023-07-14T15:56:09.969543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:12:08.491508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489120+0000","last_change":"2023-07-14T15:56:08.972999+0000","last_active":"2023-07-14T15:56:10.489120+0000","last_peered":"2023-07-14T15:56:10.489120+0000","last_clean":"2023-07-14T15:56:10.489120+0000","last_became_active":"2023-07-14T15:56:08.972737+0000","last_became_peered":"2023-07-14T15:56:08.972737+0000","last_unstale":"2023-07-14T15:56:10.489120+0000","last_undegraded":"2023-07-14T15:56:10.489120+0000","last_fullsized":"2023-07-14T15:56:10.489120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:31:46.923553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.490157+0000","last_change":"2023-07-14T15:56:07.970831+0000","last_active":"2023-07-14T15:56:10.490157+0000","last_peered":"2023-07-14T15:56:10.490157+0000","last_clean":"2023-07-14T15:56:10.490157+0000","last_became_active":"2023-07-14T15:56:07.970450+0000","last_became_peered":"2023-07-14T15:56:07.970450+0000","last_unstale":"2023-07-14T15:56:10.490157+0000","last_undegraded":"2023-07-14T15:56:10.490157+0000","last_fullsized":"2023-07-14T15:56:10.490157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:20:57.146500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.317671+0000","last_change":"2023-07-14T15:56:08.969440+0000","last_active":"2023-07-14T15:56:10.317671+0000","last_peered":"2023-07-14T15:56:10.317671+0000","last_clean":"2023-07-14T15:56:10.317671+0000","last_became_active":"2023-07-14T15:56:08.966859+0000","last_became_peered":"2023-07-14T15:56:08.966859+0000","last_unstale":"2023-07-14T15:56:10.317671+0000","last_undegraded":"2023-07-14T15:56:10.317671+0000","last_fullsized":"2023-07-14T15:56:10.317671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:22:06.842480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"24'3","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968598+0000","last_change":"2023-07-14T15:56:07.964545+0000","last_active":"2023-07-14T15:56:09.968598+0000","last_peered":"2023-07-14T15:56:09.968598+0000","last_clean":"2023-07-14T15:56:09.968598+0000","last_became_active":"2023-07-14T15:56:07.963768+0000","last_became_peered":"2023-07-14T15:56:07.963768+0000","last_unstale":"2023-07-14T15:56:09.968598+0000","last_undegraded":"2023-07-14T15:56:09.968598+0000","last_fullsized":"2023-07-14T15:56:09.968598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:47:20.344379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.318158+0000","last_change":"2023-07-14T15:56:08.970241+0000","last_active":"2023-07-14T15:56:10.318158+0000","last_peered":"2023-07-14T15:56:10.318158+0000","last_clean":"2023-07-14T15:56:10.318158+0000","last_became_active":"2023-07-14T15:56:08.969947+0000","last_became_peered":"2023-07-14T15:56:08.969947+0000","last_unstale":"2023-07-14T15:56:10.318158+0000","last_undegraded":"2023-07-14T15:56:10.318158+0000","last_fullsized":"2023-07-14T15:56:10.318158+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:10:40.403063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"24'6","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969540+0000","last_change":"2023-07-14T15:56:07.970523+0000","last_active":"2023-07-14T15:56:09.969540+0000","last_peered":"2023-07-14T15:56:09.969540+0000","last_clean":"2023-07-14T15:56:09.969540+0000","last_became_active":"2023-07-14T15:56:07.970142+0000","last_became_peered":"2023-07-14T15:56:07.970142+0000","last_unstale":"2023-07-14T15:56:09.969540+0000","last_undegraded":"2023-07-14T15:56:09.969540+0000","last_fullsized":"2023-07-14T15:56:09.969540+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:47:08.966111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489691+0000","last_change":"2023-07-14T15:56:08.969130+0000","last_active":"2023-07-14T15:56:10.489691+0000","last_peered":"2023-07-14T15:56:10.489691+0000","last_clean":"2023-07-14T15:56:10.489691+0000","last_became_active":"2023-07-14T15:56:08.968814+0000","last_became_peered":"2023-07-14T15:56:08.968814+0000","last_unstale":"2023-07-14T15:56:10.489691+0000","last_undegraded":"2023-07-14T15:56:10.489691+0000","last_fullsized":"2023-07-14T15:56:10.489691+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:28:16.724128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969426+0000","last_change":"2023-07-14T15:56:07.970235+0000","last_active":"2023-07-14T15:56:09.969426+0000","last_peered":"2023-07-14T15:56:09.969426+0000","last_clean":"2023-07-14T15:56:09.969426+0000","last_became_active":"2023-07-14T15:56:07.969938+0000","last_became_peered":"2023-07-14T15:56:07.969938+0000","last_unstale":"2023-07-14T15:56:09.969426+0000","last_undegraded":"2023-07-14T15:56:09.969426+0000","last_fullsized":"2023-07-14T15:56:09.969426+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:03:38.271024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489380+0000","last_change":"2023-07-14T15:56:08.980388+0000","last_active":"2023-07-14T15:56:10.489380+0000","last_peered":"2023-07-14T15:56:10.489380+0000","last_clean":"2023-07-14T15:56:10.489380+0000","last_became_active":"2023-07-14T15:56:08.980080+0000","last_became_peered":"2023-07-14T15:56:08.980080+0000","last_unstale":"2023-07-14T15:56:10.489380+0000","last_undegraded":"2023-07-14T15:56:10.489380+0000","last_fullsized":"2023-07-14T15:56:10.489380+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:20:12.345478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489365+0000","last_change":"2023-07-14T15:56:07.975515+0000","last_active":"2023-07-14T15:56:10.489365+0000","last_peered":"2023-07-14T15:56:10.489365+0000","last_clean":"2023-07-14T15:56:10.489365+0000","last_became_active":"2023-07-14T15:56:07.975155+0000","last_became_peered":"2023-07-14T15:56:07.975155+0000","last_unstale":"2023-07-14T15:56:10.489365+0000","last_undegraded":"2023-07-14T15:56:10.489365+0000","last_fullsized":"2023-07-14T15:56:10.489365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:33:36.247286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.970018+0000","last_change":"2023-07-14T15:56:08.970329+0000","last_active":"2023-07-14T15:56:09.970018+0000","last_peered":"2023-07-14T15:56:09.970018+0000","last_clean":"2023-07-14T15:56:09.970018+0000","last_became_active":"2023-07-14T15:56:08.970021+0000","last_became_peered":"2023-07-14T15:56:08.970021+0000","last_unstale":"2023-07-14T15:56:09.970018+0000","last_undegraded":"2023-07-14T15:56:09.970018+0000","last_fullsized":"2023-07-14T15:56:09.970018+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:59:48.587072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968889+0000","last_change":"2023-07-14T15:56:07.970580+0000","last_active":"2023-07-14T15:56:09.968889+0000","last_peered":"2023-07-14T15:56:09.968889+0000","last_clean":"2023-07-14T15:56:09.968889+0000","last_became_active":"2023-07-14T15:56:07.970015+0000","last_became_peered":"2023-07-14T15:56:07.970015+0000","last_unstale":"2023-07-14T15:56:09.968889+0000","last_undegraded":"2023-07-14T15:56:09.968889+0000","last_fullsized":"2023-07-14T15:56:09.968889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:14:44.479408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969220+0000","last_change":"2023-07-14T15:56:08.980174+0000","last_active":"2023-07-14T15:56:09.969220+0000","last_peered":"2023-07-14T15:56:09.969220+0000","last_clean":"2023-07-14T15:56:09.969220+0000","last_became_active":"2023-07-14T15:56:08.979596+0000","last_became_peered":"2023-07-14T15:56:08.979596+0000","last_unstale":"2023-07-14T15:56:09.969220+0000","last_undegraded":"2023-07-14T15:56:09.969220+0000","last_fullsized":"2023-07-14T15:56:09.969220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:15:28.458174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"24'8","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489443+0000","last_change":"2023-07-14T15:56:07.968155+0000","last_active":"2023-07-14T15:56:10.489443+0000","last_peered":"2023-07-14T15:56:10.489443+0000","last_clean":"2023-07-14T15:56:10.489443+0000","last_became_active":"2023-07-14T15:56:07.967859+0000","last_became_peered":"2023-07-14T15:56:07.967859+0000","last_unstale":"2023-07-14T15:56:10.489443+0000","last_undegraded":"2023-07-14T15:56:10.489443+0000","last_fullsized":"2023-07-14T15:56:10.489443+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:15:27.451548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969509+0000","last_change":"2023-07-14T15:56:08.977704+0000","last_active":"2023-07-14T15:56:09.969509+0000","last_peered":"2023-07-14T15:56:09.969509+0000","last_clean":"2023-07-14T15:56:09.969509+0000","last_became_active":"2023-07-14T15:56:08.977428+0000","last_became_peered":"2023-07-14T15:56:08.977428+0000","last_unstale":"2023-07-14T15:56:09.969509+0000","last_undegraded":"2023-07-14T15:56:09.969509+0000","last_fullsized":"2023-07-14T15:56:09.969509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:32:30.477405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"24'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969149+0000","last_change":"2023-07-14T15:56:07.967243+0000","last_active":"2023-07-14T15:56:09.969149+0000","last_peered":"2023-07-14T15:56:09.969149+0000","last_clean":"2023-07-14T15:56:09.969149+0000","last_became_active":"2023-07-14T15:56:07.966979+0000","last_became_peered":"2023-07-14T15:56:07.966979+0000","last_unstale":"2023-07-14T15:56:09.969149+0000","last_undegraded":"2023-07-14T15:56:09.969149+0000","last_fullsized":"2023-07-14T15:56:09.969149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:01:03.734490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969353+0000","last_change":"2023-07-14T15:56:08.972023+0000","last_active":"2023-07-14T15:56:09.969353+0000","last_peered":"2023-07-14T15:56:09.969353+0000","last_clean":"2023-07-14T15:56:09.969353+0000","last_became_active":"2023-07-14T15:56:08.971728+0000","last_became_peered":"2023-07-14T15:56:08.971728+0000","last_unstale":"2023-07-14T15:56:09.969353+0000","last_undegraded":"2023-07-14T15:56:09.969353+0000","last_fullsized":"2023-07-14T15:56:09.969353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:28:39.134928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.490181+0000","last_change":"2023-07-14T15:56:07.968894+0000","last_active":"2023-07-14T15:56:10.490181+0000","last_peered":"2023-07-14T15:56:10.490181+0000","last_clean":"2023-07-14T15:56:10.490181+0000","last_became_active":"2023-07-14T15:56:07.968577+0000","last_became_peered":"2023-07-14T15:56:07.968577+0000","last_unstale":"2023-07-14T15:56:10.490181+0000","last_undegraded":"2023-07-14T15:56:10.490181+0000","last_fullsized":"2023-07-14T15:56:10.490181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:45:38.253764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489497+0000","last_change":"2023-07-14T15:56:08.985023+0000","last_active":"2023-07-14T15:56:10.489497+0000","last_peered":"2023-07-14T15:56:10.489497+0000","last_clean":"2023-07-14T15:56:10.489497+0000","last_became_active":"2023-07-14T15:56:08.984743+0000","last_became_peered":"2023-07-14T15:56:08.984743+0000","last_unstale":"2023-07-14T15:56:10.489497+0000","last_undegraded":"2023-07-14T15:56:10.489497+0000","last_fullsized":"2023-07-14T15:56:10.489497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:52:49.596576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"24'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969616+0000","last_change":"2023-07-14T15:56:07.975480+0000","last_active":"2023-07-14T15:56:09.969616+0000","last_peered":"2023-07-14T15:56:09.969616+0000","last_clean":"2023-07-14T15:56:09.969616+0000","last_became_active":"2023-07-14T15:56:07.975128+0000","last_became_peered":"2023-07-14T15:56:07.975128+0000","last_unstale":"2023-07-14T15:56:09.969616+0000","last_undegraded":"2023-07-14T15:56:09.969616+0000","last_fullsized":"2023-07-14T15:56:09.969616+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:35:54.302044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489485+0000","last_change":"2023-07-14T15:56:08.971193+0000","last_active":"2023-07-14T15:56:10.489485+0000","last_peered":"2023-07-14T15:56:10.489485+0000","last_clean":"2023-07-14T15:56:10.489485+0000","last_became_active":"2023-07-14T15:56:08.970747+0000","last_became_peered":"2023-07-14T15:56:08.970747+0000","last_unstale":"2023-07-14T15:56:10.489485+0000","last_undegraded":"2023-07-14T15:56:10.489485+0000","last_fullsized":"2023-07-14T15:56:10.489485+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:47:21.351005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968901+0000","last_change":"2023-07-14T15:56:07.973033+0000","last_active":"2023-07-14T15:56:09.968901+0000","last_peered":"2023-07-14T15:56:09.968901+0000","last_clean":"2023-07-14T15:56:09.968901+0000","last_became_active":"2023-07-14T15:56:07.972707+0000","last_became_peered":"2023-07-14T15:56:07.972707+0000","last_unstale":"2023-07-14T15:56:09.968901+0000","last_undegraded":"2023-07-14T15:56:09.968901+0000","last_fullsized":"2023-07-14T15:56:09.968901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:30:23.173622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969628+0000","last_change":"2023-07-14T15:56:08.983804+0000","last_active":"2023-07-14T15:56:09.969628+0000","last_peered":"2023-07-14T15:56:09.969628+0000","last_clean":"2023-07-14T15:56:09.969628+0000","last_became_active":"2023-07-14T15:56:08.983565+0000","last_became_peered":"2023-07-14T15:56:08.983565+0000","last_unstale":"2023-07-14T15:56:09.969628+0000","last_undegraded":"2023-07-14T15:56:09.969628+0000","last_fullsized":"2023-07-14T15:56:09.969628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:23:33.554098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.b","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489252+0000","last_change":"2023-07-14T15:56:07.973408+0000","last_active":"2023-07-14T15:56:10.489252+0000","last_peered":"2023-07-14T15:56:10.489252+0000","last_clean":"2023-07-14T15:56:10.489252+0000","last_became_active":"2023-07-14T15:56:07.973090+0000","last_became_peered":"2023-07-14T15:56:07.973090+0000","last_unstale":"2023-07-14T15:56:10.489252+0000","last_undegraded":"2023-07-14T15:56:10.489252+0000","last_fullsized":"2023-07-14T15:56:10.489252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:10:08.601895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968784+0000","last_change":"2023-07-14T15:56:08.963200+0000","last_active":"2023-07-14T15:56:09.968784+0000","last_peered":"2023-07-14T15:56:09.968784+0000","last_clean":"2023-07-14T15:56:09.968784+0000","last_became_active":"2023-07-14T15:56:08.962998+0000","last_became_peered":"2023-07-14T15:56:08.962998+0000","last_unstale":"2023-07-14T15:56:09.968784+0000","last_undegraded":"2023-07-14T15:56:09.968784+0000","last_fullsized":"2023-07-14T15:56:09.968784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:38:45.760463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969028+0000","last_change":"2023-07-14T15:56:07.976310+0000","last_active":"2023-07-14T15:56:09.969028+0000","last_peered":"2023-07-14T15:56:09.969028+0000","last_clean":"2023-07-14T15:56:09.969028+0000","last_became_active":"2023-07-14T15:56:07.975997+0000","last_became_peered":"2023-07-14T15:56:07.975997+0000","last_unstale":"2023-07-14T15:56:09.969028+0000","last_undegraded":"2023-07-14T15:56:09.969028+0000","last_fullsized":"2023-07-14T15:56:09.969028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:58:04.257883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969893+0000","last_change":"2023-07-14T15:56:08.975038+0000","last_active":"2023-07-14T15:56:09.969893+0000","last_peered":"2023-07-14T15:56:09.969893+0000","last_clean":"2023-07-14T15:56:09.969893+0000","last_became_active":"2023-07-14T15:56:08.974739+0000","last_became_peered":"2023-07-14T15:56:08.974739+0000","last_unstale":"2023-07-14T15:56:09.969893+0000","last_undegraded":"2023-07-14T15:56:09.969893+0000","last_fullsized":"2023-07-14T15:56:09.969893+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:11:18.956807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968825+0000","last_change":"2023-07-14T15:56:07.969636+0000","last_active":"2023-07-14T15:56:09.968825+0000","last_peered":"2023-07-14T15:56:09.968825+0000","last_clean":"2023-07-14T15:56:09.968825+0000","last_became_active":"2023-07-14T15:56:07.969277+0000","last_became_peered":"2023-07-14T15:56:07.969277+0000","last_unstale":"2023-07-14T15:56:09.968825+0000","last_undegraded":"2023-07-14T15:56:09.968825+0000","last_fullsized":"2023-07-14T15:56:09.968825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:16:33.190367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.490104+0000","last_change":"2023-07-14T15:56:08.961767+0000","last_active":"2023-07-14T15:56:10.490104+0000","last_peered":"2023-07-14T15:56:10.490104+0000","last_clean":"2023-07-14T15:56:10.490104+0000","last_became_active":"2023-07-14T15:56:08.961258+0000","last_became_peered":"2023-07-14T15:56:08.961258+0000","last_unstale":"2023-07-14T15:56:10.490104+0000","last_undegraded":"2023-07-14T15:56:10.490104+0000","last_fullsized":"2023-07-14T15:56:10.490104+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:12:21.171093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.317923+0000","last_change":"2023-07-14T15:56:07.971828+0000","last_active":"2023-07-14T15:56:10.317923+0000","last_peered":"2023-07-14T15:56:10.317923+0000","last_clean":"2023-07-14T15:56:10.317923+0000","last_became_active":"2023-07-14T15:56:07.971500+0000","last_became_peered":"2023-07-14T15:56:07.971500+0000","last_unstale":"2023-07-14T15:56:10.317923+0000","last_undegraded":"2023-07-14T15:56:10.317923+0000","last_fullsized":"2023-07-14T15:56:10.317923+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:54:18.286729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489687+0000","last_change":"2023-07-14T15:56:08.978423+0000","last_active":"2023-07-14T15:56:10.489687+0000","last_peered":"2023-07-14T15:56:10.489687+0000","last_clean":"2023-07-14T15:56:10.489687+0000","last_became_active":"2023-07-14T15:56:08.978126+0000","last_became_peered":"2023-07-14T15:56:08.978126+0000","last_unstale":"2023-07-14T15:56:10.489687+0000","last_undegraded":"2023-07-14T15:56:10.489687+0000","last_fullsized":"2023-07-14T15:56:10.489687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:29:32.279704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969494+0000","last_change":"2023-07-14T15:56:02.621850+0000","last_active":"2023-07-14T15:56:09.969494+0000","last_peered":"2023-07-14T15:56:09.969494+0000","last_clean":"2023-07-14T15:56:09.969494+0000","last_became_active":"2023-07-14T15:56:02.621471+0000","last_became_peered":"2023-07-14T15:56:02.621471+0000","last_unstale":"2023-07-14T15:56:09.969494+0000","last_undegraded":"2023-07-14T15:56:09.969494+0000","last_fullsized":"2023-07-14T15:56:09.969494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:54:12.263158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.490008+0000","last_change":"2023-07-14T15:56:07.965851+0000","last_active":"2023-07-14T15:56:10.490008+0000","last_peered":"2023-07-14T15:56:10.490008+0000","last_clean":"2023-07-14T15:56:10.490008+0000","last_became_active":"2023-07-14T15:56:07.965312+0000","last_became_peered":"2023-07-14T15:56:07.965312+0000","last_unstale":"2023-07-14T15:56:10.490008+0000","last_undegraded":"2023-07-14T15:56:10.490008+0000","last_fullsized":"2023-07-14T15:56:10.490008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:01:03.734490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.488879+0000","last_change":"2023-07-14T15:56:08.974753+0000","last_active":"2023-07-14T15:56:10.488879+0000","last_peered":"2023-07-14T15:56:10.488879+0000","last_clean":"2023-07-14T15:56:10.488879+0000","last_became_active":"2023-07-14T15:56:08.974482+0000","last_became_peered":"2023-07-14T15:56:08.974482+0000","last_unstale":"2023-07-14T15:56:10.488879+0000","last_undegraded":"2023-07-14T15:56:10.488879+0000","last_fullsized":"2023-07-14T15:56:10.488879+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:22:21.802038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969169+0000","last_change":"2023-07-14T15:56:02.621963+0000","last_active":"2023-07-14T15:56:09.969169+0000","last_peered":"2023-07-14T15:56:09.969169+0000","last_clean":"2023-07-14T15:56:09.969169+0000","last_became_active":"2023-07-14T15:56:02.621678+0000","last_became_peered":"2023-07-14T15:56:02.621678+0000","last_unstale":"2023-07-14T15:56:09.969169+0000","last_undegraded":"2023-07-14T15:56:09.969169+0000","last_fullsized":"2023-07-14T15:56:09.969169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:42:28.210730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968484+0000","last_change":"2023-07-14T15:56:07.970834+0000","last_active":"2023-07-14T15:56:09.968484+0000","last_peered":"2023-07-14T15:56:09.968484+0000","last_clean":"2023-07-14T15:56:09.968484+0000","last_became_active":"2023-07-14T15:56:07.970464+0000","last_became_peered":"2023-07-14T15:56:07.970464+0000","last_unstale":"2023-07-14T15:56:09.968484+0000","last_undegraded":"2023-07-14T15:56:09.968484+0000","last_fullsized":"2023-07-14T15:56:09.968484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:00:38.398401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489620+0000","last_change":"2023-07-14T15:56:08.974479+0000","last_active":"2023-07-14T15:56:10.489620+0000","last_peered":"2023-07-14T15:56:10.489620+0000","last_clean":"2023-07-14T15:56:10.489620+0000","last_became_active":"2023-07-14T15:56:08.974197+0000","last_became_peered":"2023-07-14T15:56:08.974197+0000","last_unstale":"2023-07-14T15:56:10.489620+0000","last_undegraded":"2023-07-14T15:56:10.489620+0000","last_fullsized":"2023-07-14T15:56:10.489620+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:10:08.144011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489381+0000","last_change":"2023-07-14T15:56:01.925110+0000","last_active":"2023-07-14T15:56:10.489381+0000","last_peered":"2023-07-14T15:56:10.489381+0000","last_clean":"2023-07-14T15:56:10.489381+0000","last_became_active":"2023-07-14T15:56:01.924723+0000","last_became_peered":"2023-07-14T15:56:01.924723+0000","last_unstale":"2023-07-14T15:56:10.489381+0000","last_undegraded":"2023-07-14T15:56:10.489381+0000","last_fullsized":"2023-07-14T15:56:10.489381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:33:30.223715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968791+0000","last_change":"2023-07-14T15:56:07.971753+0000","last_active":"2023-07-14T15:56:09.968791+0000","last_peered":"2023-07-14T15:56:09.968791+0000","last_clean":"2023-07-14T15:56:09.968791+0000","last_became_active":"2023-07-14T15:56:07.971447+0000","last_became_peered":"2023-07-14T15:56:07.971447+0000","last_unstale":"2023-07-14T15:56:09.968791+0000","last_undegraded":"2023-07-14T15:56:09.968791+0000","last_fullsized":"2023-07-14T15:56:09.968791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:14:57.078074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489621+0000","last_change":"2023-07-14T15:56:08.981489+0000","last_active":"2023-07-14T15:56:10.489621+0000","last_peered":"2023-07-14T15:56:10.489621+0000","last_clean":"2023-07-14T15:56:10.489621+0000","last_became_active":"2023-07-14T15:56:08.981064+0000","last_became_peered":"2023-07-14T15:56:08.981064+0000","last_unstale":"2023-07-14T15:56:10.489621+0000","last_undegraded":"2023-07-14T15:56:10.489621+0000","last_fullsized":"2023-07-14T15:56:10.489621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:09:43.406898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968541+0000","last_change":"2023-07-14T15:56:01.923465+0000","last_active":"2023-07-14T15:56:09.968541+0000","last_peered":"2023-07-14T15:56:09.968541+0000","last_clean":"2023-07-14T15:56:09.968541+0000","last_became_active":"2023-07-14T15:56:01.923160+0000","last_became_peered":"2023-07-14T15:56:01.923160+0000","last_unstale":"2023-07-14T15:56:09.968541+0000","last_undegraded":"2023-07-14T15:56:09.968541+0000","last_fullsized":"2023-07-14T15:56:09.968541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:50:40.374649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":175,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489184+0000","last_change":"2023-07-14T15:55:54.040065+0000","last_active":"2023-07-14T15:56:10.489184+0000","last_peered":"2023-07-14T15:56:10.489184+0000","last_clean":"2023-07-14T15:56:10.489184+0000","last_became_active":"2023-07-14T15:55:54.038885+0000","last_became_peered":"2023-07-14T15:55:54.038885+0000","last_unstale":"2023-07-14T15:56:10.489184+0000","last_undegraded":"2023-07-14T15:56:10.489184+0000","last_fullsized":"2023-07-14T15:56:10.489184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:55:53.025696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:55:53.025696+0000","last_clean_scrub_stamp":"2023-07-14T15:55:53.025696+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:14:43.173657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.317859+0000","last_change":"2023-07-14T15:56:07.970931+0000","last_active":"2023-07-14T15:56:10.317859+0000","last_peered":"2023-07-14T15:56:10.317859+0000","last_clean":"2023-07-14T15:56:10.317859+0000","last_became_active":"2023-07-14T15:56:07.970576+0000","last_became_peered":"2023-07-14T15:56:07.970576+0000","last_unstale":"2023-07-14T15:56:10.317859+0000","last_undegraded":"2023-07-14T15:56:10.317859+0000","last_fullsized":"2023-07-14T15:56:10.317859+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:32:29.470779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969965+0000","last_change":"2023-07-14T15:56:08.972039+0000","last_active":"2023-07-14T15:56:09.969965+0000","last_peered":"2023-07-14T15:56:09.969965+0000","last_clean":"2023-07-14T15:56:09.969965+0000","last_became_active":"2023-07-14T15:56:08.971718+0000","last_became_peered":"2023-07-14T15:56:08.971718+0000","last_unstale":"2023-07-14T15:56:09.969965+0000","last_undegraded":"2023-07-14T15:56:09.969965+0000","last_fullsized":"2023-07-14T15:56:09.969965+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:31:57.408531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968778+0000","last_change":"2023-07-14T15:56:01.920714+0000","last_active":"2023-07-14T15:56:09.968778+0000","last_peered":"2023-07-14T15:56:09.968778+0000","last_clean":"2023-07-14T15:56:09.968778+0000","last_became_active":"2023-07-14T15:56:01.920325+0000","last_became_peered":"2023-07-14T15:56:01.920325+0000","last_unstale":"2023-07-14T15:56:09.968778+0000","last_undegraded":"2023-07-14T15:56:09.968778+0000","last_fullsized":"2023-07-14T15:56:09.968778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:03:08.403097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.488883+0000","last_change":"2023-07-14T15:56:07.970542+0000","last_active":"2023-07-14T15:56:10.488883+0000","last_peered":"2023-07-14T15:56:10.488883+0000","last_clean":"2023-07-14T15:56:10.488883+0000","last_became_active":"2023-07-14T15:56:07.970172+0000","last_became_peered":"2023-07-14T15:56:07.970172+0000","last_unstale":"2023-07-14T15:56:10.488883+0000","last_undegraded":"2023-07-14T15:56:10.488883+0000","last_fullsized":"2023-07-14T15:56:10.488883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:31:45.916927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969443+0000","last_change":"2023-07-14T15:56:08.980388+0000","last_active":"2023-07-14T15:56:09.969443+0000","last_peered":"2023-07-14T15:56:09.969443+0000","last_clean":"2023-07-14T15:56:09.969443+0000","last_became_active":"2023-07-14T15:56:08.979897+0000","last_became_peered":"2023-07-14T15:56:08.979897+0000","last_unstale":"2023-07-14T15:56:09.969443+0000","last_undegraded":"2023-07-14T15:56:09.969443+0000","last_fullsized":"2023-07-14T15:56:09.969443+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:11:49.645623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969752+0000","last_change":"2023-07-14T15:56:01.923631+0000","last_active":"2023-07-14T15:56:09.969752+0000","last_peered":"2023-07-14T15:56:09.969752+0000","last_clean":"2023-07-14T15:56:09.969752+0000","last_became_active":"2023-07-14T15:56:01.922783+0000","last_became_peered":"2023-07-14T15:56:01.922783+0000","last_unstale":"2023-07-14T15:56:09.969752+0000","last_undegraded":"2023-07-14T15:56:09.969752+0000","last_fullsized":"2023-07-14T15:56:09.969752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:27:47.642533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489594+0000","last_change":"2023-07-14T15:56:07.967762+0000","last_active":"2023-07-14T15:56:10.489594+0000","last_peered":"2023-07-14T15:56:10.489594+0000","last_clean":"2023-07-14T15:56:10.489594+0000","last_became_active":"2023-07-14T15:56:07.967471+0000","last_became_peered":"2023-07-14T15:56:07.967471+0000","last_unstale":"2023-07-14T15:56:10.489594+0000","last_undegraded":"2023-07-14T15:56:10.489594+0000","last_fullsized":"2023-07-14T15:56:10.489594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:29:31.273078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489319+0000","last_change":"2023-07-14T15:56:08.976758+0000","last_active":"2023-07-14T15:56:10.489319+0000","last_peered":"2023-07-14T15:56:10.489319+0000","last_clean":"2023-07-14T15:56:10.489319+0000","last_became_active":"2023-07-14T15:56:08.976318+0000","last_became_peered":"2023-07-14T15:56:08.976318+0000","last_unstale":"2023-07-14T15:56:10.489319+0000","last_undegraded":"2023-07-14T15:56:10.489319+0000","last_fullsized":"2023-07-14T15:56:10.489319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:18:49.883894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.318181+0000","last_change":"2023-07-14T15:56:07.967060+0000","last_active":"2023-07-14T15:56:10.318181+0000","last_peered":"2023-07-14T15:56:10.318181+0000","last_clean":"2023-07-14T15:56:10.318181+0000","last_became_active":"2023-07-14T15:56:07.966852+0000","last_became_peered":"2023-07-14T15:56:07.966852+0000","last_unstale":"2023-07-14T15:56:10.318181+0000","last_undegraded":"2023-07-14T15:56:10.318181+0000","last_fullsized":"2023-07-14T15:56:10.318181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:58:00.742453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.318071+0000","last_change":"2023-07-14T15:56:01.965649+0000","last_active":"2023-07-14T15:56:10.318071+0000","last_peered":"2023-07-14T15:56:10.318071+0000","last_clean":"2023-07-14T15:56:10.318071+0000","last_became_active":"2023-07-14T15:56:01.965344+0000","last_became_peered":"2023-07-14T15:56:01.965344+0000","last_unstale":"2023-07-14T15:56:10.318071+0000","last_undegraded":"2023-07-14T15:56:10.318071+0000","last_fullsized":"2023-07-14T15:56:10.318071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:23:26.523901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.317808+0000","last_change":"2023-07-14T15:56:08.961123+0000","last_active":"2023-07-14T15:56:10.317808+0000","last_peered":"2023-07-14T15:56:10.317808+0000","last_clean":"2023-07-14T15:56:10.317808+0000","last_became_active":"2023-07-14T15:56:08.960675+0000","last_became_peered":"2023-07-14T15:56:08.960675+0000","last_unstale":"2023-07-14T15:56:10.317808+0000","last_undegraded":"2023-07-14T15:56:10.317808+0000","last_fullsized":"2023-07-14T15:56:10.317808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:11:49.645623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.970285+0000","last_change":"2023-07-14T15:56:01.966578+0000","last_active":"2023-07-14T15:56:09.970285+0000","last_peered":"2023-07-14T15:56:09.970285+0000","last_clean":"2023-07-14T15:56:09.970285+0000","last_became_active":"2023-07-14T15:56:01.966216+0000","last_became_peered":"2023-07-14T15:56:01.966216+0000","last_unstale":"2023-07-14T15:56:09.970285+0000","last_undegraded":"2023-07-14T15:56:09.970285+0000","last_fullsized":"2023-07-14T15:56:09.970285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:16:28.116727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.318279+0000","last_change":"2023-07-14T15:56:07.970881+0000","last_active":"2023-07-14T15:56:10.318279+0000","last_peered":"2023-07-14T15:56:10.318279+0000","last_clean":"2023-07-14T15:56:10.318279+0000","last_became_active":"2023-07-14T15:56:07.970596+0000","last_became_peered":"2023-07-14T15:56:07.970596+0000","last_unstale":"2023-07-14T15:56:10.318279+0000","last_undegraded":"2023-07-14T15:56:10.318279+0000","last_fullsized":"2023-07-14T15:56:10.318279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:29:12.393151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489389+0000","last_change":"2023-07-14T15:56:08.964323+0000","last_active":"2023-07-14T15:56:10.489389+0000","last_peered":"2023-07-14T15:56:10.489389+0000","last_clean":"2023-07-14T15:56:10.489389+0000","last_became_active":"2023-07-14T15:56:08.964024+0000","last_became_peered":"2023-07-14T15:56:08.964024+0000","last_unstale":"2023-07-14T15:56:10.489389+0000","last_undegraded":"2023-07-14T15:56:10.489389+0000","last_fullsized":"2023-07-14T15:56:10.489389+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:00:39.405027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"24'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.317703+0000","last_change":"2023-07-14T15:56:07.965044+0000","last_active":"2023-07-14T15:56:10.317703+0000","last_peered":"2023-07-14T15:56:10.317703+0000","last_clean":"2023-07-14T15:56:10.317703+0000","last_became_active":"2023-07-14T15:56:07.964585+0000","last_became_peered":"2023-07-14T15:56:07.964585+0000","last_unstale":"2023-07-14T15:56:10.317703+0000","last_undegraded":"2023-07-14T15:56:10.317703+0000","last_fullsized":"2023-07-14T15:56:10.317703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:59:56.654841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.318165+0000","last_change":"2023-07-14T15:56:08.972801+0000","last_active":"2023-07-14T15:56:10.318165+0000","last_peered":"2023-07-14T15:56:10.318165+0000","last_clean":"2023-07-14T15:56:10.318165+0000","last_became_active":"2023-07-14T15:56:08.972481+0000","last_became_peered":"2023-07-14T15:56:08.972481+0000","last_unstale":"2023-07-14T15:56:10.318165+0000","last_undegraded":"2023-07-14T15:56:10.318165+0000","last_fullsized":"2023-07-14T15:56:10.318165+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:35:57.456677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.490013+0000","last_change":"2023-07-14T15:56:07.968681+0000","last_active":"2023-07-14T15:56:10.490013+0000","last_peered":"2023-07-14T15:56:10.490013+0000","last_clean":"2023-07-14T15:56:10.490013+0000","last_became_active":"2023-07-14T15:56:07.968350+0000","last_became_peered":"2023-07-14T15:56:07.968350+0000","last_unstale":"2023-07-14T15:56:10.490013+0000","last_undegraded":"2023-07-14T15:56:10.490013+0000","last_fullsized":"2023-07-14T15:56:10.490013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:12:08.491508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489567+0000","last_change":"2023-07-14T15:56:08.987218+0000","last_active":"2023-07-14T15:56:10.489567+0000","last_peered":"2023-07-14T15:56:10.489567+0000","last_clean":"2023-07-14T15:56:10.489567+0000","last_became_active":"2023-07-14T15:56:08.986928+0000","last_became_peered":"2023-07-14T15:56:08.986928+0000","last_unstale":"2023-07-14T15:56:10.489567+0000","last_undegraded":"2023-07-14T15:56:10.489567+0000","last_fullsized":"2023-07-14T15:56:10.489567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:38:45.760463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"24'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969829+0000","last_change":"2023-07-14T15:56:07.971194+0000","last_active":"2023-07-14T15:56:09.969829+0000","last_peered":"2023-07-14T15:56:09.969829+0000","last_clean":"2023-07-14T15:56:09.969829+0000","last_became_active":"2023-07-14T15:56:07.970215+0000","last_became_peered":"2023-07-14T15:56:07.970215+0000","last_unstale":"2023-07-14T15:56:09.969829+0000","last_undegraded":"2023-07-14T15:56:09.969829+0000","last_fullsized":"2023-07-14T15:56:09.969829+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:57:28.541870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489443+0000","last_change":"2023-07-14T15:56:08.976795+0000","last_active":"2023-07-14T15:56:10.489443+0000","last_peered":"2023-07-14T15:56:10.489443+0000","last_clean":"2023-07-14T15:56:10.489443+0000","last_became_active":"2023-07-14T15:56:08.976405+0000","last_became_peered":"2023-07-14T15:56:08.976405+0000","last_unstale":"2023-07-14T15:56:10.489443+0000","last_undegraded":"2023-07-14T15:56:10.489443+0000","last_fullsized":"2023-07-14T15:56:10.489443+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:51:26.834028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"24'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969185+0000","last_change":"2023-07-14T15:56:07.977048+0000","last_active":"2023-07-14T15:56:09.969185+0000","last_peered":"2023-07-14T15:56:09.969185+0000","last_clean":"2023-07-14T15:56:09.969185+0000","last_became_active":"2023-07-14T15:56:07.976771+0000","last_became_peered":"2023-07-14T15:56:07.976771+0000","last_unstale":"2023-07-14T15:56:09.969185+0000","last_undegraded":"2023-07-14T15:56:09.969185+0000","last_fullsized":"2023-07-14T15:56:09.969185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:22:05.835854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489537+0000","last_change":"2023-07-14T15:56:08.976062+0000","last_active":"2023-07-14T15:56:10.489537+0000","last_peered":"2023-07-14T15:56:10.489537+0000","last_clean":"2023-07-14T15:56:10.489537+0000","last_became_active":"2023-07-14T15:56:08.975745+0000","last_became_peered":"2023-07-14T15:56:08.975745+0000","last_unstale":"2023-07-14T15:56:10.489537+0000","last_undegraded":"2023-07-14T15:56:10.489537+0000","last_fullsized":"2023-07-14T15:56:10.489537+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:20:12.345478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"24'4","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969619+0000","last_change":"2023-07-14T15:56:07.974964+0000","last_active":"2023-07-14T15:56:09.969619+0000","last_peered":"2023-07-14T15:56:09.969619+0000","last_clean":"2023-07-14T15:56:09.969619+0000","last_became_active":"2023-07-14T15:56:07.974696+0000","last_became_peered":"2023-07-14T15:56:07.974696+0000","last_unstale":"2023-07-14T15:56:09.969619+0000","last_undegraded":"2023-07-14T15:56:09.969619+0000","last_fullsized":"2023-07-14T15:56:09.969619+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:06.930113+0000","last_clean_scrub_stamp":"2023-07-14T15:56:06.930113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:10:39.396437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489229+0000","last_change":"2023-07-14T15:56:08.962402+0000","last_active":"2023-07-14T15:56:10.489229+0000","last_peered":"2023-07-14T15:56:10.489229+0000","last_clean":"2023-07-14T15:56:10.489229+0000","last_became_active":"2023-07-14T15:56:08.962087+0000","last_became_peered":"2023-07-14T15:56:08.962087+0000","last_unstale":"2023-07-14T15:56:10.489229+0000","last_undegraded":"2023-07-14T15:56:10.489229+0000","last_fullsized":"2023-07-14T15:56:10.489229+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:51:55.348364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.489873+0000","last_change":"2023-07-14T15:56:08.962047+0000","last_active":"2023-07-14T15:56:10.489873+0000","last_peered":"2023-07-14T15:56:10.489873+0000","last_clean":"2023-07-14T15:56:10.489873+0000","last_became_active":"2023-07-14T15:56:08.961657+0000","last_became_peered":"2023-07-14T15:56:08.961657+0000","last_unstale":"2023-07-14T15:56:10.489873+0000","last_undegraded":"2023-07-14T15:56:10.489873+0000","last_fullsized":"2023-07-14T15:56:10.489873+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:32:30.477405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:10.488979+0000","last_change":"2023-07-14T15:56:08.979917+0000","last_active":"2023-07-14T15:56:10.488979+0000","last_peered":"2023-07-14T15:56:10.488979+0000","last_clean":"2023-07-14T15:56:10.488979+0000","last_became_active":"2023-07-14T15:56:08.979617+0000","last_became_peered":"2023-07-14T15:56:08.979617+0000","last_unstale":"2023-07-14T15:56:10.488979+0000","last_undegraded":"2023-07-14T15:56:10.488979+0000","last_fullsized":"2023-07-14T15:56:10.488979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:10:09.608521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.968216+0000","last_change":"2023-07-14T15:56:08.971350+0000","last_active":"2023-07-14T15:56:09.968216+0000","last_peered":"2023-07-14T15:56:09.968216+0000","last_clean":"2023-07-14T15:56:09.968216+0000","last_became_active":"2023-07-14T15:56:08.970957+0000","last_became_peered":"2023-07-14T15:56:08.970957+0000","last_unstale":"2023-07-14T15:56:09.968216+0000","last_undegraded":"2023-07-14T15:56:09.968216+0000","last_fullsized":"2023-07-14T15:56:09.968216+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:02:13.093743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969481+0000","last_change":"2023-07-14T15:56:08.968381+0000","last_active":"2023-07-14T15:56:09.969481+0000","last_peered":"2023-07-14T15:56:09.969481+0000","last_clean":"2023-07-14T15:56:09.969481+0000","last_became_active":"2023-07-14T15:56:08.968037+0000","last_became_peered":"2023-07-14T15:56:08.968037+0000","last_unstale":"2023-07-14T15:56:09.969481+0000","last_undegraded":"2023-07-14T15:56:09.969481+0000","last_fullsized":"2023-07-14T15:56:09.969481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:36:15.019527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-14T15:56:09.969340+0000","last_change":"2023-07-14T15:56:08.960651+0000","last_active":"2023-07-14T15:56:09.969340+0000","last_peered":"2023-07-14T15:56:09.969340+0000","last_clean":"2023-07-14T15:56:09.969340+0000","last_became_active":"2023-07-14T15:56:08.960387+0000","last_became_peered":"2023-07-14T15:56:08.960387+0000","last_unstale":"2023-07-14T15:56:09.969340+0000","last_undegraded":"2023-07-14T15:56:09.969340+0000","last_fullsized":"2023-07-14T15:56:09.969340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:07.936740+0000","last_clean_scrub_stamp":"2023-07-14T15:56:07.936740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:59:57.661468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476745,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":96845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]}]},{"osd":0,"up_from":16,"seq":68719476746,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":95323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":258048,"data_stored":95267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":860160,"data_stored":686219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]}]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":96741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]}]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":253952,"data_stored":95177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":851968,"data_stored":686127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]}]},{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":253952,"data_stored":95177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1240000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T15:56:22.814 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-07-14T15:56:22.814 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-07-14T15:56:22.814 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-07-14T15:56:22.815 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-07-14T15:56:23.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.061+0000 7f100fbff700 1 Processor -- start 2023-07-14T15:56:23.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.061+0000 7f100fbff700 1 -- start start 2023-07-14T15:56:23.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.062+0000 7f100fbff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f10080b85f0 0x7f100815d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:23.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.062+0000 7f100fbff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10080cf6b0 con 0x7f10080b4910 2023-07-14T15:56:23.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.062+0000 7f100fbff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10080cdc40 con 0x7f10080b54b0 2023-07-14T15:56:23.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.062+0000 7f100fbff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f100815dba0 con 0x7f10080b85f0 2023-07-14T15:56:23.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.063+0000 7f100d99b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f10080b85f0 0x7f100815d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:23.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.063+0000 7f100e19c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f10080b4910 0x7f10080b4d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37338/0 (socket says 172.21.15.37:37338) 2023-07-14T15:56:23.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.063+0000 7f100e19c700 1 -- 172.21.15.37:0/791243287 learned_addr learned my addr 172.21.15.37:0/791243287 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:23.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.063+0000 7f100d99b700 1 -- 172.21.15.37:0/791243287 >> v1:172.21.15.98:6789/0 conn(0x7f10080b54b0 legacy=0x7f10080cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:23.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.063+0000 7f100d99b700 1 -- 172.21.15.37:0/791243287 >> v1:172.21.15.37:6789/0 conn(0x7f10080b4910 legacy=0x7f10080b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:23.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.063+0000 7f100d99b700 1 -- 172.21.15.37:0/791243287 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10080d0250 con 0x7f10080b85f0 2023-07-14T15:56:23.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.063+0000 7f100c999700 1 -- 172.21.15.37:0/791243287 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 802679598 0 0) 0x7f10080cf6b0 con 0x7f10080b4910 2023-07-14T15:56:23.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.063+0000 7f100d99b700 1 --2- 172.21.15.37:0/791243287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10080b85f0 0x7f100815d660 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1004009840 tx=0x7f1004009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e11a9163aa2cb18 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:23.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.064+0000 7f100c999700 1 -- 172.21.15.37:0/791243287 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1004011830 con 0x7f10080b85f0 2023-07-14T15:56:23.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.064+0000 7f100c999700 1 -- 172.21.15.37:0/791243287 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1004011990 con 0x7f10080b85f0 2023-07-14T15:56:23.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.064+0000 7f100c999700 1 -- 172.21.15.37:0/791243287 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1004011d20 con 0x7f10080b85f0 2023-07-14T15:56:23.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.064+0000 7f100fbff700 1 -- 172.21.15.37:0/791243287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10080b85f0 msgr2=0x7f100815d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:23.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.064+0000 7f100fbff700 1 --2- 172.21.15.37:0/791243287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10080b85f0 0x7f100815d660 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1004009840 tx=0x7f1004009b50 comp rx=0 tx=0).stop 2023-07-14T15:56:23.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.064+0000 7f100fbff700 1 -- 172.21.15.37:0/791243287 shutdown_connections 2023-07-14T15:56:23.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.064+0000 7f100fbff700 1 --2- 172.21.15.37:0/791243287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10080b85f0 0x7f100815d660 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:23.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.064+0000 7f100fbff700 1 -- 172.21.15.37:0/791243287 >> 172.21.15.37:0/791243287 conn(0x7f100806a580 msgr2=0x7f100806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:23.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.064+0000 7f100fbff700 1 -- 172.21.15.37:0/791243287 shutdown_connections 2023-07-14T15:56:23.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.064+0000 7f100fbff700 1 -- 172.21.15.37:0/791243287 wait complete. 2023-07-14T15:56:23.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.066+0000 7f100fbff700 1 Processor -- start 2023-07-14T15:56:23.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.066+0000 7f100fbff700 1 -- start start 2023-07-14T15:56:23.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.067+0000 7f100fbff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10080b4910 0x7f10080caa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:23.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.067+0000 7f100fbff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f10080b54b0 0x7f100815f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:23.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.067+0000 7f100fbff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10080b85f0 0x7f100814cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:23.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.067+0000 7f100fbff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100815fce0 con 0x7f10080b4910 2023-07-14T15:56:23.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.067+0000 7f100fbff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10080c7c90 con 0x7f10080b85f0 2023-07-14T15:56:23.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.067+0000 7f100fbff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10080c7f70 con 0x7f10080b54b0 2023-07-14T15:56:23.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.067+0000 7f100d99b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10080b4910 0x7f10080caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:23.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.067+0000 7f100d99b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10080b4910 0x7f10080caa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33822/0 (socket says 172.21.15.37:33822) 2023-07-14T15:56:23.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.067+0000 7f100d99b700 1 -- 172.21.15.37:0/16845395 learned_addr learned my addr 172.21.15.37:0/16845395 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:23.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.067+0000 7f100e19c700 1 --2- 172.21.15.37:0/16845395 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10080b85f0 0x7f100814cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:23.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.067+0000 7f100d19a700 1 --2- 172.21.15.37:0/16845395 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f10080b54b0 0x7f100815f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:23.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.068+0000 7f100d99b700 1 -- 172.21.15.37:0/16845395 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f10080b54b0 msgr2=0x7f100815f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:23.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.068+0000 7f100d99b700 1 --2- 172.21.15.37:0/16845395 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f10080b54b0 0x7f100815f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:23.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.068+0000 7f100d99b700 1 -- 172.21.15.37:0/16845395 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10080b85f0 msgr2=0x7f100814cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:23.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.068+0000 7f100d99b700 1 --2- 172.21.15.37:0/16845395 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10080b85f0 0x7f100814cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:23.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.068+0000 7f100d99b700 1 -- 172.21.15.37:0/16845395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10040094a0 con 0x7f10080b4910 2023-07-14T15:56:23.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.068+0000 7f100d19a700 1 --2- 172.21.15.37:0/16845395 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f10080b54b0 0x7f100815f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:56:23.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.068+0000 7f100d99b700 1 --2- 172.21.15.37:0/16845395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10080b4910 0x7f10080caa50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1004014040 tx=0x7f1004004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:23.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.068+0000 7f0ffe7fc700 1 -- 172.21.15.37:0/16845395 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100401a900 con 0x7f10080b4910 2023-07-14T15:56:23.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.068+0000 7f0ffe7fc700 1 -- 172.21.15.37:0/16845395 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100401aa60 con 0x7f10080b4910 2023-07-14T15:56:23.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.068+0000 7f0ffe7fc700 1 -- 172.21.15.37:0/16845395 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100401add0 con 0x7f10080b4910 2023-07-14T15:56:23.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.068+0000 7f100fbff700 1 -- 172.21.15.37:0/16845395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10080c8250 con 0x7f10080b4910 2023-07-14T15:56:23.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.069+0000 7f100fbff700 1 -- 172.21.15.37:0/16845395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1008157bd0 con 0x7f10080b4910 2023-07-14T15:56:23.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.070+0000 7f100fbff700 1 -- 172.21.15.37:0/16845395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1008067840 con 0x7f10080b4910 2023-07-14T15:56:23.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.070+0000 7f0ffe7fc700 1 -- 172.21.15.37:0/16845395 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1004022070 con 0x7f10080b4910 2023-07-14T15:56:23.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.071+0000 7f0ffe7fc700 1 --2- 172.21.15.37:0/16845395 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0fec06ace0 0x7f0fec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:23.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.071+0000 7f0ffe7fc700 1 -- 172.21.15.37:0/16845395 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f100408a410 con 0x7f10080b4910 2023-07-14T15:56:23.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.072+0000 7f100d19a700 1 --2- 172.21.15.37:0/16845395 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0fec06ace0 0x7f0fec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:23.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.072+0000 7f100d19a700 1 --2- 172.21.15.37:0/16845395 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0fec06ace0 0x7f0fec06d190 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f100815c0d0 tx=0x7f0ff8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:23.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.075+0000 7f0ffe7fc700 1 -- 172.21.15.37:0/16845395 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1004055560 con 0x7f10080b4910 2023-07-14T15:56:23.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.329+0000 7f100fbff700 1 -- 172.21.15.37:0/16845395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f100815aa30 con 0x7f10080b4910 2023-07-14T15:56:23.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.329+0000 7f0ffe7fc700 1 -- 172.21.15.37:0/16845395 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f1004006cc0 con 0x7f10080b4910 2023-07-14T15:56:23.316 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:56:23.317 INFO:teuthology.orchestra.run.smithi037.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-07-14T15:56:23.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.332+0000 7f100fbff700 1 -- 172.21.15.37:0/16845395 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0fec06ace0 msgr2=0x7f0fec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:23.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.332+0000 7f100fbff700 1 --2- 172.21.15.37:0/16845395 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0fec06ace0 0x7f0fec06d190 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f100815c0d0 tx=0x7f0ff8009040 comp rx=0 tx=0).stop 2023-07-14T15:56:23.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.332+0000 7f100fbff700 1 -- 172.21.15.37:0/16845395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10080b4910 msgr2=0x7f10080caa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:23.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.332+0000 7f100fbff700 1 --2- 172.21.15.37:0/16845395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10080b4910 0x7f10080caa50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1004014040 tx=0x7f1004004750 comp rx=0 tx=0).stop 2023-07-14T15:56:23.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.332+0000 7f100fbff700 1 -- 172.21.15.37:0/16845395 shutdown_connections 2023-07-14T15:56:23.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.332+0000 7f100fbff700 1 --2- 172.21.15.37:0/16845395 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10080b85f0 0x7f100814cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:23.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.332+0000 7f100fbff700 1 --2- 172.21.15.37:0/16845395 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0fec06ace0 0x7f0fec06d190 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:23.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.332+0000 7f100fbff700 1 --2- 172.21.15.37:0/16845395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10080b4910 0x7f10080caa50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:23.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.332+0000 7f100fbff700 1 --2- 172.21.15.37:0/16845395 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f10080b54b0 0x7f100815f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:23.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.332+0000 7f100fbff700 1 -- 172.21.15.37:0/16845395 >> 172.21.15.37:0/16845395 conn(0x7f100806a580 msgr2=0x7f100815acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:23.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.332+0000 7f100fbff700 1 -- 172.21.15.37:0/16845395 shutdown_connections 2023-07-14T15:56:23.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.332+0000 7f100fbff700 1 -- 172.21.15.37:0/16845395 wait complete. 2023-07-14T15:56:23.336 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-07-14T15:56:23.337 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T15:56:23.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.551+0000 7f0dac1ff700 1 Processor -- start 2023-07-14T15:56:23.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.551+0000 7f0dac1ff700 1 -- start start 2023-07-14T15:56:23.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.552+0000 7f0dac1ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f0da40b85f0 0x7f0da415d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:23.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.552+0000 7f0dac1ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0da40b54b0 0x7f0da40cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:23.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.552+0000 7f0dac1ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0da40b4910 0x7f0da40b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:23.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.552+0000 7f0dac1ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0da40b52d0 con 0x7f0da40b4910 2023-07-14T15:56:23.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.552+0000 7f0dac1ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0da40cf6b0 con 0x7f0da40b85f0 2023-07-14T15:56:23.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.552+0000 7f0dac1ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0da40cdc40 con 0x7f0da40b54b0 2023-07-14T15:56:23.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.552+0000 7f0daa79c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0da40b4910 0x7f0da40b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:23.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.552+0000 7f0daa79c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0da40b4910 0x7f0da40b4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33838/0 (socket says 172.21.15.37:33838) 2023-07-14T15:56:23.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.553+0000 7f0daa79c700 1 -- 172.21.15.37:0/3266925181 learned_addr learned my addr 172.21.15.37:0/3266925181 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:23.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.553+0000 7f0da9f9b700 1 --2- 172.21.15.37:0/3266925181 >> v2:172.21.15.98:3300/0 conn(0x7f0da40b85f0 0x7f0da415d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:23.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.553+0000 7f0da979a700 1 --2- 172.21.15.37:0/3266925181 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0da40b54b0 0x7f0da40cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:23.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.553+0000 7f0daa79c700 1 -- 172.21.15.37:0/3266925181 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0da40b54b0 msgr2=0x7f0da40cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:23.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.553+0000 7f0daa79c700 1 --2- 172.21.15.37:0/3266925181 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0da40b54b0 0x7f0da40cfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:23.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.553+0000 7f0daa79c700 1 -- 172.21.15.37:0/3266925181 >> v2:172.21.15.98:3300/0 conn(0x7f0da40b85f0 msgr2=0x7f0da415d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:23.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.553+0000 7f0daa79c700 1 --2- 172.21.15.37:0/3266925181 >> v2:172.21.15.98:3300/0 conn(0x7f0da40b85f0 0x7f0da415d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:23.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.553+0000 7f0daa79c700 1 -- 172.21.15.37:0/3266925181 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da415dba0 con 0x7f0da40b4910 2023-07-14T15:56:23.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.553+0000 7f0daa79c700 1 --2- 172.21.15.37:0/3266925181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0da40b4910 0x7f0da40b4d90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0da406a110 tx=0x7f0d9c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=585039079460b3da server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:23.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.553+0000 7f0da8f99700 1 -- 172.21.15.37:0/3266925181 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9c00e070 con 0x7f0da40b4910 2023-07-14T15:56:23.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.553+0000 7f0da8f99700 1 -- 172.21.15.37:0/3266925181 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d9c00b910 con 0x7f0da40b4910 2023-07-14T15:56:23.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.553+0000 7f0da8f99700 1 -- 172.21.15.37:0/3266925181 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9c00bcc0 con 0x7f0da40b4910 2023-07-14T15:56:23.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.554+0000 7f0dac1ff700 1 -- 172.21.15.37:0/3266925181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0da40b4910 msgr2=0x7f0da40b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:23.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.554+0000 7f0dac1ff700 1 --2- 172.21.15.37:0/3266925181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0da40b4910 0x7f0da40b4d90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0da406a110 tx=0x7f0d9c00b330 comp rx=0 tx=0).stop 2023-07-14T15:56:23.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.554+0000 7f0dac1ff700 1 -- 172.21.15.37:0/3266925181 shutdown_connections 2023-07-14T15:56:23.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.554+0000 7f0dac1ff700 1 --2- 172.21.15.37:0/3266925181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0da40b4910 0x7f0da40b4d90 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:23.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.554+0000 7f0dac1ff700 1 --2- 172.21.15.37:0/3266925181 >> v2:172.21.15.98:3300/0 conn(0x7f0da40b85f0 0x7f0da415d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:23.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.554+0000 7f0dac1ff700 1 --2- 172.21.15.37:0/3266925181 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0da40b54b0 0x7f0da40cfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:23.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.554+0000 7f0dac1ff700 1 -- 172.21.15.37:0/3266925181 >> 172.21.15.37:0/3266925181 conn(0x7f0da406a580 msgr2=0x7f0da406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:23.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.554+0000 7f0dac1ff700 1 -- 172.21.15.37:0/3266925181 shutdown_connections 2023-07-14T15:56:23.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.554+0000 7f0dac1ff700 1 -- 172.21.15.37:0/3266925181 wait complete. 2023-07-14T15:56:23.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.556+0000 7f0dac1ff700 1 Processor -- start 2023-07-14T15:56:23.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.556+0000 7f0dac1ff700 1 -- start start 2023-07-14T15:56:23.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.557+0000 7f0dac1ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0da40b4910 0x7f0da4149520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:23.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.557+0000 7f0dac1ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0da40b54b0 0x7f0da40a9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:23.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.557+0000 7f0dac1ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0da40b85f0 0x7f0da40d0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:23.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.557+0000 7f0dac1ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da4149a60 con 0x7f0da40b4910 2023-07-14T15:56:23.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.557+0000 7f0dac1ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da41f31b0 con 0x7f0da40b54b0 2023-07-14T15:56:23.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.557+0000 7f0dac1ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0da41f3490 con 0x7f0da40b85f0 2023-07-14T15:56:23.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.557+0000 7f0da9f9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0da40b4910 0x7f0da4149520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:23.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.557+0000 7f0da9f9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0da40b4910 0x7f0da4149520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33844/0 (socket says 172.21.15.37:33844) 2023-07-14T15:56:23.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.557+0000 7f0da9f9b700 1 -- 172.21.15.37:0/3146840073 learned_addr learned my addr 172.21.15.37:0/3146840073 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:23.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.558+0000 7f0da979a700 1 --2- 172.21.15.37:0/3146840073 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0da40b54b0 0x7f0da40a9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:23.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.558+0000 7f0daa79c700 1 --2- 172.21.15.37:0/3146840073 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0da40b85f0 0x7f0da40d0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:23.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.558+0000 7f0da9f9b700 1 -- 172.21.15.37:0/3146840073 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0da40b85f0 msgr2=0x7f0da40d0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:23.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.558+0000 7f0da9f9b700 1 --2- 172.21.15.37:0/3146840073 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0da40b85f0 0x7f0da40d0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:23.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.558+0000 7f0da9f9b700 1 -- 172.21.15.37:0/3146840073 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0da40b54b0 msgr2=0x7f0da40a9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:23.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.558+0000 7f0da9f9b700 1 --2- 172.21.15.37:0/3146840073 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0da40b54b0 0x7f0da40a9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:23.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.558+0000 7f0da9f9b700 1 -- 172.21.15.37:0/3146840073 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d9c009b30 con 0x7f0da40b4910 2023-07-14T15:56:23.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.558+0000 7f0da979a700 1 --2- 172.21.15.37:0/3146840073 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0da40b54b0 0x7f0da40a9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:56:23.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.558+0000 7f0daa79c700 1 --2- 172.21.15.37:0/3146840073 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0da40b85f0 0x7f0da40d0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:56:23.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.558+0000 7f0da9f9b700 1 --2- 172.21.15.37:0/3146840073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0da40b4910 0x7f0da4149520 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0da000e9b0 tx=0x7f0da000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:23.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.558+0000 7f0d9a7fc700 1 -- 172.21.15.37:0/3146840073 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da0009710 con 0x7f0da40b4910 2023-07-14T15:56:23.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.558+0000 7f0d9a7fc700 1 -- 172.21.15.37:0/3146840073 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da000c850 con 0x7f0da40b4910 2023-07-14T15:56:23.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.558+0000 7f0dac1ff700 1 -- 172.21.15.37:0/3146840073 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0da41f3770 con 0x7f0da40b4910 2023-07-14T15:56:23.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.558+0000 7f0d9a7fc700 1 -- 172.21.15.37:0/3146840073 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da000cbc0 con 0x7f0da40b4910 2023-07-14T15:56:23.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.558+0000 7f0dac1ff700 1 -- 172.21.15.37:0/3146840073 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0da41f3d30 con 0x7f0da40b4910 2023-07-14T15:56:23.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.559+0000 7f0dac1ff700 1 -- 172.21.15.37:0/3146840073 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0da4067840 con 0x7f0da40b4910 2023-07-14T15:56:23.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.560+0000 7f0d9a7fc700 1 -- 172.21.15.37:0/3146840073 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0da000cd20 con 0x7f0da40b4910 2023-07-14T15:56:23.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.561+0000 7f0d9a7fc700 1 --2- 172.21.15.37:0/3146840073 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0d8806ace0 0x7f0d8806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:23.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.561+0000 7f0d9a7fc700 1 -- 172.21.15.37:0/3146840073 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0da0089630 con 0x7f0da40b4910 2023-07-14T15:56:23.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.562+0000 7f0da979a700 1 --2- 172.21.15.37:0/3146840073 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0d8806ace0 0x7f0d8806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:23.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.562+0000 7f0da979a700 1 --2- 172.21.15.37:0/3146840073 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0d8806ace0 0x7f0d8806d190 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0da40d3fb0 tx=0x7f0d94008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:23.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.565+0000 7f0d9a7fc700 1 -- 172.21.15.37:0/3146840073 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0da00580d0 con 0x7f0da40b4910 2023-07-14T15:56:23.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.773+0000 7f0dac1ff700 1 -- 172.21.15.37:0/3146840073 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0da406b440 con 0x7f0da40b4910 2023-07-14T15:56:23.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.774+0000 7f0d9a7fc700 1 -- 172.21.15.37:0/3146840073 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18341 (secure 0 0 0) 0x7f0da0057c60 con 0x7f0da40b4910 2023-07-14T15:56:23.761 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:56:23.761 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"fsid":"9da30401-a779-4e46-aba6-00c2494c6c67","created":"2023-07-14T15:55:39.898867+0000","modified":"2023-07-14T15:56:09.959850+0000","last_up_change":"2023-07-14T15:55:53.025696+0000","last_in_change":"2023-07-14T15:55:43.388192+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T15:55:52.907261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T15:55:59.992839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T15:56:06.091064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T15:56:07.448694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d049535-7b87-4276-8fe5-0f74ba422d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6801","nonce":2783032392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6803","nonce":2783032392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6807","nonce":2783032392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6805","nonce":2783032392}]},"public_addr":"172.21.15.37:6801/2783032392","cluster_addr":"172.21.15.37:6803/2783032392","heartbeat_back_addr":"172.21.15.37:6807/2783032392","heartbeat_front_addr":"172.21.15.37:6805/2783032392","state":["exists","up"]},{"osd":1,"uuid":"79ec948d-ead2-4c2d-923a-dd6eeaac9dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6823","nonce":1190059746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6826","nonce":1190059746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6831","nonce":1190059746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6829","nonce":1190059746}]},"public_addr":"172.21.15.37:6823/1190059746","cluster_addr":"172.21.15.37:6826/1190059746","heartbeat_back_addr":"172.21.15.37:6831/1190059746","heartbeat_front_addr":"172.21.15.37:6829/1190059746","state":["exists","up"]},{"osd":2,"uuid":"a1db6690-c160-4366-9c82-2cca17e4bba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6809","nonce":2266223499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6813","nonce":2266223499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6820","nonce":2266223499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6816","nonce":2266223499}]},"public_addr":"172.21.15.37:6809/2266223499","cluster_addr":"172.21.15.37:6813/2266223499","heartbeat_back_addr":"172.21.15.37:6820/2266223499","heartbeat_front_addr":"172.21.15.37:6816/2266223499","state":["exists","up"]},{"osd":3,"uuid":"767b8220-e79a-4a86-a162-6b3b73198379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6812","nonce":4166694594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6817","nonce":4166694594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6828","nonce":4166694594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6822","nonce":4166694594}]},"public_addr":"172.21.15.37:6812/4166694594","cluster_addr":"172.21.15.37:6817/4166694594","heartbeat_back_addr":"172.21.15.37:6828/4166694594","heartbeat_front_addr":"172.21.15.37:6822/4166694594","state":["exists","up"]},{"osd":4,"uuid":"717bd773-ae7e-4236-ac79-900cf99a37c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6801","nonce":3529020407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6803","nonce":3529020407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6807","nonce":3529020407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6805","nonce":3529020407}]},"public_addr":"172.21.15.98:6801/3529020407","cluster_addr":"172.21.15.98:6803/3529020407","heartbeat_back_addr":"172.21.15.98:6807/3529020407","heartbeat_front_addr":"172.21.15.98:6805/3529020407","state":["exists","up"]},{"osd":5,"uuid":"a941d358-0f03-4136-a9b2-3a1c2e9358cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6817","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6819","nonce":2311501838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6821","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6823","nonce":2311501838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6829","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6831","nonce":2311501838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6825","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6827","nonce":2311501838}]},"public_addr":"172.21.15.98:6819/2311501838","cluster_addr":"172.21.15.98:6823/2311501838","heartbeat_back_addr":"172.21.15.98:6831/2311501838","heartbeat_front_addr":"172.21.15.98:6827/2311501838","state":["exists","up"]},{"osd":6,"uuid":"27153772-6d4b-479d-9953-0582e7b96743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6809","nonce":1144224691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6811","nonce":1144224691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6815","nonce":1144224691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6813","nonce":1144224691}]},"public_addr":"172.21.15.98:6809/1144224691","cluster_addr":"172.21.15.98:6811/1144224691","heartbeat_back_addr":"172.21.15.98:6815/1144224691","heartbeat_front_addr":"172.21.15.98:6813/1144224691","state":["exists","up"]},{"osd":7,"uuid":"d21ffc8e-40bb-47eb-af2c-e3e730d3fb76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6818","nonce":1144470927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6822","nonce":1144470927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6830","nonce":1144470927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6826","nonce":1144470927}]},"public_addr":"172.21.15.98:6818/1144470927","cluster_addr":"172.21.15.98:6822/1144470927","heartbeat_back_addr":"172.21.15.98:6830/1144470927","heartbeat_front_addr":"172.21.15.98:6826/1144470927","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.921114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.739210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.024016+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.002527+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.698127+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.813416+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.709351+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.815457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T15:56:23.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.776+0000 7f0dac1ff700 1 -- 172.21.15.37:0/3146840073 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0d8806ace0 msgr2=0x7f0d8806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:23.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.776+0000 7f0dac1ff700 1 --2- 172.21.15.37:0/3146840073 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0d8806ace0 0x7f0d8806d190 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0da40d3fb0 tx=0x7f0d94008040 comp rx=0 tx=0).stop 2023-07-14T15:56:23.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.776+0000 7f0dac1ff700 1 -- 172.21.15.37:0/3146840073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0da40b4910 msgr2=0x7f0da4149520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:23.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.776+0000 7f0dac1ff700 1 --2- 172.21.15.37:0/3146840073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0da40b4910 0x7f0da4149520 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0da000e9b0 tx=0x7f0da000ed70 comp rx=0 tx=0).stop 2023-07-14T15:56:23.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.776+0000 7f0dac1ff700 1 -- 172.21.15.37:0/3146840073 shutdown_connections 2023-07-14T15:56:23.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.776+0000 7f0dac1ff700 1 --2- 172.21.15.37:0/3146840073 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0d8806ace0 0x7f0d8806d190 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:23.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.776+0000 7f0dac1ff700 1 --2- 172.21.15.37:0/3146840073 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0da40b85f0 0x7f0da40d0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:23.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.776+0000 7f0dac1ff700 1 --2- 172.21.15.37:0/3146840073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0da40b4910 0x7f0da4149520 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:23.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.776+0000 7f0dac1ff700 1 --2- 172.21.15.37:0/3146840073 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0da40b54b0 0x7f0da40a9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:23.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.776+0000 7f0dac1ff700 1 -- 172.21.15.37:0/3146840073 >> 172.21.15.37:0/3146840073 conn(0x7f0da406a580 msgr2=0x7f0da415c240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:23.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.776+0000 7f0dac1ff700 1 -- 172.21.15.37:0/3146840073 shutdown_connections 2023-07-14T15:56:23.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:23.777+0000 7f0dac1ff700 1 -- 172.21.15.37:0/3146840073 wait complete. 2023-07-14T15:56:23.781 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T15:55:52.907261+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T15:55:59.992839+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T15:56:06.091064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T15:56:07.448694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T15:56:23.782 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T15:56:23.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.002+0000 7fa1e01ff700 1 Processor -- start 2023-07-14T15:56:23.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.003+0000 7fa1e01ff700 1 -- start start 2023-07-14T15:56:23.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.004+0000 7fa1e01ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa1d815fee0 0x7fa1d815ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:23.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.004+0000 7fa1e01ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa1d80d1140 0x7fa1d80b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:23.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.004+0000 7fa1e01ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1d815dc50 con 0x7fa1d81603b0 2023-07-14T15:56:23.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.004+0000 7fa1e01ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1d80b2940 con 0x7fa1d80d1140 2023-07-14T15:56:23.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.004+0000 7fa1e01ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d80b2c20 con 0x7fa1d815fee0 2023-07-14T15:56:23.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.005+0000 7fa1ddf9b700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa1d815fee0 0x7fa1d815ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:23.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.005+0000 7fa1de79c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa1d80d1140 0x7fa1d80b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:23.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.005+0000 7fa1ddf9b700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa1d815fee0 0x7fa1d815ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3301/0 says I am v2:172.21.15.37:44706/0 (socket says 172.21.15.37:44706) 2023-07-14T15:56:23.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.005+0000 7fa1de79c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa1d80d1140 0x7fa1d80b39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.37:43080/0 (socket says 172.21.15.37:43080) 2023-07-14T15:56:23.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.005+0000 7fa1ddf9b700 1 -- 172.21.15.37:0/2731758036 learned_addr learned my addr 172.21.15.37:0/2731758036 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:23.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.005+0000 7fa1dcf99700 1 -- 172.21.15.37:0/2731758036 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 276934509 0 0) 0x7fa1d815dc50 con 0x7fa1d81603b0 2023-07-14T15:56:23.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.005+0000 7fa1ddf9b700 1 -- 172.21.15.37:0/2731758036 >> v2:172.21.15.98:3300/0 conn(0x7fa1d80d1140 msgr2=0x7fa1d80b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:23.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.005+0000 7fa1ddf9b700 1 --2- 172.21.15.37:0/2731758036 >> v2:172.21.15.98:3300/0 conn(0x7fa1d80d1140 0x7fa1d80b39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:23.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.005+0000 7fa1ddf9b700 1 -- 172.21.15.37:0/2731758036 >> v1:172.21.15.98:6789/0 conn(0x7fa1d81603b0 legacy=0x7fa1d80d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:23.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.005+0000 7fa1ddf9b700 1 -- 172.21.15.37:0/2731758036 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d80b2f00 con 0x7fa1d815fee0 2023-07-14T15:56:23.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.005+0000 7fa1de79c700 1 --2- 172.21.15.37:0/2731758036 >> v2:172.21.15.98:3300/0 conn(0x7fa1d80d1140 0x7fa1d80b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:56:23.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.006+0000 7fa1ddf9b700 1 --2- 172.21.15.37:0/2731758036 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa1d815fee0 0x7fa1d815ded0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa1d40098f0 tx=0x7fa1d4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cd34e77f63d7c80 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:23.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.006+0000 7fa1dcf99700 1 -- 172.21.15.37:0/2731758036 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d4011830 con 0x7fa1d815fee0 2023-07-14T15:56:23.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.006+0000 7fa1dcf99700 1 -- 172.21.15.37:0/2731758036 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d4011990 con 0x7fa1d815fee0 2023-07-14T15:56:23.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.006+0000 7fa1dcf99700 1 -- 172.21.15.37:0/2731758036 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d4011d20 con 0x7fa1d815fee0 2023-07-14T15:56:23.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.006+0000 7fa1e01ff700 1 -- 172.21.15.37:0/2731758036 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa1d815fee0 msgr2=0x7fa1d815ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:23.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.006+0000 7fa1e01ff700 1 --2- 172.21.15.37:0/2731758036 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa1d815fee0 0x7fa1d815ded0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa1d40098f0 tx=0x7fa1d4009c00 comp rx=0 tx=0).stop 2023-07-14T15:56:23.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.006+0000 7fa1e01ff700 1 -- 172.21.15.37:0/2731758036 shutdown_connections 2023-07-14T15:56:23.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.006+0000 7fa1e01ff700 1 --2- 172.21.15.37:0/2731758036 >> v2:172.21.15.98:3300/0 conn(0x7fa1d80d1140 0x7fa1d80b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:23.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.006+0000 7fa1e01ff700 1 --2- 172.21.15.37:0/2731758036 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa1d815fee0 0x7fa1d815ded0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:23.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.006+0000 7fa1e01ff700 1 -- 172.21.15.37:0/2731758036 >> 172.21.15.37:0/2731758036 conn(0x7fa1d809c1b0 msgr2=0x7fa1d80d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:23.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.007+0000 7fa1e01ff700 1 -- 172.21.15.37:0/2731758036 shutdown_connections 2023-07-14T15:56:23.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.007+0000 7fa1e01ff700 1 -- 172.21.15.37:0/2731758036 wait complete. 2023-07-14T15:56:23.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.008+0000 7fa1e01ff700 1 Processor -- start 2023-07-14T15:56:23.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.008+0000 7fa1e01ff700 1 -- start start 2023-07-14T15:56:23.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.009+0000 7fa1e01ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1d80d1140 0x7fa1d80c9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:23.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.009+0000 7fa1e01ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa1d815fee0 0x7fa1d80c64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:23.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.009+0000 7fa1e01ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1d81603b0 0x7fa1d80b8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:23.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.010+0000 7fa1e01ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d80c6a30 con 0x7fa1d81603b0 2023-07-14T15:56:23.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.010+0000 7fa1e01ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d80b0df0 con 0x7fa1d80d1140 2023-07-14T15:56:23.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.010+0000 7fa1e01ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d80b04c0 con 0x7fa1d815fee0 2023-07-14T15:56:23.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.010+0000 7fa1ddf9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1d80d1140 0x7fa1d80c9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:23.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.010+0000 7fa1de79c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1d81603b0 0x7fa1d80b8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:24.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.010+0000 7fa1ddf9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1d80d1140 0x7fa1d80c9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.37:43084/0 (socket says 172.21.15.37:43084) 2023-07-14T15:56:24.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.010+0000 7fa1ddf9b700 1 -- 172.21.15.37:0/1372226238 learned_addr learned my addr 172.21.15.37:0/1372226238 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:24.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.010+0000 7fa1dd79a700 1 --2- 172.21.15.37:0/1372226238 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa1d815fee0 0x7fa1d80c64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:24.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.010+0000 7fa1ddf9b700 1 -- 172.21.15.37:0/1372226238 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa1d815fee0 msgr2=0x7fa1d80c64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:24.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.010+0000 7fa1ddf9b700 1 --2- 172.21.15.37:0/1372226238 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa1d815fee0 0x7fa1d80c64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:24.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.010+0000 7fa1ddf9b700 1 -- 172.21.15.37:0/1372226238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1d81603b0 msgr2=0x7fa1d80b8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:24.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.010+0000 7fa1ddf9b700 1 --2- 172.21.15.37:0/1372226238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1d81603b0 0x7fa1d80b8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:24.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.010+0000 7fa1ddf9b700 1 -- 172.21.15.37:0/1372226238 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d0009a70 con 0x7fa1d80d1140 2023-07-14T15:56:24.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.010+0000 7fa1de79c700 1 --2- 172.21.15.37:0/1372226238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1d81603b0 0x7fa1d80b8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:56:24.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.011+0000 7fa1ddf9b700 1 --2- 172.21.15.37:0/1372226238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1d80d1140 0x7fa1d80c9390 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa1d80b2d60 tx=0x7fa1d4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:24.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.011+0000 7fa1ce7fc700 1 -- 172.21.15.37:0/1372226238 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d40042c0 con 0x7fa1d80d1140 2023-07-14T15:56:24.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.011+0000 7fa1ce7fc700 1 -- 172.21.15.37:0/1372226238 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d401f070 con 0x7fa1d80d1140 2023-07-14T15:56:24.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.011+0000 7fa1ce7fc700 1 -- 172.21.15.37:0/1372226238 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d40036a0 con 0x7fa1d80d1140 2023-07-14T15:56:24.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.011+0000 7fa1e01ff700 1 -- 172.21.15.37:0/1372226238 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1d4009550 con 0x7fa1d80d1140 2023-07-14T15:56:24.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.011+0000 7fa1e01ff700 1 -- 172.21.15.37:0/1372226238 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1d80b0a80 con 0x7fa1d80d1140 2023-07-14T15:56:24.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.012+0000 7fa1e01ff700 1 -- 172.21.15.37:0/1372226238 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1d80d2a00 con 0x7fa1d80d1140 2023-07-14T15:56:24.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.013+0000 7fa1ce7fc700 1 -- 172.21.15.37:0/1372226238 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa1d4021030 con 0x7fa1d80d1140 2023-07-14T15:56:24.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.014+0000 7fa1ce7fc700 1 --2- 172.21.15.37:0/1372226238 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa1bc06ace0 0x7fa1bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:24.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.014+0000 7fa1ce7fc700 1 -- 172.21.15.37:0/1372226238 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa1d408ac10 con 0x7fa1d80d1140 2023-07-14T15:56:24.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.015+0000 7fa1dd79a700 1 --2- 172.21.15.37:0/1372226238 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa1bc06ace0 0x7fa1bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:24.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.015+0000 7fa1dd79a700 1 --2- 172.21.15.37:0/1372226238 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa1bc06ace0 0x7fa1bc06d190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8155a80 tx=0x7fa1c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:24.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.018+0000 7fa1ce7fc700 1 -- 172.21.15.37:0/1372226238 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa1d4055d30 con 0x7fa1d80d1140 2023-07-14T15:56:24.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.224+0000 7fa1e01ff700 1 -- 172.21.15.37:0/1372226238 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa1d8067840 con 0x7fa1d80d1140 2023-07-14T15:56:24.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.225+0000 7fa1ce7fc700 1 -- 172.21.15.37:0/1372226238 <== mon.1 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa1d40150a0 con 0x7fa1d80d1140 2023-07-14T15:56:24.212 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-14T15:56:24.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.227+0000 7fa1e01ff700 1 -- 172.21.15.37:0/1372226238 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa1bc06ace0 msgr2=0x7fa1bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:24.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.227+0000 7fa1e01ff700 1 --2- 172.21.15.37:0/1372226238 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa1bc06ace0 0x7fa1bc06d190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8155a80 tx=0x7fa1c8009040 comp rx=0 tx=0).stop 2023-07-14T15:56:24.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.227+0000 7fa1e01ff700 1 -- 172.21.15.37:0/1372226238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1d80d1140 msgr2=0x7fa1d80c9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:24.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.227+0000 7fa1e01ff700 1 --2- 172.21.15.37:0/1372226238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1d80d1140 0x7fa1d80c9390 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa1d80b2d60 tx=0x7fa1d4004750 comp rx=0 tx=0).stop 2023-07-14T15:56:24.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.227+0000 7fa1e01ff700 1 -- 172.21.15.37:0/1372226238 shutdown_connections 2023-07-14T15:56:24.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.227+0000 7fa1e01ff700 1 --2- 172.21.15.37:0/1372226238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1d80d1140 0x7fa1d80c9390 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:24.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.227+0000 7fa1e01ff700 1 --2- 172.21.15.37:0/1372226238 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa1bc06ace0 0x7fa1bc06d190 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:24.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.227+0000 7fa1e01ff700 1 --2- 172.21.15.37:0/1372226238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1d81603b0 0x7fa1d80b8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:24.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.227+0000 7fa1e01ff700 1 --2- 172.21.15.37:0/1372226238 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa1d815fee0 0x7fa1d80c64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:24.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.227+0000 7fa1e01ff700 1 -- 172.21.15.37:0/1372226238 >> 172.21.15.37:0/1372226238 conn(0x7fa1d809c1b0 msgr2=0x7fa1d815f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:24.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.227+0000 7fa1e01ff700 1 -- 172.21.15.37:0/1372226238 shutdown_connections 2023-07-14T15:56:24.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.227+0000 7fa1e01ff700 1 -- 172.21.15.37:0/1372226238 wait complete. 2023-07-14T15:56:24.232 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T15:56:24.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.449+0000 7fef29fff700 1 Processor -- start 2023-07-14T15:56:24.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.449+0000 7fef29fff700 1 -- start start 2023-07-14T15:56:24.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.451+0000 7fef29fff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fef240cfd50 0x7fef240d2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:24.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.451+0000 7fef29fff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef240b1610 con 0x7fef240b1e80 2023-07-14T15:56:24.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.451+0000 7fef29fff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef240b1840 con 0x7fef240b0ac0 2023-07-14T15:56:24.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.451+0000 7fef29fff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef2415ccf0 con 0x7fef240cfd50 2023-07-14T15:56:24.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.451+0000 7fef22ffd700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fef240b1e80 0x7fef240b2d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37340/0 (socket says 172.21.15.37:37340) 2023-07-14T15:56:24.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.451+0000 7fef22ffd700 1 -- 172.21.15.37:0/1904650933 learned_addr learned my addr 172.21.15.37:0/1904650933 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:24.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.451+0000 7fef237fe700 1 --2- 172.21.15.37:0/1904650933 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fef240cfd50 0x7fef240d2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:24.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.451+0000 7fef227fc700 1 -- 172.21.15.37:0/1904650933 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 781268866 0 0) 0x7fef240b1610 con 0x7fef240b1e80 2023-07-14T15:56:24.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.451+0000 7fef227fc700 1 -- 172.21.15.37:0/1904650933 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef0c0035b0 con 0x7fef240b1e80 2023-07-14T15:56:24.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.452+0000 7fef227fc700 1 -- 172.21.15.37:0/1904650933 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3802742682 0 0) 0x7fef240b1840 con 0x7fef240b0ac0 2023-07-14T15:56:24.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.452+0000 7fef227fc700 1 -- 172.21.15.37:0/1904650933 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef240b1610 con 0x7fef240b0ac0 2023-07-14T15:56:24.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.452+0000 7fef227fc700 1 -- 172.21.15.37:0/1904650933 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 843375436 0 0) 0x7fef0c0035b0 con 0x7fef240b1e80 2023-07-14T15:56:24.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.452+0000 7fef237fe700 1 -- 172.21.15.37:0/1904650933 >> v1:172.21.15.98:6789/0 conn(0x7fef240b0ac0 legacy=0x7fef240b0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:24.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.452+0000 7fef237fe700 1 -- 172.21.15.37:0/1904650933 >> v1:172.21.15.37:6789/0 conn(0x7fef240b1e80 legacy=0x7fef240b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:24.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.452+0000 7fef237fe700 1 -- 172.21.15.37:0/1904650933 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef240b2550 con 0x7fef240cfd50 2023-07-14T15:56:24.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.452+0000 7fef237fe700 1 --2- 172.21.15.37:0/1904650933 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fef240cfd50 0x7fef240d2880 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fef140098a0 tx=0x7fef14009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98cca97e65e72258 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:24.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.452+0000 7fef227fc700 1 -- 172.21.15.37:0/1904650933 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef18001670 con 0x7fef240cfd50 2023-07-14T15:56:24.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.452+0000 7fef227fc700 1 -- 172.21.15.37:0/1904650933 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef14004030 con 0x7fef240cfd50 2023-07-14T15:56:24.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.452+0000 7fef227fc700 1 -- 172.21.15.37:0/1904650933 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef140043c0 con 0x7fef240cfd50 2023-07-14T15:56:24.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.453+0000 7fef29fff700 1 -- 172.21.15.37:0/1904650933 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fef240cfd50 msgr2=0x7fef240d2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:24.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.453+0000 7fef29fff700 1 --2- 172.21.15.37:0/1904650933 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fef240cfd50 0x7fef240d2880 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fef140098a0 tx=0x7fef14009bb0 comp rx=0 tx=0).stop 2023-07-14T15:56:24.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.453+0000 7fef29fff700 1 -- 172.21.15.37:0/1904650933 shutdown_connections 2023-07-14T15:56:24.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.453+0000 7fef29fff700 1 --2- 172.21.15.37:0/1904650933 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fef240cfd50 0x7fef240d2880 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:24.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.453+0000 7fef29fff700 1 -- 172.21.15.37:0/1904650933 >> 172.21.15.37:0/1904650933 conn(0x7fef2409c1c0 msgr2=0x7fef240d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:24.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.453+0000 7fef29fff700 1 -- 172.21.15.37:0/1904650933 shutdown_connections 2023-07-14T15:56:24.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.453+0000 7fef29fff700 1 -- 172.21.15.37:0/1904650933 wait complete. 2023-07-14T15:56:24.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.455+0000 7fef29fff700 1 Processor -- start 2023-07-14T15:56:24.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.456+0000 7fef29fff700 1 -- start start 2023-07-14T15:56:24.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.457+0000 7fef29fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef240b0ac0 0x7fef241e5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:24.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.457+0000 7fef29fff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fef240b1e80 0x7fef241544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:24.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.457+0000 7fef29fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef240cfd50 0x7fef24156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:24.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.457+0000 7fef29fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef241e4390 con 0x7fef240cfd50 2023-07-14T15:56:24.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.457+0000 7fef29fff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef241e4670 con 0x7fef240b0ac0 2023-07-14T15:56:24.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.457+0000 7fef29fff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef241e4950 con 0x7fef240b1e80 2023-07-14T15:56:24.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.457+0000 7fef23fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef240cfd50 0x7fef24156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:24.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.457+0000 7fef237fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef240b0ac0 0x7fef241e5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:24.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.457+0000 7fef22ffd700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fef240b1e80 0x7fef241544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:24.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.457+0000 7fef237fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef240b0ac0 0x7fef241e5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.37:43092/0 (socket says 172.21.15.37:43092) 2023-07-14T15:56:24.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.457+0000 7fef23fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef240cfd50 0x7fef24156a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33876/0 (socket says 172.21.15.37:33876) 2023-07-14T15:56:24.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.457+0000 7fef237fe700 1 -- 172.21.15.37:0/783624766 learned_addr learned my addr 172.21.15.37:0/783624766 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:24.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.458+0000 7fef22ffd700 1 -- 172.21.15.37:0/783624766 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef240b0ac0 msgr2=0x7fef241e5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:24.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.458+0000 7fef22ffd700 1 --2- 172.21.15.37:0/783624766 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef240b0ac0 0x7fef241e5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:24.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.458+0000 7fef22ffd700 1 -- 172.21.15.37:0/783624766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef240cfd50 msgr2=0x7fef24156a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:24.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.458+0000 7fef22ffd700 1 --2- 172.21.15.37:0/783624766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef240cfd50 0x7fef24156a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:24.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.458+0000 7fef22ffd700 1 -- 172.21.15.37:0/783624766 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef140094a0 con 0x7fef240b1e80 2023-07-14T15:56:24.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.458+0000 7fef237fe700 1 --2- 172.21.15.37:0/783624766 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef240b0ac0 0x7fef241e5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:56:24.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.458+0000 7fef23fff700 1 --2- 172.21.15.37:0/783624766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef240cfd50 0x7fef24156a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:56:24.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.458+0000 7fef22ffd700 1 --2- 172.21.15.37:0/783624766 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fef240b1e80 0x7fef241544c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fef18001380 tx=0x7fef1800ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:24.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.458+0000 7fef0bfff700 1 -- 172.21.15.37:0/783624766 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef18004c80 con 0x7fef240b1e80 2023-07-14T15:56:24.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.458+0000 7fef0bfff700 1 -- 172.21.15.37:0/783624766 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef18004de0 con 0x7fef240b1e80 2023-07-14T15:56:24.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.458+0000 7fef29fff700 1 -- 172.21.15.37:0/783624766 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef240d02a0 con 0x7fef240b1e80 2023-07-14T15:56:24.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.458+0000 7fef0bfff700 1 -- 172.21.15.37:0/783624766 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef180072d0 con 0x7fef240b1e80 2023-07-14T15:56:24.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.458+0000 7fef29fff700 1 -- 172.21.15.37:0/783624766 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef241e4f10 con 0x7fef240b1e80 2023-07-14T15:56:24.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.459+0000 7fef29fff700 1 -- 172.21.15.37:0/783624766 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef241e5100 con 0x7fef240b1e80 2023-07-14T15:56:24.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.461+0000 7fef0bfff700 1 -- 172.21.15.37:0/783624766 <== mon.2 v2:172.21.15.98:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fef18007430 con 0x7fef240b1e80 2023-07-14T15:56:24.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.461+0000 7fef0bfff700 1 --2- 172.21.15.37:0/783624766 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fef1006ace0 0x7fef1006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:24.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.462+0000 7fef0bfff700 1 -- 172.21.15.37:0/783624766 <== mon.2 v2:172.21.15.98:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fef180890f0 con 0x7fef240b1e80 2023-07-14T15:56:24.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.462+0000 7fef237fe700 1 --2- 172.21.15.37:0/783624766 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fef1006ace0 0x7fef1006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:24.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.462+0000 7fef237fe700 1 --2- 172.21.15.37:0/783624766 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fef1006ace0 0x7fef1006d190 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fef14009bf0 tx=0x7fef14008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:24.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.467+0000 7fef0bfff700 1 -- 172.21.15.37:0/783624766 <== mon.2 v2:172.21.15.98:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fef18054190 con 0x7fef240b1e80 2023-07-14T15:56:24.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.671+0000 7fef29fff700 1 -- 172.21.15.37:0/783624766 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fef24067840 con 0x7fef240b1e80 2023-07-14T15:56:24.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.673+0000 7fef0bfff700 1 -- 172.21.15.37:0/783624766 <== mon.2 v2:172.21.15.98:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fef180577b0 con 0x7fef240b1e80 2023-07-14T15:56:24.660 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-14T15:56:24.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.675+0000 7fef29fff700 1 -- 172.21.15.37:0/783624766 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fef1006ace0 msgr2=0x7fef1006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:24.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.675+0000 7fef29fff700 1 --2- 172.21.15.37:0/783624766 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fef1006ace0 0x7fef1006d190 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fef14009bf0 tx=0x7fef14008030 comp rx=0 tx=0).stop 2023-07-14T15:56:24.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.675+0000 7fef29fff700 1 -- 172.21.15.37:0/783624766 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fef240b1e80 msgr2=0x7fef241544c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:24.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.675+0000 7fef29fff700 1 --2- 172.21.15.37:0/783624766 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fef240b1e80 0x7fef241544c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fef18001380 tx=0x7fef1800ca30 comp rx=0 tx=0).stop 2023-07-14T15:56:24.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.675+0000 7fef29fff700 1 -- 172.21.15.37:0/783624766 shutdown_connections 2023-07-14T15:56:24.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.675+0000 7fef29fff700 1 --2- 172.21.15.37:0/783624766 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef240b0ac0 0x7fef241e5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:24.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.676+0000 7fef29fff700 1 --2- 172.21.15.37:0/783624766 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fef1006ace0 0x7fef1006d190 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:24.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.676+0000 7fef29fff700 1 --2- 172.21.15.37:0/783624766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef240cfd50 0x7fef24156a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:24.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.676+0000 7fef29fff700 1 --2- 172.21.15.37:0/783624766 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fef240b1e80 0x7fef241544c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:24.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.676+0000 7fef29fff700 1 -- 172.21.15.37:0/783624766 >> 172.21.15.37:0/783624766 conn(0x7fef2409c1c0 msgr2=0x7fef240b42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:24.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.676+0000 7fef29fff700 1 -- 172.21.15.37:0/783624766 shutdown_connections 2023-07-14T15:56:24.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.676+0000 7fef29fff700 1 -- 172.21.15.37:0/783624766 wait complete. 2023-07-14T15:56:24.680 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T15:56:24.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.897+0000 7f47631ff700 1 Processor -- start 2023-07-14T15:56:24.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.898+0000 7f47631ff700 1 -- start start 2023-07-14T15:56:24.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.899+0000 7f47631ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f475c0cdd10 0x7f475c160d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:24.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.899+0000 7f47631ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f475c0afd00 0x7f475c0cf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:24.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.899+0000 7f47631ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f475c0cfb60 0x7f475c0cffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:24.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.899+0000 7f47631ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f475c0cf800 con 0x7f475c0cfb60 2023-07-14T15:56:24.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.899+0000 7f47631ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f475c0d0500 con 0x7f475c0afd00 2023-07-14T15:56:24.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.899+0000 7f47631ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f475c0ce0e0 con 0x7f475c0cdd10 2023-07-14T15:56:24.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.900+0000 7f476179c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f475c0cfb60 0x7f475c0cffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:24.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.900+0000 7f476179c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f475c0cfb60 0x7f475c0cffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33878/0 (socket says 172.21.15.37:33878) 2023-07-14T15:56:24.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.900+0000 7f476179c700 1 -- 172.21.15.37:0/907391513 learned_addr learned my addr 172.21.15.37:0/907391513 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:24.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.900+0000 7f475bfff700 1 --2- 172.21.15.37:0/907391513 >> v2:172.21.15.98:3300/0 conn(0x7f475c0afd00 0x7f475c0cf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:24.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.900+0000 7f4760f9b700 1 --2- 172.21.15.37:0/907391513 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f475c0cdd10 0x7f475c160d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:24.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.900+0000 7f476179c700 1 -- 172.21.15.37:0/907391513 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f475c0cdd10 msgr2=0x7f475c160d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:24.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.900+0000 7f476179c700 1 --2- 172.21.15.37:0/907391513 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f475c0cdd10 0x7f475c160d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:24.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.900+0000 7f476179c700 1 -- 172.21.15.37:0/907391513 >> v2:172.21.15.98:3300/0 conn(0x7f475c0afd00 msgr2=0x7f475c0cf2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:24.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.900+0000 7f476179c700 1 --2- 172.21.15.37:0/907391513 >> v2:172.21.15.98:3300/0 conn(0x7f475c0afd00 0x7f475c0cf2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:24.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.900+0000 7f476179c700 1 -- 172.21.15.37:0/907391513 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f475c1608c0 con 0x7f475c0cfb60 2023-07-14T15:56:24.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.900+0000 7f475bfff700 1 --2- 172.21.15.37:0/907391513 >> v2:172.21.15.98:3300/0 conn(0x7f475c0afd00 0x7f475c0cf2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:56:24.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.900+0000 7f476179c700 1 --2- 172.21.15.37:0/907391513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f475c0cfb60 0x7f475c0cffc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f475c0d1de0 tx=0x7f475400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecdd9b34de7ec16c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:24.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.901+0000 7f475b7fe700 1 -- 172.21.15.37:0/907391513 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475400e070 con 0x7f475c0cfb60 2023-07-14T15:56:24.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.901+0000 7f475b7fe700 1 -- 172.21.15.37:0/907391513 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475400b9c0 con 0x7f475c0cfb60 2023-07-14T15:56:24.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.901+0000 7f475b7fe700 1 -- 172.21.15.37:0/907391513 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475400bd70 con 0x7f475c0cfb60 2023-07-14T15:56:24.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.901+0000 7f47631ff700 1 -- 172.21.15.37:0/907391513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f475c0cfb60 msgr2=0x7f475c0cffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:24.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.901+0000 7f47631ff700 1 --2- 172.21.15.37:0/907391513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f475c0cfb60 0x7f475c0cffc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f475c0d1de0 tx=0x7f475400b330 comp rx=0 tx=0).stop 2023-07-14T15:56:24.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.901+0000 7f47631ff700 1 -- 172.21.15.37:0/907391513 shutdown_connections 2023-07-14T15:56:24.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.901+0000 7f47631ff700 1 --2- 172.21.15.37:0/907391513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f475c0cfb60 0x7f475c0cffc0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:24.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.901+0000 7f47631ff700 1 --2- 172.21.15.37:0/907391513 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f475c0cdd10 0x7f475c160d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:24.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.901+0000 7f47631ff700 1 --2- 172.21.15.37:0/907391513 >> v2:172.21.15.98:3300/0 conn(0x7f475c0afd00 0x7f475c0cf2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:24.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.901+0000 7f47631ff700 1 -- 172.21.15.37:0/907391513 >> 172.21.15.37:0/907391513 conn(0x7f475c066800 msgr2=0x7f475c06f410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:24.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.901+0000 7f47631ff700 1 -- 172.21.15.37:0/907391513 shutdown_connections 2023-07-14T15:56:24.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.901+0000 7f47631ff700 1 -- 172.21.15.37:0/907391513 wait complete. 2023-07-14T15:56:24.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.904+0000 7f47631ff700 1 Processor -- start 2023-07-14T15:56:24.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.904+0000 7f47631ff700 1 -- start start 2023-07-14T15:56:24.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.905+0000 7f47631ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f475c0cdd10 0x7f475c0b2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:24.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.905+0000 7f47631ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f475c0cfb60 0x7f475c0ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:24.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.905+0000 7f47631ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f475c0ae1e0 0x7f475c0aed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:24.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.905+0000 7f47631ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475c0add50 con 0x7f475c0cdd10 2023-07-14T15:56:24.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.905+0000 7f47631ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475c0ad140 con 0x7f475c0cfb60 2023-07-14T15:56:24.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.905+0000 7f47631ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f475c0ad420 con 0x7f475c0ae1e0 2023-07-14T15:56:24.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.905+0000 7f4760f9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f475c0cdd10 0x7f475c0b2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:24.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.906+0000 7f4760f9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f475c0cdd10 0x7f475c0b2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33890/0 (socket says 172.21.15.37:33890) 2023-07-14T15:56:24.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.906+0000 7f4760f9b700 1 -- 172.21.15.37:0/2203732775 learned_addr learned my addr 172.21.15.37:0/2203732775 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:24.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.906+0000 7f475bfff700 1 --2- 172.21.15.37:0/2203732775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f475c0cfb60 0x7f475c0ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:24.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.906+0000 7f476179c700 1 --2- 172.21.15.37:0/2203732775 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f475c0ae1e0 0x7f475c0aed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:24.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.906+0000 7f4760f9b700 1 -- 172.21.15.37:0/2203732775 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f475c0ae1e0 msgr2=0x7f475c0aed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:24.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.906+0000 7f4760f9b700 1 --2- 172.21.15.37:0/2203732775 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f475c0ae1e0 0x7f475c0aed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:24.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.906+0000 7f4760f9b700 1 -- 172.21.15.37:0/2203732775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f475c0cfb60 msgr2=0x7f475c0ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:24.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.906+0000 7f4760f9b700 1 --2- 172.21.15.37:0/2203732775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f475c0cfb60 0x7f475c0ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:24.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.906+0000 7f4760f9b700 1 -- 172.21.15.37:0/2203732775 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4754009b30 con 0x7f475c0cdd10 2023-07-14T15:56:24.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.906+0000 7f4760f9b700 1 --2- 172.21.15.37:0/2203732775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f475c0cdd10 0x7f475c0b2800 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f475000e810 tx=0x7f475000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:24.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.906+0000 7f47597fa700 1 -- 172.21.15.37:0/2203732775 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475000c070 con 0x7f475c0cdd10 2023-07-14T15:56:24.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.906+0000 7f47597fa700 1 -- 172.21.15.37:0/2203732775 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4750013610 con 0x7f475c0cdd10 2023-07-14T15:56:24.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.907+0000 7f47597fa700 1 -- 172.21.15.37:0/2203732775 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47500139c0 con 0x7f475c0cdd10 2023-07-14T15:56:24.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.907+0000 7f47631ff700 1 -- 172.21.15.37:0/2203732775 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f475c0ad700 con 0x7f475c0cdd10 2023-07-14T15:56:24.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.907+0000 7f47631ff700 1 -- 172.21.15.37:0/2203732775 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f475c0acdf0 con 0x7f475c0cdd10 2023-07-14T15:56:24.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.908+0000 7f47631ff700 1 -- 172.21.15.37:0/2203732775 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f475c15cac0 con 0x7f475c0cdd10 2023-07-14T15:56:24.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.909+0000 7f47597fa700 1 -- 172.21.15.37:0/2203732775 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4750013b20 con 0x7f475c0cdd10 2023-07-14T15:56:24.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.910+0000 7f47597fa700 1 --2- 172.21.15.37:0/2203732775 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f474006ace0 0x7f474006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:24.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.910+0000 7f47597fa700 1 -- 172.21.15.37:0/2203732775 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4750089260 con 0x7f475c0cdd10 2023-07-14T15:56:24.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.910+0000 7f475bfff700 1 --2- 172.21.15.37:0/2203732775 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f474006ace0 0x7f474006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:24.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.911+0000 7f475bfff700 1 --2- 172.21.15.37:0/2203732775 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f474006ace0 0x7f474006d190 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f475c1f5670 tx=0x7f4748008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:24.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:24.914+0000 7f47597fa700 1 -- 172.21.15.37:0/2203732775 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f475c15cac0 con 0x7f475c0cdd10 2023-07-14T15:56:25.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.125+0000 7f47631ff700 1 -- 172.21.15.37:0/2203732775 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f475c15cac0 con 0x7f475c0cdd10 2023-07-14T15:56:25.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.125+0000 7f47597fa700 1 -- 172.21.15.37:0/2203732775 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f475c15cac0 con 0x7f475c0cdd10 2023-07-14T15:56:25.112 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-14T15:56:25.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.128+0000 7f47631ff700 1 -- 172.21.15.37:0/2203732775 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f474006ace0 msgr2=0x7f474006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:25.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.128+0000 7f47631ff700 1 --2- 172.21.15.37:0/2203732775 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f474006ace0 0x7f474006d190 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f475c1f5670 tx=0x7f4748008040 comp rx=0 tx=0).stop 2023-07-14T15:56:25.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.128+0000 7f47631ff700 1 -- 172.21.15.37:0/2203732775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f475c0cdd10 msgr2=0x7f475c0b2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:25.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.128+0000 7f47631ff700 1 --2- 172.21.15.37:0/2203732775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f475c0cdd10 0x7f475c0b2800 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f475000e810 tx=0x7f475000eb20 comp rx=0 tx=0).stop 2023-07-14T15:56:25.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.128+0000 7f47631ff700 1 -- 172.21.15.37:0/2203732775 shutdown_connections 2023-07-14T15:56:25.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.128+0000 7f47631ff700 1 --2- 172.21.15.37:0/2203732775 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f474006ace0 0x7f474006d190 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:25.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.128+0000 7f47631ff700 1 --2- 172.21.15.37:0/2203732775 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f475c0ae1e0 0x7f475c0aed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:25.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.128+0000 7f47631ff700 1 --2- 172.21.15.37:0/2203732775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f475c0cdd10 0x7f475c0b2800 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:25.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.128+0000 7f47631ff700 1 --2- 172.21.15.37:0/2203732775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f475c0cfb60 0x7f475c0ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:25.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.128+0000 7f47631ff700 1 -- 172.21.15.37:0/2203732775 >> 172.21.15.37:0/2203732775 conn(0x7f475c0afd00 msgr2=0x7f475c0b3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:25.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.128+0000 7f47631ff700 1 -- 172.21.15.37:0/2203732775 shutdown_connections 2023-07-14T15:56:25.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.128+0000 7f47631ff700 1 -- 172.21.15.37:0/2203732775 wait complete. 2023-07-14T15:56:25.132 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T15:56:25.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.349+0000 7f8ce55ff700 1 Processor -- start 2023-07-14T15:56:25.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.350+0000 7f8ce55ff700 1 -- start start 2023-07-14T15:56:25.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.351+0000 7f8ce55ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f8ce015fee0 0x7f8ce015ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:25.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.351+0000 7f8ce55ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8ce00d1140 0x7f8ce00b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:25.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.351+0000 7f8ce55ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ce015dc50 con 0x7f8ce01603b0 2023-07-14T15:56:25.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.351+0000 7f8ce55ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ce00b2940 con 0x7f8ce00d1140 2023-07-14T15:56:25.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.351+0000 7f8ce55ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ce00b2c20 con 0x7f8ce015fee0 2023-07-14T15:56:25.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.351+0000 7f8cdf7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8ce00d1140 0x7f8ce00b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:25.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.351+0000 7f8cdf7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8ce00d1140 0x7f8ce00b39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33892/0 (socket says 172.21.15.37:33892) 2023-07-14T15:56:25.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.351+0000 7f8cdf7fe700 1 -- 172.21.15.37:0/381835178 learned_addr learned my addr 172.21.15.37:0/381835178 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:25.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.351+0000 7f8cdeffd700 1 --2- 172.21.15.37:0/381835178 >> v2:172.21.15.98:3300/0 conn(0x7f8ce015fee0 0x7f8ce015ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:25.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.351+0000 7f8cdf7fe700 1 -- 172.21.15.37:0/381835178 >> v2:172.21.15.98:3300/0 conn(0x7f8ce015fee0 msgr2=0x7f8ce015ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:25.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.351+0000 7f8cdf7fe700 1 --2- 172.21.15.37:0/381835178 >> v2:172.21.15.98:3300/0 conn(0x7f8ce015fee0 0x7f8ce015ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:25.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.351+0000 7f8cdf7fe700 1 -- 172.21.15.37:0/381835178 >> v1:172.21.15.98:6789/0 conn(0x7f8ce01603b0 legacy=0x7f8ce00d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:25.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.352+0000 7f8cdf7fe700 1 -- 172.21.15.37:0/381835178 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce00b2f00 con 0x7f8ce00d1140 2023-07-14T15:56:25.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.352+0000 7f8cdeffd700 1 --2- 172.21.15.37:0/381835178 >> v2:172.21.15.98:3300/0 conn(0x7f8ce015fee0 0x7f8ce015ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:56:25.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.352+0000 7f8cdf7fe700 1 --2- 172.21.15.37:0/381835178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ce00d1140 0x7f8ce00b39e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8ce00d2dc0 tx=0x7f8cd800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3069a6220eb8b27 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:25.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.352+0000 7f8cddffb700 1 -- 172.21.15.37:0/381835178 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd800e070 con 0x7f8ce00d1140 2023-07-14T15:56:25.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.352+0000 7f8cddffb700 1 -- 172.21.15.37:0/381835178 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd8003a20 con 0x7f8ce00d1140 2023-07-14T15:56:25.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.352+0000 7f8cddffb700 1 -- 172.21.15.37:0/381835178 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8003dd0 con 0x7f8ce00d1140 2023-07-14T15:56:25.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.352+0000 7f8ce55ff700 1 -- 172.21.15.37:0/381835178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ce00d1140 msgr2=0x7f8ce00b39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:25.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.352+0000 7f8ce55ff700 1 --2- 172.21.15.37:0/381835178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ce00d1140 0x7f8ce00b39e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8ce00d2dc0 tx=0x7f8cd800b330 comp rx=0 tx=0).stop 2023-07-14T15:56:25.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.353+0000 7f8ce55ff700 1 -- 172.21.15.37:0/381835178 shutdown_connections 2023-07-14T15:56:25.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.353+0000 7f8ce55ff700 1 --2- 172.21.15.37:0/381835178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ce00d1140 0x7f8ce00b39e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:25.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.353+0000 7f8ce55ff700 1 --2- 172.21.15.37:0/381835178 >> v2:172.21.15.98:3300/0 conn(0x7f8ce015fee0 0x7f8ce015ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:25.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.353+0000 7f8ce55ff700 1 -- 172.21.15.37:0/381835178 >> 172.21.15.37:0/381835178 conn(0x7f8ce009c1b0 msgr2=0x7f8ce00d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:25.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.353+0000 7f8ce55ff700 1 -- 172.21.15.37:0/381835178 shutdown_connections 2023-07-14T15:56:25.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.353+0000 7f8ce55ff700 1 -- 172.21.15.37:0/381835178 wait complete. 2023-07-14T15:56:25.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.354+0000 7f8ce55ff700 1 Processor -- start 2023-07-14T15:56:25.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.354+0000 7f8ce55ff700 1 -- start start 2023-07-14T15:56:25.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.355+0000 7f8ce55ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ce00d1140 0x7f8ce01f2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:25.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.355+0000 7f8ce55ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ce015fee0 0x7f8ce00b0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:25.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.355+0000 7f8ce55ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f8ce01603b0 0x7f8ce00c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:25.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.355+0000 7f8ce55ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce00c8330 con 0x7f8ce00d1140 2023-07-14T15:56:25.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.355+0000 7f8ce55ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce00c7230 con 0x7f8ce015fee0 2023-07-14T15:56:25.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.355+0000 7f8ce55ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce00c7510 con 0x7f8ce01603b0 2023-07-14T15:56:25.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.356+0000 7f8cdeffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ce00d1140 0x7f8ce01f2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:25.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.356+0000 7f8cdeffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ce00d1140 0x7f8ce01f2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33896/0 (socket says 172.21.15.37:33896) 2023-07-14T15:56:25.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.356+0000 7f8cdeffd700 1 -- 172.21.15.37:0/305017083 learned_addr learned my addr 172.21.15.37:0/305017083 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:25.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.356+0000 7f8cdf7fe700 1 --2- 172.21.15.37:0/305017083 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f8ce01603b0 0x7f8ce00c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:25.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.356+0000 7f8cde7fc700 1 --2- 172.21.15.37:0/305017083 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ce015fee0 0x7f8ce00b0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:25.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.356+0000 7f8cdeffd700 1 -- 172.21.15.37:0/305017083 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f8ce01603b0 msgr2=0x7f8ce00c66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:25.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.356+0000 7f8cdeffd700 1 --2- 172.21.15.37:0/305017083 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f8ce01603b0 0x7f8ce00c66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:25.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.356+0000 7f8cdeffd700 1 -- 172.21.15.37:0/305017083 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ce015fee0 msgr2=0x7f8ce00b0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:25.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.356+0000 7f8cdeffd700 1 --2- 172.21.15.37:0/305017083 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ce015fee0 0x7f8ce00b0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:25.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.356+0000 7f8cdeffd700 1 -- 172.21.15.37:0/305017083 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd8009b30 con 0x7f8ce00d1140 2023-07-14T15:56:25.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.356+0000 7f8cdeffd700 1 --2- 172.21.15.37:0/305017083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ce00d1140 0x7f8ce01f2060 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8cd000c750 tx=0x7f8cd000cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:25.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.356+0000 7f8cc77fe700 1 -- 172.21.15.37:0/305017083 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd0011800 con 0x7f8ce00d1140 2023-07-14T15:56:25.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.356+0000 7f8cc77fe700 1 -- 172.21.15.37:0/305017083 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd0011960 con 0x7f8ce00d1140 2023-07-14T15:56:25.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.357+0000 7f8ce55ff700 1 -- 172.21.15.37:0/305017083 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ce00c7c70 con 0x7f8ce00d1140 2023-07-14T15:56:25.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.357+0000 7f8cc77fe700 1 -- 172.21.15.37:0/305017083 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd0011cd0 con 0x7f8ce00d1140 2023-07-14T15:56:25.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.357+0000 7f8ce55ff700 1 -- 172.21.15.37:0/305017083 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ce01f5850 con 0x7f8ce00d1140 2023-07-14T15:56:25.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.358+0000 7f8ce55ff700 1 -- 172.21.15.37:0/305017083 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ce00d2a00 con 0x7f8ce00d1140 2023-07-14T15:56:25.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.359+0000 7f8cc77fe700 1 -- 172.21.15.37:0/305017083 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8cd0021350 con 0x7f8ce00d1140 2023-07-14T15:56:25.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.359+0000 7f8cc77fe700 1 --2- 172.21.15.37:0/305017083 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f8ccc06ace0 0x7f8ccc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:25.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.359+0000 7f8cc77fe700 1 -- 172.21.15.37:0/305017083 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8cd0089490 con 0x7f8ce00d1140 2023-07-14T15:56:25.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.360+0000 7f8cde7fc700 1 --2- 172.21.15.37:0/305017083 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f8ccc06ace0 0x7f8ccc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:25.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.361+0000 7f8cde7fc700 1 --2- 172.21.15.37:0/305017083 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f8ccc06ace0 0x7f8ccc06d190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8ce00b2280 tx=0x7f8cd4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:25.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.364+0000 7f8cc77fe700 1 -- 172.21.15.37:0/305017083 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8cd0054530 con 0x7f8ce00d1140 2023-07-14T15:56:25.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.574+0000 7f8ce55ff700 1 -- 172.21.15.37:0/305017083 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8ce00b31b0 con 0x7f8ce00d1140 2023-07-14T15:56:25.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.574+0000 7f8cc77fe700 1 -- 172.21.15.37:0/305017083 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8cd0057b50 con 0x7f8ce00d1140 2023-07-14T15:56:25.561 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-14T15:56:25.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.577+0000 7f8ce55ff700 1 -- 172.21.15.37:0/305017083 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f8ccc06ace0 msgr2=0x7f8ccc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:25.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.577+0000 7f8ce55ff700 1 --2- 172.21.15.37:0/305017083 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f8ccc06ace0 0x7f8ccc06d190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8ce00b2280 tx=0x7f8cd4009040 comp rx=0 tx=0).stop 2023-07-14T15:56:25.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.577+0000 7f8ce55ff700 1 -- 172.21.15.37:0/305017083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ce00d1140 msgr2=0x7f8ce01f2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:25.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.577+0000 7f8ce55ff700 1 --2- 172.21.15.37:0/305017083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ce00d1140 0x7f8ce01f2060 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8cd000c750 tx=0x7f8cd000cb10 comp rx=0 tx=0).stop 2023-07-14T15:56:25.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.577+0000 7f8ce55ff700 1 -- 172.21.15.37:0/305017083 shutdown_connections 2023-07-14T15:56:25.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.577+0000 7f8ce55ff700 1 --2- 172.21.15.37:0/305017083 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f8ccc06ace0 0x7f8ccc06d190 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:25.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.577+0000 7f8ce55ff700 1 --2- 172.21.15.37:0/305017083 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f8ce01603b0 0x7f8ce00c66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:25.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.577+0000 7f8ce55ff700 1 --2- 172.21.15.37:0/305017083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ce00d1140 0x7f8ce01f2060 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:25.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.577+0000 7f8ce55ff700 1 --2- 172.21.15.37:0/305017083 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ce015fee0 0x7f8ce00b0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:25.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.577+0000 7f8ce55ff700 1 -- 172.21.15.37:0/305017083 >> 172.21.15.37:0/305017083 conn(0x7f8ce009c1b0 msgr2=0x7f8ce00d1560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:25.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.577+0000 7f8ce55ff700 1 -- 172.21.15.37:0/305017083 shutdown_connections 2023-07-14T15:56:25.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.577+0000 7f8ce55ff700 1 -- 172.21.15.37:0/305017083 wait complete. 2023-07-14T15:56:25.582 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T15:56:25.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.796+0000 7fd0b01ff700 1 Processor -- start 2023-07-14T15:56:25.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.796+0000 7fd0b01ff700 1 -- start start 2023-07-14T15:56:25.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.797+0000 7fd0b01ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd0a806c750 0x7fd0a80b2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:25.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.797+0000 7fd0b01ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0a80cfc60 con 0x7fd0a806cb20 2023-07-14T15:56:25.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.797+0000 7fd0b01ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0a80cff40 con 0x7fd0a806b690 2023-07-14T15:56:25.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.797+0000 7fd0b01ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0a80d0220 con 0x7fd0a806c750 2023-07-14T15:56:25.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.797+0000 7fd0ad79a700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd0a806cb20 0x7fd0a806af80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37346/0 (socket says 172.21.15.37:37346) 2023-07-14T15:56:25.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.798+0000 7fd0ad79a700 1 -- 172.21.15.37:0/2644371176 learned_addr learned my addr 172.21.15.37:0/2644371176 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:25.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.798+0000 7fd0adf9b700 1 --2- 172.21.15.37:0/2644371176 >> v2:172.21.15.37:3300/0 conn(0x7fd0a806c750 0x7fd0a80b2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:25.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.798+0000 7fd0acf99700 1 -- 172.21.15.37:0/2644371176 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 38729649 0 0) 0x7fd0a80cfc60 con 0x7fd0a806cb20 2023-07-14T15:56:25.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.798+0000 7fd0acf99700 1 -- 172.21.15.37:0/2644371176 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0940035b0 con 0x7fd0a806cb20 2023-07-14T15:56:25.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.798+0000 7fd0adf9b700 1 -- 172.21.15.37:0/2644371176 >> v1:172.21.15.98:6789/0 conn(0x7fd0a806b690 legacy=0x7fd0a80d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:25.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.798+0000 7fd0adf9b700 1 -- 172.21.15.37:0/2644371176 >> v1:172.21.15.37:6789/0 conn(0x7fd0a806cb20 legacy=0x7fd0a806af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:25.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.798+0000 7fd0adf9b700 1 -- 172.21.15.37:0/2644371176 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a80d0500 con 0x7fd0a806c750 2023-07-14T15:56:25.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.798+0000 7fd0adf9b700 1 --2- 172.21.15.37:0/2644371176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0a806c750 0x7fd0a80b2730 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4009840 tx=0x7fd0a4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96932486d23c0a05 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:25.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.798+0000 7fd0acf99700 1 -- 172.21.15.37:0/2644371176 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a4011830 con 0x7fd0a806c750 2023-07-14T15:56:25.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.798+0000 7fd0acf99700 1 -- 172.21.15.37:0/2644371176 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a4011990 con 0x7fd0a806c750 2023-07-14T15:56:25.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.798+0000 7fd0acf99700 1 -- 172.21.15.37:0/2644371176 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a4011d20 con 0x7fd0a806c750 2023-07-14T15:56:25.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.799+0000 7fd0b01ff700 1 -- 172.21.15.37:0/2644371176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0a806c750 msgr2=0x7fd0a80b2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:25.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.799+0000 7fd0b01ff700 1 --2- 172.21.15.37:0/2644371176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0a806c750 0x7fd0a80b2730 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4009840 tx=0x7fd0a4009b50 comp rx=0 tx=0).stop 2023-07-14T15:56:25.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.799+0000 7fd0b01ff700 1 -- 172.21.15.37:0/2644371176 shutdown_connections 2023-07-14T15:56:25.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.799+0000 7fd0b01ff700 1 --2- 172.21.15.37:0/2644371176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0a806c750 0x7fd0a80b2730 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:25.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.799+0000 7fd0b01ff700 1 -- 172.21.15.37:0/2644371176 >> 172.21.15.37:0/2644371176 conn(0x7fd0a806d9a0 msgr2=0x7fd0a806dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:25.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.799+0000 7fd0b01ff700 1 -- 172.21.15.37:0/2644371176 shutdown_connections 2023-07-14T15:56:25.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.799+0000 7fd0b01ff700 1 -- 172.21.15.37:0/2644371176 wait complete. 2023-07-14T15:56:25.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.801+0000 7fd0b01ff700 1 Processor -- start 2023-07-14T15:56:25.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.801+0000 7fd0b01ff700 1 -- start start 2023-07-14T15:56:25.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.802+0000 7fd0b01ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd0a806b690 0x7fd0a81f5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:25.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.802+0000 7fd0b01ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0a806c750 0x7fd0a80adb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:25.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.802+0000 7fd0b01ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0a806cb20 0x7fd0a8155d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:25.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.802+0000 7fd0b01ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a81f6650 con 0x7fd0a806c750 2023-07-14T15:56:25.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.802+0000 7fd0b01ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a81f6090 con 0x7fd0a806cb20 2023-07-14T15:56:25.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.802+0000 7fd0b01ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a81f6370 con 0x7fd0a806b690 2023-07-14T15:56:25.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.802+0000 7fd0ad79a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0a806c750 0x7fd0a80adb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:25.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.802+0000 7fd0ad79a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0a806c750 0x7fd0a80adb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33928/0 (socket says 172.21.15.37:33928) 2023-07-14T15:56:25.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.802+0000 7fd0ad79a700 1 -- 172.21.15.37:0/3054403853 learned_addr learned my addr 172.21.15.37:0/3054403853 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:25.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.802+0000 7fd0ae79c700 1 --2- 172.21.15.37:0/3054403853 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0a806cb20 0x7fd0a8155d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:25.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.802+0000 7fd0adf9b700 1 --2- 172.21.15.37:0/3054403853 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd0a806b690 0x7fd0a81f5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:25.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.803+0000 7fd0ad79a700 1 -- 172.21.15.37:0/3054403853 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd0a806b690 msgr2=0x7fd0a81f5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:25.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.803+0000 7fd0ad79a700 1 --2- 172.21.15.37:0/3054403853 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd0a806b690 0x7fd0a81f5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:25.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.803+0000 7fd0ad79a700 1 -- 172.21.15.37:0/3054403853 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0a806cb20 msgr2=0x7fd0a8155d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:25.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.803+0000 7fd0ad79a700 1 --2- 172.21.15.37:0/3054403853 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0a806cb20 0x7fd0a8155d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:25.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.803+0000 7fd0ad79a700 1 -- 172.21.15.37:0/3054403853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a40094a0 con 0x7fd0a806c750 2023-07-14T15:56:25.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.803+0000 7fd0adf9b700 1 --2- 172.21.15.37:0/3054403853 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd0a806b690 0x7fd0a81f5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:56:25.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.803+0000 7fd0ae79c700 1 --2- 172.21.15.37:0/3054403853 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0a806cb20 0x7fd0a8155d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:56:25.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.803+0000 7fd0ad79a700 1 --2- 172.21.15.37:0/3054403853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0a806c750 0x7fd0a80adb70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd09800c4d0 tx=0x7fd09800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:25.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.803+0000 7fd09e7fc700 1 -- 172.21.15.37:0/3054403853 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd098005d70 con 0x7fd0a806c750 2023-07-14T15:56:25.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.803+0000 7fd09e7fc700 1 -- 172.21.15.37:0/3054403853 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0980070d0 con 0x7fd0a806c750 2023-07-14T15:56:25.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.803+0000 7fd09e7fc700 1 -- 172.21.15.37:0/3054403853 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd098007440 con 0x7fd0a806c750 2023-07-14T15:56:25.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.803+0000 7fd0b01ff700 1 -- 172.21.15.37:0/3054403853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0a80b50a0 con 0x7fd0a806c750 2023-07-14T15:56:25.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.803+0000 7fd0b01ff700 1 -- 172.21.15.37:0/3054403853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0a81f2220 con 0x7fd0a806c750 2023-07-14T15:56:25.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.804+0000 7fd0b01ff700 1 -- 172.21.15.37:0/3054403853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0a80b55c0 con 0x7fd0a806c750 2023-07-14T15:56:25.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.805+0000 7fd09e7fc700 1 -- 172.21.15.37:0/3054403853 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd0980075a0 con 0x7fd0a806c750 2023-07-14T15:56:25.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.806+0000 7fd09e7fc700 1 --2- 172.21.15.37:0/3054403853 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd08c06ace0 0x7fd08c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:25.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.806+0000 7fd09e7fc700 1 -- 172.21.15.37:0/3054403853 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd098088830 con 0x7fd0a806c750 2023-07-14T15:56:25.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.807+0000 7fd0adf9b700 1 --2- 172.21.15.37:0/3054403853 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd08c06ace0 0x7fd08c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:25.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.807+0000 7fd0adf9b700 1 --2- 172.21.15.37:0/3054403853 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd08c06ace0 0x7fd08c06d190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd0a40090b0 tx=0x7fd0a4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:25.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:25.810+0000 7fd09e7fc700 1 -- 172.21.15.37:0/3054403853 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd0a80b55c0 con 0x7fd0a806c750 2023-07-14T15:56:26.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.063+0000 7fd0b01ff700 1 -- 172.21.15.37:0/3054403853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd0a80b55c0 con 0x7fd0a806c750 2023-07-14T15:56:26.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.064+0000 7fd09e7fc700 1 -- 172.21.15.37:0/3054403853 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4697 (secure 0 0 0) 0x7fd0a80b55c0 con 0x7fd0a806c750 2023-07-14T15:56:26.051 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:56:26.051 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/596800720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":596800720},{"type":"v1","addr":"172.21.15.37:6835","nonce":596800720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4318,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/1611780456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1611780456},{"type":"v1","addr":"172.21.15.37:6834","nonce":1611780456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4324,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/586880065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":586880065},{"type":"v1","addr":"172.21.15.98:6835","nonce":586880065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T15:56:08.459886+0000","modified":"2023-07-14T15:56:11.974298+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4327},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4327":{"gid":4327,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6837/2731892479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2731892479},{"type":"v1","addr":"172.21.15.98:6837","nonce":2731892479}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T15:56:26.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.066+0000 7fd0b01ff700 1 -- 172.21.15.37:0/3054403853 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd08c06ace0 msgr2=0x7fd08c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:26.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.066+0000 7fd0b01ff700 1 --2- 172.21.15.37:0/3054403853 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd08c06ace0 0x7fd08c06d190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd0a40090b0 tx=0x7fd0a4008030 comp rx=0 tx=0).stop 2023-07-14T15:56:26.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.066+0000 7fd0b01ff700 1 -- 172.21.15.37:0/3054403853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0a806c750 msgr2=0x7fd0a80adb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:26.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.066+0000 7fd0b01ff700 1 --2- 172.21.15.37:0/3054403853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0a806c750 0x7fd0a80adb70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd09800c4d0 tx=0x7fd09800c890 comp rx=0 tx=0).stop 2023-07-14T15:56:26.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.066+0000 7fd0b01ff700 1 -- 172.21.15.37:0/3054403853 shutdown_connections 2023-07-14T15:56:26.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.066+0000 7fd0b01ff700 1 --2- 172.21.15.37:0/3054403853 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0a806cb20 0x7fd0a8155d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:26.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.066+0000 7fd0b01ff700 1 --2- 172.21.15.37:0/3054403853 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd08c06ace0 0x7fd08c06d190 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:26.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.066+0000 7fd0b01ff700 1 --2- 172.21.15.37:0/3054403853 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd0a806b690 0x7fd0a81f5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:26.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.066+0000 7fd0b01ff700 1 --2- 172.21.15.37:0/3054403853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0a806c750 0x7fd0a80adb70 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:26.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.066+0000 7fd0b01ff700 1 -- 172.21.15.37:0/3054403853 >> 172.21.15.37:0/3054403853 conn(0x7fd0a806d9a0 msgr2=0x7fd0a80d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:26.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.067+0000 7fd0b01ff700 1 -- 172.21.15.37:0/3054403853 shutdown_connections 2023-07-14T15:56:26.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.067+0000 7fd0b01ff700 1 -- 172.21.15.37:0/3054403853 wait complete. 2023-07-14T15:56:26.056 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 7 2023-07-14T15:56:26.072 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T15:56:26.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.286+0000 7f8fc6bff700 1 Processor -- start 2023-07-14T15:56:26.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.286+0000 7f8fc6bff700 1 -- start start 2023-07-14T15:56:26.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.287+0000 7f8fc6bff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8fc00b85f0 0x7f8fc015d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:26.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.287+0000 7f8fc6bff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fc00cf6b0 con 0x7f8fc00b54b0 2023-07-14T15:56:26.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.287+0000 7f8fc6bff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fc00cdc40 con 0x7f8fc00b4910 2023-07-14T15:56:26.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.287+0000 7f8fc6bff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fc015dba0 con 0x7f8fc00b85f0 2023-07-14T15:56:26.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.287+0000 7f8fbffff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8fc00b54b0 0x7f8fc00cfb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37356/0 (socket says 172.21.15.37:37356) 2023-07-14T15:56:26.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.288+0000 7f8fc499b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8fc00b85f0 0x7f8fc015d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:26.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.288+0000 7f8fbffff700 1 -- 172.21.15.37:0/3631445008 learned_addr learned my addr 172.21.15.37:0/3631445008 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:26.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.288+0000 7f8fc499b700 1 -- 172.21.15.37:0/3631445008 >> v1:172.21.15.98:6789/0 conn(0x7f8fc00b4910 legacy=0x7f8fc00b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:26.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.288+0000 7f8fc499b700 1 -- 172.21.15.37:0/3631445008 >> v1:172.21.15.37:6789/0 conn(0x7f8fc00b54b0 legacy=0x7f8fc00cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:26.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.288+0000 7f8fc499b700 1 -- 172.21.15.37:0/3631445008 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc00d0250 con 0x7f8fc00b85f0 2023-07-14T15:56:26.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.288+0000 7f8fbf7fe700 1 -- 172.21.15.37:0/3631445008 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2736421570 0 0) 0x7f8fc00cf6b0 con 0x7f8fc00b54b0 2023-07-14T15:56:26.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.288+0000 7f8fc499b700 1 --2- 172.21.15.37:0/3631445008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fc00b85f0 0x7f8fc015d660 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4009840 tx=0x7f8fb4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba6fbc9591cfd024 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:26.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.288+0000 7f8fbf7fe700 1 -- 172.21.15.37:0/3631445008 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb4011830 con 0x7f8fc00b85f0 2023-07-14T15:56:26.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.288+0000 7f8fbf7fe700 1 -- 172.21.15.37:0/3631445008 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb4011990 con 0x7f8fc00b85f0 2023-07-14T15:56:26.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.288+0000 7f8fbf7fe700 1 -- 172.21.15.37:0/3631445008 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb4011d20 con 0x7f8fc00b85f0 2023-07-14T15:56:26.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.289+0000 7f8fc6bff700 1 -- 172.21.15.37:0/3631445008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fc00b85f0 msgr2=0x7f8fc015d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:26.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.289+0000 7f8fc6bff700 1 --2- 172.21.15.37:0/3631445008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fc00b85f0 0x7f8fc015d660 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4009840 tx=0x7f8fb4009b50 comp rx=0 tx=0).stop 2023-07-14T15:56:26.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.289+0000 7f8fc6bff700 1 -- 172.21.15.37:0/3631445008 shutdown_connections 2023-07-14T15:56:26.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.289+0000 7f8fc6bff700 1 --2- 172.21.15.37:0/3631445008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fc00b85f0 0x7f8fc015d660 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:26.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.289+0000 7f8fc6bff700 1 -- 172.21.15.37:0/3631445008 >> 172.21.15.37:0/3631445008 conn(0x7f8fc006a580 msgr2=0x7f8fc006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:26.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.289+0000 7f8fc6bff700 1 -- 172.21.15.37:0/3631445008 shutdown_connections 2023-07-14T15:56:26.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.289+0000 7f8fc6bff700 1 -- 172.21.15.37:0/3631445008 wait complete. 2023-07-14T15:56:26.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.291+0000 7f8fc6bff700 1 Processor -- start 2023-07-14T15:56:26.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.291+0000 7f8fc6bff700 1 -- start start 2023-07-14T15:56:26.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.292+0000 7f8fc6bff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f8fc00b4910 0x7f8fc01e8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:26.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.292+0000 7f8fc6bff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fc00b54b0 0x7f8fc015f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:26.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.292+0000 7f8fc6bff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fc00b85f0 0x7f8fc01473d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:26.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.292+0000 7f8fc6bff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc01e89b0 con 0x7f8fc00b85f0 2023-07-14T15:56:26.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.292+0000 7f8fc6bff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc015f9d0 con 0x7f8fc00b54b0 2023-07-14T15:56:26.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.292+0000 7f8fc6bff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc0160810 con 0x7f8fc00b4910 2023-07-14T15:56:26.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.292+0000 7f8fc519c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fc00b85f0 0x7f8fc01473d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:26.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.292+0000 7f8fc519c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fc00b85f0 0x7f8fc01473d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33956/0 (socket says 172.21.15.37:33956) 2023-07-14T15:56:26.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.292+0000 7f8fc519c700 1 -- 172.21.15.37:0/2750848658 learned_addr learned my addr 172.21.15.37:0/2750848658 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:26.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.292+0000 7f8fc499b700 1 --2- 172.21.15.37:0/2750848658 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f8fc00b4910 0x7f8fc01e8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:26.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.292+0000 7f8fbffff700 1 --2- 172.21.15.37:0/2750848658 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fc00b54b0 0x7f8fc015f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:26.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.293+0000 7f8fc519c700 1 -- 172.21.15.37:0/2750848658 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f8fc00b4910 msgr2=0x7f8fc01e8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:26.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.293+0000 7f8fc519c700 1 --2- 172.21.15.37:0/2750848658 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f8fc00b4910 0x7f8fc01e8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:26.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.293+0000 7f8fc519c700 1 -- 172.21.15.37:0/2750848658 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fc00b54b0 msgr2=0x7f8fc015f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:26.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.293+0000 7f8fc519c700 1 --2- 172.21.15.37:0/2750848658 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fc00b54b0 0x7f8fc015f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:26.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.293+0000 7f8fc519c700 1 -- 172.21.15.37:0/2750848658 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb40094a0 con 0x7f8fc00b85f0 2023-07-14T15:56:26.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.293+0000 7f8fc519c700 1 --2- 172.21.15.37:0/2750848658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fc00b85f0 0x7f8fc01473d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8fb800cc80 tx=0x7f8fb800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:26.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.293+0000 7f8fbd7fa700 1 -- 172.21.15.37:0/2750848658 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb8003c00 con 0x7f8fc00b85f0 2023-07-14T15:56:26.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.293+0000 7f8fbd7fa700 1 -- 172.21.15.37:0/2750848658 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb8003d60 con 0x7f8fc00b85f0 2023-07-14T15:56:26.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.293+0000 7f8fbd7fa700 1 -- 172.21.15.37:0/2750848658 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb800aae0 con 0x7f8fc00b85f0 2023-07-14T15:56:26.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.293+0000 7f8fc6bff700 1 -- 172.21.15.37:0/2750848658 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fc0147910 con 0x7f8fc00b85f0 2023-07-14T15:56:26.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.293+0000 7f8fc6bff700 1 -- 172.21.15.37:0/2750848658 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fc015fee0 con 0x7f8fc00b85f0 2023-07-14T15:56:26.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.294+0000 7f8fc6bff700 1 -- 172.21.15.37:0/2750848658 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fc0067840 con 0x7f8fc00b85f0 2023-07-14T15:56:26.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.295+0000 7f8fbd7fa700 1 -- 172.21.15.37:0/2750848658 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8fb800ac40 con 0x7f8fc00b85f0 2023-07-14T15:56:26.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.296+0000 7f8fbd7fa700 1 --2- 172.21.15.37:0/2750848658 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f8fa406ace0 0x7f8fa406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:26.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.296+0000 7f8fbd7fa700 1 -- 172.21.15.37:0/2750848658 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8fb8089470 con 0x7f8fc00b85f0 2023-07-14T15:56:26.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.297+0000 7f8fc499b700 1 --2- 172.21.15.37:0/2750848658 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f8fa406ace0 0x7f8fa406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:26.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.298+0000 7f8fc499b700 1 --2- 172.21.15.37:0/2750848658 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f8fa406ace0 0x7f8fa406d190 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8fb40090b0 tx=0x7f8fb401c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:26.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.301+0000 7f8fbd7fa700 1 -- 172.21.15.37:0/2750848658 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8fb8054510 con 0x7f8fc00b85f0 2023-07-14T15:56:26.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.507+0000 7f8fc6bff700 1 -- 172.21.15.37:0/2750848658 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8fc0160950 con 0x7f8fc00b85f0 2023-07-14T15:56:26.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.508+0000 7f8fbd7fa700 1 -- 172.21.15.37:0/2750848658 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18341 (secure 0 0 0) 0x7f8fb8057b30 con 0x7f8fc00b85f0 2023-07-14T15:56:26.496 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:56:26.496 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"fsid":"9da30401-a779-4e46-aba6-00c2494c6c67","created":"2023-07-14T15:55:39.898867+0000","modified":"2023-07-14T15:56:09.959850+0000","last_up_change":"2023-07-14T15:55:53.025696+0000","last_in_change":"2023-07-14T15:55:43.388192+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T15:55:52.907261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T15:55:59.992839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T15:56:06.091064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T15:56:07.448694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d049535-7b87-4276-8fe5-0f74ba422d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6801","nonce":2783032392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6803","nonce":2783032392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6807","nonce":2783032392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6805","nonce":2783032392}]},"public_addr":"172.21.15.37:6801/2783032392","cluster_addr":"172.21.15.37:6803/2783032392","heartbeat_back_addr":"172.21.15.37:6807/2783032392","heartbeat_front_addr":"172.21.15.37:6805/2783032392","state":["exists","up"]},{"osd":1,"uuid":"79ec948d-ead2-4c2d-923a-dd6eeaac9dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6823","nonce":1190059746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6826","nonce":1190059746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6831","nonce":1190059746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6829","nonce":1190059746}]},"public_addr":"172.21.15.37:6823/1190059746","cluster_addr":"172.21.15.37:6826/1190059746","heartbeat_back_addr":"172.21.15.37:6831/1190059746","heartbeat_front_addr":"172.21.15.37:6829/1190059746","state":["exists","up"]},{"osd":2,"uuid":"a1db6690-c160-4366-9c82-2cca17e4bba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6809","nonce":2266223499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6813","nonce":2266223499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6820","nonce":2266223499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6816","nonce":2266223499}]},"public_addr":"172.21.15.37:6809/2266223499","cluster_addr":"172.21.15.37:6813/2266223499","heartbeat_back_addr":"172.21.15.37:6820/2266223499","heartbeat_front_addr":"172.21.15.37:6816/2266223499","state":["exists","up"]},{"osd":3,"uuid":"767b8220-e79a-4a86-a162-6b3b73198379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6812","nonce":4166694594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6817","nonce":4166694594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6828","nonce":4166694594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6822","nonce":4166694594}]},"public_addr":"172.21.15.37:6812/4166694594","cluster_addr":"172.21.15.37:6817/4166694594","heartbeat_back_addr":"172.21.15.37:6828/4166694594","heartbeat_front_addr":"172.21.15.37:6822/4166694594","state":["exists","up"]},{"osd":4,"uuid":"717bd773-ae7e-4236-ac79-900cf99a37c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6801","nonce":3529020407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6803","nonce":3529020407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6807","nonce":3529020407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6805","nonce":3529020407}]},"public_addr":"172.21.15.98:6801/3529020407","cluster_addr":"172.21.15.98:6803/3529020407","heartbeat_back_addr":"172.21.15.98:6807/3529020407","heartbeat_front_addr":"172.21.15.98:6805/3529020407","state":["exists","up"]},{"osd":5,"uuid":"a941d358-0f03-4136-a9b2-3a1c2e9358cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6817","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6819","nonce":2311501838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6821","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6823","nonce":2311501838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6829","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6831","nonce":2311501838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6825","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6827","nonce":2311501838}]},"public_addr":"172.21.15.98:6819/2311501838","cluster_addr":"172.21.15.98:6823/2311501838","heartbeat_back_addr":"172.21.15.98:6831/2311501838","heartbeat_front_addr":"172.21.15.98:6827/2311501838","state":["exists","up"]},{"osd":6,"uuid":"27153772-6d4b-479d-9953-0582e7b96743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6809","nonce":1144224691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6811","nonce":1144224691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6815","nonce":1144224691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6813","nonce":1144224691}]},"public_addr":"172.21.15.98:6809/1144224691","cluster_addr":"172.21.15.98:6811/1144224691","heartbeat_back_addr":"172.21.15.98:6815/1144224691","heartbeat_front_addr":"172.21.15.98:6813/1144224691","state":["exists","up"]},{"osd":7,"uuid":"d21ffc8e-40bb-47eb-af2c-e3e730d3fb76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6818","nonce":1144470927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6822","nonce":1144470927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6830","nonce":1144470927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6826","nonce":1144470927}]},"public_addr":"172.21.15.98:6818/1144470927","cluster_addr":"172.21.15.98:6822/1144470927","heartbeat_back_addr":"172.21.15.98:6830/1144470927","heartbeat_front_addr":"172.21.15.98:6826/1144470927","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.921114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.739210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.024016+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.002527+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.698127+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.813416+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.709351+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.815457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T15:56:26.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.511+0000 7f8fc6bff700 1 -- 172.21.15.37:0/2750848658 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f8fa406ace0 msgr2=0x7f8fa406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:26.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.511+0000 7f8fc6bff700 1 --2- 172.21.15.37:0/2750848658 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f8fa406ace0 0x7f8fa406d190 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8fb40090b0 tx=0x7f8fb401c040 comp rx=0 tx=0).stop 2023-07-14T15:56:26.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.511+0000 7f8fc6bff700 1 -- 172.21.15.37:0/2750848658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fc00b85f0 msgr2=0x7f8fc01473d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:26.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.511+0000 7f8fc6bff700 1 --2- 172.21.15.37:0/2750848658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fc00b85f0 0x7f8fc01473d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8fb800cc80 tx=0x7f8fb800cf90 comp rx=0 tx=0).stop 2023-07-14T15:56:26.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.511+0000 7f8fc6bff700 1 -- 172.21.15.37:0/2750848658 shutdown_connections 2023-07-14T15:56:26.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.511+0000 7f8fc6bff700 1 --2- 172.21.15.37:0/2750848658 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f8fa406ace0 0x7f8fa406d190 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:26.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.511+0000 7f8fc6bff700 1 --2- 172.21.15.37:0/2750848658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fc00b85f0 0x7f8fc01473d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:26.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.511+0000 7f8fc6bff700 1 --2- 172.21.15.37:0/2750848658 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f8fc00b4910 0x7f8fc01e8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:26.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.511+0000 7f8fc6bff700 1 --2- 172.21.15.37:0/2750848658 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fc00b54b0 0x7f8fc015f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:26.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.511+0000 7f8fc6bff700 1 -- 172.21.15.37:0/2750848658 >> 172.21.15.37:0/2750848658 conn(0x7f8fc006a580 msgr2=0x7f8fc015cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:26.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.511+0000 7f8fc6bff700 1 -- 172.21.15.37:0/2750848658 shutdown_connections 2023-07-14T15:56:26.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.511+0000 7f8fc6bff700 1 -- 172.21.15.37:0/2750848658 wait complete. 2023-07-14T15:56:26.516 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T15:55:52.907261+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T15:55:59.992839+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T15:56:06.091064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T15:56:07.448694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T15:56:26.516 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T15:56:26.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.733+0000 7f9d65bff700 1 Processor -- start 2023-07-14T15:56:26.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.733+0000 7f9d65bff700 1 -- start start 2023-07-14T15:56:26.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.734+0000 7f9d65bff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f9d600cb490 0x7f9d600cb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:26.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.734+0000 7f9d65bff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d601595b0 con 0x7f9d600ce640 2023-07-14T15:56:26.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.734+0000 7f9d65bff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d600cbe00 con 0x7f9d60158b70 2023-07-14T15:56:26.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.734+0000 7f9d65bff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6006db00 con 0x7f9d600cb490 2023-07-14T15:56:26.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.734+0000 7f9d5effd700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9d600ce640 0x7f9d6006b7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37368/0 (socket says 172.21.15.37:37368) 2023-07-14T15:56:26.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.734+0000 7f9d5effd700 1 -- 172.21.15.37:0/1349401423 learned_addr learned my addr 172.21.15.37:0/1349401423 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:26.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.734+0000 7f9d5ffff700 1 --2- 172.21.15.37:0/1349401423 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f9d600cb490 0x7f9d600cb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:26.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.735+0000 7f9d5e7fc700 1 -- 172.21.15.37:0/1349401423 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2101954939 0 0) 0x7f9d601595b0 con 0x7f9d600ce640 2023-07-14T15:56:26.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.735+0000 7f9d5e7fc700 1 -- 172.21.15.37:0/1349401423 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d480035b0 con 0x7f9d600ce640 2023-07-14T15:56:26.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.735+0000 7f9d5e7fc700 1 -- 172.21.15.37:0/1349401423 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3362326565 0 0) 0x7f9d600cbe00 con 0x7f9d60158b70 2023-07-14T15:56:26.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.735+0000 7f9d5e7fc700 1 -- 172.21.15.37:0/1349401423 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d601595b0 con 0x7f9d60158b70 2023-07-14T15:56:26.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.735+0000 7f9d5ffff700 1 -- 172.21.15.37:0/1349401423 >> v1:172.21.15.98:6789/0 conn(0x7f9d60158b70 legacy=0x7f9d60159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:26.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.735+0000 7f9d5ffff700 1 -- 172.21.15.37:0/1349401423 >> v1:172.21.15.37:6789/0 conn(0x7f9d600ce640 legacy=0x7f9d6006b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:26.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.735+0000 7f9d5ffff700 1 -- 172.21.15.37:0/1349401423 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d60159280 con 0x7f9d600cb490 2023-07-14T15:56:26.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.735+0000 7f9d5ffff700 1 --2- 172.21.15.37:0/1349401423 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f9d600cb490 0x7f9d600cb8c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9d58009dc0 tx=0x7f9d5800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70c869bfa80d4bc9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:26.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.735+0000 7f9d5e7fc700 1 -- 172.21.15.37:0/1349401423 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5800e070 con 0x7f9d600cb490 2023-07-14T15:56:26.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.735+0000 7f9d5e7fc700 1 -- 172.21.15.37:0/1349401423 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5800bb20 con 0x7f9d600cb490 2023-07-14T15:56:26.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.736+0000 7f9d5e7fc700 1 -- 172.21.15.37:0/1349401423 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d58012430 con 0x7f9d600cb490 2023-07-14T15:56:26.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.736+0000 7f9d65bff700 1 -- 172.21.15.37:0/1349401423 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f9d600cb490 msgr2=0x7f9d600cb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:26.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.736+0000 7f9d65bff700 1 --2- 172.21.15.37:0/1349401423 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f9d600cb490 0x7f9d600cb8c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9d58009dc0 tx=0x7f9d5800b330 comp rx=0 tx=0).stop 2023-07-14T15:56:26.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.736+0000 7f9d65bff700 1 -- 172.21.15.37:0/1349401423 shutdown_connections 2023-07-14T15:56:26.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.736+0000 7f9d65bff700 1 --2- 172.21.15.37:0/1349401423 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f9d600cb490 0x7f9d600cb8c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:26.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.736+0000 7f9d65bff700 1 -- 172.21.15.37:0/1349401423 >> 172.21.15.37:0/1349401423 conn(0x7f9d6006aac0 msgr2=0x7f9d600b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:26.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.736+0000 7f9d65bff700 1 -- 172.21.15.37:0/1349401423 shutdown_connections 2023-07-14T15:56:26.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.736+0000 7f9d65bff700 1 -- 172.21.15.37:0/1349401423 wait complete. 2023-07-14T15:56:26.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.738+0000 7f9d65bff700 1 Processor -- start 2023-07-14T15:56:26.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.738+0000 7f9d65bff700 1 -- start start 2023-07-14T15:56:26.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.739+0000 7f9d65bff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f9d600cb490 0x7f9d600c5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:26.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.739+0000 7f9d65bff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d600ce640 0x7f9d600c3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:26.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.739+0000 7f9d65bff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d60158b70 0x7f9d600b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:26.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.739+0000 7f9d65bff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6014d2a0 con 0x7f9d60158b70 2023-07-14T15:56:26.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.739+0000 7f9d65bff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6014c690 con 0x7f9d600ce640 2023-07-14T15:56:26.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.739+0000 7f9d65bff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6014c970 con 0x7f9d600cb490 2023-07-14T15:56:26.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.739+0000 7f9d5ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d60158b70 0x7f9d600b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:26.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.739+0000 7f9d5ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d60158b70 0x7f9d600b3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33964/0 (socket says 172.21.15.37:33964) 2023-07-14T15:56:26.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.739+0000 7f9d5ffff700 1 -- 172.21.15.37:0/3569700847 learned_addr learned my addr 172.21.15.37:0/3569700847 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:26.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.740+0000 7f9d5effd700 1 --2- 172.21.15.37:0/3569700847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d600ce640 0x7f9d600c3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:26.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.740+0000 7f9d5f7fe700 1 --2- 172.21.15.37:0/3569700847 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f9d600cb490 0x7f9d600c5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:26.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.740+0000 7f9d5ffff700 1 -- 172.21.15.37:0/3569700847 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f9d600cb490 msgr2=0x7f9d600c5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:26.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.740+0000 7f9d5ffff700 1 --2- 172.21.15.37:0/3569700847 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f9d600cb490 0x7f9d600c5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:26.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.740+0000 7f9d5ffff700 1 -- 172.21.15.37:0/3569700847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d600ce640 msgr2=0x7f9d600c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:26.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.740+0000 7f9d5ffff700 1 --2- 172.21.15.37:0/3569700847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d600ce640 0x7f9d600c3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:26.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.740+0000 7f9d5ffff700 1 -- 172.21.15.37:0/3569700847 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d58009a70 con 0x7f9d60158b70 2023-07-14T15:56:26.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.740+0000 7f9d5effd700 1 --2- 172.21.15.37:0/3569700847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d600ce640 0x7f9d600c3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:56:26.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.740+0000 7f9d5f7fe700 1 --2- 172.21.15.37:0/3569700847 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f9d600cb490 0x7f9d600c5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:56:26.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.740+0000 7f9d5ffff700 1 --2- 172.21.15.37:0/3569700847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d60158b70 0x7f9d600b3b40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9d5800b370 tx=0x7f9d58004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:26.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.740+0000 7f9d47fff700 1 -- 172.21.15.37:0/3569700847 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5801b810 con 0x7f9d60158b70 2023-07-14T15:56:26.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.740+0000 7f9d47fff700 1 -- 172.21.15.37:0/3569700847 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d58020070 con 0x7f9d60158b70 2023-07-14T15:56:26.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.740+0000 7f9d47fff700 1 -- 172.21.15.37:0/3569700847 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5801bbf0 con 0x7f9d60158b70 2023-07-14T15:56:26.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.740+0000 7f9d65bff700 1 -- 172.21.15.37:0/3569700847 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d6014cc50 con 0x7f9d60158b70 2023-07-14T15:56:26.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.740+0000 7f9d65bff700 1 -- 172.21.15.37:0/3569700847 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d6014b4b0 con 0x7f9d60158b70 2023-07-14T15:56:26.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.741+0000 7f9d65bff700 1 -- 172.21.15.37:0/3569700847 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d60067840 con 0x7f9d60158b70 2023-07-14T15:56:26.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.742+0000 7f9d47fff700 1 -- 172.21.15.37:0/3569700847 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9d5801bd50 con 0x7f9d60158b70 2023-07-14T15:56:26.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.743+0000 7f9d47fff700 1 --2- 172.21.15.37:0/3569700847 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f9d4c06ace0 0x7f9d4c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:26.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.743+0000 7f9d47fff700 1 -- 172.21.15.37:0/3569700847 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9d58022070 con 0x7f9d60158b70 2023-07-14T15:56:26.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.743+0000 7f9d5f7fe700 1 --2- 172.21.15.37:0/3569700847 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f9d4c06ace0 0x7f9d4c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:26.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.744+0000 7f9d5f7fe700 1 --2- 172.21.15.37:0/3569700847 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f9d4c06ace0 0x7f9d4c06d190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9d500011e0 tx=0x7f9d50009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:26.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.747+0000 7f9d47fff700 1 -- 172.21.15.37:0/3569700847 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9d58056980 con 0x7f9d60158b70 2023-07-14T15:56:26.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.956+0000 7f9d65bff700 1 -- 172.21.15.37:0/3569700847 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9d6014d3e0 con 0x7f9d60158b70 2023-07-14T15:56:26.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.956+0000 7f9d47fff700 1 -- 172.21.15.37:0/3569700847 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9d5802c020 con 0x7f9d60158b70 2023-07-14T15:56:26.944 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-14T15:56:26.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.959+0000 7f9d65bff700 1 -- 172.21.15.37:0/3569700847 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f9d4c06ace0 msgr2=0x7f9d4c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:26.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.959+0000 7f9d65bff700 1 --2- 172.21.15.37:0/3569700847 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f9d4c06ace0 0x7f9d4c06d190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9d500011e0 tx=0x7f9d50009040 comp rx=0 tx=0).stop 2023-07-14T15:56:26.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.959+0000 7f9d65bff700 1 -- 172.21.15.37:0/3569700847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d60158b70 msgr2=0x7f9d600b3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:26.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.959+0000 7f9d65bff700 1 --2- 172.21.15.37:0/3569700847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d60158b70 0x7f9d600b3b40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9d5800b370 tx=0x7f9d58004ad0 comp rx=0 tx=0).stop 2023-07-14T15:56:26.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.959+0000 7f9d65bff700 1 -- 172.21.15.37:0/3569700847 shutdown_connections 2023-07-14T15:56:26.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.959+0000 7f9d65bff700 1 --2- 172.21.15.37:0/3569700847 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f9d4c06ace0 0x7f9d4c06d190 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:26.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.959+0000 7f9d65bff700 1 --2- 172.21.15.37:0/3569700847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d60158b70 0x7f9d600b3b40 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:26.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.959+0000 7f9d65bff700 1 --2- 172.21.15.37:0/3569700847 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f9d600cb490 0x7f9d600c5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:26.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.959+0000 7f9d65bff700 1 --2- 172.21.15.37:0/3569700847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d600ce640 0x7f9d600c3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:26.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.959+0000 7f9d65bff700 1 -- 172.21.15.37:0/3569700847 >> 172.21.15.37:0/3569700847 conn(0x7f9d6006aac0 msgr2=0x7f9d60070240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:26.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.959+0000 7f9d65bff700 1 -- 172.21.15.37:0/3569700847 shutdown_connections 2023-07-14T15:56:26.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:26.959+0000 7f9d65bff700 1 -- 172.21.15.37:0/3569700847 wait complete. 2023-07-14T15:56:26.964 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T15:56:27.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.182+0000 7f654cfff700 1 Processor -- start 2023-07-14T15:56:27.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.183+0000 7f654cfff700 1 -- start start 2023-07-14T15:56:27.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.184+0000 7f654cfff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f654806c0d0 0x7f654806f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:27.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.184+0000 7f654cfff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f65480ae000 0x7f65480cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:27.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.184+0000 7f654cfff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6548159870 con 0x7f6548071730 2023-07-14T15:56:27.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.184+0000 7f654cfff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65480ae420 con 0x7f65480ae000 2023-07-14T15:56:27.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.184+0000 7f654cfff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65480ca790 con 0x7f654806c0d0 2023-07-14T15:56:27.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.184+0000 7f654659c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6548071730 0x7f654806b9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37380/0 (socket says 172.21.15.37:37380) 2023-07-14T15:56:27.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.184+0000 7f654659c700 1 -- 172.21.15.37:0/2318688234 learned_addr learned my addr 172.21.15.37:0/2318688234 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:27.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.184+0000 7f6546d9d700 1 --2- 172.21.15.37:0/2318688234 >> v2:172.21.15.98:3300/0 conn(0x7f65480ae000 0x7f65480cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:27.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.184+0000 7f653ffff700 1 --2- 172.21.15.37:0/2318688234 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f654806c0d0 0x7f654806f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:27.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.185+0000 7f6546d9d700 1 -- 172.21.15.37:0/2318688234 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f654806c0d0 msgr2=0x7f654806f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:27.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.185+0000 7f6546d9d700 1 --2- 172.21.15.37:0/2318688234 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f654806c0d0 0x7f654806f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:27.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.185+0000 7f6546d9d700 1 -- 172.21.15.37:0/2318688234 >> v1:172.21.15.37:6789/0 conn(0x7f6548071730 legacy=0x7f654806b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:27.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.185+0000 7f6545d9b700 1 -- 172.21.15.37:0/2318688234 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1160168296 0 0) 0x7f6548159870 con 0x7f6548071730 2023-07-14T15:56:27.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.185+0000 7f6546d9d700 1 -- 172.21.15.37:0/2318688234 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65480cc780 con 0x7f65480ae000 2023-07-14T15:56:27.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.185+0000 7f6546d9d700 1 --2- 172.21.15.37:0/2318688234 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65480ae000 0x7f65480cd220 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6540009d90 tx=0x7f654000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc7a9cc079ab43ca server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:27.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.185+0000 7f6545d9b700 1 -- 172.21.15.37:0/2318688234 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654000bd20 con 0x7f65480ae000 2023-07-14T15:56:27.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.185+0000 7f6545d9b700 1 -- 172.21.15.37:0/2318688234 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f654000be80 con 0x7f65480ae000 2023-07-14T15:56:27.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.185+0000 7f6545d9b700 1 -- 172.21.15.37:0/2318688234 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65400116a0 con 0x7f65480ae000 2023-07-14T15:56:27.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.186+0000 7f654cfff700 1 -- 172.21.15.37:0/2318688234 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65480ae000 msgr2=0x7f65480cd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:27.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.186+0000 7f654cfff700 1 --2- 172.21.15.37:0/2318688234 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65480ae000 0x7f65480cd220 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6540009d90 tx=0x7f654000b330 comp rx=0 tx=0).stop 2023-07-14T15:56:27.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.186+0000 7f654cfff700 1 -- 172.21.15.37:0/2318688234 shutdown_connections 2023-07-14T15:56:27.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.186+0000 7f654cfff700 1 --2- 172.21.15.37:0/2318688234 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65480ae000 0x7f65480cd220 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:27.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.186+0000 7f654cfff700 1 --2- 172.21.15.37:0/2318688234 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f654806c0d0 0x7f654806f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:27.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.186+0000 7f654cfff700 1 -- 172.21.15.37:0/2318688234 >> 172.21.15.37:0/2318688234 conn(0x7f654806aac0 msgr2=0x7f65480b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:27.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.186+0000 7f654cfff700 1 -- 172.21.15.37:0/2318688234 shutdown_connections 2023-07-14T15:56:27.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.186+0000 7f654cfff700 1 -- 172.21.15.37:0/2318688234 wait complete. 2023-07-14T15:56:27.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.188+0000 7f654cfff700 1 Processor -- start 2023-07-14T15:56:27.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.188+0000 7f654cfff700 1 -- start start 2023-07-14T15:56:27.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.189+0000 7f654cfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f654806c0d0 0x7f654814bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:27.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.189+0000 7f654cfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6548071730 0x7f65480ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:27.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.189+0000 7f654cfff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f65480ae000 0x7f65480acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:27.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.189+0000 7f654cfff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65480c43f0 con 0x7f654806c0d0 2023-07-14T15:56:27.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.189+0000 7f654cfff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65480c46d0 con 0x7f6548071730 2023-07-14T15:56:27.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.189+0000 7f654cfff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65480c49b0 con 0x7f65480ae000 2023-07-14T15:56:27.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.189+0000 7f654659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f654806c0d0 0x7f654814bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:27.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.189+0000 7f654659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f654806c0d0 0x7f654814bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33978/0 (socket says 172.21.15.37:33978) 2023-07-14T15:56:27.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.189+0000 7f654659c700 1 -- 172.21.15.37:0/1787061469 learned_addr learned my addr 172.21.15.37:0/1787061469 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:27.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.189+0000 7f653ffff700 1 --2- 172.21.15.37:0/1787061469 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6548071730 0x7f65480ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:27.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.189+0000 7f6546d9d700 1 --2- 172.21.15.37:0/1787061469 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f65480ae000 0x7f65480acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:27.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.189+0000 7f654659c700 1 -- 172.21.15.37:0/1787061469 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f65480ae000 msgr2=0x7f65480acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:27.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.189+0000 7f654659c700 1 --2- 172.21.15.37:0/1787061469 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f65480ae000 0x7f65480acdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:27.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.190+0000 7f654659c700 1 -- 172.21.15.37:0/1787061469 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6548071730 msgr2=0x7f65480ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:27.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.190+0000 7f654659c700 1 --2- 172.21.15.37:0/1787061469 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6548071730 0x7f65480ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:27.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.190+0000 7f654659c700 1 -- 172.21.15.37:0/1787061469 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6540009a70 con 0x7f654806c0d0 2023-07-14T15:56:27.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.190+0000 7f654659c700 1 --2- 172.21.15.37:0/1787061469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f654806c0d0 0x7f654814bdc0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f65380011e0 tx=0x7f653800cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:27.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.190+0000 7f653effd700 1 -- 172.21.15.37:0/1787061469 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6538004c80 con 0x7f654806c0d0 2023-07-14T15:56:27.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.190+0000 7f653effd700 1 -- 172.21.15.37:0/1787061469 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6538004e00 con 0x7f654806c0d0 2023-07-14T15:56:27.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.190+0000 7f653effd700 1 -- 172.21.15.37:0/1787061469 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6538007310 con 0x7f654806c0d0 2023-07-14T15:56:27.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.190+0000 7f654cfff700 1 -- 172.21.15.37:0/1787061469 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65480c4c90 con 0x7f654806c0d0 2023-07-14T15:56:27.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.190+0000 7f654cfff700 1 -- 172.21.15.37:0/1787061469 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f654814c300 con 0x7f654806c0d0 2023-07-14T15:56:27.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.191+0000 7f654cfff700 1 -- 172.21.15.37:0/1787061469 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65480cb300 con 0x7f654806c0d0 2023-07-14T15:56:27.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.192+0000 7f653effd700 1 -- 172.21.15.37:0/1787061469 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6538007470 con 0x7f654806c0d0 2023-07-14T15:56:27.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.193+0000 7f653effd700 1 --2- 172.21.15.37:0/1787061469 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f652806ace0 0x7f652806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:27.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.193+0000 7f653effd700 1 -- 172.21.15.37:0/1787061469 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f65380892a0 con 0x7f654806c0d0 2023-07-14T15:56:27.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.193+0000 7f653ffff700 1 --2- 172.21.15.37:0/1787061469 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f652806ace0 0x7f652806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:27.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.194+0000 7f653ffff700 1 --2- 172.21.15.37:0/1787061469 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f652806ace0 0x7f652806d190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f65480cd190 tx=0x7f6530008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:27.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.197+0000 7f653effd700 1 -- 172.21.15.37:0/1787061469 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f65380542b0 con 0x7f654806c0d0 2023-07-14T15:56:27.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.408+0000 7f654cfff700 1 -- 172.21.15.37:0/1787061469 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f65480cf050 con 0x7f654806c0d0 2023-07-14T15:56:27.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.408+0000 7f653effd700 1 -- 172.21.15.37:0/1787061469 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f65380578d0 con 0x7f654806c0d0 2023-07-14T15:56:27.395 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-14T15:56:27.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.410+0000 7f654cfff700 1 -- 172.21.15.37:0/1787061469 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f652806ace0 msgr2=0x7f652806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:27.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.410+0000 7f654cfff700 1 --2- 172.21.15.37:0/1787061469 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f652806ace0 0x7f652806d190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f65480cd190 tx=0x7f6530008040 comp rx=0 tx=0).stop 2023-07-14T15:56:27.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.410+0000 7f654cfff700 1 -- 172.21.15.37:0/1787061469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f654806c0d0 msgr2=0x7f654814bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:27.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.410+0000 7f654cfff700 1 --2- 172.21.15.37:0/1787061469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f654806c0d0 0x7f654814bdc0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f65380011e0 tx=0x7f653800cae0 comp rx=0 tx=0).stop 2023-07-14T15:56:27.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.411+0000 7f654cfff700 1 -- 172.21.15.37:0/1787061469 shutdown_connections 2023-07-14T15:56:27.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.411+0000 7f654cfff700 1 --2- 172.21.15.37:0/1787061469 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f652806ace0 0x7f652806d190 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:27.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.411+0000 7f654cfff700 1 --2- 172.21.15.37:0/1787061469 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f65480ae000 0x7f65480acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:27.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.411+0000 7f654cfff700 1 --2- 172.21.15.37:0/1787061469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f654806c0d0 0x7f654814bdc0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:27.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.411+0000 7f654cfff700 1 --2- 172.21.15.37:0/1787061469 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6548071730 0x7f65480ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:27.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.411+0000 7f654cfff700 1 -- 172.21.15.37:0/1787061469 >> 172.21.15.37:0/1787061469 conn(0x7f654806aac0 msgr2=0x7f65480ae5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:27.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.411+0000 7f654cfff700 1 -- 172.21.15.37:0/1787061469 shutdown_connections 2023-07-14T15:56:27.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.411+0000 7f654cfff700 1 -- 172.21.15.37:0/1787061469 wait complete. 2023-07-14T15:56:27.416 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T15:56:27.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.632+0000 7ffad0dff700 1 Processor -- start 2023-07-14T15:56:27.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.633+0000 7ffad0dff700 1 -- start start 2023-07-14T15:56:27.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.634+0000 7ffad0dff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ffacc1603b0 0x7ffacc15ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:27.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.634+0000 7ffad0dff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffacc15dc50 con 0x7ffacc15fee0 2023-07-14T15:56:27.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.634+0000 7ffad0dff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffacc0b2940 con 0x7ffacc0d1140 2023-07-14T15:56:27.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.634+0000 7ffad0dff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffacc0b2c20 con 0x7ffacc1603b0 2023-07-14T15:56:27.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.634+0000 7ffaca59c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ffacc15fee0 0x7ffacc0d0a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37382/0 (socket says 172.21.15.37:37382) 2023-07-14T15:56:27.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.634+0000 7ffaca59c700 1 -- 172.21.15.37:0/1756682278 learned_addr learned my addr 172.21.15.37:0/1756682278 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:27.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.634+0000 7ffacad9d700 1 --2- 172.21.15.37:0/1756682278 >> v2:172.21.15.98:3300/0 conn(0x7ffacc1603b0 0x7ffacc15ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:27.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.634+0000 7ffac9d9b700 1 -- 172.21.15.37:0/1756682278 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 380540250 0 0) 0x7ffacc15dc50 con 0x7ffacc15fee0 2023-07-14T15:56:27.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.634+0000 7ffac9d9b700 1 -- 172.21.15.37:0/1756682278 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffab80035b0 con 0x7ffacc15fee0 2023-07-14T15:56:27.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.635+0000 7ffac9d9b700 1 -- 172.21.15.37:0/1756682278 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3617477395 0 0) 0x7ffacc0b2940 con 0x7ffacc0d1140 2023-07-14T15:56:27.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.635+0000 7ffac9d9b700 1 -- 172.21.15.37:0/1756682278 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffacc15dc50 con 0x7ffacc0d1140 2023-07-14T15:56:27.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.635+0000 7ffacad9d700 1 -- 172.21.15.37:0/1756682278 >> v1:172.21.15.98:6789/0 conn(0x7ffacc0d1140 legacy=0x7ffacc0b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:27.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.635+0000 7ffacad9d700 1 -- 172.21.15.37:0/1756682278 >> v1:172.21.15.37:6789/0 conn(0x7ffacc15fee0 legacy=0x7ffacc0d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:27.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.635+0000 7ffacad9d700 1 -- 172.21.15.37:0/1756682278 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffacc0b2f00 con 0x7ffacc1603b0 2023-07-14T15:56:27.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.635+0000 7ffacad9d700 1 --2- 172.21.15.37:0/1756682278 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffacc1603b0 0x7ffacc15ded0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ffac4009d90 tx=0x7ffac400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8be5d3330bac405 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:27.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.635+0000 7ffac9d9b700 1 -- 172.21.15.37:0/1756682278 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac400e070 con 0x7ffacc1603b0 2023-07-14T15:56:27.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.635+0000 7ffac9d9b700 1 -- 172.21.15.37:0/1756682278 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac400bb20 con 0x7ffacc1603b0 2023-07-14T15:56:27.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.635+0000 7ffac9d9b700 1 -- 172.21.15.37:0/1756682278 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac4012430 con 0x7ffacc1603b0 2023-07-14T15:56:27.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.636+0000 7ffad0dff700 1 -- 172.21.15.37:0/1756682278 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffacc1603b0 msgr2=0x7ffacc15ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:27.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.636+0000 7ffad0dff700 1 --2- 172.21.15.37:0/1756682278 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffacc1603b0 0x7ffacc15ded0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ffac4009d90 tx=0x7ffac400b330 comp rx=0 tx=0).stop 2023-07-14T15:56:27.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.636+0000 7ffad0dff700 1 -- 172.21.15.37:0/1756682278 shutdown_connections 2023-07-14T15:56:27.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.636+0000 7ffad0dff700 1 --2- 172.21.15.37:0/1756682278 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffacc1603b0 0x7ffacc15ded0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:27.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.636+0000 7ffad0dff700 1 -- 172.21.15.37:0/1756682278 >> 172.21.15.37:0/1756682278 conn(0x7ffacc09c1b0 msgr2=0x7ffacc0d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:27.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.636+0000 7ffad0dff700 1 -- 172.21.15.37:0/1756682278 shutdown_connections 2023-07-14T15:56:27.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.636+0000 7ffad0dff700 1 -- 172.21.15.37:0/1756682278 wait complete. 2023-07-14T15:56:27.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.637+0000 7ffad0dff700 1 Processor -- start 2023-07-14T15:56:27.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.638+0000 7ffad0dff700 1 -- start start 2023-07-14T15:56:27.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.639+0000 7ffad0dff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffacc0d1140 0x7ffacc1f17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:27.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.639+0000 7ffad0dff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffacc15fee0 0x7ffacc0c7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:27.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.639+0000 7ffad0dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ffacc1603b0 0x7ffacc0c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:27.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.639+0000 7ffad0dff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc0b6720 con 0x7ffacc15fee0 2023-07-14T15:56:27.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.639+0000 7ffad0dff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc0b6a00 con 0x7ffacc0d1140 2023-07-14T15:56:27.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.639+0000 7ffad0dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc0b6ce0 con 0x7ffacc1603b0 2023-07-14T15:56:27.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.639+0000 7ffac3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffacc15fee0 0x7ffacc0c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:27.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.639+0000 7ffaca59c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffacc0d1140 0x7ffacc1f17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:27.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.639+0000 7ffac3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffacc15fee0 0x7ffacc0c7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33994/0 (socket says 172.21.15.37:33994) 2023-07-14T15:56:27.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.639+0000 7ffac3fff700 1 -- 172.21.15.37:0/419708029 learned_addr learned my addr 172.21.15.37:0/419708029 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:27.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.639+0000 7ffacad9d700 1 --2- 172.21.15.37:0/419708029 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ffacc1603b0 0x7ffacc0c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:27.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.639+0000 7ffac3fff700 1 -- 172.21.15.37:0/419708029 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ffacc1603b0 msgr2=0x7ffacc0c7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:27.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.639+0000 7ffac3fff700 1 --2- 172.21.15.37:0/419708029 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ffacc1603b0 0x7ffacc0c7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:27.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.639+0000 7ffac3fff700 1 -- 172.21.15.37:0/419708029 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffacc0d1140 msgr2=0x7ffacc1f17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:27.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.639+0000 7ffac3fff700 1 --2- 172.21.15.37:0/419708029 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffacc0d1140 0x7ffacc1f17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:27.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.639+0000 7ffac3fff700 1 -- 172.21.15.37:0/419708029 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac4009a70 con 0x7ffacc15fee0 2023-07-14T15:56:27.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.640+0000 7ffac3fff700 1 --2- 172.21.15.37:0/419708029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffacc15fee0 0x7ffacc0c7540 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ffab400c4f0 tx=0x7ffab400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:27.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.640+0000 7ffac2ffd700 1 -- 172.21.15.37:0/419708029 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab40052d0 con 0x7ffacc15fee0 2023-07-14T15:56:27.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.640+0000 7ffac2ffd700 1 -- 172.21.15.37:0/419708029 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab4005430 con 0x7ffacc15fee0 2023-07-14T15:56:27.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.640+0000 7ffac2ffd700 1 -- 172.21.15.37:0/419708029 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab4003880 con 0x7ffacc15fee0 2023-07-14T15:56:27.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.640+0000 7ffad0dff700 1 -- 172.21.15.37:0/419708029 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffacc0b6fc0 con 0x7ffacc15fee0 2023-07-14T15:56:27.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.640+0000 7ffad0dff700 1 -- 172.21.15.37:0/419708029 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffacc1f1d10 con 0x7ffacc15fee0 2023-07-14T15:56:27.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.641+0000 7ffad0dff700 1 -- 172.21.15.37:0/419708029 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffacc067840 con 0x7ffacc15fee0 2023-07-14T15:56:27.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.642+0000 7ffac2ffd700 1 -- 172.21.15.37:0/419708029 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ffab40039e0 con 0x7ffacc15fee0 2023-07-14T15:56:27.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.643+0000 7ffac2ffd700 1 --2- 172.21.15.37:0/419708029 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ffaac06ace0 0x7ffaac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:27.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.643+0000 7ffac2ffd700 1 -- 172.21.15.37:0/419708029 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffab40887e0 con 0x7ffacc15fee0 2023-07-14T15:56:27.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.643+0000 7ffaca59c700 1 --2- 172.21.15.37:0/419708029 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ffaac06ace0 0x7ffaac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:27.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.644+0000 7ffaca59c700 1 --2- 172.21.15.37:0/419708029 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ffaac06ace0 0x7ffaac06d190 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ffabc007fd0 tx=0x7ffabc007e00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:27.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.647+0000 7ffac2ffd700 1 -- 172.21.15.37:0/419708029 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ffab40538a0 con 0x7ffacc15fee0 2023-07-14T15:56:27.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.852+0000 7ffad0dff700 1 -- 172.21.15.37:0/419708029 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffacc0b6860 con 0x7ffacc15fee0 2023-07-14T15:56:27.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.852+0000 7ffac2ffd700 1 -- 172.21.15.37:0/419708029 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffacc0b6860 con 0x7ffacc15fee0 2023-07-14T15:56:27.839 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-14T15:56:27.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.855+0000 7ffad0dff700 1 -- 172.21.15.37:0/419708029 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ffaac06ace0 msgr2=0x7ffaac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:27.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.855+0000 7ffad0dff700 1 --2- 172.21.15.37:0/419708029 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ffaac06ace0 0x7ffaac06d190 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ffabc007fd0 tx=0x7ffabc007e00 comp rx=0 tx=0).stop 2023-07-14T15:56:27.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.855+0000 7ffad0dff700 1 -- 172.21.15.37:0/419708029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffacc15fee0 msgr2=0x7ffacc0c7540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:27.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.855+0000 7ffad0dff700 1 --2- 172.21.15.37:0/419708029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffacc15fee0 0x7ffacc0c7540 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ffab400c4f0 tx=0x7ffab400c800 comp rx=0 tx=0).stop 2023-07-14T15:56:27.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.855+0000 7ffad0dff700 1 -- 172.21.15.37:0/419708029 shutdown_connections 2023-07-14T15:56:27.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.855+0000 7ffad0dff700 1 --2- 172.21.15.37:0/419708029 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffacc0d1140 0x7ffacc1f17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:27.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.855+0000 7ffad0dff700 1 --2- 172.21.15.37:0/419708029 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ffaac06ace0 0x7ffaac06d190 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:27.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.855+0000 7ffad0dff700 1 --2- 172.21.15.37:0/419708029 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ffacc1603b0 0x7ffacc0c7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:27.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.855+0000 7ffad0dff700 1 --2- 172.21.15.37:0/419708029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffacc15fee0 0x7ffacc0c7540 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:27.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.855+0000 7ffad0dff700 1 -- 172.21.15.37:0/419708029 >> 172.21.15.37:0/419708029 conn(0x7ffacc09c1b0 msgr2=0x7ffacc15cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:27.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.855+0000 7ffad0dff700 1 -- 172.21.15.37:0/419708029 shutdown_connections 2023-07-14T15:56:27.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:27.855+0000 7ffad0dff700 1 -- 172.21.15.37:0/419708029 wait complete. 2023-07-14T15:56:27.859 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T15:56:28.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.077+0000 7efe9a7ff700 1 Processor -- start 2023-07-14T15:56:28.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.078+0000 7efe9a7ff700 1 -- start start 2023-07-14T15:56:28.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.079+0000 7efe9a7ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efe940d1140 0x7efe9415ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:28.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.079+0000 7efe9a7ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7efe941603b0 0x7efe940b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:28.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.079+0000 7efe9a7ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe9415dc50 con 0x7efe9415fee0 2023-07-14T15:56:28.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.079+0000 7efe9a7ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe940b2940 con 0x7efe940d1140 2023-07-14T15:56:28.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.079+0000 7efe9a7ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe940b2c20 con 0x7efe941603b0 2023-07-14T15:56:28.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.079+0000 7efe93fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7efe9415fee0 0x7efe940d0a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37388/0 (socket says 172.21.15.37:37388) 2023-07-14T15:56:28.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.079+0000 7efe937fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efe940d1140 0x7efe9415ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:28.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.079+0000 7efe93fff700 1 -- 172.21.15.37:0/1721905348 learned_addr learned my addr 172.21.15.37:0/1721905348 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:28.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.079+0000 7efe98d9c700 1 --2- 172.21.15.37:0/1721905348 >> v2:172.21.15.98:3300/0 conn(0x7efe941603b0 0x7efe940b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:28.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.080+0000 7efe937fe700 1 -- 172.21.15.37:0/1721905348 >> v2:172.21.15.98:3300/0 conn(0x7efe941603b0 msgr2=0x7efe940b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:28.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.080+0000 7efe937fe700 1 --2- 172.21.15.37:0/1721905348 >> v2:172.21.15.98:3300/0 conn(0x7efe941603b0 0x7efe940b39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:28.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.079+0000 7efe92ffd700 1 -- 172.21.15.37:0/1721905348 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2652714942 0 0) 0x7efe9415dc50 con 0x7efe9415fee0 2023-07-14T15:56:28.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.080+0000 7efe937fe700 1 -- 172.21.15.37:0/1721905348 >> v1:172.21.15.37:6789/0 conn(0x7efe9415fee0 legacy=0x7efe940d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:28.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.080+0000 7efe937fe700 1 -- 172.21.15.37:0/1721905348 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe940b2f00 con 0x7efe940d1140 2023-07-14T15:56:28.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.080+0000 7efe98d9c700 1 --2- 172.21.15.37:0/1721905348 >> v2:172.21.15.98:3300/0 conn(0x7efe941603b0 0x7efe940b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:56:28.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.080+0000 7efe937fe700 1 --2- 172.21.15.37:0/1721905348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe940d1140 0x7efe9415ded0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7efe940b8ee0 tx=0x7efe88009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71c89c508bfc1dba server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:28.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.080+0000 7efe92ffd700 1 -- 172.21.15.37:0/1721905348 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe88011830 con 0x7efe940d1140 2023-07-14T15:56:28.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.080+0000 7efe92ffd700 1 -- 172.21.15.37:0/1721905348 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe88011990 con 0x7efe940d1140 2023-07-14T15:56:28.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.080+0000 7efe92ffd700 1 -- 172.21.15.37:0/1721905348 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe88011d20 con 0x7efe940d1140 2023-07-14T15:56:28.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.081+0000 7efe9a7ff700 1 -- 172.21.15.37:0/1721905348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe940d1140 msgr2=0x7efe9415ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:28.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.081+0000 7efe9a7ff700 1 --2- 172.21.15.37:0/1721905348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe940d1140 0x7efe9415ded0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7efe940b8ee0 tx=0x7efe88009b20 comp rx=0 tx=0).stop 2023-07-14T15:56:28.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.081+0000 7efe9a7ff700 1 -- 172.21.15.37:0/1721905348 shutdown_connections 2023-07-14T15:56:28.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.081+0000 7efe9a7ff700 1 --2- 172.21.15.37:0/1721905348 >> v2:172.21.15.98:3300/0 conn(0x7efe941603b0 0x7efe940b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:28.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.081+0000 7efe9a7ff700 1 --2- 172.21.15.37:0/1721905348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe940d1140 0x7efe9415ded0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:28.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.081+0000 7efe9a7ff700 1 -- 172.21.15.37:0/1721905348 >> 172.21.15.37:0/1721905348 conn(0x7efe9409c1b0 msgr2=0x7efe940d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:28.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.081+0000 7efe9a7ff700 1 -- 172.21.15.37:0/1721905348 shutdown_connections 2023-07-14T15:56:28.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.081+0000 7efe9a7ff700 1 -- 172.21.15.37:0/1721905348 wait complete. 2023-07-14T15:56:28.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.083+0000 7efe9a7ff700 1 Processor -- start 2023-07-14T15:56:28.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.083+0000 7efe9a7ff700 1 -- start start 2023-07-14T15:56:28.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.085+0000 7efe9a7ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7efe940d1140 0x7efe940c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:28.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.085+0000 7efe9a7ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe9415fee0 0x7efe9415a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:28.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.085+0000 7efe9a7ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efe941603b0 0x7efe9415a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:28.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.085+0000 7efe9a7ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe940c7440 con 0x7efe9415fee0 2023-07-14T15:56:28.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.085+0000 7efe9a7ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe940c7670 con 0x7efe941603b0 2023-07-14T15:56:28.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.085+0000 7efe9a7ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe940c7950 con 0x7efe940d1140 2023-07-14T15:56:28.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.085+0000 7efe937fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe9415fee0 0x7efe9415a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:28.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.085+0000 7efe937fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe9415fee0 0x7efe9415a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34000/0 (socket says 172.21.15.37:34000) 2023-07-14T15:56:28.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.085+0000 7efe937fe700 1 -- 172.21.15.37:0/2143349421 learned_addr learned my addr 172.21.15.37:0/2143349421 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:28.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.085+0000 7efe98d9c700 1 --2- 172.21.15.37:0/2143349421 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efe941603b0 0x7efe9415a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:28.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.085+0000 7efe93fff700 1 --2- 172.21.15.37:0/2143349421 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7efe940d1140 0x7efe940c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:28.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.085+0000 7efe937fe700 1 -- 172.21.15.37:0/2143349421 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7efe940d1140 msgr2=0x7efe940c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:28.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.085+0000 7efe937fe700 1 --2- 172.21.15.37:0/2143349421 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7efe940d1140 0x7efe940c6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:28.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.085+0000 7efe937fe700 1 -- 172.21.15.37:0/2143349421 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efe941603b0 msgr2=0x7efe9415a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:28.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.085+0000 7efe937fe700 1 --2- 172.21.15.37:0/2143349421 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efe941603b0 0x7efe9415a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:28.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.085+0000 7efe937fe700 1 -- 172.21.15.37:0/2143349421 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe880094a0 con 0x7efe9415fee0 2023-07-14T15:56:28.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.085+0000 7efe93fff700 1 --2- 172.21.15.37:0/2143349421 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7efe940d1140 0x7efe940c6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:56:28.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.086+0000 7efe937fe700 1 --2- 172.21.15.37:0/2143349421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe9415fee0 0x7efe9415a1e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7efe88014040 tx=0x7efe88004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:28.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.086+0000 7efe90ff9700 1 -- 172.21.15.37:0/2143349421 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe880036a0 con 0x7efe9415fee0 2023-07-14T15:56:28.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.086+0000 7efe90ff9700 1 -- 172.21.15.37:0/2143349421 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe8801e070 con 0x7efe9415fee0 2023-07-14T15:56:28.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.086+0000 7efe9a7ff700 1 -- 172.21.15.37:0/2143349421 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe940b6ce0 con 0x7efe9415fee0 2023-07-14T15:56:28.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.086+0000 7efe90ff9700 1 -- 172.21.15.37:0/2143349421 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe88003a00 con 0x7efe9415fee0 2023-07-14T15:56:28.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.086+0000 7efe9a7ff700 1 -- 172.21.15.37:0/2143349421 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe940b72a0 con 0x7efe9415fee0 2023-07-14T15:56:28.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.087+0000 7efe9a7ff700 1 -- 172.21.15.37:0/2143349421 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe94067840 con 0x7efe9415fee0 2023-07-14T15:56:28.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.088+0000 7efe90ff9700 1 -- 172.21.15.37:0/2143349421 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efe88003b60 con 0x7efe9415fee0 2023-07-14T15:56:28.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.089+0000 7efe90ff9700 1 --2- 172.21.15.37:0/2143349421 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7efe8006ad10 0x7efe8006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:28.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.089+0000 7efe90ff9700 1 -- 172.21.15.37:0/2143349421 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efe8808a500 con 0x7efe9415fee0 2023-07-14T15:56:28.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.089+0000 7efe93fff700 1 --2- 172.21.15.37:0/2143349421 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7efe8006ad10 0x7efe8006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:28.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.090+0000 7efe93fff700 1 --2- 172.21.15.37:0/2143349421 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7efe8006ad10 0x7efe8006d1c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efe84000f60 tx=0x7efe84007ca0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:28.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.093+0000 7efe90ff9700 1 -- 172.21.15.37:0/2143349421 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7efe880555a0 con 0x7efe9415fee0 2023-07-14T15:56:28.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.300+0000 7efe9a7ff700 1 -- 172.21.15.37:0/2143349421 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efe940b31b0 con 0x7efe9415fee0 2023-07-14T15:56:28.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.301+0000 7efe90ff9700 1 -- 172.21.15.37:0/2143349421 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7efe88058bc0 con 0x7efe9415fee0 2023-07-14T15:56:28.288 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-14T15:56:28.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.303+0000 7efe9a7ff700 1 -- 172.21.15.37:0/2143349421 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7efe8006ad10 msgr2=0x7efe8006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:28.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.303+0000 7efe9a7ff700 1 --2- 172.21.15.37:0/2143349421 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7efe8006ad10 0x7efe8006d1c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efe84000f60 tx=0x7efe84007ca0 comp rx=0 tx=0).stop 2023-07-14T15:56:28.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.303+0000 7efe9a7ff700 1 -- 172.21.15.37:0/2143349421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe9415fee0 msgr2=0x7efe9415a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:28.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.303+0000 7efe9a7ff700 1 --2- 172.21.15.37:0/2143349421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe9415fee0 0x7efe9415a1e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7efe88014040 tx=0x7efe88004750 comp rx=0 tx=0).stop 2023-07-14T15:56:28.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.303+0000 7efe9a7ff700 1 -- 172.21.15.37:0/2143349421 shutdown_connections 2023-07-14T15:56:28.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.303+0000 7efe9a7ff700 1 --2- 172.21.15.37:0/2143349421 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efe941603b0 0x7efe9415a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:28.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.303+0000 7efe9a7ff700 1 --2- 172.21.15.37:0/2143349421 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7efe8006ad10 0x7efe8006d1c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:28.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.303+0000 7efe9a7ff700 1 --2- 172.21.15.37:0/2143349421 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7efe940d1140 0x7efe940c6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:28.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.303+0000 7efe9a7ff700 1 --2- 172.21.15.37:0/2143349421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe9415fee0 0x7efe9415a1e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:28.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.303+0000 7efe9a7ff700 1 -- 172.21.15.37:0/2143349421 >> 172.21.15.37:0/2143349421 conn(0x7efe9409c1b0 msgr2=0x7efe94160780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:28.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.303+0000 7efe9a7ff700 1 -- 172.21.15.37:0/2143349421 shutdown_connections 2023-07-14T15:56:28.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.304+0000 7efe9a7ff700 1 -- 172.21.15.37:0/2143349421 wait complete. 2023-07-14T15:56:28.308 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T15:56:28.346 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T15:56:28.358 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T15:56:28.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.530+0000 7feeeddff700 1 Processor -- start 2023-07-14T15:56:28.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.530+0000 7feeeddff700 1 -- start start 2023-07-14T15:56:28.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.531+0000 7feeeddff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7feee8142750 0x7feee815d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:28.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.531+0000 7feeeddff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7feee815d020 0x7feee80703a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:28.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.531+0000 7feeeddff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feee80c9870 con 0x7feee80cae90 2023-07-14T15:56:28.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.531+0000 7feeeddff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feee8142b20 con 0x7feee8142750 2023-07-14T15:56:28.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.531+0000 7feeeddff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feee80ce570 con 0x7feee815d020 2023-07-14T15:56:28.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.532+0000 7feee77fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7feee8142750 0x7feee815d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:28.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.532+0000 7feee77fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7feee8142750 0x7feee815d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34002/0 (socket says 172.21.15.37:34002) 2023-07-14T15:56:28.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.532+0000 7feee77fe700 1 -- 172.21.15.37:0/3406444542 learned_addr learned my addr 172.21.15.37:0/3406444542 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:28.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.532+0000 7feee7fff700 1 --2- 172.21.15.37:0/3406444542 >> v2:172.21.15.98:3300/0 conn(0x7feee815d020 0x7feee80703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:28.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.532+0000 7feee77fe700 1 -- 172.21.15.37:0/3406444542 >> v2:172.21.15.98:3300/0 conn(0x7feee815d020 msgr2=0x7feee80703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:28.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.532+0000 7feee77fe700 1 --2- 172.21.15.37:0/3406444542 >> v2:172.21.15.98:3300/0 conn(0x7feee815d020 0x7feee80703a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:28.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.532+0000 7feee77fe700 1 -- 172.21.15.37:0/3406444542 >> v1:172.21.15.98:6789/0 conn(0x7feee80cae90 legacy=0x7feee815c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:28.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.532+0000 7feee67fc700 1 -- 172.21.15.37:0/3406444542 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 887778976 0 0) 0x7feee80c9870 con 0x7feee80cae90 2023-07-14T15:56:28.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.532+0000 7feee77fe700 1 -- 172.21.15.37:0/3406444542 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee80ce850 con 0x7feee8142750 2023-07-14T15:56:28.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.532+0000 7feee77fe700 1 --2- 172.21.15.37:0/3406444542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feee8142750 0x7feee815d4f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7feee806f7b0 tx=0x7feed800be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=742055c01d3bc8dc server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:28.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.533+0000 7feee67fc700 1 -- 172.21.15.37:0/3406444542 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed800db60 con 0x7feee8142750 2023-07-14T15:56:28.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.533+0000 7feee67fc700 1 -- 172.21.15.37:0/3406444542 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed800dcc0 con 0x7feee8142750 2023-07-14T15:56:28.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.533+0000 7feee67fc700 1 -- 172.21.15.37:0/3406444542 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed8017630 con 0x7feee8142750 2023-07-14T15:56:28.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.533+0000 7feeeddff700 1 -- 172.21.15.37:0/3406444542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feee8142750 msgr2=0x7feee815d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:28.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.533+0000 7feeeddff700 1 --2- 172.21.15.37:0/3406444542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feee8142750 0x7feee815d4f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7feee806f7b0 tx=0x7feed800be70 comp rx=0 tx=0).stop 2023-07-14T15:56:28.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.533+0000 7feeeddff700 1 -- 172.21.15.37:0/3406444542 shutdown_connections 2023-07-14T15:56:28.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.533+0000 7feeeddff700 1 --2- 172.21.15.37:0/3406444542 >> v2:172.21.15.98:3300/0 conn(0x7feee815d020 0x7feee80703a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:28.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.533+0000 7feeeddff700 1 --2- 172.21.15.37:0/3406444542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feee8142750 0x7feee815d4f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:28.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.533+0000 7feeeddff700 1 -- 172.21.15.37:0/3406444542 >> 172.21.15.37:0/3406444542 conn(0x7feee80b08c0 msgr2=0x7feee80b0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:28.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.533+0000 7feeeddff700 1 -- 172.21.15.37:0/3406444542 shutdown_connections 2023-07-14T15:56:28.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.533+0000 7feeeddff700 1 -- 172.21.15.37:0/3406444542 wait complete. 2023-07-14T15:56:28.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.535+0000 7feeeddff700 1 Processor -- start 2023-07-14T15:56:28.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.535+0000 7feeeddff700 1 -- start start 2023-07-14T15:56:28.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.536+0000 7feeeddff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feee80cae90 0x7feee81ee810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:28.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.536+0000 7feeeddff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7feee8142750 0x7feee8158020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:28.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.536+0000 7feeeddff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feee815d020 0x7feee806c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:28.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.536+0000 7feeeddff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee8139e50 con 0x7feee815d020 2023-07-14T15:56:28.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.536+0000 7feeeddff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee81eed50 con 0x7feee80cae90 2023-07-14T15:56:28.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.536+0000 7feeeddff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee81598a0 con 0x7feee8142750 2023-07-14T15:56:28.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.536+0000 7feee7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feee815d020 0x7feee806c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:28.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.536+0000 7feee7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feee815d020 0x7feee806c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34016/0 (socket says 172.21.15.37:34016) 2023-07-14T15:56:28.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.536+0000 7feee7fff700 1 -- 172.21.15.37:0/780272227 learned_addr learned my addr 172.21.15.37:0/780272227 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:28.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.537+0000 7feee77fe700 1 --2- 172.21.15.37:0/780272227 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feee80cae90 0x7feee81ee810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:28.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.537+0000 7feee6ffd700 1 --2- 172.21.15.37:0/780272227 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7feee8142750 0x7feee8158020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:28.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.537+0000 7feee7fff700 1 -- 172.21.15.37:0/780272227 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7feee8142750 msgr2=0x7feee8158020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:28.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.537+0000 7feee7fff700 1 --2- 172.21.15.37:0/780272227 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7feee8142750 0x7feee8158020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:28.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.537+0000 7feee7fff700 1 -- 172.21.15.37:0/780272227 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feee80cae90 msgr2=0x7feee81ee810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:28.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.537+0000 7feee7fff700 1 --2- 172.21.15.37:0/780272227 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feee80cae90 0x7feee81ee810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:28.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.537+0000 7feee7fff700 1 -- 172.21.15.37:0/780272227 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed800b7f0 con 0x7feee815d020 2023-07-14T15:56:28.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.537+0000 7feee6ffd700 1 --2- 172.21.15.37:0/780272227 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7feee8142750 0x7feee8158020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:56:28.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.537+0000 7feee7fff700 1 --2- 172.21.15.37:0/780272227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feee815d020 0x7feee806c030 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7feee000efc0 tx=0x7feee000c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:28.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.537+0000 7feecffff700 1 -- 172.21.15.37:0/780272227 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee000cb80 con 0x7feee815d020 2023-07-14T15:56:28.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.537+0000 7feecffff700 1 -- 172.21.15.37:0/780272227 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee000f040 con 0x7feee815d020 2023-07-14T15:56:28.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.537+0000 7feecffff700 1 -- 172.21.15.37:0/780272227 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee0014480 con 0x7feee815d020 2023-07-14T15:56:28.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.537+0000 7feeeddff700 1 -- 172.21.15.37:0/780272227 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feee8159b80 con 0x7feee815d020 2023-07-14T15:56:28.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.537+0000 7feeeddff700 1 -- 172.21.15.37:0/780272227 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feee815a140 con 0x7feee815d020 2023-07-14T15:56:28.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.538+0000 7feeeddff700 1 -- 172.21.15.37:0/780272227 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feee8067840 con 0x7feee815d020 2023-07-14T15:56:28.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.539+0000 7feecffff700 1 -- 172.21.15.37:0/780272227 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7feee00145e0 con 0x7feee815d020 2023-07-14T15:56:28.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.540+0000 7feecffff700 1 --2- 172.21.15.37:0/780272227 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7feed406ace0 0x7feed406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:28.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.540+0000 7feecffff700 1 -- 172.21.15.37:0/780272227 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feee0089ff0 con 0x7feee815d020 2023-07-14T15:56:28.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.541+0000 7feee77fe700 1 --2- 172.21.15.37:0/780272227 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7feed406ace0 0x7feed406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:28.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.541+0000 7feee77fe700 1 --2- 172.21.15.37:0/780272227 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7feed406ace0 0x7feed406d190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7feed8019040 tx=0x7feed8014000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:28.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.544+0000 7feecffff700 1 -- 172.21.15.37:0/780272227 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7feee0055060 con 0x7feee815d020 2023-07-14T15:56:28.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.800+0000 7feeeddff700 1 -- 172.21.15.37:0/780272227 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feee80b1750 con 0x7feee815d020 2023-07-14T15:56:28.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.800+0000 7feecffff700 1 -- 172.21.15.37:0/780272227 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4697 (secure 0 0 0) 0x7feee0058680 con 0x7feee815d020 2023-07-14T15:56:28.787 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:56:28.787 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/596800720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":596800720},{"type":"v1","addr":"172.21.15.37:6835","nonce":596800720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4318,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/1611780456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1611780456},{"type":"v1","addr":"172.21.15.37:6834","nonce":1611780456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4324,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/586880065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":586880065},{"type":"v1","addr":"172.21.15.98:6835","nonce":586880065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T15:56:08.459886+0000","modified":"2023-07-14T15:56:11.974298+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4327},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4327":{"gid":4327,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6837/2731892479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2731892479},{"type":"v1","addr":"172.21.15.98:6837","nonce":2731892479}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T15:56:28.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.802+0000 7feeeddff700 1 -- 172.21.15.37:0/780272227 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7feed406ace0 msgr2=0x7feed406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:28.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.802+0000 7feeeddff700 1 --2- 172.21.15.37:0/780272227 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7feed406ace0 0x7feed406d190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7feed8019040 tx=0x7feed8014000 comp rx=0 tx=0).stop 2023-07-14T15:56:28.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.802+0000 7feeeddff700 1 -- 172.21.15.37:0/780272227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feee815d020 msgr2=0x7feee806c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:28.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.802+0000 7feeeddff700 1 --2- 172.21.15.37:0/780272227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feee815d020 0x7feee806c030 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7feee000efc0 tx=0x7feee000c0c0 comp rx=0 tx=0).stop 2023-07-14T15:56:28.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.803+0000 7feeeddff700 1 -- 172.21.15.37:0/780272227 shutdown_connections 2023-07-14T15:56:28.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.803+0000 7feeeddff700 1 --2- 172.21.15.37:0/780272227 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feee80cae90 0x7feee81ee810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:28.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.803+0000 7feeeddff700 1 --2- 172.21.15.37:0/780272227 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7feed406ace0 0x7feed406d190 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:28.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.803+0000 7feeeddff700 1 --2- 172.21.15.37:0/780272227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feee815d020 0x7feee806c030 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:28.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.803+0000 7feeeddff700 1 --2- 172.21.15.37:0/780272227 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7feee8142750 0x7feee8158020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:28.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.803+0000 7feeeddff700 1 -- 172.21.15.37:0/780272227 >> 172.21.15.37:0/780272227 conn(0x7feee80b08c0 msgr2=0x7feee80cf170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:28.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.803+0000 7feeeddff700 1 -- 172.21.15.37:0/780272227 shutdown_connections 2023-07-14T15:56:28.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:28.803+0000 7feeeddff700 1 -- 172.21.15.37:0/780272227 wait complete. 2023-07-14T15:56:28.791 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 7 2023-07-14T15:56:28.808 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T15:56:29.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.023+0000 7f99901ff700 1 Processor -- start 2023-07-14T15:56:29.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.024+0000 7f99901ff700 1 -- start start 2023-07-14T15:56:29.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.025+0000 7f99901ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f99881593c0 0x7f99880ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:29.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.025+0000 7f99901ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99880c9540 con 0x7f9988159790 2023-07-14T15:56:29.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.025+0000 7f99901ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99880c9ff0 con 0x7f99880c9b30 2023-07-14T15:56:29.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.025+0000 7f99901ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99880ce3d0 con 0x7f99881593c0 2023-07-14T15:56:29.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.025+0000 7f998e79c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9988159790 0x7f99880af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37402/0 (socket says 172.21.15.37:37402) 2023-07-14T15:56:29.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.025+0000 7f998e79c700 1 -- 172.21.15.37:0/449820108 learned_addr learned my addr 172.21.15.37:0/449820108 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:29.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.026+0000 7f998df9b700 1 --2- 172.21.15.37:0/449820108 >> v2:172.21.15.98:3300/0 conn(0x7f99881593c0 0x7f99880ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:29.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.026+0000 7f998cf99700 1 -- 172.21.15.37:0/449820108 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1679345977 0 0) 0x7f99880c9540 con 0x7f9988159790 2023-07-14T15:56:29.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.026+0000 7f998cf99700 1 -- 172.21.15.37:0/449820108 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99740035b0 con 0x7f9988159790 2023-07-14T15:56:29.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.026+0000 7f998cf99700 1 -- 172.21.15.37:0/449820108 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 406853212 0 0) 0x7f99740035b0 con 0x7f9988159790 2023-07-14T15:56:29.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.026+0000 7f998cf99700 1 -- 172.21.15.37:0/449820108 >> v2:172.21.15.98:3300/0 conn(0x7f99881593c0 msgr2=0x7f99880ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:29.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.026+0000 7f998cf99700 1 --2- 172.21.15.37:0/449820108 >> v2:172.21.15.98:3300/0 conn(0x7f99881593c0 0x7f99880ccce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:29.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.026+0000 7f998cf99700 1 -- 172.21.15.37:0/449820108 >> v1:172.21.15.98:6789/0 conn(0x7f99880c9b30 legacy=0x7f998815db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:29.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.026+0000 7f998cf99700 1 -- 172.21.15.37:0/449820108 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99880ce6b0 con 0x7f9988159790 2023-07-14T15:56:29.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.026+0000 7f998cf99700 1 -- 172.21.15.37:0/449820108 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48633207 0 0) 0x7f99800019f0 con 0x7f9988159790 2023-07-14T15:56:29.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.026+0000 7f998cf99700 1 -- 172.21.15.37:0/449820108 >> v1:172.21.15.37:6789/0 conn(0x7f9988159790 legacy=0x7f99880af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:29.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.026+0000 7f998cf99700 1 --2- 172.21.15.37:0/449820108 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9974003a50 0x7f9974003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:29.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.026+0000 7f998cf99700 1 --2- 172.21.15.37:0/449820108 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f9974004850 0x7f9974004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:29.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.026+0000 7f998cf99700 1 --2- 172.21.15.37:0/449820108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9974005200 0x7f997400dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:29.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.026+0000 7f998cf99700 1 -- 172.21.15.37:0/449820108 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99880ce3d0 con 0x7f9974005200 2023-07-14T15:56:29.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.026+0000 7f998cf99700 1 -- 172.21.15.37:0/449820108 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f997400e2d0 con 0x7f9974003a50 2023-07-14T15:56:29.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.026+0000 7f998cf99700 1 -- 172.21.15.37:0/449820108 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f997400e490 con 0x7f9974004850 2023-07-14T15:56:29.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.026+0000 7f998e79c700 1 --2- 172.21.15.37:0/449820108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9974005200 0x7f997400dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:29.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.027+0000 7f998d79a700 1 --2- 172.21.15.37:0/449820108 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f9974004850 0x7f9974004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:29.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.027+0000 7f998df9b700 1 --2- 172.21.15.37:0/449820108 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9974003a50 0x7f9974003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:29.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.027+0000 7f998e79c700 1 -- 172.21.15.37:0/449820108 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f9974004850 msgr2=0x7f9974004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:29.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.027+0000 7f998e79c700 1 --2- 172.21.15.37:0/449820108 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f9974004850 0x7f9974004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:29.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.027+0000 7f998e79c700 1 -- 172.21.15.37:0/449820108 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9974003a50 msgr2=0x7f9974003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:29.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.027+0000 7f998e79c700 1 --2- 172.21.15.37:0/449820108 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9974003a50 0x7f9974003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:29.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.027+0000 7f998e79c700 1 -- 172.21.15.37:0/449820108 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99740035b0 con 0x7f9974005200 2023-07-14T15:56:29.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.027+0000 7f998e79c700 1 -- 172.21.15.37:0/449820108 reap_dead start 2023-07-14T15:56:29.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.027+0000 7f998e79c700 1 --2- 172.21.15.37:0/449820108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9974005200 0x7f997400dc20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f998000a760 tx=0x7f9974005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a03c689f3b3721 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:29.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.027+0000 7f998cf99700 1 -- 172.21.15.37:0/449820108 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998000a250 con 0x7f9974005200 2023-07-14T15:56:29.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.027+0000 7f998cf99700 1 -- 172.21.15.37:0/449820108 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99800072d0 con 0x7f9974005200 2023-07-14T15:56:29.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.027+0000 7f998cf99700 1 -- 172.21.15.37:0/449820108 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9980007680 con 0x7f9974005200 2023-07-14T15:56:29.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.028+0000 7f99901ff700 1 -- 172.21.15.37:0/449820108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9974005200 msgr2=0x7f997400dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:29.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.028+0000 7f99901ff700 1 --2- 172.21.15.37:0/449820108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9974005200 0x7f997400dc20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f998000a760 tx=0x7f9974005880 comp rx=0 tx=0).stop 2023-07-14T15:56:29.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.028+0000 7f99901ff700 1 -- 172.21.15.37:0/449820108 shutdown_connections 2023-07-14T15:56:29.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.028+0000 7f99901ff700 1 --2- 172.21.15.37:0/449820108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9974005200 0x7f997400dc20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:29.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.028+0000 7f99901ff700 1 -- 172.21.15.37:0/449820108 >> 172.21.15.37:0/449820108 conn(0x7f99880b08c0 msgr2=0x7f99880b0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:29.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.028+0000 7f99901ff700 1 -- 172.21.15.37:0/449820108 shutdown_connections 2023-07-14T15:56:29.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.028+0000 7f99901ff700 1 -- 172.21.15.37:0/449820108 wait complete. 2023-07-14T15:56:29.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.030+0000 7f99901ff700 1 Processor -- start 2023-07-14T15:56:29.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.030+0000 7f99901ff700 1 -- start start 2023-07-14T15:56:29.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.031+0000 7f99901ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9974005200 0x7f99881f6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:29.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.031+0000 7f99901ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99881425d0 0x7f998813f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:29.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.031+0000 7f99901ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f9988142a40 0x7f998813f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:29.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.031+0000 7f99901ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99881f7090 con 0x7f9974005200 2023-07-14T15:56:29.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.031+0000 7f99901ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99881e2910 con 0x7f99881425d0 2023-07-14T15:56:29.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.031+0000 7f99901ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99881e31c0 con 0x7f9988142a40 2023-07-14T15:56:29.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.031+0000 7f998df9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9974005200 0x7f99881f6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:29.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.031+0000 7f998df9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9974005200 0x7f99881f6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34040/0 (socket says 172.21.15.37:34040) 2023-07-14T15:56:29.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.031+0000 7f998df9b700 1 -- 172.21.15.37:0/121698192 learned_addr learned my addr 172.21.15.37:0/121698192 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:29.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.031+0000 7f998d79a700 1 --2- 172.21.15.37:0/121698192 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99881425d0 0x7f998813f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:29.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.031+0000 7f998e79c700 1 --2- 172.21.15.37:0/121698192 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f9988142a40 0x7f998813f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:29.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.032+0000 7f998df9b700 1 -- 172.21.15.37:0/121698192 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f9988142a40 msgr2=0x7f998813f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:29.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.032+0000 7f998df9b700 1 --2- 172.21.15.37:0/121698192 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f9988142a40 0x7f998813f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:29.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.032+0000 7f998df9b700 1 -- 172.21.15.37:0/121698192 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99881425d0 msgr2=0x7f998813f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:29.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.032+0000 7f998df9b700 1 --2- 172.21.15.37:0/121698192 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99881425d0 0x7f998813f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:29.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.032+0000 7f998df9b700 1 -- 172.21.15.37:0/121698192 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99881e34a0 con 0x7f9974005200 2023-07-14T15:56:29.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.032+0000 7f998df9b700 1 --2- 172.21.15.37:0/121698192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9974005200 0x7f99881f6b50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9984011900 tx=0x7f9984011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:29.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.032+0000 7f997e7fc700 1 -- 172.21.15.37:0/121698192 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9984011e50 con 0x7f9974005200 2023-07-14T15:56:29.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.032+0000 7f997e7fc700 1 -- 172.21.15.37:0/121698192 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9984004240 con 0x7f9974005200 2023-07-14T15:56:29.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.032+0000 7f997e7fc700 1 -- 172.21.15.37:0/121698192 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998400f730 con 0x7f9974005200 2023-07-14T15:56:29.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.032+0000 7f99901ff700 1 -- 172.21.15.37:0/121698192 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99881e3780 con 0x7f9974005200 2023-07-14T15:56:29.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.032+0000 7f99901ff700 1 -- 172.21.15.37:0/121698192 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99881e2d70 con 0x7f9974005200 2023-07-14T15:56:29.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.033+0000 7f99901ff700 1 -- 172.21.15.37:0/121698192 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99881e2f90 con 0x7f9974005200 2023-07-14T15:56:29.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.034+0000 7f997e7fc700 1 -- 172.21.15.37:0/121698192 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f998400f890 con 0x7f9974005200 2023-07-14T15:56:29.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.036+0000 7f997e7fc700 1 --2- 172.21.15.37:0/121698192 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f996c06ad30 0x7f996c06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:29.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.036+0000 7f997e7fc700 1 -- 172.21.15.37:0/121698192 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9984089800 con 0x7f9974005200 2023-07-14T15:56:29.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.036+0000 7f998d79a700 1 --2- 172.21.15.37:0/121698192 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f996c06ad30 0x7f996c06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:29.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.037+0000 7f998d79a700 1 --2- 172.21.15.37:0/121698192 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f996c06ad30 0x7f996c06d1e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9988140e60 tx=0x7f9978009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:29.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.040+0000 7f997e7fc700 1 -- 172.21.15.37:0/121698192 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9984054920 con 0x7f9974005200 2023-07-14T15:56:29.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.250+0000 7f99901ff700 1 -- 172.21.15.37:0/121698192 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99881e3dd0 con 0x7f9974005200 2023-07-14T15:56:29.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.251+0000 7f997e7fc700 1 -- 172.21.15.37:0/121698192 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18341 (secure 0 0 0) 0x7f9984057f40 con 0x7f9974005200 2023-07-14T15:56:29.238 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:56:29.238 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"fsid":"9da30401-a779-4e46-aba6-00c2494c6c67","created":"2023-07-14T15:55:39.898867+0000","modified":"2023-07-14T15:56:09.959850+0000","last_up_change":"2023-07-14T15:55:53.025696+0000","last_in_change":"2023-07-14T15:55:43.388192+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T15:55:52.907261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T15:55:59.992839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T15:56:06.091064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T15:56:07.448694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d049535-7b87-4276-8fe5-0f74ba422d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6801","nonce":2783032392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6803","nonce":2783032392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6807","nonce":2783032392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6805","nonce":2783032392}]},"public_addr":"172.21.15.37:6801/2783032392","cluster_addr":"172.21.15.37:6803/2783032392","heartbeat_back_addr":"172.21.15.37:6807/2783032392","heartbeat_front_addr":"172.21.15.37:6805/2783032392","state":["exists","up"]},{"osd":1,"uuid":"79ec948d-ead2-4c2d-923a-dd6eeaac9dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6823","nonce":1190059746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6826","nonce":1190059746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6831","nonce":1190059746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6829","nonce":1190059746}]},"public_addr":"172.21.15.37:6823/1190059746","cluster_addr":"172.21.15.37:6826/1190059746","heartbeat_back_addr":"172.21.15.37:6831/1190059746","heartbeat_front_addr":"172.21.15.37:6829/1190059746","state":["exists","up"]},{"osd":2,"uuid":"a1db6690-c160-4366-9c82-2cca17e4bba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6809","nonce":2266223499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6813","nonce":2266223499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6820","nonce":2266223499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6816","nonce":2266223499}]},"public_addr":"172.21.15.37:6809/2266223499","cluster_addr":"172.21.15.37:6813/2266223499","heartbeat_back_addr":"172.21.15.37:6820/2266223499","heartbeat_front_addr":"172.21.15.37:6816/2266223499","state":["exists","up"]},{"osd":3,"uuid":"767b8220-e79a-4a86-a162-6b3b73198379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6812","nonce":4166694594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6817","nonce":4166694594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6828","nonce":4166694594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6822","nonce":4166694594}]},"public_addr":"172.21.15.37:6812/4166694594","cluster_addr":"172.21.15.37:6817/4166694594","heartbeat_back_addr":"172.21.15.37:6828/4166694594","heartbeat_front_addr":"172.21.15.37:6822/4166694594","state":["exists","up"]},{"osd":4,"uuid":"717bd773-ae7e-4236-ac79-900cf99a37c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6801","nonce":3529020407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6803","nonce":3529020407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6807","nonce":3529020407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6805","nonce":3529020407}]},"public_addr":"172.21.15.98:6801/3529020407","cluster_addr":"172.21.15.98:6803/3529020407","heartbeat_back_addr":"172.21.15.98:6807/3529020407","heartbeat_front_addr":"172.21.15.98:6805/3529020407","state":["exists","up"]},{"osd":5,"uuid":"a941d358-0f03-4136-a9b2-3a1c2e9358cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6817","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6819","nonce":2311501838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6821","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6823","nonce":2311501838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6829","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6831","nonce":2311501838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6825","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6827","nonce":2311501838}]},"public_addr":"172.21.15.98:6819/2311501838","cluster_addr":"172.21.15.98:6823/2311501838","heartbeat_back_addr":"172.21.15.98:6831/2311501838","heartbeat_front_addr":"172.21.15.98:6827/2311501838","state":["exists","up"]},{"osd":6,"uuid":"27153772-6d4b-479d-9953-0582e7b96743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6809","nonce":1144224691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6811","nonce":1144224691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6815","nonce":1144224691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6813","nonce":1144224691}]},"public_addr":"172.21.15.98:6809/1144224691","cluster_addr":"172.21.15.98:6811/1144224691","heartbeat_back_addr":"172.21.15.98:6815/1144224691","heartbeat_front_addr":"172.21.15.98:6813/1144224691","state":["exists","up"]},{"osd":7,"uuid":"d21ffc8e-40bb-47eb-af2c-e3e730d3fb76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6818","nonce":1144470927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6822","nonce":1144470927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6830","nonce":1144470927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6826","nonce":1144470927}]},"public_addr":"172.21.15.98:6818/1144470927","cluster_addr":"172.21.15.98:6822/1144470927","heartbeat_back_addr":"172.21.15.98:6830/1144470927","heartbeat_front_addr":"172.21.15.98:6826/1144470927","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.921114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.739210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.024016+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.002527+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.698127+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.813416+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.709351+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.815457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T15:56:29.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.253+0000 7f99901ff700 1 -- 172.21.15.37:0/121698192 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f996c06ad30 msgr2=0x7f996c06d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:29.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.253+0000 7f99901ff700 1 --2- 172.21.15.37:0/121698192 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f996c06ad30 0x7f996c06d1e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9988140e60 tx=0x7f9978009040 comp rx=0 tx=0).stop 2023-07-14T15:56:29.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.253+0000 7f99901ff700 1 -- 172.21.15.37:0/121698192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9974005200 msgr2=0x7f99881f6b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:29.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.253+0000 7f99901ff700 1 --2- 172.21.15.37:0/121698192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9974005200 0x7f99881f6b50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9984011900 tx=0x7f9984011c10 comp rx=0 tx=0).stop 2023-07-14T15:56:29.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.254+0000 7f99901ff700 1 -- 172.21.15.37:0/121698192 shutdown_connections 2023-07-14T15:56:29.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.254+0000 7f99901ff700 1 --2- 172.21.15.37:0/121698192 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f996c06ad30 0x7f996c06d1e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:29.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.254+0000 7f99901ff700 1 --2- 172.21.15.37:0/121698192 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f9988142a40 0x7f998813f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:29.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.254+0000 7f99901ff700 1 --2- 172.21.15.37:0/121698192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9974005200 0x7f99881f6b50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:29.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.254+0000 7f99901ff700 1 --2- 172.21.15.37:0/121698192 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99881425d0 0x7f998813f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:29.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.254+0000 7f99901ff700 1 -- 172.21.15.37:0/121698192 >> 172.21.15.37:0/121698192 conn(0x7f99880b08c0 msgr2=0x7f99881e7cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:29.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.254+0000 7f99901ff700 1 -- 172.21.15.37:0/121698192 shutdown_connections 2023-07-14T15:56:29.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.254+0000 7f99901ff700 1 -- 172.21.15.37:0/121698192 wait complete. 2023-07-14T15:56:29.259 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T15:56:29.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.476+0000 7fad309ff700 1 Processor -- start 2023-07-14T15:56:29.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.476+0000 7fad309ff700 1 -- start start 2023-07-14T15:56:29.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.477+0000 7fad309ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fad2c0b4910 0x7fad2c0b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:29.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.477+0000 7fad309ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad2c0cf6b0 con 0x7fad2c0b85f0 2023-07-14T15:56:29.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.477+0000 7fad309ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad2c0b5270 con 0x7fad2c0b54b0 2023-07-14T15:56:29.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.477+0000 7fad309ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad2c0cdc40 con 0x7fad2c0b4910 2023-07-14T15:56:29.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.477+0000 7fad2a59c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fad2c0b85f0 0x7fad2c15d660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37416/0 (socket says 172.21.15.37:37416) 2023-07-14T15:56:29.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.477+0000 7fad2a59c700 1 -- 172.21.15.37:0/3283080201 learned_addr learned my addr 172.21.15.37:0/3283080201 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:29.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.477+0000 7fad2ad9d700 1 --2- 172.21.15.37:0/3283080201 >> v2:172.21.15.37:3300/0 conn(0x7fad2c0b4910 0x7fad2c0b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:29.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.478+0000 7fad29d9b700 1 -- 172.21.15.37:0/3283080201 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3046719717 0 0) 0x7fad2c0cf6b0 con 0x7fad2c0b85f0 2023-07-14T15:56:29.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.478+0000 7fad29d9b700 1 -- 172.21.15.37:0/3283080201 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad180035b0 con 0x7fad2c0b85f0 2023-07-14T15:56:29.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.478+0000 7fad2ad9d700 1 -- 172.21.15.37:0/3283080201 >> v1:172.21.15.98:6789/0 conn(0x7fad2c0b54b0 legacy=0x7fad2c0cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:29.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.478+0000 7fad2ad9d700 1 -- 172.21.15.37:0/3283080201 >> v1:172.21.15.37:6789/0 conn(0x7fad2c0b85f0 legacy=0x7fad2c15d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:29.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.478+0000 7fad2ad9d700 1 -- 172.21.15.37:0/3283080201 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad2c0d0250 con 0x7fad2c0b4910 2023-07-14T15:56:29.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.478+0000 7fad2ad9d700 1 --2- 172.21.15.37:0/3283080201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad2c0b4910 0x7fad2c0b4d30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fad24009d90 tx=0x7fad2400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1971f3532a746c64 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:29.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.478+0000 7fad29d9b700 1 -- 172.21.15.37:0/3283080201 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2400e070 con 0x7fad2c0b4910 2023-07-14T15:56:29.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.478+0000 7fad29d9b700 1 -- 172.21.15.37:0/3283080201 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad2400bb20 con 0x7fad2c0b4910 2023-07-14T15:56:29.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.478+0000 7fad29d9b700 1 -- 172.21.15.37:0/3283080201 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad24012430 con 0x7fad2c0b4910 2023-07-14T15:56:29.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.479+0000 7fad309ff700 1 -- 172.21.15.37:0/3283080201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad2c0b4910 msgr2=0x7fad2c0b4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:29.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.479+0000 7fad309ff700 1 --2- 172.21.15.37:0/3283080201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad2c0b4910 0x7fad2c0b4d30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fad24009d90 tx=0x7fad2400b330 comp rx=0 tx=0).stop 2023-07-14T15:56:29.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.479+0000 7fad309ff700 1 -- 172.21.15.37:0/3283080201 shutdown_connections 2023-07-14T15:56:29.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.479+0000 7fad309ff700 1 --2- 172.21.15.37:0/3283080201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad2c0b4910 0x7fad2c0b4d30 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:29.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.479+0000 7fad309ff700 1 -- 172.21.15.37:0/3283080201 >> 172.21.15.37:0/3283080201 conn(0x7fad2c06a580 msgr2=0x7fad2c06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:29.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.479+0000 7fad309ff700 1 -- 172.21.15.37:0/3283080201 shutdown_connections 2023-07-14T15:56:29.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.479+0000 7fad309ff700 1 -- 172.21.15.37:0/3283080201 wait complete. 2023-07-14T15:56:29.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.481+0000 7fad309ff700 1 Processor -- start 2023-07-14T15:56:29.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.481+0000 7fad309ff700 1 -- start start 2023-07-14T15:56:29.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.482+0000 7fad309ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fad2c0b4910 0x7fad2c15e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:29.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.482+0000 7fad309ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad2c0b54b0 0x7fad2c15e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:29.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.482+0000 7fad309ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad2c0b85f0 0x7fad2c14bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:29.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.482+0000 7fad309ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2c0c92e0 con 0x7fad2c0b85f0 2023-07-14T15:56:29.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.482+0000 7fad309ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2c0c9860 con 0x7fad2c0b54b0 2023-07-14T15:56:29.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.482+0000 7fad309ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad2c0c9580 con 0x7fad2c0b4910 2023-07-14T15:56:29.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.482+0000 7fad2ad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad2c0b85f0 0x7fad2c14bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:29.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.482+0000 7fad2ad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad2c0b85f0 0x7fad2c14bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34052/0 (socket says 172.21.15.37:34052) 2023-07-14T15:56:29.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.482+0000 7fad2ad9d700 1 -- 172.21.15.37:0/4075603311 learned_addr learned my addr 172.21.15.37:0/4075603311 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:29.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.482+0000 7fad23fff700 1 --2- 172.21.15.37:0/4075603311 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad2c0b54b0 0x7fad2c15e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:29.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.482+0000 7fad2a59c700 1 --2- 172.21.15.37:0/4075603311 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fad2c0b4910 0x7fad2c15e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:29.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.482+0000 7fad2ad9d700 1 -- 172.21.15.37:0/4075603311 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fad2c0b4910 msgr2=0x7fad2c15e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:29.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.482+0000 7fad2ad9d700 1 --2- 172.21.15.37:0/4075603311 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fad2c0b4910 0x7fad2c15e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:29.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.483+0000 7fad2ad9d700 1 -- 172.21.15.37:0/4075603311 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad2c0b54b0 msgr2=0x7fad2c15e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:29.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.483+0000 7fad2ad9d700 1 --2- 172.21.15.37:0/4075603311 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad2c0b54b0 0x7fad2c15e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:29.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.483+0000 7fad2ad9d700 1 -- 172.21.15.37:0/4075603311 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad24009a70 con 0x7fad2c0b85f0 2023-07-14T15:56:29.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.483+0000 7fad23fff700 1 --2- 172.21.15.37:0/4075603311 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad2c0b54b0 0x7fad2c15e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:56:29.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.483+0000 7fad2ad9d700 1 --2- 172.21.15.37:0/4075603311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad2c0b85f0 0x7fad2c14bbb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fad2c0673c0 tx=0x7fad24004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:29.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.483+0000 7fad22ffd700 1 -- 172.21.15.37:0/4075603311 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad24012430 con 0x7fad2c0b85f0 2023-07-14T15:56:29.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.483+0000 7fad22ffd700 1 -- 172.21.15.37:0/4075603311 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad24020070 con 0x7fad2c0b85f0 2023-07-14T15:56:29.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.483+0000 7fad309ff700 1 -- 172.21.15.37:0/4075603311 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad2c0c6c60 con 0x7fad2c0b85f0 2023-07-14T15:56:29.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.483+0000 7fad22ffd700 1 -- 172.21.15.37:0/4075603311 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad24004280 con 0x7fad2c0b85f0 2023-07-14T15:56:29.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.483+0000 7fad309ff700 1 -- 172.21.15.37:0/4075603311 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad2c0c7220 con 0x7fad2c0b85f0 2023-07-14T15:56:29.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.484+0000 7fad309ff700 1 -- 172.21.15.37:0/4075603311 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad2c0cf580 con 0x7fad2c0b85f0 2023-07-14T15:56:29.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.485+0000 7fad22ffd700 1 -- 172.21.15.37:0/4075603311 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fad240043e0 con 0x7fad2c0b85f0 2023-07-14T15:56:29.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.487+0000 7fad22ffd700 1 --2- 172.21.15.37:0/4075603311 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fad0c06ace0 0x7fad0c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:29.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.487+0000 7fad22ffd700 1 -- 172.21.15.37:0/4075603311 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fad24022070 con 0x7fad2c0b85f0 2023-07-14T15:56:29.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.487+0000 7fad2a59c700 1 --2- 172.21.15.37:0/4075603311 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fad0c06ace0 0x7fad0c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:29.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.488+0000 7fad2a59c700 1 --2- 172.21.15.37:0/4075603311 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fad0c06ace0 0x7fad0c06d190 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fad1c0011e0 tx=0x7fad1c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:29.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.491+0000 7fad22ffd700 1 -- 172.21.15.37:0/4075603311 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fad240562d0 con 0x7fad2c0b85f0 2023-07-14T15:56:29.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.745+0000 7fad309ff700 1 -- 172.21.15.37:0/4075603311 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fad2c067840 con 0x7fad2c0b85f0 2023-07-14T15:56:29.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.746+0000 7fad22ffd700 1 -- 172.21.15.37:0/4075603311 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4697 (secure 0 0 0) 0x7fad240598f0 con 0x7fad2c0b85f0 2023-07-14T15:56:29.733 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:56:29.733 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/596800720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":596800720},{"type":"v1","addr":"172.21.15.37:6835","nonce":596800720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4318,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/1611780456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1611780456},{"type":"v1","addr":"172.21.15.37:6834","nonce":1611780456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4324,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/586880065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":586880065},{"type":"v1","addr":"172.21.15.98:6835","nonce":586880065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T15:56:08.459886+0000","modified":"2023-07-14T15:56:11.974298+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4327},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4327":{"gid":4327,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6837/2731892479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2731892479},{"type":"v1","addr":"172.21.15.98:6837","nonce":2731892479}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T15:56:29.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.748+0000 7fad309ff700 1 -- 172.21.15.37:0/4075603311 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fad0c06ace0 msgr2=0x7fad0c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:29.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.748+0000 7fad309ff700 1 --2- 172.21.15.37:0/4075603311 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fad0c06ace0 0x7fad0c06d190 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fad1c0011e0 tx=0x7fad1c009040 comp rx=0 tx=0).stop 2023-07-14T15:56:29.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.748+0000 7fad309ff700 1 -- 172.21.15.37:0/4075603311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad2c0b85f0 msgr2=0x7fad2c14bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:29.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.748+0000 7fad309ff700 1 --2- 172.21.15.37:0/4075603311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad2c0b85f0 0x7fad2c14bbb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fad2c0673c0 tx=0x7fad24004ad0 comp rx=0 tx=0).stop 2023-07-14T15:56:29.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.748+0000 7fad309ff700 1 -- 172.21.15.37:0/4075603311 shutdown_connections 2023-07-14T15:56:29.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.748+0000 7fad309ff700 1 --2- 172.21.15.37:0/4075603311 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fad0c06ace0 0x7fad0c06d190 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:29.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.748+0000 7fad309ff700 1 --2- 172.21.15.37:0/4075603311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad2c0b85f0 0x7fad2c14bbb0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:29.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.748+0000 7fad309ff700 1 --2- 172.21.15.37:0/4075603311 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fad2c0b4910 0x7fad2c15e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:29.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.748+0000 7fad309ff700 1 --2- 172.21.15.37:0/4075603311 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad2c0b54b0 0x7fad2c15e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:29.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.748+0000 7fad309ff700 1 -- 172.21.15.37:0/4075603311 >> 172.21.15.37:0/4075603311 conn(0x7fad2c06a580 msgr2=0x7fad2c0cfb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:29.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.748+0000 7fad309ff700 1 -- 172.21.15.37:0/4075603311 shutdown_connections 2023-07-14T15:56:29.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:29.748+0000 7fad309ff700 1 -- 172.21.15.37:0/4075603311 wait complete. 2023-07-14T15:56:29.737 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 7 2023-07-14T15:56:30.155 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-14T15:56:08.459886+0000', 'modified': '2023-07-14T15:56:11.974298+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4327}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4327': {'gid': 4327, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.98:6837/2731892479', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6836', 'nonce': 2731892479}, {'type': 'v1', 'addr': '172.21.15.98:6837', 'nonce': 2731892479}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-14T15:56:30.156 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-14T15:56:30.156 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-07-14T15:56:30.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.372+0000 7f809d7ff700 1 Processor -- start 2023-07-14T15:56:30.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.372+0000 7f809d7ff700 1 -- start start 2023-07-14T15:56:30.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.374+0000 7f809d7ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f80980d15c0 0x7f80980cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:30.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.374+0000 7f809d7ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80980cdb50 con 0x7f80980b0ae0 2023-07-14T15:56:30.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.374+0000 7f809d7ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80980cde30 con 0x7f80980b8900 2023-07-14T15:56:30.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.374+0000 7f809d7ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f809815d030 con 0x7f80980d15c0 2023-07-14T15:56:30.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.374+0000 7f80977fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f80980b0ae0 0x7f80980cebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:59978/0 (socket says 172.21.15.37:59978) 2023-07-14T15:56:30.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.374+0000 7f80977fe700 1 -- 172.21.15.37:0/599663184 learned_addr learned my addr 172.21.15.37:0/599663184 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:30.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.374+0000 7f80967fc700 1 --2- 172.21.15.37:0/599663184 >> v2:172.21.15.98:3300/0 conn(0x7f80980d15c0 0x7f80980cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:30.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.374+0000 7f8095ffb700 1 -- 172.21.15.37:0/599663184 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2537641452 0 0) 0x7f80980cdb50 con 0x7f80980b0ae0 2023-07-14T15:56:30.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.374+0000 7f8095ffb700 1 -- 172.21.15.37:0/599663184 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80800035b0 con 0x7f80980b0ae0 2023-07-14T15:56:30.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.374+0000 7f80967fc700 1 -- 172.21.15.37:0/599663184 >> v1:172.21.15.98:6789/0 conn(0x7f80980b8900 legacy=0x7f80980d0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:30.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.375+0000 7f8095ffb700 1 -- 172.21.15.37:0/599663184 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3653656668 0 0) 0x7f80980cde30 con 0x7f80980b8900 2023-07-14T15:56:30.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.375+0000 7f80967fc700 1 -- 172.21.15.37:0/599663184 >> v1:172.21.15.37:6789/0 conn(0x7f80980b0ae0 legacy=0x7f80980cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:30.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.375+0000 7f80967fc700 1 -- 172.21.15.37:0/599663184 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80980ce110 con 0x7f80980d15c0 2023-07-14T15:56:30.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.375+0000 7f80967fc700 1 --2- 172.21.15.37:0/599663184 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f80980d15c0 0x7f80980cd570 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f808c009840 tx=0x7f808c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c52320f1f6073a0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:30.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.375+0000 7f8095ffb700 1 -- 172.21.15.37:0/599663184 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c011830 con 0x7f80980d15c0 2023-07-14T15:56:30.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.375+0000 7f8095ffb700 1 -- 172.21.15.37:0/599663184 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f808c011990 con 0x7f80980d15c0 2023-07-14T15:56:30.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.375+0000 7f8095ffb700 1 -- 172.21.15.37:0/599663184 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c011d00 con 0x7f80980d15c0 2023-07-14T15:56:30.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.376+0000 7f809d7ff700 1 -- 172.21.15.37:0/599663184 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f80980d15c0 msgr2=0x7f80980cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:30.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.376+0000 7f809d7ff700 1 --2- 172.21.15.37:0/599663184 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f80980d15c0 0x7f80980cd570 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f808c009840 tx=0x7f808c009b50 comp rx=0 tx=0).stop 2023-07-14T15:56:30.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.376+0000 7f809d7ff700 1 -- 172.21.15.37:0/599663184 shutdown_connections 2023-07-14T15:56:30.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.376+0000 7f809d7ff700 1 --2- 172.21.15.37:0/599663184 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f80980d15c0 0x7f80980cd570 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:30.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.376+0000 7f809d7ff700 1 -- 172.21.15.37:0/599663184 >> 172.21.15.37:0/599663184 conn(0x7f809809c1e0 msgr2=0x7f80980d2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:30.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.376+0000 7f809d7ff700 1 -- 172.21.15.37:0/599663184 shutdown_connections 2023-07-14T15:56:30.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.376+0000 7f809d7ff700 1 -- 172.21.15.37:0/599663184 wait complete. 2023-07-14T15:56:30.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.378+0000 7f809d7ff700 1 Processor -- start 2023-07-14T15:56:30.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.378+0000 7f809d7ff700 1 -- start start 2023-07-14T15:56:30.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.379+0000 7f809d7ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80980b0ae0 0x7f80980cd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:30.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.379+0000 7f809d7ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f80980b8900 0x7f80980b3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:30.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.379+0000 7f809d7ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f80980d15c0 0x7f80981e63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:30.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.379+0000 7f809d7ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809815e360 con 0x7f80980b0ae0 2023-07-14T15:56:30.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.379+0000 7f809d7ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809815b030 con 0x7f80980d15c0 2023-07-14T15:56:30.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.379+0000 7f809d7ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f809815d6e0 con 0x7f80980b8900 2023-07-14T15:56:30.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.379+0000 7f8096ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80980b0ae0 0x7f80980cd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:30.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.379+0000 7f8096ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80980b0ae0 0x7f80980cd110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51630/0 (socket says 172.21.15.37:51630) 2023-07-14T15:56:30.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.379+0000 7f8096ffd700 1 -- 172.21.15.37:0/1286802638 learned_addr learned my addr 172.21.15.37:0/1286802638 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:30.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.379+0000 7f80977fe700 1 --2- 172.21.15.37:0/1286802638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f80980d15c0 0x7f80981e63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:30.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.379+0000 7f80967fc700 1 --2- 172.21.15.37:0/1286802638 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f80980b8900 0x7f80980b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:30.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.379+0000 7f8096ffd700 1 -- 172.21.15.37:0/1286802638 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f80980b8900 msgr2=0x7f80980b3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:30.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.379+0000 7f8096ffd700 1 --2- 172.21.15.37:0/1286802638 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f80980b8900 0x7f80980b3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:30.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.379+0000 7f8096ffd700 1 -- 172.21.15.37:0/1286802638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f80980d15c0 msgr2=0x7f80981e63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:30.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.379+0000 7f8096ffd700 1 --2- 172.21.15.37:0/1286802638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f80980d15c0 0x7f80981e63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:30.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.379+0000 7f8096ffd700 1 -- 172.21.15.37:0/1286802638 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f808c0094a0 con 0x7f80980b0ae0 2023-07-14T15:56:30.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.379+0000 7f80977fe700 1 --2- 172.21.15.37:0/1286802638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f80980d15c0 0x7f80981e63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:56:30.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.379+0000 7f8096ffd700 1 --2- 172.21.15.37:0/1286802638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80980b0ae0 0x7f80980cd110 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8088001f00 tx=0x7f808800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:30.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.380+0000 7f807f7fe700 1 -- 172.21.15.37:0/1286802638 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80880054e0 con 0x7f80980b0ae0 2023-07-14T15:56:30.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.380+0000 7f807f7fe700 1 -- 172.21.15.37:0/1286802638 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80880036d0 con 0x7f80980b0ae0 2023-07-14T15:56:30.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.380+0000 7f807f7fe700 1 -- 172.21.15.37:0/1286802638 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8088003a60 con 0x7f80980b0ae0 2023-07-14T15:56:30.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.380+0000 7f809d7ff700 1 -- 172.21.15.37:0/1286802638 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f809815d9c0 con 0x7f80980b0ae0 2023-07-14T15:56:30.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.380+0000 7f809d7ff700 1 -- 172.21.15.37:0/1286802638 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f809815df80 con 0x7f80980b0ae0 2023-07-14T15:56:30.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.382+0000 7f807f7fe700 1 -- 172.21.15.37:0/1286802638 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8088003bc0 con 0x7f80980b0ae0 2023-07-14T15:56:30.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.383+0000 7f807f7fe700 1 --2- 172.21.15.37:0/1286802638 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f808406ace0 0x7f808406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:30.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.383+0000 7f807f7fe700 1 -- 172.21.15.37:0/1286802638 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8088088a80 con 0x7f80980b0ae0 2023-07-14T15:56:30.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.383+0000 7f80967fc700 1 --2- 172.21.15.37:0/1286802638 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f808406ace0 0x7f808406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:30.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.384+0000 7f80967fc700 1 --2- 172.21.15.37:0/1286802638 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f808406ace0 0x7f808406d190 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f80980d19b0 tx=0x7f808c01c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:30.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.385+0000 7f80b11bbb80 1 Processor -- start 2023-07-14T15:56:30.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.385+0000 7f80b11bbb80 1 -- start start 2023-07-14T15:56:30.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.386+0000 7f80b11bbb80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563e3b2a2f00 0x563e3b2a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:30.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.386+0000 7f80b11bbb80 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x563e3b2a32d0 0x563e3b2a7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:30.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.386+0000 7f80b11bbb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563e3b2a7ea0 0x563e3b2c20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:30.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.386+0000 7f80b11bbb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e3b181c60 con 0x563e3b2a7ea0 2023-07-14T15:56:30.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.386+0000 7f80b11bbb80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e3b1d49f0 con 0x563e3b2a2f00 2023-07-14T15:56:30.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.386+0000 7f80b11bbb80 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x563e3b1cde80 con 0x563e3b2a32d0 2023-07-14T15:56:30.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.386+0000 7f80977fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563e3b2a7ea0 0x563e3b2c20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:30.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.386+0000 7f80977fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563e3b2a7ea0 0x563e3b2c20d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51640/0 (socket says 172.21.15.37:51640) 2023-07-14T15:56:30.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.386+0000 7f80977fe700 1 -- 172.21.15.37:0/2101452375 learned_addr learned my addr 172.21.15.37:0/2101452375 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:30.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.386+0000 7f8096ffd700 1 --2- 172.21.15.37:0/2101452375 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563e3b2a2f00 0x563e3b2a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:30.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.386+0000 7f80967fc700 1 --2- 172.21.15.37:0/2101452375 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x563e3b2a32d0 0x563e3b2a7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:30.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.387+0000 7f8096ffd700 1 -- 172.21.15.37:0/2101452375 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x563e3b2a32d0 msgr2=0x563e3b2a7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:30.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.387+0000 7f8096ffd700 1 --2- 172.21.15.37:0/2101452375 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x563e3b2a32d0 0x563e3b2a7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:30.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.387+0000 7f8096ffd700 1 -- 172.21.15.37:0/2101452375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563e3b2a7ea0 msgr2=0x563e3b2c20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:30.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.387+0000 7f8096ffd700 1 --2- 172.21.15.37:0/2101452375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563e3b2a7ea0 0x563e3b2c20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:30.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.387+0000 7f8096ffd700 1 -- 172.21.15.37:0/2101452375 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563e3affbd90 con 0x563e3b2a2f00 2023-07-14T15:56:30.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.387+0000 7f80977fe700 1 --2- 172.21.15.37:0/2101452375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563e3b2a7ea0 0x563e3b2c20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:56:30.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.387+0000 7f8096ffd700 1 --2- 172.21.15.37:0/2101452375 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563e3b2a2f00 0x563e3b2a36f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8088001000 tx=0x7f80880573f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70e477620b23645f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:30.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.387+0000 7f807cff9700 1 -- 172.21.15.37:0/2101452375 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808805fb30 con 0x563e3b2a2f00 2023-07-14T15:56:30.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.387+0000 7f807cff9700 1 -- 172.21.15.37:0/2101452375 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8088055b80 con 0x563e3b2a2f00 2023-07-14T15:56:30.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.387+0000 7f807cff9700 1 -- 172.21.15.37:0/2101452375 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8088058dd0 con 0x563e3b2a2f00 2023-07-14T15:56:30.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.388+0000 7f80b11bbb80 1 -- 172.21.15.37:0/2101452375 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563e3b2a2f00 msgr2=0x563e3b2a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:30.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.388+0000 7f80b11bbb80 1 --2- 172.21.15.37:0/2101452375 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563e3b2a2f00 0x563e3b2a36f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8088001000 tx=0x7f80880573f0 comp rx=0 tx=0).stop 2023-07-14T15:56:30.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.388+0000 7f80b11bbb80 1 -- 172.21.15.37:0/2101452375 shutdown_connections 2023-07-14T15:56:30.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.388+0000 7f80b11bbb80 1 --2- 172.21.15.37:0/2101452375 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563e3b2a2f00 0x563e3b2a36f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:30.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.388+0000 7f80b11bbb80 1 --2- 172.21.15.37:0/2101452375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563e3b2a7ea0 0x563e3b2c20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:30.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.388+0000 7f80b11bbb80 1 --2- 172.21.15.37:0/2101452375 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x563e3b2a32d0 0x563e3b2a7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:30.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.388+0000 7f80b11bbb80 1 -- 172.21.15.37:0/2101452375 >> 172.21.15.37:0/2101452375 conn(0x563e3b271b90 msgr2=0x563e3b277130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:30.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.388+0000 7f80b11bbb80 1 -- 172.21.15.37:0/2101452375 shutdown_connections 2023-07-14T15:56:30.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.388+0000 7f80b11bbb80 1 -- 172.21.15.37:0/2101452375 wait complete. 2023-07-14T15:56:30.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.389+0000 7f80b11bbb80 1 -- start start 2023-07-14T15:56:30.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.389+0000 7f80b11bbb80 1 Processor -- start 2023-07-14T15:56:30.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.391+0000 7f80b11bbb80 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x563e3b2a2f00 0x563e3b2d52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:30.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.391+0000 7f80b11bbb80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563e3b2a32d0 0x563e3b29f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:30.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.391+0000 7f80b11bbb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563e3b2a7ea0 0x563e3b2a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:30.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.391+0000 7f80b11bbb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e3b16da70 con 0x563e3b2a7ea0 2023-07-14T15:56:30.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.391+0000 7f80b11bbb80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e3b16d770 con 0x563e3b2a32d0 2023-07-14T15:56:30.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.391+0000 7f80b11bbb80 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x563e3b0518d0 con 0x563e3b2a2f00 2023-07-14T15:56:30.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.391+0000 7f80b11bbb80 10 client.0 _ll_register_callbacks cb 0x563e3b16b710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T15:56:30.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.391+0000 7f80977fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563e3b2a7ea0 0x563e3b2a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:30.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.391+0000 7f80977fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563e3b2a7ea0 0x563e3b2a36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51646/0 (socket says 172.21.15.37:51646) 2023-07-14T15:56:30.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.391+0000 7f80977fe700 1 -- 172.21.15.37:0/763990629 learned_addr learned my addr 172.21.15.37:0/763990629 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:30.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.391+0000 7f80967fc700 1 --2- 172.21.15.37:0/763990629 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563e3b2a32d0 0x563e3b29f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:30.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.391+0000 7f8096ffd700 1 --2- 172.21.15.37:0/763990629 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x563e3b2a2f00 0x563e3b2d52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:30.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.392+0000 7f80977fe700 1 -- 172.21.15.37:0/763990629 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x563e3b2a2f00 msgr2=0x563e3b2d52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:30.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.392+0000 7f80977fe700 1 --2- 172.21.15.37:0/763990629 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x563e3b2a2f00 0x563e3b2d52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:30.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.392+0000 7f80977fe700 1 -- 172.21.15.37:0/763990629 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563e3b2a32d0 msgr2=0x563e3b29f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:30.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.392+0000 7f80977fe700 1 --2- 172.21.15.37:0/763990629 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563e3b2a32d0 0x563e3b29f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:30.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.392+0000 7f80977fe700 1 -- 172.21.15.37:0/763990629 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f809000f040 con 0x563e3b2a7ea0 2023-07-14T15:56:30.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.392+0000 7f80967fc700 1 --2- 172.21.15.37:0/763990629 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563e3b2a32d0 0x563e3b29f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:56:30.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.392+0000 7f80977fe700 1 --2- 172.21.15.37:0/763990629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563e3b2a7ea0 0x563e3b2a36a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8090011940 tx=0x7f8090011c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d008fbe0bb91c81 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:30.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.392+0000 7f8075ffb700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-07-14T15:56:30.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.392+0000 7f8075ffb700 1 -- 172.21.15.37:0/763990629 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809000f7a0 con 0x563e3b2a7ea0 2023-07-14T15:56:30.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.392+0000 7f8075ffb700 1 -- 172.21.15.37:0/763990629 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f809000f900 con 0x563e3b2a7ea0 2023-07-14T15:56:30.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.392+0000 7f80b11bbb80 1 -- 172.21.15.37:0/763990629 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563e3b26f1a0 con 0x563e3b2a7ea0 2023-07-14T15:56:30.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.392+0000 7f8075ffb700 1 -- 172.21.15.37:0/763990629 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f809000fac0 con 0x563e3b2a7ea0 2023-07-14T15:56:30.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.392+0000 7f80b11bbb80 10 client.4659 fetch_fsmap learned FSMap version 7 2023-07-14T15:56:30.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.392+0000 7f80b11bbb80 1 -- 172.21.15.37:0/763990629 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x7f809815df80 con 0x563e3b2a7ea0 2023-07-14T15:56:30.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.392+0000 7f8075ffb700 1 -- 172.21.15.37:0/763990629 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563e3b26f1a0 con 0x563e3b2a7ea0 2023-07-14T15:56:30.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.393+0000 7f8075ffb700 1 -- 172.21.15.37:0/763990629 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 7) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f809000fc20 con 0x563e3b2a7ea0 2023-07-14T15:56:30.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.393+0000 7f80b11bbb80 10 client.4659 fetch_fsmap finished waiting for FSMap version 7 2023-07-14T15:56:30.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.393+0000 7f80b11bbb80 10 client.4659 resolve_mds: resolved name 'd' to daemon mds.d 2023-07-14T15:56:30.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.393+0000 7f80b11bbb80 20 client.4659 populate_metadata read hostname 'smithi037' 2023-07-14T15:56:30.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.393+0000 7f80b11bbb80 1 --2- 172.21.15.37:0/763990629 >> [v2:172.21.15.98:6836/2731892479,v1:172.21.15.98:6837/2731892479] conn(0x563e3b2795f0 0x563e3b2799c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:30.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.393+0000 7f80b11bbb80 4 client.4659 mds_command: new command op to 4327 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T15:56:30.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.393+0000 7f80b11bbb80 1 -- 172.21.15.37:0/763990629 --> [v2:172.21.15.98:6836/2731892479,v1:172.21.15.98:6837/2731892479] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563e3b1c6e60 con 0x563e3b2795f0 2023-07-14T15:56:30.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.393+0000 7f8096ffd700 1 --2- 172.21.15.37:0/763990629 >> [v2:172.21.15.98:6836/2731892479,v1:172.21.15.98:6837/2731892479] conn(0x563e3b2795f0 0x563e3b2799c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:30.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.394+0000 7f8096ffd700 1 --2- 172.21.15.37:0/763990629 >> [v2:172.21.15.98:6836/2731892479,v1:172.21.15.98:6837/2731892479] conn(0x563e3b2795f0 0x563e3b2799c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e33be1465399ab74 server_cookie=a419ae359394717b in_seq=0 out_seq=0 2023-07-14T15:56:30.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.394+0000 7f8075ffb700 10 client.4659 ms_handle_connect on v2:172.21.15.98:6836/2731892479 2023-07-14T15:56:30.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.395+0000 7f8075ffb700 1 -- 172.21.15.37:0/763990629 <== mds.0 v2:172.21.15.98:6836/2731892479 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x563e3b1c6e60 con 0x563e3b2795f0 2023-07-14T15:56:30.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.395+0000 7f8075ffb700 10 client.4659 handle_command_reply: tid=0 2023-07-14T15:56:30.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.395+0000 7f80b11bbb80 1 client.4659 shutdown 2023-07-14T15:56:30.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.395+0000 7f80b11bbb80 1 -- 172.21.15.37:0/763990629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563e3b2a7ea0 msgr2=0x563e3b2a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:30.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.395+0000 7f80b11bbb80 1 --2- 172.21.15.37:0/763990629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563e3b2a7ea0 0x563e3b2a36a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8090011940 tx=0x7f8090011c50 comp rx=0 tx=0).stop 2023-07-14T15:56:30.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.395+0000 7f80b11bbb80 1 -- 172.21.15.37:0/763990629 shutdown_connections 2023-07-14T15:56:30.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.395+0000 7f80b11bbb80 1 --2- 172.21.15.37:0/763990629 >> [v2:172.21.15.98:6836/2731892479,v1:172.21.15.98:6837/2731892479] conn(0x563e3b2795f0 0x563e3b2799c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:30.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.395+0000 7f80b11bbb80 1 --2- 172.21.15.37:0/763990629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563e3b2a7ea0 0x563e3b2a36a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:30.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.395+0000 7f80b11bbb80 1 --2- 172.21.15.37:0/763990629 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x563e3b2a2f00 0x563e3b2d52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:30.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.395+0000 7f8075ffb700 0 client.4659 ms_handle_reset on v2:172.21.15.98:6836/2731892479 2023-07-14T15:56:30.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.395+0000 7f80b11bbb80 1 --2- 172.21.15.37:0/763990629 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563e3b2a32d0 0x563e3b29f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:30.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.395+0000 7f80b11bbb80 1 -- 172.21.15.37:0/763990629 >> 172.21.15.37:0/763990629 conn(0x563e3b271b90 msgr2=0x563e3b2a0430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:30.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.395+0000 7f80b11bbb80 1 -- 172.21.15.37:0/763990629 shutdown_connections 2023-07-14T15:56:30.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.396+0000 7f80b11bbb80 1 -- 172.21.15.37:0/763990629 wait complete. 2023-07-14T15:56:30.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.396+0000 7f80b11bbb80 20 client.4659 trim_cache size 0 max 16384 2023-07-14T15:56:30.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.414+0000 7f80b11bbb80 1 Processor -- start 2023-07-14T15:56:30.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.414+0000 7f80b11bbb80 1 -- start start 2023-07-14T15:56:30.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.415+0000 7f80b11bbb80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563e3b2a2f00 0x563e3b2a2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:30.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.415+0000 7f80b11bbb80 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x563e3b2a32d0 0x563e3b2a7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:30.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.415+0000 7f80b11bbb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563e3b2a7ea0 0x563e3b2c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:30.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.415+0000 7f80b11bbb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e3b2aab50 con 0x563e3b2a7ea0 2023-07-14T15:56:30.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.415+0000 7f80b11bbb80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e3b279ef0 con 0x563e3b2a2f00 2023-07-14T15:56:30.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.415+0000 7f80b11bbb80 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x563e3b27c950 con 0x563e3b2a32d0 2023-07-14T15:56:30.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.415+0000 7f80977fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563e3b2a7ea0 0x563e3b2c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:30.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.415+0000 7f80977fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563e3b2a7ea0 0x563e3b2c5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51656/0 (socket says 172.21.15.37:51656) 2023-07-14T15:56:30.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.415+0000 7f80977fe700 1 -- 172.21.15.37:0/3915888931 learned_addr learned my addr 172.21.15.37:0/3915888931 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:30.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.415+0000 7f80967fc700 1 --2- 172.21.15.37:0/3915888931 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x563e3b2a32d0 0x563e3b2a7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:30.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.415+0000 7f8096ffd700 1 --2- 172.21.15.37:0/3915888931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563e3b2a2f00 0x563e3b2a2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:30.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.416+0000 7f80977fe700 1 -- 172.21.15.37:0/3915888931 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x563e3b2a32d0 msgr2=0x563e3b2a7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:30.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.416+0000 7f80977fe700 1 --2- 172.21.15.37:0/3915888931 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x563e3b2a32d0 0x563e3b2a7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:30.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.416+0000 7f80977fe700 1 -- 172.21.15.37:0/3915888931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563e3b2a2f00 msgr2=0x563e3b2a2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:30.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.416+0000 7f80977fe700 1 --2- 172.21.15.37:0/3915888931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563e3b2a2f00 0x563e3b2a2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:30.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.416+0000 7f80977fe700 1 -- 172.21.15.37:0/3915888931 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563e3afe4c10 con 0x563e3b2a7ea0 2023-07-14T15:56:30.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.416+0000 7f80977fe700 1 --2- 172.21.15.37:0/3915888931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563e3b2a7ea0 0x563e3b2c5bb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8090011910 tx=0x7f809000c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2360d0f6c521d18 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:30.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.416+0000 7f807d7fa700 1 -- 172.21.15.37:0/3915888931 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809002b070 con 0x563e3b2a7ea0 2023-07-14T15:56:30.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.416+0000 7f807d7fa700 1 -- 172.21.15.37:0/3915888931 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809000f1d0 con 0x563e3b2a7ea0 2023-07-14T15:56:30.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.416+0000 7f807d7fa700 1 -- 172.21.15.37:0/3915888931 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809000f7a0 con 0x563e3b2a7ea0 2023-07-14T15:56:30.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.417+0000 7f80b11bbb80 1 -- 172.21.15.37:0/3915888931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563e3b2a7ea0 msgr2=0x563e3b2c5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:30.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.417+0000 7f80b11bbb80 1 --2- 172.21.15.37:0/3915888931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563e3b2a7ea0 0x563e3b2c5bb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8090011910 tx=0x7f809000c000 comp rx=0 tx=0).stop 2023-07-14T15:56:30.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.417+0000 7f80b11bbb80 1 -- 172.21.15.37:0/3915888931 shutdown_connections 2023-07-14T15:56:30.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.417+0000 7f80b11bbb80 1 --2- 172.21.15.37:0/3915888931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563e3b2a2f00 0x563e3b2a2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:30.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.417+0000 7f80b11bbb80 1 --2- 172.21.15.37:0/3915888931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563e3b2a7ea0 0x563e3b2c5bb0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:30.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.417+0000 7f80b11bbb80 1 --2- 172.21.15.37:0/3915888931 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x563e3b2a32d0 0x563e3b2a7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:30.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.417+0000 7f80b11bbb80 1 -- 172.21.15.37:0/3915888931 >> 172.21.15.37:0/3915888931 conn(0x563e3b271b90 msgr2=0x563e3b2a6850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:30.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.417+0000 7f80b11bbb80 1 -- 172.21.15.37:0/3915888931 shutdown_connections 2023-07-14T15:56:30.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.417+0000 7f80b11bbb80 1 -- 172.21.15.37:0/3915888931 wait complete. 2023-07-14T15:56:30.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.417+0000 7f80b11bbb80 1 -- start start 2023-07-14T15:56:30.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.418+0000 7f80b11bbb80 1 Processor -- start 2023-07-14T15:56:30.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.419+0000 7f80b11bbb80 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x563e3b2a2f00 0x563e3b2a6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:30.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.419+0000 7f80b11bbb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563e3b2a32d0 0x563e3b2a6b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:30.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.419+0000 7f80b11bbb80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563e3b2a7ea0 0x563e3b2a8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:30.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.419+0000 7f80b11bbb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e3b27c2e0 con 0x563e3b2a32d0 2023-07-14T15:56:30.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.419+0000 7f80b11bbb80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e3b2a1400 con 0x563e3b2a7ea0 2023-07-14T15:56:30.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.419+0000 7f80b11bbb80 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x563e3b2c2280 con 0x563e3b2a2f00 2023-07-14T15:56:30.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.419+0000 7f80b11bbb80 10 client.0 _ll_register_callbacks cb 0x7f80900115a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T15:56:30.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.419+0000 7f80967fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563e3b2a32d0 0x563e3b2a6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:30.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.419+0000 7f80967fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563e3b2a32d0 0x563e3b2a6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51666/0 (socket says 172.21.15.37:51666) 2023-07-14T15:56:30.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.419+0000 7f80967fc700 1 -- 172.21.15.37:0/641097070 learned_addr learned my addr 172.21.15.37:0/641097070 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:30.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.419+0000 7f8096ffd700 1 --2- 172.21.15.37:0/641097070 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x563e3b2a2f00 0x563e3b2a6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:30.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.419+0000 7f80977fe700 1 --2- 172.21.15.37:0/641097070 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563e3b2a7ea0 0x563e3b2a8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:30.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.419+0000 7f80967fc700 1 -- 172.21.15.37:0/641097070 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x563e3b2a2f00 msgr2=0x563e3b2a6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:30.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.419+0000 7f80967fc700 1 --2- 172.21.15.37:0/641097070 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x563e3b2a2f00 0x563e3b2a6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:30.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.419+0000 7f80967fc700 1 -- 172.21.15.37:0/641097070 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563e3b2a7ea0 msgr2=0x563e3b2a8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:30.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.419+0000 7f80967fc700 1 --2- 172.21.15.37:0/641097070 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563e3b2a7ea0 0x563e3b2a8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:30.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.419+0000 7f80967fc700 1 -- 172.21.15.37:0/641097070 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f809815df80 con 0x563e3b2a32d0 2023-07-14T15:56:30.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.420+0000 7f80967fc700 1 --2- 172.21.15.37:0/641097070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563e3b2a32d0 0x563e3b2a6b50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f808c009b90 tx=0x7f808c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce5a803d75cbee6f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:30.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.420+0000 7f8075ffb700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-07-14T15:56:30.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.420+0000 7f8075ffb700 1 -- 172.21.15.37:0/641097070 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c02b040 con 0x563e3b2a32d0 2023-07-14T15:56:30.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.420+0000 7f80b11bbb80 1 -- 172.21.15.37:0/641097070 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563e3b189000 con 0x563e3b2a32d0 2023-07-14T15:56:30.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.420+0000 7f8075ffb700 1 -- 172.21.15.37:0/641097070 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f808c030470 con 0x563e3b2a32d0 2023-07-14T15:56:30.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.420+0000 7f8075ffb700 1 -- 172.21.15.37:0/641097070 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f808c030630 con 0x563e3b2a32d0 2023-07-14T15:56:30.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.420+0000 7f80b11bbb80 10 client.4665 fetch_fsmap learned FSMap version 7 2023-07-14T15:56:30.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.420+0000 7f80b11bbb80 1 -- 172.21.15.37:0/641097070 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x563e3b022200 con 0x563e3b2a32d0 2023-07-14T15:56:30.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.420+0000 7f8075ffb700 1 -- 172.21.15.37:0/641097070 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563e3b189000 con 0x563e3b2a32d0 2023-07-14T15:56:30.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.420+0000 7f8075ffb700 1 -- 172.21.15.37:0/641097070 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 7) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f808c02e050 con 0x563e3b2a32d0 2023-07-14T15:56:30.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.420+0000 7f80b11bbb80 10 client.4665 fetch_fsmap finished waiting for FSMap version 7 2023-07-14T15:56:30.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.420+0000 7f80b11bbb80 10 client.4665 resolve_mds: resolved name 'd' to daemon mds.d 2023-07-14T15:56:30.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.420+0000 7f80b11bbb80 20 client.4665 populate_metadata read hostname 'smithi037' 2023-07-14T15:56:30.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.421+0000 7f80b11bbb80 1 --2- 172.21.15.37:0/641097070 >> [v2:172.21.15.98:6836/2731892479,v1:172.21.15.98:6837/2731892479] conn(0x563e3b2a9220 0x563e3b32b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:30.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.421+0000 7f80b11bbb80 4 client.4665 mds_command: new command op to 4327 tid=0[{"prefix": "status"}] 2023-07-14T15:56:30.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.421+0000 7f80b11bbb80 1 -- 172.21.15.37:0/641097070 --> [v2:172.21.15.98:6836/2731892479,v1:172.21.15.98:6837/2731892479] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563e3b01cf20 con 0x563e3b2a9220 2023-07-14T15:56:30.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.421+0000 7f8096ffd700 1 --2- 172.21.15.37:0/641097070 >> [v2:172.21.15.98:6836/2731892479,v1:172.21.15.98:6837/2731892479] conn(0x563e3b2a9220 0x563e3b32b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:30.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.421+0000 7f8075ffb700 10 client.4665 ms_handle_connect on v2:172.21.15.98:6836/2731892479 2023-07-14T15:56:30.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.421+0000 7f8096ffd700 1 --2- 172.21.15.37:0/641097070 >> [v2:172.21.15.98:6836/2731892479,v1:172.21.15.98:6837/2731892479] conn(0x563e3b2a9220 0x563e3b32b8e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=402892764eae0084 server_cookie=b1ec8db3fae6d5ba in_seq=0 out_seq=0 2023-07-14T15:56:30.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.422+0000 7f8075ffb700 1 -- 172.21.15.37:0/641097070 <== mds.0 v2:172.21.15.98:6836/2731892479 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x563e3b01cf20 con 0x563e3b2a9220 2023-07-14T15:56:30.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.422+0000 7f8075ffb700 10 client.4665 handle_command_reply: tid=0 2023-07-14T15:56:30.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.422+0000 7f80b11bbb80 1 client.4665 shutdown 2023-07-14T15:56:30.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.422+0000 7f80b11bbb80 1 -- 172.21.15.37:0/641097070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563e3b2a32d0 msgr2=0x563e3b2a6b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:30.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.422+0000 7f80b11bbb80 1 --2- 172.21.15.37:0/641097070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563e3b2a32d0 0x563e3b2a6b50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f808c009b90 tx=0x7f808c0047c0 comp rx=0 tx=0).stop 2023-07-14T15:56:30.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.422+0000 7f80b11bbb80 1 -- 172.21.15.37:0/641097070 shutdown_connections 2023-07-14T15:56:30.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.422+0000 7f80b11bbb80 1 --2- 172.21.15.37:0/641097070 >> [v2:172.21.15.98:6836/2731892479,v1:172.21.15.98:6837/2731892479] conn(0x563e3b2a9220 0x563e3b32b8e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:30.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.422+0000 7f80b11bbb80 1 --2- 172.21.15.37:0/641097070 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563e3b2a7ea0 0x563e3b2a8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:30.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.422+0000 7f80b11bbb80 1 --2- 172.21.15.37:0/641097070 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x563e3b2a2f00 0x563e3b2a6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:30.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.422+0000 7f8075ffb700 0 client.4665 ms_handle_reset on v2:172.21.15.98:6836/2731892479 2023-07-14T15:56:30.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.422+0000 7f80b11bbb80 1 --2- 172.21.15.37:0/641097070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563e3b2a32d0 0x563e3b2a6b50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:30.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.422+0000 7f80b11bbb80 1 -- 172.21.15.37:0/641097070 >> 172.21.15.37:0/641097070 conn(0x563e3b271b90 msgr2=0x563e3b2c5bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:30.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.422+0000 7f80b11bbb80 1 -- 172.21.15.37:0/641097070 shutdown_connections 2023-07-14T15:56:30.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.422+0000 7f80b11bbb80 1 -- 172.21.15.37:0/641097070 wait complete. 2023-07-14T15:56:30.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.422+0000 7f80b11bbb80 20 client.4665 trim_cache size 0 max 16384 2023-07-14T15:56:30.418 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-14T15:56:30.419 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "9da30401-a779-4e46-aba6-00c2494c6c67", 2023-07-14T15:56:30.419 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2023-07-14T15:56:30.419 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 4327, 2023-07-14T15:56:30.419 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2023-07-14T15:56:30.419 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2023-07-14T15:56:30.419 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2023-07-14T15:56:30.419 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 21.457049502, 2023-07-14T15:56:30.420 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 7, 2023-07-14T15:56:30.420 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 25, 2023-07-14T15:56:30.420 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 25, 2023-07-14T15:56:30.420 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 28.304733753000001 2023-07-14T15:56:30.420 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-14T15:56:30.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.423+0000 7f809d7ff700 1 -- 172.21.15.37:0/1286802638 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f808406ace0 msgr2=0x7f808406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:30.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.423+0000 7f809d7ff700 1 --2- 172.21.15.37:0/1286802638 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f808406ace0 0x7f808406d190 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f80980d19b0 tx=0x7f808c01c040 comp rx=0 tx=0).stop 2023-07-14T15:56:30.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.423+0000 7f809d7ff700 1 -- 172.21.15.37:0/1286802638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80980b0ae0 msgr2=0x7f80980cd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:30.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.423+0000 7f809d7ff700 1 --2- 172.21.15.37:0/1286802638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80980b0ae0 0x7f80980cd110 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8088001f00 tx=0x7f808800c8b0 comp rx=0 tx=0).stop 2023-07-14T15:56:30.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.423+0000 7f809d7ff700 1 -- 172.21.15.37:0/1286802638 shutdown_connections 2023-07-14T15:56:30.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.423+0000 7f809d7ff700 1 --2- 172.21.15.37:0/1286802638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f80980d15c0 0x7f80981e63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:30.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.423+0000 7f809d7ff700 1 --2- 172.21.15.37:0/1286802638 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f808406ace0 0x7f808406d190 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:30.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.423+0000 7f809d7ff700 1 --2- 172.21.15.37:0/1286802638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80980b0ae0 0x7f80980cd110 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:30.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.423+0000 7f809d7ff700 1 --2- 172.21.15.37:0/1286802638 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f80980b8900 0x7f80980b3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:30.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.423+0000 7f809d7ff700 1 -- 172.21.15.37:0/1286802638 >> 172.21.15.37:0/1286802638 conn(0x7f809809c1e0 msgr2=0x7f80980b7ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:30.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.423+0000 7f809d7ff700 1 -- 172.21.15.37:0/1286802638 shutdown_connections 2023-07-14T15:56:30.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:30.423+0000 7f809d7ff700 1 -- 172.21.15.37:0/1286802638 wait complete. 2023-07-14T15:56:30.427 INFO:teuthology.run_tasks:Running task kclient... 2023-07-14T15:56:30.449 INFO:tasks.kclient:Mounting kernel clients... 2023-07-14T15:56:30.449 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-07-14T15:56:30.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:30.450 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-07-14T15:56:30.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:30.495 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link delete ceph-brx 2023-07-14T15:56:30.607 INFO:teuthology.orchestra.run.smithi037.stderr:Cannot find device "ceph-brx" 2023-07-14T15:56:30.610 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T15:56:30.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:30.611 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-07-14T15:56:30.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:30.654 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link delete ceph-brx 2023-07-14T15:56:30.767 INFO:teuthology.orchestra.run.smithi037.stderr:Cannot find device "ceph-brx" 2023-07-14T15:56:30.769 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T15:56:30.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:30.770 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2023-07-14T15:56:30.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:30.819 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link delete ceph-brx 2023-07-14T15:56:30.894 INFO:teuthology.orchestra.run.smithi098.stderr:Cannot find device "ceph-brx" 2023-07-14T15:56:30.898 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T15:56:30.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:30.899 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2023-07-14T15:56:30.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:30.944 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link delete ceph-brx 2023-07-14T15:56:31.054 INFO:teuthology.orchestra.run.smithi098.stderr:Cannot find device "ceph-brx" 2023-07-14T15:56:31.056 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T15:56:31.057 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-07-14T15:56:31.057 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-14T15:56:31.057 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-14T15:56:31.058 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-14T15:56:31.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.273+0000 7fc706dff700 1 Processor -- start 2023-07-14T15:56:31.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.274+0000 7fc706dff700 1 -- start start 2023-07-14T15:56:31.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.275+0000 7fc706dff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fc7000b85f0 0x7fc70015d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:31.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.275+0000 7fc706dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc7000b54b0 0x7fc7000cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:31.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.275+0000 7fc706dff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc7000b4910 0x7fc7000b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:31.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.275+0000 7fc706dff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7000b52d0 con 0x7fc7000b4910 2023-07-14T15:56:31.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.275+0000 7fc706dff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7000cf6b0 con 0x7fc7000b85f0 2023-07-14T15:56:31.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.275+0000 7fc706dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7000cdc40 con 0x7fc7000b54b0 2023-07-14T15:56:31.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.275+0000 7fc70539c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc7000b4910 0x7fc7000b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:31.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.275+0000 7fc70539c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc7000b4910 0x7fc7000b4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51668/0 (socket says 172.21.15.37:51668) 2023-07-14T15:56:31.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.275+0000 7fc70539c700 1 -- 172.21.15.37:0/1501836705 learned_addr learned my addr 172.21.15.37:0/1501836705 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:31.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.275+0000 7fc6fffff700 1 --2- 172.21.15.37:0/1501836705 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc7000b54b0 0x7fc7000cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:31.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.275+0000 7fc704b9b700 1 --2- 172.21.15.37:0/1501836705 >> v2:172.21.15.98:3300/0 conn(0x7fc7000b85f0 0x7fc70015d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:31.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.275+0000 7fc70539c700 1 -- 172.21.15.37:0/1501836705 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc7000b54b0 msgr2=0x7fc7000cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:31.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.275+0000 7fc70539c700 1 --2- 172.21.15.37:0/1501836705 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc7000b54b0 0x7fc7000cfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:31.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.275+0000 7fc70539c700 1 -- 172.21.15.37:0/1501836705 >> v2:172.21.15.98:3300/0 conn(0x7fc7000b85f0 msgr2=0x7fc70015d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:31.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.275+0000 7fc70539c700 1 --2- 172.21.15.37:0/1501836705 >> v2:172.21.15.98:3300/0 conn(0x7fc7000b85f0 0x7fc70015d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:31.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.275+0000 7fc70539c700 1 -- 172.21.15.37:0/1501836705 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc70015dba0 con 0x7fc7000b4910 2023-07-14T15:56:31.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.276+0000 7fc704b9b700 1 --2- 172.21.15.37:0/1501836705 >> v2:172.21.15.98:3300/0 conn(0x7fc7000b85f0 0x7fc70015d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:56:31.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.276+0000 7fc6fffff700 1 --2- 172.21.15.37:0/1501836705 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc7000b54b0 0x7fc7000cfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:56:31.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.276+0000 7fc70539c700 1 --2- 172.21.15.37:0/1501836705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7000b4910 0x7fc7000b4d90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc70006a110 tx=0x7fc6f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=676604fa980b5237 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:31.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.276+0000 7fc6ff7fe700 1 -- 172.21.15.37:0/1501836705 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f800e070 con 0x7fc7000b4910 2023-07-14T15:56:31.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.276+0000 7fc6ff7fe700 1 -- 172.21.15.37:0/1501836705 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f800b9c0 con 0x7fc7000b4910 2023-07-14T15:56:31.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.276+0000 7fc6ff7fe700 1 -- 172.21.15.37:0/1501836705 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f800bd70 con 0x7fc7000b4910 2023-07-14T15:56:31.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.276+0000 7fc706dff700 1 -- 172.21.15.37:0/1501836705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7000b4910 msgr2=0x7fc7000b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:31.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.276+0000 7fc706dff700 1 --2- 172.21.15.37:0/1501836705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7000b4910 0x7fc7000b4d90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc70006a110 tx=0x7fc6f800b330 comp rx=0 tx=0).stop 2023-07-14T15:56:31.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.277+0000 7fc706dff700 1 -- 172.21.15.37:0/1501836705 shutdown_connections 2023-07-14T15:56:31.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.277+0000 7fc706dff700 1 --2- 172.21.15.37:0/1501836705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7000b4910 0x7fc7000b4d90 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:31.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.277+0000 7fc706dff700 1 --2- 172.21.15.37:0/1501836705 >> v2:172.21.15.98:3300/0 conn(0x7fc7000b85f0 0x7fc70015d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:31.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.277+0000 7fc706dff700 1 --2- 172.21.15.37:0/1501836705 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc7000b54b0 0x7fc7000cfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:31.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.277+0000 7fc706dff700 1 -- 172.21.15.37:0/1501836705 >> 172.21.15.37:0/1501836705 conn(0x7fc70006a580 msgr2=0x7fc70006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:31.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.277+0000 7fc706dff700 1 -- 172.21.15.37:0/1501836705 shutdown_connections 2023-07-14T15:56:31.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.277+0000 7fc706dff700 1 -- 172.21.15.37:0/1501836705 wait complete. 2023-07-14T15:56:31.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.278+0000 7fc706dff700 1 Processor -- start 2023-07-14T15:56:31.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.279+0000 7fc706dff700 1 -- start start 2023-07-14T15:56:31.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.280+0000 7fc706dff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7000b4910 0x7fc7000ca170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:31.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.280+0000 7fc706dff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7000b54b0 0x7fc7000cc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:31.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.280+0000 7fc706dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc7000b85f0 0x7fc700149270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:31.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.280+0000 7fc706dff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7000c9250 con 0x7fc7000b54b0 2023-07-14T15:56:31.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.280+0000 7fc706dff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7001497b0 con 0x7fc7000b4910 2023-07-14T15:56:31.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.280+0000 7fc706dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7000c6a20 con 0x7fc7000b85f0 2023-07-14T15:56:31.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.280+0000 7fc6fffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7000b54b0 0x7fc7000cc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:31.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.280+0000 7fc6fffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7000b54b0 0x7fc7000cc9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51672/0 (socket says 172.21.15.37:51672) 2023-07-14T15:56:31.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.280+0000 7fc6fffff700 1 -- 172.21.15.37:0/164529061 learned_addr learned my addr 172.21.15.37:0/164529061 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:31.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.280+0000 7fc704b9b700 1 --2- 172.21.15.37:0/164529061 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7000b4910 0x7fc7000ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:31.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.280+0000 7fc70539c700 1 --2- 172.21.15.37:0/164529061 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc7000b85f0 0x7fc700149270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:31.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.280+0000 7fc6fffff700 1 -- 172.21.15.37:0/164529061 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc7000b85f0 msgr2=0x7fc700149270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:31.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.280+0000 7fc6fffff700 1 --2- 172.21.15.37:0/164529061 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc7000b85f0 0x7fc700149270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:31.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.280+0000 7fc6fffff700 1 -- 172.21.15.37:0/164529061 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7000b4910 msgr2=0x7fc7000ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:31.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.280+0000 7fc6fffff700 1 --2- 172.21.15.37:0/164529061 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7000b4910 0x7fc7000ca170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:31.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.280+0000 7fc6fffff700 1 -- 172.21.15.37:0/164529061 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f8009b30 con 0x7fc7000b54b0 2023-07-14T15:56:31.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.280+0000 7fc6fffff700 1 --2- 172.21.15.37:0/164529061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7000b54b0 0x7fc7000cc9b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec00d800 tx=0x7fc6ec00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:31.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.281+0000 7fc6fd7fa700 1 -- 172.21.15.37:0/164529061 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec004030 con 0x7fc7000b54b0 2023-07-14T15:56:31.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.281+0000 7fc6fd7fa700 1 -- 172.21.15.37:0/164529061 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6ec004190 con 0x7fc7000b54b0 2023-07-14T15:56:31.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.281+0000 7fc706dff700 1 -- 172.21.15.37:0/164529061 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7000c6d00 con 0x7fc7000b54b0 2023-07-14T15:56:31.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.281+0000 7fc6fd7fa700 1 -- 172.21.15.37:0/164529061 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec004520 con 0x7fc7000b54b0 2023-07-14T15:56:31.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.281+0000 7fc706dff700 1 -- 172.21.15.37:0/164529061 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7000ca750 con 0x7fc7000b54b0 2023-07-14T15:56:31.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.282+0000 7fc706dff700 1 -- 172.21.15.37:0/164529061 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7000c9580 con 0x7fc7000b54b0 2023-07-14T15:56:31.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.283+0000 7fc6fd7fa700 1 -- 172.21.15.37:0/164529061 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc6ec0036a0 con 0x7fc7000b54b0 2023-07-14T15:56:31.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.284+0000 7fc6fd7fa700 1 --2- 172.21.15.37:0/164529061 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc6e406ace0 0x7fc6e406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:31.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.284+0000 7fc6fd7fa700 1 -- 172.21.15.37:0/164529061 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc6ec089a80 con 0x7fc7000b54b0 2023-07-14T15:56:31.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.284+0000 7fc704b9b700 1 --2- 172.21.15.37:0/164529061 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc6e406ace0 0x7fc6e406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:31.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.285+0000 7fc704b9b700 1 --2- 172.21.15.37:0/164529061 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc6e406ace0 0x7fc6e406d190 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc70015f250 tx=0x7fc6f4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:31.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.288+0000 7fc6fd7fa700 1 -- 172.21.15.37:0/164529061 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc6ec0585b0 con 0x7fc7000b54b0 2023-07-14T15:56:31.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.543+0000 7fc706dff700 1 -- 172.21.15.37:0/164529061 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc700067840 con 0x7fc7000b54b0 2023-07-14T15:56:31.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.543+0000 7fc6fd7fa700 1 -- 172.21.15.37:0/164529061 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc6ec058140 con 0x7fc7000b54b0 2023-07-14T15:56:31.530 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-14T15:56:31.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.545+0000 7fc706dff700 1 -- 172.21.15.37:0/164529061 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc6e406ace0 msgr2=0x7fc6e406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:31.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.545+0000 7fc706dff700 1 --2- 172.21.15.37:0/164529061 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc6e406ace0 0x7fc6e406d190 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc70015f250 tx=0x7fc6f4008040 comp rx=0 tx=0).stop 2023-07-14T15:56:31.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.545+0000 7fc706dff700 1 -- 172.21.15.37:0/164529061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7000b54b0 msgr2=0x7fc7000cc9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:31.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.545+0000 7fc706dff700 1 --2- 172.21.15.37:0/164529061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7000b54b0 0x7fc7000cc9b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec00d800 tx=0x7fc6ec00dbc0 comp rx=0 tx=0).stop 2023-07-14T15:56:31.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.546+0000 7fc706dff700 1 -- 172.21.15.37:0/164529061 shutdown_connections 2023-07-14T15:56:31.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.546+0000 7fc706dff700 1 --2- 172.21.15.37:0/164529061 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7000b4910 0x7fc7000ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:31.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.546+0000 7fc706dff700 1 --2- 172.21.15.37:0/164529061 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc6e406ace0 0x7fc6e406d190 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:31.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.546+0000 7fc706dff700 1 --2- 172.21.15.37:0/164529061 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc7000b85f0 0x7fc700149270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:31.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.546+0000 7fc706dff700 1 --2- 172.21.15.37:0/164529061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7000b54b0 0x7fc7000cc9b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:31.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.546+0000 7fc706dff700 1 -- 172.21.15.37:0/164529061 >> 172.21.15.37:0/164529061 conn(0x7fc70006a580 msgr2=0x7fc7000d0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:31.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.546+0000 7fc706dff700 1 -- 172.21.15.37:0/164529061 shutdown_connections 2023-07-14T15:56:31.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:31.546+0000 7fc706dff700 1 -- 172.21.15.37:0/164529061 wait complete. 2023-07-14T15:56:31.550 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-14T15:56:31.550 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-14T15:56:31.551 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2023-07-14T15:56:31.551 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-14T15:56:31.551 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-14T15:56:31.551 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-14T15:56:31.551 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-14T15:56:31.552 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-14T15:56:31.552 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-14T15:56:31.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:31.552 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2023-07-14T15:56:31.596 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T15:56:31.596 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T15:56:31.596 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T15:56:31.597 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:56:31.597 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-07-14T15:56:31.597 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:56:31.597 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T15:56:31.597 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2023-07-14T15:56:31.597 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2023-07-14T15:56:31.597 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T15:56:31.598 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2023-07-14T15:56:31.598 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2023-07-14T15:56:31.598 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-14T15:56:31.598 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2023-07-14T15:56:31.598 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2023-07-14T15:56:31.598 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-07-14T15:56:31.598 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42046sec preferred_lft 42046sec 2023-07-14T15:56:31.599 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2023-07-14T15:56:31.599 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:56:31.599 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T15:56:31.599 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2023-07-14T15:56:31.599 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2023-07-14T15:56:31.600 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-14T15:56:31.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:31.600 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-07-14T15:56:31.601 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-07-14T15:56:31.601 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add name ceph-brx type bridge 2023-07-14T15:56:31.601 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr flush dev ceph-brx 2023-07-14T15:56:31.601 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set ceph-brx up 2023-07-14T15:56:31.602 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-14T15:56:31.602 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-07-14T15:56:32.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:32.231 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-14T15:56:32.305 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-07-14T15:56:32.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:32.309 DEBUG:teuthology.orchestra.run.smithi037:> route 2023-07-14T15:56:32.368 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2023-07-14T15:56:32.368 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-14T15:56:32.368 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-07-14T15:56:32.369 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-07-14T15:56:32.369 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-14T15:56:32.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:32.370 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-07-14T15:56:32.370 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-07-14T15:56:32.370 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-14T15:56:32.371 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-14T15:56:32.371 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-14T15:56:32.371 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-07-14T15:56:33.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:33.225 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-07-14T15:56:33.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:33.269 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list-id 2023-07-14T15:56:33.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:33.354 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-07-14T15:56:33.354 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-07-14T15:56:33.354 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-14T15:56:33.354 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-07-14T15:56:33.355 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-07-14T15:56:33.539 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-07-14T15:56:33.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:33.540 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-07-14T15:56:33.540 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-07-14T15:56:33.540 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-07-14T15:56:33.541 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-14T15:56:33.541 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-07-14T15:56:33.541 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-07-14T15:56:33.541 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-07-14T15:56:33.542 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-07-14T15:56:33.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:33.938 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-07-14T15:56:33.938 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-07-14T15:56:33.938 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2023-07-14T15:56:33.938 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set dev brx.0 master ceph-brx 2023-07-14T15:56:33.938 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-07-14T15:56:34.114 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T15:56:34.115 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-14T15:56:34.158 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-14T15:56:34.159 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T15:56:34.159 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-14T15:56:34.240 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-07-14T15:56:34.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:34.241 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T15:56:34.405 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T15:56:34.405 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-14T15:56:34.855 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T15:56:34.855 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-14T15:56:34.856 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.98:3300,172.21.15.98:3301" 2023-07-14T15:56:34.856 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with new device syntax: 0@9da30401-a779-4e46-aba6-00c2494c6c67.cephfs=/ 2023-07-14T15:56:34.856 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.37:3300/172.21.15.98:3300/172.21.15.98:3301" will pass to kernel 2023-07-14T15:56:34.861 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-14T15:56:34.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:34.862 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-14T15:56:34.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:34.932 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T15:56:35.055 INFO:teuthology.orchestra.run.smithi037.stdout:client4681 2023-07-14T15:56:35.055 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-14T15:56:35.056 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T15:56:35.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:35.099 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T15:56:35.247 INFO:teuthology.orchestra.run.smithi037.stdout:client4681 2023-07-14T15:56:35.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:35.248 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T15:56:35.357 INFO:teuthology.orchestra.run.smithi037.stdout:client4681 2023-07-14T15:56:35.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:35.358 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/9da30401-a779-4e46-aba6-00c2494c6c67.client4681/status') 2023-07-14T15:56:35.485 INFO:teuthology.orchestra.run.smithi037.stdout:instance: client.4681 (3)172.21.15.37:0/2983654132 2023-07-14T15:56:35.486 INFO:teuthology.orchestra.run.smithi037.stdout:blocklisted: false 2023-07-14T15:56:35.486 INFO:teuthology.orchestra.run.smithi037.stderr:0+1 records in 2023-07-14T15:56:35.486 INFO:teuthology.orchestra.run.smithi037.stderr:0+1 records out 2023-07-14T15:56:35.486 INFO:teuthology.orchestra.run.smithi037.stderr:70 bytes copied, 7.0584e-05 s, 992 kB/s 2023-07-14T15:56:35.488 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-07-14T15:56:35.489 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-14T15:56:35.489 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-07-14T15:56:35.489 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-14T15:56:35.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.707+0000 7fd0c81ff700 1 Processor -- start 2023-07-14T15:56:35.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.707+0000 7fd0c81ff700 1 -- start start 2023-07-14T15:56:35.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.708+0000 7fd0c81ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd0c00c9b30 0x7fd0c00ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:35.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.708+0000 7fd0c81ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd0c0159790 0x7fd0c00af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:35.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.708+0000 7fd0c81ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0c00c9540 con 0x7fd0c01593c0 2023-07-14T15:56:35.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.708+0000 7fd0c81ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0c00c9ff0 con 0x7fd0c00c9b30 2023-07-14T15:56:35.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.708+0000 7fd0c81ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0c00ce3d0 con 0x7fd0c0159790 2023-07-14T15:56:35.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.708+0000 7fd0c579a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd0c00c9b30 0x7fd0c00ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:35.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.708+0000 7fd0c5f9b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd0c01593c0 0x7fd0c015db60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:59990/0 (socket says 172.21.15.37:59990) 2023-07-14T15:56:35.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.708+0000 7fd0c5f9b700 1 -- 172.21.15.37:0/4039304448 learned_addr learned my addr 172.21.15.37:0/4039304448 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:35.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.709+0000 7fd0c679c700 1 --2- 172.21.15.37:0/4039304448 >> v2:172.21.15.98:3300/0 conn(0x7fd0c0159790 0x7fd0c00af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:35.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.709+0000 7fd0c579a700 1 -- 172.21.15.37:0/4039304448 >> v2:172.21.15.98:3300/0 conn(0x7fd0c0159790 msgr2=0x7fd0c00af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:35.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.709+0000 7fd0c579a700 1 --2- 172.21.15.37:0/4039304448 >> v2:172.21.15.98:3300/0 conn(0x7fd0c0159790 0x7fd0c00af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:35.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.709+0000 7fd0c579a700 1 -- 172.21.15.37:0/4039304448 >> v1:172.21.15.37:6789/0 conn(0x7fd0c01593c0 legacy=0x7fd0c015db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:35.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.709+0000 7fd0c579a700 1 -- 172.21.15.37:0/4039304448 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c00ce6b0 con 0x7fd0c00c9b30 2023-07-14T15:56:35.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.709+0000 7fd0c4f99700 1 -- 172.21.15.37:0/4039304448 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2416509464 0 0) 0x7fd0c00c9540 con 0x7fd0c01593c0 2023-07-14T15:56:35.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.709+0000 7fd0c579a700 1 --2- 172.21.15.37:0/4039304448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0c00c9b30 0x7fd0c00ccce0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0071310 tx=0x7fd0b0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fd7a10e0bbf5c02 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:35.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.709+0000 7fd0c4f99700 1 -- 172.21.15.37:0/4039304448 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b0011830 con 0x7fd0c00c9b30 2023-07-14T15:56:35.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.709+0000 7fd0c4f99700 1 -- 172.21.15.37:0/4039304448 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b0011990 con 0x7fd0c00c9b30 2023-07-14T15:56:35.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.710+0000 7fd0c4f99700 1 -- 172.21.15.37:0/4039304448 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b0011d20 con 0x7fd0c00c9b30 2023-07-14T15:56:35.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.710+0000 7fd0c81ff700 1 -- 172.21.15.37:0/4039304448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0c00c9b30 msgr2=0x7fd0c00ccce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:35.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.710+0000 7fd0c81ff700 1 --2- 172.21.15.37:0/4039304448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0c00c9b30 0x7fd0c00ccce0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0071310 tx=0x7fd0b0009b20 comp rx=0 tx=0).stop 2023-07-14T15:56:35.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.710+0000 7fd0c81ff700 1 -- 172.21.15.37:0/4039304448 shutdown_connections 2023-07-14T15:56:35.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.710+0000 7fd0c81ff700 1 --2- 172.21.15.37:0/4039304448 >> v2:172.21.15.98:3300/0 conn(0x7fd0c0159790 0x7fd0c00af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:35.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.710+0000 7fd0c81ff700 1 --2- 172.21.15.37:0/4039304448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0c00c9b30 0x7fd0c00ccce0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:35.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.710+0000 7fd0c81ff700 1 -- 172.21.15.37:0/4039304448 >> 172.21.15.37:0/4039304448 conn(0x7fd0c00b08c0 msgr2=0x7fd0c00b0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:35.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.710+0000 7fd0c81ff700 1 -- 172.21.15.37:0/4039304448 shutdown_connections 2023-07-14T15:56:35.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.710+0000 7fd0c81ff700 1 -- 172.21.15.37:0/4039304448 wait complete. 2023-07-14T15:56:35.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.712+0000 7fd0c81ff700 1 Processor -- start 2023-07-14T15:56:35.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.712+0000 7fd0c81ff700 1 -- start start 2023-07-14T15:56:35.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.713+0000 7fd0c81ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0c00c9b30 0x7fd0c01569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:35.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.713+0000 7fd0c81ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd0c01593c0 0x7fd0c014c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:35.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.713+0000 7fd0c81ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0c0159790 0x7fd0c01f59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:35.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.713+0000 7fd0c81ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c00b4c80 con 0x7fd0c0159790 2023-07-14T15:56:35.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.713+0000 7fd0c81ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c014c900 con 0x7fd0c00c9b30 2023-07-14T15:56:35.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.713+0000 7fd0c81ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c0157050 con 0x7fd0c01593c0 2023-07-14T15:56:35.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.713+0000 7fd0c679c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0c0159790 0x7fd0c01f59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:35.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.713+0000 7fd0c679c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0c0159790 0x7fd0c01f59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51688/0 (socket says 172.21.15.37:51688) 2023-07-14T15:56:35.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.713+0000 7fd0c679c700 1 -- 172.21.15.37:0/1686173415 learned_addr learned my addr 172.21.15.37:0/1686173415 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:35.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.714+0000 7fd0c5f9b700 1 --2- 172.21.15.37:0/1686173415 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0c00c9b30 0x7fd0c01569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:35.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.714+0000 7fd0c579a700 1 --2- 172.21.15.37:0/1686173415 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd0c01593c0 0x7fd0c014c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:35.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.714+0000 7fd0c679c700 1 -- 172.21.15.37:0/1686173415 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd0c01593c0 msgr2=0x7fd0c014c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:35.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.714+0000 7fd0c679c700 1 --2- 172.21.15.37:0/1686173415 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd0c01593c0 0x7fd0c014c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:35.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.714+0000 7fd0c679c700 1 -- 172.21.15.37:0/1686173415 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0c00c9b30 msgr2=0x7fd0c01569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:35.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.714+0000 7fd0c679c700 1 --2- 172.21.15.37:0/1686173415 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0c00c9b30 0x7fd0c01569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:35.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.714+0000 7fd0c679c700 1 -- 172.21.15.37:0/1686173415 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b00094a0 con 0x7fd0c0159790 2023-07-14T15:56:35.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.714+0000 7fd0c5f9b700 1 --2- 172.21.15.37:0/1686173415 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0c00c9b30 0x7fd0c01569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:56:35.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.714+0000 7fd0c679c700 1 --2- 172.21.15.37:0/1686173415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0c0159790 0x7fd0c01f59f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd0b800efc0 tx=0x7fd0b800c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:35.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.714+0000 7fd0b67fc700 1 -- 172.21.15.37:0/1686173415 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b800cb80 con 0x7fd0c0159790 2023-07-14T15:56:35.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.714+0000 7fd0b67fc700 1 -- 172.21.15.37:0/1686173415 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b800f040 con 0x7fd0c0159790 2023-07-14T15:56:35.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.714+0000 7fd0b67fc700 1 -- 172.21.15.37:0/1686173415 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b8014480 con 0x7fd0c0159790 2023-07-14T15:56:35.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.714+0000 7fd0c81ff700 1 -- 172.21.15.37:0/1686173415 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0c0157330 con 0x7fd0c0159790 2023-07-14T15:56:35.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.715+0000 7fd0c81ff700 1 -- 172.21.15.37:0/1686173415 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0c01578f0 con 0x7fd0c0159790 2023-07-14T15:56:35.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.715+0000 7fd0c81ff700 1 -- 172.21.15.37:0/1686173415 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0c0067840 con 0x7fd0c0159790 2023-07-14T15:56:35.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.716+0000 7fd0b67fc700 1 -- 172.21.15.37:0/1686173415 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd0b80145e0 con 0x7fd0c0159790 2023-07-14T15:56:35.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.717+0000 7fd0b67fc700 1 --2- 172.21.15.37:0/1686173415 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd0a406ace0 0x7fd0a406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:35.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.717+0000 7fd0b67fc700 1 -- 172.21.15.37:0/1686173415 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd0b8089cb0 con 0x7fd0c0159790 2023-07-14T15:56:35.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.718+0000 7fd0c5f9b700 1 --2- 172.21.15.37:0/1686173415 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd0a406ace0 0x7fd0a406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:35.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.718+0000 7fd0c5f9b700 1 --2- 172.21.15.37:0/1686173415 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd0a406ace0 0x7fd0a406d190 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc000f60 tx=0x7fd0bc007ca0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:35.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.722+0000 7fd0b67fc700 1 -- 172.21.15.37:0/1686173415 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd0b8054d50 con 0x7fd0c0159790 2023-07-14T15:56:35.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.976+0000 7fd0c81ff700 1 -- 172.21.15.37:0/1686173415 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd0c00b16e0 con 0x7fd0c0159790 2023-07-14T15:56:35.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.977+0000 7fd0b67fc700 1 -- 172.21.15.37:0/1686173415 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd0b8018060 con 0x7fd0c0159790 2023-07-14T15:56:35.966 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-14T15:56:35.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.979+0000 7fd0c81ff700 1 -- 172.21.15.37:0/1686173415 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd0a406ace0 msgr2=0x7fd0a406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:35.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.979+0000 7fd0c81ff700 1 --2- 172.21.15.37:0/1686173415 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd0a406ace0 0x7fd0a406d190 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc000f60 tx=0x7fd0bc007ca0 comp rx=0 tx=0).stop 2023-07-14T15:56:35.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.979+0000 7fd0c81ff700 1 -- 172.21.15.37:0/1686173415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0c0159790 msgr2=0x7fd0c01f59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:35.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.979+0000 7fd0c81ff700 1 --2- 172.21.15.37:0/1686173415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0c0159790 0x7fd0c01f59f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd0b800efc0 tx=0x7fd0b800c0c0 comp rx=0 tx=0).stop 2023-07-14T15:56:35.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.979+0000 7fd0c81ff700 1 -- 172.21.15.37:0/1686173415 shutdown_connections 2023-07-14T15:56:35.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.979+0000 7fd0c81ff700 1 --2- 172.21.15.37:0/1686173415 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0c00c9b30 0x7fd0c01569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:35.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.979+0000 7fd0c81ff700 1 --2- 172.21.15.37:0/1686173415 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd0a406ace0 0x7fd0a406d190 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:35.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.979+0000 7fd0c81ff700 1 --2- 172.21.15.37:0/1686173415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0c0159790 0x7fd0c01f59f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:35.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.979+0000 7fd0c81ff700 1 --2- 172.21.15.37:0/1686173415 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd0c01593c0 0x7fd0c014c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:35.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.979+0000 7fd0c81ff700 1 -- 172.21.15.37:0/1686173415 >> 172.21.15.37:0/1686173415 conn(0x7fd0c00b08c0 msgr2=0x7fd0c00cd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:35.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.980+0000 7fd0c81ff700 1 -- 172.21.15.37:0/1686173415 shutdown_connections 2023-07-14T15:56:35.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:35.980+0000 7fd0c81ff700 1 -- 172.21.15.37:0/1686173415 wait complete. 2023-07-14T15:56:35.985 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-14T15:56:35.986 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-14T15:56:35.988 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2023-07-14T15:56:35.988 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-07-14T15:56:35.988 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-07-14T15:56:35.992 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-14T15:56:35.992 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-14T15:56:35.993 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-14T15:56:35.993 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-07-14T15:56:35.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:35.994 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2023-07-14T15:56:36.038 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T15:56:36.038 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T15:56:36.039 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T15:56:36.039 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:56:36.039 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-07-14T15:56:36.039 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:56:36.040 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T15:56:36.040 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2023-07-14T15:56:36.040 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2023-07-14T15:56:36.040 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T15:56:36.040 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2023-07-14T15:56:36.040 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2023-07-14T15:56:36.040 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-14T15:56:36.041 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2023-07-14T15:56:36.041 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2023-07-14T15:56:36.041 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-07-14T15:56:36.041 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42042sec preferred_lft 42042sec 2023-07-14T15:56:36.041 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2023-07-14T15:56:36.041 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:56:36.041 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T15:56:36.042 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2023-07-14T15:56:36.042 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2023-07-14T15:56:36.042 INFO:teuthology.orchestra.run.smithi037.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-14T15:56:36.042 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 96:4b:9b:4c:a1:a6 brd ff:ff:ff:ff:ff:ff 2023-07-14T15:56:36.042 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-14T15:56:36.042 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:56:36.042 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::bcee:35ff:fe0f:4eb1/64 scope link 2023-07-14T15:56:36.042 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:56:36.043 INFO:teuthology.orchestra.run.smithi037.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T15:56:36.043 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 96:4b:9b:4c:a1:a6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-14T15:56:36.043 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::944b:9bff:fe4c:a1a6/64 scope link 2023-07-14T15:56:36.043 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:56:36.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:36.044 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-14T15:56:36.152 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-07-14T15:56:36.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:36.156 DEBUG:teuthology.orchestra.run.smithi037:> route 2023-07-14T15:56:36.204 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2023-07-14T15:56:36.205 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-14T15:56:36.205 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-07-14T15:56:36.205 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-07-14T15:56:36.206 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-14T15:56:36.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:36.207 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-07-14T15:56:36.207 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-07-14T15:56:36.208 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-14T15:56:36.208 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-14T15:56:36.209 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-14T15:56:36.209 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-07-14T15:56:36.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:36.383 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-07-14T15:56:36.427 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-14T15:56:36.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:36.428 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list-id 2023-07-14T15:56:36.511 INFO:teuthology.orchestra.run.smithi037.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-07-14T15:56:36.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:36.512 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-07-14T15:56:36.513 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-07-14T15:56:36.513 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-14T15:56:36.513 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-07-14T15:56:36.513 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-07-14T15:56:36.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:36.698 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-07-14T15:56:36.768 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T15:56:36.769 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T15:56:36.769 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T15:56:36.769 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:56:36.769 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-07-14T15:56:36.770 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:56:36.770 INFO:teuthology.orchestra.run.smithi037.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-14T15:56:36.770 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether d6:90:45:09:65:f7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-14T15:56:36.770 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-14T15:56:36.770 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:56:36.770 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::d490:45ff:fe09:65f7/64 scope link 2023-07-14T15:56:36.771 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:56:36.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:36.772 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-07-14T15:56:36.842 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T15:56:36.842 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T15:56:36.843 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T15:56:36.843 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:56:36.843 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-07-14T15:56:36.844 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:56:36.844 INFO:teuthology.orchestra.run.smithi037.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-14T15:56:36.844 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether d6:90:45:09:65:f7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-14T15:56:36.844 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-14T15:56:36.845 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:56:36.845 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::d490:45ff:fe09:65f7/64 scope link 2023-07-14T15:56:36.845 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:56:36.847 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-07-14T15:56:36.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:36.848 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-07-14T15:56:36.849 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-07-14T15:56:36.849 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-07-14T15:56:36.850 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-07-14T15:56:36.850 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-07-14T15:56:36.850 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-07-14T15:56:36.850 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-07-14T15:56:36.850 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-07-14T15:56:37.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:37.113 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-07-14T15:56:37.113 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-07-14T15:56:37.114 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.1 up 2023-07-14T15:56:37.114 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set dev brx.1 master ceph-brx 2023-07-14T15:56:37.114 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-07-14T15:56:37.288 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T15:56:37.289 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-07-14T15:56:37.332 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-07-14T15:56:37.333 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T15:56:37.333 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-07-14T15:56:37.416 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-07-14T15:56:37.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:37.416 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T15:56:37.562 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T15:56:37.563 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-14T15:56:37.593 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T15:56:37.593 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-14T15:56:37.593 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.98:3300,172.21.15.98:3301" 2023-07-14T15:56:37.593 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with new device syntax: 2@9da30401-a779-4e46-aba6-00c2494c6c67.cephfs=/ 2023-07-14T15:56:37.594 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.37:3300/172.21.15.98:3300/172.21.15.98:3301" will pass to kernel 2023-07-14T15:56:37.599 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-14T15:56:37.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:37.599 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-07-14T15:56:37.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:37.669 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T15:56:37.754 INFO:teuthology.orchestra.run.smithi037.stdout:client4683 2023-07-14T15:56:37.755 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-14T15:56:37.755 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T15:56:37.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:37.799 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T15:56:37.924 INFO:teuthology.orchestra.run.smithi037.stdout:client4683 2023-07-14T15:56:37.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:37.925 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T15:56:38.011 INFO:teuthology.orchestra.run.smithi037.stdout:client4683 2023-07-14T15:56:38.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:38.012 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/9da30401-a779-4e46-aba6-00c2494c6c67.client4683/status') 2023-07-14T15:56:38.119 INFO:teuthology.orchestra.run.smithi037.stdout:instance: client.4683 (3)192.168.0.2:0/538033869 2023-07-14T15:56:38.120 INFO:teuthology.orchestra.run.smithi037.stdout:blocklisted: false 2023-07-14T15:56:38.120 INFO:teuthology.orchestra.run.smithi037.stderr:0+1 records in 2023-07-14T15:56:38.120 INFO:teuthology.orchestra.run.smithi037.stderr:0+1 records out 2023-07-14T15:56:38.120 INFO:teuthology.orchestra.run.smithi037.stderr:68 bytes copied, 5.4847e-05 s, 1.2 MB/s 2023-07-14T15:56:38.122 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-07-14T15:56:38.123 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-14T15:56:38.123 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-14T15:56:38.123 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-14T15:56:38.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.338+0000 7f10ec1ff700 1 Processor -- start 2023-07-14T15:56:38.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.338+0000 7f10ec1ff700 1 -- start start 2023-07-14T15:56:38.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.339+0000 7f10ec1ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f10e40ca170 0x7f10e4071120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:38.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.339+0000 7f10ec1ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f10e4069e70 0x7f10e406a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:38.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.339+0000 7f10ec1ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10e40cbb40 con 0x7f10e415cc40 2023-07-14T15:56:38.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.339+0000 7f10ec1ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10e41615c0 con 0x7f10e40ca170 2023-07-14T15:56:38.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.339+0000 7f10ec1ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10e406a830 con 0x7f10e4069e70 2023-07-14T15:56:38.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.339+0000 7f10e979a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f10e40ca170 0x7f10e4071120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:38.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.339+0000 7f10e979a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f10e40ca170 0x7f10e4071120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51690/0 (socket says 172.21.15.37:51690) 2023-07-14T15:56:38.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.339+0000 7f10e9f9b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f10e415cc40 0x7f10e4160eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:59998/0 (socket says 172.21.15.37:59998) 2023-07-14T15:56:38.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.339+0000 7f10e979a700 1 -- 172.21.15.37:0/45553597 learned_addr learned my addr 172.21.15.37:0/45553597 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:38.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.340+0000 7f10ea79c700 1 --2- 172.21.15.37:0/45553597 >> v2:172.21.15.98:3300/0 conn(0x7f10e4069e70 0x7f10e406a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:38.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.340+0000 7f10e979a700 1 -- 172.21.15.37:0/45553597 >> v2:172.21.15.98:3300/0 conn(0x7f10e4069e70 msgr2=0x7f10e406a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:38.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.340+0000 7f10e979a700 1 --2- 172.21.15.37:0/45553597 >> v2:172.21.15.98:3300/0 conn(0x7f10e4069e70 0x7f10e406a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:38.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.340+0000 7f10e979a700 1 -- 172.21.15.37:0/45553597 >> v1:172.21.15.37:6789/0 conn(0x7f10e415cc40 legacy=0x7f10e4160eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:38.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.340+0000 7f10e979a700 1 -- 172.21.15.37:0/45553597 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e4070c90 con 0x7f10e40ca170 2023-07-14T15:56:38.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.340+0000 7f10e979a700 1 --2- 172.21.15.37:0/45553597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10e40ca170 0x7f10e4071120 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f10d40098f0 tx=0x7f10d4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa02b278861fc78 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:38.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.340+0000 7f10e8f99700 1 -- 172.21.15.37:0/45553597 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d400b860 con 0x7f10e40ca170 2023-07-14T15:56:38.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.340+0000 7f10e8f99700 1 -- 172.21.15.37:0/45553597 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d400b9c0 con 0x7f10e40ca170 2023-07-14T15:56:38.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.340+0000 7f10e8f99700 1 -- 172.21.15.37:0/45553597 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d400bd50 con 0x7f10e40ca170 2023-07-14T15:56:38.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.341+0000 7f10ec1ff700 1 -- 172.21.15.37:0/45553597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10e40ca170 msgr2=0x7f10e4071120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:38.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.341+0000 7f10ec1ff700 1 --2- 172.21.15.37:0/45553597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10e40ca170 0x7f10e4071120 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f10d40098f0 tx=0x7f10d4009c00 comp rx=0 tx=0).stop 2023-07-14T15:56:38.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.341+0000 7f10ec1ff700 1 -- 172.21.15.37:0/45553597 shutdown_connections 2023-07-14T15:56:38.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.341+0000 7f10ec1ff700 1 --2- 172.21.15.37:0/45553597 >> v2:172.21.15.98:3300/0 conn(0x7f10e4069e70 0x7f10e406a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:38.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.341+0000 7f10ec1ff700 1 --2- 172.21.15.37:0/45553597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10e40ca170 0x7f10e4071120 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:38.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.341+0000 7f10ec1ff700 1 -- 172.21.15.37:0/45553597 >> 172.21.15.37:0/45553597 conn(0x7f10e40cd230 msgr2=0x7f10e40cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:38.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.341+0000 7f10ec1ff700 1 -- 172.21.15.37:0/45553597 shutdown_connections 2023-07-14T15:56:38.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.341+0000 7f10ec1ff700 1 -- 172.21.15.37:0/45553597 wait complete. 2023-07-14T15:56:38.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.343+0000 7f10ec1ff700 1 Processor -- start 2023-07-14T15:56:38.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.343+0000 7f10ec1ff700 1 -- start start 2023-07-14T15:56:38.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.344+0000 7f10ec1ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f10e4069e70 0x7f10e41f2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:38.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.344+0000 7f10ec1ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10e40ca170 0x7f10e41f63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:38.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.344+0000 7f10ec1ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10e415cc40 0x7f10e40b5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:38.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.344+0000 7f10ec1ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e40b3fa0 con 0x7f10e40ca170 2023-07-14T15:56:38.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.344+0000 7f10ec1ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e41f68e0 con 0x7f10e415cc40 2023-07-14T15:56:38.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.344+0000 7f10ec1ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10e40b41d0 con 0x7f10e4069e70 2023-07-14T15:56:38.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.344+0000 7f10e979a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10e40ca170 0x7f10e41f63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:38.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.344+0000 7f10e979a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10e40ca170 0x7f10e41f63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51704/0 (socket says 172.21.15.37:51704) 2023-07-14T15:56:38.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.344+0000 7f10e979a700 1 -- 172.21.15.37:0/3932630664 learned_addr learned my addr 172.21.15.37:0/3932630664 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:38.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.344+0000 7f10ea79c700 1 --2- 172.21.15.37:0/3932630664 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10e415cc40 0x7f10e40b5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:38.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.344+0000 7f10e979a700 1 -- 172.21.15.37:0/3932630664 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f10e4069e70 msgr2=0x7f10e41f2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:38.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.344+0000 7f10e979a700 1 --2- 172.21.15.37:0/3932630664 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f10e4069e70 0x7f10e41f2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:38.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.344+0000 7f10e979a700 1 -- 172.21.15.37:0/3932630664 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10e415cc40 msgr2=0x7f10e40b5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:38.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.344+0000 7f10e979a700 1 --2- 172.21.15.37:0/3932630664 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10e415cc40 0x7f10e40b5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:38.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.344+0000 7f10e979a700 1 -- 172.21.15.37:0/3932630664 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d4009550 con 0x7f10e40ca170 2023-07-14T15:56:38.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.344+0000 7f10ea79c700 1 --2- 172.21.15.37:0/3932630664 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10e415cc40 0x7f10e40b5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:56:38.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.345+0000 7f10e979a700 1 --2- 172.21.15.37:0/3932630664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10e40ca170 0x7f10e41f63a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f10d4000c00 tx=0x7f10d4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:38.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.345+0000 7f10da7fc700 1 -- 172.21.15.37:0/3932630664 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d4004480 con 0x7f10e40ca170 2023-07-14T15:56:38.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.345+0000 7f10da7fc700 1 -- 172.21.15.37:0/3932630664 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d401f070 con 0x7f10e40ca170 2023-07-14T15:56:38.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.345+0000 7f10da7fc700 1 -- 172.21.15.37:0/3932630664 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d40038e0 con 0x7f10e40ca170 2023-07-14T15:56:38.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.345+0000 7f10ec1ff700 1 -- 172.21.15.37:0/3932630664 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10e40b4470 con 0x7f10e40ca170 2023-07-14T15:56:38.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.345+0000 7f10ec1ff700 1 -- 172.21.15.37:0/3932630664 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10e40b4a30 con 0x7f10e40ca170 2023-07-14T15:56:38.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.346+0000 7f10ec1ff700 1 -- 172.21.15.37:0/3932630664 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10e4067840 con 0x7f10e40ca170 2023-07-14T15:56:38.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.347+0000 7f10da7fc700 1 -- 172.21.15.37:0/3932630664 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f10d4021030 con 0x7f10e40ca170 2023-07-14T15:56:38.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.348+0000 7f10da7fc700 1 --2- 172.21.15.37:0/3932630664 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f10c806ace0 0x7f10c806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:38.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.348+0000 7f10da7fc700 1 -- 172.21.15.37:0/3932630664 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f10d408a970 con 0x7f10e40ca170 2023-07-14T15:56:38.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.349+0000 7f10e9f9b700 1 --2- 172.21.15.37:0/3932630664 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f10c806ace0 0x7f10c806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:38.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.349+0000 7f10e9f9b700 1 --2- 172.21.15.37:0/3932630664 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f10c806ace0 0x7f10c806d190 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f10e00015c0 tx=0x7f10e0007a50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:38.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.352+0000 7f10da7fc700 1 -- 172.21.15.37:0/3932630664 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f10d4055a10 con 0x7f10e40ca170 2023-07-14T15:56:38.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.606+0000 7f10ec1ff700 1 -- 172.21.15.37:0/3932630664 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f10e40b5aa0 con 0x7f10e40ca170 2023-07-14T15:56:38.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.607+0000 7f10da7fc700 1 -- 172.21.15.37:0/3932630664 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f10d4010380 con 0x7f10e40ca170 2023-07-14T15:56:38.594 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-14T15:56:38.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.609+0000 7f10ec1ff700 1 -- 172.21.15.37:0/3932630664 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f10c806ace0 msgr2=0x7f10c806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:38.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.609+0000 7f10ec1ff700 1 --2- 172.21.15.37:0/3932630664 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f10c806ace0 0x7f10c806d190 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f10e00015c0 tx=0x7f10e0007a50 comp rx=0 tx=0).stop 2023-07-14T15:56:38.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.609+0000 7f10ec1ff700 1 -- 172.21.15.37:0/3932630664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10e40ca170 msgr2=0x7f10e41f63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:38.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.609+0000 7f10ec1ff700 1 --2- 172.21.15.37:0/3932630664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10e40ca170 0x7f10e41f63a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f10d4000c00 tx=0x7f10d4004750 comp rx=0 tx=0).stop 2023-07-14T15:56:38.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.609+0000 7f10ec1ff700 1 -- 172.21.15.37:0/3932630664 shutdown_connections 2023-07-14T15:56:38.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.609+0000 7f10ec1ff700 1 --2- 172.21.15.37:0/3932630664 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10e415cc40 0x7f10e40b5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:38.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.609+0000 7f10ec1ff700 1 --2- 172.21.15.37:0/3932630664 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f10c806ace0 0x7f10c806d190 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:38.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.609+0000 7f10ec1ff700 1 --2- 172.21.15.37:0/3932630664 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f10e4069e70 0x7f10e41f2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:38.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.609+0000 7f10ec1ff700 1 --2- 172.21.15.37:0/3932630664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10e40ca170 0x7f10e41f63a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:38.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.609+0000 7f10ec1ff700 1 -- 172.21.15.37:0/3932630664 >> 172.21.15.37:0/3932630664 conn(0x7f10e40cd230 msgr2=0x7f10e406e710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:38.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.609+0000 7f10ec1ff700 1 -- 172.21.15.37:0/3932630664 shutdown_connections 2023-07-14T15:56:38.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:38.609+0000 7f10ec1ff700 1 -- 172.21.15.37:0/3932630664 wait complete. 2023-07-14T15:56:38.614 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-14T15:56:38.614 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-14T15:56:38.614 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi098.front.sepia.ceph.com 2023-07-14T15:56:38.614 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-14T15:56:38.615 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-14T15:56:38.615 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-14T15:56:38.615 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-14T15:56:38.615 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-14T15:56:38.615 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-14T15:56:38.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:38.616 DEBUG:teuthology.orchestra.run.smithi098:> ip addr 2023-07-14T15:56:38.664 INFO:teuthology.orchestra.run.smithi098.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T15:56:38.664 INFO:teuthology.orchestra.run.smithi098.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T15:56:38.664 INFO:teuthology.orchestra.run.smithi098.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T15:56:38.665 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:56:38.665 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 ::1/128 scope host 2023-07-14T15:56:38.665 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:56:38.665 INFO:teuthology.orchestra.run.smithi098.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T15:56:38.665 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b8 brd ff:ff:ff:ff:ff:ff 2023-07-14T15:56:38.665 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f0 2023-07-14T15:56:38.665 INFO:teuthology.orchestra.run.smithi098.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T15:56:38.665 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b9 brd ff:ff:ff:ff:ff:ff 2023-07-14T15:56:38.666 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f1 2023-07-14T15:56:38.666 INFO:teuthology.orchestra.run.smithi098.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T15:56:38.666 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6a brd ff:ff:ff:ff:ff:ff 2023-07-14T15:56:38.666 INFO:teuthology.orchestra.run.smithi098.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-14T15:56:38.666 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6b brd ff:ff:ff:ff:ff:ff 2023-07-14T15:56:38.666 INFO:teuthology.orchestra.run.smithi098.stdout: inet 172.21.15.98/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-14T15:56:38.666 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft 42055sec preferred_lft 42055sec 2023-07-14T15:56:38.667 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::9888:7b88:1642:cf3d/64 scope link noprefixroute 2023-07-14T15:56:38.667 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:56:38.668 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-14T15:56:38.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:38.669 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec bash -c ' 2023-07-14T15:56:38.669 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2023-07-14T15:56:38.670 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link add name ceph-brx type bridge 2023-07-14T15:56:38.670 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip addr flush dev ceph-brx 2023-07-14T15:56:38.671 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set ceph-brx up 2023-07-14T15:56:38.671 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-14T15:56:38.671 DEBUG:teuthology.orchestra.run.smithi098:> ') 2023-07-14T15:56:39.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:39.112 DEBUG:teuthology.orchestra.run.smithi098:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-14T15:56:39.184 INFO:teuthology.orchestra.run.smithi098.stdout:1 2023-07-14T15:56:39.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:39.188 DEBUG:teuthology.orchestra.run.smithi098:> route 2023-07-14T15:56:39.245 INFO:teuthology.orchestra.run.smithi098.stdout:Kernel IP routing table 2023-07-14T15:56:39.245 INFO:teuthology.orchestra.run.smithi098.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-14T15:56:39.245 INFO:teuthology.orchestra.run.smithi098.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-14T15:56:39.245 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-14T15:56:39.245 INFO:teuthology.orchestra.run.smithi098.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-14T15:56:39.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:39.247 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec bash -c ' 2023-07-14T15:56:39.247 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2023-07-14T15:56:39.247 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-14T15:56:39.247 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-14T15:56:39.248 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-14T15:56:39.248 DEBUG:teuthology.orchestra.run.smithi098:> ') 2023-07-14T15:56:39.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:39.949 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2023-07-14T15:56:39.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:39.994 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list-id 2023-07-14T15:56:40.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:40.076 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec bash -c ' 2023-07-14T15:56:40.077 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2023-07-14T15:56:40.077 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-14T15:56:40.077 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-07-14T15:56:40.077 DEBUG:teuthology.orchestra.run.smithi098:> ') 2023-07-14T15:56:40.256 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-07-14T15:56:40.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:40.257 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec bash -c ' 2023-07-14T15:56:40.258 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2023-07-14T15:56:40.258 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-07-14T15:56:40.258 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-14T15:56:40.259 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-07-14T15:56:40.259 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-07-14T15:56:40.259 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-07-14T15:56:40.259 DEBUG:teuthology.orchestra.run.smithi098:> ') 2023-07-14T15:56:40.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:40.539 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec bash -c ' 2023-07-14T15:56:40.539 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2023-07-14T15:56:40.539 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set brx.0 up 2023-07-14T15:56:40.539 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set dev brx.0 master ceph-brx 2023-07-14T15:56:40.540 DEBUG:teuthology.orchestra.run.smithi098:> ') 2023-07-14T15:56:40.710 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T15:56:40.711 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-14T15:56:40.753 INFO:teuthology.orchestra.run.smithi098.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-14T15:56:40.753 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T15:56:40.754 DEBUG:teuthology.orchestra.run.smithi098:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-14T15:56:40.834 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-07-14T15:56:40.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:40.835 DEBUG:teuthology.orchestra.run.smithi098:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T15:56:41.000 INFO:teuthology.orchestra.run.smithi098.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T15:56:41.000 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-14T15:56:41.445 INFO:teuthology.orchestra.run.smithi098.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T15:56:41.445 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-14T15:56:41.446 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.98:3300,172.21.15.98:3301" 2023-07-14T15:56:41.446 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: trying mount with new device syntax: 1@9da30401-a779-4e46-aba6-00c2494c6c67.cephfs=/ 2023-07-14T15:56:41.446 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.37:3300/172.21.15.98:3300/172.21.15.98:3301" will pass to kernel 2023-07-14T15:56:41.452 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-14T15:56:41.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:41.453 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-14T15:56:41.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:41.525 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T15:56:41.627 INFO:teuthology.orchestra.run.smithi098.stdout:client4508 2023-07-14T15:56:41.627 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-14T15:56:41.628 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T15:56:41.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:41.671 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T15:56:41.794 INFO:teuthology.orchestra.run.smithi098.stdout:client4508 2023-07-14T15:56:41.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:41.795 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T15:56:41.878 INFO:teuthology.orchestra.run.smithi098.stdout:client4508 2023-07-14T15:56:41.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:41.879 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/9da30401-a779-4e46-aba6-00c2494c6c67.client4508/status') 2023-07-14T15:56:41.986 INFO:teuthology.orchestra.run.smithi098.stdout:instance: client.4508 (3)192.168.0.1:0/1666669135 2023-07-14T15:56:41.987 INFO:teuthology.orchestra.run.smithi098.stdout:blocklisted: false 2023-07-14T15:56:41.987 INFO:teuthology.orchestra.run.smithi098.stderr:0+1 records in 2023-07-14T15:56:41.987 INFO:teuthology.orchestra.run.smithi098.stderr:0+1 records out 2023-07-14T15:56:41.987 INFO:teuthology.orchestra.run.smithi098.stderr:69 bytes copied, 5.0691e-05 s, 1.4 MB/s 2023-07-14T15:56:41.989 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-07-14T15:56:41.990 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-14T15:56:41.990 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-07-14T15:56:41.990 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-14T15:56:42.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.217+0000 7f1e8c9ff700 1 Processor -- start 2023-07-14T15:56:42.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.217+0000 7f1e8c9ff700 1 -- start start 2023-07-14T15:56:42.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.218+0000 7f1e8c9ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f1e880b85f0 0x7f1e8815d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:42.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.218+0000 7f1e8c9ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1e880b4910 0x7f1e880b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:42.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.218+0000 7f1e8c9ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e880cf6b0 con 0x7f1e880b54b0 2023-07-14T15:56:42.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.218+0000 7f1e8c9ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e880b52d0 con 0x7f1e880b4910 2023-07-14T15:56:42.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.218+0000 7f1e8c9ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e880cdc40 con 0x7f1e880b85f0 2023-07-14T15:56:42.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.218+0000 7f1e86d9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1e880b4910 0x7f1e880b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:42.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.218+0000 7f1e86d9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1e880b4910 0x7f1e880b4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45992/0 (socket says 172.21.15.37:45992) 2023-07-14T15:56:42.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.218+0000 7f1e86d9d700 1 -- 172.21.15.37:0/134030929 learned_addr learned my addr 172.21.15.37:0/134030929 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:42.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.218+0000 7f1e8659c700 1 --2- 172.21.15.37:0/134030929 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f1e880b85f0 0x7f1e8815d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:42.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.219+0000 7f1e8559a700 1 -- 172.21.15.37:0/134030929 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 804442325 0 0) 0x7f1e880cf6b0 con 0x7f1e880b54b0 2023-07-14T15:56:42.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.219+0000 7f1e86d9d700 1 -- 172.21.15.37:0/134030929 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f1e880b85f0 msgr2=0x7f1e8815d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:42.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.219+0000 7f1e86d9d700 1 --2- 172.21.15.37:0/134030929 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f1e880b85f0 0x7f1e8815d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:42.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.219+0000 7f1e86d9d700 1 -- 172.21.15.37:0/134030929 >> v1:172.21.15.98:6789/0 conn(0x7f1e880b54b0 legacy=0x7f1e880cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:42.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.219+0000 7f1e86d9d700 1 -- 172.21.15.37:0/134030929 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e8815dba0 con 0x7f1e880b4910 2023-07-14T15:56:42.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.219+0000 7f1e86d9d700 1 --2- 172.21.15.37:0/134030929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e880b4910 0x7f1e880b4d90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1e80009e50 tx=0x7f1e8000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc5515757a9622d6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:42.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.219+0000 7f1e8559a700 1 -- 172.21.15.37:0/134030929 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8000e070 con 0x7f1e880b4910 2023-07-14T15:56:42.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.219+0000 7f1e8559a700 1 -- 172.21.15.37:0/134030929 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e8000b910 con 0x7f1e880b4910 2023-07-14T15:56:42.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.219+0000 7f1e8559a700 1 -- 172.21.15.37:0/134030929 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8000bcc0 con 0x7f1e880b4910 2023-07-14T15:56:42.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.220+0000 7f1e8c9ff700 1 -- 172.21.15.37:0/134030929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e880b4910 msgr2=0x7f1e880b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:42.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.220+0000 7f1e8c9ff700 1 --2- 172.21.15.37:0/134030929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e880b4910 0x7f1e880b4d90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1e80009e50 tx=0x7f1e8000b330 comp rx=0 tx=0).stop 2023-07-14T15:56:42.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.220+0000 7f1e8c9ff700 1 -- 172.21.15.37:0/134030929 shutdown_connections 2023-07-14T15:56:42.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.220+0000 7f1e8c9ff700 1 --2- 172.21.15.37:0/134030929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e880b4910 0x7f1e880b4d90 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:42.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.220+0000 7f1e8c9ff700 1 --2- 172.21.15.37:0/134030929 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f1e880b85f0 0x7f1e8815d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:42.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.220+0000 7f1e8c9ff700 1 -- 172.21.15.37:0/134030929 >> 172.21.15.37:0/134030929 conn(0x7f1e8806a580 msgr2=0x7f1e8806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:42.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.220+0000 7f1e8c9ff700 1 -- 172.21.15.37:0/134030929 shutdown_connections 2023-07-14T15:56:42.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.220+0000 7f1e8c9ff700 1 -- 172.21.15.37:0/134030929 wait complete. 2023-07-14T15:56:42.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.222+0000 7f1e8c9ff700 1 Processor -- start 2023-07-14T15:56:42.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.222+0000 7f1e8c9ff700 1 -- start start 2023-07-14T15:56:42.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.223+0000 7f1e8c9ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1e880b4910 0x7f1e881f4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:42.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.223+0000 7f1e8c9ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f1e880b54b0 0x7f1e881f2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:42.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.223+0000 7f1e8c9ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e880b85f0 0x7f1e880a9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:42.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.223+0000 7f1e8c9ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e881f2d40 con 0x7f1e880b85f0 2023-07-14T15:56:42.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.223+0000 7f1e8c9ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e881f3c50 con 0x7f1e880b4910 2023-07-14T15:56:42.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.223+0000 7f1e8c9ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e881f3f30 con 0x7f1e880b54b0 2023-07-14T15:56:42.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.223+0000 7f1e86d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e880b85f0 0x7f1e880a9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:42.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.223+0000 7f1e86d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e880b85f0 0x7f1e880a9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46000/0 (socket says 172.21.15.37:46000) 2023-07-14T15:56:42.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.223+0000 7f1e86d9d700 1 -- 172.21.15.37:0/1150061900 learned_addr learned my addr 172.21.15.37:0/1150061900 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:42.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.224+0000 7f1e8659c700 1 --2- 172.21.15.37:0/1150061900 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1e880b4910 0x7f1e881f4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:42.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.224+0000 7f1e85d9b700 1 --2- 172.21.15.37:0/1150061900 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f1e880b54b0 0x7f1e881f2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:42.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.224+0000 7f1e86d9d700 1 -- 172.21.15.37:0/1150061900 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f1e880b54b0 msgr2=0x7f1e881f2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:42.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.224+0000 7f1e86d9d700 1 --2- 172.21.15.37:0/1150061900 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f1e880b54b0 0x7f1e881f2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:42.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.224+0000 7f1e86d9d700 1 -- 172.21.15.37:0/1150061900 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1e880b4910 msgr2=0x7f1e881f4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:42.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.224+0000 7f1e86d9d700 1 --2- 172.21.15.37:0/1150061900 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1e880b4910 0x7f1e881f4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:42.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.224+0000 7f1e86d9d700 1 -- 172.21.15.37:0/1150061900 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e80009b30 con 0x7f1e880b85f0 2023-07-14T15:56:42.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.224+0000 7f1e86d9d700 1 --2- 172.21.15.37:0/1150061900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e880b85f0 0x7f1e880a9d00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1e8000b680 tx=0x7f1e80004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:42.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.224+0000 7f1e76ffd700 1 -- 172.21.15.37:0/1150061900 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e800048b0 con 0x7f1e880b85f0 2023-07-14T15:56:42.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.224+0000 7f1e76ffd700 1 -- 172.21.15.37:0/1150061900 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e800099b0 con 0x7f1e880b85f0 2023-07-14T15:56:42.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.224+0000 7f1e8c9ff700 1 -- 172.21.15.37:0/1150061900 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e881f4210 con 0x7f1e880b85f0 2023-07-14T15:56:42.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.224+0000 7f1e76ffd700 1 -- 172.21.15.37:0/1150061900 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8001c680 con 0x7f1e880b85f0 2023-07-14T15:56:42.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.225+0000 7f1e8c9ff700 1 -- 172.21.15.37:0/1150061900 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e881f47d0 con 0x7f1e880b85f0 2023-07-14T15:56:42.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.226+0000 7f1e8c9ff700 1 -- 172.21.15.37:0/1150061900 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e88067840 con 0x7f1e880b85f0 2023-07-14T15:56:42.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.227+0000 7f1e76ffd700 1 -- 172.21.15.37:0/1150061900 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1e8001c7e0 con 0x7f1e880b85f0 2023-07-14T15:56:42.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.227+0000 7f1e76ffd700 1 --2- 172.21.15.37:0/1150061900 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f1e6806ace0 0x7f1e6806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:42.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.228+0000 7f1e76ffd700 1 -- 172.21.15.37:0/1150061900 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1e8008b000 con 0x7f1e880b85f0 2023-07-14T15:56:42.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.228+0000 7f1e8659c700 1 --2- 172.21.15.37:0/1150061900 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f1e6806ace0 0x7f1e6806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:42.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.228+0000 7f1e8659c700 1 --2- 172.21.15.37:0/1150061900 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f1e6806ace0 0x7f1e6806d190 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1e78009b40 tx=0x7f1e78009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:42.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.232+0000 7f1e76ffd700 1 -- 172.21.15.37:0/1150061900 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1e80056140 con 0x7f1e880b85f0 2023-07-14T15:56:42.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.488+0000 7f1e8c9ff700 1 -- 172.21.15.37:0/1150061900 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1e8806b440 con 0x7f1e880b85f0 2023-07-14T15:56:42.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.489+0000 7f1e76ffd700 1 -- 172.21.15.37:0/1150061900 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1e80059760 con 0x7f1e880b85f0 2023-07-14T15:56:42.475 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-14T15:56:42.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.491+0000 7f1e8c9ff700 1 -- 172.21.15.37:0/1150061900 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f1e6806ace0 msgr2=0x7f1e6806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:42.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.491+0000 7f1e8c9ff700 1 --2- 172.21.15.37:0/1150061900 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f1e6806ace0 0x7f1e6806d190 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1e78009b40 tx=0x7f1e78009210 comp rx=0 tx=0).stop 2023-07-14T15:56:42.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.491+0000 7f1e8c9ff700 1 -- 172.21.15.37:0/1150061900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e880b85f0 msgr2=0x7f1e880a9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:42.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.491+0000 7f1e8c9ff700 1 --2- 172.21.15.37:0/1150061900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e880b85f0 0x7f1e880a9d00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1e8000b680 tx=0x7f1e80004ad0 comp rx=0 tx=0).stop 2023-07-14T15:56:42.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.491+0000 7f1e8c9ff700 1 -- 172.21.15.37:0/1150061900 shutdown_connections 2023-07-14T15:56:42.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.491+0000 7f1e8c9ff700 1 --2- 172.21.15.37:0/1150061900 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1e880b4910 0x7f1e881f4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:42.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.491+0000 7f1e8c9ff700 1 --2- 172.21.15.37:0/1150061900 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f1e6806ace0 0x7f1e6806d190 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:42.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.491+0000 7f1e8c9ff700 1 --2- 172.21.15.37:0/1150061900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e880b85f0 0x7f1e880a9d00 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:42.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.491+0000 7f1e8c9ff700 1 --2- 172.21.15.37:0/1150061900 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f1e880b54b0 0x7f1e881f2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:42.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.491+0000 7f1e8c9ff700 1 -- 172.21.15.37:0/1150061900 >> 172.21.15.37:0/1150061900 conn(0x7f1e8806a580 msgr2=0x7f1e880cfa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:42.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.491+0000 7f1e8c9ff700 1 -- 172.21.15.37:0/1150061900 shutdown_connections 2023-07-14T15:56:42.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:42.491+0000 7f1e8c9ff700 1 -- 172.21.15.37:0/1150061900 wait complete. 2023-07-14T15:56:42.496 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-14T15:56:42.497 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-14T15:56:42.497 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi098.front.sepia.ceph.com 2023-07-14T15:56:42.497 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-07-14T15:56:42.497 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-07-14T15:56:42.497 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-14T15:56:42.498 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-14T15:56:42.498 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-14T15:56:42.498 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-07-14T15:56:42.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:42.499 DEBUG:teuthology.orchestra.run.smithi098:> ip addr 2023-07-14T15:56:42.543 INFO:teuthology.orchestra.run.smithi098.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T15:56:42.543 INFO:teuthology.orchestra.run.smithi098.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T15:56:42.543 INFO:teuthology.orchestra.run.smithi098.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T15:56:42.543 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:56:42.544 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 ::1/128 scope host 2023-07-14T15:56:42.544 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:56:42.544 INFO:teuthology.orchestra.run.smithi098.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T15:56:42.544 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b8 brd ff:ff:ff:ff:ff:ff 2023-07-14T15:56:42.544 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f0 2023-07-14T15:56:42.544 INFO:teuthology.orchestra.run.smithi098.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T15:56:42.544 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b9 brd ff:ff:ff:ff:ff:ff 2023-07-14T15:56:42.545 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f1 2023-07-14T15:56:42.545 INFO:teuthology.orchestra.run.smithi098.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T15:56:42.545 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6a brd ff:ff:ff:ff:ff:ff 2023-07-14T15:56:42.545 INFO:teuthology.orchestra.run.smithi098.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-14T15:56:42.545 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6b brd ff:ff:ff:ff:ff:ff 2023-07-14T15:56:42.545 INFO:teuthology.orchestra.run.smithi098.stdout: inet 172.21.15.98/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-14T15:56:42.545 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft 42051sec preferred_lft 42051sec 2023-07-14T15:56:42.546 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::9888:7b88:1642:cf3d/64 scope link noprefixroute 2023-07-14T15:56:42.546 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:56:42.546 INFO:teuthology.orchestra.run.smithi098.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-14T15:56:42.546 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether f6:48:a1:0d:45:34 brd ff:ff:ff:ff:ff:ff 2023-07-14T15:56:42.546 INFO:teuthology.orchestra.run.smithi098.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-14T15:56:42.546 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:56:42.546 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::80a1:17ff:febf:8ddc/64 scope link 2023-07-14T15:56:42.546 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:56:42.547 INFO:teuthology.orchestra.run.smithi098.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T15:56:42.547 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether f6:48:a1:0d:45:34 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-14T15:56:42.547 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::f448:a1ff:fe0d:4534/64 scope link 2023-07-14T15:56:42.547 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:56:42.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:42.548 DEBUG:teuthology.orchestra.run.smithi098:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-14T15:56:42.648 INFO:teuthology.orchestra.run.smithi098.stdout:1 2023-07-14T15:56:42.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:42.652 DEBUG:teuthology.orchestra.run.smithi098:> route 2023-07-14T15:56:42.698 INFO:teuthology.orchestra.run.smithi098.stdout:Kernel IP routing table 2023-07-14T15:56:42.698 INFO:teuthology.orchestra.run.smithi098.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-14T15:56:42.698 INFO:teuthology.orchestra.run.smithi098.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-14T15:56:42.698 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-14T15:56:42.698 INFO:teuthology.orchestra.run.smithi098.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-14T15:56:42.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:42.700 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec bash -c ' 2023-07-14T15:56:42.700 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2023-07-14T15:56:42.700 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-14T15:56:42.701 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-14T15:56:42.701 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-14T15:56:42.701 DEBUG:teuthology.orchestra.run.smithi098:> ') 2023-07-14T15:56:42.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:42.912 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2023-07-14T15:56:42.956 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-14T15:56:42.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:42.957 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list-id 2023-07-14T15:56:43.037 INFO:teuthology.orchestra.run.smithi098.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-07-14T15:56:43.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:43.039 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec bash -c ' 2023-07-14T15:56:43.039 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2023-07-14T15:56:43.040 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-14T15:56:43.040 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-07-14T15:56:43.040 DEBUG:teuthology.orchestra.run.smithi098:> ') 2023-07-14T15:56:43.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:43.219 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-07-14T15:56:43.286 INFO:teuthology.orchestra.run.smithi098.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T15:56:43.286 INFO:teuthology.orchestra.run.smithi098.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T15:56:43.287 INFO:teuthology.orchestra.run.smithi098.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T15:56:43.287 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:56:43.287 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 ::1/128 scope host 2023-07-14T15:56:43.287 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:56:43.287 INFO:teuthology.orchestra.run.smithi098.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-14T15:56:43.287 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether a2:0b:d0:26:e7:22 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-14T15:56:43.288 INFO:teuthology.orchestra.run.smithi098.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-14T15:56:43.288 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:56:43.288 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::a00b:d0ff:fe26:e722/64 scope link 2023-07-14T15:56:43.288 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:56:43.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:43.290 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-07-14T15:56:43.358 INFO:teuthology.orchestra.run.smithi098.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T15:56:43.358 INFO:teuthology.orchestra.run.smithi098.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T15:56:43.358 INFO:teuthology.orchestra.run.smithi098.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T15:56:43.358 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:56:43.359 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 ::1/128 scope host 2023-07-14T15:56:43.359 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:56:43.359 INFO:teuthology.orchestra.run.smithi098.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-14T15:56:43.359 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether a2:0b:d0:26:e7:22 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-14T15:56:43.359 INFO:teuthology.orchestra.run.smithi098.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-14T15:56:43.359 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:56:43.359 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::a00b:d0ff:fe26:e722/64 scope link 2023-07-14T15:56:43.360 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:56:43.361 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-07-14T15:56:43.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:43.362 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec bash -c ' 2023-07-14T15:56:43.362 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2023-07-14T15:56:43.362 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-07-14T15:56:43.362 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-07-14T15:56:43.363 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-07-14T15:56:43.363 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-07-14T15:56:43.363 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-07-14T15:56:43.363 DEBUG:teuthology.orchestra.run.smithi098:> ') 2023-07-14T15:56:43.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:43.609 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec bash -c ' 2023-07-14T15:56:43.610 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2023-07-14T15:56:43.610 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set brx.1 up 2023-07-14T15:56:43.610 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set dev brx.1 master ceph-brx 2023-07-14T15:56:43.610 DEBUG:teuthology.orchestra.run.smithi098:> ') 2023-07-14T15:56:43.781 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T15:56:43.781 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-07-14T15:56:43.824 INFO:teuthology.orchestra.run.smithi098.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-07-14T15:56:43.824 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T15:56:43.825 DEBUG:teuthology.orchestra.run.smithi098:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-07-14T15:56:43.907 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-07-14T15:56:43.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:43.907 DEBUG:teuthology.orchestra.run.smithi098:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T15:56:44.052 INFO:teuthology.orchestra.run.smithi098.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T15:56:44.052 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-14T15:56:44.080 INFO:teuthology.orchestra.run.smithi098.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T15:56:44.080 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-14T15:56:44.080 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.98:3300,172.21.15.98:3301" 2023-07-14T15:56:44.081 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: trying mount with new device syntax: 3@9da30401-a779-4e46-aba6-00c2494c6c67.cephfs=/ 2023-07-14T15:56:44.081 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.37:3300/172.21.15.98:3300/172.21.15.98:3301" will pass to kernel 2023-07-14T15:56:44.087 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-14T15:56:44.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:44.088 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-07-14T15:56:44.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:44.157 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T15:56:44.240 INFO:teuthology.orchestra.run.smithi098.stdout:client4699 2023-07-14T15:56:44.241 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-14T15:56:44.241 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T15:56:44.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:44.284 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T15:56:44.407 INFO:teuthology.orchestra.run.smithi098.stdout:client4699 2023-07-14T15:56:44.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:44.408 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T15:56:44.492 INFO:teuthology.orchestra.run.smithi098.stdout:client4699 2023-07-14T15:56:44.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:44.493 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/9da30401-a779-4e46-aba6-00c2494c6c67.client4699/status') 2023-07-14T15:56:44.599 INFO:teuthology.orchestra.run.smithi098.stdout:instance: client.4699 (3)192.168.0.2:0/877989736 2023-07-14T15:56:44.599 INFO:teuthology.orchestra.run.smithi098.stdout:blocklisted: false 2023-07-14T15:56:44.599 INFO:teuthology.orchestra.run.smithi098.stderr:0+1 records in 2023-07-14T15:56:44.599 INFO:teuthology.orchestra.run.smithi098.stderr:0+1 records out 2023-07-14T15:56:44.600 INFO:teuthology.orchestra.run.smithi098.stderr:68 bytes copied, 5.2066e-05 s, 1.3 MB/s 2023-07-14T15:56:44.602 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-07-14T15:56:44.625 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T15:56:44.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.854+0000 7fa90f9ff700 1 Processor -- start 2023-07-14T15:56:44.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.854+0000 7fa90f9ff700 1 -- start start 2023-07-14T15:56:44.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.855+0000 7fa90f9ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa9080b8b80 0x7fa9080b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:44.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.855+0000 7fa90f9ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa908160c50 0x7fa9080cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:44.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.855+0000 7fa90f9ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9080cf6f0 con 0x7fa9080cf8b0 2023-07-14T15:56:44.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.855+0000 7fa90f9ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9080d0de0 con 0x7fa908160c50 2023-07-14T15:56:44.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.855+0000 7fa90f9ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9080cd590 con 0x7fa9080b8b80 2023-07-14T15:56:44.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.855+0000 7fa90cf9a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa908160c50 0x7fa9080cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:44.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.855+0000 7fa90cf9a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa908160c50 0x7fa9080cf1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46006/0 (socket says 172.21.15.37:46006) 2023-07-14T15:56:44.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.855+0000 7fa90cf9a700 1 -- 172.21.15.37:0/559574663 learned_addr learned my addr 172.21.15.37:0/559574663 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:44.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.855+0000 7fa90d79b700 1 --2- 172.21.15.37:0/559574663 >> v2:172.21.15.98:3300/0 conn(0x7fa9080b8b80 0x7fa9080b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:44.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.856+0000 7fa90cf9a700 1 -- 172.21.15.37:0/559574663 >> v2:172.21.15.98:3300/0 conn(0x7fa9080b8b80 msgr2=0x7fa9080b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:44.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.856+0000 7fa90cf9a700 1 --2- 172.21.15.37:0/559574663 >> v2:172.21.15.98:3300/0 conn(0x7fa9080b8b80 0x7fa9080b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:44.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.856+0000 7fa90cf9a700 1 -- 172.21.15.37:0/559574663 >> v1:172.21.15.98:6789/0 conn(0x7fa9080cf8b0 legacy=0x7fa9080d1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:44.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.856+0000 7fa90cf9a700 1 -- 172.21.15.37:0/559574663 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9080cd870 con 0x7fa908160c50 2023-07-14T15:56:44.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.856+0000 7fa90cf9a700 1 --2- 172.21.15.37:0/559574663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa908160c50 0x7fa9080cf1b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa9080cf880 tx=0x7fa8f8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5f5705e3176a53f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:44.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.856+0000 7fa8fffff700 1 -- 172.21.15.37:0/559574663 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f8011830 con 0x7fa908160c50 2023-07-14T15:56:44.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.856+0000 7fa8fffff700 1 -- 172.21.15.37:0/559574663 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f8011990 con 0x7fa908160c50 2023-07-14T15:56:44.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.856+0000 7fa8fffff700 1 -- 172.21.15.37:0/559574663 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f8011d20 con 0x7fa908160c50 2023-07-14T15:56:44.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.857+0000 7fa90f9ff700 1 -- 172.21.15.37:0/559574663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa908160c50 msgr2=0x7fa9080cf1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:44.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.857+0000 7fa90f9ff700 1 --2- 172.21.15.37:0/559574663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa908160c50 0x7fa9080cf1b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa9080cf880 tx=0x7fa8f8009bd0 comp rx=0 tx=0).stop 2023-07-14T15:56:44.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.857+0000 7fa90f9ff700 1 -- 172.21.15.37:0/559574663 shutdown_connections 2023-07-14T15:56:44.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.857+0000 7fa90f9ff700 1 --2- 172.21.15.37:0/559574663 >> v2:172.21.15.98:3300/0 conn(0x7fa9080b8b80 0x7fa9080b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:44.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.857+0000 7fa90f9ff700 1 --2- 172.21.15.37:0/559574663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa908160c50 0x7fa9080cf1b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:44.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.857+0000 7fa90f9ff700 1 -- 172.21.15.37:0/559574663 >> 172.21.15.37:0/559574663 conn(0x7fa90806b150 msgr2=0x7fa90806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:44.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.857+0000 7fa90f9ff700 1 -- 172.21.15.37:0/559574663 shutdown_connections 2023-07-14T15:56:44.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.857+0000 7fa90f9ff700 1 -- 172.21.15.37:0/559574663 wait complete. 2023-07-14T15:56:44.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.859+0000 7fa90f9ff700 1 Processor -- start 2023-07-14T15:56:44.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.859+0000 7fa90f9ff700 1 -- start start 2023-07-14T15:56:44.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.860+0000 7fa90f9ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9080b8b80 0x7fa9080b47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:44.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.860+0000 7fa90f9ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9080cf8b0 0x7fa9080b2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:44.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.860+0000 7fa90f9ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa908160c50 0x7fa9080c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:44.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.860+0000 7fa90f9ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9080ca810 con 0x7fa9080cf8b0 2023-07-14T15:56:44.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.860+0000 7fa90f9ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9080c69d0 con 0x7fa9080b8b80 2023-07-14T15:56:44.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.860+0000 7fa90f9ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9080c6c70 con 0x7fa908160c50 2023-07-14T15:56:44.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.860+0000 7fa90cf9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9080cf8b0 0x7fa9080b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:44.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.860+0000 7fa90d79b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9080b8b80 0x7fa9080b47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:44.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.860+0000 7fa90cf9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9080cf8b0 0x7fa9080b2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46016/0 (socket says 172.21.15.37:46016) 2023-07-14T15:56:44.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.860+0000 7fa90cf9a700 1 -- 172.21.15.37:0/3662367898 learned_addr learned my addr 172.21.15.37:0/3662367898 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:44.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.860+0000 7fa90df9c700 1 --2- 172.21.15.37:0/3662367898 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa908160c50 0x7fa9080c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:44.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.861+0000 7fa90cf9a700 1 -- 172.21.15.37:0/3662367898 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa908160c50 msgr2=0x7fa9080c8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:44.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.861+0000 7fa90cf9a700 1 --2- 172.21.15.37:0/3662367898 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa908160c50 0x7fa9080c8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:44.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.861+0000 7fa90cf9a700 1 -- 172.21.15.37:0/3662367898 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9080b8b80 msgr2=0x7fa9080b47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:44.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.861+0000 7fa90cf9a700 1 --2- 172.21.15.37:0/3662367898 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9080b8b80 0x7fa9080b47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:44.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.861+0000 7fa90cf9a700 1 -- 172.21.15.37:0/3662367898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f8009550 con 0x7fa9080cf8b0 2023-07-14T15:56:44.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.861+0000 7fa90cf9a700 1 --2- 172.21.15.37:0/3662367898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9080cf8b0 0x7fa9080b2470 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa908066a70 tx=0x7fa8f8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:44.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.861+0000 7fa8fdffb700 1 -- 172.21.15.37:0/3662367898 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f8004300 con 0x7fa9080cf8b0 2023-07-14T15:56:44.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.861+0000 7fa8fdffb700 1 -- 172.21.15.37:0/3662367898 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f801f070 con 0x7fa9080cf8b0 2023-07-14T15:56:44.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.861+0000 7fa90f9ff700 1 -- 172.21.15.37:0/3662367898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9080b29b0 con 0x7fa9080cf8b0 2023-07-14T15:56:44.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.861+0000 7fa8fdffb700 1 -- 172.21.15.37:0/3662367898 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f80036a0 con 0x7fa9080cf8b0 2023-07-14T15:56:44.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.861+0000 7fa90f9ff700 1 -- 172.21.15.37:0/3662367898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9080b2f30 con 0x7fa9080cf8b0 2023-07-14T15:56:44.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.862+0000 7fa90f9ff700 1 -- 172.21.15.37:0/3662367898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa908067840 con 0x7fa9080cf8b0 2023-07-14T15:56:44.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.864+0000 7fa8fdffb700 1 -- 172.21.15.37:0/3662367898 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa8f8021030 con 0x7fa9080cf8b0 2023-07-14T15:56:44.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.865+0000 7fa8fdffb700 1 --2- 172.21.15.37:0/3662367898 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa8ec06ace0 0x7fa8ec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:44.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.865+0000 7fa8fdffb700 1 -- 172.21.15.37:0/3662367898 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa8f808ad40 con 0x7fa9080cf8b0 2023-07-14T15:56:44.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.865+0000 7fa90d79b700 1 --2- 172.21.15.37:0/3662367898 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa8ec06ace0 0x7fa8ec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:44.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.866+0000 7fa90d79b700 1 --2- 172.21.15.37:0/3662367898 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa8ec06ace0 0x7fa8ec06d190 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa904009b40 tx=0x7fa904009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:44.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:44.869+0000 7fa8fdffb700 1 -- 172.21.15.37:0/3662367898 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa8f8055de0 con 0x7fa9080cf8b0 2023-07-14T15:56:45.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.078+0000 7fa90f9ff700 1 -- 172.21.15.37:0/3662367898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9080b2040 con 0x7fa9080cf8b0 2023-07-14T15:56:45.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.080+0000 7fa8fdffb700 1 -- 172.21.15.37:0/3662367898 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18341 (secure 0 0 0) 0x7fa8f8015090 con 0x7fa9080cf8b0 2023-07-14T15:56:45.067 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:56:45.067 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"fsid":"9da30401-a779-4e46-aba6-00c2494c6c67","created":"2023-07-14T15:55:39.898867+0000","modified":"2023-07-14T15:56:09.959850+0000","last_up_change":"2023-07-14T15:55:53.025696+0000","last_in_change":"2023-07-14T15:55:43.388192+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T15:55:52.907261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T15:55:59.992839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T15:56:06.091064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T15:56:07.448694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d049535-7b87-4276-8fe5-0f74ba422d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6801","nonce":2783032392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6803","nonce":2783032392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6807","nonce":2783032392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6805","nonce":2783032392}]},"public_addr":"172.21.15.37:6801/2783032392","cluster_addr":"172.21.15.37:6803/2783032392","heartbeat_back_addr":"172.21.15.37:6807/2783032392","heartbeat_front_addr":"172.21.15.37:6805/2783032392","state":["exists","up"]},{"osd":1,"uuid":"79ec948d-ead2-4c2d-923a-dd6eeaac9dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6823","nonce":1190059746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6826","nonce":1190059746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6831","nonce":1190059746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6829","nonce":1190059746}]},"public_addr":"172.21.15.37:6823/1190059746","cluster_addr":"172.21.15.37:6826/1190059746","heartbeat_back_addr":"172.21.15.37:6831/1190059746","heartbeat_front_addr":"172.21.15.37:6829/1190059746","state":["exists","up"]},{"osd":2,"uuid":"a1db6690-c160-4366-9c82-2cca17e4bba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6809","nonce":2266223499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6813","nonce":2266223499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6820","nonce":2266223499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6816","nonce":2266223499}]},"public_addr":"172.21.15.37:6809/2266223499","cluster_addr":"172.21.15.37:6813/2266223499","heartbeat_back_addr":"172.21.15.37:6820/2266223499","heartbeat_front_addr":"172.21.15.37:6816/2266223499","state":["exists","up"]},{"osd":3,"uuid":"767b8220-e79a-4a86-a162-6b3b73198379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6812","nonce":4166694594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6817","nonce":4166694594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6828","nonce":4166694594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6822","nonce":4166694594}]},"public_addr":"172.21.15.37:6812/4166694594","cluster_addr":"172.21.15.37:6817/4166694594","heartbeat_back_addr":"172.21.15.37:6828/4166694594","heartbeat_front_addr":"172.21.15.37:6822/4166694594","state":["exists","up"]},{"osd":4,"uuid":"717bd773-ae7e-4236-ac79-900cf99a37c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6801","nonce":3529020407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6803","nonce":3529020407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6807","nonce":3529020407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6805","nonce":3529020407}]},"public_addr":"172.21.15.98:6801/3529020407","cluster_addr":"172.21.15.98:6803/3529020407","heartbeat_back_addr":"172.21.15.98:6807/3529020407","heartbeat_front_addr":"172.21.15.98:6805/3529020407","state":["exists","up"]},{"osd":5,"uuid":"a941d358-0f03-4136-a9b2-3a1c2e9358cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6817","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6819","nonce":2311501838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6821","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6823","nonce":2311501838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6829","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6831","nonce":2311501838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6825","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6827","nonce":2311501838}]},"public_addr":"172.21.15.98:6819/2311501838","cluster_addr":"172.21.15.98:6823/2311501838","heartbeat_back_addr":"172.21.15.98:6831/2311501838","heartbeat_front_addr":"172.21.15.98:6827/2311501838","state":["exists","up"]},{"osd":6,"uuid":"27153772-6d4b-479d-9953-0582e7b96743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6809","nonce":1144224691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6811","nonce":1144224691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6815","nonce":1144224691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6813","nonce":1144224691}]},"public_addr":"172.21.15.98:6809/1144224691","cluster_addr":"172.21.15.98:6811/1144224691","heartbeat_back_addr":"172.21.15.98:6815/1144224691","heartbeat_front_addr":"172.21.15.98:6813/1144224691","state":["exists","up"]},{"osd":7,"uuid":"d21ffc8e-40bb-47eb-af2c-e3e730d3fb76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6818","nonce":1144470927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6822","nonce":1144470927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6830","nonce":1144470927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6826","nonce":1144470927}]},"public_addr":"172.21.15.98:6818/1144470927","cluster_addr":"172.21.15.98:6822/1144470927","heartbeat_back_addr":"172.21.15.98:6830/1144470927","heartbeat_front_addr":"172.21.15.98:6826/1144470927","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.921114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.739210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.024016+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.002527+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.698127+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.813416+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.709351+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.815457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T15:56:45.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.082+0000 7fa90f9ff700 1 -- 172.21.15.37:0/3662367898 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa8ec06ace0 msgr2=0x7fa8ec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:45.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.082+0000 7fa90f9ff700 1 --2- 172.21.15.37:0/3662367898 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa8ec06ace0 0x7fa8ec06d190 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa904009b40 tx=0x7fa904009210 comp rx=0 tx=0).stop 2023-07-14T15:56:45.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.082+0000 7fa90f9ff700 1 -- 172.21.15.37:0/3662367898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9080cf8b0 msgr2=0x7fa9080b2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:45.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.082+0000 7fa90f9ff700 1 --2- 172.21.15.37:0/3662367898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9080cf8b0 0x7fa9080b2470 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa908066a70 tx=0x7fa8f8004750 comp rx=0 tx=0).stop 2023-07-14T15:56:45.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.082+0000 7fa90f9ff700 1 -- 172.21.15.37:0/3662367898 shutdown_connections 2023-07-14T15:56:45.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.082+0000 7fa90f9ff700 1 --2- 172.21.15.37:0/3662367898 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9080b8b80 0x7fa9080b47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:45.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.082+0000 7fa90f9ff700 1 --2- 172.21.15.37:0/3662367898 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa8ec06ace0 0x7fa8ec06d190 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:45.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.082+0000 7fa90f9ff700 1 --2- 172.21.15.37:0/3662367898 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa908160c50 0x7fa9080c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:45.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.082+0000 7fa90f9ff700 1 --2- 172.21.15.37:0/3662367898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9080cf8b0 0x7fa9080b2470 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:45.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.082+0000 7fa90f9ff700 1 -- 172.21.15.37:0/3662367898 >> 172.21.15.37:0/3662367898 conn(0x7fa90806b150 msgr2=0x7fa9080b7e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:45.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.082+0000 7fa90f9ff700 1 -- 172.21.15.37:0/3662367898 shutdown_connections 2023-07-14T15:56:45.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.082+0000 7fa90f9ff700 1 -- 172.21.15.37:0/3662367898 wait complete. 2023-07-14T15:56:45.087 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T15:55:52.907261+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T15:55:59.992839+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T15:56:06.091064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T15:56:07.448694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T15:56:45.088 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T15:56:45.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.306+0000 7f95bb9ff700 1 Processor -- start 2023-07-14T15:56:45.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.306+0000 7f95bb9ff700 1 -- start start 2023-07-14T15:56:45.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.307+0000 7f95bb9ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f95b415fee0 0x7f95b415ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:45.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.307+0000 7f95bb9ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f95b41603b0 0x7f95b40d0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:45.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.307+0000 7f95bb9ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95b40d13d0 con 0x7f95b40d0f70 2023-07-14T15:56:45.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.307+0000 7f95bb9ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95b415dc50 con 0x7f95b41603b0 2023-07-14T15:56:45.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.307+0000 7f95bb9ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b40b2940 con 0x7f95b415fee0 2023-07-14T15:56:45.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.307+0000 7f95b9f9c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f95b40d0f70 0x7f95b40b39e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35848/0 (socket says 172.21.15.37:35848) 2023-07-14T15:56:45.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.307+0000 7f95b9f9c700 1 -- 172.21.15.37:0/4289334561 learned_addr learned my addr 172.21.15.37:0/4289334561 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:45.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.307+0000 7f95b8f9a700 1 --2- 172.21.15.37:0/4289334561 >> v2:172.21.15.98:3300/0 conn(0x7f95b41603b0 0x7f95b40d0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:45.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.307+0000 7f95b979b700 1 --2- 172.21.15.37:0/4289334561 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f95b415fee0 0x7f95b415ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:45.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.308+0000 7f95abfff700 1 -- 172.21.15.37:0/4289334561 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3697406170 0 0) 0x7f95b40d13d0 con 0x7f95b40d0f70 2023-07-14T15:56:45.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.308+0000 7f95abfff700 1 -- 172.21.15.37:0/4289334561 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95a00035b0 con 0x7f95b40d0f70 2023-07-14T15:56:45.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.308+0000 7f95b8f9a700 1 -- 172.21.15.37:0/4289334561 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f95b415fee0 msgr2=0x7f95b415ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:45.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.308+0000 7f95b8f9a700 1 --2- 172.21.15.37:0/4289334561 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f95b415fee0 0x7f95b415ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:45.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.308+0000 7f95b8f9a700 1 -- 172.21.15.37:0/4289334561 >> v1:172.21.15.37:6789/0 conn(0x7f95b40d0f70 legacy=0x7f95b40b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:45.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.308+0000 7f95b8f9a700 1 -- 172.21.15.37:0/4289334561 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b40b2c20 con 0x7f95b41603b0 2023-07-14T15:56:45.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.308+0000 7f95b8f9a700 1 --2- 172.21.15.37:0/4289334561 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95b41603b0 0x7f95b40d0a30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f95a4009840 tx=0x7f95a4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ffb966bfcb321ad server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:45.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.308+0000 7f95abfff700 1 -- 172.21.15.37:0/4289334561 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a4011830 con 0x7f95b41603b0 2023-07-14T15:56:45.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.308+0000 7f95abfff700 1 -- 172.21.15.37:0/4289334561 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a4011990 con 0x7f95b41603b0 2023-07-14T15:56:45.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.309+0000 7f95abfff700 1 -- 172.21.15.37:0/4289334561 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a4011d20 con 0x7f95b41603b0 2023-07-14T15:56:45.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.309+0000 7f95bb9ff700 1 -- 172.21.15.37:0/4289334561 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95b41603b0 msgr2=0x7f95b40d0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:45.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.309+0000 7f95bb9ff700 1 --2- 172.21.15.37:0/4289334561 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95b41603b0 0x7f95b40d0a30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f95a4009840 tx=0x7f95a4009b50 comp rx=0 tx=0).stop 2023-07-14T15:56:45.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.309+0000 7f95bb9ff700 1 -- 172.21.15.37:0/4289334561 shutdown_connections 2023-07-14T15:56:45.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.309+0000 7f95bb9ff700 1 --2- 172.21.15.37:0/4289334561 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f95b415fee0 0x7f95b415ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:45.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.309+0000 7f95bb9ff700 1 --2- 172.21.15.37:0/4289334561 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95b41603b0 0x7f95b40d0a30 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:45.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.309+0000 7f95bb9ff700 1 -- 172.21.15.37:0/4289334561 >> 172.21.15.37:0/4289334561 conn(0x7f95b409c1b0 msgr2=0x7f95b40d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:45.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.309+0000 7f95bb9ff700 1 -- 172.21.15.37:0/4289334561 shutdown_connections 2023-07-14T15:56:45.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.309+0000 7f95bb9ff700 1 -- 172.21.15.37:0/4289334561 wait complete. 2023-07-14T15:56:45.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.311+0000 7f95bb9ff700 1 Processor -- start 2023-07-14T15:56:45.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.311+0000 7f95bb9ff700 1 -- start start 2023-07-14T15:56:45.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.312+0000 7f95bb9ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95b40d0f70 0x7f95b40b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:45.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.312+0000 7f95bb9ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f95b415fee0 0x7f95b414e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:45.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.312+0000 7f95bb9ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95b41603b0 0x7f95b414b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:45.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.312+0000 7f95bb9ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b40b6f30 con 0x7f95b41603b0 2023-07-14T15:56:45.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.312+0000 7f95bb9ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b414ba70 con 0x7f95b40d0f70 2023-07-14T15:56:45.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.312+0000 7f95bb9ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b40b6320 con 0x7f95b415fee0 2023-07-14T15:56:45.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.312+0000 7f95b9f9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95b41603b0 0x7f95b414b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:45.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.312+0000 7f95b979b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95b40d0f70 0x7f95b40b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:45.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.312+0000 7f95b8f9a700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f95b415fee0 0x7f95b414e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:45.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.312+0000 7f95b9f9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95b41603b0 0x7f95b414b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46026/0 (socket says 172.21.15.37:46026) 2023-07-14T15:56:45.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.313+0000 7f95b9f9c700 1 -- 172.21.15.37:0/4079000321 learned_addr learned my addr 172.21.15.37:0/4079000321 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:45.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.313+0000 7f95b9f9c700 1 -- 172.21.15.37:0/4079000321 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f95b415fee0 msgr2=0x7f95b414e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:45.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.313+0000 7f95b9f9c700 1 --2- 172.21.15.37:0/4079000321 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f95b415fee0 0x7f95b414e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:45.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.313+0000 7f95b9f9c700 1 -- 172.21.15.37:0/4079000321 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95b40d0f70 msgr2=0x7f95b40b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:45.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.313+0000 7f95b9f9c700 1 --2- 172.21.15.37:0/4079000321 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95b40d0f70 0x7f95b40b5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:45.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.313+0000 7f95b9f9c700 1 -- 172.21.15.37:0/4079000321 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a40094a0 con 0x7f95b41603b0 2023-07-14T15:56:45.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.313+0000 7f95b9f9c700 1 --2- 172.21.15.37:0/4079000321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95b41603b0 0x7f95b414b530 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f95ac00cb40 tx=0x7f95ac00ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:45.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.313+0000 7f95a9ffb700 1 -- 172.21.15.37:0/4079000321 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ac00a980 con 0x7f95b41603b0 2023-07-14T15:56:45.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.313+0000 7f95a9ffb700 1 -- 172.21.15.37:0/4079000321 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95ac00aae0 con 0x7f95b41603b0 2023-07-14T15:56:45.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.313+0000 7f95a9ffb700 1 -- 172.21.15.37:0/4079000321 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ac00ae50 con 0x7f95b41603b0 2023-07-14T15:56:45.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.313+0000 7f95bb9ff700 1 -- 172.21.15.37:0/4079000321 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95b40b6600 con 0x7f95b41603b0 2023-07-14T15:56:45.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.314+0000 7f95bb9ff700 1 -- 172.21.15.37:0/4079000321 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95b40b6bc0 con 0x7f95b41603b0 2023-07-14T15:56:45.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.315+0000 7f95bb9ff700 1 -- 172.21.15.37:0/4079000321 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95b4067840 con 0x7f95b41603b0 2023-07-14T15:56:45.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.315+0000 7f95a9ffb700 1 -- 172.21.15.37:0/4079000321 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f95ac01b3b0 con 0x7f95b41603b0 2023-07-14T15:56:45.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.316+0000 7f95a9ffb700 1 --2- 172.21.15.37:0/4079000321 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f959806ace0 0x7f959806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:45.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.316+0000 7f95a9ffb700 1 -- 172.21.15.37:0/4079000321 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f95ac089070 con 0x7f95b41603b0 2023-07-14T15:56:45.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.317+0000 7f95b979b700 1 --2- 172.21.15.37:0/4079000321 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f959806ace0 0x7f959806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:45.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.317+0000 7f95b979b700 1 --2- 172.21.15.37:0/4079000321 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f959806ace0 0x7f959806d190 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f95b0009be0 tx=0x7f95b0009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:45.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.321+0000 7f95a9ffb700 1 -- 172.21.15.37:0/4079000321 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f95ac0bb330 con 0x7f95b41603b0 2023-07-14T15:56:45.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.527+0000 7f95bb9ff700 1 -- 172.21.15.37:0/4079000321 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f95b40b7070 con 0x7f95b41603b0 2023-07-14T15:56:45.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.528+0000 7f95a9ffb700 1 -- 172.21.15.37:0/4079000321 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f95ac017020 con 0x7f95b41603b0 2023-07-14T15:56:45.515 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-14T15:56:45.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.530+0000 7f95bb9ff700 1 -- 172.21.15.37:0/4079000321 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f959806ace0 msgr2=0x7f959806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:45.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.530+0000 7f95bb9ff700 1 --2- 172.21.15.37:0/4079000321 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f959806ace0 0x7f959806d190 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f95b0009be0 tx=0x7f95b0009210 comp rx=0 tx=0).stop 2023-07-14T15:56:45.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.530+0000 7f95bb9ff700 1 -- 172.21.15.37:0/4079000321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95b41603b0 msgr2=0x7f95b414b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:45.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.530+0000 7f95bb9ff700 1 --2- 172.21.15.37:0/4079000321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95b41603b0 0x7f95b414b530 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f95ac00cb40 tx=0x7f95ac00ce50 comp rx=0 tx=0).stop 2023-07-14T15:56:45.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.530+0000 7f95bb9ff700 1 -- 172.21.15.37:0/4079000321 shutdown_connections 2023-07-14T15:56:45.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.530+0000 7f95bb9ff700 1 --2- 172.21.15.37:0/4079000321 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95b40d0f70 0x7f95b40b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:45.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.530+0000 7f95bb9ff700 1 --2- 172.21.15.37:0/4079000321 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f959806ace0 0x7f959806d190 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:45.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.530+0000 7f95bb9ff700 1 --2- 172.21.15.37:0/4079000321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95b41603b0 0x7f95b414b530 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:45.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.530+0000 7f95bb9ff700 1 --2- 172.21.15.37:0/4079000321 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f95b415fee0 0x7f95b414e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:45.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.530+0000 7f95bb9ff700 1 -- 172.21.15.37:0/4079000321 >> 172.21.15.37:0/4079000321 conn(0x7f95b409c1b0 msgr2=0x7f95b40b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:45.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.530+0000 7f95bb9ff700 1 -- 172.21.15.37:0/4079000321 shutdown_connections 2023-07-14T15:56:45.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.530+0000 7f95bb9ff700 1 -- 172.21.15.37:0/4079000321 wait complete. 2023-07-14T15:56:45.535 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T15:56:45.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.757+0000 7f98255ff700 1 Processor -- start 2023-07-14T15:56:45.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.757+0000 7f98255ff700 1 -- start start 2023-07-14T15:56:45.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.758+0000 7f98255ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f982015c8a0 0x7f98200d0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:45.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.758+0000 7f98255ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f98200b1ad0 0x7f98200d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:45.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.758+0000 7f98255ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98200b2f00 con 0x7f98200b3390 2023-07-14T15:56:45.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.758+0000 7f98255ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98200b2010 con 0x7f982015c8a0 2023-07-14T15:56:45.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.758+0000 7f98255ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98200b22f0 con 0x7f98200b1ad0 2023-07-14T15:56:45.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.759+0000 7f981e7fc700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f98200b1ad0 0x7f98200d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:45.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.759+0000 7f981e7fc700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f98200b1ad0 0x7f98200d10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3301/0 says I am v2:172.21.15.37:39182/0 (socket says 172.21.15.37:39182) 2023-07-14T15:56:45.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.759+0000 7f981e7fc700 1 -- 172.21.15.37:0/3754892004 learned_addr learned my addr 172.21.15.37:0/3754892004 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:45.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.759+0000 7f981f7fe700 1 --1- 172.21.15.37:0/3754892004 >> v1:172.21.15.98:6789/0 conn(0x7f98200b3390 0x7f98200b3810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.37:41662/0 (socket says 172.21.15.37:41662) 2023-07-14T15:56:45.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.759+0000 7f981effd700 1 --2- 172.21.15.37:0/3754892004 >> v2:172.21.15.98:3300/0 conn(0x7f982015c8a0 0x7f98200d0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:45.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.759+0000 7f981dffb700 1 -- 172.21.15.37:0/3754892004 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1463451545 0 0) 0x7f98200b2f00 con 0x7f98200b3390 2023-07-14T15:56:45.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.759+0000 7f981dffb700 1 -- 172.21.15.37:0/3754892004 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98080035b0 con 0x7f98200b3390 2023-07-14T15:56:45.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.759+0000 7f981e7fc700 1 -- 172.21.15.37:0/3754892004 >> v2:172.21.15.98:3300/0 conn(0x7f982015c8a0 msgr2=0x7f98200d0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:45.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.759+0000 7f981e7fc700 1 --2- 172.21.15.37:0/3754892004 >> v2:172.21.15.98:3300/0 conn(0x7f982015c8a0 0x7f98200d0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:45.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.759+0000 7f981e7fc700 1 -- 172.21.15.37:0/3754892004 >> v1:172.21.15.98:6789/0 conn(0x7f98200b3390 legacy=0x7f98200b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:45.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.759+0000 7f981e7fc700 1 -- 172.21.15.37:0/3754892004 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98200b25d0 con 0x7f98200b1ad0 2023-07-14T15:56:45.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.759+0000 7f981effd700 1 --2- 172.21.15.37:0/3754892004 >> v2:172.21.15.98:3300/0 conn(0x7f982015c8a0 0x7f98200d0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:56:45.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.760+0000 7f981e7fc700 1 --2- 172.21.15.37:0/3754892004 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f98200b1ad0 0x7f98200d10d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f98140098f0 tx=0x7f9814009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4349518ff82b0db server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:45.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.760+0000 7f981dffb700 1 -- 172.21.15.37:0/3754892004 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9814011830 con 0x7f98200b1ad0 2023-07-14T15:56:45.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.760+0000 7f981dffb700 1 -- 172.21.15.37:0/3754892004 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9814011990 con 0x7f98200b1ad0 2023-07-14T15:56:45.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.760+0000 7f981dffb700 1 -- 172.21.15.37:0/3754892004 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9814011d20 con 0x7f98200b1ad0 2023-07-14T15:56:45.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.760+0000 7f98255ff700 1 -- 172.21.15.37:0/3754892004 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f98200b1ad0 msgr2=0x7f98200d10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:45.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.760+0000 7f98255ff700 1 --2- 172.21.15.37:0/3754892004 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f98200b1ad0 0x7f98200d10d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f98140098f0 tx=0x7f9814009c00 comp rx=0 tx=0).stop 2023-07-14T15:56:45.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.761+0000 7f98255ff700 1 -- 172.21.15.37:0/3754892004 shutdown_connections 2023-07-14T15:56:45.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.761+0000 7f98255ff700 1 --2- 172.21.15.37:0/3754892004 >> v2:172.21.15.98:3300/0 conn(0x7f982015c8a0 0x7f98200d0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:45.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.761+0000 7f98255ff700 1 --2- 172.21.15.37:0/3754892004 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f98200b1ad0 0x7f98200d10d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:45.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.761+0000 7f98255ff700 1 -- 172.21.15.37:0/3754892004 >> 172.21.15.37:0/3754892004 conn(0x7f982009c190 msgr2=0x7f98200d2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:45.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.761+0000 7f98255ff700 1 -- 172.21.15.37:0/3754892004 shutdown_connections 2023-07-14T15:56:45.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.761+0000 7f98255ff700 1 -- 172.21.15.37:0/3754892004 wait complete. 2023-07-14T15:56:45.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.762+0000 7f98255ff700 1 Processor -- start 2023-07-14T15:56:45.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.763+0000 7f98255ff700 1 -- start start 2023-07-14T15:56:45.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.764+0000 7f98255ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98200b1ad0 0x7f98200cf850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:45.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.764+0000 7f98255ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98200b3390 0x7f98200c7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:45.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.764+0000 7f98255ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f982015c8a0 0x7f98200c8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:45.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.764+0000 7f98255ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98200cbf50 con 0x7f98200b3390 2023-07-14T15:56:45.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.764+0000 7f98255ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98200b5e90 con 0x7f98200b1ad0 2023-07-14T15:56:45.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.764+0000 7f98255ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98200cc1a0 con 0x7f982015c8a0 2023-07-14T15:56:45.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.764+0000 7f981e7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98200b3390 0x7f98200c7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:45.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.764+0000 7f981e7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98200b3390 0x7f98200c7b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46038/0 (socket says 172.21.15.37:46038) 2023-07-14T15:56:45.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.764+0000 7f981e7fc700 1 -- 172.21.15.37:0/3007097392 learned_addr learned my addr 172.21.15.37:0/3007097392 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:45.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.764+0000 7f981effd700 1 --2- 172.21.15.37:0/3007097392 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98200b1ad0 0x7f98200cf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:45.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.764+0000 7f981f7fe700 1 --2- 172.21.15.37:0/3007097392 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f982015c8a0 0x7f98200c8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:45.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.764+0000 7f981e7fc700 1 -- 172.21.15.37:0/3007097392 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f982015c8a0 msgr2=0x7f98200c8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:45.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.764+0000 7f981e7fc700 1 --2- 172.21.15.37:0/3007097392 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f982015c8a0 0x7f98200c8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:45.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.764+0000 7f981e7fc700 1 -- 172.21.15.37:0/3007097392 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98200b1ad0 msgr2=0x7f98200cf850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:45.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.764+0000 7f981e7fc700 1 --2- 172.21.15.37:0/3007097392 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98200b1ad0 0x7f98200cf850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:45.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.764+0000 7f981e7fc700 1 -- 172.21.15.37:0/3007097392 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98100094a0 con 0x7f98200b3390 2023-07-14T15:56:45.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.765+0000 7f981e7fc700 1 --2- 172.21.15.37:0/3007097392 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98200b3390 0x7f98200c7b20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9814000c00 tx=0x7f9814004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:45.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.765+0000 7f98077fe700 1 -- 172.21.15.37:0/3007097392 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9814004300 con 0x7f98200b3390 2023-07-14T15:56:45.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.765+0000 7f98077fe700 1 -- 172.21.15.37:0/3007097392 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981401f070 con 0x7f98200b3390 2023-07-14T15:56:45.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.765+0000 7f98077fe700 1 -- 172.21.15.37:0/3007097392 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98140036a0 con 0x7f98200b3390 2023-07-14T15:56:45.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.765+0000 7f98255ff700 1 -- 172.21.15.37:0/3007097392 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9814009550 con 0x7f98200b3390 2023-07-14T15:56:45.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.765+0000 7f98255ff700 1 -- 172.21.15.37:0/3007097392 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98200cc760 con 0x7f98200b3390 2023-07-14T15:56:45.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.766+0000 7f98255ff700 1 -- 172.21.15.37:0/3007097392 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98200b6060 con 0x7f98200b3390 2023-07-14T15:56:45.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.767+0000 7f98077fe700 1 -- 172.21.15.37:0/3007097392 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9814021030 con 0x7f98200b3390 2023-07-14T15:56:45.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.768+0000 7f98077fe700 1 --2- 172.21.15.37:0/3007097392 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f980c06ace0 0x7f980c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:45.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.768+0000 7f98077fe700 1 -- 172.21.15.37:0/3007097392 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f981408a7e0 con 0x7f98200b3390 2023-07-14T15:56:45.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.769+0000 7f981effd700 1 --2- 172.21.15.37:0/3007097392 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f980c06ace0 0x7f980c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:45.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.769+0000 7f981effd700 1 --2- 172.21.15.37:0/3007097392 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f980c06ace0 0x7f980c06d190 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9810009cd0 tx=0x7f9810009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:45.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.773+0000 7f98077fe700 1 -- 172.21.15.37:0/3007097392 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f98200b6060 con 0x7f98200b3390 2023-07-14T15:56:45.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.981+0000 7f98255ff700 1 -- 172.21.15.37:0/3007097392 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f98200d0830 con 0x7f98200b3390 2023-07-14T15:56:45.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.982+0000 7f98077fe700 1 -- 172.21.15.37:0/3007097392 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9814055800 con 0x7f98200b3390 2023-07-14T15:56:45.969 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-14T15:56:45.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.984+0000 7f98255ff700 1 -- 172.21.15.37:0/3007097392 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f980c06ace0 msgr2=0x7f980c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:45.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.984+0000 7f98255ff700 1 --2- 172.21.15.37:0/3007097392 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f980c06ace0 0x7f980c06d190 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9810009cd0 tx=0x7f9810009210 comp rx=0 tx=0).stop 2023-07-14T15:56:45.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.984+0000 7f98255ff700 1 -- 172.21.15.37:0/3007097392 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98200b3390 msgr2=0x7f98200c7b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:45.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.984+0000 7f98255ff700 1 --2- 172.21.15.37:0/3007097392 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98200b3390 0x7f98200c7b20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9814000c00 tx=0x7f9814004750 comp rx=0 tx=0).stop 2023-07-14T15:56:45.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.984+0000 7f98255ff700 1 -- 172.21.15.37:0/3007097392 shutdown_connections 2023-07-14T15:56:45.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.984+0000 7f98255ff700 1 --2- 172.21.15.37:0/3007097392 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98200b1ad0 0x7f98200cf850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:45.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.984+0000 7f98255ff700 1 --2- 172.21.15.37:0/3007097392 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f980c06ace0 0x7f980c06d190 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:45.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.984+0000 7f98255ff700 1 --2- 172.21.15.37:0/3007097392 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f982015c8a0 0x7f98200c8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:45.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.984+0000 7f98255ff700 1 --2- 172.21.15.37:0/3007097392 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98200b3390 0x7f98200c7b20 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:45.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.984+0000 7f98255ff700 1 -- 172.21.15.37:0/3007097392 >> 172.21.15.37:0/3007097392 conn(0x7f982009c190 msgr2=0x7f98200d2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:45.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.984+0000 7f98255ff700 1 -- 172.21.15.37:0/3007097392 shutdown_connections 2023-07-14T15:56:45.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:45.984+0000 7f98255ff700 1 -- 172.21.15.37:0/3007097392 wait complete. 2023-07-14T15:56:45.989 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T15:56:46.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.208+0000 7f5a06dff700 1 Processor -- start 2023-07-14T15:56:46.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.208+0000 7f5a06dff700 1 -- start start 2023-07-14T15:56:46.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.209+0000 7f5a06dff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f5a0006d290 0x7f5a00165070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:46.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.209+0000 7f5a06dff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a000707f0 con 0x7f5a00071820 2023-07-14T15:56:46.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.209+0000 7f5a06dff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a00070a60 con 0x7f5a000cb430 2023-07-14T15:56:46.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.209+0000 7f5a06dff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a00070d40 con 0x7f5a0006d290 2023-07-14T15:56:46.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.209+0000 7f59fffff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5a00071820 0x7f5a0006cb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35854/0 (socket says 172.21.15.37:35854) 2023-07-14T15:56:46.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.209+0000 7f59fffff700 1 -- 172.21.15.37:0/232522643 learned_addr learned my addr 172.21.15.37:0/232522643 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:46.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.209+0000 7f5a0539c700 1 --2- 172.21.15.37:0/232522643 >> v2:172.21.15.98:3300/0 conn(0x7f5a0006d290 0x7f5a00165070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:46.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.210+0000 7f59ff7fe700 1 -- 172.21.15.37:0/232522643 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4113146208 0 0) 0x7f5a000707f0 con 0x7f5a00071820 2023-07-14T15:56:46.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.210+0000 7f59ff7fe700 1 -- 172.21.15.37:0/232522643 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59f00035b0 con 0x7f5a00071820 2023-07-14T15:56:46.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.210+0000 7f59ff7fe700 1 -- 172.21.15.37:0/232522643 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3072747248 0 0) 0x7f5a00070a60 con 0x7f5a000cb430 2023-07-14T15:56:46.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.210+0000 7f59ff7fe700 1 -- 172.21.15.37:0/232522643 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a000707f0 con 0x7f5a000cb430 2023-07-14T15:56:46.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.210+0000 7f5a0539c700 1 -- 172.21.15.37:0/232522643 >> v1:172.21.15.98:6789/0 conn(0x7f5a000cb430 legacy=0x7f5a000cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:46.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.210+0000 7f5a0539c700 1 -- 172.21.15.37:0/232522643 >> v1:172.21.15.37:6789/0 conn(0x7f5a00071820 legacy=0x7f5a0006cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:46.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.210+0000 7f59ff7fe700 1 -- 172.21.15.37:0/232522643 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4180833840 0 0) 0x7f59f00035b0 con 0x7f5a00071820 2023-07-14T15:56:46.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.210+0000 7f5a0539c700 1 -- 172.21.15.37:0/232522643 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a00071020 con 0x7f5a0006d290 2023-07-14T15:56:46.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.210+0000 7f5a0539c700 1 --2- 172.21.15.37:0/232522643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a0006d290 0x7f5a00165070 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f59f8009d90 tx=0x7f59f800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce156b190802241b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:46.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.210+0000 7f59ff7fe700 1 -- 172.21.15.37:0/232522643 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f800e070 con 0x7f5a0006d290 2023-07-14T15:56:46.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.210+0000 7f59ff7fe700 1 -- 172.21.15.37:0/232522643 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f8003a20 con 0x7f5a0006d290 2023-07-14T15:56:46.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.211+0000 7f59ff7fe700 1 -- 172.21.15.37:0/232522643 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ec001670 con 0x7f5a0006d290 2023-07-14T15:56:46.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.211+0000 7f5a06dff700 1 -- 172.21.15.37:0/232522643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a0006d290 msgr2=0x7f5a00165070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:46.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.211+0000 7f5a06dff700 1 --2- 172.21.15.37:0/232522643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a0006d290 0x7f5a00165070 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f59f8009d90 tx=0x7f59f800b330 comp rx=0 tx=0).stop 2023-07-14T15:56:46.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.211+0000 7f5a06dff700 1 -- 172.21.15.37:0/232522643 shutdown_connections 2023-07-14T15:56:46.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.211+0000 7f5a06dff700 1 --2- 172.21.15.37:0/232522643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a0006d290 0x7f5a00165070 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:46.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.211+0000 7f5a06dff700 1 -- 172.21.15.37:0/232522643 >> 172.21.15.37:0/232522643 conn(0x7f5a0006aac0 msgr2=0x7f5a000b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:46.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.211+0000 7f5a06dff700 1 -- 172.21.15.37:0/232522643 shutdown_connections 2023-07-14T15:56:46.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.211+0000 7f5a06dff700 1 -- 172.21.15.37:0/232522643 wait complete. 2023-07-14T15:56:46.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.213+0000 7f5a06dff700 1 Processor -- start 2023-07-14T15:56:46.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.213+0000 7f5a06dff700 1 -- start start 2023-07-14T15:56:46.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.215+0000 7f5a06dff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a0006d290 0x7f5a001544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:46.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.215+0000 7f5a06dff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a00071820 0x7f5a00153bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:46.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.215+0000 7f5a06dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5a000cb430 0x7f5a00152c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:46.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.215+0000 7f5a06dff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a00152200 con 0x7f5a0006d290 2023-07-14T15:56:46.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.215+0000 7f5a06dff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a00154100 con 0x7f5a00071820 2023-07-14T15:56:46.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.215+0000 7f5a06dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a00154b50 con 0x7f5a000cb430 2023-07-14T15:56:46.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.215+0000 7f5a04b9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a0006d290 0x7f5a001544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:46.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.215+0000 7f5a04b9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a0006d290 0x7f5a001544c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46040/0 (socket says 172.21.15.37:46040) 2023-07-14T15:56:46.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.215+0000 7f5a04b9b700 1 -- 172.21.15.37:0/3921413306 learned_addr learned my addr 172.21.15.37:0/3921413306 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:46.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.215+0000 7f59fffff700 1 --2- 172.21.15.37:0/3921413306 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a00071820 0x7f5a00153bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:46.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.215+0000 7f5a0539c700 1 --2- 172.21.15.37:0/3921413306 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5a000cb430 0x7f5a00152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:46.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.215+0000 7f5a04b9b700 1 -- 172.21.15.37:0/3921413306 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5a000cb430 msgr2=0x7f5a00152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:46.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.215+0000 7f5a04b9b700 1 --2- 172.21.15.37:0/3921413306 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5a000cb430 0x7f5a00152c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:46.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.215+0000 7f5a04b9b700 1 -- 172.21.15.37:0/3921413306 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a00071820 msgr2=0x7f5a00153bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:46.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.215+0000 7f5a04b9b700 1 --2- 172.21.15.37:0/3921413306 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a00071820 0x7f5a00153bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:46.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.215+0000 7f5a04b9b700 1 -- 172.21.15.37:0/3921413306 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f8009a70 con 0x7f5a0006d290 2023-07-14T15:56:46.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.215+0000 7f5a04b9b700 1 --2- 172.21.15.37:0/3921413306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a0006d290 0x7f5a001544c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f59f400c500 tx=0x7f59f400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:46.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.215+0000 7f59fd7fa700 1 -- 172.21.15.37:0/3921413306 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f40052d0 con 0x7f5a0006d290 2023-07-14T15:56:46.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.215+0000 7f59fd7fa700 1 -- 172.21.15.37:0/3921413306 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f4005450 con 0x7f5a0006d290 2023-07-14T15:56:46.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.215+0000 7f5a06dff700 1 -- 172.21.15.37:0/3921413306 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a00154e30 con 0x7f5a0006d290 2023-07-14T15:56:46.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.215+0000 7f59fd7fa700 1 -- 172.21.15.37:0/3921413306 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f40038c0 con 0x7f5a0006d290 2023-07-14T15:56:46.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.215+0000 7f5a06dff700 1 -- 172.21.15.37:0/3921413306 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a00152730 con 0x7f5a0006d290 2023-07-14T15:56:46.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.216+0000 7f5a06dff700 1 -- 172.21.15.37:0/3921413306 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a000ca640 con 0x7f5a0006d290 2023-07-14T15:56:46.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.217+0000 7f59fd7fa700 1 -- 172.21.15.37:0/3921413306 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f59f4003a20 con 0x7f5a0006d290 2023-07-14T15:56:46.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.218+0000 7f59fd7fa700 1 --2- 172.21.15.37:0/3921413306 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f59e406ace0 0x7f59e406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:46.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.219+0000 7f59fd7fa700 1 -- 172.21.15.37:0/3921413306 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f59f40888b0 con 0x7f5a0006d290 2023-07-14T15:56:46.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.219+0000 7f59fffff700 1 --2- 172.21.15.37:0/3921413306 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f59e406ace0 0x7f59e406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:46.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.220+0000 7f59fffff700 1 --2- 172.21.15.37:0/3921413306 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f59e406ace0 0x7f59e406d190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5a001556a0 tx=0x7f59ec000ed0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:46.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.222+0000 7f59fd7fa700 1 -- 172.21.15.37:0/3921413306 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f59f40538c0 con 0x7f5a0006d290 2023-07-14T15:56:46.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.428+0000 7f5a06dff700 1 -- 172.21.15.37:0/3921413306 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5a00067840 con 0x7f5a0006d290 2023-07-14T15:56:46.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.429+0000 7f59fd7fa700 1 -- 172.21.15.37:0/3921413306 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f59f4056ee0 con 0x7f5a0006d290 2023-07-14T15:56:46.415 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-14T15:56:46.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.431+0000 7f5a06dff700 1 -- 172.21.15.37:0/3921413306 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f59e406ace0 msgr2=0x7f59e406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:46.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.431+0000 7f5a06dff700 1 --2- 172.21.15.37:0/3921413306 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f59e406ace0 0x7f59e406d190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5a001556a0 tx=0x7f59ec000ed0 comp rx=0 tx=0).stop 2023-07-14T15:56:46.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.431+0000 7f5a06dff700 1 -- 172.21.15.37:0/3921413306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a0006d290 msgr2=0x7f5a001544c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:46.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.431+0000 7f5a06dff700 1 --2- 172.21.15.37:0/3921413306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a0006d290 0x7f5a001544c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f59f400c500 tx=0x7f59f400c810 comp rx=0 tx=0).stop 2023-07-14T15:56:46.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.431+0000 7f5a06dff700 1 -- 172.21.15.37:0/3921413306 shutdown_connections 2023-07-14T15:56:46.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.431+0000 7f5a06dff700 1 --2- 172.21.15.37:0/3921413306 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f59e406ace0 0x7f59e406d190 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:46.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.431+0000 7f5a06dff700 1 --2- 172.21.15.37:0/3921413306 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5a000cb430 0x7f5a00152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:46.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.431+0000 7f5a06dff700 1 --2- 172.21.15.37:0/3921413306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a0006d290 0x7f5a001544c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:46.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.431+0000 7f5a06dff700 1 --2- 172.21.15.37:0/3921413306 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a00071820 0x7f5a00153bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:46.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.431+0000 7f5a06dff700 1 -- 172.21.15.37:0/3921413306 >> 172.21.15.37:0/3921413306 conn(0x7f5a0006aac0 msgr2=0x7f5a00159780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:46.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.431+0000 7f5a06dff700 1 -- 172.21.15.37:0/3921413306 shutdown_connections 2023-07-14T15:56:46.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.431+0000 7f5a06dff700 1 -- 172.21.15.37:0/3921413306 wait complete. 2023-07-14T15:56:46.437 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T15:56:46.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.656+0000 7ffb99dff700 1 Processor -- start 2023-07-14T15:56:46.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.656+0000 7ffb99dff700 1 -- start start 2023-07-14T15:56:46.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.656+0000 7ffb99dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ffb9415fee0 0x7ffb9415ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:46.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.656+0000 7ffb99dff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb9415dc50 con 0x7ffb940d1140 2023-07-14T15:56:46.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.656+0000 7ffb99dff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb940b2940 con 0x7ffb941603b0 2023-07-14T15:56:46.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.656+0000 7ffb99dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb940b2c20 con 0x7ffb9415fee0 2023-07-14T15:56:46.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.657+0000 7ffb937fe700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ffb9415fee0 0x7ffb9415ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:46.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.657+0000 7ffb93fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ffb940d1140 0x7ffb940b39e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35858/0 (socket says 172.21.15.37:35858) 2023-07-14T15:56:46.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.657+0000 7ffb93fff700 1 -- 172.21.15.37:0/2201091323 learned_addr learned my addr 172.21.15.37:0/2201091323 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:46.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.657+0000 7ffb927fc700 1 -- 172.21.15.37:0/2201091323 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4184399839 0 0) 0x7ffb940b2940 con 0x7ffb941603b0 2023-07-14T15:56:46.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.657+0000 7ffb937fe700 1 -- 172.21.15.37:0/2201091323 >> v1:172.21.15.98:6789/0 conn(0x7ffb941603b0 legacy=0x7ffb940d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:46.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.657+0000 7ffb937fe700 1 -- 172.21.15.37:0/2201091323 >> v1:172.21.15.37:6789/0 conn(0x7ffb940d1140 legacy=0x7ffb940b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:46.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.657+0000 7ffb937fe700 1 -- 172.21.15.37:0/2201091323 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb940b2f00 con 0x7ffb9415fee0 2023-07-14T15:56:46.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.657+0000 7ffb937fe700 1 --2- 172.21.15.37:0/2201091323 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ffb9415fee0 0x7ffb9415ded0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ffb84009870 tx=0x7ffb84009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=199ee491b6e52423 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:46.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.658+0000 7ffb927fc700 1 -- 172.21.15.37:0/2201091323 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb84004230 con 0x7ffb9415fee0 2023-07-14T15:56:46.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.658+0000 7ffb927fc700 1 -- 172.21.15.37:0/2201091323 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb84004390 con 0x7ffb9415fee0 2023-07-14T15:56:46.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.658+0000 7ffb927fc700 1 -- 172.21.15.37:0/2201091323 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb840036a0 con 0x7ffb9415fee0 2023-07-14T15:56:46.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.658+0000 7ffb99dff700 1 -- 172.21.15.37:0/2201091323 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ffb9415fee0 msgr2=0x7ffb9415ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:46.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.658+0000 7ffb99dff700 1 --2- 172.21.15.37:0/2201091323 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ffb9415fee0 0x7ffb9415ded0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ffb84009870 tx=0x7ffb84009b80 comp rx=0 tx=0).stop 2023-07-14T15:56:46.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.658+0000 7ffb99dff700 1 -- 172.21.15.37:0/2201091323 shutdown_connections 2023-07-14T15:56:46.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.658+0000 7ffb99dff700 1 --2- 172.21.15.37:0/2201091323 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ffb9415fee0 0x7ffb9415ded0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:46.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.658+0000 7ffb99dff700 1 -- 172.21.15.37:0/2201091323 >> 172.21.15.37:0/2201091323 conn(0x7ffb9409c1b0 msgr2=0x7ffb940d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:46.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.658+0000 7ffb99dff700 1 -- 172.21.15.37:0/2201091323 shutdown_connections 2023-07-14T15:56:46.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.659+0000 7ffb99dff700 1 -- 172.21.15.37:0/2201091323 wait complete. 2023-07-14T15:56:46.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.660+0000 7ffb99dff700 1 Processor -- start 2023-07-14T15:56:46.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.660+0000 7ffb99dff700 1 -- start start 2023-07-14T15:56:46.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.661+0000 7ffb99dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ffb940d1140 0x7ffb94155290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:46.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.661+0000 7ffb99dff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb9415fee0 0x7ffb940c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:46.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.661+0000 7ffb99dff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb941603b0 0x7ffb941e5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:46.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.661+0000 7ffb99dff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb940b7230 con 0x7ffb9415fee0 2023-07-14T15:56:46.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.661+0000 7ffb99dff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb940c8880 con 0x7ffb941603b0 2023-07-14T15:56:46.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.661+0000 7ffb99dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb940c8b60 con 0x7ffb940d1140 2023-07-14T15:56:46.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.661+0000 7ffb92ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb9415fee0 0x7ffb940c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:46.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.662+0000 7ffb92ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb9415fee0 0x7ffb940c7ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46052/0 (socket says 172.21.15.37:46052) 2023-07-14T15:56:46.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.662+0000 7ffb92ffd700 1 -- 172.21.15.37:0/2065937504 learned_addr learned my addr 172.21.15.37:0/2065937504 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:46.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.662+0000 7ffb937fe700 1 --2- 172.21.15.37:0/2065937504 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ffb940d1140 0x7ffb94155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:46.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.662+0000 7ffb93fff700 1 --2- 172.21.15.37:0/2065937504 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb941603b0 0x7ffb941e5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:46.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.662+0000 7ffb92ffd700 1 -- 172.21.15.37:0/2065937504 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ffb940d1140 msgr2=0x7ffb94155290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:46.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.662+0000 7ffb92ffd700 1 --2- 172.21.15.37:0/2065937504 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ffb940d1140 0x7ffb94155290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:46.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.662+0000 7ffb92ffd700 1 -- 172.21.15.37:0/2065937504 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb941603b0 msgr2=0x7ffb941e5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:46.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.662+0000 7ffb92ffd700 1 --2- 172.21.15.37:0/2065937504 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb941603b0 0x7ffb941e5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:46.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.662+0000 7ffb92ffd700 1 -- 172.21.15.37:0/2065937504 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb840094a0 con 0x7ffb9415fee0 2023-07-14T15:56:46.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.662+0000 7ffb937fe700 1 --2- 172.21.15.37:0/2065937504 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ffb940d1140 0x7ffb94155290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:56:46.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.662+0000 7ffb92ffd700 1 --2- 172.21.15.37:0/2065937504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb9415fee0 0x7ffb940c7ea0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ffb880011e0 tx=0x7ffb8800ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:46.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.662+0000 7ffb7bfff700 1 -- 172.21.15.37:0/2065937504 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb880054e0 con 0x7ffb9415fee0 2023-07-14T15:56:46.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.663+0000 7ffb7bfff700 1 -- 172.21.15.37:0/2065937504 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb88003680 con 0x7ffb9415fee0 2023-07-14T15:56:46.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.663+0000 7ffb99dff700 1 -- 172.21.15.37:0/2065937504 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb940c8e40 con 0x7ffb9415fee0 2023-07-14T15:56:46.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.663+0000 7ffb7bfff700 1 -- 172.21.15.37:0/2065937504 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb88003a30 con 0x7ffb9415fee0 2023-07-14T15:56:46.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.663+0000 7ffb99dff700 1 -- 172.21.15.37:0/2065937504 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb941557d0 con 0x7ffb9415fee0 2023-07-14T15:56:46.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.664+0000 7ffb99dff700 1 -- 172.21.15.37:0/2065937504 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb940c9360 con 0x7ffb9415fee0 2023-07-14T15:56:46.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.665+0000 7ffb7bfff700 1 -- 172.21.15.37:0/2065937504 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ffb88003b90 con 0x7ffb9415fee0 2023-07-14T15:56:46.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.666+0000 7ffb7bfff700 1 --2- 172.21.15.37:0/2065937504 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ffb8006ace0 0x7ffb8006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:46.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.666+0000 7ffb7bfff700 1 -- 172.21.15.37:0/2065937504 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffb88088990 con 0x7ffb9415fee0 2023-07-14T15:56:46.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.666+0000 7ffb937fe700 1 --2- 172.21.15.37:0/2065937504 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ffb8006ace0 0x7ffb8006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:46.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.667+0000 7ffb937fe700 1 --2- 172.21.15.37:0/2065937504 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ffb8006ace0 0x7ffb8006d190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ffb840090b0 tx=0x7ffb84008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:46.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.670+0000 7ffb7bfff700 1 -- 172.21.15.37:0/2065937504 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ffb88053a30 con 0x7ffb9415fee0 2023-07-14T15:56:46.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.875+0000 7ffb99dff700 1 -- 172.21.15.37:0/2065937504 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffb94067840 con 0x7ffb9415fee0 2023-07-14T15:56:46.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.876+0000 7ffb7bfff700 1 -- 172.21.15.37:0/2065937504 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffb880170a0 con 0x7ffb9415fee0 2023-07-14T15:56:46.862 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-14T15:56:46.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.878+0000 7ffb99dff700 1 -- 172.21.15.37:0/2065937504 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ffb8006ace0 msgr2=0x7ffb8006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:46.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.878+0000 7ffb99dff700 1 --2- 172.21.15.37:0/2065937504 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ffb8006ace0 0x7ffb8006d190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ffb840090b0 tx=0x7ffb84008030 comp rx=0 tx=0).stop 2023-07-14T15:56:46.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.878+0000 7ffb99dff700 1 -- 172.21.15.37:0/2065937504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb9415fee0 msgr2=0x7ffb940c7ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:46.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.878+0000 7ffb99dff700 1 --2- 172.21.15.37:0/2065937504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb9415fee0 0x7ffb940c7ea0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ffb880011e0 tx=0x7ffb8800ca30 comp rx=0 tx=0).stop 2023-07-14T15:56:46.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.878+0000 7ffb99dff700 1 -- 172.21.15.37:0/2065937504 shutdown_connections 2023-07-14T15:56:46.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.878+0000 7ffb99dff700 1 --2- 172.21.15.37:0/2065937504 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb941603b0 0x7ffb941e5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:46.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.878+0000 7ffb99dff700 1 --2- 172.21.15.37:0/2065937504 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ffb8006ace0 0x7ffb8006d190 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:46.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.878+0000 7ffb99dff700 1 --2- 172.21.15.37:0/2065937504 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ffb940d1140 0x7ffb94155290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:46.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.878+0000 7ffb99dff700 1 --2- 172.21.15.37:0/2065937504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb9415fee0 0x7ffb940c7ea0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:46.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.878+0000 7ffb99dff700 1 -- 172.21.15.37:0/2065937504 >> 172.21.15.37:0/2065937504 conn(0x7ffb9409c1b0 msgr2=0x7ffb9406a690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:46.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.878+0000 7ffb99dff700 1 -- 172.21.15.37:0/2065937504 shutdown_connections 2023-07-14T15:56:46.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:46.878+0000 7ffb99dff700 1 -- 172.21.15.37:0/2065937504 wait complete. 2023-07-14T15:56:46.883 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T15:56:47.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.099+0000 7f36761ff700 1 Processor -- start 2023-07-14T15:56:47.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.099+0000 7f36761ff700 1 -- start start 2023-07-14T15:56:47.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.100+0000 7f36761ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f36700b54b0 0x7f36700cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:47.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.100+0000 7f36761ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f36700b4910 0x7f36700b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:47.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.100+0000 7f36761ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36700b52b0 con 0x7f36700b85f0 2023-07-14T15:56:47.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.100+0000 7f36761ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36700cf6b0 con 0x7f36700b54b0 2023-07-14T15:56:47.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.100+0000 7f36761ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36700cdc40 con 0x7f36700b4910 2023-07-14T15:56:47.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.100+0000 7f366f7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f36700b85f0 0x7f367015d660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35868/0 (socket says 172.21.15.37:35868) 2023-07-14T15:56:47.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.100+0000 7f366f7fe700 1 -- 172.21.15.37:0/931003763 learned_addr learned my addr 172.21.15.37:0/931003763 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:47.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.100+0000 7f366effd700 1 --2- 172.21.15.37:0/931003763 >> v2:172.21.15.98:3300/0 conn(0x7f36700b54b0 0x7f36700cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:47.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.100+0000 7f366ffff700 1 --2- 172.21.15.37:0/931003763 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f36700b4910 0x7f36700b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:47.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.101+0000 7f366e7fc700 1 -- 172.21.15.37:0/931003763 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3058890404 0 0) 0x7f36700b52b0 con 0x7f36700b85f0 2023-07-14T15:56:47.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.101+0000 7f366e7fc700 1 -- 172.21.15.37:0/931003763 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36580035b0 con 0x7f36700b85f0 2023-07-14T15:56:47.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.101+0000 7f366effd700 1 -- 172.21.15.37:0/931003763 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f36700b4910 msgr2=0x7f36700b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:47.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.101+0000 7f366effd700 1 --2- 172.21.15.37:0/931003763 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f36700b4910 0x7f36700b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:47.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.101+0000 7f366effd700 1 -- 172.21.15.37:0/931003763 >> v1:172.21.15.37:6789/0 conn(0x7f36700b85f0 legacy=0x7f367015d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:47.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.101+0000 7f366effd700 1 -- 172.21.15.37:0/931003763 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36700cf0a0 con 0x7f36700b54b0 2023-07-14T15:56:47.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.101+0000 7f366effd700 1 --2- 172.21.15.37:0/931003763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f36700b54b0 0x7f36700cfb40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3664009840 tx=0x7f3664009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7674a64a6ed1f2c9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:47.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.101+0000 7f366e7fc700 1 -- 172.21.15.37:0/931003763 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3664011830 con 0x7f36700b54b0 2023-07-14T15:56:47.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.102+0000 7f366e7fc700 1 -- 172.21.15.37:0/931003763 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3664011990 con 0x7f36700b54b0 2023-07-14T15:56:47.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.102+0000 7f366e7fc700 1 -- 172.21.15.37:0/931003763 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3664011d20 con 0x7f36700b54b0 2023-07-14T15:56:47.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.102+0000 7f36761ff700 1 -- 172.21.15.37:0/931003763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f36700b54b0 msgr2=0x7f36700cfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:47.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.102+0000 7f36761ff700 1 --2- 172.21.15.37:0/931003763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f36700b54b0 0x7f36700cfb40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3664009840 tx=0x7f3664009b50 comp rx=0 tx=0).stop 2023-07-14T15:56:47.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.102+0000 7f36761ff700 1 -- 172.21.15.37:0/931003763 shutdown_connections 2023-07-14T15:56:47.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.102+0000 7f36761ff700 1 --2- 172.21.15.37:0/931003763 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f36700b4910 0x7f36700b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:47.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.102+0000 7f36761ff700 1 --2- 172.21.15.37:0/931003763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f36700b54b0 0x7f36700cfb40 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:47.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.102+0000 7f36761ff700 1 -- 172.21.15.37:0/931003763 >> 172.21.15.37:0/931003763 conn(0x7f367006a580 msgr2=0x7f367006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:47.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.102+0000 7f36761ff700 1 -- 172.21.15.37:0/931003763 shutdown_connections 2023-07-14T15:56:47.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.102+0000 7f36761ff700 1 -- 172.21.15.37:0/931003763 wait complete. 2023-07-14T15:56:47.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.104+0000 7f36761ff700 1 Processor -- start 2023-07-14T15:56:47.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.104+0000 7f36761ff700 1 -- start start 2023-07-14T15:56:47.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.105+0000 7f36761ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f36700b4910 0x7f36700c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:47.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.105+0000 7f36761ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f36700b54b0 0x7f367015a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:47.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.105+0000 7f36761ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36700b85f0 0x7f36701f22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:47.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.105+0000 7f36761ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36700cad80 con 0x7f36700b85f0 2023-07-14T15:56:47.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.105+0000 7f36761ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36700c98f0 con 0x7f36700b54b0 2023-07-14T15:56:47.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.105+0000 7f36761ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f367015a9c0 con 0x7f36700b4910 2023-07-14T15:56:47.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.105+0000 7f366ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36700b85f0 0x7f36701f22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:47.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.105+0000 7f366ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36700b85f0 0x7f36701f22b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46056/0 (socket says 172.21.15.37:46056) 2023-07-14T15:56:47.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.105+0000 7f366ffff700 1 -- 172.21.15.37:0/3797415642 learned_addr learned my addr 172.21.15.37:0/3797415642 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:47.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.105+0000 7f366f7fe700 1 --2- 172.21.15.37:0/3797415642 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f36700b4910 0x7f36700c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:47.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.105+0000 7f366effd700 1 --2- 172.21.15.37:0/3797415642 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f36700b54b0 0x7f367015a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:47.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.106+0000 7f366ffff700 1 -- 172.21.15.37:0/3797415642 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f36700b4910 msgr2=0x7f36700c93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:47.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.106+0000 7f366ffff700 1 --2- 172.21.15.37:0/3797415642 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f36700b4910 0x7f36700c93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:47.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.106+0000 7f366ffff700 1 -- 172.21.15.37:0/3797415642 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f36700b54b0 msgr2=0x7f367015a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:47.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.106+0000 7f366ffff700 1 --2- 172.21.15.37:0/3797415642 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f36700b54b0 0x7f367015a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:47.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.106+0000 7f366ffff700 1 -- 172.21.15.37:0/3797415642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36640094a0 con 0x7f36700b85f0 2023-07-14T15:56:47.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.106+0000 7f366ffff700 1 --2- 172.21.15.37:0/3797415642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36700b85f0 0x7f36701f22b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3668009dd0 tx=0x7f366800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:47.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.106+0000 7f3657fff700 1 -- 172.21.15.37:0/3797415642 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3668009c40 con 0x7f36700b85f0 2023-07-14T15:56:47.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.106+0000 7f3657fff700 1 -- 172.21.15.37:0/3797415642 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f366800f040 con 0x7f36700b85f0 2023-07-14T15:56:47.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.106+0000 7f3657fff700 1 -- 172.21.15.37:0/3797415642 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366800ceb0 con 0x7f36700b85f0 2023-07-14T15:56:47.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.106+0000 7f36761ff700 1 -- 172.21.15.37:0/3797415642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36700c8190 con 0x7f36700b85f0 2023-07-14T15:56:47.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.106+0000 7f36761ff700 1 -- 172.21.15.37:0/3797415642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36700c8750 con 0x7f36700b85f0 2023-07-14T15:56:47.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.107+0000 7f36761ff700 1 -- 172.21.15.37:0/3797415642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36700caf30 con 0x7f36700b85f0 2023-07-14T15:56:47.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.108+0000 7f3657fff700 1 -- 172.21.15.37:0/3797415642 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3668014480 con 0x7f36700b85f0 2023-07-14T15:56:47.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.110+0000 7f3657fff700 1 --2- 172.21.15.37:0/3797415642 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f365c06ace0 0x7f365c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:47.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.110+0000 7f3657fff700 1 -- 172.21.15.37:0/3797415642 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3668089fc0 con 0x7f36700b85f0 2023-07-14T15:56:47.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.110+0000 7f366f7fe700 1 --2- 172.21.15.37:0/3797415642 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f365c06ace0 0x7f365c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:47.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.111+0000 7f366f7fe700 1 --2- 172.21.15.37:0/3797415642 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f365c06ace0 0x7f365c06d190 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3660007fd0 tx=0x7f3660007dc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:47.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.114+0000 7f3657fff700 1 -- 172.21.15.37:0/3797415642 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f36700caf30 con 0x7f36700b85f0 2023-07-14T15:56:47.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.322+0000 7f36761ff700 1 -- 172.21.15.37:0/3797415642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3670067840 con 0x7f36700b85f0 2023-07-14T15:56:47.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.323+0000 7f3657fff700 1 -- 172.21.15.37:0/3797415642 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18341 (secure 0 0 0) 0x7f3668058af0 con 0x7f36700b85f0 2023-07-14T15:56:47.309 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:56:47.309 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"fsid":"9da30401-a779-4e46-aba6-00c2494c6c67","created":"2023-07-14T15:55:39.898867+0000","modified":"2023-07-14T15:56:09.959850+0000","last_up_change":"2023-07-14T15:55:53.025696+0000","last_in_change":"2023-07-14T15:55:43.388192+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T15:55:52.907261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T15:55:59.992839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T15:56:06.091064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T15:56:07.448694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d049535-7b87-4276-8fe5-0f74ba422d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6801","nonce":2783032392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6803","nonce":2783032392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6807","nonce":2783032392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6805","nonce":2783032392}]},"public_addr":"172.21.15.37:6801/2783032392","cluster_addr":"172.21.15.37:6803/2783032392","heartbeat_back_addr":"172.21.15.37:6807/2783032392","heartbeat_front_addr":"172.21.15.37:6805/2783032392","state":["exists","up"]},{"osd":1,"uuid":"79ec948d-ead2-4c2d-923a-dd6eeaac9dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6823","nonce":1190059746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6826","nonce":1190059746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6831","nonce":1190059746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6829","nonce":1190059746}]},"public_addr":"172.21.15.37:6823/1190059746","cluster_addr":"172.21.15.37:6826/1190059746","heartbeat_back_addr":"172.21.15.37:6831/1190059746","heartbeat_front_addr":"172.21.15.37:6829/1190059746","state":["exists","up"]},{"osd":2,"uuid":"a1db6690-c160-4366-9c82-2cca17e4bba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6809","nonce":2266223499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6813","nonce":2266223499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6820","nonce":2266223499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6816","nonce":2266223499}]},"public_addr":"172.21.15.37:6809/2266223499","cluster_addr":"172.21.15.37:6813/2266223499","heartbeat_back_addr":"172.21.15.37:6820/2266223499","heartbeat_front_addr":"172.21.15.37:6816/2266223499","state":["exists","up"]},{"osd":3,"uuid":"767b8220-e79a-4a86-a162-6b3b73198379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6812","nonce":4166694594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6817","nonce":4166694594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6828","nonce":4166694594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6822","nonce":4166694594}]},"public_addr":"172.21.15.37:6812/4166694594","cluster_addr":"172.21.15.37:6817/4166694594","heartbeat_back_addr":"172.21.15.37:6828/4166694594","heartbeat_front_addr":"172.21.15.37:6822/4166694594","state":["exists","up"]},{"osd":4,"uuid":"717bd773-ae7e-4236-ac79-900cf99a37c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6801","nonce":3529020407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6803","nonce":3529020407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6807","nonce":3529020407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6805","nonce":3529020407}]},"public_addr":"172.21.15.98:6801/3529020407","cluster_addr":"172.21.15.98:6803/3529020407","heartbeat_back_addr":"172.21.15.98:6807/3529020407","heartbeat_front_addr":"172.21.15.98:6805/3529020407","state":["exists","up"]},{"osd":5,"uuid":"a941d358-0f03-4136-a9b2-3a1c2e9358cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6817","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6819","nonce":2311501838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6821","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6823","nonce":2311501838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6829","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6831","nonce":2311501838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6825","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6827","nonce":2311501838}]},"public_addr":"172.21.15.98:6819/2311501838","cluster_addr":"172.21.15.98:6823/2311501838","heartbeat_back_addr":"172.21.15.98:6831/2311501838","heartbeat_front_addr":"172.21.15.98:6827/2311501838","state":["exists","up"]},{"osd":6,"uuid":"27153772-6d4b-479d-9953-0582e7b96743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6809","nonce":1144224691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6811","nonce":1144224691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6815","nonce":1144224691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6813","nonce":1144224691}]},"public_addr":"172.21.15.98:6809/1144224691","cluster_addr":"172.21.15.98:6811/1144224691","heartbeat_back_addr":"172.21.15.98:6815/1144224691","heartbeat_front_addr":"172.21.15.98:6813/1144224691","state":["exists","up"]},{"osd":7,"uuid":"d21ffc8e-40bb-47eb-af2c-e3e730d3fb76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6818","nonce":1144470927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6822","nonce":1144470927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6830","nonce":1144470927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6826","nonce":1144470927}]},"public_addr":"172.21.15.98:6818/1144470927","cluster_addr":"172.21.15.98:6822/1144470927","heartbeat_back_addr":"172.21.15.98:6830/1144470927","heartbeat_front_addr":"172.21.15.98:6826/1144470927","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.921114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.739210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.024016+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.002527+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.698127+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.813416+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.709351+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.815457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T15:56:47.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.326+0000 7f36761ff700 1 -- 172.21.15.37:0/3797415642 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f365c06ace0 msgr2=0x7f365c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:47.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.326+0000 7f36761ff700 1 --2- 172.21.15.37:0/3797415642 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f365c06ace0 0x7f365c06d190 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3660007fd0 tx=0x7f3660007dc0 comp rx=0 tx=0).stop 2023-07-14T15:56:47.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.326+0000 7f36761ff700 1 -- 172.21.15.37:0/3797415642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36700b85f0 msgr2=0x7f36701f22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:47.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.326+0000 7f36761ff700 1 --2- 172.21.15.37:0/3797415642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36700b85f0 0x7f36701f22b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3668009dd0 tx=0x7f366800c3a0 comp rx=0 tx=0).stop 2023-07-14T15:56:47.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.326+0000 7f36761ff700 1 -- 172.21.15.37:0/3797415642 shutdown_connections 2023-07-14T15:56:47.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.326+0000 7f36761ff700 1 --2- 172.21.15.37:0/3797415642 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f365c06ace0 0x7f365c06d190 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:47.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.326+0000 7f36761ff700 1 --2- 172.21.15.37:0/3797415642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36700b85f0 0x7f36701f22b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:47.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.326+0000 7f36761ff700 1 --2- 172.21.15.37:0/3797415642 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f36700b4910 0x7f36700c93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:47.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.326+0000 7f36761ff700 1 --2- 172.21.15.37:0/3797415642 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f36700b54b0 0x7f367015a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:47.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.326+0000 7f36761ff700 1 -- 172.21.15.37:0/3797415642 >> 172.21.15.37:0/3797415642 conn(0x7f367006a580 msgr2=0x7f36700b75a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:47.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.326+0000 7f36761ff700 1 -- 172.21.15.37:0/3797415642 shutdown_connections 2023-07-14T15:56:47.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.326+0000 7f36761ff700 1 -- 172.21.15.37:0/3797415642 wait complete. 2023-07-14T15:56:47.329 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T15:55:52.907261+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T15:55:59.992839+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T15:56:06.091064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T15:56:07.448694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T15:56:47.330 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T15:56:47.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.550+0000 7f4e6c9ff700 1 Processor -- start 2023-07-14T15:56:47.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.550+0000 7f4e6c9ff700 1 -- start start 2023-07-14T15:56:47.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.551+0000 7f4e6c9ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4e6815fee0 0x7f4e6815ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:47.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.551+0000 7f4e6c9ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4e681603b0 0x7f4e680d0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:47.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.551+0000 7f4e6c9ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e680d13d0 con 0x7f4e680d0f70 2023-07-14T15:56:47.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.551+0000 7f4e6c9ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e6815dc50 con 0x7f4e6815fee0 2023-07-14T15:56:47.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.551+0000 7f4e6c9ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e680b2940 con 0x7f4e681603b0 2023-07-14T15:56:47.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.551+0000 7f4e6659c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4e6815fee0 0x7f4e6815ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:47.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.551+0000 7f4e66d9d700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4e680d0f70 0x7f4e680b39e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35872/0 (socket says 172.21.15.37:35872) 2023-07-14T15:56:47.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.551+0000 7f4e66d9d700 1 -- 172.21.15.37:0/121507517 learned_addr learned my addr 172.21.15.37:0/121507517 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:47.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.552+0000 7f4e65d9b700 1 --2- 172.21.15.37:0/121507517 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4e681603b0 0x7f4e680d0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:47.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.552+0000 7f4e6659c700 1 -- 172.21.15.37:0/121507517 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4e681603b0 msgr2=0x7f4e680d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:47.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.552+0000 7f4e6659c700 1 --2- 172.21.15.37:0/121507517 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4e681603b0 0x7f4e680d0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:47.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.552+0000 7f4e6659c700 1 -- 172.21.15.37:0/121507517 >> v1:172.21.15.37:6789/0 conn(0x7f4e680d0f70 legacy=0x7f4e680b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:47.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.552+0000 7f4e6659c700 1 -- 172.21.15.37:0/121507517 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e680b2c20 con 0x7f4e6815fee0 2023-07-14T15:56:47.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.552+0000 7f4e6559a700 1 -- 172.21.15.37:0/121507517 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1816980299 0 0) 0x7f4e680d13d0 con 0x7f4e680d0f70 2023-07-14T15:56:47.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.552+0000 7f4e6659c700 1 --2- 172.21.15.37:0/121507517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e6815fee0 0x7f4e6815ded0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4e58009840 tx=0x7f4e58009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94deb13afd12d04d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:47.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.552+0000 7f4e6559a700 1 -- 172.21.15.37:0/121507517 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e58011830 con 0x7f4e6815fee0 2023-07-14T15:56:47.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.553+0000 7f4e6559a700 1 -- 172.21.15.37:0/121507517 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e58011990 con 0x7f4e6815fee0 2023-07-14T15:56:47.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.553+0000 7f4e6559a700 1 -- 172.21.15.37:0/121507517 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e58011d20 con 0x7f4e6815fee0 2023-07-14T15:56:47.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.553+0000 7f4e6c9ff700 1 -- 172.21.15.37:0/121507517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e6815fee0 msgr2=0x7f4e6815ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:47.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.553+0000 7f4e6c9ff700 1 --2- 172.21.15.37:0/121507517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e6815fee0 0x7f4e6815ded0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4e58009840 tx=0x7f4e58009b50 comp rx=0 tx=0).stop 2023-07-14T15:56:47.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.553+0000 7f4e6c9ff700 1 -- 172.21.15.37:0/121507517 shutdown_connections 2023-07-14T15:56:47.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.553+0000 7f4e6c9ff700 1 --2- 172.21.15.37:0/121507517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e6815fee0 0x7f4e6815ded0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:47.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.553+0000 7f4e6c9ff700 1 --2- 172.21.15.37:0/121507517 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4e681603b0 0x7f4e680d0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:47.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.553+0000 7f4e6c9ff700 1 -- 172.21.15.37:0/121507517 >> 172.21.15.37:0/121507517 conn(0x7f4e6809c1b0 msgr2=0x7f4e680d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:47.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.553+0000 7f4e6c9ff700 1 -- 172.21.15.37:0/121507517 shutdown_connections 2023-07-14T15:56:47.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.553+0000 7f4e6c9ff700 1 -- 172.21.15.37:0/121507517 wait complete. 2023-07-14T15:56:47.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.555+0000 7f4e6c9ff700 1 Processor -- start 2023-07-14T15:56:47.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.555+0000 7f4e6c9ff700 1 -- start start 2023-07-14T15:56:47.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.556+0000 7f4e6c9ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e680d0f70 0x7f4e680afa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:47.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.556+0000 7f4e6c9ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e6815fee0 0x7f4e680b78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:47.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.556+0000 7f4e6c9ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4e681603b0 0x7f4e680b7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:47.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.556+0000 7f4e6c9ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e680c7330 con 0x7f4e6815fee0 2023-07-14T15:56:47.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.556+0000 7f4e6c9ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e681566a0 con 0x7f4e680d0f70 2023-07-14T15:56:47.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.556+0000 7f4e6c9ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e680b8430 con 0x7f4e681603b0 2023-07-14T15:56:47.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.556+0000 7f4e65d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e6815fee0 0x7f4e680b78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:47.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.556+0000 7f4e65d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e6815fee0 0x7f4e680b78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46068/0 (socket says 172.21.15.37:46068) 2023-07-14T15:56:47.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.556+0000 7f4e65d9b700 1 -- 172.21.15.37:0/4194956764 learned_addr learned my addr 172.21.15.37:0/4194956764 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:47.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.556+0000 7f4e66d9d700 1 --2- 172.21.15.37:0/4194956764 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4e681603b0 0x7f4e680b7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:47.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.557+0000 7f4e6659c700 1 --2- 172.21.15.37:0/4194956764 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e680d0f70 0x7f4e680afa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:47.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.557+0000 7f4e65d9b700 1 -- 172.21.15.37:0/4194956764 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4e681603b0 msgr2=0x7f4e680b7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:47.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.557+0000 7f4e65d9b700 1 --2- 172.21.15.37:0/4194956764 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4e681603b0 0x7f4e680b7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:47.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.557+0000 7f4e65d9b700 1 -- 172.21.15.37:0/4194956764 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e680d0f70 msgr2=0x7f4e680afa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:47.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.557+0000 7f4e65d9b700 1 --2- 172.21.15.37:0/4194956764 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e680d0f70 0x7f4e680afa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:47.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.557+0000 7f4e65d9b700 1 -- 172.21.15.37:0/4194956764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e580094a0 con 0x7f4e6815fee0 2023-07-14T15:56:47.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.557+0000 7f4e65d9b700 1 --2- 172.21.15.37:0/4194956764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e6815fee0 0x7f4e680b78c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c00e9b0 tx=0x7f4e5c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:47.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.557+0000 7f4e56ffd700 1 -- 172.21.15.37:0/4194956764 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c009710 con 0x7f4e6815fee0 2023-07-14T15:56:47.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.557+0000 7f4e56ffd700 1 -- 172.21.15.37:0/4194956764 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5c00c850 con 0x7f4e6815fee0 2023-07-14T15:56:47.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.557+0000 7f4e56ffd700 1 -- 172.21.15.37:0/4194956764 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c00cbc0 con 0x7f4e6815fee0 2023-07-14T15:56:47.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.557+0000 7f4e6c9ff700 1 -- 172.21.15.37:0/4194956764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e680c7560 con 0x7f4e6815fee0 2023-07-14T15:56:47.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.557+0000 7f4e6c9ff700 1 -- 172.21.15.37:0/4194956764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e680c7b20 con 0x7f4e6815fee0 2023-07-14T15:56:47.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.559+0000 7f4e6c9ff700 1 -- 172.21.15.37:0/4194956764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e680c7cb0 con 0x7f4e6815fee0 2023-07-14T15:56:47.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.559+0000 7f4e56ffd700 1 -- 172.21.15.37:0/4194956764 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4e5c00cd20 con 0x7f4e6815fee0 2023-07-14T15:56:47.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.560+0000 7f4e56ffd700 1 --2- 172.21.15.37:0/4194956764 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4e4806ace0 0x7f4e4806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:47.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.560+0000 7f4e56ffd700 1 -- 172.21.15.37:0/4194956764 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4e5c089590 con 0x7f4e6815fee0 2023-07-14T15:56:47.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.561+0000 7f4e6659c700 1 --2- 172.21.15.37:0/4194956764 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4e4806ace0 0x7f4e4806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:47.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.561+0000 7f4e6659c700 1 --2- 172.21.15.37:0/4194956764 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4e4806ace0 0x7f4e4806d190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4e580090b0 tx=0x7f4e58008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:47.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.564+0000 7f4e56ffd700 1 -- 172.21.15.37:0/4194956764 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4e5c0580d0 con 0x7f4e6815fee0 2023-07-14T15:56:47.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.772+0000 7f4e6c9ff700 1 -- 172.21.15.37:0/4194956764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4e68158d30 con 0x7f4e6815fee0 2023-07-14T15:56:47.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.773+0000 7f4e56ffd700 1 -- 172.21.15.37:0/4194956764 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4e5c057c60 con 0x7f4e6815fee0 2023-07-14T15:56:47.759 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-14T15:56:47.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.775+0000 7f4e6c9ff700 1 -- 172.21.15.37:0/4194956764 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4e4806ace0 msgr2=0x7f4e4806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:47.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.775+0000 7f4e6c9ff700 1 --2- 172.21.15.37:0/4194956764 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4e4806ace0 0x7f4e4806d190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4e580090b0 tx=0x7f4e58008030 comp rx=0 tx=0).stop 2023-07-14T15:56:47.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.775+0000 7f4e6c9ff700 1 -- 172.21.15.37:0/4194956764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e6815fee0 msgr2=0x7f4e680b78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:47.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.775+0000 7f4e6c9ff700 1 --2- 172.21.15.37:0/4194956764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e6815fee0 0x7f4e680b78c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c00e9b0 tx=0x7f4e5c00ed70 comp rx=0 tx=0).stop 2023-07-14T15:56:47.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.775+0000 7f4e6c9ff700 1 -- 172.21.15.37:0/4194956764 shutdown_connections 2023-07-14T15:56:47.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.775+0000 7f4e6c9ff700 1 --2- 172.21.15.37:0/4194956764 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e680d0f70 0x7f4e680afa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:47.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.775+0000 7f4e6c9ff700 1 --2- 172.21.15.37:0/4194956764 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4e4806ace0 0x7f4e4806d190 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:47.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.775+0000 7f4e6c9ff700 1 --2- 172.21.15.37:0/4194956764 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4e681603b0 0x7f4e680b7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:47.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.775+0000 7f4e6c9ff700 1 --2- 172.21.15.37:0/4194956764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e6815fee0 0x7f4e680b78c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:47.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.775+0000 7f4e6c9ff700 1 -- 172.21.15.37:0/4194956764 >> 172.21.15.37:0/4194956764 conn(0x7f4e6809c1b0 msgr2=0x7f4e68158620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:47.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.775+0000 7f4e6c9ff700 1 -- 172.21.15.37:0/4194956764 shutdown_connections 2023-07-14T15:56:47.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:47.775+0000 7f4e6c9ff700 1 -- 172.21.15.37:0/4194956764 wait complete. 2023-07-14T15:56:47.778 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T15:56:47.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.000+0000 7f6fa45ff700 1 Processor -- start 2023-07-14T15:56:47.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.000+0000 7f6fa45ff700 1 -- start start 2023-07-14T15:56:47.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.001+0000 7f6fa45ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6f9c0cfd50 0x7f6f9c0d2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:47.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.001+0000 7f6fa45ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6f9c0b1e80 0x7f6f9c0b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:47.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.001+0000 7f6fa45ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f6f9c0b3290 0x7f6f9c0b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:47.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.001+0000 7f6fa45ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f9c15ccf0 con 0x7f6f9c0cfd50 2023-07-14T15:56:47.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.001+0000 7f6fa45ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f9c0b1840 con 0x7f6f9c0b3290 2023-07-14T15:56:47.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.001+0000 7f6fa45ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9c0b2550 con 0x7f6f9c0b1e80 2023-07-14T15:56:47.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.001+0000 7f6fa239b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6f9c0cfd50 0x7f6f9c0d2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:47.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.001+0000 7f6fa239b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6f9c0cfd50 0x7f6f9c0d2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46072/0 (socket says 172.21.15.37:46072) 2023-07-14T15:56:47.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.001+0000 7f6fa239b700 1 -- 172.21.15.37:0/1331838762 learned_addr learned my addr 172.21.15.37:0/1331838762 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:47.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.001+0000 7f6fa2b9c700 1 --2- 172.21.15.37:0/1331838762 >> v2:172.21.15.98:3300/0 conn(0x7f6f9c0b3290 0x7f6f9c0b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:47.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.001+0000 7f6fa1b9a700 1 --2- 172.21.15.37:0/1331838762 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6f9c0b1e80 0x7f6f9c0b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:47.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.002+0000 7f6fa239b700 1 -- 172.21.15.37:0/1331838762 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6f9c0b1e80 msgr2=0x7f6f9c0b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:47.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.002+0000 7f6fa239b700 1 --2- 172.21.15.37:0/1331838762 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6f9c0b1e80 0x7f6f9c0b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:47.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.002+0000 7f6fa239b700 1 -- 172.21.15.37:0/1331838762 >> v2:172.21.15.98:3300/0 conn(0x7f6f9c0b3290 msgr2=0x7f6f9c0b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:47.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.002+0000 7f6fa239b700 1 --2- 172.21.15.37:0/1331838762 >> v2:172.21.15.98:3300/0 conn(0x7f6f9c0b3290 0x7f6f9c0b36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:47.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.002+0000 7f6fa239b700 1 -- 172.21.15.37:0/1331838762 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f9c0b2830 con 0x7f6f9c0cfd50 2023-07-14T15:56:47.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.002+0000 7f6fa239b700 1 --2- 172.21.15.37:0/1331838762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f9c0cfd50 0x7f6f9c0d2880 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c066b40 tx=0x7f6f98009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=295aca80e9df3a02 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:47.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.002+0000 7f6fa1399700 1 -- 172.21.15.37:0/1331838762 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f98011830 con 0x7f6f9c0cfd50 2023-07-14T15:56:47.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.002+0000 7f6fa1399700 1 -- 172.21.15.37:0/1331838762 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f98011990 con 0x7f6f9c0cfd50 2023-07-14T15:56:47.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.002+0000 7f6fa1399700 1 -- 172.21.15.37:0/1331838762 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f98011d20 con 0x7f6f9c0cfd50 2023-07-14T15:56:47.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.003+0000 7f6fa45ff700 1 -- 172.21.15.37:0/1331838762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f9c0cfd50 msgr2=0x7f6f9c0d2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:47.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.003+0000 7f6fa45ff700 1 --2- 172.21.15.37:0/1331838762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f9c0cfd50 0x7f6f9c0d2880 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c066b40 tx=0x7f6f98009bd0 comp rx=0 tx=0).stop 2023-07-14T15:56:47.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.003+0000 7f6fa45ff700 1 -- 172.21.15.37:0/1331838762 shutdown_connections 2023-07-14T15:56:47.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.003+0000 7f6fa45ff700 1 --2- 172.21.15.37:0/1331838762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f9c0cfd50 0x7f6f9c0d2880 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:47.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.003+0000 7f6fa45ff700 1 --2- 172.21.15.37:0/1331838762 >> v2:172.21.15.98:3300/0 conn(0x7f6f9c0b3290 0x7f6f9c0b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:47.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.003+0000 7f6fa45ff700 1 --2- 172.21.15.37:0/1331838762 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6f9c0b1e80 0x7f6f9c0b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:47.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.003+0000 7f6fa45ff700 1 -- 172.21.15.37:0/1331838762 >> 172.21.15.37:0/1331838762 conn(0x7f6f9c09c1c0 msgr2=0x7f6f9c0d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:47.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.003+0000 7f6fa45ff700 1 -- 172.21.15.37:0/1331838762 shutdown_connections 2023-07-14T15:56:47.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.003+0000 7f6fa45ff700 1 -- 172.21.15.37:0/1331838762 wait complete. 2023-07-14T15:56:47.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.005+0000 7f6fa45ff700 1 Processor -- start 2023-07-14T15:56:47.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.005+0000 7f6fa45ff700 1 -- start start 2023-07-14T15:56:47.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.006+0000 7f6fa45ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f9c0b1e80 0x7f6f9c1553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:47.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.006+0000 7f6fa45ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6f9c0b3290 0x7f6f9c0b7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:47.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.006+0000 7f6fa45ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6f9c0cfd50 0x7f6f9c0b7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:47.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.006+0000 7f6fa45ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9c0c6960 con 0x7f6f9c0b1e80 2023-07-14T15:56:47.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.006+0000 7f6fa45ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9c0b69a0 con 0x7f6f9c0b3290 2023-07-14T15:56:47.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.006+0000 7f6fa45ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9c0b6c80 con 0x7f6f9c0cfd50 2023-07-14T15:56:47.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.006+0000 7f6fa239b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f9c0b1e80 0x7f6f9c1553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:47.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.006+0000 7f6fa239b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f9c0b1e80 0x7f6f9c1553b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46078/0 (socket says 172.21.15.37:46078) 2023-07-14T15:56:47.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.006+0000 7f6fa239b700 1 -- 172.21.15.37:0/776602097 learned_addr learned my addr 172.21.15.37:0/776602097 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:47.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.007+0000 7f6fa1b9a700 1 --2- 172.21.15.37:0/776602097 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6f9c0b3290 0x7f6f9c0b7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:47.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.007+0000 7f6fa2b9c700 1 --2- 172.21.15.37:0/776602097 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6f9c0cfd50 0x7f6f9c0b7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:47.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.007+0000 7f6fa239b700 1 -- 172.21.15.37:0/776602097 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6f9c0cfd50 msgr2=0x7f6f9c0b7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:47.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.007+0000 7f6fa239b700 1 --2- 172.21.15.37:0/776602097 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6f9c0cfd50 0x7f6f9c0b7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:47.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.007+0000 7f6fa239b700 1 -- 172.21.15.37:0/776602097 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6f9c0b3290 msgr2=0x7f6f9c0b7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:47.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.007+0000 7f6fa239b700 1 --2- 172.21.15.37:0/776602097 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6f9c0b3290 0x7f6f9c0b7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:47.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.007+0000 7f6fa239b700 1 -- 172.21.15.37:0/776602097 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f98009550 con 0x7f6f9c0b1e80 2023-07-14T15:56:47.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.007+0000 7f6fa239b700 1 --2- 172.21.15.37:0/776602097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f9c0b1e80 0x7f6f9c1553b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6f98009c10 tx=0x7f6f98004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:47.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.007+0000 7f6f92ffd700 1 -- 172.21.15.37:0/776602097 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f98004510 con 0x7f6f9c0b1e80 2023-07-14T15:56:47.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.007+0000 7f6f92ffd700 1 -- 172.21.15.37:0/776602097 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f9801e070 con 0x7f6f9c0b1e80 2023-07-14T15:56:47.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.007+0000 7f6fa45ff700 1 -- 172.21.15.37:0/776602097 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f9c0d02a0 con 0x7f6f9c0b1e80 2023-07-14T15:56:47.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.007+0000 7f6f92ffd700 1 -- 172.21.15.37:0/776602097 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f980038e0 con 0x7f6f9c0b1e80 2023-07-14T15:56:47.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.008+0000 7f6fa45ff700 1 -- 172.21.15.37:0/776602097 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f9c0c6f00 con 0x7f6f9c0b1e80 2023-07-14T15:56:47.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.008+0000 7f6fa45ff700 1 -- 172.21.15.37:0/776602097 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f9c067840 con 0x7f6f9c0b1e80 2023-07-14T15:56:47.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.009+0000 7f6f92ffd700 1 -- 172.21.15.37:0/776602097 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6f98003a40 con 0x7f6f9c0b1e80 2023-07-14T15:56:47.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.010+0000 7f6f92ffd700 1 --2- 172.21.15.37:0/776602097 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f6f8006ace0 0x7f6f8006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:47.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.011+0000 7f6f92ffd700 1 -- 172.21.15.37:0/776602097 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6f9808a350 con 0x7f6f9c0b1e80 2023-07-14T15:56:47.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.011+0000 7f6fa1b9a700 1 --2- 172.21.15.37:0/776602097 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f6f8006ace0 0x7f6f8006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:47.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.012+0000 7f6fa1b9a700 1 --2- 172.21.15.37:0/776602097 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f6f8006ace0 0x7f6f8006d190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c1e71e0 tx=0x7f6f8c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:47.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.014+0000 7f6f92ffd700 1 -- 172.21.15.37:0/776602097 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6f980553f0 con 0x7f6f9c0b1e80 2023-07-14T15:56:48.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.221+0000 7f6fa45ff700 1 -- 172.21.15.37:0/776602097 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6f9c15c940 con 0x7f6f9c0b1e80 2023-07-14T15:56:48.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.222+0000 7f6f92ffd700 1 -- 172.21.15.37:0/776602097 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6f9802c3b0 con 0x7f6f9c0b1e80 2023-07-14T15:56:48.207 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-14T15:56:48.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.224+0000 7f6fa45ff700 1 -- 172.21.15.37:0/776602097 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f6f8006ace0 msgr2=0x7f6f8006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:48.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.224+0000 7f6fa45ff700 1 --2- 172.21.15.37:0/776602097 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f6f8006ace0 0x7f6f8006d190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c1e71e0 tx=0x7f6f8c008040 comp rx=0 tx=0).stop 2023-07-14T15:56:48.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.224+0000 7f6fa45ff700 1 -- 172.21.15.37:0/776602097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f9c0b1e80 msgr2=0x7f6f9c1553b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:48.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.224+0000 7f6fa45ff700 1 --2- 172.21.15.37:0/776602097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f9c0b1e80 0x7f6f9c1553b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6f98009c10 tx=0x7f6f98004750 comp rx=0 tx=0).stop 2023-07-14T15:56:48.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.224+0000 7f6fa45ff700 1 -- 172.21.15.37:0/776602097 shutdown_connections 2023-07-14T15:56:48.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.224+0000 7f6fa45ff700 1 --2- 172.21.15.37:0/776602097 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f6f8006ace0 0x7f6f8006d190 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:48.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.224+0000 7f6fa45ff700 1 --2- 172.21.15.37:0/776602097 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6f9c0cfd50 0x7f6f9c0b7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:48.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.224+0000 7f6fa45ff700 1 --2- 172.21.15.37:0/776602097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f9c0b1e80 0x7f6f9c1553b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:48.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.224+0000 7f6fa45ff700 1 --2- 172.21.15.37:0/776602097 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6f9c0b3290 0x7f6f9c0b7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:48.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.224+0000 7f6fa45ff700 1 -- 172.21.15.37:0/776602097 >> 172.21.15.37:0/776602097 conn(0x7f6f9c09c1c0 msgr2=0x7f6f9c0d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:48.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.224+0000 7f6fa45ff700 1 -- 172.21.15.37:0/776602097 shutdown_connections 2023-07-14T15:56:48.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.224+0000 7f6fa45ff700 1 -- 172.21.15.37:0/776602097 wait complete. 2023-07-14T15:56:48.228 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T15:56:48.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.446+0000 7f777a1ff700 1 Processor -- start 2023-07-14T15:56:48.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.446+0000 7f777a1ff700 1 -- start start 2023-07-14T15:56:48.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.447+0000 7f777a1ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f77740b2240 0x7f77740d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:48.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.447+0000 7f777a1ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f77740b42e0 0x7f77740cf890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:48.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.448+0000 7f777a1ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77740b2610 con 0x7f77740cfdd0 2023-07-14T15:56:48.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.448+0000 7f777a1ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77740d1720 con 0x7f77740b2240 2023-07-14T15:56:48.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.448+0000 7f777a1ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77740cd4d0 con 0x7f77740b42e0 2023-07-14T15:56:48.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.448+0000 7f77737fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f77740b2240 0x7f77740d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:48.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.448+0000 7f7773fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f77740cfdd0 0x7f77740b27c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35886/0 (socket says 172.21.15.37:35886) 2023-07-14T15:56:48.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.448+0000 7f7773fff700 1 -- 172.21.15.37:0/3218089177 learned_addr learned my addr 172.21.15.37:0/3218089177 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:48.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.448+0000 7f7772ffd700 1 --2- 172.21.15.37:0/3218089177 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f77740b42e0 0x7f77740cf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:48.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.448+0000 7f77737fe700 1 -- 172.21.15.37:0/3218089177 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f77740b42e0 msgr2=0x7f77740cf890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:48.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.448+0000 7f77737fe700 1 --2- 172.21.15.37:0/3218089177 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f77740b42e0 0x7f77740cf890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:48.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.448+0000 7f77737fe700 1 -- 172.21.15.37:0/3218089177 >> v1:172.21.15.37:6789/0 conn(0x7f77740cfdd0 legacy=0x7f77740b27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:48.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.448+0000 7f77727fc700 1 -- 172.21.15.37:0/3218089177 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1120526172 0 0) 0x7f77740b2610 con 0x7f77740cfdd0 2023-07-14T15:56:48.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.448+0000 7f77737fe700 1 -- 172.21.15.37:0/3218089177 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77740d1160 con 0x7f77740b2240 2023-07-14T15:56:48.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.449+0000 7f77737fe700 1 --2- 172.21.15.37:0/3218089177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77740b2240 0x7f77740d0a50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7764009840 tx=0x7f7764009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83f03d4592ce9978 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:48.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.449+0000 7f77727fc700 1 -- 172.21.15.37:0/3218089177 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7764011830 con 0x7f77740b2240 2023-07-14T15:56:48.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.449+0000 7f77727fc700 1 -- 172.21.15.37:0/3218089177 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7764011990 con 0x7f77740b2240 2023-07-14T15:56:48.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.449+0000 7f77727fc700 1 -- 172.21.15.37:0/3218089177 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7764011d20 con 0x7f77740b2240 2023-07-14T15:56:48.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.449+0000 7f777a1ff700 1 -- 172.21.15.37:0/3218089177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77740b2240 msgr2=0x7f77740d0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:48.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.449+0000 7f777a1ff700 1 --2- 172.21.15.37:0/3218089177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77740b2240 0x7f77740d0a50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7764009840 tx=0x7f7764009b50 comp rx=0 tx=0).stop 2023-07-14T15:56:48.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.449+0000 7f777a1ff700 1 -- 172.21.15.37:0/3218089177 shutdown_connections 2023-07-14T15:56:48.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.449+0000 7f777a1ff700 1 --2- 172.21.15.37:0/3218089177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77740b2240 0x7f77740d0a50 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:48.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.449+0000 7f777a1ff700 1 --2- 172.21.15.37:0/3218089177 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f77740b42e0 0x7f77740cf890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:48.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.449+0000 7f777a1ff700 1 -- 172.21.15.37:0/3218089177 >> 172.21.15.37:0/3218089177 conn(0x7f777409c170 msgr2=0x7f77740d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:48.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.450+0000 7f777a1ff700 1 -- 172.21.15.37:0/3218089177 shutdown_connections 2023-07-14T15:56:48.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.450+0000 7f777a1ff700 1 -- 172.21.15.37:0/3218089177 wait complete. 2023-07-14T15:56:48.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.451+0000 7f777a1ff700 1 Processor -- start 2023-07-14T15:56:48.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.451+0000 7f777a1ff700 1 -- start start 2023-07-14T15:56:48.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.452+0000 7f777a1ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f77740b2240 0x7f77741f1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:48.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.452+0000 7f777a1ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77740b42e0 0x7f777415d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:48.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.452+0000 7f777a1ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77740cfdd0 0x7f77740b7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:48.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.452+0000 7f777a1ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7774156070 con 0x7f77740b42e0 2023-07-14T15:56:48.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.452+0000 7f777a1ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77740c9ff0 con 0x7f77740cfdd0 2023-07-14T15:56:48.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.452+0000 7f777a1ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77740ca2d0 con 0x7f77740b2240 2023-07-14T15:56:48.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.453+0000 7f7772ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77740b42e0 0x7f777415d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:48.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.453+0000 7f7772ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77740b42e0 0x7f777415d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46102/0 (socket says 172.21.15.37:46102) 2023-07-14T15:56:48.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.453+0000 7f7772ffd700 1 -- 172.21.15.37:0/370695079 learned_addr learned my addr 172.21.15.37:0/370695079 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:48.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.453+0000 7f77737fe700 1 --2- 172.21.15.37:0/370695079 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f77740b2240 0x7f77741f1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:48.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.453+0000 7f7773fff700 1 --2- 172.21.15.37:0/370695079 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77740cfdd0 0x7f77740b7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:48.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.453+0000 7f7772ffd700 1 -- 172.21.15.37:0/370695079 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f77740b2240 msgr2=0x7f77741f1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:48.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.453+0000 7f7772ffd700 1 --2- 172.21.15.37:0/370695079 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f77740b2240 0x7f77741f1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:48.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.453+0000 7f7772ffd700 1 -- 172.21.15.37:0/370695079 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77740cfdd0 msgr2=0x7f77740b7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:48.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.453+0000 7f7772ffd700 1 --2- 172.21.15.37:0/370695079 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77740cfdd0 0x7f77740b7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:48.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.453+0000 7f7772ffd700 1 -- 172.21.15.37:0/370695079 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77640094a0 con 0x7f77740b42e0 2023-07-14T15:56:48.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.453+0000 7f77737fe700 1 --2- 172.21.15.37:0/370695079 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f77740b2240 0x7f77741f1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:56:48.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.453+0000 7f7773fff700 1 --2- 172.21.15.37:0/370695079 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77740cfdd0 0x7f77740b7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:56:48.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.453+0000 7f7772ffd700 1 --2- 172.21.15.37:0/370695079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77740b42e0 0x7f777415d570 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f776800e810 tx=0x7f776800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:48.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.454+0000 7f775bfff700 1 -- 172.21.15.37:0/370695079 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7768013610 con 0x7f77740b42e0 2023-07-14T15:56:48.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.454+0000 7f775bfff700 1 -- 172.21.15.37:0/370695079 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7768013770 con 0x7f77740b42e0 2023-07-14T15:56:48.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.454+0000 7f775bfff700 1 -- 172.21.15.37:0/370695079 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7768013b20 con 0x7f77740b42e0 2023-07-14T15:56:48.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.454+0000 7f777a1ff700 1 -- 172.21.15.37:0/370695079 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77740ca5b0 con 0x7f77740b42e0 2023-07-14T15:56:48.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.454+0000 7f777a1ff700 1 -- 172.21.15.37:0/370695079 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77740cab70 con 0x7f77740b42e0 2023-07-14T15:56:48.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.455+0000 7f777a1ff700 1 -- 172.21.15.37:0/370695079 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77740cf700 con 0x7f77740b42e0 2023-07-14T15:56:48.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.456+0000 7f775bfff700 1 -- 172.21.15.37:0/370695079 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7768013c80 con 0x7f77740b42e0 2023-07-14T15:56:48.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.457+0000 7f775bfff700 1 --2- 172.21.15.37:0/370695079 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f776006ace0 0x7f776006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:48.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.457+0000 7f775bfff700 1 -- 172.21.15.37:0/370695079 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f77680891f0 con 0x7f77740b42e0 2023-07-14T15:56:48.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.457+0000 7f77737fe700 1 --2- 172.21.15.37:0/370695079 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f776006ace0 0x7f776006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:48.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.458+0000 7f77737fe700 1 --2- 172.21.15.37:0/370695079 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f776006ace0 0x7f776006d190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f77640090b0 tx=0x7f7764008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:48.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.461+0000 7f775bfff700 1 -- 172.21.15.37:0/370695079 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7768054210 con 0x7f77740b42e0 2023-07-14T15:56:48.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.669+0000 7f777a1ff700 1 -- 172.21.15.37:0/370695079 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f777404e210 con 0x7f77740b42e0 2023-07-14T15:56:48.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.669+0000 7f775bfff700 1 -- 172.21.15.37:0/370695079 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7768057830 con 0x7f77740b42e0 2023-07-14T15:56:48.655 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-14T15:56:48.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.672+0000 7f777a1ff700 1 -- 172.21.15.37:0/370695079 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f776006ace0 msgr2=0x7f776006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:48.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.672+0000 7f777a1ff700 1 --2- 172.21.15.37:0/370695079 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f776006ace0 0x7f776006d190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f77640090b0 tx=0x7f7764008030 comp rx=0 tx=0).stop 2023-07-14T15:56:48.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.672+0000 7f777a1ff700 1 -- 172.21.15.37:0/370695079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77740b42e0 msgr2=0x7f777415d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:48.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.672+0000 7f777a1ff700 1 --2- 172.21.15.37:0/370695079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77740b42e0 0x7f777415d570 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f776800e810 tx=0x7f776800ebd0 comp rx=0 tx=0).stop 2023-07-14T15:56:48.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.672+0000 7f777a1ff700 1 -- 172.21.15.37:0/370695079 shutdown_connections 2023-07-14T15:56:48.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.672+0000 7f777a1ff700 1 --2- 172.21.15.37:0/370695079 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77740cfdd0 0x7f77740b7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:48.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.672+0000 7f777a1ff700 1 --2- 172.21.15.37:0/370695079 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f776006ace0 0x7f776006d190 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:48.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.672+0000 7f777a1ff700 1 --2- 172.21.15.37:0/370695079 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f77740b2240 0x7f77741f1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:48.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.672+0000 7f777a1ff700 1 --2- 172.21.15.37:0/370695079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77740b42e0 0x7f777415d570 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:48.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.672+0000 7f777a1ff700 1 -- 172.21.15.37:0/370695079 >> 172.21.15.37:0/370695079 conn(0x7f777409c170 msgr2=0x7f77740b3240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:48.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.672+0000 7f777a1ff700 1 -- 172.21.15.37:0/370695079 shutdown_connections 2023-07-14T15:56:48.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.672+0000 7f777a1ff700 1 -- 172.21.15.37:0/370695079 wait complete. 2023-07-14T15:56:48.675 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T15:56:48.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.894+0000 7f0b385ff700 1 Processor -- start 2023-07-14T15:56:48.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.894+0000 7f0b385ff700 1 -- start start 2023-07-14T15:56:48.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.895+0000 7f0b385ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0b300d1140 0x7f0b3015ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:48.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.895+0000 7f0b385ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f0b301603b0 0x7f0b300b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:48.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.895+0000 7f0b385ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b3015dc50 con 0x7f0b3015fee0 2023-07-14T15:56:48.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.895+0000 7f0b385ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b300b2940 con 0x7f0b301603b0 2023-07-14T15:56:48.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.895+0000 7f0b385ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b300b2c20 con 0x7f0b300d1140 2023-07-14T15:56:48.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.895+0000 7f0b3639b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0b3015fee0 0x7f0b300d0a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35888/0 (socket says 172.21.15.37:35888) 2023-07-14T15:56:48.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.895+0000 7f0b3639b700 1 -- 172.21.15.37:0/4020788907 learned_addr learned my addr 172.21.15.37:0/4020788907 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:48.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.896+0000 7f0b35b9a700 1 --2- 172.21.15.37:0/4020788907 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0b300d1140 0x7f0b3015ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:48.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.896+0000 7f0b36b9c700 1 --2- 172.21.15.37:0/4020788907 >> v2:172.21.15.98:3300/0 conn(0x7f0b301603b0 0x7f0b300b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:48.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.896+0000 7f0b35399700 1 -- 172.21.15.37:0/4020788907 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2402337281 0 0) 0x7f0b3015dc50 con 0x7f0b3015fee0 2023-07-14T15:56:48.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.896+0000 7f0b35399700 1 -- 172.21.15.37:0/4020788907 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b1c0035b0 con 0x7f0b3015fee0 2023-07-14T15:56:48.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.896+0000 7f0b35399700 1 -- 172.21.15.37:0/4020788907 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 305281877 0 0) 0x7f0b1c0035b0 con 0x7f0b3015fee0 2023-07-14T15:56:48.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.896+0000 7f0b36b9c700 1 -- 172.21.15.37:0/4020788907 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0b300d1140 msgr2=0x7f0b3015ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:48.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.896+0000 7f0b36b9c700 1 --2- 172.21.15.37:0/4020788907 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0b300d1140 0x7f0b3015ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:48.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.896+0000 7f0b36b9c700 1 -- 172.21.15.37:0/4020788907 >> v1:172.21.15.37:6789/0 conn(0x7f0b3015fee0 legacy=0x7f0b300d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:48.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.896+0000 7f0b36b9c700 1 -- 172.21.15.37:0/4020788907 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b300b2f00 con 0x7f0b301603b0 2023-07-14T15:56:48.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.896+0000 7f0b35b9a700 1 --2- 172.21.15.37:0/4020788907 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0b300d1140 0x7f0b3015ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:56:48.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.896+0000 7f0b36b9c700 1 --2- 172.21.15.37:0/4020788907 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b301603b0 0x7f0b300b39e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0b28009d90 tx=0x7f0b2800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73589d1830026f7f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:48.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.897+0000 7f0b35399700 1 -- 172.21.15.37:0/4020788907 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2800e070 con 0x7f0b301603b0 2023-07-14T15:56:48.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.897+0000 7f0b35399700 1 -- 172.21.15.37:0/4020788907 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b28003a20 con 0x7f0b301603b0 2023-07-14T15:56:48.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.897+0000 7f0b35399700 1 -- 172.21.15.37:0/4020788907 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2c001670 con 0x7f0b301603b0 2023-07-14T15:56:48.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.897+0000 7f0b385ff700 1 -- 172.21.15.37:0/4020788907 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b301603b0 msgr2=0x7f0b300b39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:48.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.897+0000 7f0b385ff700 1 --2- 172.21.15.37:0/4020788907 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b301603b0 0x7f0b300b39e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0b28009d90 tx=0x7f0b2800b330 comp rx=0 tx=0).stop 2023-07-14T15:56:48.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.898+0000 7f0b385ff700 1 -- 172.21.15.37:0/4020788907 shutdown_connections 2023-07-14T15:56:48.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.898+0000 7f0b385ff700 1 --2- 172.21.15.37:0/4020788907 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b301603b0 0x7f0b300b39e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:48.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.898+0000 7f0b385ff700 1 --2- 172.21.15.37:0/4020788907 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0b300d1140 0x7f0b3015ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:48.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.898+0000 7f0b385ff700 1 -- 172.21.15.37:0/4020788907 >> 172.21.15.37:0/4020788907 conn(0x7f0b3009c1b0 msgr2=0x7f0b300d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:48.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.898+0000 7f0b385ff700 1 -- 172.21.15.37:0/4020788907 shutdown_connections 2023-07-14T15:56:48.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.898+0000 7f0b385ff700 1 -- 172.21.15.37:0/4020788907 wait complete. 2023-07-14T15:56:48.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.899+0000 7f0b385ff700 1 Processor -- start 2023-07-14T15:56:48.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.900+0000 7f0b385ff700 1 -- start start 2023-07-14T15:56:48.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.901+0000 7f0b385ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b300d1140 0x7f0b300c6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:48.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.901+0000 7f0b385ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b3015fee0 0x7f0b3009cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:48.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.901+0000 7f0b385ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0b301603b0 0x7f0b300c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:48.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.901+0000 7f0b385ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b300c70e0 con 0x7f0b3015fee0 2023-07-14T15:56:48.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.901+0000 7f0b385ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b300c73c0 con 0x7f0b300d1140 2023-07-14T15:56:48.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.901+0000 7f0b385ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b300c76a0 con 0x7f0b301603b0 2023-07-14T15:56:48.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.901+0000 7f0b35b9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b3015fee0 0x7f0b3009cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:48.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.901+0000 7f0b35b9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b3015fee0 0x7f0b3009cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46108/0 (socket says 172.21.15.37:46108) 2023-07-14T15:56:48.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.901+0000 7f0b35b9a700 1 -- 172.21.15.37:0/728954266 learned_addr learned my addr 172.21.15.37:0/728954266 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:48.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.901+0000 7f0b3639b700 1 --2- 172.21.15.37:0/728954266 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b300d1140 0x7f0b300c6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:48.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.901+0000 7f0b36b9c700 1 --2- 172.21.15.37:0/728954266 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0b301603b0 0x7f0b300c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:48.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.901+0000 7f0b35b9a700 1 -- 172.21.15.37:0/728954266 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0b301603b0 msgr2=0x7f0b300c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:48.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.901+0000 7f0b35b9a700 1 --2- 172.21.15.37:0/728954266 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0b301603b0 0x7f0b300c8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:48.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.901+0000 7f0b35b9a700 1 -- 172.21.15.37:0/728954266 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b300d1140 msgr2=0x7f0b300c6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:48.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.901+0000 7f0b35b9a700 1 --2- 172.21.15.37:0/728954266 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b300d1140 0x7f0b300c6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:48.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.901+0000 7f0b35b9a700 1 -- 172.21.15.37:0/728954266 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b200094a0 con 0x7f0b3015fee0 2023-07-14T15:56:48.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.902+0000 7f0b35b9a700 1 --2- 172.21.15.37:0/728954266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b3015fee0 0x7f0b3009cb20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0b2000e9b0 tx=0x7f0b2000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:48.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.902+0000 7f0b26ffd700 1 -- 172.21.15.37:0/728954266 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2000ee50 con 0x7f0b3015fee0 2023-07-14T15:56:48.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.902+0000 7f0b26ffd700 1 -- 172.21.15.37:0/728954266 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b2000c850 con 0x7f0b3015fee0 2023-07-14T15:56:48.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.902+0000 7f0b385ff700 1 -- 172.21.15.37:0/728954266 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b28009a70 con 0x7f0b3015fee0 2023-07-14T15:56:48.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.902+0000 7f0b26ffd700 1 -- 172.21.15.37:0/728954266 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2000cc00 con 0x7f0b3015fee0 2023-07-14T15:56:48.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.902+0000 7f0b385ff700 1 -- 172.21.15.37:0/728954266 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b300c7c60 con 0x7f0b3015fee0 2023-07-14T15:56:48.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.903+0000 7f0b385ff700 1 -- 172.21.15.37:0/728954266 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b30067840 con 0x7f0b3015fee0 2023-07-14T15:56:48.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.904+0000 7f0b26ffd700 1 -- 172.21.15.37:0/728954266 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0b20013470 con 0x7f0b3015fee0 2023-07-14T15:56:48.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.905+0000 7f0b26ffd700 1 --2- 172.21.15.37:0/728954266 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0b1406ace0 0x7f0b1406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:48.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.905+0000 7f0b26ffd700 1 -- 172.21.15.37:0/728954266 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0b20089120 con 0x7f0b3015fee0 2023-07-14T15:56:48.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.906+0000 7f0b3639b700 1 --2- 172.21.15.37:0/728954266 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0b1406ace0 0x7f0b1406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:48.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.906+0000 7f0b3639b700 1 --2- 172.21.15.37:0/728954266 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0b1406ace0 0x7f0b1406d190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c0011e0 tx=0x7f0b2c001da0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:48.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:48.909+0000 7f0b26ffd700 1 -- 172.21.15.37:0/728954266 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0b20057c50 con 0x7f0b3015fee0 2023-07-14T15:56:49.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.120+0000 7f0b385ff700 1 -- 172.21.15.37:0/728954266 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0b300d1700 con 0x7f0b3015fee0 2023-07-14T15:56:49.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.120+0000 7f0b26ffd700 1 -- 172.21.15.37:0/728954266 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0b200577e0 con 0x7f0b3015fee0 2023-07-14T15:56:49.106 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-14T15:56:49.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.123+0000 7f0b385ff700 1 -- 172.21.15.37:0/728954266 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0b1406ace0 msgr2=0x7f0b1406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:49.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.123+0000 7f0b385ff700 1 --2- 172.21.15.37:0/728954266 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0b1406ace0 0x7f0b1406d190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c0011e0 tx=0x7f0b2c001da0 comp rx=0 tx=0).stop 2023-07-14T15:56:49.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.123+0000 7f0b385ff700 1 -- 172.21.15.37:0/728954266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b3015fee0 msgr2=0x7f0b3009cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:49.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.123+0000 7f0b385ff700 1 --2- 172.21.15.37:0/728954266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b3015fee0 0x7f0b3009cb20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0b2000e9b0 tx=0x7f0b2000ecc0 comp rx=0 tx=0).stop 2023-07-14T15:56:49.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.123+0000 7f0b385ff700 1 -- 172.21.15.37:0/728954266 shutdown_connections 2023-07-14T15:56:49.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.123+0000 7f0b385ff700 1 --2- 172.21.15.37:0/728954266 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b300d1140 0x7f0b300c6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:49.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.123+0000 7f0b385ff700 1 --2- 172.21.15.37:0/728954266 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0b1406ace0 0x7f0b1406d190 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:49.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.123+0000 7f0b385ff700 1 --2- 172.21.15.37:0/728954266 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0b301603b0 0x7f0b300c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:49.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.123+0000 7f0b385ff700 1 --2- 172.21.15.37:0/728954266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b3015fee0 0x7f0b3009cb20 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:49.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.123+0000 7f0b385ff700 1 -- 172.21.15.37:0/728954266 >> 172.21.15.37:0/728954266 conn(0x7f0b3009c1b0 msgr2=0x7f0b3006ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:49.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.123+0000 7f0b385ff700 1 -- 172.21.15.37:0/728954266 shutdown_connections 2023-07-14T15:56:49.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.123+0000 7f0b385ff700 1 -- 172.21.15.37:0/728954266 wait complete. 2023-07-14T15:56:49.126 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T15:56:49.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.342+0000 7f72ebdff700 1 Processor -- start 2023-07-14T15:56:49.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.343+0000 7f72ebdff700 1 -- start start 2023-07-14T15:56:49.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.344+0000 7f72ebdff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f72e40b4910 0x7f72e40b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:49.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.344+0000 7f72ebdff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72e40cf6b0 con 0x7f72e40b85f0 2023-07-14T15:56:49.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.344+0000 7f72ebdff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72e40b5270 con 0x7f72e40b54b0 2023-07-14T15:56:49.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.344+0000 7f72ebdff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72e40cdc40 con 0x7f72e40b4910 2023-07-14T15:56:49.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.344+0000 7f72ea39c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f72e40b4910 0x7f72e40b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:49.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.344+0000 7f72e9b9b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f72e40b85f0 0x7f72e415d660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35900/0 (socket says 172.21.15.37:35900) 2023-07-14T15:56:49.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.344+0000 7f72e9b9b700 1 -- 172.21.15.37:0/2081605202 learned_addr learned my addr 172.21.15.37:0/2081605202 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:49.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.344+0000 7f72ea39c700 1 -- 172.21.15.37:0/2081605202 >> v1:172.21.15.98:6789/0 conn(0x7f72e40b54b0 legacy=0x7f72e40cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:49.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.344+0000 7f72ea39c700 1 -- 172.21.15.37:0/2081605202 >> v1:172.21.15.37:6789/0 conn(0x7f72e40b85f0 legacy=0x7f72e415d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:49.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.344+0000 7f72ea39c700 1 -- 172.21.15.37:0/2081605202 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e40d0250 con 0x7f72e40b4910 2023-07-14T15:56:49.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.345+0000 7f72ea39c700 1 --2- 172.21.15.37:0/2081605202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72e40b4910 0x7f72e40b4d30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f72dc009d90 tx=0x7f72dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d95351f2f50878a7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:49.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.345+0000 7f72e8b99700 1 -- 172.21.15.37:0/2081605202 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72dc00e070 con 0x7f72e40b4910 2023-07-14T15:56:49.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.345+0000 7f72e8b99700 1 -- 172.21.15.37:0/2081605202 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72dc00bb90 con 0x7f72e40b4910 2023-07-14T15:56:49.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.345+0000 7f72e8b99700 1 -- 172.21.15.37:0/2081605202 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72dc003a20 con 0x7f72e40b4910 2023-07-14T15:56:49.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.345+0000 7f72ebdff700 1 -- 172.21.15.37:0/2081605202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72e40b4910 msgr2=0x7f72e40b4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:49.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.345+0000 7f72ebdff700 1 --2- 172.21.15.37:0/2081605202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72e40b4910 0x7f72e40b4d30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f72dc009d90 tx=0x7f72dc00b330 comp rx=0 tx=0).stop 2023-07-14T15:56:49.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.346+0000 7f72ebdff700 1 -- 172.21.15.37:0/2081605202 shutdown_connections 2023-07-14T15:56:49.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.346+0000 7f72ebdff700 1 --2- 172.21.15.37:0/2081605202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72e40b4910 0x7f72e40b4d30 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:49.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.346+0000 7f72ebdff700 1 -- 172.21.15.37:0/2081605202 >> 172.21.15.37:0/2081605202 conn(0x7f72e406a580 msgr2=0x7f72e406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:49.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.346+0000 7f72ebdff700 1 -- 172.21.15.37:0/2081605202 shutdown_connections 2023-07-14T15:56:49.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.346+0000 7f72ebdff700 1 -- 172.21.15.37:0/2081605202 wait complete. 2023-07-14T15:56:49.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.347+0000 7f72ebdff700 1 Processor -- start 2023-07-14T15:56:49.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.348+0000 7f72ebdff700 1 -- start start 2023-07-14T15:56:49.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.348+0000 7f72ebdff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72e40b4910 0x7f72e40c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:49.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.348+0000 7f72ebdff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f72e40b54b0 0x7f72e40c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:49.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.348+0000 7f72ebdff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f72e40b85f0 0x7f72e415e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:49.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.349+0000 7f72ebdff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e40c7ee0 con 0x7f72e40b4910 2023-07-14T15:56:49.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.349+0000 7f72ebdff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e40c81c0 con 0x7f72e40b54b0 2023-07-14T15:56:49.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.349+0000 7f72ebdff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e40c84a0 con 0x7f72e40b85f0 2023-07-14T15:56:49.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.349+0000 7f72e9b9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72e40b4910 0x7f72e40c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:49.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.349+0000 7f72e9b9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72e40b4910 0x7f72e40c5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46134/0 (socket says 172.21.15.37:46134) 2023-07-14T15:56:49.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.349+0000 7f72e9b9b700 1 -- 172.21.15.37:0/2836132459 learned_addr learned my addr 172.21.15.37:0/2836132459 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:49.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.349+0000 7f72e939a700 1 --2- 172.21.15.37:0/2836132459 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f72e40b54b0 0x7f72e40c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:49.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.349+0000 7f72ea39c700 1 --2- 172.21.15.37:0/2836132459 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f72e40b85f0 0x7f72e415e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:49.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.349+0000 7f72e9b9b700 1 -- 172.21.15.37:0/2836132459 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f72e40b85f0 msgr2=0x7f72e415e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:49.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.349+0000 7f72e9b9b700 1 --2- 172.21.15.37:0/2836132459 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f72e40b85f0 0x7f72e415e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:49.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.349+0000 7f72e9b9b700 1 -- 172.21.15.37:0/2836132459 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f72e40b54b0 msgr2=0x7f72e40c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:49.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.349+0000 7f72e9b9b700 1 --2- 172.21.15.37:0/2836132459 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f72e40b54b0 0x7f72e40c8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:49.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.349+0000 7f72e9b9b700 1 -- 172.21.15.37:0/2836132459 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72dc009a70 con 0x7f72e40b4910 2023-07-14T15:56:49.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.349+0000 7f72e9b9b700 1 --2- 172.21.15.37:0/2836132459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72e40b4910 0x7f72e40c5d80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f72e000c430 tx=0x7f72e000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:49.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.350+0000 7f72da7fc700 1 -- 172.21.15.37:0/2836132459 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e0005d70 con 0x7f72e40b4910 2023-07-14T15:56:49.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.350+0000 7f72da7fc700 1 -- 172.21.15.37:0/2836132459 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e00070d0 con 0x7f72e40b4910 2023-07-14T15:56:49.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.350+0000 7f72ebdff700 1 -- 172.21.15.37:0/2836132459 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72e40c8780 con 0x7f72e40b4910 2023-07-14T15:56:49.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.350+0000 7f72da7fc700 1 -- 172.21.15.37:0/2836132459 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e0007460 con 0x7f72e40b4910 2023-07-14T15:56:49.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.350+0000 7f72ebdff700 1 -- 172.21.15.37:0/2836132459 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72e40c62c0 con 0x7f72e40b4910 2023-07-14T15:56:49.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.351+0000 7f72ebdff700 1 -- 172.21.15.37:0/2836132459 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72e40c8ca0 con 0x7f72e40b4910 2023-07-14T15:56:49.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.352+0000 7f72da7fc700 1 -- 172.21.15.37:0/2836132459 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f72e00075c0 con 0x7f72e40b4910 2023-07-14T15:56:49.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.353+0000 7f72da7fc700 1 --2- 172.21.15.37:0/2836132459 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f72c806ad10 0x7f72c806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:49.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.353+0000 7f72da7fc700 1 -- 172.21.15.37:0/2836132459 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f72e0088990 con 0x7f72e40b4910 2023-07-14T15:56:49.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.353+0000 7f72e939a700 1 --2- 172.21.15.37:0/2836132459 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f72c806ad10 0x7f72c806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:49.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.354+0000 7f72e939a700 1 --2- 172.21.15.37:0/2836132459 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f72c806ad10 0x7f72c806d1c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f72e41541d0 tx=0x7f72d4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:49.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.357+0000 7f72da7fc700 1 -- 172.21.15.37:0/2836132459 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f72e40c8ca0 con 0x7f72e40b4910 2023-07-14T15:56:49.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.566+0000 7f72ebdff700 1 -- 172.21.15.37:0/2836132459 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f72e40c8ca0 con 0x7f72e40b4910 2023-07-14T15:56:49.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.568+0000 7f72da7fc700 1 -- 172.21.15.37:0/2836132459 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18341 (secure 0 0 0) 0x7f72e40c8ca0 con 0x7f72e40b4910 2023-07-14T15:56:49.553 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:56:49.554 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"fsid":"9da30401-a779-4e46-aba6-00c2494c6c67","created":"2023-07-14T15:55:39.898867+0000","modified":"2023-07-14T15:56:09.959850+0000","last_up_change":"2023-07-14T15:55:53.025696+0000","last_in_change":"2023-07-14T15:55:43.388192+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T15:55:52.907261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T15:55:59.992839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T15:56:06.091064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T15:56:07.448694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d049535-7b87-4276-8fe5-0f74ba422d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6801","nonce":2783032392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6803","nonce":2783032392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6807","nonce":2783032392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6805","nonce":2783032392}]},"public_addr":"172.21.15.37:6801/2783032392","cluster_addr":"172.21.15.37:6803/2783032392","heartbeat_back_addr":"172.21.15.37:6807/2783032392","heartbeat_front_addr":"172.21.15.37:6805/2783032392","state":["exists","up"]},{"osd":1,"uuid":"79ec948d-ead2-4c2d-923a-dd6eeaac9dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6823","nonce":1190059746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6826","nonce":1190059746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6831","nonce":1190059746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6829","nonce":1190059746}]},"public_addr":"172.21.15.37:6823/1190059746","cluster_addr":"172.21.15.37:6826/1190059746","heartbeat_back_addr":"172.21.15.37:6831/1190059746","heartbeat_front_addr":"172.21.15.37:6829/1190059746","state":["exists","up"]},{"osd":2,"uuid":"a1db6690-c160-4366-9c82-2cca17e4bba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6809","nonce":2266223499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6813","nonce":2266223499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6820","nonce":2266223499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6816","nonce":2266223499}]},"public_addr":"172.21.15.37:6809/2266223499","cluster_addr":"172.21.15.37:6813/2266223499","heartbeat_back_addr":"172.21.15.37:6820/2266223499","heartbeat_front_addr":"172.21.15.37:6816/2266223499","state":["exists","up"]},{"osd":3,"uuid":"767b8220-e79a-4a86-a162-6b3b73198379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6812","nonce":4166694594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6817","nonce":4166694594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6828","nonce":4166694594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6822","nonce":4166694594}]},"public_addr":"172.21.15.37:6812/4166694594","cluster_addr":"172.21.15.37:6817/4166694594","heartbeat_back_addr":"172.21.15.37:6828/4166694594","heartbeat_front_addr":"172.21.15.37:6822/4166694594","state":["exists","up"]},{"osd":4,"uuid":"717bd773-ae7e-4236-ac79-900cf99a37c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6801","nonce":3529020407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6803","nonce":3529020407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6807","nonce":3529020407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6805","nonce":3529020407}]},"public_addr":"172.21.15.98:6801/3529020407","cluster_addr":"172.21.15.98:6803/3529020407","heartbeat_back_addr":"172.21.15.98:6807/3529020407","heartbeat_front_addr":"172.21.15.98:6805/3529020407","state":["exists","up"]},{"osd":5,"uuid":"a941d358-0f03-4136-a9b2-3a1c2e9358cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6817","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6819","nonce":2311501838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6821","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6823","nonce":2311501838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6829","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6831","nonce":2311501838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6825","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6827","nonce":2311501838}]},"public_addr":"172.21.15.98:6819/2311501838","cluster_addr":"172.21.15.98:6823/2311501838","heartbeat_back_addr":"172.21.15.98:6831/2311501838","heartbeat_front_addr":"172.21.15.98:6827/2311501838","state":["exists","up"]},{"osd":6,"uuid":"27153772-6d4b-479d-9953-0582e7b96743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6809","nonce":1144224691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6811","nonce":1144224691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6815","nonce":1144224691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6813","nonce":1144224691}]},"public_addr":"172.21.15.98:6809/1144224691","cluster_addr":"172.21.15.98:6811/1144224691","heartbeat_back_addr":"172.21.15.98:6815/1144224691","heartbeat_front_addr":"172.21.15.98:6813/1144224691","state":["exists","up"]},{"osd":7,"uuid":"d21ffc8e-40bb-47eb-af2c-e3e730d3fb76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6818","nonce":1144470927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6822","nonce":1144470927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6830","nonce":1144470927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6826","nonce":1144470927}]},"public_addr":"172.21.15.98:6818/1144470927","cluster_addr":"172.21.15.98:6822/1144470927","heartbeat_back_addr":"172.21.15.98:6830/1144470927","heartbeat_front_addr":"172.21.15.98:6826/1144470927","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.921114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.739210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.024016+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.002527+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.698127+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.813416+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.709351+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.815457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T15:56:49.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.570+0000 7f72ebdff700 1 -- 172.21.15.37:0/2836132459 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f72c806ad10 msgr2=0x7f72c806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:49.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.570+0000 7f72ebdff700 1 --2- 172.21.15.37:0/2836132459 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f72c806ad10 0x7f72c806d1c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f72e41541d0 tx=0x7f72d4009040 comp rx=0 tx=0).stop 2023-07-14T15:56:49.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.570+0000 7f72ebdff700 1 -- 172.21.15.37:0/2836132459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72e40b4910 msgr2=0x7f72e40c5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:49.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.570+0000 7f72ebdff700 1 --2- 172.21.15.37:0/2836132459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72e40b4910 0x7f72e40c5d80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f72e000c430 tx=0x7f72e000c7f0 comp rx=0 tx=0).stop 2023-07-14T15:56:49.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.570+0000 7f72ebdff700 1 -- 172.21.15.37:0/2836132459 shutdown_connections 2023-07-14T15:56:49.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.570+0000 7f72ebdff700 1 --2- 172.21.15.37:0/2836132459 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f72c806ad10 0x7f72c806d1c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:49.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.570+0000 7f72ebdff700 1 --2- 172.21.15.37:0/2836132459 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f72e40b85f0 0x7f72e415e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:49.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.570+0000 7f72ebdff700 1 --2- 172.21.15.37:0/2836132459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72e40b4910 0x7f72e40c5d80 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:49.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.570+0000 7f72ebdff700 1 --2- 172.21.15.37:0/2836132459 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f72e40b54b0 0x7f72e40c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:49.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.570+0000 7f72ebdff700 1 -- 172.21.15.37:0/2836132459 >> 172.21.15.37:0/2836132459 conn(0x7f72e406a580 msgr2=0x7f72e415c320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:49.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.570+0000 7f72ebdff700 1 -- 172.21.15.37:0/2836132459 shutdown_connections 2023-07-14T15:56:49.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.570+0000 7f72ebdff700 1 -- 172.21.15.37:0/2836132459 wait complete. 2023-07-14T15:56:49.574 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T15:55:52.907261+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T15:55:59.992839+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T15:56:06.091064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T15:56:07.448694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T15:56:49.575 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T15:56:49.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.796+0000 7f06f53ff700 1 Processor -- start 2023-07-14T15:56:49.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.796+0000 7f06f53ff700 1 -- start start 2023-07-14T15:56:49.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.797+0000 7f06f53ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f06f00d1140 0x7f06f015ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:49.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.797+0000 7f06f53ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f06f01603b0 0x7f06f00b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:49.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.797+0000 7f06f53ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06f015dc50 con 0x7f06f015fee0 2023-07-14T15:56:49.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.797+0000 7f06f53ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06f00b2940 con 0x7f06f00d1140 2023-07-14T15:56:49.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.797+0000 7f06f53ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06f00b2c20 con 0x7f06f01603b0 2023-07-14T15:56:49.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.797+0000 7f06ee7fc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f06f00d1140 0x7f06f015ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:49.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.797+0000 7f06eeffd700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f06f015fee0 0x7f06f00d0a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35912/0 (socket says 172.21.15.37:35912) 2023-07-14T15:56:49.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.797+0000 7f06ee7fc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f06f00d1140 0x7f06f015ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46150/0 (socket says 172.21.15.37:46150) 2023-07-14T15:56:49.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.797+0000 7f06eeffd700 1 -- 172.21.15.37:0/2859452698 learned_addr learned my addr 172.21.15.37:0/2859452698 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:49.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.798+0000 7f06ef7fe700 1 --2- 172.21.15.37:0/2859452698 >> v2:172.21.15.98:3300/0 conn(0x7f06f01603b0 0x7f06f00b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:49.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.798+0000 7f06ee7fc700 1 -- 172.21.15.37:0/2859452698 >> v2:172.21.15.98:3300/0 conn(0x7f06f01603b0 msgr2=0x7f06f00b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:49.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.798+0000 7f06ee7fc700 1 --2- 172.21.15.37:0/2859452698 >> v2:172.21.15.98:3300/0 conn(0x7f06f01603b0 0x7f06f00b39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:49.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.798+0000 7f06ee7fc700 1 -- 172.21.15.37:0/2859452698 >> v1:172.21.15.37:6789/0 conn(0x7f06f015fee0 legacy=0x7f06f00d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:49.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.798+0000 7f06ee7fc700 1 -- 172.21.15.37:0/2859452698 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f00b2f00 con 0x7f06f00d1140 2023-07-14T15:56:49.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.798+0000 7f06ef7fe700 1 --2- 172.21.15.37:0/2859452698 >> v2:172.21.15.98:3300/0 conn(0x7f06f01603b0 0x7f06f00b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:56:49.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.798+0000 7f06ee7fc700 1 --2- 172.21.15.37:0/2859452698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06f00d1140 0x7f06f015ded0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f06f00b8ee0 tx=0x7f06e4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ce2249af21c41dc server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:49.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.798+0000 7f06edffb700 1 -- 172.21.15.37:0/2859452698 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e4011830 con 0x7f06f00d1140 2023-07-14T15:56:49.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.798+0000 7f06edffb700 1 -- 172.21.15.37:0/2859452698 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e4011990 con 0x7f06f00d1140 2023-07-14T15:56:49.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.798+0000 7f06edffb700 1 -- 172.21.15.37:0/2859452698 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e4011d20 con 0x7f06f00d1140 2023-07-14T15:56:49.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.799+0000 7f06f53ff700 1 -- 172.21.15.37:0/2859452698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06f00d1140 msgr2=0x7f06f015ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:49.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.799+0000 7f06f53ff700 1 --2- 172.21.15.37:0/2859452698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06f00d1140 0x7f06f015ded0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f06f00b8ee0 tx=0x7f06e4009b20 comp rx=0 tx=0).stop 2023-07-14T15:56:49.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.799+0000 7f06f53ff700 1 -- 172.21.15.37:0/2859452698 shutdown_connections 2023-07-14T15:56:49.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.799+0000 7f06f53ff700 1 --2- 172.21.15.37:0/2859452698 >> v2:172.21.15.98:3300/0 conn(0x7f06f01603b0 0x7f06f00b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:49.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.799+0000 7f06f53ff700 1 --2- 172.21.15.37:0/2859452698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06f00d1140 0x7f06f015ded0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:49.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.799+0000 7f06f53ff700 1 -- 172.21.15.37:0/2859452698 >> 172.21.15.37:0/2859452698 conn(0x7f06f009c1b0 msgr2=0x7f06f00d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:49.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.799+0000 7f06f53ff700 1 -- 172.21.15.37:0/2859452698 shutdown_connections 2023-07-14T15:56:49.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.799+0000 7f06f53ff700 1 -- 172.21.15.37:0/2859452698 wait complete. 2023-07-14T15:56:49.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.801+0000 7f06f53ff700 1 Processor -- start 2023-07-14T15:56:49.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.801+0000 7f06f53ff700 1 -- start start 2023-07-14T15:56:49.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.802+0000 7f06f53ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06f00d1140 0x7f06f00c6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:49.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.802+0000 7f06f53ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f06f015fee0 0x7f06f00b6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:49.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.802+0000 7f06f53ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06f01603b0 0x7f06f01550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:49.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.802+0000 7f06f53ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f00b6d70 con 0x7f06f00d1140 2023-07-14T15:56:49.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.802+0000 7f06f53ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f00c7090 con 0x7f06f01603b0 2023-07-14T15:56:49.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.802+0000 7f06f53ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06f00c7370 con 0x7f06f015fee0 2023-07-14T15:56:49.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.802+0000 7f06eeffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06f00d1140 0x7f06f00c6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:49.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.802+0000 7f06eeffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06f00d1140 0x7f06f00c6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46164/0 (socket says 172.21.15.37:46164) 2023-07-14T15:56:49.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.802+0000 7f06eeffd700 1 -- 172.21.15.37:0/2328005189 learned_addr learned my addr 172.21.15.37:0/2328005189 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:49.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.802+0000 7f06ef7fe700 1 --2- 172.21.15.37:0/2328005189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06f01603b0 0x7f06f01550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:49.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.802+0000 7f06ee7fc700 1 --2- 172.21.15.37:0/2328005189 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f06f015fee0 0x7f06f00b6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:49.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.802+0000 7f06eeffd700 1 -- 172.21.15.37:0/2328005189 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f06f015fee0 msgr2=0x7f06f00b6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:49.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.802+0000 7f06eeffd700 1 --2- 172.21.15.37:0/2328005189 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f06f015fee0 0x7f06f00b6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:49.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.802+0000 7f06eeffd700 1 -- 172.21.15.37:0/2328005189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06f01603b0 msgr2=0x7f06f01550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:49.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.802+0000 7f06eeffd700 1 --2- 172.21.15.37:0/2328005189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06f01603b0 0x7f06f01550f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:49.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.802+0000 7f06eeffd700 1 -- 172.21.15.37:0/2328005189 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e40094a0 con 0x7f06f00d1140 2023-07-14T15:56:49.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.802+0000 7f06ee7fc700 1 --2- 172.21.15.37:0/2328005189 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f06f015fee0 0x7f06f00b6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:56:49.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.803+0000 7f06eeffd700 1 --2- 172.21.15.37:0/2328005189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06f00d1140 0x7f06f00c6990 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f06e000c520 tx=0x7f06e000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:49.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.803+0000 7f06d77fe700 1 -- 172.21.15.37:0/2328005189 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e0005d70 con 0x7f06f00d1140 2023-07-14T15:56:49.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.803+0000 7f06d77fe700 1 -- 172.21.15.37:0/2328005189 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e00070d0 con 0x7f06f00d1140 2023-07-14T15:56:49.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.803+0000 7f06f53ff700 1 -- 172.21.15.37:0/2328005189 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06f00c7650 con 0x7f06f00d1140 2023-07-14T15:56:49.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.803+0000 7f06d77fe700 1 -- 172.21.15.37:0/2328005189 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e0007440 con 0x7f06f00d1140 2023-07-14T15:56:49.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.803+0000 7f06f53ff700 1 -- 172.21.15.37:0/2328005189 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06f00c7c10 con 0x7f06f00d1140 2023-07-14T15:56:49.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.804+0000 7f06f53ff700 1 -- 172.21.15.37:0/2328005189 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06f0067840 con 0x7f06f00d1140 2023-07-14T15:56:49.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.805+0000 7f06d77fe700 1 -- 172.21.15.37:0/2328005189 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f06e00075a0 con 0x7f06f00d1140 2023-07-14T15:56:49.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.806+0000 7f06d77fe700 1 --2- 172.21.15.37:0/2328005189 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f06dc06ace0 0x7f06dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:49.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.806+0000 7f06d77fe700 1 -- 172.21.15.37:0/2328005189 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f06e0088930 con 0x7f06f00d1140 2023-07-14T15:56:49.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.806+0000 7f06ee7fc700 1 --2- 172.21.15.37:0/2328005189 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f06dc06ace0 0x7f06dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:49.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.807+0000 7f06ee7fc700 1 --2- 172.21.15.37:0/2328005189 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f06dc06ace0 0x7f06dc06d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f06f008b440 tx=0x7f06e4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:49.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:49.810+0000 7f06d77fe700 1 -- 172.21.15.37:0/2328005189 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f06e00539f0 con 0x7f06f00d1140 2023-07-14T15:56:50.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.018+0000 7f06f53ff700 1 -- 172.21.15.37:0/2328005189 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f06f00b3490 con 0x7f06f00d1140 2023-07-14T15:56:50.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.018+0000 7f06d77fe700 1 -- 172.21.15.37:0/2328005189 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f06e0057010 con 0x7f06f00d1140 2023-07-14T15:56:50.004 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-14T15:56:50.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.020+0000 7f06f53ff700 1 -- 172.21.15.37:0/2328005189 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f06dc06ace0 msgr2=0x7f06dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:50.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.020+0000 7f06f53ff700 1 --2- 172.21.15.37:0/2328005189 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f06dc06ace0 0x7f06dc06d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f06f008b440 tx=0x7f06e4008030 comp rx=0 tx=0).stop 2023-07-14T15:56:50.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.020+0000 7f06f53ff700 1 -- 172.21.15.37:0/2328005189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06f00d1140 msgr2=0x7f06f00c6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:50.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.020+0000 7f06f53ff700 1 --2- 172.21.15.37:0/2328005189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06f00d1140 0x7f06f00c6990 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f06e000c520 tx=0x7f06e000c8e0 comp rx=0 tx=0).stop 2023-07-14T15:56:50.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.020+0000 7f06f53ff700 1 -- 172.21.15.37:0/2328005189 shutdown_connections 2023-07-14T15:56:50.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.020+0000 7f06f53ff700 1 --2- 172.21.15.37:0/2328005189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06f01603b0 0x7f06f01550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:50.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.020+0000 7f06f53ff700 1 --2- 172.21.15.37:0/2328005189 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f06dc06ace0 0x7f06dc06d190 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:50.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.020+0000 7f06f53ff700 1 --2- 172.21.15.37:0/2328005189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06f00d1140 0x7f06f00c6990 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:50.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.020+0000 7f06f53ff700 1 --2- 172.21.15.37:0/2328005189 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f06f015fee0 0x7f06f00b6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:50.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.020+0000 7f06f53ff700 1 -- 172.21.15.37:0/2328005189 >> 172.21.15.37:0/2328005189 conn(0x7f06f009c1b0 msgr2=0x7f06f006be90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:50.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.020+0000 7f06f53ff700 1 -- 172.21.15.37:0/2328005189 shutdown_connections 2023-07-14T15:56:50.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.020+0000 7f06f53ff700 1 -- 172.21.15.37:0/2328005189 wait complete. 2023-07-14T15:56:50.024 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T15:56:50.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.244+0000 7f39d21ff700 1 Processor -- start 2023-07-14T15:56:50.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.245+0000 7f39d21ff700 1 -- start start 2023-07-14T15:56:50.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.246+0000 7f39d21ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f39cc1603b0 0x7f39cc15ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:50.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.246+0000 7f39d21ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39cc15dc50 con 0x7f39cc15fee0 2023-07-14T15:56:50.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.246+0000 7f39d21ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39cc0b2940 con 0x7f39cc0d1140 2023-07-14T15:56:50.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.246+0000 7f39d21ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39cc0b2c20 con 0x7f39cc1603b0 2023-07-14T15:56:50.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.246+0000 7f39cb7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f39cc15fee0 0x7f39cc0d0a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38004/0 (socket says 172.21.15.37:38004) 2023-07-14T15:56:50.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.246+0000 7f39cb7fe700 1 -- 172.21.15.37:0/394756342 learned_addr learned my addr 172.21.15.37:0/394756342 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:50.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.246+0000 7f39cbfff700 1 --2- 172.21.15.37:0/394756342 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f39cc1603b0 0x7f39cc15ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:50.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.247+0000 7f39ca7fc700 1 -- 172.21.15.37:0/394756342 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 211309650 0 0) 0x7f39cc15dc50 con 0x7f39cc15fee0 2023-07-14T15:56:50.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.247+0000 7f39ca7fc700 1 -- 172.21.15.37:0/394756342 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39b40035b0 con 0x7f39cc15fee0 2023-07-14T15:56:50.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.247+0000 7f39ca7fc700 1 -- 172.21.15.37:0/394756342 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1366781990 0 0) 0x7f39cc0b2940 con 0x7f39cc0d1140 2023-07-14T15:56:50.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.247+0000 7f39ca7fc700 1 -- 172.21.15.37:0/394756342 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39cc15dc50 con 0x7f39cc0d1140 2023-07-14T15:56:50.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.247+0000 7f39cbfff700 1 -- 172.21.15.37:0/394756342 >> v1:172.21.15.98:6789/0 conn(0x7f39cc0d1140 legacy=0x7f39cc0b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:50.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.247+0000 7f39cbfff700 1 -- 172.21.15.37:0/394756342 >> v1:172.21.15.37:6789/0 conn(0x7f39cc15fee0 legacy=0x7f39cc0d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:50.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.247+0000 7f39cbfff700 1 -- 172.21.15.37:0/394756342 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39cc0b2f00 con 0x7f39cc1603b0 2023-07-14T15:56:50.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.247+0000 7f39cbfff700 1 --2- 172.21.15.37:0/394756342 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f39cc1603b0 0x7f39cc15ded0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f39c4009dc0 tx=0x7f39c400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e29c2698e8e6ec29 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:50.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.247+0000 7f39ca7fc700 1 -- 172.21.15.37:0/394756342 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c400e070 con 0x7f39cc1603b0 2023-07-14T15:56:50.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.247+0000 7f39ca7fc700 1 -- 172.21.15.37:0/394756342 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c400bb20 con 0x7f39cc1603b0 2023-07-14T15:56:50.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.247+0000 7f39ca7fc700 1 -- 172.21.15.37:0/394756342 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c4012430 con 0x7f39cc1603b0 2023-07-14T15:56:50.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.248+0000 7f39d21ff700 1 -- 172.21.15.37:0/394756342 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f39cc1603b0 msgr2=0x7f39cc15ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:50.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.248+0000 7f39d21ff700 1 --2- 172.21.15.37:0/394756342 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f39cc1603b0 0x7f39cc15ded0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f39c4009dc0 tx=0x7f39c400b330 comp rx=0 tx=0).stop 2023-07-14T15:56:50.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.248+0000 7f39d21ff700 1 -- 172.21.15.37:0/394756342 shutdown_connections 2023-07-14T15:56:50.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.248+0000 7f39d21ff700 1 --2- 172.21.15.37:0/394756342 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f39cc1603b0 0x7f39cc15ded0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:50.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.248+0000 7f39d21ff700 1 -- 172.21.15.37:0/394756342 >> 172.21.15.37:0/394756342 conn(0x7f39cc09c1b0 msgr2=0x7f39cc0d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:50.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.248+0000 7f39d21ff700 1 -- 172.21.15.37:0/394756342 shutdown_connections 2023-07-14T15:56:50.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.248+0000 7f39d21ff700 1 -- 172.21.15.37:0/394756342 wait complete. 2023-07-14T15:56:50.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.250+0000 7f39d21ff700 1 Processor -- start 2023-07-14T15:56:50.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.251+0000 7f39d21ff700 1 -- start start 2023-07-14T15:56:50.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.252+0000 7f39d21ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f39cc0d1140 0x7f39cc0c6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:50.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.252+0000 7f39d21ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39cc15fee0 0x7f39cc0b0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:50.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.252+0000 7f39d21ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39cc1603b0 0x7f39cc0b0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:50.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.252+0000 7f39d21ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39cc148410 con 0x7f39cc15fee0 2023-07-14T15:56:50.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.252+0000 7f39d21ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39cc14ac30 con 0x7f39cc1603b0 2023-07-14T15:56:50.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.252+0000 7f39d21ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39cc0c7320 con 0x7f39cc0d1140 2023-07-14T15:56:50.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.252+0000 7f39caffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39cc15fee0 0x7f39cc0b0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:50.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.252+0000 7f39caffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39cc15fee0 0x7f39cc0b0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43120/0 (socket says 172.21.15.37:43120) 2023-07-14T15:56:50.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.252+0000 7f39caffd700 1 -- 172.21.15.37:0/3117739942 learned_addr learned my addr 172.21.15.37:0/3117739942 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:50.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.253+0000 7f39cb7fe700 1 --2- 172.21.15.37:0/3117739942 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f39cc0d1140 0x7f39cc0c6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:50.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.253+0000 7f39cbfff700 1 --2- 172.21.15.37:0/3117739942 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39cc1603b0 0x7f39cc0b0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:50.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.253+0000 7f39caffd700 1 -- 172.21.15.37:0/3117739942 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f39cc0d1140 msgr2=0x7f39cc0c6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:50.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.253+0000 7f39caffd700 1 --2- 172.21.15.37:0/3117739942 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f39cc0d1140 0x7f39cc0c6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:50.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.253+0000 7f39caffd700 1 -- 172.21.15.37:0/3117739942 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39cc1603b0 msgr2=0x7f39cc0b0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:50.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.253+0000 7f39caffd700 1 --2- 172.21.15.37:0/3117739942 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39cc1603b0 0x7f39cc0b0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:50.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.253+0000 7f39caffd700 1 -- 172.21.15.37:0/3117739942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c4009a70 con 0x7f39cc15fee0 2023-07-14T15:56:50.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.253+0000 7f39caffd700 1 --2- 172.21.15.37:0/3117739942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39cc15fee0 0x7f39cc0b0a60 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f39c000c4d0 tx=0x7f39c000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:50.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.253+0000 7f39b3fff700 1 -- 172.21.15.37:0/3117739942 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c00052d0 con 0x7f39cc15fee0 2023-07-14T15:56:50.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.253+0000 7f39b3fff700 1 -- 172.21.15.37:0/3117739942 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c0005430 con 0x7f39cc15fee0 2023-07-14T15:56:50.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.253+0000 7f39d21ff700 1 -- 172.21.15.37:0/3117739942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39cc14a950 con 0x7f39cc15fee0 2023-07-14T15:56:50.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.253+0000 7f39b3fff700 1 -- 172.21.15.37:0/3117739942 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c00038a0 con 0x7f39cc15fee0 2023-07-14T15:56:50.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.253+0000 7f39d21ff700 1 -- 172.21.15.37:0/3117739942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39cc1480a0 con 0x7f39cc15fee0 2023-07-14T15:56:50.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.255+0000 7f39d21ff700 1 -- 172.21.15.37:0/3117739942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39cc0b1b80 con 0x7f39cc15fee0 2023-07-14T15:56:50.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.255+0000 7f39b3fff700 1 -- 172.21.15.37:0/3117739942 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f39c0003a00 con 0x7f39cc15fee0 2023-07-14T15:56:50.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.256+0000 7f39b3fff700 1 --2- 172.21.15.37:0/3117739942 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f39b806ace0 0x7f39b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:50.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.256+0000 7f39b3fff700 1 -- 172.21.15.37:0/3117739942 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f39c0088940 con 0x7f39cc15fee0 2023-07-14T15:56:50.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.257+0000 7f39cb7fe700 1 --2- 172.21.15.37:0/3117739942 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f39b806ace0 0x7f39b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:50.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.257+0000 7f39cb7fe700 1 --2- 172.21.15.37:0/3117739942 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f39b806ace0 0x7f39b806d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f39bc0011e0 tx=0x7f39bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:50.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.261+0000 7f39b3fff700 1 -- 172.21.15.37:0/3117739942 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f39c00539e0 con 0x7f39cc15fee0 2023-07-14T15:56:50.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.465+0000 7f39d21ff700 1 -- 172.21.15.37:0/3117739942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f39cc067840 con 0x7f39cc15fee0 2023-07-14T15:56:50.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.465+0000 7f39b3fff700 1 -- 172.21.15.37:0/3117739942 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f39c0017020 con 0x7f39cc15fee0 2023-07-14T15:56:50.451 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-14T15:56:50.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.467+0000 7f39d21ff700 1 -- 172.21.15.37:0/3117739942 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f39b806ace0 msgr2=0x7f39b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:50.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.467+0000 7f39d21ff700 1 --2- 172.21.15.37:0/3117739942 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f39b806ace0 0x7f39b806d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f39bc0011e0 tx=0x7f39bc009040 comp rx=0 tx=0).stop 2023-07-14T15:56:50.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.467+0000 7f39d21ff700 1 -- 172.21.15.37:0/3117739942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39cc15fee0 msgr2=0x7f39cc0b0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:50.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.467+0000 7f39d21ff700 1 --2- 172.21.15.37:0/3117739942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39cc15fee0 0x7f39cc0b0a60 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f39c000c4d0 tx=0x7f39c000c890 comp rx=0 tx=0).stop 2023-07-14T15:56:50.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.467+0000 7f39d21ff700 1 -- 172.21.15.37:0/3117739942 shutdown_connections 2023-07-14T15:56:50.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.467+0000 7f39d21ff700 1 --2- 172.21.15.37:0/3117739942 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39cc1603b0 0x7f39cc0b0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:50.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.467+0000 7f39d21ff700 1 --2- 172.21.15.37:0/3117739942 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f39b806ace0 0x7f39b806d190 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:50.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.467+0000 7f39d21ff700 1 --2- 172.21.15.37:0/3117739942 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f39cc0d1140 0x7f39cc0c6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:50.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.467+0000 7f39d21ff700 1 --2- 172.21.15.37:0/3117739942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39cc15fee0 0x7f39cc0b0a60 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:50.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.467+0000 7f39d21ff700 1 -- 172.21.15.37:0/3117739942 >> 172.21.15.37:0/3117739942 conn(0x7f39cc09c1b0 msgr2=0x7f39cc0b4df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:50.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.468+0000 7f39d21ff700 1 -- 172.21.15.37:0/3117739942 shutdown_connections 2023-07-14T15:56:50.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.468+0000 7f39d21ff700 1 -- 172.21.15.37:0/3117739942 wait complete. 2023-07-14T15:56:50.471 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T15:56:50.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.690+0000 7ff9763ff700 1 Processor -- start 2023-07-14T15:56:50.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.690+0000 7ff9763ff700 1 -- start start 2023-07-14T15:56:50.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.691+0000 7ff9763ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff970158b70 0x7ff970159a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:50.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.691+0000 7ff9763ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff9700ce640 0x7ff97006b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:50.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.691+0000 7ff9763ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff9700cb490 0x7ff9700cb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:50.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.691+0000 7ff9763ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff97006db00 con 0x7ff970158b70 2023-07-14T15:56:50.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.691+0000 7ff9763ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9701595b0 con 0x7ff9700ce640 2023-07-14T15:56:50.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.691+0000 7ff9763ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9700cbe00 con 0x7ff9700cb490 2023-07-14T15:56:50.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.691+0000 7ff96ffff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff970158b70 0x7ff970159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:50.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.692+0000 7ff96ffff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff970158b70 0x7ff970159a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43122/0 (socket says 172.21.15.37:43122) 2023-07-14T15:56:50.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.692+0000 7ff96ffff700 1 -- 172.21.15.37:0/204986812 learned_addr learned my addr 172.21.15.37:0/204986812 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:50.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.692+0000 7ff96f7fe700 1 --2- 172.21.15.37:0/204986812 >> v2:172.21.15.98:3300/0 conn(0x7ff9700ce640 0x7ff97006b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:50.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.692+0000 7ff97499c700 1 --2- 172.21.15.37:0/204986812 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff9700cb490 0x7ff9700cb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:50.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.692+0000 7ff96ffff700 1 -- 172.21.15.37:0/204986812 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff9700cb490 msgr2=0x7ff9700cb8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:50.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.692+0000 7ff96ffff700 1 --2- 172.21.15.37:0/204986812 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff9700cb490 0x7ff9700cb8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:50.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.692+0000 7ff96ffff700 1 -- 172.21.15.37:0/204986812 >> v2:172.21.15.98:3300/0 conn(0x7ff9700ce640 msgr2=0x7ff97006b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:50.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.692+0000 7ff96ffff700 1 --2- 172.21.15.37:0/204986812 >> v2:172.21.15.98:3300/0 conn(0x7ff9700ce640 0x7ff97006b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:50.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.692+0000 7ff96ffff700 1 -- 172.21.15.37:0/204986812 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff970159280 con 0x7ff970158b70 2023-07-14T15:56:50.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.692+0000 7ff96ffff700 1 --2- 172.21.15.37:0/204986812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff970158b70 0x7ff970159a40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff9700cc480 tx=0x7ff960009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=251eedb80e968890 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:50.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.692+0000 7ff96effd700 1 -- 172.21.15.37:0/204986812 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96000b870 con 0x7ff970158b70 2023-07-14T15:56:50.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.693+0000 7ff96effd700 1 -- 172.21.15.37:0/204986812 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff96000b9d0 con 0x7ff970158b70 2023-07-14T15:56:50.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.693+0000 7ff96effd700 1 -- 172.21.15.37:0/204986812 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96000bd60 con 0x7ff970158b70 2023-07-14T15:56:50.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.693+0000 7ff9763ff700 1 -- 172.21.15.37:0/204986812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff970158b70 msgr2=0x7ff970159a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:50.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.693+0000 7ff9763ff700 1 --2- 172.21.15.37:0/204986812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff970158b70 0x7ff970159a40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff9700cc480 tx=0x7ff960009bd0 comp rx=0 tx=0).stop 2023-07-14T15:56:50.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.693+0000 7ff9763ff700 1 -- 172.21.15.37:0/204986812 shutdown_connections 2023-07-14T15:56:50.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.693+0000 7ff9763ff700 1 --2- 172.21.15.37:0/204986812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff970158b70 0x7ff970159a40 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:50.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.693+0000 7ff9763ff700 1 --2- 172.21.15.37:0/204986812 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff9700cb490 0x7ff9700cb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:50.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.693+0000 7ff9763ff700 1 --2- 172.21.15.37:0/204986812 >> v2:172.21.15.98:3300/0 conn(0x7ff9700ce640 0x7ff97006b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:50.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.693+0000 7ff9763ff700 1 -- 172.21.15.37:0/204986812 >> 172.21.15.37:0/204986812 conn(0x7ff97006aac0 msgr2=0x7ff9700b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:50.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.693+0000 7ff9763ff700 1 -- 172.21.15.37:0/204986812 shutdown_connections 2023-07-14T15:56:50.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.693+0000 7ff9763ff700 1 -- 172.21.15.37:0/204986812 wait complete. 2023-07-14T15:56:50.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.695+0000 7ff9763ff700 1 Processor -- start 2023-07-14T15:56:50.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.695+0000 7ff9763ff700 1 -- start start 2023-07-14T15:56:50.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.696+0000 7ff9763ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff9700cb490 0x7ff9700b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:50.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.696+0000 7ff9763ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9700ce640 0x7ff97014e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:50.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.696+0000 7ff9763ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff970158b70 0x7ff9700c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:50.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.696+0000 7ff9763ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9700b1e20 con 0x7ff9700ce640 2023-07-14T15:56:50.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.696+0000 7ff9763ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9700b20c0 con 0x7ff970158b70 2023-07-14T15:56:50.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.696+0000 7ff9763ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9700b23a0 con 0x7ff9700cb490 2023-07-14T15:56:50.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.696+0000 7ff96f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9700ce640 0x7ff97014e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:50.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.697+0000 7ff96f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9700ce640 0x7ff97014e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43136/0 (socket says 172.21.15.37:43136) 2023-07-14T15:56:50.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.697+0000 7ff96f7fe700 1 -- 172.21.15.37:0/2945031982 learned_addr learned my addr 172.21.15.37:0/2945031982 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:50.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.697+0000 7ff96ffff700 1 --2- 172.21.15.37:0/2945031982 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff9700cb490 0x7ff9700b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:50.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.697+0000 7ff97499c700 1 --2- 172.21.15.37:0/2945031982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff970158b70 0x7ff9700c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:50.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.697+0000 7ff96f7fe700 1 -- 172.21.15.37:0/2945031982 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff9700cb490 msgr2=0x7ff9700b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:50.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.697+0000 7ff96f7fe700 1 --2- 172.21.15.37:0/2945031982 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff9700cb490 0x7ff9700b0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:50.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.697+0000 7ff96f7fe700 1 -- 172.21.15.37:0/2945031982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff970158b70 msgr2=0x7ff9700c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:50.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.697+0000 7ff96f7fe700 1 --2- 172.21.15.37:0/2945031982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff970158b70 0x7ff9700c9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:50.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.697+0000 7ff96f7fe700 1 -- 172.21.15.37:0/2945031982 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff960009550 con 0x7ff9700ce640 2023-07-14T15:56:50.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.697+0000 7ff96f7fe700 1 --2- 172.21.15.37:0/2945031982 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9700ce640 0x7ff97014e210 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff96400e810 tx=0x7ff96400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:50.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.700+0000 7ff96cff9700 1 -- 172.21.15.37:0/2945031982 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96400c070 con 0x7ff9700ce640 2023-07-14T15:56:50.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.700+0000 7ff9763ff700 1 -- 172.21.15.37:0/2945031982 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9700b2680 con 0x7ff9700ce640 2023-07-14T15:56:50.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.700+0000 7ff96cff9700 1 -- 172.21.15.37:0/2945031982 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff964013610 con 0x7ff9700ce640 2023-07-14T15:56:50.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.700+0000 7ff96cff9700 1 -- 172.21.15.37:0/2945031982 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9640139c0 con 0x7ff9700ce640 2023-07-14T15:56:50.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.700+0000 7ff9763ff700 1 -- 172.21.15.37:0/2945031982 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9700b38f0 con 0x7ff9700ce640 2023-07-14T15:56:50.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.701+0000 7ff9763ff700 1 -- 172.21.15.37:0/2945031982 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff97006d230 con 0x7ff9700ce640 2023-07-14T15:56:50.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.702+0000 7ff96cff9700 1 -- 172.21.15.37:0/2945031982 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff964013b20 con 0x7ff9700ce640 2023-07-14T15:56:50.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.703+0000 7ff96cff9700 1 --2- 172.21.15.37:0/2945031982 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff95c06ace0 0x7ff95c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:50.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.703+0000 7ff96cff9700 1 -- 172.21.15.37:0/2945031982 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff964089250 con 0x7ff9700ce640 2023-07-14T15:56:50.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.703+0000 7ff96ffff700 1 --2- 172.21.15.37:0/2945031982 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff95c06ace0 0x7ff95c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:50.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.704+0000 7ff96ffff700 1 --2- 172.21.15.37:0/2945031982 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff95c06ace0 0x7ff95c06d190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff960014040 tx=0x7ff960008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:50.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.707+0000 7ff96cff9700 1 -- 172.21.15.37:0/2945031982 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff9640541e0 con 0x7ff9700ce640 2023-07-14T15:56:50.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.914+0000 7ff9763ff700 1 -- 172.21.15.37:0/2945031982 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff970067840 con 0x7ff9700ce640 2023-07-14T15:56:50.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.915+0000 7ff96cff9700 1 -- 172.21.15.37:0/2945031982 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff964057800 con 0x7ff9700ce640 2023-07-14T15:56:50.900 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-14T15:56:50.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.917+0000 7ff9763ff700 1 -- 172.21.15.37:0/2945031982 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff95c06ace0 msgr2=0x7ff95c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:50.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.917+0000 7ff9763ff700 1 --2- 172.21.15.37:0/2945031982 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff95c06ace0 0x7ff95c06d190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff960014040 tx=0x7ff960008030 comp rx=0 tx=0).stop 2023-07-14T15:56:50.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.917+0000 7ff9763ff700 1 -- 172.21.15.37:0/2945031982 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9700ce640 msgr2=0x7ff97014e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:50.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.917+0000 7ff9763ff700 1 --2- 172.21.15.37:0/2945031982 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9700ce640 0x7ff97014e210 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff96400e810 tx=0x7ff96400eb20 comp rx=0 tx=0).stop 2023-07-14T15:56:50.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.917+0000 7ff9763ff700 1 -- 172.21.15.37:0/2945031982 shutdown_connections 2023-07-14T15:56:50.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.917+0000 7ff9763ff700 1 --2- 172.21.15.37:0/2945031982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff970158b70 0x7ff9700c9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:50.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.917+0000 7ff9763ff700 1 --2- 172.21.15.37:0/2945031982 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff95c06ace0 0x7ff95c06d190 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:50.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.917+0000 7ff9763ff700 1 --2- 172.21.15.37:0/2945031982 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff9700cb490 0x7ff9700b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:50.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.917+0000 7ff9763ff700 1 --2- 172.21.15.37:0/2945031982 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9700ce640 0x7ff97014e210 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:50.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.917+0000 7ff9763ff700 1 -- 172.21.15.37:0/2945031982 >> 172.21.15.37:0/2945031982 conn(0x7ff97006aac0 msgr2=0x7ff970070530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:50.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.917+0000 7ff9763ff700 1 -- 172.21.15.37:0/2945031982 shutdown_connections 2023-07-14T15:56:50.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:50.917+0000 7ff9763ff700 1 -- 172.21.15.37:0/2945031982 wait complete. 2023-07-14T15:56:50.920 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T15:56:51.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.140+0000 7f13fc3ff700 1 Processor -- start 2023-07-14T15:56:51.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.140+0000 7f13fc3ff700 1 -- start start 2023-07-14T15:56:51.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.141+0000 7f13fc3ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f13f4071820 0x7f13f406cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:51.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.141+0000 7f13fc3ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13f40707f0 con 0x7f13f406d0c0 2023-07-14T15:56:51.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.141+0000 7f13fc3ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13f4070a60 con 0x7f13f40cb430 2023-07-14T15:56:51.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.141+0000 7f13fc3ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13f4070d40 con 0x7f13f4071820 2023-07-14T15:56:51.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.142+0000 7f13fa99c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f13f406d0c0 0x7f13f40c90d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38008/0 (socket says 172.21.15.37:38008) 2023-07-14T15:56:51.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.142+0000 7f13fa99c700 1 -- 172.21.15.37:0/3955830951 learned_addr learned my addr 172.21.15.37:0/3955830951 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:51.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.142+0000 7f13f999a700 1 --2- 172.21.15.37:0/3955830951 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f13f4071820 0x7f13f406cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:51.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.142+0000 7f13f9199700 1 -- 172.21.15.37:0/3955830951 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1351688112 0 0) 0x7f13f40707f0 con 0x7f13f406d0c0 2023-07-14T15:56:51.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.142+0000 7f13f9199700 1 -- 172.21.15.37:0/3955830951 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13e00035b0 con 0x7f13f406d0c0 2023-07-14T15:56:51.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.142+0000 7f13f9199700 1 -- 172.21.15.37:0/3955830951 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 781983981 0 0) 0x7f13f4070a60 con 0x7f13f40cb430 2023-07-14T15:56:51.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.142+0000 7f13f9199700 1 -- 172.21.15.37:0/3955830951 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13f40707f0 con 0x7f13f40cb430 2023-07-14T15:56:51.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.142+0000 7f13f9199700 1 -- 172.21.15.37:0/3955830951 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3706011796 0 0) 0x7f13e00035b0 con 0x7f13f406d0c0 2023-07-14T15:56:51.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.142+0000 7f13f999a700 1 -- 172.21.15.37:0/3955830951 >> v1:172.21.15.98:6789/0 conn(0x7f13f40cb430 legacy=0x7f13f40cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:51.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.142+0000 7f13f999a700 1 -- 172.21.15.37:0/3955830951 >> v1:172.21.15.37:6789/0 conn(0x7f13f406d0c0 legacy=0x7f13f40c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:51.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.142+0000 7f13f999a700 1 -- 172.21.15.37:0/3955830951 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f4071020 con 0x7f13f4071820 2023-07-14T15:56:51.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.143+0000 7f13f999a700 1 --2- 172.21.15.37:0/3955830951 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f13f4071820 0x7f13f406cb80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f13e4009870 tx=0x7f13e4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7898852c683e084f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:51.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.143+0000 7f13f9199700 1 -- 172.21.15.37:0/3955830951 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13ec0019f0 con 0x7f13f4071820 2023-07-14T15:56:51.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.143+0000 7f13f9199700 1 -- 172.21.15.37:0/3955830951 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13e4004030 con 0x7f13f4071820 2023-07-14T15:56:51.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.143+0000 7f13f9199700 1 -- 172.21.15.37:0/3955830951 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e40043c0 con 0x7f13f4071820 2023-07-14T15:56:51.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.143+0000 7f13fc3ff700 1 -- 172.21.15.37:0/3955830951 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f13f4071820 msgr2=0x7f13f406cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:51.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.143+0000 7f13fc3ff700 1 --2- 172.21.15.37:0/3955830951 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f13f4071820 0x7f13f406cb80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f13e4009870 tx=0x7f13e4009b80 comp rx=0 tx=0).stop 2023-07-14T15:56:51.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.144+0000 7f13fc3ff700 1 -- 172.21.15.37:0/3955830951 shutdown_connections 2023-07-14T15:56:51.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.144+0000 7f13fc3ff700 1 --2- 172.21.15.37:0/3955830951 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f13f4071820 0x7f13f406cb80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:51.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.144+0000 7f13fc3ff700 1 -- 172.21.15.37:0/3955830951 >> 172.21.15.37:0/3955830951 conn(0x7f13f406aac0 msgr2=0x7f13f40b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:51.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.144+0000 7f13fc3ff700 1 -- 172.21.15.37:0/3955830951 shutdown_connections 2023-07-14T15:56:51.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.144+0000 7f13fc3ff700 1 -- 172.21.15.37:0/3955830951 wait complete. 2023-07-14T15:56:51.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.145+0000 7f13fc3ff700 1 Processor -- start 2023-07-14T15:56:51.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.146+0000 7f13fc3ff700 1 -- start start 2023-07-14T15:56:51.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.147+0000 7f13fc3ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13f406d0c0 0x7f13f41489e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:51.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.147+0000 7f13fc3ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13f4071820 0x7f13f40cc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:51.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.147+0000 7f13fc3ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f13f40cb430 0x7f13f40ce9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:51.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.147+0000 7f13fc3ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f40ccb90 con 0x7f13f4071820 2023-07-14T15:56:51.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.147+0000 7f13fc3ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f40ce680 con 0x7f13f406d0c0 2023-07-14T15:56:51.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.147+0000 7f13fc3ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13f40b2a60 con 0x7f13f40cb430 2023-07-14T15:56:51.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.147+0000 7f13f999a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13f4071820 0x7f13f40cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:51.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.147+0000 7f13f999a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13f4071820 0x7f13f40cc650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43150/0 (socket says 172.21.15.37:43150) 2023-07-14T15:56:51.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.147+0000 7f13f999a700 1 -- 172.21.15.37:0/2174592912 learned_addr learned my addr 172.21.15.37:0/2174592912 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:51.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.147+0000 7f13fa99c700 1 --2- 172.21.15.37:0/2174592912 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f13f40cb430 0x7f13f40ce9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:51.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.147+0000 7f13fa19b700 1 --2- 172.21.15.37:0/2174592912 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13f406d0c0 0x7f13f41489e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:51.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.147+0000 7f13f999a700 1 -- 172.21.15.37:0/2174592912 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f13f40cb430 msgr2=0x7f13f40ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:51.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.147+0000 7f13f999a700 1 --2- 172.21.15.37:0/2174592912 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f13f40cb430 0x7f13f40ce9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:51.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.147+0000 7f13f999a700 1 -- 172.21.15.37:0/2174592912 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13f406d0c0 msgr2=0x7f13f41489e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:51.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.147+0000 7f13f999a700 1 --2- 172.21.15.37:0/2174592912 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13f406d0c0 0x7f13f41489e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:51.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.147+0000 7f13f999a700 1 -- 172.21.15.37:0/2174592912 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e40094a0 con 0x7f13f4071820 2023-07-14T15:56:51.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.148+0000 7f13f999a700 1 --2- 172.21.15.37:0/2174592912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13f4071820 0x7f13f40cc650 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f13e40090b0 tx=0x7f13e4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:51.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.148+0000 7f13eaffd700 1 -- 172.21.15.37:0/2174592912 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e4011630 con 0x7f13f4071820 2023-07-14T15:56:51.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.148+0000 7f13eaffd700 1 -- 172.21.15.37:0/2174592912 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13e401f070 con 0x7f13f4071820 2023-07-14T15:56:51.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.148+0000 7f13eaffd700 1 -- 172.21.15.37:0/2174592912 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e40119f0 con 0x7f13f4071820 2023-07-14T15:56:51.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.148+0000 7f13fc3ff700 1 -- 172.21.15.37:0/2174592912 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13f40b2d40 con 0x7f13f4071820 2023-07-14T15:56:51.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.148+0000 7f13fc3ff700 1 -- 172.21.15.37:0/2174592912 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13f40b3300 con 0x7f13f4071820 2023-07-14T15:56:51.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.149+0000 7f13fc3ff700 1 -- 172.21.15.37:0/2174592912 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13f40ca640 con 0x7f13f4071820 2023-07-14T15:56:51.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.150+0000 7f13eaffd700 1 -- 172.21.15.37:0/2174592912 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f13e4011b50 con 0x7f13f4071820 2023-07-14T15:56:51.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.151+0000 7f13eaffd700 1 --2- 172.21.15.37:0/2174592912 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f13d806ace0 0x7f13d806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:51.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.151+0000 7f13eaffd700 1 -- 172.21.15.37:0/2174592912 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f13e4021070 con 0x7f13f4071820 2023-07-14T15:56:51.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.152+0000 7f13fa19b700 1 --2- 172.21.15.37:0/2174592912 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f13d806ace0 0x7f13d806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:51.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.152+0000 7f13fa19b700 1 --2- 172.21.15.37:0/2174592912 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f13d806ace0 0x7f13d806d190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f13f0007fd0 tx=0x7f13f0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:51.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.155+0000 7f13eaffd700 1 -- 172.21.15.37:0/2174592912 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f13e4055ed0 con 0x7f13f4071820 2023-07-14T15:56:51.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.362+0000 7f13fc3ff700 1 -- 172.21.15.37:0/2174592912 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f13f4067840 con 0x7f13f4071820 2023-07-14T15:56:51.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.363+0000 7f13eaffd700 1 -- 172.21.15.37:0/2174592912 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f13e402b0a0 con 0x7f13f4071820 2023-07-14T15:56:51.348 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-14T15:56:51.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.365+0000 7f13fc3ff700 1 -- 172.21.15.37:0/2174592912 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f13d806ace0 msgr2=0x7f13d806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:51.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.365+0000 7f13fc3ff700 1 --2- 172.21.15.37:0/2174592912 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f13d806ace0 0x7f13d806d190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f13f0007fd0 tx=0x7f13f0009040 comp rx=0 tx=0).stop 2023-07-14T15:56:51.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.365+0000 7f13fc3ff700 1 -- 172.21.15.37:0/2174592912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13f4071820 msgr2=0x7f13f40cc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:51.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.365+0000 7f13fc3ff700 1 --2- 172.21.15.37:0/2174592912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13f4071820 0x7f13f40cc650 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f13e40090b0 tx=0x7f13e4004750 comp rx=0 tx=0).stop 2023-07-14T15:56:51.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.365+0000 7f13fc3ff700 1 -- 172.21.15.37:0/2174592912 shutdown_connections 2023-07-14T15:56:51.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.365+0000 7f13fc3ff700 1 --2- 172.21.15.37:0/2174592912 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13f406d0c0 0x7f13f41489e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:51.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.365+0000 7f13fc3ff700 1 --2- 172.21.15.37:0/2174592912 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f13d806ace0 0x7f13d806d190 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:51.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.365+0000 7f13fc3ff700 1 --2- 172.21.15.37:0/2174592912 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f13f40cb430 0x7f13f40ce9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:51.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.365+0000 7f13fc3ff700 1 --2- 172.21.15.37:0/2174592912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13f4071820 0x7f13f40cc650 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:51.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.365+0000 7f13fc3ff700 1 -- 172.21.15.37:0/2174592912 >> 172.21.15.37:0/2174592912 conn(0x7f13f406aac0 msgr2=0x7f13f40cb800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:51.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.365+0000 7f13fc3ff700 1 -- 172.21.15.37:0/2174592912 shutdown_connections 2023-07-14T15:56:51.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.365+0000 7f13fc3ff700 1 -- 172.21.15.37:0/2174592912 wait complete. 2023-07-14T15:56:51.369 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T15:56:51.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.584+0000 7fcbe43ff700 1 Processor -- start 2023-07-14T15:56:51.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.584+0000 7fcbe43ff700 1 -- start start 2023-07-14T15:56:51.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.585+0000 7fcbe43ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcbdc0b85f0 0x7fcbdc15d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:51.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.585+0000 7fcbe43ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fcbdc0b54b0 0x7fcbdc0cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:51.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.585+0000 7fcbe43ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcbdc0b4910 0x7fcbdc0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:51.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.585+0000 7fcbe43ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbdc0b52d0 con 0x7fcbdc0b4910 2023-07-14T15:56:51.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.585+0000 7fcbe43ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbdc0cf6b0 con 0x7fcbdc0b54b0 2023-07-14T15:56:51.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.585+0000 7fcbe43ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc0cdc40 con 0x7fcbdc0b85f0 2023-07-14T15:56:51.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.586+0000 7fcbe299c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcbdc0b4910 0x7fcbdc0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:51.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.586+0000 7fcbe299c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcbdc0b4910 0x7fcbdc0b4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43158/0 (socket says 172.21.15.37:43158) 2023-07-14T15:56:51.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.586+0000 7fcbe299c700 1 -- 172.21.15.37:0/4204650484 learned_addr learned my addr 172.21.15.37:0/4204650484 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:51.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.586+0000 7fcbe199a700 1 --2- 172.21.15.37:0/4204650484 >> v2:172.21.15.98:3300/0 conn(0x7fcbdc0b54b0 0x7fcbdc0cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:51.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.586+0000 7fcbe219b700 1 --2- 172.21.15.37:0/4204650484 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcbdc0b85f0 0x7fcbdc15d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:51.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.586+0000 7fcbe299c700 1 -- 172.21.15.37:0/4204650484 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcbdc0b85f0 msgr2=0x7fcbdc15d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:51.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.586+0000 7fcbe299c700 1 --2- 172.21.15.37:0/4204650484 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcbdc0b85f0 0x7fcbdc15d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:51.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.586+0000 7fcbe299c700 1 -- 172.21.15.37:0/4204650484 >> v2:172.21.15.98:3300/0 conn(0x7fcbdc0b54b0 msgr2=0x7fcbdc0cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:51.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.586+0000 7fcbe299c700 1 --2- 172.21.15.37:0/4204650484 >> v2:172.21.15.98:3300/0 conn(0x7fcbdc0b54b0 0x7fcbdc0cfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:51.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.586+0000 7fcbe299c700 1 -- 172.21.15.37:0/4204650484 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbdc15dba0 con 0x7fcbdc0b4910 2023-07-14T15:56:51.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.586+0000 7fcbe299c700 1 --2- 172.21.15.37:0/4204650484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbdc0b4910 0x7fcbdc0b4d90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc06bb10 tx=0x7fcbd400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=501a867d3a7e2fe5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:51.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.587+0000 7fcbe1199700 1 -- 172.21.15.37:0/4204650484 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd400e070 con 0x7fcbdc0b4910 2023-07-14T15:56:51.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.587+0000 7fcbe1199700 1 -- 172.21.15.37:0/4204650484 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd400b910 con 0x7fcbdc0b4910 2023-07-14T15:56:51.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.587+0000 7fcbe1199700 1 -- 172.21.15.37:0/4204650484 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd400bcc0 con 0x7fcbdc0b4910 2023-07-14T15:56:51.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.587+0000 7fcbe43ff700 1 -- 172.21.15.37:0/4204650484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbdc0b4910 msgr2=0x7fcbdc0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:51.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.587+0000 7fcbe43ff700 1 --2- 172.21.15.37:0/4204650484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbdc0b4910 0x7fcbdc0b4d90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc06bb10 tx=0x7fcbd400b330 comp rx=0 tx=0).stop 2023-07-14T15:56:51.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.587+0000 7fcbe43ff700 1 -- 172.21.15.37:0/4204650484 shutdown_connections 2023-07-14T15:56:51.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.587+0000 7fcbe43ff700 1 --2- 172.21.15.37:0/4204650484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbdc0b4910 0x7fcbdc0b4d90 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:51.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.587+0000 7fcbe43ff700 1 --2- 172.21.15.37:0/4204650484 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcbdc0b85f0 0x7fcbdc15d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:51.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.587+0000 7fcbe43ff700 1 --2- 172.21.15.37:0/4204650484 >> v2:172.21.15.98:3300/0 conn(0x7fcbdc0b54b0 0x7fcbdc0cfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:51.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.587+0000 7fcbe43ff700 1 -- 172.21.15.37:0/4204650484 >> 172.21.15.37:0/4204650484 conn(0x7fcbdc06a580 msgr2=0x7fcbdc06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:51.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.587+0000 7fcbe43ff700 1 -- 172.21.15.37:0/4204650484 shutdown_connections 2023-07-14T15:56:51.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.587+0000 7fcbe43ff700 1 -- 172.21.15.37:0/4204650484 wait complete. 2023-07-14T15:56:51.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.589+0000 7fcbe43ff700 1 Processor -- start 2023-07-14T15:56:51.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.589+0000 7fcbe43ff700 1 -- start start 2023-07-14T15:56:51.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.590+0000 7fcbe43ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbdc0b4910 0x7fcbdc1f15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:51.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.590+0000 7fcbe43ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcbdc0b54b0 0x7fcbdc14a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:51.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.590+0000 7fcbe43ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbdc0b85f0 0x7fcbdc14c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:51.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.590+0000 7fcbe43ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc148f80 con 0x7fcbdc0b85f0 2023-07-14T15:56:51.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.590+0000 7fcbe43ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc14f5c0 con 0x7fcbdc0b4910 2023-07-14T15:56:51.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.590+0000 7fcbe43ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc149790 con 0x7fcbdc0b54b0 2023-07-14T15:56:51.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.590+0000 7fcbe299c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbdc0b85f0 0x7fcbdc14c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:51.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.590+0000 7fcbe299c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbdc0b85f0 0x7fcbdc14c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43160/0 (socket says 172.21.15.37:43160) 2023-07-14T15:56:51.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.590+0000 7fcbe299c700 1 -- 172.21.15.37:0/887998320 learned_addr learned my addr 172.21.15.37:0/887998320 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:51.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.591+0000 7fcbe199a700 1 --2- 172.21.15.37:0/887998320 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcbdc0b54b0 0x7fcbdc14a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:51.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.591+0000 7fcbe219b700 1 --2- 172.21.15.37:0/887998320 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbdc0b4910 0x7fcbdc1f15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:51.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.591+0000 7fcbe299c700 1 -- 172.21.15.37:0/887998320 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcbdc0b54b0 msgr2=0x7fcbdc14a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:51.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.591+0000 7fcbe299c700 1 --2- 172.21.15.37:0/887998320 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcbdc0b54b0 0x7fcbdc14a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:51.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.591+0000 7fcbe299c700 1 -- 172.21.15.37:0/887998320 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbdc0b4910 msgr2=0x7fcbdc1f15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:51.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.591+0000 7fcbe299c700 1 --2- 172.21.15.37:0/887998320 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbdc0b4910 0x7fcbdc1f15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:51.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.591+0000 7fcbe299c700 1 -- 172.21.15.37:0/887998320 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd4009b30 con 0x7fcbdc0b85f0 2023-07-14T15:56:51.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.591+0000 7fcbe199a700 1 --2- 172.21.15.37:0/887998320 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcbdc0b54b0 0x7fcbdc14a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:56:51.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.591+0000 7fcbe299c700 1 --2- 172.21.15.37:0/887998320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbdc0b85f0 0x7fcbdc14c6c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc0673c0 tx=0x7fcbd4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:51.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.591+0000 7fcbd2ffd700 1 -- 172.21.15.37:0/887998320 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd400ce80 con 0x7fcbdc0b85f0 2023-07-14T15:56:51.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.591+0000 7fcbd2ffd700 1 -- 172.21.15.37:0/887998320 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd4004250 con 0x7fcbdc0b85f0 2023-07-14T15:56:51.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.591+0000 7fcbd2ffd700 1 -- 172.21.15.37:0/887998320 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd4004600 con 0x7fcbdc0b85f0 2023-07-14T15:56:51.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.591+0000 7fcbe43ff700 1 -- 172.21.15.37:0/887998320 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbdc149a70 con 0x7fcbdc0b85f0 2023-07-14T15:56:51.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.592+0000 7fcbe43ff700 1 -- 172.21.15.37:0/887998320 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbdc14a030 con 0x7fcbdc0b85f0 2023-07-14T15:56:51.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.593+0000 7fcbe43ff700 1 -- 172.21.15.37:0/887998320 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbdc067840 con 0x7fcbdc0b85f0 2023-07-14T15:56:51.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.593+0000 7fcbd2ffd700 1 -- 172.21.15.37:0/887998320 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcbd4004760 con 0x7fcbdc0b85f0 2023-07-14T15:56:51.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.594+0000 7fcbd2ffd700 1 --2- 172.21.15.37:0/887998320 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fcbc006ace0 0x7fcbc006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:51.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.594+0000 7fcbd2ffd700 1 -- 172.21.15.37:0/887998320 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcbd408a570 con 0x7fcbdc0b85f0 2023-07-14T15:56:51.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.595+0000 7fcbe219b700 1 --2- 172.21.15.37:0/887998320 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fcbc006ace0 0x7fcbc006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:51.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.595+0000 7fcbe219b700 1 --2- 172.21.15.37:0/887998320 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fcbc006ace0 0x7fcbc006d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8009b70 tx=0x7fcbd8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:51.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.598+0000 7fcbd2ffd700 1 -- 172.21.15.37:0/887998320 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fcbd4055610 con 0x7fcbdc0b85f0 2023-07-14T15:56:51.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.806+0000 7fcbe43ff700 1 -- 172.21.15.37:0/887998320 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcbdc06b440 con 0x7fcbdc0b85f0 2023-07-14T15:56:51.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.807+0000 7fcbd2ffd700 1 -- 172.21.15.37:0/887998320 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18341 (secure 0 0 0) 0x7fcbd4058c30 con 0x7fcbdc0b85f0 2023-07-14T15:56:51.793 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:56:51.793 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"fsid":"9da30401-a779-4e46-aba6-00c2494c6c67","created":"2023-07-14T15:55:39.898867+0000","modified":"2023-07-14T15:56:09.959850+0000","last_up_change":"2023-07-14T15:55:53.025696+0000","last_in_change":"2023-07-14T15:55:43.388192+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T15:55:52.907261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T15:55:59.992839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T15:56:06.091064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T15:56:07.448694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d049535-7b87-4276-8fe5-0f74ba422d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6801","nonce":2783032392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6803","nonce":2783032392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6807","nonce":2783032392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6805","nonce":2783032392}]},"public_addr":"172.21.15.37:6801/2783032392","cluster_addr":"172.21.15.37:6803/2783032392","heartbeat_back_addr":"172.21.15.37:6807/2783032392","heartbeat_front_addr":"172.21.15.37:6805/2783032392","state":["exists","up"]},{"osd":1,"uuid":"79ec948d-ead2-4c2d-923a-dd6eeaac9dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6823","nonce":1190059746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6826","nonce":1190059746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6831","nonce":1190059746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6829","nonce":1190059746}]},"public_addr":"172.21.15.37:6823/1190059746","cluster_addr":"172.21.15.37:6826/1190059746","heartbeat_back_addr":"172.21.15.37:6831/1190059746","heartbeat_front_addr":"172.21.15.37:6829/1190059746","state":["exists","up"]},{"osd":2,"uuid":"a1db6690-c160-4366-9c82-2cca17e4bba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6809","nonce":2266223499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6813","nonce":2266223499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6820","nonce":2266223499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6816","nonce":2266223499}]},"public_addr":"172.21.15.37:6809/2266223499","cluster_addr":"172.21.15.37:6813/2266223499","heartbeat_back_addr":"172.21.15.37:6820/2266223499","heartbeat_front_addr":"172.21.15.37:6816/2266223499","state":["exists","up"]},{"osd":3,"uuid":"767b8220-e79a-4a86-a162-6b3b73198379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6812","nonce":4166694594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6817","nonce":4166694594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6828","nonce":4166694594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6822","nonce":4166694594}]},"public_addr":"172.21.15.37:6812/4166694594","cluster_addr":"172.21.15.37:6817/4166694594","heartbeat_back_addr":"172.21.15.37:6828/4166694594","heartbeat_front_addr":"172.21.15.37:6822/4166694594","state":["exists","up"]},{"osd":4,"uuid":"717bd773-ae7e-4236-ac79-900cf99a37c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6801","nonce":3529020407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6803","nonce":3529020407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6807","nonce":3529020407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6805","nonce":3529020407}]},"public_addr":"172.21.15.98:6801/3529020407","cluster_addr":"172.21.15.98:6803/3529020407","heartbeat_back_addr":"172.21.15.98:6807/3529020407","heartbeat_front_addr":"172.21.15.98:6805/3529020407","state":["exists","up"]},{"osd":5,"uuid":"a941d358-0f03-4136-a9b2-3a1c2e9358cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6817","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6819","nonce":2311501838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6821","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6823","nonce":2311501838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6829","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6831","nonce":2311501838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6825","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6827","nonce":2311501838}]},"public_addr":"172.21.15.98:6819/2311501838","cluster_addr":"172.21.15.98:6823/2311501838","heartbeat_back_addr":"172.21.15.98:6831/2311501838","heartbeat_front_addr":"172.21.15.98:6827/2311501838","state":["exists","up"]},{"osd":6,"uuid":"27153772-6d4b-479d-9953-0582e7b96743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6809","nonce":1144224691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6811","nonce":1144224691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6815","nonce":1144224691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6813","nonce":1144224691}]},"public_addr":"172.21.15.98:6809/1144224691","cluster_addr":"172.21.15.98:6811/1144224691","heartbeat_back_addr":"172.21.15.98:6815/1144224691","heartbeat_front_addr":"172.21.15.98:6813/1144224691","state":["exists","up"]},{"osd":7,"uuid":"d21ffc8e-40bb-47eb-af2c-e3e730d3fb76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6818","nonce":1144470927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6822","nonce":1144470927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6830","nonce":1144470927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6826","nonce":1144470927}]},"public_addr":"172.21.15.98:6818/1144470927","cluster_addr":"172.21.15.98:6822/1144470927","heartbeat_back_addr":"172.21.15.98:6830/1144470927","heartbeat_front_addr":"172.21.15.98:6826/1144470927","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.921114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.739210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.024016+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.002527+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.698127+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.813416+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.709351+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.815457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T15:56:51.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.810+0000 7fcbe43ff700 1 -- 172.21.15.37:0/887998320 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fcbc006ace0 msgr2=0x7fcbc006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:51.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.810+0000 7fcbe43ff700 1 --2- 172.21.15.37:0/887998320 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fcbc006ace0 0x7fcbc006d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8009b70 tx=0x7fcbd8008040 comp rx=0 tx=0).stop 2023-07-14T15:56:51.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.810+0000 7fcbe43ff700 1 -- 172.21.15.37:0/887998320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbdc0b85f0 msgr2=0x7fcbdc14c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:51.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.810+0000 7fcbe43ff700 1 --2- 172.21.15.37:0/887998320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbdc0b85f0 0x7fcbdc14c6c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc0673c0 tx=0x7fcbd4004ad0 comp rx=0 tx=0).stop 2023-07-14T15:56:51.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.810+0000 7fcbe43ff700 1 -- 172.21.15.37:0/887998320 shutdown_connections 2023-07-14T15:56:51.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.810+0000 7fcbe43ff700 1 --2- 172.21.15.37:0/887998320 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbdc0b4910 0x7fcbdc1f15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:51.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.810+0000 7fcbe43ff700 1 --2- 172.21.15.37:0/887998320 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fcbc006ace0 0x7fcbc006d190 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:51.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.810+0000 7fcbe43ff700 1 --2- 172.21.15.37:0/887998320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbdc0b85f0 0x7fcbdc14c6c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:51.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.810+0000 7fcbe43ff700 1 --2- 172.21.15.37:0/887998320 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcbdc0b54b0 0x7fcbdc14a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:51.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.810+0000 7fcbe43ff700 1 -- 172.21.15.37:0/887998320 >> 172.21.15.37:0/887998320 conn(0x7fcbdc06a580 msgr2=0x7fcbdc15cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:51.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.810+0000 7fcbe43ff700 1 -- 172.21.15.37:0/887998320 shutdown_connections 2023-07-14T15:56:51.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:51.810+0000 7fcbe43ff700 1 -- 172.21.15.37:0/887998320 wait complete. 2023-07-14T15:56:51.813 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T15:55:52.907261+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T15:55:59.992839+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T15:56:06.091064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T15:56:07.448694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T15:56:51.814 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T15:56:52.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.032+0000 7f45d45ff700 1 Processor -- start 2023-07-14T15:56:52.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.032+0000 7f45d45ff700 1 -- start start 2023-07-14T15:56:52.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.034+0000 7f45d45ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f45cc0cfd50 0x7f45cc0d2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:52.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.034+0000 7f45d45ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f45cc0b0ac0 0x7f45cc0b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:52.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.034+0000 7f45d45ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45cc0b1840 con 0x7f45cc0b1e80 2023-07-14T15:56:52.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.034+0000 7f45d45ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45cc15ccf0 con 0x7f45cc0b0ac0 2023-07-14T15:56:52.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.034+0000 7f45d45ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45cc0b2550 con 0x7f45cc0cfd50 2023-07-14T15:56:52.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.034+0000 7f45d2b9c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f45cc0b0ac0 0x7f45cc0b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:52.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.034+0000 7f45d1b9a700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f45cc0b1e80 0x7f45cc0b2d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38020/0 (socket says 172.21.15.37:38020) 2023-07-14T15:56:52.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.034+0000 7f45d1b9a700 1 -- 172.21.15.37:0/3786027260 learned_addr learned my addr 172.21.15.37:0/3786027260 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:52.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.034+0000 7f45d239b700 1 --2- 172.21.15.37:0/3786027260 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f45cc0cfd50 0x7f45cc0d2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:52.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.034+0000 7f45d2b9c700 1 -- 172.21.15.37:0/3786027260 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f45cc0cfd50 msgr2=0x7f45cc0d2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:52.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.034+0000 7f45d2b9c700 1 --2- 172.21.15.37:0/3786027260 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f45cc0cfd50 0x7f45cc0d2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:52.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.034+0000 7f45d2b9c700 1 -- 172.21.15.37:0/3786027260 >> v1:172.21.15.37:6789/0 conn(0x7f45cc0b1e80 legacy=0x7f45cc0b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:52.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.034+0000 7f45d2b9c700 1 -- 172.21.15.37:0/3786027260 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45cc0b2830 con 0x7f45cc0b0ac0 2023-07-14T15:56:52.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.034+0000 7f45d239b700 1 --2- 172.21.15.37:0/3786027260 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f45cc0cfd50 0x7f45cc0d2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:56:52.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.034+0000 7f45d1399700 1 -- 172.21.15.37:0/3786027260 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2810836059 0 0) 0x7f45cc0b1840 con 0x7f45cc0b1e80 2023-07-14T15:56:52.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.035+0000 7f45d2b9c700 1 --2- 172.21.15.37:0/3786027260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45cc0b0ac0 0x7f45cc0b0f00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f45c4009dc0 tx=0x7f45c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dea4bc8ea81f2334 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:52.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.035+0000 7f45d1399700 1 -- 172.21.15.37:0/3786027260 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c400e070 con 0x7f45cc0b0ac0 2023-07-14T15:56:52.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.035+0000 7f45d1399700 1 -- 172.21.15.37:0/3786027260 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45c400bb90 con 0x7f45cc0b0ac0 2023-07-14T15:56:52.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.035+0000 7f45d1399700 1 -- 172.21.15.37:0/3786027260 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c4012430 con 0x7f45cc0b0ac0 2023-07-14T15:56:52.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.035+0000 7f45d45ff700 1 -- 172.21.15.37:0/3786027260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45cc0b0ac0 msgr2=0x7f45cc0b0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:52.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.035+0000 7f45d45ff700 1 --2- 172.21.15.37:0/3786027260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45cc0b0ac0 0x7f45cc0b0f00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f45c4009dc0 tx=0x7f45c400b330 comp rx=0 tx=0).stop 2023-07-14T15:56:52.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.036+0000 7f45d45ff700 1 -- 172.21.15.37:0/3786027260 shutdown_connections 2023-07-14T15:56:52.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.036+0000 7f45d45ff700 1 --2- 172.21.15.37:0/3786027260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45cc0b0ac0 0x7f45cc0b0f00 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:52.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.036+0000 7f45d45ff700 1 --2- 172.21.15.37:0/3786027260 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f45cc0cfd50 0x7f45cc0d2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:52.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.036+0000 7f45d45ff700 1 -- 172.21.15.37:0/3786027260 >> 172.21.15.37:0/3786027260 conn(0x7f45cc09c1c0 msgr2=0x7f45cc0d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:52.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.036+0000 7f45d45ff700 1 -- 172.21.15.37:0/3786027260 shutdown_connections 2023-07-14T15:56:52.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.036+0000 7f45d45ff700 1 -- 172.21.15.37:0/3786027260 wait complete. 2023-07-14T15:56:52.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.037+0000 7f45d45ff700 1 Processor -- start 2023-07-14T15:56:52.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.038+0000 7f45d45ff700 1 -- start start 2023-07-14T15:56:52.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.039+0000 7f45d45ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45cc0b0ac0 0x7f45cc158140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:52.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.039+0000 7f45d45ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45cc0b1e80 0x7f45cc0b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:52.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.039+0000 7f45d45ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f45cc0cfd50 0x7f45cc15b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:52.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.039+0000 7f45d45ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45cc1f2e30 con 0x7f45cc0b0ac0 2023-07-14T15:56:52.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.039+0000 7f45d45ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45cc1591f0 con 0x7f45cc0b1e80 2023-07-14T15:56:52.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.039+0000 7f45d45ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45cc1594d0 con 0x7f45cc0cfd50 2023-07-14T15:56:52.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.039+0000 7f45d239b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45cc0b0ac0 0x7f45cc158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:52.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.039+0000 7f45d239b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45cc0b0ac0 0x7f45cc158140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43174/0 (socket says 172.21.15.37:43174) 2023-07-14T15:56:52.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.039+0000 7f45d239b700 1 -- 172.21.15.37:0/2834292494 learned_addr learned my addr 172.21.15.37:0/2834292494 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:52.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.039+0000 7f45d2b9c700 1 --2- 172.21.15.37:0/2834292494 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f45cc0cfd50 0x7f45cc15b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:52.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.039+0000 7f45d1b9a700 1 --2- 172.21.15.37:0/2834292494 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45cc0b1e80 0x7f45cc0b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:52.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.039+0000 7f45d239b700 1 -- 172.21.15.37:0/2834292494 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f45cc0cfd50 msgr2=0x7f45cc15b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:52.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.039+0000 7f45d239b700 1 --2- 172.21.15.37:0/2834292494 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f45cc0cfd50 0x7f45cc15b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:52.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.039+0000 7f45d239b700 1 -- 172.21.15.37:0/2834292494 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45cc0b1e80 msgr2=0x7f45cc0b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:52.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.039+0000 7f45d239b700 1 --2- 172.21.15.37:0/2834292494 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45cc0b1e80 0x7f45cc0b5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:52.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.039+0000 7f45d239b700 1 -- 172.21.15.37:0/2834292494 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c4009a70 con 0x7f45cc0b0ac0 2023-07-14T15:56:52.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.040+0000 7f45d239b700 1 --2- 172.21.15.37:0/2834292494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45cc0b0ac0 0x7f45cc158140 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f45c800e810 tx=0x7f45c800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:52.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.040+0000 7f45c2ffd700 1 -- 172.21.15.37:0/2834292494 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c800c020 con 0x7f45cc0b0ac0 2023-07-14T15:56:52.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.040+0000 7f45c2ffd700 1 -- 172.21.15.37:0/2834292494 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45c8004250 con 0x7f45cc0b0ac0 2023-07-14T15:56:52.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.040+0000 7f45c2ffd700 1 -- 172.21.15.37:0/2834292494 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c80036a0 con 0x7f45cc0b0ac0 2023-07-14T15:56:52.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.040+0000 7f45d45ff700 1 -- 172.21.15.37:0/2834292494 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45cc0d02a0 con 0x7f45cc0b0ac0 2023-07-14T15:56:52.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.040+0000 7f45d45ff700 1 -- 172.21.15.37:0/2834292494 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45cc159a90 con 0x7f45cc0b0ac0 2023-07-14T15:56:52.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.041+0000 7f45d45ff700 1 -- 172.21.15.37:0/2834292494 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45cc067840 con 0x7f45cc0b0ac0 2023-07-14T15:56:52.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.042+0000 7f45c2ffd700 1 -- 172.21.15.37:0/2834292494 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f45c8003800 con 0x7f45cc0b0ac0 2023-07-14T15:56:52.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.043+0000 7f45c2ffd700 1 --2- 172.21.15.37:0/2834292494 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f45b006ace0 0x7f45b006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:52.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.043+0000 7f45c2ffd700 1 -- 172.21.15.37:0/2834292494 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f45c8089240 con 0x7f45cc0b0ac0 2023-07-14T15:56:52.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.043+0000 7f45d1b9a700 1 --2- 172.21.15.37:0/2834292494 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f45b006ace0 0x7f45b006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:52.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.044+0000 7f45d1b9a700 1 --2- 172.21.15.37:0/2834292494 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f45b006ace0 0x7f45b006d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f45cc1e3c00 tx=0x7f45bc007be0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:52.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.047+0000 7f45c2ffd700 1 -- 172.21.15.37:0/2834292494 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f45c80542e0 con 0x7f45cc0b0ac0 2023-07-14T15:56:52.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.251+0000 7f45d45ff700 1 -- 172.21.15.37:0/2834292494 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f45cc0d3700 con 0x7f45cc0b0ac0 2023-07-14T15:56:52.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.252+0000 7f45c2ffd700 1 -- 172.21.15.37:0/2834292494 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f45c8057900 con 0x7f45cc0b0ac0 2023-07-14T15:56:52.237 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-14T15:56:52.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.254+0000 7f45d45ff700 1 -- 172.21.15.37:0/2834292494 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f45b006ace0 msgr2=0x7f45b006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:52.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.254+0000 7f45d45ff700 1 --2- 172.21.15.37:0/2834292494 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f45b006ace0 0x7f45b006d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f45cc1e3c00 tx=0x7f45bc007be0 comp rx=0 tx=0).stop 2023-07-14T15:56:52.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.254+0000 7f45d45ff700 1 -- 172.21.15.37:0/2834292494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45cc0b0ac0 msgr2=0x7f45cc158140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:52.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.254+0000 7f45d45ff700 1 --2- 172.21.15.37:0/2834292494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45cc0b0ac0 0x7f45cc158140 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f45c800e810 tx=0x7f45c800ebd0 comp rx=0 tx=0).stop 2023-07-14T15:56:52.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.254+0000 7f45d45ff700 1 -- 172.21.15.37:0/2834292494 shutdown_connections 2023-07-14T15:56:52.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.254+0000 7f45d45ff700 1 --2- 172.21.15.37:0/2834292494 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f45b006ace0 0x7f45b006d190 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:52.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.254+0000 7f45d45ff700 1 --2- 172.21.15.37:0/2834292494 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f45cc0cfd50 0x7f45cc15b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:52.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.254+0000 7f45d45ff700 1 --2- 172.21.15.37:0/2834292494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45cc0b0ac0 0x7f45cc158140 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:52.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.254+0000 7f45d45ff700 1 --2- 172.21.15.37:0/2834292494 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45cc0b1e80 0x7f45cc0b5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:52.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.254+0000 7f45d45ff700 1 -- 172.21.15.37:0/2834292494 >> 172.21.15.37:0/2834292494 conn(0x7f45cc09c1c0 msgr2=0x7f45cc0b4540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:52.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.254+0000 7f45d45ff700 1 -- 172.21.15.37:0/2834292494 shutdown_connections 2023-07-14T15:56:52.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.254+0000 7f45d45ff700 1 -- 172.21.15.37:0/2834292494 wait complete. 2023-07-14T15:56:52.258 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T15:56:52.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.476+0000 7ff2d6fff700 1 Processor -- start 2023-07-14T15:56:52.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.476+0000 7ff2d6fff700 1 -- start start 2023-07-14T15:56:52.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.477+0000 7ff2d6fff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff2d00cfd50 0x7ff2d00d2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:52.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.477+0000 7ff2d6fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff2d00b1e80 0x7ff2d00b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:52.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.478+0000 7ff2d6fff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2d00b1840 con 0x7ff2d00b3290 2023-07-14T15:56:52.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.478+0000 7ff2d6fff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2d015ccf0 con 0x7ff2d00b1e80 2023-07-14T15:56:52.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.478+0000 7ff2d6fff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d00b2550 con 0x7ff2d00cfd50 2023-07-14T15:56:52.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.478+0000 7ff2d559c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff2d00b3290 0x7ff2d00b36d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38024/0 (socket says 172.21.15.37:38024) 2023-07-14T15:56:52.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.478+0000 7ff2d559c700 1 -- 172.21.15.37:0/3903525328 learned_addr learned my addr 172.21.15.37:0/3903525328 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:52.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.478+0000 7ff2d4d9b700 1 --2- 172.21.15.37:0/3903525328 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff2d00cfd50 0x7ff2d00d2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:52.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.478+0000 7ff2cffff700 1 --2- 172.21.15.37:0/3903525328 >> v2:172.21.15.98:3300/0 conn(0x7ff2d00b1e80 0x7ff2d00b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:52.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.478+0000 7ff2cf7fe700 1 -- 172.21.15.37:0/3903525328 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3818198498 0 0) 0x7ff2d00b1840 con 0x7ff2d00b3290 2023-07-14T15:56:52.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.478+0000 7ff2cf7fe700 1 -- 172.21.15.37:0/3903525328 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2c00035b0 con 0x7ff2d00b3290 2023-07-14T15:56:52.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.478+0000 7ff2d4d9b700 1 -- 172.21.15.37:0/3903525328 >> v2:172.21.15.98:3300/0 conn(0x7ff2d00b1e80 msgr2=0x7ff2d00b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:52.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.478+0000 7ff2d4d9b700 1 --2- 172.21.15.37:0/3903525328 >> v2:172.21.15.98:3300/0 conn(0x7ff2d00b1e80 0x7ff2d00b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:52.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.478+0000 7ff2d4d9b700 1 -- 172.21.15.37:0/3903525328 >> v1:172.21.15.37:6789/0 conn(0x7ff2d00b3290 legacy=0x7ff2d00b36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:52.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.478+0000 7ff2d4d9b700 1 -- 172.21.15.37:0/3903525328 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d00b2830 con 0x7ff2d00cfd50 2023-07-14T15:56:52.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.479+0000 7ff2d4d9b700 1 --2- 172.21.15.37:0/3903525328 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff2d00cfd50 0x7ff2d00d2880 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4009870 tx=0x7ff2c4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a419b02e94976e75 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:52.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.479+0000 7ff2cf7fe700 1 -- 172.21.15.37:0/3903525328 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c4011830 con 0x7ff2d00cfd50 2023-07-14T15:56:52.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.479+0000 7ff2cf7fe700 1 -- 172.21.15.37:0/3903525328 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c4011990 con 0x7ff2d00cfd50 2023-07-14T15:56:52.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.479+0000 7ff2cf7fe700 1 -- 172.21.15.37:0/3903525328 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c4011d20 con 0x7ff2d00cfd50 2023-07-14T15:56:52.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.480+0000 7ff2d6fff700 1 -- 172.21.15.37:0/3903525328 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff2d00cfd50 msgr2=0x7ff2d00d2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:52.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.480+0000 7ff2d6fff700 1 --2- 172.21.15.37:0/3903525328 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff2d00cfd50 0x7ff2d00d2880 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4009870 tx=0x7ff2c4009b80 comp rx=0 tx=0).stop 2023-07-14T15:56:52.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.480+0000 7ff2d6fff700 1 -- 172.21.15.37:0/3903525328 shutdown_connections 2023-07-14T15:56:52.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.480+0000 7ff2d6fff700 1 --2- 172.21.15.37:0/3903525328 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff2d00cfd50 0x7ff2d00d2880 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:52.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.480+0000 7ff2d6fff700 1 --2- 172.21.15.37:0/3903525328 >> v2:172.21.15.98:3300/0 conn(0x7ff2d00b1e80 0x7ff2d00b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:52.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.480+0000 7ff2d6fff700 1 -- 172.21.15.37:0/3903525328 >> 172.21.15.37:0/3903525328 conn(0x7ff2d009c1c0 msgr2=0x7ff2d00d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:52.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.480+0000 7ff2d6fff700 1 -- 172.21.15.37:0/3903525328 shutdown_connections 2023-07-14T15:56:52.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.480+0000 7ff2d6fff700 1 -- 172.21.15.37:0/3903525328 wait complete. 2023-07-14T15:56:52.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.481+0000 7ff2d6fff700 1 Processor -- start 2023-07-14T15:56:52.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.482+0000 7ff2d6fff700 1 -- start start 2023-07-14T15:56:52.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.483+0000 7ff2d6fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2d00b1e80 0x7ff2d01e3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:52.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.483+0000 7ff2d6fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2d00b3290 0x7ff2d0152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:52.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.483+0000 7ff2d6fff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff2d00cfd50 0x7ff2d00c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:52.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.483+0000 7ff2d6fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d00c83f0 con 0x7ff2d00b3290 2023-07-14T15:56:52.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.483+0000 7ff2d6fff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d00c77e0 con 0x7ff2d00b1e80 2023-07-14T15:56:52.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.483+0000 7ff2d6fff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d00c7ac0 con 0x7ff2d00cfd50 2023-07-14T15:56:52.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.483+0000 7ff2cffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2d00b3290 0x7ff2d0152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:52.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.483+0000 7ff2cffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2d00b3290 0x7ff2d0152f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43182/0 (socket says 172.21.15.37:43182) 2023-07-14T15:56:52.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.483+0000 7ff2cffff700 1 -- 172.21.15.37:0/3356364789 learned_addr learned my addr 172.21.15.37:0/3356364789 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:52.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.483+0000 7ff2d4d9b700 1 --2- 172.21.15.37:0/3356364789 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2d00b1e80 0x7ff2d01e3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:52.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.483+0000 7ff2cffff700 1 -- 172.21.15.37:0/3356364789 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff2d00cfd50 msgr2=0x7ff2d00c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:52.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.483+0000 7ff2cffff700 1 --2- 172.21.15.37:0/3356364789 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff2d00cfd50 0x7ff2d00c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:52.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.483+0000 7ff2cffff700 1 -- 172.21.15.37:0/3356364789 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2d00b1e80 msgr2=0x7ff2d01e3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:52.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.483+0000 7ff2cffff700 1 --2- 172.21.15.37:0/3356364789 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2d00b1e80 0x7ff2d01e3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:52.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.483+0000 7ff2cffff700 1 -- 172.21.15.37:0/3356364789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c40094a0 con 0x7ff2d00b3290 2023-07-14T15:56:52.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.483+0000 7ff2d4d9b700 1 --2- 172.21.15.37:0/3356364789 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2d00b1e80 0x7ff2d01e3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:56:52.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.484+0000 7ff2cffff700 1 --2- 172.21.15.37:0/3356364789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2d00b3290 0x7ff2d0152f60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc00e980 tx=0x7ff2bc00ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:52.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.484+0000 7ff2cd7fa700 1 -- 172.21.15.37:0/3356364789 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc009710 con 0x7ff2d00b3290 2023-07-14T15:56:52.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.484+0000 7ff2cd7fa700 1 -- 172.21.15.37:0/3356364789 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2bc00c850 con 0x7ff2d00b3290 2023-07-14T15:56:52.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.484+0000 7ff2d6fff700 1 -- 172.21.15.37:0/3356364789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d00d02a0 con 0x7ff2d00b3290 2023-07-14T15:56:52.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.484+0000 7ff2cd7fa700 1 -- 172.21.15.37:0/3356364789 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc00cc00 con 0x7ff2d00b3290 2023-07-14T15:56:52.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.484+0000 7ff2d6fff700 1 -- 172.21.15.37:0/3356364789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d00c8080 con 0x7ff2d00b3290 2023-07-14T15:56:52.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.485+0000 7ff2d6fff700 1 -- 172.21.15.37:0/3356364789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2d0067840 con 0x7ff2d00b3290 2023-07-14T15:56:52.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.486+0000 7ff2cd7fa700 1 -- 172.21.15.37:0/3356364789 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff2bc013470 con 0x7ff2d00b3290 2023-07-14T15:56:52.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.488+0000 7ff2cd7fa700 1 --2- 172.21.15.37:0/3356364789 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff2b406ace0 0x7ff2b406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:52.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.488+0000 7ff2cd7fa700 1 -- 172.21.15.37:0/3356364789 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff2bc0895f0 con 0x7ff2d00b3290 2023-07-14T15:56:52.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.489+0000 7ff2d4d9b700 1 --2- 172.21.15.37:0/3356364789 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff2b406ace0 0x7ff2b406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:52.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.489+0000 7ff2d4d9b700 1 --2- 172.21.15.37:0/3356364789 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff2b406ace0 0x7ff2b406d190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff2c40090b0 tx=0x7ff2c4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:52.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.492+0000 7ff2cd7fa700 1 -- 172.21.15.37:0/3356364789 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff2bc058150 con 0x7ff2d00b3290 2023-07-14T15:56:52.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.699+0000 7ff2d6fff700 1 -- 172.21.15.37:0/3356364789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff2d00c8530 con 0x7ff2d00b3290 2023-07-14T15:56:52.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.699+0000 7ff2cd7fa700 1 -- 172.21.15.37:0/3356364789 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff2d00c8530 con 0x7ff2d00b3290 2023-07-14T15:56:52.685 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-14T15:56:52.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.701+0000 7ff2d6fff700 1 -- 172.21.15.37:0/3356364789 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff2b406ace0 msgr2=0x7ff2b406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:52.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.701+0000 7ff2d6fff700 1 --2- 172.21.15.37:0/3356364789 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff2b406ace0 0x7ff2b406d190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff2c40090b0 tx=0x7ff2c4008030 comp rx=0 tx=0).stop 2023-07-14T15:56:52.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.701+0000 7ff2d6fff700 1 -- 172.21.15.37:0/3356364789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2d00b3290 msgr2=0x7ff2d0152f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:52.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.701+0000 7ff2d6fff700 1 --2- 172.21.15.37:0/3356364789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2d00b3290 0x7ff2d0152f60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc00e980 tx=0x7ff2bc00ed40 comp rx=0 tx=0).stop 2023-07-14T15:56:52.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.701+0000 7ff2d6fff700 1 -- 172.21.15.37:0/3356364789 shutdown_connections 2023-07-14T15:56:52.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.701+0000 7ff2d6fff700 1 --2- 172.21.15.37:0/3356364789 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2d00b1e80 0x7ff2d01e3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:52.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.701+0000 7ff2d6fff700 1 --2- 172.21.15.37:0/3356364789 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff2b406ace0 0x7ff2b406d190 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:52.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.701+0000 7ff2d6fff700 1 --2- 172.21.15.37:0/3356364789 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff2d00cfd50 0x7ff2d00c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:52.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.701+0000 7ff2d6fff700 1 --2- 172.21.15.37:0/3356364789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2d00b3290 0x7ff2d0152f60 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:52.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.701+0000 7ff2d6fff700 1 -- 172.21.15.37:0/3356364789 >> 172.21.15.37:0/3356364789 conn(0x7ff2d009c1c0 msgr2=0x7ff2d01554f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:52.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.701+0000 7ff2d6fff700 1 -- 172.21.15.37:0/3356364789 shutdown_connections 2023-07-14T15:56:52.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.701+0000 7ff2d6fff700 1 -- 172.21.15.37:0/3356364789 wait complete. 2023-07-14T15:56:52.705 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T15:56:52.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.925+0000 7fc718dff700 1 Processor -- start 2023-07-14T15:56:52.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.925+0000 7fc718dff700 1 -- start start 2023-07-14T15:56:52.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.926+0000 7fc718dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc71415fee0 0x7fc71415ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:52.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.926+0000 7fc718dff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc71415dc50 con 0x7fc7140d1140 2023-07-14T15:56:52.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.926+0000 7fc718dff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7140b2940 con 0x7fc7141603b0 2023-07-14T15:56:52.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.926+0000 7fc718dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7140b2c20 con 0x7fc71415fee0 2023-07-14T15:56:52.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.926+0000 7fc712d9d700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc7140d1140 0x7fc7140b39e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38032/0 (socket says 172.21.15.37:38032) 2023-07-14T15:56:52.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.926+0000 7fc712d9d700 1 -- 172.21.15.37:0/494571093 learned_addr learned my addr 172.21.15.37:0/494571093 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:52.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.927+0000 7fc71259c700 1 --2- 172.21.15.37:0/494571093 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc71415fee0 0x7fc71415ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:52.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.927+0000 7fc711d9b700 1 -- 172.21.15.37:0/494571093 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 559950865 0 0) 0x7fc71415dc50 con 0x7fc7140d1140 2023-07-14T15:56:52.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.927+0000 7fc711d9b700 1 -- 172.21.15.37:0/494571093 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7000035b0 con 0x7fc7140d1140 2023-07-14T15:56:52.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.927+0000 7fc711d9b700 1 -- 172.21.15.37:0/494571093 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2828622847 0 0) 0x7fc7140b2940 con 0x7fc7141603b0 2023-07-14T15:56:52.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.927+0000 7fc71259c700 1 -- 172.21.15.37:0/494571093 >> v1:172.21.15.98:6789/0 conn(0x7fc7141603b0 legacy=0x7fc7140d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:52.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.927+0000 7fc71259c700 1 -- 172.21.15.37:0/494571093 >> v1:172.21.15.37:6789/0 conn(0x7fc7140d1140 legacy=0x7fc7140b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:52.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.927+0000 7fc71259c700 1 -- 172.21.15.37:0/494571093 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7140b2f00 con 0x7fc71415fee0 2023-07-14T15:56:52.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.927+0000 7fc71259c700 1 --2- 172.21.15.37:0/494571093 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc71415fee0 0x7fc71415ded0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc704009870 tx=0x7fc704009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6dba7a8a249dc2b0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:52.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.928+0000 7fc711d9b700 1 -- 172.21.15.37:0/494571093 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc704011830 con 0x7fc71415fee0 2023-07-14T15:56:52.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.928+0000 7fc711d9b700 1 -- 172.21.15.37:0/494571093 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc704011990 con 0x7fc71415fee0 2023-07-14T15:56:52.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.928+0000 7fc711d9b700 1 -- 172.21.15.37:0/494571093 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc704011d20 con 0x7fc71415fee0 2023-07-14T15:56:52.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.928+0000 7fc718dff700 1 -- 172.21.15.37:0/494571093 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc71415fee0 msgr2=0x7fc71415ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:52.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.928+0000 7fc718dff700 1 --2- 172.21.15.37:0/494571093 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc71415fee0 0x7fc71415ded0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc704009870 tx=0x7fc704009b80 comp rx=0 tx=0).stop 2023-07-14T15:56:52.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.928+0000 7fc718dff700 1 -- 172.21.15.37:0/494571093 shutdown_connections 2023-07-14T15:56:52.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.928+0000 7fc718dff700 1 --2- 172.21.15.37:0/494571093 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc71415fee0 0x7fc71415ded0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:52.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.928+0000 7fc718dff700 1 -- 172.21.15.37:0/494571093 >> 172.21.15.37:0/494571093 conn(0x7fc71409c1b0 msgr2=0x7fc7140d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:52.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.928+0000 7fc718dff700 1 -- 172.21.15.37:0/494571093 shutdown_connections 2023-07-14T15:56:52.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.928+0000 7fc718dff700 1 -- 172.21.15.37:0/494571093 wait complete. 2023-07-14T15:56:52.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.930+0000 7fc718dff700 1 Processor -- start 2023-07-14T15:56:52.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.930+0000 7fc718dff700 1 -- start start 2023-07-14T15:56:52.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.931+0000 7fc718dff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7140d1140 0x7fc71414b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:52.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.931+0000 7fc718dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc71415fee0 0x7fc7141e5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:52.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.931+0000 7fc718dff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7141603b0 0x7fc7140b0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:52.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.931+0000 7fc718dff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7141e6970 con 0x7fc7141603b0 2023-07-14T15:56:52.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.931+0000 7fc718dff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7141e6c50 con 0x7fc7140d1140 2023-07-14T15:56:52.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.931+0000 7fc718dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7141e6f30 con 0x7fc71415fee0 2023-07-14T15:56:52.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.931+0000 7fc712d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7141603b0 0x7fc7140b0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:52.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.932+0000 7fc71259c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7140d1140 0x7fc71414b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:52.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.932+0000 7fc712d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7141603b0 0x7fc7140b0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43184/0 (socket says 172.21.15.37:43184) 2023-07-14T15:56:52.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.932+0000 7fc712d9d700 1 -- 172.21.15.37:0/3422776805 learned_addr learned my addr 172.21.15.37:0/3422776805 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:52.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.932+0000 7fc70bfff700 1 --2- 172.21.15.37:0/3422776805 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc71415fee0 0x7fc7141e5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:52.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.932+0000 7fc712d9d700 1 -- 172.21.15.37:0/3422776805 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc71415fee0 msgr2=0x7fc7141e5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:52.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.932+0000 7fc712d9d700 1 --2- 172.21.15.37:0/3422776805 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc71415fee0 0x7fc7141e5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:52.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.932+0000 7fc712d9d700 1 -- 172.21.15.37:0/3422776805 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7140d1140 msgr2=0x7fc71414b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:52.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.932+0000 7fc712d9d700 1 --2- 172.21.15.37:0/3422776805 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7140d1140 0x7fc71414b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:52.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.932+0000 7fc712d9d700 1 -- 172.21.15.37:0/3422776805 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7040094a0 con 0x7fc7141603b0 2023-07-14T15:56:52.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.932+0000 7fc712d9d700 1 --2- 172.21.15.37:0/3422776805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7141603b0 0x7fc7140b0a60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc70c00cbb0 tx=0x7fc70c00cec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:52.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.932+0000 7fc70affd700 1 -- 172.21.15.37:0/3422776805 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70c00a9e0 con 0x7fc7141603b0 2023-07-14T15:56:52.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.932+0000 7fc70affd700 1 -- 172.21.15.37:0/3422776805 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc70c00ab40 con 0x7fc7141603b0 2023-07-14T15:56:52.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.932+0000 7fc70affd700 1 -- 172.21.15.37:0/3422776805 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70c012400 con 0x7fc7141603b0 2023-07-14T15:56:52.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.932+0000 7fc718dff700 1 -- 172.21.15.37:0/3422776805 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7141e7210 con 0x7fc7141603b0 2023-07-14T15:56:52.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.933+0000 7fc718dff700 1 -- 172.21.15.37:0/3422776805 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc71414b690 con 0x7fc7141603b0 2023-07-14T15:56:52.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.934+0000 7fc718dff700 1 -- 172.21.15.37:0/3422776805 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc714067840 con 0x7fc7141603b0 2023-07-14T15:56:52.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.934+0000 7fc70affd700 1 -- 172.21.15.37:0/3422776805 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc70c01b3b0 con 0x7fc7141603b0 2023-07-14T15:56:52.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.936+0000 7fc70affd700 1 --2- 172.21.15.37:0/3422776805 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc6f406ace0 0x7fc6f406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:52.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.936+0000 7fc70affd700 1 -- 172.21.15.37:0/3422776805 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc70c089090 con 0x7fc7141603b0 2023-07-14T15:56:52.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.936+0000 7fc71259c700 1 --2- 172.21.15.37:0/3422776805 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc6f406ace0 0x7fc6f406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:52.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.937+0000 7fc71259c700 1 --2- 172.21.15.37:0/3422776805 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc6f406ace0 0x7fc6f406d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc704009bc0 tx=0x7fc70401c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:52.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:52.940+0000 7fc70affd700 1 -- 172.21.15.37:0/3422776805 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc70c0541f0 con 0x7fc7141603b0 2023-07-14T15:56:53.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.147+0000 7fc718dff700 1 -- 172.21.15.37:0/3422776805 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc7140d1950 con 0x7fc7141603b0 2023-07-14T15:56:53.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.147+0000 7fc70affd700 1 -- 172.21.15.37:0/3422776805 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc70c057810 con 0x7fc7141603b0 2023-07-14T15:56:53.133 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-14T15:56:53.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.149+0000 7fc718dff700 1 -- 172.21.15.37:0/3422776805 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc6f406ace0 msgr2=0x7fc6f406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:53.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.149+0000 7fc718dff700 1 --2- 172.21.15.37:0/3422776805 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc6f406ace0 0x7fc6f406d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc704009bc0 tx=0x7fc70401c040 comp rx=0 tx=0).stop 2023-07-14T15:56:53.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.149+0000 7fc718dff700 1 -- 172.21.15.37:0/3422776805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7141603b0 msgr2=0x7fc7140b0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:53.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.149+0000 7fc718dff700 1 --2- 172.21.15.37:0/3422776805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7141603b0 0x7fc7140b0a60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc70c00cbb0 tx=0x7fc70c00cec0 comp rx=0 tx=0).stop 2023-07-14T15:56:53.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.149+0000 7fc718dff700 1 -- 172.21.15.37:0/3422776805 shutdown_connections 2023-07-14T15:56:53.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.149+0000 7fc718dff700 1 --2- 172.21.15.37:0/3422776805 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7140d1140 0x7fc71414b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:53.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.149+0000 7fc718dff700 1 --2- 172.21.15.37:0/3422776805 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc6f406ace0 0x7fc6f406d190 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:53.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.149+0000 7fc718dff700 1 --2- 172.21.15.37:0/3422776805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7141603b0 0x7fc7140b0a60 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:53.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.149+0000 7fc718dff700 1 --2- 172.21.15.37:0/3422776805 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc71415fee0 0x7fc7141e5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:53.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.149+0000 7fc718dff700 1 -- 172.21.15.37:0/3422776805 >> 172.21.15.37:0/3422776805 conn(0x7fc71409c1b0 msgr2=0x7fc71406a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:53.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.150+0000 7fc718dff700 1 -- 172.21.15.37:0/3422776805 shutdown_connections 2023-07-14T15:56:53.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.150+0000 7fc718dff700 1 -- 172.21.15.37:0/3422776805 wait complete. 2023-07-14T15:56:53.153 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T15:56:53.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.373+0000 7f713fdff700 1 Processor -- start 2023-07-14T15:56:53.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.373+0000 7f713fdff700 1 -- start start 2023-07-14T15:56:53.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.375+0000 7f713fdff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f713815fee0 0x7f713815ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:53.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.375+0000 7f713fdff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f71381603b0 0x7f71380d0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:53.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.375+0000 7f713fdff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71380d1370 con 0x7f71380d0f70 2023-07-14T15:56:53.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.375+0000 7f713fdff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f713815dc50 con 0x7f713815fee0 2023-07-14T15:56:53.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.375+0000 7f713fdff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71380b2940 con 0x7f71381603b0 2023-07-14T15:56:53.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.375+0000 7f713db9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f713815fee0 0x7f713815ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:53.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.375+0000 7f713db9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f713815fee0 0x7f713815ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43192/0 (socket says 172.21.15.37:43192) 2023-07-14T15:56:53.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.375+0000 7f713db9b700 1 -- 172.21.15.37:0/2782441345 learned_addr learned my addr 172.21.15.37:0/2782441345 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:53.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.375+0000 7f713d39a700 1 --2- 172.21.15.37:0/2782441345 >> v2:172.21.15.98:3300/0 conn(0x7f71381603b0 0x7f71380d0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:53.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.375+0000 7f713db9b700 1 -- 172.21.15.37:0/2782441345 >> v2:172.21.15.98:3300/0 conn(0x7f71381603b0 msgr2=0x7f71380d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:53.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.375+0000 7f713db9b700 1 --2- 172.21.15.37:0/2782441345 >> v2:172.21.15.98:3300/0 conn(0x7f71381603b0 0x7f71380d0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:53.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.375+0000 7f713db9b700 1 -- 172.21.15.37:0/2782441345 >> v1:172.21.15.98:6789/0 conn(0x7f71380d0f70 legacy=0x7f71380b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:53.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.375+0000 7f713db9b700 1 -- 172.21.15.37:0/2782441345 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71380b2c20 con 0x7f713815fee0 2023-07-14T15:56:53.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.376+0000 7f713db9b700 1 --2- 172.21.15.37:0/2782441345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f713815fee0 0x7f713815ded0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f713808d510 tx=0x7f7134009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2485e5f0935f31c8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:53.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.376+0000 7f713cb99700 1 -- 172.21.15.37:0/2782441345 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713400b870 con 0x7f713815fee0 2023-07-14T15:56:53.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.376+0000 7f713cb99700 1 -- 172.21.15.37:0/2782441345 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f713400b9d0 con 0x7f713815fee0 2023-07-14T15:56:53.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.376+0000 7f713cb99700 1 -- 172.21.15.37:0/2782441345 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713400bd60 con 0x7f713815fee0 2023-07-14T15:56:53.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.376+0000 7f713fdff700 1 -- 172.21.15.37:0/2782441345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f713815fee0 msgr2=0x7f713815ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:53.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.376+0000 7f713fdff700 1 --2- 172.21.15.37:0/2782441345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f713815fee0 0x7f713815ded0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f713808d510 tx=0x7f7134009bd0 comp rx=0 tx=0).stop 2023-07-14T15:56:53.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.377+0000 7f713fdff700 1 -- 172.21.15.37:0/2782441345 shutdown_connections 2023-07-14T15:56:53.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.377+0000 7f713fdff700 1 --2- 172.21.15.37:0/2782441345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f713815fee0 0x7f713815ded0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:53.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.377+0000 7f713fdff700 1 --2- 172.21.15.37:0/2782441345 >> v2:172.21.15.98:3300/0 conn(0x7f71381603b0 0x7f71380d0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:53.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.377+0000 7f713fdff700 1 -- 172.21.15.37:0/2782441345 >> 172.21.15.37:0/2782441345 conn(0x7f713809c1b0 msgr2=0x7f71380d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:53.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.377+0000 7f713fdff700 1 -- 172.21.15.37:0/2782441345 shutdown_connections 2023-07-14T15:56:53.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.377+0000 7f713fdff700 1 -- 172.21.15.37:0/2782441345 wait complete. 2023-07-14T15:56:53.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.378+0000 7f713fdff700 1 Processor -- start 2023-07-14T15:56:53.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.379+0000 7f713fdff700 1 -- start start 2023-07-14T15:56:53.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.379+0000 7f713fdff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71380d0f70 0x7f71381f2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:53.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.379+0000 7f713fdff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f713815fee0 0x7f7138153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:53.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.379+0000 7f713fdff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f71381603b0 0x7f7138156650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:53.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.379+0000 7f713fdff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71381f3520 con 0x7f71380d0f70 2023-07-14T15:56:53.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.379+0000 7f713fdff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7138159720 con 0x7f713815fee0 2023-07-14T15:56:53.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.379+0000 7f713fdff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7138159a00 con 0x7f71381603b0 2023-07-14T15:56:53.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.380+0000 7f713db9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71380d0f70 0x7f71381f2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:53.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.380+0000 7f713db9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71380d0f70 0x7f71381f2fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43200/0 (socket says 172.21.15.37:43200) 2023-07-14T15:56:53.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.380+0000 7f713db9b700 1 -- 172.21.15.37:0/1526196537 learned_addr learned my addr 172.21.15.37:0/1526196537 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:53.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.380+0000 7f713d39a700 1 --2- 172.21.15.37:0/1526196537 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f713815fee0 0x7f7138153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:53.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.380+0000 7f713e39c700 1 --2- 172.21.15.37:0/1526196537 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f71381603b0 0x7f7138156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:53.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.380+0000 7f713db9b700 1 -- 172.21.15.37:0/1526196537 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f71381603b0 msgr2=0x7f7138156650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:53.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.380+0000 7f713db9b700 1 --2- 172.21.15.37:0/1526196537 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f71381603b0 0x7f7138156650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:53.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.380+0000 7f713db9b700 1 -- 172.21.15.37:0/1526196537 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f713815fee0 msgr2=0x7f7138153590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:53.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.380+0000 7f713db9b700 1 --2- 172.21.15.37:0/1526196537 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f713815fee0 0x7f7138153590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:53.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.380+0000 7f713db9b700 1 -- 172.21.15.37:0/1526196537 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7134009550 con 0x7f71380d0f70 2023-07-14T15:56:53.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.380+0000 7f713db9b700 1 --2- 172.21.15.37:0/1526196537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71380d0f70 0x7f71381f2fe0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7134000c00 tx=0x7f7134004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:53.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.381+0000 7f712e7fc700 1 -- 172.21.15.37:0/1526196537 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7134004540 con 0x7f71380d0f70 2023-07-14T15:56:53.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.381+0000 7f712e7fc700 1 -- 172.21.15.37:0/1526196537 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71340036a0 con 0x7f71380d0f70 2023-07-14T15:56:53.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.381+0000 7f712e7fc700 1 -- 172.21.15.37:0/1526196537 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7134003a10 con 0x7f71380d0f70 2023-07-14T15:56:53.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.381+0000 7f713fdff700 1 -- 172.21.15.37:0/1526196537 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7138159ce0 con 0x7f71380d0f70 2023-07-14T15:56:53.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.381+0000 7f713fdff700 1 -- 172.21.15.37:0/1526196537 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f713815a2a0 con 0x7f71380d0f70 2023-07-14T15:56:53.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.382+0000 7f713fdff700 1 -- 172.21.15.37:0/1526196537 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7138067840 con 0x7f71380d0f70 2023-07-14T15:56:53.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.383+0000 7f712e7fc700 1 -- 172.21.15.37:0/1526196537 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7134021070 con 0x7f71380d0f70 2023-07-14T15:56:53.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.384+0000 7f712e7fc700 1 --2- 172.21.15.37:0/1526196537 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f711c06ace0 0x7f711c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:53.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.384+0000 7f712e7fc700 1 -- 172.21.15.37:0/1526196537 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f713408aa60 con 0x7f71380d0f70 2023-07-14T15:56:53.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.384+0000 7f713d39a700 1 --2- 172.21.15.37:0/1526196537 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f711c06ace0 0x7f711c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:53.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.385+0000 7f713d39a700 1 --2- 172.21.15.37:0/1526196537 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f711c06ace0 0x7f711c06d190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7128007a30 tx=0x7f7128008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:53.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.388+0000 7f712e7fc700 1 -- 172.21.15.37:0/1526196537 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7134055b00 con 0x7f71380d0f70 2023-07-14T15:56:53.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.595+0000 7f713fdff700 1 -- 172.21.15.37:0/1526196537 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f713815e880 con 0x7f71380d0f70 2023-07-14T15:56:53.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.596+0000 7f712e7fc700 1 -- 172.21.15.37:0/1526196537 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f71340150a0 con 0x7f71380d0f70 2023-07-14T15:56:53.581 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-14T15:56:53.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.598+0000 7f713fdff700 1 -- 172.21.15.37:0/1526196537 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f711c06ace0 msgr2=0x7f711c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:53.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.598+0000 7f713fdff700 1 --2- 172.21.15.37:0/1526196537 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f711c06ace0 0x7f711c06d190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7128007a30 tx=0x7f7128008040 comp rx=0 tx=0).stop 2023-07-14T15:56:53.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.598+0000 7f713fdff700 1 -- 172.21.15.37:0/1526196537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71380d0f70 msgr2=0x7f71381f2fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:53.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.598+0000 7f713fdff700 1 --2- 172.21.15.37:0/1526196537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71380d0f70 0x7f71381f2fe0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7134000c00 tx=0x7f7134004750 comp rx=0 tx=0).stop 2023-07-14T15:56:53.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.598+0000 7f713fdff700 1 -- 172.21.15.37:0/1526196537 shutdown_connections 2023-07-14T15:56:53.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.598+0000 7f713fdff700 1 --2- 172.21.15.37:0/1526196537 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f711c06ace0 0x7f711c06d190 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:53.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.598+0000 7f713fdff700 1 --2- 172.21.15.37:0/1526196537 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f71381603b0 0x7f7138156650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:53.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.598+0000 7f713fdff700 1 --2- 172.21.15.37:0/1526196537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71380d0f70 0x7f71381f2fe0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:53.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.598+0000 7f713fdff700 1 --2- 172.21.15.37:0/1526196537 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f713815fee0 0x7f7138153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:53.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.598+0000 7f713fdff700 1 -- 172.21.15.37:0/1526196537 >> 172.21.15.37:0/1526196537 conn(0x7f713809c1b0 msgr2=0x7f71381553d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:53.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.598+0000 7f713fdff700 1 -- 172.21.15.37:0/1526196537 shutdown_connections 2023-07-14T15:56:53.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.598+0000 7f713fdff700 1 -- 172.21.15.37:0/1526196537 wait complete. 2023-07-14T15:56:53.673 INFO:tasks.cephfs_test_runner:Starting test: test_nonexistent_subvolume_group_snapshot_rm (tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots) 2023-07-14T15:56:53.674 INFO:tasks.cephfs_test_runner:test_nonexistent_subvolume_group_snapshot_rm (tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots) ... skipped 'skipping subvolumegroup snapshot tests' 2023-07-14T15:56:53.674 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_group_snapshot_create_and_rm (tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots) 2023-07-14T15:56:53.675 INFO:tasks.cephfs_test_runner:test_subvolume_group_snapshot_create_and_rm (tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots) ... skipped 'skipping subvolumegroup snapshot tests' 2023-07-14T15:56:53.675 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_group_snapshot_idempotence (tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots) 2023-07-14T15:56:53.675 INFO:tasks.cephfs_test_runner:test_subvolume_group_snapshot_idempotence (tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots) ... skipped 'skipping subvolumegroup snapshot tests' 2023-07-14T15:56:53.675 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_group_snapshot_ls (tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots) 2023-07-14T15:56:53.676 INFO:tasks.cephfs_test_runner:test_subvolume_group_snapshot_ls (tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots) ... skipped 'skipping subvolumegroup snapshot tests' 2023-07-14T15:56:53.676 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_group_snapshot_rm_force (tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots) 2023-07-14T15:56:53.676 INFO:tasks.cephfs_test_runner:test_subvolume_group_snapshot_rm_force (tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots) ... skipped 'skipping subvolumegroup snapshot tests' 2023-07-14T15:56:53.676 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_group_snapshot_unsupported_status (tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots) 2023-07-14T15:56:53.677 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots.test_subvolume_group_snapshot_unsupported_status' 2023-07-14T15:56:53.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.896+0000 7f3457fff700 1 Processor -- start 2023-07-14T15:56:53.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.896+0000 7f3457fff700 1 -- start start 2023-07-14T15:56:53.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.897+0000 7f3457fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f34500b85f0 0x7f345015d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:53.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.897+0000 7f3457fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f34500b4910 0x7f34500b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:53.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.897+0000 7f3457fff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34500cf6b0 con 0x7f34500b54b0 2023-07-14T15:56:53.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.897+0000 7f3457fff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34500b5270 con 0x7f34500b85f0 2023-07-14T15:56:53.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.897+0000 7f3457fff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34500cdc40 con 0x7f34500b4910 2023-07-14T15:56:53.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.897+0000 7f3455d9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f34500b85f0 0x7f345015d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:53.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.897+0000 7f345559a700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f34500b54b0 0x7f34500cfb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38046/0 (socket says 172.21.15.37:38046) 2023-07-14T15:56:53.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.897+0000 7f345559a700 1 -- 172.21.15.37:0/1727389928 learned_addr learned my addr 172.21.15.37:0/1727389928 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:53.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.898+0000 7f345659c700 1 --2- 172.21.15.37:0/1727389928 >> v2:172.21.15.98:3300/0 conn(0x7f34500b4910 0x7f34500b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:53.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.898+0000 7f3455d9b700 1 -- 172.21.15.37:0/1727389928 >> v2:172.21.15.98:3300/0 conn(0x7f34500b4910 msgr2=0x7f34500b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:53.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.898+0000 7f3455d9b700 1 --2- 172.21.15.37:0/1727389928 >> v2:172.21.15.98:3300/0 conn(0x7f34500b4910 0x7f34500b4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:53.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.898+0000 7f3455d9b700 1 -- 172.21.15.37:0/1727389928 >> v1:172.21.15.37:6789/0 conn(0x7f34500b54b0 legacy=0x7f34500cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:53.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.898+0000 7f3455d9b700 1 -- 172.21.15.37:0/1727389928 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f345015dba0 con 0x7f34500b85f0 2023-07-14T15:56:53.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.898+0000 7f3454d99700 1 -- 172.21.15.37:0/1727389928 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3930203572 0 0) 0x7f34500cf6b0 con 0x7f34500b54b0 2023-07-14T15:56:53.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.898+0000 7f3455d9b700 1 --2- 172.21.15.37:0/1727389928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34500b85f0 0x7f345015d660 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3450161270 tx=0x7f344c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41946298635991cd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:53.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.898+0000 7f3454d99700 1 -- 172.21.15.37:0/1727389928 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344c011830 con 0x7f34500b85f0 2023-07-14T15:56:53.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.899+0000 7f3454d99700 1 -- 172.21.15.37:0/1727389928 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f344c011990 con 0x7f34500b85f0 2023-07-14T15:56:53.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.899+0000 7f3454d99700 1 -- 172.21.15.37:0/1727389928 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344c011d20 con 0x7f34500b85f0 2023-07-14T15:56:53.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.899+0000 7f3457fff700 1 -- 172.21.15.37:0/1727389928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34500b85f0 msgr2=0x7f345015d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:53.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.899+0000 7f3457fff700 1 --2- 172.21.15.37:0/1727389928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34500b85f0 0x7f345015d660 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3450161270 tx=0x7f344c009b20 comp rx=0 tx=0).stop 2023-07-14T15:56:53.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.899+0000 7f3457fff700 1 -- 172.21.15.37:0/1727389928 shutdown_connections 2023-07-14T15:56:53.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.899+0000 7f3457fff700 1 --2- 172.21.15.37:0/1727389928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34500b85f0 0x7f345015d660 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:53.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.899+0000 7f3457fff700 1 --2- 172.21.15.37:0/1727389928 >> v2:172.21.15.98:3300/0 conn(0x7f34500b4910 0x7f34500b4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:53.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.899+0000 7f3457fff700 1 -- 172.21.15.37:0/1727389928 >> 172.21.15.37:0/1727389928 conn(0x7f345006a580 msgr2=0x7f345006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:53.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.899+0000 7f3457fff700 1 -- 172.21.15.37:0/1727389928 shutdown_connections 2023-07-14T15:56:53.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.899+0000 7f3457fff700 1 -- 172.21.15.37:0/1727389928 wait complete. 2023-07-14T15:56:53.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.901+0000 7f3457fff700 1 Processor -- start 2023-07-14T15:56:53.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.901+0000 7f3457fff700 1 -- start start 2023-07-14T15:56:53.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.902+0000 7f3457fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34500b4910 0x7f345014a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:53.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.902+0000 7f3457fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34500b54b0 0x7f34500cc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:53.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.902+0000 7f3457fff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f34500b85f0 0x7f34500c6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:53.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.902+0000 7f3457fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f345014a7e0 con 0x7f34500b54b0 2023-07-14T15:56:53.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.902+0000 7f3457fff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34500cb670 con 0x7f34500b4910 2023-07-14T15:56:53.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.902+0000 7f3457fff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34500cb950 con 0x7f34500b85f0 2023-07-14T15:56:53.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.903+0000 7f345559a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34500b54b0 0x7f34500cc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:53.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.903+0000 7f345559a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34500b54b0 0x7f34500cc710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43220/0 (socket says 172.21.15.37:43220) 2023-07-14T15:56:53.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.903+0000 7f345559a700 1 -- 172.21.15.37:0/3942950235 learned_addr learned my addr 172.21.15.37:0/3942950235 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:53.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.903+0000 7f3455d9b700 1 --2- 172.21.15.37:0/3942950235 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34500b4910 0x7f345014a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:53.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.903+0000 7f345659c700 1 --2- 172.21.15.37:0/3942950235 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f34500b85f0 0x7f34500c6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:53.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.903+0000 7f345559a700 1 -- 172.21.15.37:0/3942950235 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f34500b85f0 msgr2=0x7f34500c6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:53.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.903+0000 7f345559a700 1 --2- 172.21.15.37:0/3942950235 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f34500b85f0 0x7f34500c6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:53.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.903+0000 7f345559a700 1 -- 172.21.15.37:0/3942950235 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34500b4910 msgr2=0x7f345014a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:53.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.903+0000 7f345559a700 1 --2- 172.21.15.37:0/3942950235 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34500b4910 0x7f345014a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:53.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.903+0000 7f345559a700 1 -- 172.21.15.37:0/3942950235 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f344c0094a0 con 0x7f34500b54b0 2023-07-14T15:56:53.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.903+0000 7f345559a700 1 --2- 172.21.15.37:0/3942950235 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34500b54b0 0x7f34500cc710 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f34400011e0 tx=0x7f344000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:53.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.903+0000 7f34467fc700 1 -- 172.21.15.37:0/3942950235 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3440004c80 con 0x7f34500b54b0 2023-07-14T15:56:53.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.903+0000 7f34467fc700 1 -- 172.21.15.37:0/3942950235 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3440004de0 con 0x7f34500b54b0 2023-07-14T15:56:53.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.903+0000 7f34467fc700 1 -- 172.21.15.37:0/3942950235 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3440007310 con 0x7f34500b54b0 2023-07-14T15:56:53.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.903+0000 7f3457fff700 1 -- 172.21.15.37:0/3942950235 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34500cbc30 con 0x7f34500b54b0 2023-07-14T15:56:53.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.904+0000 7f3457fff700 1 -- 172.21.15.37:0/3942950235 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34500cc1f0 con 0x7f34500b54b0 2023-07-14T15:56:53.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.905+0000 7f3457fff700 1 -- 172.21.15.37:0/3942950235 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34500670c0 con 0x7f34500b54b0 2023-07-14T15:56:53.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.906+0000 7f34467fc700 1 -- 172.21.15.37:0/3942950235 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3440007470 con 0x7f34500b54b0 2023-07-14T15:56:53.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.907+0000 7f34467fc700 1 --2- 172.21.15.37:0/3942950235 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f343406ad10 0x7f343406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:53.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.907+0000 7f34467fc700 1 -- 172.21.15.37:0/3942950235 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3440089250 con 0x7f34500b54b0 2023-07-14T15:56:53.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.908+0000 7f3455d9b700 1 --2- 172.21.15.37:0/3942950235 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f343406ad10 0x7f343406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:53.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.908+0000 7f3455d9b700 1 --2- 172.21.15.37:0/3942950235 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f343406ad10 0x7f343406d1c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f344c0090b0 tx=0x7f344c01c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:53.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:53.911+0000 7f34467fc700 1 -- 172.21.15.37:0/3942950235 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3440054260 con 0x7f34500b54b0 2023-07-14T15:56:54.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.199+0000 7f3457fff700 1 -- 172.21.15.37:0/3942950235 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots.test_subvolume_group_snapshot_unsupported_status"]} v 0) v1 -- 0x7f34500cc3e0 con 0x7f34500b54b0 2023-07-14T15:56:54.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.714+0000 7f34467fc700 1 -- 172.21.15.37:0/3942950235 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots.test_subvolume_group_snapshot_unsupported_status"]}]=0 v66) v1 ==== 184+0+0 (secure 0 0 0) 0x7f3440057880 con 0x7f34500b54b0 2023-07-14T15:56:54.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.717+0000 7f3457fff700 1 -- 172.21.15.37:0/3942950235 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f343406ad10 msgr2=0x7f343406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:54.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.717+0000 7f3457fff700 1 --2- 172.21.15.37:0/3942950235 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f343406ad10 0x7f343406d1c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f344c0090b0 tx=0x7f344c01c040 comp rx=0 tx=0).stop 2023-07-14T15:56:54.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.717+0000 7f3457fff700 1 -- 172.21.15.37:0/3942950235 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34500b54b0 msgr2=0x7f34500cc710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:54.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.717+0000 7f3457fff700 1 --2- 172.21.15.37:0/3942950235 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34500b54b0 0x7f34500cc710 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f34400011e0 tx=0x7f344000ca30 comp rx=0 tx=0).stop 2023-07-14T15:56:54.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.717+0000 7f3457fff700 1 -- 172.21.15.37:0/3942950235 shutdown_connections 2023-07-14T15:56:54.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.717+0000 7f3457fff700 1 --2- 172.21.15.37:0/3942950235 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34500b4910 0x7f345014a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:54.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.717+0000 7f3457fff700 1 --2- 172.21.15.37:0/3942950235 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f343406ad10 0x7f343406d1c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:54.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.717+0000 7f3457fff700 1 --2- 172.21.15.37:0/3942950235 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f34500b85f0 0x7f34500c6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:54.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.717+0000 7f3457fff700 1 --2- 172.21.15.37:0/3942950235 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34500b54b0 0x7f34500cc710 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:54.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.717+0000 7f3457fff700 1 -- 172.21.15.37:0/3942950235 >> 172.21.15.37:0/3942950235 conn(0x7f345006a580 msgr2=0x7f34500b5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:54.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.717+0000 7f3457fff700 1 -- 172.21.15.37:0/3942950235 shutdown_connections 2023-07-14T15:56:54.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.717+0000 7f3457fff700 1 -- 172.21.15.37:0/3942950235 wait complete. 2023-07-14T15:56:54.723 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-14T15:56:54.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.949+0000 7f44595ff700 1 Processor -- start 2023-07-14T15:56:54.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.949+0000 7f44595ff700 1 -- start start 2023-07-14T15:56:54.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.950+0000 7f44595ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f44540cf300 0x7f44540cf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:54.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.950+0000 7f44595ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f44540cfcb0 0x7f44540d1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:54.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.950+0000 7f44595ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44540cd550 con 0x7f445415c6b0 2023-07-14T15:56:54.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.950+0000 7f44595ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f445415ca80 con 0x7f44540cfcb0 2023-07-14T15:56:54.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.950+0000 7f44595ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44540cd830 con 0x7f44540cf300 2023-07-14T15:56:54.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.951+0000 7f44527fc700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f44540cf300 0x7f44540cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:54.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.951+0000 7f44537fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f44540cfcb0 0x7f44540d1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:54.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.951+0000 7f44527fc700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f44540cf300 0x7f44540cf770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3301/0 says I am v2:172.21.15.37:55616/0 (socket says 172.21.15.37:55616) 2023-07-14T15:56:54.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.951+0000 7f44527fc700 1 -- 172.21.15.37:0/2020983654 learned_addr learned my addr 172.21.15.37:0/2020983654 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:54.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.951+0000 7f44537fe700 1 -- 172.21.15.37:0/2020983654 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f44540cf300 msgr2=0x7f44540cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:54.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.951+0000 7f44537fe700 1 --2- 172.21.15.37:0/2020983654 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f44540cf300 0x7f44540cf770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:54.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.951+0000 7f44537fe700 1 -- 172.21.15.37:0/2020983654 >> v1:172.21.15.98:6789/0 conn(0x7f445415c6b0 legacy=0x7f44540d3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:54.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.951+0000 7f44537fe700 1 -- 172.21.15.37:0/2020983654 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44540cdb10 con 0x7f44540cfcb0 2023-07-14T15:56:54.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.952+0000 7f44537fe700 1 --2- 172.21.15.37:0/2020983654 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f44540cfcb0 0x7f44540d1230 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f444c009dc0 tx=0x7f444c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67c55174f7ba1d82 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:54.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.952+0000 7f4451ffb700 1 -- 172.21.15.37:0/2020983654 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444c00e070 con 0x7f44540cfcb0 2023-07-14T15:56:54.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.952+0000 7f4451ffb700 1 -- 172.21.15.37:0/2020983654 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f444c00bae0 con 0x7f44540cfcb0 2023-07-14T15:56:54.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.952+0000 7f4451ffb700 1 -- 172.21.15.37:0/2020983654 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444c00be90 con 0x7f44540cfcb0 2023-07-14T15:56:54.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.952+0000 7f44595ff700 1 -- 172.21.15.37:0/2020983654 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f44540cfcb0 msgr2=0x7f44540d1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:54.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.952+0000 7f44595ff700 1 --2- 172.21.15.37:0/2020983654 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f44540cfcb0 0x7f44540d1230 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f444c009dc0 tx=0x7f444c00b330 comp rx=0 tx=0).stop 2023-07-14T15:56:54.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.952+0000 7f44595ff700 1 -- 172.21.15.37:0/2020983654 shutdown_connections 2023-07-14T15:56:54.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.952+0000 7f44595ff700 1 --2- 172.21.15.37:0/2020983654 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f44540cfcb0 0x7f44540d1230 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:54.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.952+0000 7f44595ff700 1 --2- 172.21.15.37:0/2020983654 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f44540cf300 0x7f44540cf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:54.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.952+0000 7f44595ff700 1 -- 172.21.15.37:0/2020983654 >> 172.21.15.37:0/2020983654 conn(0x7f445406a680 msgr2=0x7f445406aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:54.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.953+0000 7f44595ff700 1 -- 172.21.15.37:0/2020983654 shutdown_connections 2023-07-14T15:56:54.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.953+0000 7f44595ff700 1 -- 172.21.15.37:0/2020983654 wait complete. 2023-07-14T15:56:54.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.955+0000 7f44595ff700 1 Processor -- start 2023-07-14T15:56:54.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.955+0000 7f44595ff700 1 -- start start 2023-07-14T15:56:54.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.956+0000 7f44595ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f44540cf300 0x7f4454156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:54.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.956+0000 7f44595ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44540cfcb0 0x7f44541e8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:54.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.956+0000 7f44595ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f445415c6b0 0x7f44541e8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:54.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.956+0000 7f44595ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44541e90c0 con 0x7f44540cfcb0 2023-07-14T15:56:54.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.956+0000 7f44595ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4454159410 con 0x7f445415c6b0 2023-07-14T15:56:54.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.956+0000 7f44595ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44541e6d20 con 0x7f44540cf300 2023-07-14T15:56:54.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.957+0000 7f44527fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44540cfcb0 0x7f44541e8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:54.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.957+0000 7f44527fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44540cfcb0 0x7f44541e8640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43226/0 (socket says 172.21.15.37:43226) 2023-07-14T15:56:54.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.957+0000 7f44527fc700 1 -- 172.21.15.37:0/1021154968 learned_addr learned my addr 172.21.15.37:0/1021154968 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:54.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.957+0000 7f4452ffd700 1 --2- 172.21.15.37:0/1021154968 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f44540cf300 0x7f4454156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:54.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.957+0000 7f44537fe700 1 --2- 172.21.15.37:0/1021154968 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f445415c6b0 0x7f44541e8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:54.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.957+0000 7f44527fc700 1 -- 172.21.15.37:0/1021154968 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f44540cf300 msgr2=0x7f4454156380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:54.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.957+0000 7f44527fc700 1 --2- 172.21.15.37:0/1021154968 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f44540cf300 0x7f4454156380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:54.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.957+0000 7f44527fc700 1 -- 172.21.15.37:0/1021154968 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f445415c6b0 msgr2=0x7f44541e8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:54.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.957+0000 7f44527fc700 1 --2- 172.21.15.37:0/1021154968 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f445415c6b0 0x7f44541e8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:54.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.957+0000 7f44527fc700 1 -- 172.21.15.37:0/1021154968 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f444c009a70 con 0x7f44540cfcb0 2023-07-14T15:56:54.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.957+0000 7f44527fc700 1 --2- 172.21.15.37:0/1021154968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44540cfcb0 0x7f44541e8640 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f444800e910 tx=0x7f444800ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:54.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.958+0000 7f443b7fe700 1 -- 172.21.15.37:0/1021154968 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44480096a0 con 0x7f44540cfcb0 2023-07-14T15:56:54.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.958+0000 7f443b7fe700 1 -- 172.21.15.37:0/1021154968 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4448013680 con 0x7f44540cfcb0 2023-07-14T15:56:54.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.958+0000 7f44595ff700 1 -- 172.21.15.37:0/1021154968 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44541e7000 con 0x7f44540cfcb0 2023-07-14T15:56:54.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.958+0000 7f443b7fe700 1 -- 172.21.15.37:0/1021154968 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4448013a30 con 0x7f44540cfcb0 2023-07-14T15:56:54.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.958+0000 7f44595ff700 1 -- 172.21.15.37:0/1021154968 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4454159990 con 0x7f44540cfcb0 2023-07-14T15:56:54.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.959+0000 7f44595ff700 1 -- 172.21.15.37:0/1021154968 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4454067840 con 0x7f44540cfcb0 2023-07-14T15:56:54.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.960+0000 7f443b7fe700 1 -- 172.21.15.37:0/1021154968 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4448013b90 con 0x7f44540cfcb0 2023-07-14T15:56:54.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.961+0000 7f443b7fe700 1 --2- 172.21.15.37:0/1021154968 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f444006ace0 0x7f444006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:54.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.961+0000 7f443b7fe700 1 -- 172.21.15.37:0/1021154968 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f44480892f0 con 0x7f44540cfcb0 2023-07-14T15:56:54.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.961+0000 7f4452ffd700 1 --2- 172.21.15.37:0/1021154968 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f444006ace0 0x7f444006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:54.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.962+0000 7f4452ffd700 1 --2- 172.21.15.37:0/1021154968 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f444006ace0 0x7f444006d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4444001800 tx=0x7f4444009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:54.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:54.966+0000 7f443b7fe700 1 -- 172.21.15.37:0/1021154968 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4448054390 con 0x7f44540cfcb0 2023-07-14T15:56:55.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.176+0000 7f44595ff700 1 -- 172.21.15.37:0/1021154968 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f4454073530 con 0x7f44540cfcb0 2023-07-14T15:56:55.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.180+0000 7f443b7fe700 1 -- 172.21.15.37:0/1021154968 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f44480579b0 con 0x7f44540cfcb0 2023-07-14T15:56:55.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.183+0000 7f44595ff700 1 -- 172.21.15.37:0/1021154968 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f444006ace0 msgr2=0x7f444006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:55.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.183+0000 7f44595ff700 1 --2- 172.21.15.37:0/1021154968 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f444006ace0 0x7f444006d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4444001800 tx=0x7f4444009040 comp rx=0 tx=0).stop 2023-07-14T15:56:55.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.183+0000 7f44595ff700 1 -- 172.21.15.37:0/1021154968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44540cfcb0 msgr2=0x7f44541e8640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:55.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.183+0000 7f44595ff700 1 --2- 172.21.15.37:0/1021154968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44540cfcb0 0x7f44541e8640 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f444800e910 tx=0x7f444800ec20 comp rx=0 tx=0).stop 2023-07-14T15:56:55.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.183+0000 7f44595ff700 1 -- 172.21.15.37:0/1021154968 shutdown_connections 2023-07-14T15:56:55.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.183+0000 7f44595ff700 1 --2- 172.21.15.37:0/1021154968 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f445415c6b0 0x7f44541e8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:55.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.183+0000 7f44595ff700 1 --2- 172.21.15.37:0/1021154968 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f444006ace0 0x7f444006d190 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:55.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.183+0000 7f44595ff700 1 --2- 172.21.15.37:0/1021154968 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f44540cf300 0x7f4454156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:55.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.183+0000 7f44595ff700 1 --2- 172.21.15.37:0/1021154968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44540cfcb0 0x7f44541e8640 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:55.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.183+0000 7f44595ff700 1 -- 172.21.15.37:0/1021154968 >> 172.21.15.37:0/1021154968 conn(0x7f445406a680 msgr2=0x7f4454156c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:55.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.183+0000 7f44595ff700 1 -- 172.21.15.37:0/1021154968 shutdown_connections 2023-07-14T15:56:55.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.183+0000 7f44595ff700 1 -- 172.21.15.37:0/1021154968 wait complete. 2023-07-14T15:56:55.186 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-14T15:56:55.187 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T15:56:55.293 DEBUG:teuthology.orchestra.run.smithi098:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T15:56:55.402 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-14T15:56:55.403 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-14T15:56:55.403 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T15:56:55.446 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-14T15:56:55.447 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T15:56:55.530 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-14T15:56:55.530 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T15:56:55.613 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T15:56:55.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.869+0000 7ff05b9ff700 1 Processor -- start 2023-07-14T15:56:55.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.869+0000 7ff05b9ff700 1 -- start start 2023-07-14T15:56:55.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.870+0000 7ff05b9ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff0540b85f0 0x7ff05415d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:55.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.870+0000 7ff05b9ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff0540b4910 0x7ff0540b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:55.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.870+0000 7ff05b9ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0540cf6b0 con 0x7ff0540b54b0 2023-07-14T15:56:55.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.871+0000 7ff05b9ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0540b52d0 con 0x7ff0540b4910 2023-07-14T15:56:55.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.871+0000 7ff05b9ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0540cdc40 con 0x7ff0540b85f0 2023-07-14T15:56:55.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.871+0000 7ff058f9a700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff0540b54b0 0x7ff0540cfb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38052/0 (socket says 172.21.15.37:38052) 2023-07-14T15:56:55.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.871+0000 7ff058f9a700 1 -- 172.21.15.37:0/1713859623 learned_addr learned my addr 172.21.15.37:0/1713859623 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:55.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.871+0000 7ff059f9c700 1 --2- 172.21.15.37:0/1713859623 >> v2:172.21.15.98:3300/0 conn(0x7ff0540b4910 0x7ff0540b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:55.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.871+0000 7ff05979b700 1 --2- 172.21.15.37:0/1713859623 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff0540b85f0 0x7ff05415d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:55.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.871+0000 7ff04bfff700 1 -- 172.21.15.37:0/1713859623 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2657931939 0 0) 0x7ff0540cf6b0 con 0x7ff0540b54b0 2023-07-14T15:56:55.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.871+0000 7ff04bfff700 1 -- 172.21.15.37:0/1713859623 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0400035b0 con 0x7ff0540b54b0 2023-07-14T15:56:55.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.871+0000 7ff059f9c700 1 -- 172.21.15.37:0/1713859623 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff0540b85f0 msgr2=0x7ff05415d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:55.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.871+0000 7ff059f9c700 1 --2- 172.21.15.37:0/1713859623 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff0540b85f0 0x7ff05415d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:55.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.871+0000 7ff059f9c700 1 -- 172.21.15.37:0/1713859623 >> v1:172.21.15.37:6789/0 conn(0x7ff0540b54b0 legacy=0x7ff0540cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:55.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.871+0000 7ff059f9c700 1 -- 172.21.15.37:0/1713859623 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff05415dba0 con 0x7ff0540b4910 2023-07-14T15:56:55.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.872+0000 7ff059f9c700 1 --2- 172.21.15.37:0/1713859623 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0540b4910 0x7ff0540b4d90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff04c009d90 tx=0x7ff04c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cc956b499937791 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:55.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.872+0000 7ff04bfff700 1 -- 172.21.15.37:0/1713859623 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04c00e070 con 0x7ff0540b4910 2023-07-14T15:56:55.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.872+0000 7ff04bfff700 1 -- 172.21.15.37:0/1713859623 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff04c00bb20 con 0x7ff0540b4910 2023-07-14T15:56:55.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.872+0000 7ff04bfff700 1 -- 172.21.15.37:0/1713859623 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04c012430 con 0x7ff0540b4910 2023-07-14T15:56:55.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.873+0000 7ff05b9ff700 1 -- 172.21.15.37:0/1713859623 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0540b4910 msgr2=0x7ff0540b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:55.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.873+0000 7ff05b9ff700 1 --2- 172.21.15.37:0/1713859623 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0540b4910 0x7ff0540b4d90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff04c009d90 tx=0x7ff04c00b330 comp rx=0 tx=0).stop 2023-07-14T15:56:55.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.873+0000 7ff05b9ff700 1 -- 172.21.15.37:0/1713859623 shutdown_connections 2023-07-14T15:56:55.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.873+0000 7ff05b9ff700 1 --2- 172.21.15.37:0/1713859623 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0540b4910 0x7ff0540b4d90 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:55.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.873+0000 7ff05b9ff700 1 --2- 172.21.15.37:0/1713859623 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff0540b85f0 0x7ff05415d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:55.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.873+0000 7ff05b9ff700 1 -- 172.21.15.37:0/1713859623 >> 172.21.15.37:0/1713859623 conn(0x7ff05406a580 msgr2=0x7ff05406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:55.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.873+0000 7ff05b9ff700 1 -- 172.21.15.37:0/1713859623 shutdown_connections 2023-07-14T15:56:55.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.873+0000 7ff05b9ff700 1 -- 172.21.15.37:0/1713859623 wait complete. 2023-07-14T15:56:55.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.875+0000 7ff05b9ff700 1 Processor -- start 2023-07-14T15:56:55.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.875+0000 7ff05b9ff700 1 -- start start 2023-07-14T15:56:55.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.876+0000 7ff05b9ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0540b4910 0x7ff0540c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:55.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.876+0000 7ff05b9ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0540b54b0 0x7ff0540b4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:55.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.876+0000 7ff05b9ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff0540b85f0 0x7ff05415f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:55.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.876+0000 7ff05b9ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0541f5970 con 0x7ff0540b4910 2023-07-14T15:56:55.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.876+0000 7ff05b9ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0541f5c50 con 0x7ff0540b54b0 2023-07-14T15:56:55.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.876+0000 7ff05b9ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0541f5f30 con 0x7ff0540b85f0 2023-07-14T15:56:55.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.876+0000 7ff05979b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0540b4910 0x7ff0540c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:55.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.876+0000 7ff05979b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0540b4910 0x7ff0540c9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43236/0 (socket says 172.21.15.37:43236) 2023-07-14T15:56:55.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.876+0000 7ff05979b700 1 -- 172.21.15.37:0/215481194 learned_addr learned my addr 172.21.15.37:0/215481194 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:55.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.876+0000 7ff059f9c700 1 --2- 172.21.15.37:0/215481194 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff0540b85f0 0x7ff05415f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:55.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.876+0000 7ff058f9a700 1 --2- 172.21.15.37:0/215481194 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0540b54b0 0x7ff0540b4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:55.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.876+0000 7ff05979b700 1 -- 172.21.15.37:0/215481194 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff0540b85f0 msgr2=0x7ff05415f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:55.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.876+0000 7ff05979b700 1 --2- 172.21.15.37:0/215481194 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff0540b85f0 0x7ff05415f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:55.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.876+0000 7ff05979b700 1 -- 172.21.15.37:0/215481194 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0540b54b0 msgr2=0x7ff0540b4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:55.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.877+0000 7ff05979b700 1 --2- 172.21.15.37:0/215481194 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0540b54b0 0x7ff0540b4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:55.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.877+0000 7ff05979b700 1 -- 172.21.15.37:0/215481194 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff04c009a70 con 0x7ff0540b4910 2023-07-14T15:56:55.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.877+0000 7ff058f9a700 1 --2- 172.21.15.37:0/215481194 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0540b54b0 0x7ff0540b4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:56:55.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.877+0000 7ff059f9c700 1 --2- 172.21.15.37:0/215481194 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff0540b85f0 0x7ff05415f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:56:55.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.877+0000 7ff05979b700 1 --2- 172.21.15.37:0/215481194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0540b4910 0x7ff0540c9f60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff05000e870 tx=0x7ff05000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:55.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.877+0000 7ff049ffb700 1 -- 172.21.15.37:0/215481194 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff050009590 con 0x7ff0540b4910 2023-07-14T15:56:55.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.877+0000 7ff049ffb700 1 -- 172.21.15.37:0/215481194 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff05000ee70 con 0x7ff0540b4910 2023-07-14T15:56:55.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.877+0000 7ff05b9ff700 1 -- 172.21.15.37:0/215481194 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0541f6210 con 0x7ff0540b4910 2023-07-14T15:56:55.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.877+0000 7ff049ffb700 1 -- 172.21.15.37:0/215481194 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05000ca50 con 0x7ff0540b4910 2023-07-14T15:56:55.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.877+0000 7ff05b9ff700 1 -- 172.21.15.37:0/215481194 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff05414e580 con 0x7ff0540b4910 2023-07-14T15:56:55.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.878+0000 7ff05b9ff700 1 -- 172.21.15.37:0/215481194 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0540c8140 con 0x7ff0540b4910 2023-07-14T15:56:55.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.879+0000 7ff049ffb700 1 -- 172.21.15.37:0/215481194 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff05000cbb0 con 0x7ff0540b4910 2023-07-14T15:56:55.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.880+0000 7ff049ffb700 1 --2- 172.21.15.37:0/215481194 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff03806ace0 0x7ff03806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:55.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.880+0000 7ff049ffb700 1 -- 172.21.15.37:0/215481194 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff0500893f0 con 0x7ff0540b4910 2023-07-14T15:56:55.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.881+0000 7ff058f9a700 1 --2- 172.21.15.37:0/215481194 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff03806ace0 0x7ff03806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:55.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.881+0000 7ff058f9a700 1 --2- 172.21.15.37:0/215481194 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff03806ace0 0x7ff03806d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff0540ca4a0 tx=0x7ff044009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:55.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:55.885+0000 7ff049ffb700 1 -- 172.21.15.37:0/215481194 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff050057f20 con 0x7ff0540b4910 2023-07-14T15:56:56.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.097+0000 7ff05b9ff700 1 -- 172.21.15.37:0/215481194 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff054067840 con 0x7ff0540b4910 2023-07-14T15:56:56.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.099+0000 7ff049ffb700 1 -- 172.21.15.37:0/215481194 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18341 (secure 0 0 0) 0x7ff05000ce60 con 0x7ff0540b4910 2023-07-14T15:56:56.085 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:56:56.085 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"fsid":"9da30401-a779-4e46-aba6-00c2494c6c67","created":"2023-07-14T15:55:39.898867+0000","modified":"2023-07-14T15:56:09.959850+0000","last_up_change":"2023-07-14T15:55:53.025696+0000","last_in_change":"2023-07-14T15:55:43.388192+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T15:55:52.907261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T15:55:59.992839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T15:56:06.091064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T15:56:07.448694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d049535-7b87-4276-8fe5-0f74ba422d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6801","nonce":2783032392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6803","nonce":2783032392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6807","nonce":2783032392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6805","nonce":2783032392}]},"public_addr":"172.21.15.37:6801/2783032392","cluster_addr":"172.21.15.37:6803/2783032392","heartbeat_back_addr":"172.21.15.37:6807/2783032392","heartbeat_front_addr":"172.21.15.37:6805/2783032392","state":["exists","up"]},{"osd":1,"uuid":"79ec948d-ead2-4c2d-923a-dd6eeaac9dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6823","nonce":1190059746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6826","nonce":1190059746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6831","nonce":1190059746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6829","nonce":1190059746}]},"public_addr":"172.21.15.37:6823/1190059746","cluster_addr":"172.21.15.37:6826/1190059746","heartbeat_back_addr":"172.21.15.37:6831/1190059746","heartbeat_front_addr":"172.21.15.37:6829/1190059746","state":["exists","up"]},{"osd":2,"uuid":"a1db6690-c160-4366-9c82-2cca17e4bba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6809","nonce":2266223499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6813","nonce":2266223499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6820","nonce":2266223499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6816","nonce":2266223499}]},"public_addr":"172.21.15.37:6809/2266223499","cluster_addr":"172.21.15.37:6813/2266223499","heartbeat_back_addr":"172.21.15.37:6820/2266223499","heartbeat_front_addr":"172.21.15.37:6816/2266223499","state":["exists","up"]},{"osd":3,"uuid":"767b8220-e79a-4a86-a162-6b3b73198379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6812","nonce":4166694594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6817","nonce":4166694594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6828","nonce":4166694594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6822","nonce":4166694594}]},"public_addr":"172.21.15.37:6812/4166694594","cluster_addr":"172.21.15.37:6817/4166694594","heartbeat_back_addr":"172.21.15.37:6828/4166694594","heartbeat_front_addr":"172.21.15.37:6822/4166694594","state":["exists","up"]},{"osd":4,"uuid":"717bd773-ae7e-4236-ac79-900cf99a37c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6801","nonce":3529020407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6803","nonce":3529020407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6807","nonce":3529020407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6805","nonce":3529020407}]},"public_addr":"172.21.15.98:6801/3529020407","cluster_addr":"172.21.15.98:6803/3529020407","heartbeat_back_addr":"172.21.15.98:6807/3529020407","heartbeat_front_addr":"172.21.15.98:6805/3529020407","state":["exists","up"]},{"osd":5,"uuid":"a941d358-0f03-4136-a9b2-3a1c2e9358cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6817","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6819","nonce":2311501838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6821","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6823","nonce":2311501838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6829","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6831","nonce":2311501838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6825","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6827","nonce":2311501838}]},"public_addr":"172.21.15.98:6819/2311501838","cluster_addr":"172.21.15.98:6823/2311501838","heartbeat_back_addr":"172.21.15.98:6831/2311501838","heartbeat_front_addr":"172.21.15.98:6827/2311501838","state":["exists","up"]},{"osd":6,"uuid":"27153772-6d4b-479d-9953-0582e7b96743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6809","nonce":1144224691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6811","nonce":1144224691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6815","nonce":1144224691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6813","nonce":1144224691}]},"public_addr":"172.21.15.98:6809/1144224691","cluster_addr":"172.21.15.98:6811/1144224691","heartbeat_back_addr":"172.21.15.98:6815/1144224691","heartbeat_front_addr":"172.21.15.98:6813/1144224691","state":["exists","up"]},{"osd":7,"uuid":"d21ffc8e-40bb-47eb-af2c-e3e730d3fb76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6818","nonce":1144470927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6822","nonce":1144470927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6830","nonce":1144470927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6826","nonce":1144470927}]},"public_addr":"172.21.15.98:6818/1144470927","cluster_addr":"172.21.15.98:6822/1144470927","heartbeat_back_addr":"172.21.15.98:6830/1144470927","heartbeat_front_addr":"172.21.15.98:6826/1144470927","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.921114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.739210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.024016+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.002527+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.698127+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.813416+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.709351+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.815457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T15:56:56.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.101+0000 7ff05b9ff700 1 -- 172.21.15.37:0/215481194 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff03806ace0 msgr2=0x7ff03806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:56.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.101+0000 7ff05b9ff700 1 --2- 172.21.15.37:0/215481194 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff03806ace0 0x7ff03806d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff0540ca4a0 tx=0x7ff044009040 comp rx=0 tx=0).stop 2023-07-14T15:56:56.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.101+0000 7ff05b9ff700 1 -- 172.21.15.37:0/215481194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0540b4910 msgr2=0x7ff0540c9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:56.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.101+0000 7ff05b9ff700 1 --2- 172.21.15.37:0/215481194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0540b4910 0x7ff0540c9f60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff05000e870 tx=0x7ff05000ec30 comp rx=0 tx=0).stop 2023-07-14T15:56:56.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.101+0000 7ff05b9ff700 1 -- 172.21.15.37:0/215481194 shutdown_connections 2023-07-14T15:56:56.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.101+0000 7ff05b9ff700 1 --2- 172.21.15.37:0/215481194 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff03806ace0 0x7ff03806d190 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:56.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.101+0000 7ff05b9ff700 1 --2- 172.21.15.37:0/215481194 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff0540b85f0 0x7ff05415f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:56.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.101+0000 7ff05b9ff700 1 --2- 172.21.15.37:0/215481194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0540b4910 0x7ff0540c9f60 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:56.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.101+0000 7ff05b9ff700 1 --2- 172.21.15.37:0/215481194 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0540b54b0 0x7ff0540b4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:56.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.101+0000 7ff05b9ff700 1 -- 172.21.15.37:0/215481194 >> 172.21.15.37:0/215481194 conn(0x7ff05406a580 msgr2=0x7ff0540cfa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:56.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.101+0000 7ff05b9ff700 1 -- 172.21.15.37:0/215481194 shutdown_connections 2023-07-14T15:56:56.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.101+0000 7ff05b9ff700 1 -- 172.21.15.37:0/215481194 wait complete. 2023-07-14T15:56:56.105 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T15:55:52.907261+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T15:55:59.992839+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T15:56:06.091064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T15:56:07.448694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T15:56:56.106 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T15:56:56.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.325+0000 7f5f343ff700 1 Processor -- start 2023-07-14T15:56:56.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.325+0000 7f5f343ff700 1 -- start start 2023-07-14T15:56:56.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.326+0000 7f5f343ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5f2c071820 0x7f5f2c06cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:56.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.326+0000 7f5f343ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5f2c06d0c0 0x7f5f2c0c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:56.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.326+0000 7f5f343ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f2c0707f0 con 0x7f5f2c0cb430 2023-07-14T15:56:56.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.326+0000 7f5f343ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f2c070a60 con 0x7f5f2c06d0c0 2023-07-14T15:56:56.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.326+0000 7f5f343ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c070d40 con 0x7f5f2c071820 2023-07-14T15:56:56.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.327+0000 7f5f3299c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5f2c06d0c0 0x7f5f2c0c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:56.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.327+0000 7f5f3299c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5f2c06d0c0 0x7f5f2c0c90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43250/0 (socket says 172.21.15.37:43250) 2023-07-14T15:56:56.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.327+0000 7f5f3299c700 1 -- 172.21.15.37:0/1155456545 learned_addr learned my addr 172.21.15.37:0/1155456545 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:56.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.327+0000 7f5f3199a700 1 --2- 172.21.15.37:0/1155456545 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5f2c071820 0x7f5f2c06cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:56.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.327+0000 7f5f3299c700 1 -- 172.21.15.37:0/1155456545 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5f2c071820 msgr2=0x7f5f2c06cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:56.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.327+0000 7f5f3299c700 1 --2- 172.21.15.37:0/1155456545 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5f2c071820 0x7f5f2c06cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:56.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.327+0000 7f5f3299c700 1 -- 172.21.15.37:0/1155456545 >> v1:172.21.15.98:6789/0 conn(0x7f5f2c0cb430 legacy=0x7f5f2c0cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:56.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.327+0000 7f5f3299c700 1 -- 172.21.15.37:0/1155456545 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f2c071020 con 0x7f5f2c06d0c0 2023-07-14T15:56:56.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.327+0000 7f5f3299c700 1 --2- 172.21.15.37:0/1155456545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f2c06d0c0 0x7f5f2c0c90d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5f24009e50 tx=0x7f5f2400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d0ddbb33d6f1e50 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:56.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.328+0000 7f5f31199700 1 -- 172.21.15.37:0/1155456545 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2400e070 con 0x7f5f2c06d0c0 2023-07-14T15:56:56.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.328+0000 7f5f31199700 1 -- 172.21.15.37:0/1155456545 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2400b9c0 con 0x7f5f2c06d0c0 2023-07-14T15:56:56.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.328+0000 7f5f31199700 1 -- 172.21.15.37:0/1155456545 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2400bd70 con 0x7f5f2c06d0c0 2023-07-14T15:56:56.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.328+0000 7f5f343ff700 1 -- 172.21.15.37:0/1155456545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f2c06d0c0 msgr2=0x7f5f2c0c90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:56.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.328+0000 7f5f343ff700 1 --2- 172.21.15.37:0/1155456545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f2c06d0c0 0x7f5f2c0c90d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5f24009e50 tx=0x7f5f2400b330 comp rx=0 tx=0).stop 2023-07-14T15:56:56.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.328+0000 7f5f343ff700 1 -- 172.21.15.37:0/1155456545 shutdown_connections 2023-07-14T15:56:56.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.328+0000 7f5f343ff700 1 --2- 172.21.15.37:0/1155456545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f2c06d0c0 0x7f5f2c0c90d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:56.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.328+0000 7f5f343ff700 1 --2- 172.21.15.37:0/1155456545 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5f2c071820 0x7f5f2c06cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:56.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.328+0000 7f5f343ff700 1 -- 172.21.15.37:0/1155456545 >> 172.21.15.37:0/1155456545 conn(0x7f5f2c06aac0 msgr2=0x7f5f2c0b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:56.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.328+0000 7f5f343ff700 1 -- 172.21.15.37:0/1155456545 shutdown_connections 2023-07-14T15:56:56.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.328+0000 7f5f343ff700 1 -- 172.21.15.37:0/1155456545 wait complete. 2023-07-14T15:56:56.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.331+0000 7f5f343ff700 1 Processor -- start 2023-07-14T15:56:56.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.331+0000 7f5f343ff700 1 -- start start 2023-07-14T15:56:56.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.332+0000 7f5f343ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f2c06d0c0 0x7f5f2c14d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:56.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.332+0000 7f5f343ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5f2c071820 0x7f5f2c153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:56.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.333+0000 7f5f3199a700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5f2c071820 0x7f5f2c153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:56.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.333+0000 7f5f3199a700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5f2c071820 0x7f5f2c153b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3301/0 says I am v2:172.21.15.37:55664/0 (socket says 172.21.15.37:55664) 2023-07-14T15:56:56.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.333+0000 7f5f3219b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f2c06d0c0 0x7f5f2c14d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:56.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.333+0000 7f5f343ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f2c0cb430 0x7f5f2c150c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:56.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.333+0000 7f5f3199a700 1 -- 172.21.15.37:0/405999617 learned_addr learned my addr 172.21.15.37:0/405999617 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:56.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.333+0000 7f5f343ff700 1 -- 172.21.15.37:0/405999617 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c1545b0 con 0x7f5f2c0cb430 2023-07-14T15:56:56.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.333+0000 7f5f343ff700 1 -- 172.21.15.37:0/405999617 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c154890 con 0x7f5f2c06d0c0 2023-07-14T15:56:56.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.333+0000 7f5f343ff700 1 -- 172.21.15.37:0/405999617 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c154b70 con 0x7f5f2c071820 2023-07-14T15:56:56.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.333+0000 7f5f3299c700 1 --2- 172.21.15.37:0/405999617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f2c0cb430 0x7f5f2c150c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:56.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.333+0000 7f5f3199a700 1 -- 172.21.15.37:0/405999617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f2c06d0c0 msgr2=0x7f5f2c14d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:56.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.333+0000 7f5f3199a700 1 --2- 172.21.15.37:0/405999617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f2c06d0c0 0x7f5f2c14d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:56.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.333+0000 7f5f3199a700 1 -- 172.21.15.37:0/405999617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f2c0cb430 msgr2=0x7f5f2c150c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:56.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.333+0000 7f5f3199a700 1 --2- 172.21.15.37:0/405999617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f2c0cb430 0x7f5f2c150c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:56.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.333+0000 7f5f3199a700 1 -- 172.21.15.37:0/405999617 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f24009b30 con 0x7f5f2c071820 2023-07-14T15:56:56.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.333+0000 7f5f3199a700 1 --2- 172.21.15.37:0/405999617 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5f2c071820 0x7f5f2c153b40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c00e810 tx=0x7f5f1c00eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:56.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.334+0000 7f5f22ffd700 1 -- 172.21.15.37:0/405999617 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c00c070 con 0x7f5f2c071820 2023-07-14T15:56:56.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.334+0000 7f5f22ffd700 1 -- 172.21.15.37:0/405999617 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f1c013610 con 0x7f5f2c071820 2023-07-14T15:56:56.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.334+0000 7f5f343ff700 1 -- 172.21.15.37:0/405999617 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f2c154e50 con 0x7f5f2c071820 2023-07-14T15:56:56.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.334+0000 7f5f22ffd700 1 -- 172.21.15.37:0/405999617 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c0139a0 con 0x7f5f2c071820 2023-07-14T15:56:56.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.334+0000 7f5f343ff700 1 -- 172.21.15.37:0/405999617 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f2c152430 con 0x7f5f2c071820 2023-07-14T15:56:56.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.335+0000 7f5f343ff700 1 -- 172.21.15.37:0/405999617 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f2c0ca640 con 0x7f5f2c071820 2023-07-14T15:56:56.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.336+0000 7f5f22ffd700 1 -- 172.21.15.37:0/405999617 <== mon.2 v2:172.21.15.98:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5f1c013b00 con 0x7f5f2c071820 2023-07-14T15:56:56.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.337+0000 7f5f22ffd700 1 --2- 172.21.15.37:0/405999617 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f5f1006ace0 0x7f5f1006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:56.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.337+0000 7f5f22ffd700 1 -- 172.21.15.37:0/405999617 <== mon.2 v2:172.21.15.98:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5f1c0892f0 con 0x7f5f2c071820 2023-07-14T15:56:56.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.338+0000 7f5f3219b700 1 --2- 172.21.15.37:0/405999617 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f5f1006ace0 0x7f5f1006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:56.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.338+0000 7f5f3219b700 1 --2- 172.21.15.37:0/405999617 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f5f1006ace0 0x7f5f1006d190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c0ae520 tx=0x7f5f28009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:56.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.340+0000 7f5f22ffd700 1 -- 172.21.15.37:0/405999617 <== mon.2 v2:172.21.15.98:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5f1c057e10 con 0x7f5f2c071820 2023-07-14T15:56:56.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.547+0000 7f5f343ff700 1 -- 172.21.15.37:0/405999617 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5f2c152650 con 0x7f5f2c071820 2023-07-14T15:56:56.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.548+0000 7f5f22ffd700 1 -- 172.21.15.37:0/405999617 <== mon.2 v2:172.21.15.98:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5f2c152650 con 0x7f5f2c071820 2023-07-14T15:56:56.533 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-14T15:56:56.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.550+0000 7f5f343ff700 1 -- 172.21.15.37:0/405999617 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f5f1006ace0 msgr2=0x7f5f1006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:56.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.550+0000 7f5f343ff700 1 --2- 172.21.15.37:0/405999617 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f5f1006ace0 0x7f5f1006d190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c0ae520 tx=0x7f5f28009040 comp rx=0 tx=0).stop 2023-07-14T15:56:56.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.550+0000 7f5f343ff700 1 -- 172.21.15.37:0/405999617 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5f2c071820 msgr2=0x7f5f2c153b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:56.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.550+0000 7f5f343ff700 1 --2- 172.21.15.37:0/405999617 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5f2c071820 0x7f5f2c153b40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c00e810 tx=0x7f5f1c00eb20 comp rx=0 tx=0).stop 2023-07-14T15:56:56.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.550+0000 7f5f343ff700 1 -- 172.21.15.37:0/405999617 shutdown_connections 2023-07-14T15:56:56.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.550+0000 7f5f343ff700 1 --2- 172.21.15.37:0/405999617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f2c06d0c0 0x7f5f2c14d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:56.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.550+0000 7f5f343ff700 1 --2- 172.21.15.37:0/405999617 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f5f1006ace0 0x7f5f1006d190 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:56.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.550+0000 7f5f343ff700 1 --2- 172.21.15.37:0/405999617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f2c0cb430 0x7f5f2c150c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:56.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.550+0000 7f5f343ff700 1 --2- 172.21.15.37:0/405999617 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5f2c071820 0x7f5f2c153b40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:56.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.550+0000 7f5f343ff700 1 -- 172.21.15.37:0/405999617 >> 172.21.15.37:0/405999617 conn(0x7f5f2c06aac0 msgr2=0x7f5f2c0b0040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:56.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.550+0000 7f5f343ff700 1 -- 172.21.15.37:0/405999617 shutdown_connections 2023-07-14T15:56:56.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.550+0000 7f5f343ff700 1 -- 172.21.15.37:0/405999617 wait complete. 2023-07-14T15:56:56.553 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T15:56:56.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.774+0000 7fc6413ff700 1 Processor -- start 2023-07-14T15:56:56.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.775+0000 7fc6413ff700 1 -- start start 2023-07-14T15:56:56.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.776+0000 7fc6413ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fc63c1603b0 0x7fc63c15ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:56.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.776+0000 7fc6413ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc63c15dc50 con 0x7fc63c0d1140 2023-07-14T15:56:56.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.776+0000 7fc6413ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc63c0b2940 con 0x7fc63c15fee0 2023-07-14T15:56:56.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.776+0000 7fc6413ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc63c0b2c20 con 0x7fc63c1603b0 2023-07-14T15:56:56.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.776+0000 7fc63a7fc700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc63c0d1140 0x7fc63c0b39e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38064/0 (socket says 172.21.15.37:38064) 2023-07-14T15:56:56.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.776+0000 7fc63a7fc700 1 -- 172.21.15.37:0/3441212103 learned_addr learned my addr 172.21.15.37:0/3441212103 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:56.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.776+0000 7fc63b7fe700 1 --2- 172.21.15.37:0/3441212103 >> v2:172.21.15.98:3300/0 conn(0x7fc63c1603b0 0x7fc63c15ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:56.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.776+0000 7fc639ffb700 1 -- 172.21.15.37:0/3441212103 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4102997363 0 0) 0x7fc63c15dc50 con 0x7fc63c0d1140 2023-07-14T15:56:56.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.777+0000 7fc639ffb700 1 -- 172.21.15.37:0/3441212103 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6240035b0 con 0x7fc63c0d1140 2023-07-14T15:56:56.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.777+0000 7fc639ffb700 1 -- 172.21.15.37:0/3441212103 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2158406598 0 0) 0x7fc6240035b0 con 0x7fc63c0d1140 2023-07-14T15:56:56.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.777+0000 7fc639ffb700 1 -- 172.21.15.37:0/3441212103 >> v2:172.21.15.98:3300/0 conn(0x7fc63c1603b0 msgr2=0x7fc63c15ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:56.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.777+0000 7fc639ffb700 1 --2- 172.21.15.37:0/3441212103 >> v2:172.21.15.98:3300/0 conn(0x7fc63c1603b0 0x7fc63c15ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:56.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.777+0000 7fc639ffb700 1 -- 172.21.15.37:0/3441212103 >> v1:172.21.15.98:6789/0 conn(0x7fc63c15fee0 legacy=0x7fc63c0d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:56.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.777+0000 7fc639ffb700 1 -- 172.21.15.37:0/3441212103 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc63c0b2f00 con 0x7fc63c0d1140 2023-07-14T15:56:56.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.777+0000 7fc639ffb700 1 -- 172.21.15.37:0/3441212103 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48633207 0 0) 0x7fc630001670 con 0x7fc63c0d1140 2023-07-14T15:56:56.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.777+0000 7fc639ffb700 1 -- 172.21.15.37:0/3441212103 >> v1:172.21.15.37:6789/0 conn(0x7fc63c0d1140 legacy=0x7fc63c0b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:56.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.777+0000 7fc639ffb700 1 --2- 172.21.15.37:0/3441212103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc624003a00 0x7fc624003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:56.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.777+0000 7fc639ffb700 1 --2- 172.21.15.37:0/3441212103 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc624004850 0x7fc624004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:56.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.777+0000 7fc639ffb700 1 --2- 172.21.15.37:0/3441212103 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc624005200 0x7fc62400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:56.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.777+0000 7fc639ffb700 1 -- 172.21.15.37:0/3441212103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63c0b2c20 con 0x7fc624003a00 2023-07-14T15:56:56.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.777+0000 7fc639ffb700 1 -- 172.21.15.37:0/3441212103 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc62400c190 con 0x7fc624005200 2023-07-14T15:56:56.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.777+0000 7fc639ffb700 1 -- 172.21.15.37:0/3441212103 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc62400c350 con 0x7fc624004850 2023-07-14T15:56:56.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.777+0000 7fc63affd700 1 --2- 172.21.15.37:0/3441212103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc624003a00 0x7fc624003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:56.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.777+0000 7fc63a7fc700 1 --2- 172.21.15.37:0/3441212103 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc624004850 0x7fc624004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:56.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.778+0000 7fc63b7fe700 1 --2- 172.21.15.37:0/3441212103 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc624005200 0x7fc62400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:56.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.778+0000 7fc63affd700 1 -- 172.21.15.37:0/3441212103 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc624004850 msgr2=0x7fc624004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:56.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.778+0000 7fc63affd700 1 --2- 172.21.15.37:0/3441212103 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc624004850 0x7fc624004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:56.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.778+0000 7fc63affd700 1 -- 172.21.15.37:0/3441212103 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc624005200 msgr2=0x7fc62400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:56.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.778+0000 7fc63affd700 1 --2- 172.21.15.37:0/3441212103 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc624005200 0x7fc62400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:56.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.778+0000 7fc63affd700 1 -- 172.21.15.37:0/3441212103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6240035b0 con 0x7fc624003a00 2023-07-14T15:56:56.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.778+0000 7fc63b7fe700 1 --2- 172.21.15.37:0/3441212103 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc624005200 0x7fc62400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:56:56.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.778+0000 7fc63b7fe700 1 -- 172.21.15.37:0/3441212103 reap_dead start 2023-07-14T15:56:56.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.778+0000 7fc63affd700 1 --2- 172.21.15.37:0/3441212103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc624003a00 0x7fc624003dd0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc62c007fd0 tx=0x7fc624005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de613a4208ee5352 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:56.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.778+0000 7fc639ffb700 1 -- 172.21.15.37:0/3441212103 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62c0052d0 con 0x7fc624003a00 2023-07-14T15:56:56.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.778+0000 7fc639ffb700 1 -- 172.21.15.37:0/3441212103 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62c005430 con 0x7fc624003a00 2023-07-14T15:56:56.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.778+0000 7fc639ffb700 1 -- 172.21.15.37:0/3441212103 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62c0038c0 con 0x7fc624003a00 2023-07-14T15:56:56.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.779+0000 7fc6413ff700 1 -- 172.21.15.37:0/3441212103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc624003a00 msgr2=0x7fc624003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:56.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.779+0000 7fc6413ff700 1 --2- 172.21.15.37:0/3441212103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc624003a00 0x7fc624003dd0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc62c007fd0 tx=0x7fc624005880 comp rx=0 tx=0).stop 2023-07-14T15:56:56.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.779+0000 7fc6413ff700 1 -- 172.21.15.37:0/3441212103 shutdown_connections 2023-07-14T15:56:56.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.779+0000 7fc6413ff700 1 --2- 172.21.15.37:0/3441212103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc624003a00 0x7fc624003dd0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:56.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.779+0000 7fc6413ff700 1 -- 172.21.15.37:0/3441212103 >> 172.21.15.37:0/3441212103 conn(0x7fc63c09c1b0 msgr2=0x7fc63c0d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:56.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.779+0000 7fc6413ff700 1 -- 172.21.15.37:0/3441212103 shutdown_connections 2023-07-14T15:56:56.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.779+0000 7fc6413ff700 1 -- 172.21.15.37:0/3441212103 wait complete. 2023-07-14T15:56:56.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.781+0000 7fc6413ff700 1 Processor -- start 2023-07-14T15:56:56.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.781+0000 7fc6413ff700 1 -- start start 2023-07-14T15:56:56.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.782+0000 7fc6413ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc624003a00 0x7fc63c157820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:56.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.782+0000 7fc6413ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc63c0c70f0 0x7fc63c0c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:56.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.782+0000 7fc6413ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc63c0c7560 0x7fc63c0c9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:56.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.782+0000 7fc6413ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63c0b5c90 con 0x7fc63c0c70f0 2023-07-14T15:56:56.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.782+0000 7fc6413ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63c0b5f70 con 0x7fc63c0c7560 2023-07-14T15:56:56.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.782+0000 7fc6413ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc63c0b6250 con 0x7fc624003a00 2023-07-14T15:56:56.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.782+0000 7fc63a7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc63c0c70f0 0x7fc63c0c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:56.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.782+0000 7fc63a7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc63c0c70f0 0x7fc63c0c8cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43270/0 (socket says 172.21.15.37:43270) 2023-07-14T15:56:56.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.782+0000 7fc63a7fc700 1 -- 172.21.15.37:0/1016022970 learned_addr learned my addr 172.21.15.37:0/1016022970 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:56.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.782+0000 7fc63affd700 1 --2- 172.21.15.37:0/1016022970 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc624003a00 0x7fc63c157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:56.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.782+0000 7fc63b7fe700 1 --2- 172.21.15.37:0/1016022970 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc63c0c7560 0x7fc63c0c9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:56.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.783+0000 7fc63a7fc700 1 -- 172.21.15.37:0/1016022970 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc624003a00 msgr2=0x7fc63c157820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:56.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.783+0000 7fc63a7fc700 1 --2- 172.21.15.37:0/1016022970 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc624003a00 0x7fc63c157820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:56.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.783+0000 7fc63a7fc700 1 -- 172.21.15.37:0/1016022970 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc63c0c7560 msgr2=0x7fc63c0c9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:56.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.783+0000 7fc63a7fc700 1 --2- 172.21.15.37:0/1016022970 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc63c0c7560 0x7fc63c0c9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:56.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.783+0000 7fc63a7fc700 1 -- 172.21.15.37:0/1016022970 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc63c0b6530 con 0x7fc63c0c70f0 2023-07-14T15:56:56.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.783+0000 7fc63affd700 1 --2- 172.21.15.37:0/1016022970 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc624003a00 0x7fc63c157820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:56:56.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.783+0000 7fc63a7fc700 1 --2- 172.21.15.37:0/1016022970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc63c0c70f0 0x7fc63c0c8cc0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc630007060 tx=0x7fc630007420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:56.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.783+0000 7fc6237fe700 1 -- 172.21.15.37:0/1016022970 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc630011580 con 0x7fc63c0c70f0 2023-07-14T15:56:56.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.783+0000 7fc6237fe700 1 -- 172.21.15.37:0/1016022970 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc630011700 con 0x7fc63c0c70f0 2023-07-14T15:56:56.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.783+0000 7fc6237fe700 1 -- 172.21.15.37:0/1016022970 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc630011ab0 con 0x7fc63c0c70f0 2023-07-14T15:56:56.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.783+0000 7fc6413ff700 1 -- 172.21.15.37:0/1016022970 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc63c0b6810 con 0x7fc63c0c70f0 2023-07-14T15:56:56.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.783+0000 7fc6413ff700 1 -- 172.21.15.37:0/1016022970 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc63c0c6ca0 con 0x7fc63c0c70f0 2023-07-14T15:56:56.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.784+0000 7fc6413ff700 1 -- 172.21.15.37:0/1016022970 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc63c0b6d30 con 0x7fc63c0c70f0 2023-07-14T15:56:56.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.785+0000 7fc6237fe700 1 -- 172.21.15.37:0/1016022970 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc630011c10 con 0x7fc63c0c70f0 2023-07-14T15:56:56.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.786+0000 7fc6237fe700 1 --2- 172.21.15.37:0/1016022970 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc62806ace0 0x7fc62806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:56.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.786+0000 7fc6237fe700 1 -- 172.21.15.37:0/1016022970 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc630089410 con 0x7fc63c0c70f0 2023-07-14T15:56:56.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.787+0000 7fc63affd700 1 --2- 172.21.15.37:0/1016022970 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc62806ace0 0x7fc62806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:56.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.787+0000 7fc63affd700 1 --2- 172.21.15.37:0/1016022970 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc62806ace0 0x7fc62806d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc62c000c00 tx=0x7fc62c005000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:56.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.790+0000 7fc6237fe700 1 -- 172.21.15.37:0/1016022970 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc63c0b6d30 con 0x7fc63c0c70f0 2023-07-14T15:56:56.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:56.999+0000 7fc6413ff700 1 -- 172.21.15.37:0/1016022970 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc63c0b6d30 con 0x7fc63c0c70f0 2023-07-14T15:56:56.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.000+0000 7fc6237fe700 1 -- 172.21.15.37:0/1016022970 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc63c0b6d30 con 0x7fc63c0c70f0 2023-07-14T15:56:56.985 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-14T15:56:56.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.002+0000 7fc6413ff700 1 -- 172.21.15.37:0/1016022970 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc62806ace0 msgr2=0x7fc62806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:56.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.002+0000 7fc6413ff700 1 --2- 172.21.15.37:0/1016022970 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc62806ace0 0x7fc62806d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc62c000c00 tx=0x7fc62c005000 comp rx=0 tx=0).stop 2023-07-14T15:56:56.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.002+0000 7fc6413ff700 1 -- 172.21.15.37:0/1016022970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc63c0c70f0 msgr2=0x7fc63c0c8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:56.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.002+0000 7fc6413ff700 1 --2- 172.21.15.37:0/1016022970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc63c0c70f0 0x7fc63c0c8cc0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc630007060 tx=0x7fc630007420 comp rx=0 tx=0).stop 2023-07-14T15:56:56.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.002+0000 7fc6413ff700 1 -- 172.21.15.37:0/1016022970 shutdown_connections 2023-07-14T15:56:56.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.002+0000 7fc6413ff700 1 --2- 172.21.15.37:0/1016022970 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc63c0c7560 0x7fc63c0c9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:56.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.002+0000 7fc6413ff700 1 --2- 172.21.15.37:0/1016022970 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc62806ace0 0x7fc62806d190 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:56.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.002+0000 7fc6413ff700 1 --2- 172.21.15.37:0/1016022970 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc624003a00 0x7fc63c157820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:56.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.002+0000 7fc6413ff700 1 --2- 172.21.15.37:0/1016022970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc63c0c70f0 0x7fc63c0c8cc0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:56.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.002+0000 7fc6413ff700 1 -- 172.21.15.37:0/1016022970 >> 172.21.15.37:0/1016022970 conn(0x7fc63c09c1b0 msgr2=0x7fc63c158670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:56.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.003+0000 7fc6413ff700 1 -- 172.21.15.37:0/1016022970 shutdown_connections 2023-07-14T15:56:56.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.003+0000 7fc6413ff700 1 -- 172.21.15.37:0/1016022970 wait complete. 2023-07-14T15:56:57.006 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T15:56:57.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.227+0000 7eff8e9ff700 1 Processor -- start 2023-07-14T15:56:57.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.227+0000 7eff8e9ff700 1 -- start start 2023-07-14T15:56:57.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.228+0000 7eff8e9ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7eff8806f740 0x7eff880ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:57.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.229+0000 7eff8e9ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff88159870 con 0x7eff88071730 2023-07-14T15:56:57.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.229+0000 7eff8e9ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff880ca790 con 0x7eff8806c0d0 2023-07-14T15:56:57.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.229+0000 7eff8e9ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff8806fb60 con 0x7eff8806f740 2023-07-14T15:56:57.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.229+0000 7eff87fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7eff88071730 0x7eff8806b9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38066/0 (socket says 172.21.15.37:38066) 2023-07-14T15:56:57.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.229+0000 7eff87fff700 1 -- 172.21.15.37:0/3000161439 learned_addr learned my addr 172.21.15.37:0/3000161439 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:57.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.229+0000 7eff8cf9c700 1 --2- 172.21.15.37:0/3000161439 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7eff8806f740 0x7eff880ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:57.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.229+0000 7eff86ffd700 1 -- 172.21.15.37:0/3000161439 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3227512654 0 0) 0x7eff88159870 con 0x7eff88071730 2023-07-14T15:56:57.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.229+0000 7eff86ffd700 1 -- 172.21.15.37:0/3000161439 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff700035b0 con 0x7eff88071730 2023-07-14T15:56:57.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.229+0000 7eff86ffd700 1 -- 172.21.15.37:0/3000161439 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2454078946 0 0) 0x7eff700035b0 con 0x7eff88071730 2023-07-14T15:56:57.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.229+0000 7eff86ffd700 1 -- 172.21.15.37:0/3000161439 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7eff8806f740 msgr2=0x7eff880ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:57.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.229+0000 7eff86ffd700 1 --2- 172.21.15.37:0/3000161439 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7eff8806f740 0x7eff880ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:57.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.229+0000 7eff86ffd700 1 -- 172.21.15.37:0/3000161439 >> v1:172.21.15.98:6789/0 conn(0x7eff8806c0d0 legacy=0x7eff880cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:57.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.230+0000 7eff86ffd700 1 -- 172.21.15.37:0/3000161439 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff880cc780 con 0x7eff88071730 2023-07-14T15:56:57.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.230+0000 7eff86ffd700 1 -- 172.21.15.37:0/3000161439 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48633207 0 0) 0x7eff78001670 con 0x7eff88071730 2023-07-14T15:56:57.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.230+0000 7eff86ffd700 1 -- 172.21.15.37:0/3000161439 >> v1:172.21.15.37:6789/0 conn(0x7eff88071730 legacy=0x7eff8806b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:57.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.230+0000 7eff86ffd700 1 --2- 172.21.15.37:0/3000161439 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7eff8806f740 0x7eff70003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:57.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.230+0000 7eff86ffd700 1 --2- 172.21.15.37:0/3000161439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff70003f70 0x7eff70004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:57.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.230+0000 7eff86ffd700 1 --2- 172.21.15.37:0/3000161439 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff70004d90 0x7eff70005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:57.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.230+0000 7eff86ffd700 1 -- 172.21.15.37:0/3000161439 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8806fb60 con 0x7eff70003f70 2023-07-14T15:56:57.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.230+0000 7eff86ffd700 1 -- 172.21.15.37:0/3000161439 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff7000baf0 con 0x7eff70004d90 2023-07-14T15:56:57.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.230+0000 7eff86ffd700 1 -- 172.21.15.37:0/3000161439 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff7000bcb0 con 0x7eff8806f740 2023-07-14T15:56:57.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.230+0000 7eff877fe700 1 --2- 172.21.15.37:0/3000161439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff70003f70 0x7eff70004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:57.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.230+0000 7eff877fe700 1 -- 172.21.15.37:0/3000161439 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7eff8806f740 msgr2=0x7eff70003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:57.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.230+0000 7eff877fe700 1 --2- 172.21.15.37:0/3000161439 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7eff8806f740 0x7eff70003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:57.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.230+0000 7eff877fe700 1 -- 172.21.15.37:0/3000161439 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff70004d90 msgr2=0x7eff70005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:57.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.230+0000 7eff877fe700 1 --2- 172.21.15.37:0/3000161439 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff70004d90 0x7eff70005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:57.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.230+0000 7eff877fe700 1 -- 172.21.15.37:0/3000161439 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff700035b0 con 0x7eff70003f70 2023-07-14T15:56:57.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.231+0000 7eff877fe700 1 --2- 172.21.15.37:0/3000161439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff70003f70 0x7eff70004850 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7eff7c007fd0 tx=0x7eff70005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e97c6c94298ae06a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:57.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.231+0000 7eff86ffd700 1 -- 172.21.15.37:0/3000161439 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7c012620 con 0x7eff70003f70 2023-07-14T15:56:57.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.231+0000 7eff86ffd700 1 -- 172.21.15.37:0/3000161439 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff7c012780 con 0x7eff70003f70 2023-07-14T15:56:57.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.231+0000 7eff86ffd700 1 -- 172.21.15.37:0/3000161439 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7c012b30 con 0x7eff70003f70 2023-07-14T15:56:57.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.231+0000 7eff8e9ff700 1 -- 172.21.15.37:0/3000161439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff70003f70 msgr2=0x7eff70004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:57.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.231+0000 7eff8e9ff700 1 --2- 172.21.15.37:0/3000161439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff70003f70 0x7eff70004850 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7eff7c007fd0 tx=0x7eff70005880 comp rx=0 tx=0).stop 2023-07-14T15:56:57.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.231+0000 7eff8cf9c700 1 -- 172.21.15.37:0/3000161439 reap_dead start 2023-07-14T15:56:57.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.231+0000 7eff8e9ff700 1 -- 172.21.15.37:0/3000161439 shutdown_connections 2023-07-14T15:56:57.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.231+0000 7eff8e9ff700 1 -- 172.21.15.37:0/3000161439 >> 172.21.15.37:0/3000161439 conn(0x7eff8806aac0 msgr2=0x7eff880b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:57.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.231+0000 7eff8e9ff700 1 -- 172.21.15.37:0/3000161439 shutdown_connections 2023-07-14T15:56:57.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.231+0000 7eff8e9ff700 1 -- 172.21.15.37:0/3000161439 wait complete. 2023-07-14T15:56:57.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.233+0000 7eff8e9ff700 1 Processor -- start 2023-07-14T15:56:57.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.233+0000 7eff8e9ff700 1 -- start start 2023-07-14T15:56:57.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.234+0000 7eff8e9ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff70003f70 0x7eff88157aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:57.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.234+0000 7eff8e9ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7eff880afca0 0x7eff881573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:57.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.234+0000 7eff8e9ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff8815b3a0 0x7eff8815b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:57.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.234+0000 7eff8e9ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff881578e0 con 0x7eff8815b3a0 2023-07-14T15:56:57.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.234+0000 7eff8e9ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8815bd80 con 0x7eff70003f70 2023-07-14T15:56:57.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.234+0000 7eff8e9ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff880b0210 con 0x7eff880afca0 2023-07-14T15:56:57.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.234+0000 7eff8cf9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff8815b3a0 0x7eff8815b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:57.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.235+0000 7eff8cf9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff8815b3a0 0x7eff8815b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43284/0 (socket says 172.21.15.37:43284) 2023-07-14T15:56:57.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.235+0000 7eff8cf9c700 1 -- 172.21.15.37:0/262578084 learned_addr learned my addr 172.21.15.37:0/262578084 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:57.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.235+0000 7eff87fff700 1 --2- 172.21.15.37:0/262578084 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff70003f70 0x7eff88157aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:57.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.235+0000 7eff877fe700 1 --2- 172.21.15.37:0/262578084 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7eff880afca0 0x7eff881573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:57.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.235+0000 7eff8cf9c700 1 -- 172.21.15.37:0/262578084 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7eff880afca0 msgr2=0x7eff881573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:57.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.235+0000 7eff8cf9c700 1 --2- 172.21.15.37:0/262578084 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7eff880afca0 0x7eff881573a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:57.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.235+0000 7eff8cf9c700 1 -- 172.21.15.37:0/262578084 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff70003f70 msgr2=0x7eff88157aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:57.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.235+0000 7eff8cf9c700 1 --2- 172.21.15.37:0/262578084 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff70003f70 0x7eff88157aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:57.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.235+0000 7eff8cf9c700 1 -- 172.21.15.37:0/262578084 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff880b04f0 con 0x7eff8815b3a0 2023-07-14T15:56:57.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.235+0000 7eff8cf9c700 1 --2- 172.21.15.37:0/262578084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff8815b3a0 0x7eff8815b840 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7eff8806dc50 tx=0x7eff8000d390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:57.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.235+0000 7eff84ff9700 1 -- 172.21.15.37:0/262578084 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8000b310 con 0x7eff8815b3a0 2023-07-14T15:56:57.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.235+0000 7eff84ff9700 1 -- 172.21.15.37:0/262578084 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff80003a20 con 0x7eff8815b3a0 2023-07-14T15:56:57.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.235+0000 7eff8e9ff700 1 -- 172.21.15.37:0/262578084 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff880b07d0 con 0x7eff8815b3a0 2023-07-14T15:56:57.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.235+0000 7eff84ff9700 1 -- 172.21.15.37:0/262578084 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff80003d90 con 0x7eff8815b3a0 2023-07-14T15:56:57.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.236+0000 7eff8e9ff700 1 -- 172.21.15.37:0/262578084 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff880add70 con 0x7eff8815b3a0 2023-07-14T15:56:57.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.237+0000 7eff8e9ff700 1 -- 172.21.15.37:0/262578084 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff880cb300 con 0x7eff8815b3a0 2023-07-14T15:56:57.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.237+0000 7eff84ff9700 1 -- 172.21.15.37:0/262578084 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7eff80009050 con 0x7eff8815b3a0 2023-07-14T15:56:57.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.238+0000 7eff84ff9700 1 --2- 172.21.15.37:0/262578084 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7eff7406ace0 0x7eff7406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:57.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.238+0000 7eff84ff9700 1 -- 172.21.15.37:0/262578084 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7eff80088aa0 con 0x7eff8815b3a0 2023-07-14T15:56:57.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.239+0000 7eff87fff700 1 --2- 172.21.15.37:0/262578084 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7eff7406ace0 0x7eff7406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:57.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.239+0000 7eff87fff700 1 --2- 172.21.15.37:0/262578084 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7eff7406ace0 0x7eff7406d190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7eff78001600 tx=0x7eff78001570 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:57.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.243+0000 7eff84ff9700 1 -- 172.21.15.37:0/262578084 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7eff80053b40 con 0x7eff8815b3a0 2023-07-14T15:56:57.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.450+0000 7eff8e9ff700 1 -- 172.21.15.37:0/262578084 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7eff88067840 con 0x7eff8815b3a0 2023-07-14T15:56:57.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.451+0000 7eff84ff9700 1 -- 172.21.15.37:0/262578084 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7eff80057160 con 0x7eff8815b3a0 2023-07-14T15:56:57.437 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-14T15:56:57.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.453+0000 7eff8e9ff700 1 -- 172.21.15.37:0/262578084 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7eff7406ace0 msgr2=0x7eff7406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:57.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.453+0000 7eff8e9ff700 1 --2- 172.21.15.37:0/262578084 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7eff7406ace0 0x7eff7406d190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7eff78001600 tx=0x7eff78001570 comp rx=0 tx=0).stop 2023-07-14T15:56:57.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.453+0000 7eff8e9ff700 1 -- 172.21.15.37:0/262578084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff8815b3a0 msgr2=0x7eff8815b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:57.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.453+0000 7eff8e9ff700 1 --2- 172.21.15.37:0/262578084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff8815b3a0 0x7eff8815b840 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7eff8806dc50 tx=0x7eff8000d390 comp rx=0 tx=0).stop 2023-07-14T15:56:57.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.453+0000 7eff8e9ff700 1 -- 172.21.15.37:0/262578084 shutdown_connections 2023-07-14T15:56:57.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.453+0000 7eff8e9ff700 1 --2- 172.21.15.37:0/262578084 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff70003f70 0x7eff88157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:57.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.453+0000 7eff8e9ff700 1 --2- 172.21.15.37:0/262578084 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7eff7406ace0 0x7eff7406d190 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:57.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.453+0000 7eff8e9ff700 1 --2- 172.21.15.37:0/262578084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff8815b3a0 0x7eff8815b840 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:57.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.453+0000 7eff8e9ff700 1 --2- 172.21.15.37:0/262578084 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7eff880afca0 0x7eff881573a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:57.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.453+0000 7eff8e9ff700 1 -- 172.21.15.37:0/262578084 >> 172.21.15.37:0/262578084 conn(0x7eff8806aac0 msgr2=0x7eff880c5180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:57.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.454+0000 7eff8e9ff700 1 -- 172.21.15.37:0/262578084 shutdown_connections 2023-07-14T15:56:57.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.454+0000 7eff8e9ff700 1 -- 172.21.15.37:0/262578084 wait complete. 2023-07-14T15:56:57.458 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T15:56:57.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.677+0000 7f7f135ff700 1 Processor -- start 2023-07-14T15:56:57.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.678+0000 7f7f135ff700 1 -- start start 2023-07-14T15:56:57.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.679+0000 7f7f135ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7f0c1603b0 0x7f7f0c15ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:57.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.679+0000 7f7f135ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f0c15dc50 con 0x7f7f0c0d1140 2023-07-14T15:56:57.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.679+0000 7f7f135ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f0c0b2940 con 0x7f7f0c15fee0 2023-07-14T15:56:57.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.679+0000 7f7f135ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c0b2c20 con 0x7f7f0c1603b0 2023-07-14T15:56:57.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.679+0000 7f7f10b9a700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7f0c0d1140 0x7f7f0c0b39e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38068/0 (socket says 172.21.15.37:38068) 2023-07-14T15:56:57.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.679+0000 7f7f10b9a700 1 -- 172.21.15.37:0/3905940770 learned_addr learned my addr 172.21.15.37:0/3905940770 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:57.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.679+0000 7f7f11b9c700 1 --2- 172.21.15.37:0/3905940770 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7f0c1603b0 0x7f7f0c15ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:57.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.679+0000 7f7f03fff700 1 -- 172.21.15.37:0/3905940770 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1010328836 0 0) 0x7f7f0c15dc50 con 0x7f7f0c0d1140 2023-07-14T15:56:57.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.680+0000 7f7f03fff700 1 -- 172.21.15.37:0/3905940770 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ef80035b0 con 0x7f7f0c0d1140 2023-07-14T15:56:57.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.680+0000 7f7f03fff700 1 -- 172.21.15.37:0/3905940770 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2716388537 0 0) 0x7f7ef80035b0 con 0x7f7f0c0d1140 2023-07-14T15:56:57.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.680+0000 7f7f03fff700 1 -- 172.21.15.37:0/3905940770 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7f0c1603b0 msgr2=0x7f7f0c15ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:57.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.680+0000 7f7f03fff700 1 --2- 172.21.15.37:0/3905940770 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7f0c1603b0 0x7f7f0c15ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:57.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.680+0000 7f7f03fff700 1 -- 172.21.15.37:0/3905940770 >> v1:172.21.15.98:6789/0 conn(0x7f7f0c15fee0 legacy=0x7f7f0c0d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:57.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.680+0000 7f7f03fff700 1 -- 172.21.15.37:0/3905940770 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f0c0b2f00 con 0x7f7f0c0d1140 2023-07-14T15:56:57.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.680+0000 7f7f03fff700 1 -- 172.21.15.37:0/3905940770 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48633207 0 0) 0x7f7efc001670 con 0x7f7f0c0d1140 2023-07-14T15:56:57.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.680+0000 7f7f03fff700 1 -- 172.21.15.37:0/3905940770 >> v1:172.21.15.37:6789/0 conn(0x7f7f0c0d1140 legacy=0x7f7f0c0b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:57.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.680+0000 7f7f03fff700 1 --2- 172.21.15.37:0/3905940770 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7f0c1603b0 0x7f7ef8003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:57.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.680+0000 7f7f03fff700 1 --2- 172.21.15.37:0/3905940770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ef8003f70 0x7f7ef8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:57.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.680+0000 7f7f03fff700 1 --2- 172.21.15.37:0/3905940770 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ef8004d90 0x7f7ef8005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:57.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.680+0000 7f7f03fff700 1 -- 172.21.15.37:0/3905940770 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c0b2c20 con 0x7f7ef8003f70 2023-07-14T15:56:57.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.680+0000 7f7f03fff700 1 -- 172.21.15.37:0/3905940770 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef800bba0 con 0x7f7ef8004d90 2023-07-14T15:56:57.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.680+0000 7f7f03fff700 1 -- 172.21.15.37:0/3905940770 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef800bd60 con 0x7f7f0c1603b0 2023-07-14T15:56:57.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.680+0000 7f7f10b9a700 1 --2- 172.21.15.37:0/3905940770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ef8003f70 0x7f7ef8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:57.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.680+0000 7f7f1139b700 1 --2- 172.21.15.37:0/3905940770 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7f0c1603b0 0x7f7ef8003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:57.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.681+0000 7f7f11b9c700 1 --2- 172.21.15.37:0/3905940770 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ef8004d90 0x7f7ef8005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:57.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.681+0000 7f7f1139b700 1 -- 172.21.15.37:0/3905940770 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ef8004d90 msgr2=0x7f7ef8005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:57.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.681+0000 7f7f1139b700 1 --2- 172.21.15.37:0/3905940770 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ef8004d90 0x7f7ef8005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:57.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.681+0000 7f7f1139b700 1 -- 172.21.15.37:0/3905940770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ef8003f70 msgr2=0x7f7ef8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:57.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.681+0000 7f7f1139b700 1 --2- 172.21.15.37:0/3905940770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ef8003f70 0x7f7ef8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:57.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.681+0000 7f7f1139b700 1 -- 172.21.15.37:0/3905940770 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef80035b0 con 0x7f7f0c1603b0 2023-07-14T15:56:57.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.681+0000 7f7f10b9a700 1 --2- 172.21.15.37:0/3905940770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ef8003f70 0x7f7ef8004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:56:57.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.681+0000 7f7f1139b700 1 --2- 172.21.15.37:0/3905940770 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7f0c1603b0 0x7f7ef8003a30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7f08001980 tx=0x7f7ef8005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81eed326c5180d73 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:57.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.681+0000 7f7f03fff700 1 -- 172.21.15.37:0/3905940770 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f08016070 con 0x7f7f0c1603b0 2023-07-14T15:56:57.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.681+0000 7f7f03fff700 1 -- 172.21.15.37:0/3905940770 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f08006860 con 0x7f7f0c1603b0 2023-07-14T15:56:57.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.681+0000 7f7f03fff700 1 -- 172.21.15.37:0/3905940770 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f08001420 con 0x7f7f0c1603b0 2023-07-14T15:56:57.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.682+0000 7f7f135ff700 1 -- 172.21.15.37:0/3905940770 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7f0c1603b0 msgr2=0x7f7ef8003a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:57.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.682+0000 7f7f135ff700 1 --2- 172.21.15.37:0/3905940770 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7f0c1603b0 0x7f7ef8003a30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7f08001980 tx=0x7f7ef8005880 comp rx=0 tx=0).stop 2023-07-14T15:56:57.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.682+0000 7f7f11b9c700 1 -- 172.21.15.37:0/3905940770 reap_dead start 2023-07-14T15:56:57.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.682+0000 7f7f135ff700 1 -- 172.21.15.37:0/3905940770 shutdown_connections 2023-07-14T15:56:57.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.682+0000 7f7f135ff700 1 -- 172.21.15.37:0/3905940770 >> 172.21.15.37:0/3905940770 conn(0x7f7f0c09c1b0 msgr2=0x7f7f0c0d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:57.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.682+0000 7f7f135ff700 1 -- 172.21.15.37:0/3905940770 shutdown_connections 2023-07-14T15:56:57.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.682+0000 7f7f135ff700 1 -- 172.21.15.37:0/3905940770 wait complete. 2023-07-14T15:56:57.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.684+0000 7f7f135ff700 1 Processor -- start 2023-07-14T15:56:57.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.684+0000 7f7f135ff700 1 -- start start 2023-07-14T15:56:57.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.685+0000 7f7f135ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f0c1603b0 0x7f7f0c15a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:57.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.685+0000 7f7f135ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7f0c0c64f0 0x7f7f0c0c6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:57.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.685+0000 7f7f135ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f0c157ae0 0x7f7f0c157f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:57.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.685+0000 7f7f135ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c0b60f0 con 0x7f7f0c157ae0 2023-07-14T15:56:57.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.685+0000 7f7f135ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c0c7620 con 0x7f7f0c1603b0 2023-07-14T15:56:57.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.685+0000 7f7f135ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c0b5dc0 con 0x7f7f0c0c64f0 2023-07-14T15:56:57.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.685+0000 7f7f11b9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f0c157ae0 0x7f7f0c157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:57.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.685+0000 7f7f11b9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f0c157ae0 0x7f7f0c157f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43308/0 (socket says 172.21.15.37:43308) 2023-07-14T15:56:57.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.685+0000 7f7f11b9c700 1 -- 172.21.15.37:0/3128742463 learned_addr learned my addr 172.21.15.37:0/3128742463 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:57.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.685+0000 7f7f1139b700 1 --2- 172.21.15.37:0/3128742463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f0c1603b0 0x7f7f0c15a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:57.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.685+0000 7f7f10b9a700 1 --2- 172.21.15.37:0/3128742463 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7f0c0c64f0 0x7f7f0c0c6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:57.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.686+0000 7f7f11b9c700 1 -- 172.21.15.37:0/3128742463 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7f0c0c64f0 msgr2=0x7f7f0c0c6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:57.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.686+0000 7f7f11b9c700 1 --2- 172.21.15.37:0/3128742463 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7f0c0c64f0 0x7f7f0c0c6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:57.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.686+0000 7f7f11b9c700 1 -- 172.21.15.37:0/3128742463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f0c1603b0 msgr2=0x7f7f0c15a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:57.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.686+0000 7f7f11b9c700 1 --2- 172.21.15.37:0/3128742463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f0c1603b0 0x7f7f0c15a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:57.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.686+0000 7f7f11b9c700 1 -- 172.21.15.37:0/3128742463 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f0c0c7060 con 0x7f7f0c157ae0 2023-07-14T15:56:57.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.686+0000 7f7f11b9c700 1 --2- 172.21.15.37:0/3128742463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f0c157ae0 0x7f7f0c157f80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c08bd60 tx=0x7f7f04011f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:57.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.686+0000 7f7f01ffb700 1 -- 172.21.15.37:0/3128742463 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0400e040 con 0x7f7f0c157ae0 2023-07-14T15:56:57.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.686+0000 7f7f01ffb700 1 -- 172.21.15.37:0/3128742463 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0400f040 con 0x7f7f0c157ae0 2023-07-14T15:56:57.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.686+0000 7f7f135ff700 1 -- 172.21.15.37:0/3128742463 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f0c0c7340 con 0x7f7f0c157ae0 2023-07-14T15:56:57.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.686+0000 7f7f01ffb700 1 -- 172.21.15.37:0/3128742463 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0400f940 con 0x7f7f0c157ae0 2023-07-14T15:56:57.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.686+0000 7f7f135ff700 1 -- 172.21.15.37:0/3128742463 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f0c1589c0 con 0x7f7f0c157ae0 2023-07-14T15:56:57.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.688+0000 7f7f135ff700 1 -- 172.21.15.37:0/3128742463 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f0c0b62a0 con 0x7f7f0c157ae0 2023-07-14T15:56:57.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.689+0000 7f7f01ffb700 1 -- 172.21.15.37:0/3128742463 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7f0400faa0 con 0x7f7f0c157ae0 2023-07-14T15:56:57.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.689+0000 7f7f01ffb700 1 --2- 172.21.15.37:0/3128742463 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f7ef006ace0 0x7f7ef006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:57.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.689+0000 7f7f01ffb700 1 -- 172.21.15.37:0/3128742463 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7f04089880 con 0x7f7f0c157ae0 2023-07-14T15:56:57.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.690+0000 7f7f1139b700 1 --2- 172.21.15.37:0/3128742463 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f7ef006ace0 0x7f7ef006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:57.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.690+0000 7f7f1139b700 1 --2- 172.21.15.37:0/3128742463 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f7ef006ace0 0x7f7ef006d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7f08000fd0 tx=0x7f7f08009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:57.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.694+0000 7f7f01ffb700 1 -- 172.21.15.37:0/3128742463 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7f0c0b62a0 con 0x7f7f0c157ae0 2023-07-14T15:56:57.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.903+0000 7f7f135ff700 1 -- 172.21.15.37:0/3128742463 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7f0c067840 con 0x7f7f0c157ae0 2023-07-14T15:56:57.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.904+0000 7f7f01ffb700 1 -- 172.21.15.37:0/3128742463 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7f04054920 con 0x7f7f0c157ae0 2023-07-14T15:56:57.889 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-14T15:56:57.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.906+0000 7f7f135ff700 1 -- 172.21.15.37:0/3128742463 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f7ef006ace0 msgr2=0x7f7ef006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:57.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.906+0000 7f7f135ff700 1 --2- 172.21.15.37:0/3128742463 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f7ef006ace0 0x7f7ef006d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7f08000fd0 tx=0x7f7f08009030 comp rx=0 tx=0).stop 2023-07-14T15:56:57.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.906+0000 7f7f135ff700 1 -- 172.21.15.37:0/3128742463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f0c157ae0 msgr2=0x7f7f0c157f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:57.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.906+0000 7f7f135ff700 1 --2- 172.21.15.37:0/3128742463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f0c157ae0 0x7f7f0c157f80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c08bd60 tx=0x7f7f04011f40 comp rx=0 tx=0).stop 2023-07-14T15:56:57.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.906+0000 7f7f135ff700 1 -- 172.21.15.37:0/3128742463 shutdown_connections 2023-07-14T15:56:57.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.906+0000 7f7f135ff700 1 --2- 172.21.15.37:0/3128742463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f0c1603b0 0x7f7f0c15a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:57.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.906+0000 7f7f135ff700 1 --2- 172.21.15.37:0/3128742463 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f7ef006ace0 0x7f7ef006d190 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:57.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.906+0000 7f7f135ff700 1 --2- 172.21.15.37:0/3128742463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f0c157ae0 0x7f7f0c157f80 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:57.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.906+0000 7f7f135ff700 1 --2- 172.21.15.37:0/3128742463 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7f0c0c64f0 0x7f7f0c0c6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:57.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.906+0000 7f7f135ff700 1 -- 172.21.15.37:0/3128742463 >> 172.21.15.37:0/3128742463 conn(0x7f7f0c09c1b0 msgr2=0x7f7f0c0d2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:57.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.906+0000 7f7f135ff700 1 -- 172.21.15.37:0/3128742463 shutdown_connections 2023-07-14T15:56:57.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:57.906+0000 7f7f135ff700 1 -- 172.21.15.37:0/3128742463 wait complete. 2023-07-14T15:56:57.910 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-14T15:56:58.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.128+0000 7f33aebff700 1 Processor -- start 2023-07-14T15:56:58.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.128+0000 7f33aebff700 1 -- start start 2023-07-14T15:56:58.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.129+0000 7f33aebff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f33a80b0ae0 0x7f33a80cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:58.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.129+0000 7f33aebff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33a80cdb50 con 0x7f33a80b8900 2023-07-14T15:56:58.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.129+0000 7f33aebff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33a80cde30 con 0x7f33a80d15c0 2023-07-14T15:56:58.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.129+0000 7f33aebff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a815d030 con 0x7f33a80b0ae0 2023-07-14T15:56:58.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.129+0000 7f33ac99b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f33a80b8900 0x7f33a80d0eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38072/0 (socket says 172.21.15.37:38072) 2023-07-14T15:56:58.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.129+0000 7f33ac99b700 1 -- 172.21.15.37:0/101287132 learned_addr learned my addr 172.21.15.37:0/101287132 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:58.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.129+0000 7f33ad19c700 1 --2- 172.21.15.37:0/101287132 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f33a80b0ae0 0x7f33a80cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:58.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.130+0000 7f33a77fe700 1 -- 172.21.15.37:0/101287132 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3405918292 0 0) 0x7f33a80cdb50 con 0x7f33a80b8900 2023-07-14T15:56:58.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.130+0000 7f33a77fe700 1 -- 172.21.15.37:0/101287132 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33980035b0 con 0x7f33a80b8900 2023-07-14T15:56:58.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.130+0000 7f33a77fe700 1 -- 172.21.15.37:0/101287132 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1626181449 0 0) 0x7f33a80cde30 con 0x7f33a80d15c0 2023-07-14T15:56:58.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.130+0000 7f33a77fe700 1 -- 172.21.15.37:0/101287132 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33a80cdb50 con 0x7f33a80d15c0 2023-07-14T15:56:58.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.130+0000 7f33ad19c700 1 -- 172.21.15.37:0/101287132 >> v1:172.21.15.98:6789/0 conn(0x7f33a80d15c0 legacy=0x7f33a80cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:58.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.130+0000 7f33ad19c700 1 -- 172.21.15.37:0/101287132 >> v1:172.21.15.37:6789/0 conn(0x7f33a80b8900 legacy=0x7f33a80d0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:58.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.130+0000 7f33ad19c700 1 -- 172.21.15.37:0/101287132 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a80ce110 con 0x7f33a80b0ae0 2023-07-14T15:56:58.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.130+0000 7f33ad19c700 1 --2- 172.21.15.37:0/101287132 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f33a80b0ae0 0x7f33a80cd570 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f33a0009dc0 tx=0x7f33a000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6bfb66e8dc56b15c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:58.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.131+0000 7f33a77fe700 1 -- 172.21.15.37:0/101287132 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a000e070 con 0x7f33a80b0ae0 2023-07-14T15:56:58.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.131+0000 7f33a77fe700 1 -- 172.21.15.37:0/101287132 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a000bb20 con 0x7f33a80b0ae0 2023-07-14T15:56:58.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.131+0000 7f33a77fe700 1 -- 172.21.15.37:0/101287132 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a0012430 con 0x7f33a80b0ae0 2023-07-14T15:56:58.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.131+0000 7f33aebff700 1 -- 172.21.15.37:0/101287132 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f33a80b0ae0 msgr2=0x7f33a80cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:58.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.131+0000 7f33aebff700 1 --2- 172.21.15.37:0/101287132 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f33a80b0ae0 0x7f33a80cd570 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f33a0009dc0 tx=0x7f33a000b330 comp rx=0 tx=0).stop 2023-07-14T15:56:58.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.131+0000 7f33aebff700 1 -- 172.21.15.37:0/101287132 shutdown_connections 2023-07-14T15:56:58.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.131+0000 7f33aebff700 1 --2- 172.21.15.37:0/101287132 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f33a80b0ae0 0x7f33a80cd570 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:58.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.131+0000 7f33aebff700 1 -- 172.21.15.37:0/101287132 >> 172.21.15.37:0/101287132 conn(0x7f33a809c1e0 msgr2=0x7f33a80d2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:58.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.131+0000 7f33aebff700 1 -- 172.21.15.37:0/101287132 shutdown_connections 2023-07-14T15:56:58.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.131+0000 7f33aebff700 1 -- 172.21.15.37:0/101287132 wait complete. 2023-07-14T15:56:58.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.133+0000 7f33aebff700 1 Processor -- start 2023-07-14T15:56:58.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.133+0000 7f33aebff700 1 -- start start 2023-07-14T15:56:58.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.134+0000 7f33aebff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33a80b0ae0 0x7f33a80cac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:58.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.134+0000 7f33aebff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f33a80b8900 0x7f33a815d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:58.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.134+0000 7f33aebff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33a80d15c0 0x7f33a80b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:58.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.134+0000 7f33aebff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a815e640 con 0x7f33a80d15c0 2023-07-14T15:56:58.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.134+0000 7f33aebff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a815d9c0 con 0x7f33a80b0ae0 2023-07-14T15:56:58.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.134+0000 7f33aebff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a815dca0 con 0x7f33a80b8900 2023-07-14T15:56:58.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.135+0000 7f33ad19c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33a80d15c0 0x7f33a80b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:58.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.135+0000 7f33ad19c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33a80d15c0 0x7f33a80b3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43322/0 (socket says 172.21.15.37:43322) 2023-07-14T15:56:58.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.135+0000 7f33ad19c700 1 -- 172.21.15.37:0/399865047 learned_addr learned my addr 172.21.15.37:0/399865047 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:58.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.135+0000 7f33ac99b700 1 --2- 172.21.15.37:0/399865047 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33a80b0ae0 0x7f33a80cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:58.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.135+0000 7f33a7fff700 1 --2- 172.21.15.37:0/399865047 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f33a80b8900 0x7f33a815d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:58.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.135+0000 7f33ad19c700 1 -- 172.21.15.37:0/399865047 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f33a80b8900 msgr2=0x7f33a815d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:58.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.135+0000 7f33ad19c700 1 --2- 172.21.15.37:0/399865047 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f33a80b8900 0x7f33a815d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:58.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.135+0000 7f33ad19c700 1 -- 172.21.15.37:0/399865047 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33a80b0ae0 msgr2=0x7f33a80cac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:58.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.135+0000 7f33ad19c700 1 --2- 172.21.15.37:0/399865047 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33a80b0ae0 0x7f33a80cac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:58.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.135+0000 7f33ad19c700 1 -- 172.21.15.37:0/399865047 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a0009a70 con 0x7f33a80d15c0 2023-07-14T15:56:58.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.135+0000 7f33ac99b700 1 --2- 172.21.15.37:0/399865047 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33a80b0ae0 0x7f33a80cac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:56:58.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.135+0000 7f33a7fff700 1 --2- 172.21.15.37:0/399865047 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f33a80b8900 0x7f33a815d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:56:58.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.135+0000 7f33ad19c700 1 --2- 172.21.15.37:0/399865047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33a80d15c0 0x7f33a80b3e10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f33a000b370 tx=0x7f33a0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:58.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.136+0000 7f33a57fa700 1 -- 172.21.15.37:0/399865047 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a001b810 con 0x7f33a80d15c0 2023-07-14T15:56:58.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.136+0000 7f33a57fa700 1 -- 172.21.15.37:0/399865047 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a0020070 con 0x7f33a80d15c0 2023-07-14T15:56:58.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.136+0000 7f33aebff700 1 -- 172.21.15.37:0/399865047 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33a815df80 con 0x7f33a80d15c0 2023-07-14T15:56:58.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.136+0000 7f33a57fa700 1 -- 172.21.15.37:0/399865047 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a001bbf0 con 0x7f33a80d15c0 2023-07-14T15:56:58.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.136+0000 7f33aebff700 1 -- 172.21.15.37:0/399865047 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33a815d6b0 con 0x7f33a80d15c0 2023-07-14T15:56:58.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.137+0000 7f33aebff700 1 -- 172.21.15.37:0/399865047 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33a804e210 con 0x7f33a80d15c0 2023-07-14T15:56:58.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.138+0000 7f33a57fa700 1 -- 172.21.15.37:0/399865047 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f33a001bd50 con 0x7f33a80d15c0 2023-07-14T15:56:58.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.139+0000 7f33a57fa700 1 --2- 172.21.15.37:0/399865047 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f338c06ace0 0x7f338c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:58.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.139+0000 7f33a57fa700 1 -- 172.21.15.37:0/399865047 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f33a0022070 con 0x7f33a80d15c0 2023-07-14T15:56:58.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.140+0000 7f33ac99b700 1 --2- 172.21.15.37:0/399865047 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f338c06ace0 0x7f338c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:58.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.140+0000 7f33ac99b700 1 --2- 172.21.15.37:0/399865047 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f338c06ace0 0x7f338c06d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f339c001000 tx=0x7f339c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:58.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.143+0000 7f33a57fa700 1 -- 172.21.15.37:0/399865047 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f33a0056980 con 0x7f33a80d15c0 2023-07-14T15:56:58.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.369+0000 7f33aebff700 1 -- 172.21.15.37:0/399865047 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f33a80d2620 con 0x7f33a80d15c0 2023-07-14T15:56:58.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.369+0000 7f33a57fa700 1 -- 172.21.15.37:0/399865047 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f33a0059fa0 con 0x7f33a80d15c0 2023-07-14T15:56:58.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.371+0000 7f33aebff700 1 -- 172.21.15.37:0/399865047 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f338c06ace0 msgr2=0x7f338c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:58.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.371+0000 7f33aebff700 1 --2- 172.21.15.37:0/399865047 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f338c06ace0 0x7f338c06d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f339c001000 tx=0x7f339c009040 comp rx=0 tx=0).stop 2023-07-14T15:56:58.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.371+0000 7f33aebff700 1 -- 172.21.15.37:0/399865047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33a80d15c0 msgr2=0x7f33a80b3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:58.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.371+0000 7f33aebff700 1 --2- 172.21.15.37:0/399865047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33a80d15c0 0x7f33a80b3e10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f33a000b370 tx=0x7f33a0004ad0 comp rx=0 tx=0).stop 2023-07-14T15:56:58.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.372+0000 7f33aebff700 1 -- 172.21.15.37:0/399865047 shutdown_connections 2023-07-14T15:56:58.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.372+0000 7f33aebff700 1 --2- 172.21.15.37:0/399865047 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33a80b0ae0 0x7f33a80cac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:58.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.372+0000 7f33aebff700 1 --2- 172.21.15.37:0/399865047 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f338c06ace0 0x7f338c06d190 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:58.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.372+0000 7f33aebff700 1 --2- 172.21.15.37:0/399865047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33a80d15c0 0x7f33a80b3e10 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:58.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.372+0000 7f33aebff700 1 --2- 172.21.15.37:0/399865047 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f33a80b8900 0x7f33a815d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:58.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.372+0000 7f33aebff700 1 -- 172.21.15.37:0/399865047 >> 172.21.15.37:0/399865047 conn(0x7f33a809c1e0 msgr2=0x7f33a80d0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:58.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.372+0000 7f33aebff700 1 -- 172.21.15.37:0/399865047 shutdown_connections 2023-07-14T15:56:58.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.372+0000 7f33aebff700 1 -- 172.21.15.37:0/399865047 wait complete. 2023-07-14T15:56:58.359 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2023-07-14T15:56:58.375 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-14T15:56:58.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:58.376 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-07-14T15:56:58.468 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-07-14T15:56:58.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:56:58.469 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-14T15:56:58.470 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T15:56:58.477 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T15:56:58.519 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-14T15:56:58.519 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T15:56:58.570 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-14T15:56:58.570 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T15:56:58.670 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-14T15:56:58.670 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T15:56:58.753 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T15:56:58.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.971+0000 7f0a379ff700 1 Processor -- start 2023-07-14T15:56:58.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.971+0000 7f0a379ff700 1 -- start start 2023-07-14T15:56:58.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.972+0000 7f0a379ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0a300ce400 0x7f0a300afae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:58.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.972+0000 7f0a379ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a300cb5e0 con 0x7f0a3015a810 2023-07-14T15:56:58.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.972+0000 7f0a379ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a300cb880 con 0x7f0a3015a440 2023-07-14T15:56:58.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.972+0000 7f0a379ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a300cbb60 con 0x7f0a300ce400 2023-07-14T15:56:58.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.972+0000 7f0a34f9a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0a300ce400 0x7f0a300afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:58.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.973+0000 7f0a35f9c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0a3015a810 0x7f0a300b0020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38074/0 (socket says 172.21.15.37:38074) 2023-07-14T15:56:58.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.973+0000 7f0a35f9c700 1 -- 172.21.15.37:0/689962587 learned_addr learned my addr 172.21.15.37:0/689962587 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:56:58.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.973+0000 7f0a34f9a700 1 -- 172.21.15.37:0/689962587 >> v1:172.21.15.98:6789/0 conn(0x7f0a3015a440 legacy=0x7f0a300cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:58.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.973+0000 7f0a34f9a700 1 -- 172.21.15.37:0/689962587 >> v1:172.21.15.37:6789/0 conn(0x7f0a3015a810 legacy=0x7f0a300b0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:58.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.973+0000 7f0a34f9a700 1 -- 172.21.15.37:0/689962587 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a300cbe40 con 0x7f0a300ce400 2023-07-14T15:56:58.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.973+0000 7f0a27fff700 1 -- 172.21.15.37:0/689962587 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1950729265 0 0) 0x7f0a300cb5e0 con 0x7f0a3015a810 2023-07-14T15:56:58.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.973+0000 7f0a34f9a700 1 --2- 172.21.15.37:0/689962587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a300ce400 0x7f0a300afae0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0a20009840 tx=0x7f0a20009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc7893edae905b50 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:58.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.973+0000 7f0a27fff700 1 -- 172.21.15.37:0/689962587 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a20011830 con 0x7f0a300ce400 2023-07-14T15:56:58.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.974+0000 7f0a27fff700 1 -- 172.21.15.37:0/689962587 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a20011990 con 0x7f0a300ce400 2023-07-14T15:56:58.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.974+0000 7f0a27fff700 1 -- 172.21.15.37:0/689962587 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a20011d20 con 0x7f0a300ce400 2023-07-14T15:56:58.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.974+0000 7f0a379ff700 1 -- 172.21.15.37:0/689962587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a300ce400 msgr2=0x7f0a300afae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:58.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.974+0000 7f0a379ff700 1 --2- 172.21.15.37:0/689962587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a300ce400 0x7f0a300afae0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0a20009840 tx=0x7f0a20009b50 comp rx=0 tx=0).stop 2023-07-14T15:56:58.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.974+0000 7f0a379ff700 1 -- 172.21.15.37:0/689962587 shutdown_connections 2023-07-14T15:56:58.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.974+0000 7f0a379ff700 1 --2- 172.21.15.37:0/689962587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a300ce400 0x7f0a300afae0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:58.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.974+0000 7f0a379ff700 1 -- 172.21.15.37:0/689962587 >> 172.21.15.37:0/689962587 conn(0x7f0a300b08c0 msgr2=0x7f0a300b0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:58.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.974+0000 7f0a379ff700 1 -- 172.21.15.37:0/689962587 shutdown_connections 2023-07-14T15:56:58.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.974+0000 7f0a379ff700 1 -- 172.21.15.37:0/689962587 wait complete. 2023-07-14T15:56:58.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.976+0000 7f0a379ff700 1 Processor -- start 2023-07-14T15:56:58.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.976+0000 7f0a379ff700 1 -- start start 2023-07-14T15:56:58.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.977+0000 7f0a379ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a300ce400 0x7f0a300c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:58.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.977+0000 7f0a379ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0a3015a440 0x7f0a300b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:58.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.977+0000 7f0a379ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a3015a810 0x7f0a30148270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:58.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.977+0000 7f0a379ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3006d560 con 0x7f0a3015a810 2023-07-14T15:56:58.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.977+0000 7f0a379ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3006c7e0 con 0x7f0a300ce400 2023-07-14T15:56:58.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.977+0000 7f0a379ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3006b8f0 con 0x7f0a3015a440 2023-07-14T15:56:58.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.978+0000 7f0a35f9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a3015a810 0x7f0a30148270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:58.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.978+0000 7f0a35f9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a3015a810 0x7f0a30148270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43338/0 (socket says 172.21.15.37:43338) 2023-07-14T15:56:58.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.978+0000 7f0a35f9c700 1 -- 172.21.15.37:0/2880726911 learned_addr learned my addr 172.21.15.37:0/2880726911 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:58.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.978+0000 7f0a34f9a700 1 --2- 172.21.15.37:0/2880726911 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0a3015a440 0x7f0a300b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:58.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.978+0000 7f0a3579b700 1 --2- 172.21.15.37:0/2880726911 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a300ce400 0x7f0a300c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:58.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.978+0000 7f0a35f9c700 1 -- 172.21.15.37:0/2880726911 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0a3015a440 msgr2=0x7f0a300b1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:58.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.978+0000 7f0a35f9c700 1 --2- 172.21.15.37:0/2880726911 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0a3015a440 0x7f0a300b1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:58.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.978+0000 7f0a35f9c700 1 -- 172.21.15.37:0/2880726911 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a300ce400 msgr2=0x7f0a300c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:58.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.978+0000 7f0a35f9c700 1 --2- 172.21.15.37:0/2880726911 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a300ce400 0x7f0a300c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:58.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.978+0000 7f0a35f9c700 1 -- 172.21.15.37:0/2880726911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a200094a0 con 0x7f0a3015a810 2023-07-14T15:56:58.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.978+0000 7f0a3579b700 1 --2- 172.21.15.37:0/2880726911 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a300ce400 0x7f0a300c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:56:58.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.978+0000 7f0a35f9c700 1 --2- 172.21.15.37:0/2880726911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a3015a810 0x7f0a30148270 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0a2800cba0 tx=0x7f0a2800ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:58.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.978+0000 7f0a25ffb700 1 -- 172.21.15.37:0/2880726911 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2800aad0 con 0x7f0a3015a810 2023-07-14T15:56:58.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.979+0000 7f0a25ffb700 1 -- 172.21.15.37:0/2880726911 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a2800ac50 con 0x7f0a3015a810 2023-07-14T15:56:58.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.979+0000 7f0a25ffb700 1 -- 172.21.15.37:0/2880726911 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a280070d0 con 0x7f0a3015a810 2023-07-14T15:56:58.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.979+0000 7f0a379ff700 1 -- 172.21.15.37:0/2880726911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a3006bbd0 con 0x7f0a3015a810 2023-07-14T15:56:58.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.979+0000 7f0a379ff700 1 -- 172.21.15.37:0/2880726911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a3006c190 con 0x7f0a3015a810 2023-07-14T15:56:58.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.980+0000 7f0a379ff700 1 -- 172.21.15.37:0/2880726911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a3006c990 con 0x7f0a3015a810 2023-07-14T15:56:58.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.981+0000 7f0a25ffb700 1 -- 172.21.15.37:0/2880726911 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0a28007230 con 0x7f0a3015a810 2023-07-14T15:56:58.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.981+0000 7f0a25ffb700 1 --2- 172.21.15.37:0/2880726911 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0a1406ace0 0x7f0a1406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:58.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.982+0000 7f0a25ffb700 1 -- 172.21.15.37:0/2880726911 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0a28088f40 con 0x7f0a3015a810 2023-07-14T15:56:58.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.982+0000 7f0a3579b700 1 --2- 172.21.15.37:0/2880726911 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0a1406ace0 0x7f0a1406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:58.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.983+0000 7f0a3579b700 1 --2- 172.21.15.37:0/2880726911 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0a1406ace0 0x7f0a1406d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c000f60 tx=0x7f0a2c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:58.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:58.986+0000 7f0a25ffb700 1 -- 172.21.15.37:0/2880726911 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0a3006c990 con 0x7f0a3015a810 2023-07-14T15:56:59.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.196+0000 7f0a379ff700 1 -- 172.21.15.37:0/2880726911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a3006c990 con 0x7f0a3015a810 2023-07-14T15:56:59.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.197+0000 7f0a25ffb700 1 -- 172.21.15.37:0/2880726911 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18341 (secure 0 0 0) 0x7f0a3006c990 con 0x7f0a3015a810 2023-07-14T15:56:59.182 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:56:59.183 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"fsid":"9da30401-a779-4e46-aba6-00c2494c6c67","created":"2023-07-14T15:55:39.898867+0000","modified":"2023-07-14T15:56:09.959850+0000","last_up_change":"2023-07-14T15:55:53.025696+0000","last_in_change":"2023-07-14T15:55:43.388192+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T15:55:52.907261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T15:55:59.992839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T15:56:06.091064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T15:56:07.448694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d049535-7b87-4276-8fe5-0f74ba422d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6801","nonce":2783032392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6803","nonce":2783032392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6807","nonce":2783032392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6805","nonce":2783032392}]},"public_addr":"172.21.15.37:6801/2783032392","cluster_addr":"172.21.15.37:6803/2783032392","heartbeat_back_addr":"172.21.15.37:6807/2783032392","heartbeat_front_addr":"172.21.15.37:6805/2783032392","state":["exists","up"]},{"osd":1,"uuid":"79ec948d-ead2-4c2d-923a-dd6eeaac9dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6823","nonce":1190059746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6826","nonce":1190059746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6831","nonce":1190059746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6829","nonce":1190059746}]},"public_addr":"172.21.15.37:6823/1190059746","cluster_addr":"172.21.15.37:6826/1190059746","heartbeat_back_addr":"172.21.15.37:6831/1190059746","heartbeat_front_addr":"172.21.15.37:6829/1190059746","state":["exists","up"]},{"osd":2,"uuid":"a1db6690-c160-4366-9c82-2cca17e4bba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6809","nonce":2266223499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6813","nonce":2266223499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6820","nonce":2266223499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6816","nonce":2266223499}]},"public_addr":"172.21.15.37:6809/2266223499","cluster_addr":"172.21.15.37:6813/2266223499","heartbeat_back_addr":"172.21.15.37:6820/2266223499","heartbeat_front_addr":"172.21.15.37:6816/2266223499","state":["exists","up"]},{"osd":3,"uuid":"767b8220-e79a-4a86-a162-6b3b73198379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6812","nonce":4166694594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6817","nonce":4166694594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6828","nonce":4166694594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6822","nonce":4166694594}]},"public_addr":"172.21.15.37:6812/4166694594","cluster_addr":"172.21.15.37:6817/4166694594","heartbeat_back_addr":"172.21.15.37:6828/4166694594","heartbeat_front_addr":"172.21.15.37:6822/4166694594","state":["exists","up"]},{"osd":4,"uuid":"717bd773-ae7e-4236-ac79-900cf99a37c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6801","nonce":3529020407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6803","nonce":3529020407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6807","nonce":3529020407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6805","nonce":3529020407}]},"public_addr":"172.21.15.98:6801/3529020407","cluster_addr":"172.21.15.98:6803/3529020407","heartbeat_back_addr":"172.21.15.98:6807/3529020407","heartbeat_front_addr":"172.21.15.98:6805/3529020407","state":["exists","up"]},{"osd":5,"uuid":"a941d358-0f03-4136-a9b2-3a1c2e9358cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6817","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6819","nonce":2311501838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6821","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6823","nonce":2311501838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6829","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6831","nonce":2311501838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6825","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6827","nonce":2311501838}]},"public_addr":"172.21.15.98:6819/2311501838","cluster_addr":"172.21.15.98:6823/2311501838","heartbeat_back_addr":"172.21.15.98:6831/2311501838","heartbeat_front_addr":"172.21.15.98:6827/2311501838","state":["exists","up"]},{"osd":6,"uuid":"27153772-6d4b-479d-9953-0582e7b96743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6809","nonce":1144224691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6811","nonce":1144224691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6815","nonce":1144224691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6813","nonce":1144224691}]},"public_addr":"172.21.15.98:6809/1144224691","cluster_addr":"172.21.15.98:6811/1144224691","heartbeat_back_addr":"172.21.15.98:6815/1144224691","heartbeat_front_addr":"172.21.15.98:6813/1144224691","state":["exists","up"]},{"osd":7,"uuid":"d21ffc8e-40bb-47eb-af2c-e3e730d3fb76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6818","nonce":1144470927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6822","nonce":1144470927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6830","nonce":1144470927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6826","nonce":1144470927}]},"public_addr":"172.21.15.98:6818/1144470927","cluster_addr":"172.21.15.98:6822/1144470927","heartbeat_back_addr":"172.21.15.98:6830/1144470927","heartbeat_front_addr":"172.21.15.98:6826/1144470927","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.921114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.739210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.024016+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.002527+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.698127+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.813416+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.709351+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.815457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T15:56:59.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.199+0000 7f0a379ff700 1 -- 172.21.15.37:0/2880726911 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0a1406ace0 msgr2=0x7f0a1406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:59.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.199+0000 7f0a379ff700 1 --2- 172.21.15.37:0/2880726911 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0a1406ace0 0x7f0a1406d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c000f60 tx=0x7f0a2c009040 comp rx=0 tx=0).stop 2023-07-14T15:56:59.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.200+0000 7f0a379ff700 1 -- 172.21.15.37:0/2880726911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a3015a810 msgr2=0x7f0a30148270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:59.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.200+0000 7f0a379ff700 1 --2- 172.21.15.37:0/2880726911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a3015a810 0x7f0a30148270 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0a2800cba0 tx=0x7f0a2800ceb0 comp rx=0 tx=0).stop 2023-07-14T15:56:59.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.200+0000 7f0a379ff700 1 -- 172.21.15.37:0/2880726911 shutdown_connections 2023-07-14T15:56:59.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.200+0000 7f0a379ff700 1 --2- 172.21.15.37:0/2880726911 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a300ce400 0x7f0a300c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:59.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.200+0000 7f0a379ff700 1 --2- 172.21.15.37:0/2880726911 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0a1406ace0 0x7f0a1406d190 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:59.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.200+0000 7f0a379ff700 1 --2- 172.21.15.37:0/2880726911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a3015a810 0x7f0a30148270 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:59.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.200+0000 7f0a379ff700 1 --2- 172.21.15.37:0/2880726911 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0a3015a440 0x7f0a300b1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:59.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.200+0000 7f0a379ff700 1 -- 172.21.15.37:0/2880726911 >> 172.21.15.37:0/2880726911 conn(0x7f0a300b08c0 msgr2=0x7f0a3014cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:59.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.200+0000 7f0a379ff700 1 -- 172.21.15.37:0/2880726911 shutdown_connections 2023-07-14T15:56:59.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.200+0000 7f0a379ff700 1 -- 172.21.15.37:0/2880726911 wait complete. 2023-07-14T15:56:59.203 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T15:55:52.907261+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T15:55:59.992839+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T15:56:06.091064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T15:56:07.448694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T15:56:59.204 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T15:56:59.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.425+0000 7fe2025ff700 1 Processor -- start 2023-07-14T15:56:59.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.425+0000 7fe2025ff700 1 -- start start 2023-07-14T15:56:59.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.426+0000 7fe2025ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe1fc071820 0x7fe1fc06cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:59.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.426+0000 7fe2025ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe1fc06d0c0 0x7fe1fc0c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:59.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.426+0000 7fe2025ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1fc0707f0 con 0x7fe1fc0cb430 2023-07-14T15:56:59.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.426+0000 7fe2025ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1fc070a60 con 0x7fe1fc071820 2023-07-14T15:56:59.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.426+0000 7fe2025ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc070d40 con 0x7fe1fc06d0c0 2023-07-14T15:56:59.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.427+0000 7fe1fb7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe1fc071820 0x7fe1fc06cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:59.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.427+0000 7fe1fb7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe1fc071820 0x7fe1fc06cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43350/0 (socket says 172.21.15.37:43350) 2023-07-14T15:56:59.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.427+0000 7fe1fbfff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe1fc0cb430 0x7fe1fc0cb800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38078/0 (socket says 172.21.15.37:38078) 2023-07-14T15:56:59.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.427+0000 7fe1fb7fe700 1 -- 172.21.15.37:0/775260118 learned_addr learned my addr 172.21.15.37:0/775260118 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:59.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.427+0000 7fe200b9c700 1 --2- 172.21.15.37:0/775260118 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe1fc06d0c0 0x7fe1fc0c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:59.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.427+0000 7fe1fb7fe700 1 -- 172.21.15.37:0/775260118 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe1fc06d0c0 msgr2=0x7fe1fc0c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:59.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.427+0000 7fe1fb7fe700 1 --2- 172.21.15.37:0/775260118 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe1fc06d0c0 0x7fe1fc0c90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:59.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.427+0000 7fe1fb7fe700 1 -- 172.21.15.37:0/775260118 >> v1:172.21.15.37:6789/0 conn(0x7fe1fc0cb430 legacy=0x7fe1fc0cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:59.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.427+0000 7fe1fb7fe700 1 -- 172.21.15.37:0/775260118 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1fc071020 con 0x7fe1fc071820 2023-07-14T15:56:59.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.427+0000 7fe1faffd700 1 -- 172.21.15.37:0/775260118 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2955175600 0 0) 0x7fe1fc0707f0 con 0x7fe1fc0cb430 2023-07-14T15:56:59.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.427+0000 7fe1fb7fe700 1 --2- 172.21.15.37:0/775260118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1fc071820 0x7fe1fc06cb80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe1f00098f0 tx=0x7fe1f0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aadf1bdf0fc3e7ec server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:59.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.428+0000 7fe1faffd700 1 -- 172.21.15.37:0/775260118 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f0011830 con 0x7fe1fc071820 2023-07-14T15:56:59.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.428+0000 7fe1faffd700 1 -- 172.21.15.37:0/775260118 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f0011990 con 0x7fe1fc071820 2023-07-14T15:56:59.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.428+0000 7fe1faffd700 1 -- 172.21.15.37:0/775260118 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f0011d20 con 0x7fe1fc071820 2023-07-14T15:56:59.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.428+0000 7fe2025ff700 1 -- 172.21.15.37:0/775260118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1fc071820 msgr2=0x7fe1fc06cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:59.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.428+0000 7fe2025ff700 1 --2- 172.21.15.37:0/775260118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1fc071820 0x7fe1fc06cb80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe1f00098f0 tx=0x7fe1f0009c00 comp rx=0 tx=0).stop 2023-07-14T15:56:59.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.428+0000 7fe2025ff700 1 -- 172.21.15.37:0/775260118 shutdown_connections 2023-07-14T15:56:59.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.428+0000 7fe2025ff700 1 --2- 172.21.15.37:0/775260118 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe1fc06d0c0 0x7fe1fc0c90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:59.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.428+0000 7fe2025ff700 1 --2- 172.21.15.37:0/775260118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1fc071820 0x7fe1fc06cb80 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:59.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.428+0000 7fe2025ff700 1 -- 172.21.15.37:0/775260118 >> 172.21.15.37:0/775260118 conn(0x7fe1fc06aac0 msgr2=0x7fe1fc0b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:59.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.428+0000 7fe2025ff700 1 -- 172.21.15.37:0/775260118 shutdown_connections 2023-07-14T15:56:59.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.428+0000 7fe2025ff700 1 -- 172.21.15.37:0/775260118 wait complete. 2023-07-14T15:56:59.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.430+0000 7fe2025ff700 1 Processor -- start 2023-07-14T15:56:59.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.430+0000 7fe2025ff700 1 -- start start 2023-07-14T15:56:59.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.431+0000 7fe2025ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe1fc06d0c0 0x7fe1fc1f3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:59.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.431+0000 7fe2025ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1fc071820 0x7fe1fc0b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:59.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.431+0000 7fe2025ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1fc0cb430 0x7fe1fc14ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:59.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.431+0000 7fe2025ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc145380 con 0x7fe1fc0cb430 2023-07-14T15:56:59.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.431+0000 7fe2025ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc1f3580 con 0x7fe1fc071820 2023-07-14T15:56:59.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.431+0000 7fe2025ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc0b4300 con 0x7fe1fc06d0c0 2023-07-14T15:56:59.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.432+0000 7fe200b9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1fc0cb430 0x7fe1fc14ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:59.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.432+0000 7fe200b9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1fc0cb430 0x7fe1fc14ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43356/0 (socket says 172.21.15.37:43356) 2023-07-14T15:56:59.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.432+0000 7fe200b9c700 1 -- 172.21.15.37:0/3726182279 learned_addr learned my addr 172.21.15.37:0/3726182279 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:59.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.432+0000 7fe1fbfff700 1 --2- 172.21.15.37:0/3726182279 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe1fc06d0c0 0x7fe1fc1f3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:59.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.432+0000 7fe1fb7fe700 1 --2- 172.21.15.37:0/3726182279 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1fc071820 0x7fe1fc0b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:59.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.432+0000 7fe200b9c700 1 -- 172.21.15.37:0/3726182279 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe1fc06d0c0 msgr2=0x7fe1fc1f3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:59.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.432+0000 7fe200b9c700 1 --2- 172.21.15.37:0/3726182279 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe1fc06d0c0 0x7fe1fc1f3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:59.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.432+0000 7fe200b9c700 1 -- 172.21.15.37:0/3726182279 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1fc071820 msgr2=0x7fe1fc0b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:59.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.432+0000 7fe200b9c700 1 --2- 172.21.15.37:0/3726182279 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1fc071820 0x7fe1fc0b33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:59.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.432+0000 7fe200b9c700 1 -- 172.21.15.37:0/3726182279 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f0009550 con 0x7fe1fc0cb430 2023-07-14T15:56:59.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.432+0000 7fe1fbfff700 1 --2- 172.21.15.37:0/3726182279 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe1fc06d0c0 0x7fe1fc1f3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:56:59.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.432+0000 7fe1fb7fe700 1 --2- 172.21.15.37:0/3726182279 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1fc071820 0x7fe1fc0b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:56:59.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.432+0000 7fe200b9c700 1 --2- 172.21.15.37:0/3726182279 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1fc0cb430 0x7fe1fc14ec80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe1f400efc0 tx=0x7fe1f400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:59.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.433+0000 7fe1f8ff9700 1 -- 172.21.15.37:0/3726182279 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f400cd40 con 0x7fe1fc0cb430 2023-07-14T15:56:59.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.433+0000 7fe1f8ff9700 1 -- 172.21.15.37:0/3726182279 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f400f040 con 0x7fe1fc0cb430 2023-07-14T15:56:59.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.433+0000 7fe2025ff700 1 -- 172.21.15.37:0/3726182279 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1fc0b3d40 con 0x7fe1fc0cb430 2023-07-14T15:56:59.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.433+0000 7fe1f8ff9700 1 -- 172.21.15.37:0/3726182279 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f40146c0 con 0x7fe1fc0cb430 2023-07-14T15:56:59.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.433+0000 7fe2025ff700 1 -- 172.21.15.37:0/3726182279 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1fc152990 con 0x7fe1fc0cb430 2023-07-14T15:56:59.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.434+0000 7fe2025ff700 1 -- 172.21.15.37:0/3726182279 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1fc0ca640 con 0x7fe1fc0cb430 2023-07-14T15:56:59.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.435+0000 7fe1f8ff9700 1 -- 172.21.15.37:0/3726182279 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe1f4014820 con 0x7fe1fc0cb430 2023-07-14T15:56:59.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.436+0000 7fe1f8ff9700 1 --2- 172.21.15.37:0/3726182279 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe1e806ace0 0x7fe1e806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:59.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.436+0000 7fe1f8ff9700 1 -- 172.21.15.37:0/3726182279 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe1f4089e80 con 0x7fe1fc0cb430 2023-07-14T15:56:59.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.436+0000 7fe1fbfff700 1 --2- 172.21.15.37:0/3726182279 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe1e806ace0 0x7fe1e806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:59.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.437+0000 7fe1fbfff700 1 --2- 172.21.15.37:0/3726182279 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe1e806ace0 0x7fe1e806d190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec007fd0 tx=0x7fe1ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:59.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.440+0000 7fe1f8ff9700 1 -- 172.21.15.37:0/3726182279 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe1f4058920 con 0x7fe1fc0cb430 2023-07-14T15:56:59.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.648+0000 7fe2025ff700 1 -- 172.21.15.37:0/3726182279 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe1fc15dbd0 con 0x7fe1fc0cb430 2023-07-14T15:56:59.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.649+0000 7fe1f8ff9700 1 -- 172.21.15.37:0/3726182279 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe1f4018020 con 0x7fe1fc0cb430 2023-07-14T15:56:59.634 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-14T15:56:59.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.651+0000 7fe2025ff700 1 -- 172.21.15.37:0/3726182279 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe1e806ace0 msgr2=0x7fe1e806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:59.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.651+0000 7fe2025ff700 1 --2- 172.21.15.37:0/3726182279 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe1e806ace0 0x7fe1e806d190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec007fd0 tx=0x7fe1ec009040 comp rx=0 tx=0).stop 2023-07-14T15:56:59.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.651+0000 7fe2025ff700 1 -- 172.21.15.37:0/3726182279 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1fc0cb430 msgr2=0x7fe1fc14ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:59.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.651+0000 7fe2025ff700 1 --2- 172.21.15.37:0/3726182279 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1fc0cb430 0x7fe1fc14ec80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe1f400efc0 tx=0x7fe1f400c3a0 comp rx=0 tx=0).stop 2023-07-14T15:56:59.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.651+0000 7fe2025ff700 1 -- 172.21.15.37:0/3726182279 shutdown_connections 2023-07-14T15:56:59.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.651+0000 7fe2025ff700 1 --2- 172.21.15.37:0/3726182279 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe1e806ace0 0x7fe1e806d190 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:59.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.651+0000 7fe2025ff700 1 --2- 172.21.15.37:0/3726182279 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1fc0cb430 0x7fe1fc14ec80 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:59.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.651+0000 7fe2025ff700 1 --2- 172.21.15.37:0/3726182279 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe1fc06d0c0 0x7fe1fc1f3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:59.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.651+0000 7fe2025ff700 1 --2- 172.21.15.37:0/3726182279 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1fc071820 0x7fe1fc0b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:59.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.651+0000 7fe2025ff700 1 -- 172.21.15.37:0/3726182279 >> 172.21.15.37:0/3726182279 conn(0x7fe1fc06aac0 msgr2=0x7fe1fc0cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:59.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.651+0000 7fe2025ff700 1 -- 172.21.15.37:0/3726182279 shutdown_connections 2023-07-14T15:56:59.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.651+0000 7fe2025ff700 1 -- 172.21.15.37:0/3726182279 wait complete. 2023-07-14T15:56:59.654 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T15:56:59.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.874+0000 7f4d761ff700 1 Processor -- start 2023-07-14T15:56:59.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.875+0000 7f4d761ff700 1 -- start start 2023-07-14T15:56:59.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.876+0000 7f4d761ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4d7015fee0 0x7f4d7015ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:59.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.876+0000 7f4d761ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4d701603b0 0x7f4d700d0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:59.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.876+0000 7f4d761ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f4d700d0f70 0x7f4d700b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:59.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.876+0000 7f4d761ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d700d13d0 con 0x7f4d7015fee0 2023-07-14T15:56:59.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.876+0000 7f4d761ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d700b2940 con 0x7f4d700d0f70 2023-07-14T15:56:59.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.876+0000 7f4d761ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d700b2c20 con 0x7f4d701603b0 2023-07-14T15:56:59.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.876+0000 7f4d6f7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4d7015fee0 0x7f4d7015ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:59.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.876+0000 7f4d6f7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4d7015fee0 0x7f4d7015ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43372/0 (socket says 172.21.15.37:43372) 2023-07-14T15:56:59.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.876+0000 7f4d6f7fe700 1 -- 172.21.15.37:0/3869623676 learned_addr learned my addr 172.21.15.37:0/3869623676 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:59.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.876+0000 7f4d6effd700 1 --2- 172.21.15.37:0/3869623676 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4d701603b0 0x7f4d700d0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:59.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.876+0000 7f4d6ffff700 1 --2- 172.21.15.37:0/3869623676 >> v2:172.21.15.98:3300/0 conn(0x7f4d700d0f70 0x7f4d700b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:59.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.876+0000 7f4d6f7fe700 1 -- 172.21.15.37:0/3869623676 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4d701603b0 msgr2=0x7f4d700d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:59.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.877+0000 7f4d6f7fe700 1 --2- 172.21.15.37:0/3869623676 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4d701603b0 0x7f4d700d0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:59.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.877+0000 7f4d6f7fe700 1 -- 172.21.15.37:0/3869623676 >> v2:172.21.15.98:3300/0 conn(0x7f4d700d0f70 msgr2=0x7f4d700b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:56:59.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.877+0000 7f4d6f7fe700 1 --2- 172.21.15.37:0/3869623676 >> v2:172.21.15.98:3300/0 conn(0x7f4d700d0f70 0x7f4d700b39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:59.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.877+0000 7f4d6f7fe700 1 -- 172.21.15.37:0/3869623676 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d700b2f00 con 0x7f4d7015fee0 2023-07-14T15:56:59.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.877+0000 7f4d6ffff700 1 --2- 172.21.15.37:0/3869623676 >> v2:172.21.15.98:3300/0 conn(0x7f4d700d0f70 0x7f4d700b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:56:59.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.877+0000 7f4d6effd700 1 --2- 172.21.15.37:0/3869623676 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4d701603b0 0x7f4d700d0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:56:59.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.877+0000 7f4d6f7fe700 1 --2- 172.21.15.37:0/3869623676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d7015fee0 0x7f4d7015ded0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4d7008b420 tx=0x7f4d60009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dd6806f23bbf80e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:59.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.877+0000 7f4d6e7fc700 1 -- 172.21.15.37:0/3869623676 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6000b870 con 0x7f4d7015fee0 2023-07-14T15:56:59.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.877+0000 7f4d6e7fc700 1 -- 172.21.15.37:0/3869623676 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d6000b9d0 con 0x7f4d7015fee0 2023-07-14T15:56:59.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.877+0000 7f4d6e7fc700 1 -- 172.21.15.37:0/3869623676 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6000bd60 con 0x7f4d7015fee0 2023-07-14T15:56:59.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.878+0000 7f4d761ff700 1 -- 172.21.15.37:0/3869623676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d7015fee0 msgr2=0x7f4d7015ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:59.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.878+0000 7f4d761ff700 1 --2- 172.21.15.37:0/3869623676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d7015fee0 0x7f4d7015ded0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4d7008b420 tx=0x7f4d60009bd0 comp rx=0 tx=0).stop 2023-07-14T15:56:59.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.878+0000 7f4d761ff700 1 -- 172.21.15.37:0/3869623676 shutdown_connections 2023-07-14T15:56:59.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.878+0000 7f4d761ff700 1 --2- 172.21.15.37:0/3869623676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d7015fee0 0x7f4d7015ded0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:59.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.878+0000 7f4d761ff700 1 --2- 172.21.15.37:0/3869623676 >> v2:172.21.15.98:3300/0 conn(0x7f4d700d0f70 0x7f4d700b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:59.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.878+0000 7f4d761ff700 1 --2- 172.21.15.37:0/3869623676 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4d701603b0 0x7f4d700d0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:59.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.878+0000 7f4d761ff700 1 -- 172.21.15.37:0/3869623676 >> 172.21.15.37:0/3869623676 conn(0x7f4d7009c1b0 msgr2=0x7f4d700d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:56:59.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.878+0000 7f4d761ff700 1 -- 172.21.15.37:0/3869623676 shutdown_connections 2023-07-14T15:56:59.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.878+0000 7f4d761ff700 1 -- 172.21.15.37:0/3869623676 wait complete. 2023-07-14T15:56:59.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.880+0000 7f4d761ff700 1 Processor -- start 2023-07-14T15:56:59.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.880+0000 7f4d761ff700 1 -- start start 2023-07-14T15:56:59.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.881+0000 7f4d761ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d700d0f70 0x7f4d701f6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:59.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.881+0000 7f4d761ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d7015fee0 0x7f4d700b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:59.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.881+0000 7f4d761ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4d701603b0 0x7f4d700c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:59.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.881+0000 7f4d761ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d700b7690 con 0x7f4d7015fee0 2023-07-14T15:56:59.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.881+0000 7f4d761ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d700c7710 con 0x7f4d700d0f70 2023-07-14T15:56:59.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.881+0000 7f4d761ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d700c7440 con 0x7f4d701603b0 2023-07-14T15:56:59.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.881+0000 7f4d6effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d7015fee0 0x7f4d700b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:59.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.881+0000 7f4d6effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d7015fee0 0x7f4d700b7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43384/0 (socket says 172.21.15.37:43384) 2023-07-14T15:56:59.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.881+0000 7f4d6effd700 1 -- 172.21.15.37:0/404310218 learned_addr learned my addr 172.21.15.37:0/404310218 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:56:59.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.881+0000 7f4d6f7fe700 1 --2- 172.21.15.37:0/404310218 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d700d0f70 0x7f4d701f6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:59.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.881+0000 7f4d6ffff700 1 --2- 172.21.15.37:0/404310218 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4d701603b0 0x7f4d700c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:59.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.882+0000 7f4d6effd700 1 -- 172.21.15.37:0/404310218 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4d701603b0 msgr2=0x7f4d700c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:59.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.882+0000 7f4d6effd700 1 --2- 172.21.15.37:0/404310218 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4d701603b0 0x7f4d700c6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:59.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.882+0000 7f4d6effd700 1 -- 172.21.15.37:0/404310218 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d700d0f70 msgr2=0x7f4d701f6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:56:59.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.882+0000 7f4d6effd700 1 --2- 172.21.15.37:0/404310218 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d700d0f70 0x7f4d701f6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:56:59.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.882+0000 7f4d6effd700 1 -- 172.21.15.37:0/404310218 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d60009550 con 0x7f4d7015fee0 2023-07-14T15:56:59.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.882+0000 7f4d6ffff700 1 --2- 172.21.15.37:0/404310218 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4d701603b0 0x7f4d700c6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:56:59.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.882+0000 7f4d6effd700 1 --2- 172.21.15.37:0/404310218 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d7015fee0 0x7f4d700b7150 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4d6400c750 tx=0x7f4d6400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:59.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.882+0000 7f4d57fff700 1 -- 172.21.15.37:0/404310218 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d64011800 con 0x7f4d7015fee0 2023-07-14T15:56:59.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.882+0000 7f4d57fff700 1 -- 172.21.15.37:0/404310218 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d64011960 con 0x7f4d7015fee0 2023-07-14T15:56:59.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.882+0000 7f4d57fff700 1 -- 172.21.15.37:0/404310218 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d64011cd0 con 0x7f4d7015fee0 2023-07-14T15:56:59.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.882+0000 7f4d761ff700 1 -- 172.21.15.37:0/404310218 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d700b6390 con 0x7f4d7015fee0 2023-07-14T15:56:59.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.882+0000 7f4d761ff700 1 -- 172.21.15.37:0/404310218 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d700b6950 con 0x7f4d7015fee0 2023-07-14T15:56:59.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.883+0000 7f4d761ff700 1 -- 172.21.15.37:0/404310218 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d70067840 con 0x7f4d7015fee0 2023-07-14T15:56:59.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.884+0000 7f4d57fff700 1 -- 172.21.15.37:0/404310218 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4d64021350 con 0x7f4d7015fee0 2023-07-14T15:56:59.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.885+0000 7f4d57fff700 1 --2- 172.21.15.37:0/404310218 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4d5c06ace0 0x7f4d5c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:56:59.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.885+0000 7f4d57fff700 1 -- 172.21.15.37:0/404310218 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4d640894c0 con 0x7f4d7015fee0 2023-07-14T15:56:59.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.885+0000 7f4d6f7fe700 1 --2- 172.21.15.37:0/404310218 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4d5c06ace0 0x7f4d5c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:56:59.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.886+0000 7f4d6f7fe700 1 --2- 172.21.15.37:0/404310218 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4d5c06ace0 0x7f4d5c06d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4d60000c00 tx=0x7f4d60008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:56:59.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:56:59.890+0000 7f4d57fff700 1 -- 172.21.15.37:0/404310218 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4d64057f60 con 0x7f4d7015fee0 2023-07-14T15:57:00.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.098+0000 7f4d761ff700 1 -- 172.21.15.37:0/404310218 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4d70151850 con 0x7f4d7015fee0 2023-07-14T15:57:00.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.098+0000 7f4d57fff700 1 -- 172.21.15.37:0/404310218 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4d64057af0 con 0x7f4d7015fee0 2023-07-14T15:57:00.084 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-14T15:57:00.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.101+0000 7f4d761ff700 1 -- 172.21.15.37:0/404310218 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4d5c06ace0 msgr2=0x7f4d5c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:00.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.101+0000 7f4d761ff700 1 --2- 172.21.15.37:0/404310218 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4d5c06ace0 0x7f4d5c06d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4d60000c00 tx=0x7f4d60008030 comp rx=0 tx=0).stop 2023-07-14T15:57:00.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.101+0000 7f4d761ff700 1 -- 172.21.15.37:0/404310218 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d7015fee0 msgr2=0x7f4d700b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:00.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.101+0000 7f4d761ff700 1 --2- 172.21.15.37:0/404310218 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d7015fee0 0x7f4d700b7150 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4d6400c750 tx=0x7f4d6400cb10 comp rx=0 tx=0).stop 2023-07-14T15:57:00.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.101+0000 7f4d761ff700 1 -- 172.21.15.37:0/404310218 shutdown_connections 2023-07-14T15:57:00.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.101+0000 7f4d761ff700 1 --2- 172.21.15.37:0/404310218 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d700d0f70 0x7f4d701f6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:00.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.101+0000 7f4d761ff700 1 --2- 172.21.15.37:0/404310218 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4d5c06ace0 0x7f4d5c06d190 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:00.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.101+0000 7f4d761ff700 1 --2- 172.21.15.37:0/404310218 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4d701603b0 0x7f4d700c6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:00.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.101+0000 7f4d761ff700 1 --2- 172.21.15.37:0/404310218 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d7015fee0 0x7f4d700b7150 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:00.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.101+0000 7f4d761ff700 1 -- 172.21.15.37:0/404310218 >> 172.21.15.37:0/404310218 conn(0x7f4d7009c1b0 msgr2=0x7f4d700b38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:00.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.101+0000 7f4d761ff700 1 -- 172.21.15.37:0/404310218 shutdown_connections 2023-07-14T15:57:00.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.101+0000 7f4d761ff700 1 -- 172.21.15.37:0/404310218 wait complete. 2023-07-14T15:57:00.104 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T15:57:00.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.324+0000 7efd513ff700 1 Processor -- start 2023-07-14T15:57:00.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.324+0000 7efd513ff700 1 -- start start 2023-07-14T15:57:00.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.325+0000 7efd513ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7efd4c0cb490 0x7efd4c0cb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:00.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.325+0000 7efd513ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd4c1595b0 con 0x7efd4c0ce640 2023-07-14T15:57:00.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.325+0000 7efd513ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd4c0cbe00 con 0x7efd4c158b70 2023-07-14T15:57:00.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.325+0000 7efd513ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd4c06db00 con 0x7efd4c0cb490 2023-07-14T15:57:00.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.325+0000 7efd43fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7efd4c0ce640 0x7efd4c06b7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42680/0 (socket says 172.21.15.37:42680) 2023-07-14T15:57:00.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.325+0000 7efd43fff700 1 -- 172.21.15.37:0/2480418356 learned_addr learned my addr 172.21.15.37:0/2480418356 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:00.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.325+0000 7efd4b7fe700 1 --2- 172.21.15.37:0/2480418356 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7efd4c0cb490 0x7efd4c0cb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:00.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.326+0000 7efd4a7fc700 1 -- 172.21.15.37:0/2480418356 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 977455428 0 0) 0x7efd4c1595b0 con 0x7efd4c0ce640 2023-07-14T15:57:00.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.326+0000 7efd4a7fc700 1 -- 172.21.15.37:0/2480418356 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd380035b0 con 0x7efd4c0ce640 2023-07-14T15:57:00.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.326+0000 7efd4a7fc700 1 -- 172.21.15.37:0/2480418356 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3442769312 0 0) 0x7efd4c0cbe00 con 0x7efd4c158b70 2023-07-14T15:57:00.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.326+0000 7efd4a7fc700 1 -- 172.21.15.37:0/2480418356 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd4c1595b0 con 0x7efd4c158b70 2023-07-14T15:57:00.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.326+0000 7efd4b7fe700 1 -- 172.21.15.37:0/2480418356 >> v1:172.21.15.98:6789/0 conn(0x7efd4c158b70 legacy=0x7efd4c159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:00.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.326+0000 7efd4b7fe700 1 -- 172.21.15.37:0/2480418356 >> v1:172.21.15.37:6789/0 conn(0x7efd4c0ce640 legacy=0x7efd4c06b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:00.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.326+0000 7efd4b7fe700 1 -- 172.21.15.37:0/2480418356 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd4c159280 con 0x7efd4c0cb490 2023-07-14T15:57:00.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.326+0000 7efd4b7fe700 1 --2- 172.21.15.37:0/2480418356 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7efd4c0cb490 0x7efd4c0cb8c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efd44009dc0 tx=0x7efd4400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5487f45481553b3b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:00.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.326+0000 7efd4a7fc700 1 -- 172.21.15.37:0/2480418356 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4400e070 con 0x7efd4c0cb490 2023-07-14T15:57:00.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.327+0000 7efd4a7fc700 1 -- 172.21.15.37:0/2480418356 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd4400bb20 con 0x7efd4c0cb490 2023-07-14T15:57:00.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.327+0000 7efd4a7fc700 1 -- 172.21.15.37:0/2480418356 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd44012430 con 0x7efd4c0cb490 2023-07-14T15:57:00.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.327+0000 7efd513ff700 1 -- 172.21.15.37:0/2480418356 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7efd4c0cb490 msgr2=0x7efd4c0cb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:00.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.327+0000 7efd513ff700 1 --2- 172.21.15.37:0/2480418356 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7efd4c0cb490 0x7efd4c0cb8c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efd44009dc0 tx=0x7efd4400b330 comp rx=0 tx=0).stop 2023-07-14T15:57:00.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.327+0000 7efd513ff700 1 -- 172.21.15.37:0/2480418356 shutdown_connections 2023-07-14T15:57:00.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.327+0000 7efd513ff700 1 --2- 172.21.15.37:0/2480418356 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7efd4c0cb490 0x7efd4c0cb8c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:00.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.327+0000 7efd513ff700 1 -- 172.21.15.37:0/2480418356 >> 172.21.15.37:0/2480418356 conn(0x7efd4c06aac0 msgr2=0x7efd4c0b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:00.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.327+0000 7efd513ff700 1 -- 172.21.15.37:0/2480418356 shutdown_connections 2023-07-14T15:57:00.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.327+0000 7efd513ff700 1 -- 172.21.15.37:0/2480418356 wait complete. 2023-07-14T15:57:00.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.329+0000 7efd513ff700 1 Processor -- start 2023-07-14T15:57:00.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.329+0000 7efd513ff700 1 -- start start 2023-07-14T15:57:00.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.330+0000 7efd513ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd4c0cb490 0x7efd4c0ae850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:00.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.330+0000 7efd513ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7efd4c0ce640 0x7efd4c0b03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:00.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.330+0000 7efd513ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd4c158b70 0x7efd4c14cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:00.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.330+0000 7efd513ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd4c0b3100 con 0x7efd4c158b70 2023-07-14T15:57:00.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.330+0000 7efd513ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd4c0b24f0 con 0x7efd4c0cb490 2023-07-14T15:57:00.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.330+0000 7efd513ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd4c0b27d0 con 0x7efd4c0ce640 2023-07-14T15:57:00.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.330+0000 7efd4b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd4c158b70 0x7efd4c14cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:00.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.330+0000 7efd4affd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd4c0cb490 0x7efd4c0ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:00.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.330+0000 7efd4b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd4c158b70 0x7efd4c14cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46642/0 (socket says 172.21.15.37:46642) 2023-07-14T15:57:00.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.330+0000 7efd4b7fe700 1 -- 172.21.15.37:0/3237978871 learned_addr learned my addr 172.21.15.37:0/3237978871 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:00.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.330+0000 7efd43fff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7efd4c0ce640 0x7efd4c0b03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:00.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.331+0000 7efd4b7fe700 1 -- 172.21.15.37:0/3237978871 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7efd4c0ce640 msgr2=0x7efd4c0b03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:00.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.331+0000 7efd4b7fe700 1 --2- 172.21.15.37:0/3237978871 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7efd4c0ce640 0x7efd4c0b03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:00.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.331+0000 7efd4b7fe700 1 -- 172.21.15.37:0/3237978871 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd4c0cb490 msgr2=0x7efd4c0ae850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:00.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.331+0000 7efd4b7fe700 1 --2- 172.21.15.37:0/3237978871 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd4c0cb490 0x7efd4c0ae850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:00.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.331+0000 7efd4b7fe700 1 -- 172.21.15.37:0/3237978871 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd44009a70 con 0x7efd4c158b70 2023-07-14T15:57:00.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.331+0000 7efd4b7fe700 1 --2- 172.21.15.37:0/3237978871 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd4c158b70 0x7efd4c14cc70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7efd4400b370 tx=0x7efd44004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:00.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.331+0000 7efd437fe700 1 -- 172.21.15.37:0/3237978871 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4401b810 con 0x7efd4c158b70 2023-07-14T15:57:00.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.331+0000 7efd437fe700 1 -- 172.21.15.37:0/3237978871 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd44020070 con 0x7efd4c158b70 2023-07-14T15:57:00.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.331+0000 7efd437fe700 1 -- 172.21.15.37:0/3237978871 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4401bbb0 con 0x7efd4c158b70 2023-07-14T15:57:00.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.331+0000 7efd513ff700 1 -- 172.21.15.37:0/3237978871 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd4c0b2ab0 con 0x7efd4c158b70 2023-07-14T15:57:00.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.332+0000 7efd513ff700 1 -- 172.21.15.37:0/3237978871 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd4c0aed90 con 0x7efd4c158b70 2023-07-14T15:57:00.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.333+0000 7efd513ff700 1 -- 172.21.15.37:0/3237978871 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd4c0b32b0 con 0x7efd4c158b70 2023-07-14T15:57:00.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.334+0000 7efd437fe700 1 -- 172.21.15.37:0/3237978871 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efd4401bd10 con 0x7efd4c158b70 2023-07-14T15:57:00.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.335+0000 7efd437fe700 1 --2- 172.21.15.37:0/3237978871 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7efd2c06ace0 0x7efd2c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:00.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.335+0000 7efd437fe700 1 -- 172.21.15.37:0/3237978871 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efd44022070 con 0x7efd4c158b70 2023-07-14T15:57:00.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.335+0000 7efd4affd700 1 --2- 172.21.15.37:0/3237978871 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7efd2c06ace0 0x7efd2c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:00.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.336+0000 7efd4affd700 1 --2- 172.21.15.37:0/3237978871 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7efd2c06ace0 0x7efd2c06d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efd3c0011e0 tx=0x7efd3c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:00.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.339+0000 7efd437fe700 1 -- 172.21.15.37:0/3237978871 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7efd44056460 con 0x7efd4c158b70 2023-07-14T15:57:00.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.549+0000 7efd513ff700 1 -- 172.21.15.37:0/3237978871 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efd4c067840 con 0x7efd4c158b70 2023-07-14T15:57:00.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.549+0000 7efd437fe700 1 -- 172.21.15.37:0/3237978871 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7efd44059a80 con 0x7efd4c158b70 2023-07-14T15:57:00.535 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-14T15:57:00.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.552+0000 7efd513ff700 1 -- 172.21.15.37:0/3237978871 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7efd2c06ace0 msgr2=0x7efd2c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:00.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.552+0000 7efd513ff700 1 --2- 172.21.15.37:0/3237978871 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7efd2c06ace0 0x7efd2c06d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efd3c0011e0 tx=0x7efd3c009040 comp rx=0 tx=0).stop 2023-07-14T15:57:00.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.552+0000 7efd513ff700 1 -- 172.21.15.37:0/3237978871 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd4c158b70 msgr2=0x7efd4c14cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:00.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.552+0000 7efd513ff700 1 --2- 172.21.15.37:0/3237978871 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd4c158b70 0x7efd4c14cc70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7efd4400b370 tx=0x7efd44004ad0 comp rx=0 tx=0).stop 2023-07-14T15:57:00.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.552+0000 7efd513ff700 1 -- 172.21.15.37:0/3237978871 shutdown_connections 2023-07-14T15:57:00.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.552+0000 7efd513ff700 1 --2- 172.21.15.37:0/3237978871 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd4c0cb490 0x7efd4c0ae850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:00.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.552+0000 7efd513ff700 1 --2- 172.21.15.37:0/3237978871 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7efd2c06ace0 0x7efd2c06d190 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:00.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.552+0000 7efd513ff700 1 --2- 172.21.15.37:0/3237978871 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd4c158b70 0x7efd4c14cc70 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:00.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.552+0000 7efd513ff700 1 --2- 172.21.15.37:0/3237978871 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7efd4c0ce640 0x7efd4c0b03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:00.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.552+0000 7efd513ff700 1 -- 172.21.15.37:0/3237978871 >> 172.21.15.37:0/3237978871 conn(0x7efd4c06aac0 msgr2=0x7efd4c06f720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:00.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.552+0000 7efd513ff700 1 -- 172.21.15.37:0/3237978871 shutdown_connections 2023-07-14T15:57:00.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.552+0000 7efd513ff700 1 -- 172.21.15.37:0/3237978871 wait complete. 2023-07-14T15:57:00.555 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T15:57:00.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.774+0000 7f3b523ff700 1 Processor -- start 2023-07-14T15:57:00.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.774+0000 7f3b523ff700 1 -- start start 2023-07-14T15:57:00.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.775+0000 7f3b523ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3b4c0d1140 0x7f3b4c15ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:00.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.775+0000 7f3b523ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3b4c1603b0 0x7f3b4c0b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:00.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.775+0000 7f3b523ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b4c15dc50 con 0x7f3b4c15fee0 2023-07-14T15:57:00.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.775+0000 7f3b523ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b4c0b2940 con 0x7f3b4c0d1140 2023-07-14T15:57:00.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.775+0000 7f3b523ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4c0b2c20 con 0x7f3b4c1603b0 2023-07-14T15:57:00.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.776+0000 7f3b5099c700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3b4c1603b0 0x7f3b4c0b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:00.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.776+0000 7f3b4b7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3b4c0d1140 0x7f3b4c15ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:00.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.776+0000 7f3b5099c700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3b4c1603b0 0x7f3b4c0b39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3301/0 says I am v2:172.21.15.37:58740/0 (socket says 172.21.15.37:58740) 2023-07-14T15:57:00.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.776+0000 7f3b5099c700 1 -- 172.21.15.37:0/2874744728 learned_addr learned my addr 172.21.15.37:0/2874744728 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:00.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.776+0000 7f3b5099c700 1 -- 172.21.15.37:0/2874744728 >> v2:172.21.15.98:3300/0 conn(0x7f3b4c0d1140 msgr2=0x7f3b4c15ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:00.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.776+0000 7f3b5099c700 1 --2- 172.21.15.37:0/2874744728 >> v2:172.21.15.98:3300/0 conn(0x7f3b4c0d1140 0x7f3b4c15ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:00.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.776+0000 7f3b5099c700 1 -- 172.21.15.37:0/2874744728 >> v1:172.21.15.98:6789/0 conn(0x7f3b4c15fee0 legacy=0x7f3b4c0d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:00.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.776+0000 7f3b5099c700 1 -- 172.21.15.37:0/2874744728 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b4c0b2f00 con 0x7f3b4c1603b0 2023-07-14T15:57:00.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.776+0000 7f3b4b7fe700 1 --2- 172.21.15.37:0/2874744728 >> v2:172.21.15.98:3300/0 conn(0x7f3b4c0d1140 0x7f3b4c15ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:57:00.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.777+0000 7f3b5099c700 1 --2- 172.21.15.37:0/2874744728 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3b4c1603b0 0x7f3b4c0b39e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3b44009e50 tx=0x7f3b4400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f121f5d594a119b1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:00.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.777+0000 7f3b4affd700 1 -- 172.21.15.37:0/2874744728 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4400e070 con 0x7f3b4c1603b0 2023-07-14T15:57:00.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.777+0000 7f3b4affd700 1 -- 172.21.15.37:0/2874744728 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4400b910 con 0x7f3b4c1603b0 2023-07-14T15:57:00.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.777+0000 7f3b4affd700 1 -- 172.21.15.37:0/2874744728 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4400bcc0 con 0x7f3b4c1603b0 2023-07-14T15:57:00.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.777+0000 7f3b523ff700 1 -- 172.21.15.37:0/2874744728 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3b4c1603b0 msgr2=0x7f3b4c0b39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:00.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.777+0000 7f3b523ff700 1 --2- 172.21.15.37:0/2874744728 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3b4c1603b0 0x7f3b4c0b39e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3b44009e50 tx=0x7f3b4400b330 comp rx=0 tx=0).stop 2023-07-14T15:57:00.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.778+0000 7f3b523ff700 1 -- 172.21.15.37:0/2874744728 shutdown_connections 2023-07-14T15:57:00.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.778+0000 7f3b523ff700 1 --2- 172.21.15.37:0/2874744728 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3b4c1603b0 0x7f3b4c0b39e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:00.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.778+0000 7f3b523ff700 1 --2- 172.21.15.37:0/2874744728 >> v2:172.21.15.98:3300/0 conn(0x7f3b4c0d1140 0x7f3b4c15ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:00.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.778+0000 7f3b523ff700 1 -- 172.21.15.37:0/2874744728 >> 172.21.15.37:0/2874744728 conn(0x7f3b4c09c1b0 msgr2=0x7f3b4c0d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:00.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.778+0000 7f3b523ff700 1 -- 172.21.15.37:0/2874744728 shutdown_connections 2023-07-14T15:57:00.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.778+0000 7f3b523ff700 1 -- 172.21.15.37:0/2874744728 wait complete. 2023-07-14T15:57:00.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.779+0000 7f3b523ff700 1 Processor -- start 2023-07-14T15:57:00.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.780+0000 7f3b523ff700 1 -- start start 2023-07-14T15:57:00.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.781+0000 7f3b523ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b4c0d1140 0x7f3b4c14c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:00.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.781+0000 7f3b523ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3b4c15fee0 0x7f3b4c14a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:00.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.781+0000 7f3b523ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b4c1603b0 0x7f3b4c14a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:00.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.781+0000 7f3b523ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4c14d160 con 0x7f3b4c1603b0 2023-07-14T15:57:00.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.781+0000 7f3b523ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4c14ae00 con 0x7f3b4c0d1140 2023-07-14T15:57:00.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.781+0000 7f3b523ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4c14b0e0 con 0x7f3b4c15fee0 2023-07-14T15:57:00.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.781+0000 7f3b5099c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b4c1603b0 0x7f3b4c14a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:00.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.781+0000 7f3b5099c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b4c1603b0 0x7f3b4c14a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46644/0 (socket says 172.21.15.37:46644) 2023-07-14T15:57:00.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.781+0000 7f3b5099c700 1 -- 172.21.15.37:0/203653023 learned_addr learned my addr 172.21.15.37:0/203653023 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:00.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.781+0000 7f3b4bfff700 1 --2- 172.21.15.37:0/203653023 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b4c0d1140 0x7f3b4c14c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:00.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.781+0000 7f3b4b7fe700 1 --2- 172.21.15.37:0/203653023 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3b4c15fee0 0x7f3b4c14a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:00.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.781+0000 7f3b5099c700 1 -- 172.21.15.37:0/203653023 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3b4c15fee0 msgr2=0x7f3b4c14a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:00.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.781+0000 7f3b5099c700 1 --2- 172.21.15.37:0/203653023 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3b4c15fee0 0x7f3b4c14a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:00.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.781+0000 7f3b5099c700 1 -- 172.21.15.37:0/203653023 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b4c0d1140 msgr2=0x7f3b4c14c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:00.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.781+0000 7f3b5099c700 1 --2- 172.21.15.37:0/203653023 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b4c0d1140 0x7f3b4c14c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:00.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.781+0000 7f3b5099c700 1 -- 172.21.15.37:0/203653023 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b400094a0 con 0x7f3b4c1603b0 2023-07-14T15:57:00.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.782+0000 7f3b5099c700 1 --2- 172.21.15.37:0/203653023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b4c1603b0 0x7f3b4c14a7d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c08b260 tx=0x7f3b44004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:00.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.782+0000 7f3b48ff9700 1 -- 172.21.15.37:0/203653023 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b44004800 con 0x7f3b4c1603b0 2023-07-14T15:57:00.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.782+0000 7f3b48ff9700 1 -- 172.21.15.37:0/203653023 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b44004960 con 0x7f3b4c1603b0 2023-07-14T15:57:00.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.782+0000 7f3b48ff9700 1 -- 172.21.15.37:0/203653023 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4401b670 con 0x7f3b4c1603b0 2023-07-14T15:57:00.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.782+0000 7f3b523ff700 1 -- 172.21.15.37:0/203653023 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b44009b30 con 0x7f3b4c1603b0 2023-07-14T15:57:00.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.782+0000 7f3b523ff700 1 -- 172.21.15.37:0/203653023 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b4c14b6a0 con 0x7f3b4c1603b0 2023-07-14T15:57:00.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.783+0000 7f3b523ff700 1 -- 172.21.15.37:0/203653023 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b4c067840 con 0x7f3b4c1603b0 2023-07-14T15:57:00.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.784+0000 7f3b48ff9700 1 -- 172.21.15.37:0/203653023 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3b4401b7d0 con 0x7f3b4c1603b0 2023-07-14T15:57:00.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.785+0000 7f3b48ff9700 1 --2- 172.21.15.37:0/203653023 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f3b3806ace0 0x7f3b3806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:00.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.786+0000 7f3b48ff9700 1 -- 172.21.15.37:0/203653023 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3b4408ac70 con 0x7f3b4c1603b0 2023-07-14T15:57:00.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.786+0000 7f3b4bfff700 1 --2- 172.21.15.37:0/203653023 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f3b3806ace0 0x7f3b3806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:00.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.787+0000 7f3b4bfff700 1 --2- 172.21.15.37:0/203653023 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f3b3806ace0 0x7f3b3806d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c007fd0 tx=0x7f3b3c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:00.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.790+0000 7f3b48ff9700 1 -- 172.21.15.37:0/203653023 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3b44055d10 con 0x7f3b4c1603b0 2023-07-14T15:57:00.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.994+0000 7f3b523ff700 1 -- 172.21.15.37:0/203653023 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3b4c0d0bb0 con 0x7f3b4c1603b0 2023-07-14T15:57:00.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.995+0000 7f3b48ff9700 1 -- 172.21.15.37:0/203653023 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3b44059330 con 0x7f3b4c1603b0 2023-07-14T15:57:00.980 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-14T15:57:00.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.997+0000 7f3b523ff700 1 -- 172.21.15.37:0/203653023 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f3b3806ace0 msgr2=0x7f3b3806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:00.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.997+0000 7f3b523ff700 1 --2- 172.21.15.37:0/203653023 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f3b3806ace0 0x7f3b3806d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c007fd0 tx=0x7f3b3c009040 comp rx=0 tx=0).stop 2023-07-14T15:57:00.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.997+0000 7f3b523ff700 1 -- 172.21.15.37:0/203653023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b4c1603b0 msgr2=0x7f3b4c14a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:00.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.997+0000 7f3b523ff700 1 --2- 172.21.15.37:0/203653023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b4c1603b0 0x7f3b4c14a7d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c08b260 tx=0x7f3b44004ad0 comp rx=0 tx=0).stop 2023-07-14T15:57:00.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.997+0000 7f3b523ff700 1 -- 172.21.15.37:0/203653023 shutdown_connections 2023-07-14T15:57:00.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.997+0000 7f3b523ff700 1 --2- 172.21.15.37:0/203653023 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b4c0d1140 0x7f3b4c14c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:00.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.997+0000 7f3b523ff700 1 --2- 172.21.15.37:0/203653023 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f3b3806ace0 0x7f3b3806d190 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:00.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.997+0000 7f3b523ff700 1 --2- 172.21.15.37:0/203653023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b4c1603b0 0x7f3b4c14a7d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:00.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.997+0000 7f3b523ff700 1 --2- 172.21.15.37:0/203653023 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3b4c15fee0 0x7f3b4c14a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:00.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.997+0000 7f3b523ff700 1 -- 172.21.15.37:0/203653023 >> 172.21.15.37:0/203653023 conn(0x7f3b4c09c1b0 msgr2=0x7f3b4c06b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:00.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.997+0000 7f3b523ff700 1 -- 172.21.15.37:0/203653023 shutdown_connections 2023-07-14T15:57:00.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:00.997+0000 7f3b523ff700 1 -- 172.21.15.37:0/203653023 wait complete. 2023-07-14T15:57:01.000 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-14T15:57:01.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.217+0000 7fdc009ff700 1 Processor -- start 2023-07-14T15:57:01.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.217+0000 7fdc009ff700 1 -- start start 2023-07-14T15:57:01.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.218+0000 7fdc009ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdbfc0d15c0 0x7fdbfc0cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:01.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.218+0000 7fdc009ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdbfc0b0ae0 0x7fdbfc0b5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:01.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.218+0000 7fdc009ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbfc0cdb50 con 0x7fdbfc0b8900 2023-07-14T15:57:01.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.218+0000 7fdc009ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbfc15d030 con 0x7fdbfc0b0ae0 2023-07-14T15:57:01.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.218+0000 7fdc009ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc0cde30 con 0x7fdbfc0d15c0 2023-07-14T15:57:01.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.218+0000 7fdbfad9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdbfc0b0ae0 0x7fdbfc0b5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:01.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.218+0000 7fdbfad9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdbfc0b0ae0 0x7fdbfc0b5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46656/0 (socket says 172.21.15.37:46656) 2023-07-14T15:57:01.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.218+0000 7fdbfad9d700 1 -- 172.21.15.37:0/1299579940 learned_addr learned my addr 172.21.15.37:0/1299579940 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:01.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.219+0000 7fdbf3fff700 1 --2- 172.21.15.37:0/1299579940 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdbfc0d15c0 0x7fdbfc0cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:01.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.219+0000 7fdbfad9d700 1 -- 172.21.15.37:0/1299579940 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdbfc0d15c0 msgr2=0x7fdbfc0cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:01.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.219+0000 7fdbfad9d700 1 --2- 172.21.15.37:0/1299579940 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdbfc0d15c0 0x7fdbfc0cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:01.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.219+0000 7fdbfad9d700 1 -- 172.21.15.37:0/1299579940 >> v1:172.21.15.98:6789/0 conn(0x7fdbfc0b8900 legacy=0x7fdbfc0d0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:01.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.219+0000 7fdbfad9d700 1 -- 172.21.15.37:0/1299579940 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbfc0ce110 con 0x7fdbfc0b0ae0 2023-07-14T15:57:01.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.219+0000 7fdbf3fff700 1 --2- 172.21.15.37:0/1299579940 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdbfc0d15c0 0x7fdbfc0cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:57:01.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.219+0000 7fdbfad9d700 1 --2- 172.21.15.37:0/1299579940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbfc0b0ae0 0x7fdbfc0b5e00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fdbf4009e50 tx=0x7fdbf400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98de5d3079f929de server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:01.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.219+0000 7fdbf9d9b700 1 -- 172.21.15.37:0/1299579940 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf400e070 con 0x7fdbfc0b0ae0 2023-07-14T15:57:01.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.219+0000 7fdbf9d9b700 1 -- 172.21.15.37:0/1299579940 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf400b9c0 con 0x7fdbfc0b0ae0 2023-07-14T15:57:01.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.219+0000 7fdbf9d9b700 1 -- 172.21.15.37:0/1299579940 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf400bd70 con 0x7fdbfc0b0ae0 2023-07-14T15:57:01.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.220+0000 7fdc009ff700 1 -- 172.21.15.37:0/1299579940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbfc0b0ae0 msgr2=0x7fdbfc0b5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:01.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.220+0000 7fdc009ff700 1 --2- 172.21.15.37:0/1299579940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbfc0b0ae0 0x7fdbfc0b5e00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fdbf4009e50 tx=0x7fdbf400b330 comp rx=0 tx=0).stop 2023-07-14T15:57:01.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.220+0000 7fdc009ff700 1 -- 172.21.15.37:0/1299579940 shutdown_connections 2023-07-14T15:57:01.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.220+0000 7fdc009ff700 1 --2- 172.21.15.37:0/1299579940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbfc0b0ae0 0x7fdbfc0b5e00 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:01.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.220+0000 7fdc009ff700 1 --2- 172.21.15.37:0/1299579940 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdbfc0d15c0 0x7fdbfc0cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:01.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.220+0000 7fdc009ff700 1 -- 172.21.15.37:0/1299579940 >> 172.21.15.37:0/1299579940 conn(0x7fdbfc09c1e0 msgr2=0x7fdbfc0d2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:01.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.220+0000 7fdc009ff700 1 -- 172.21.15.37:0/1299579940 shutdown_connections 2023-07-14T15:57:01.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.220+0000 7fdc009ff700 1 -- 172.21.15.37:0/1299579940 wait complete. 2023-07-14T15:57:01.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.222+0000 7fdc009ff700 1 Processor -- start 2023-07-14T15:57:01.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.222+0000 7fdc009ff700 1 -- start start 2023-07-14T15:57:01.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.223+0000 7fdc009ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdbfc0b0ae0 0x7fdbfc06be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:01.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.223+0000 7fdc009ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbfc0b8900 0x7fdbfc15a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:01.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.223+0000 7fdc009ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbfc0d15c0 0x7fdbfc0cfb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:01.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.223+0000 7fdc009ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc15ddb0 con 0x7fdbfc0d15c0 2023-07-14T15:57:01.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.223+0000 7fdc009ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc15e090 con 0x7fdbfc0b8900 2023-07-14T15:57:01.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.223+0000 7fdc009ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc15a640 con 0x7fdbfc0b0ae0 2023-07-14T15:57:01.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.223+0000 7fdbfad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbfc0d15c0 0x7fdbfc0cfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:01.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.223+0000 7fdbfa59c700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdbfc0b0ae0 0x7fdbfc06be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:01.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.223+0000 7fdbfad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbfc0d15c0 0x7fdbfc0cfb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46658/0 (socket says 172.21.15.37:46658) 2023-07-14T15:57:01.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.223+0000 7fdbfad9d700 1 -- 172.21.15.37:0/4231065498 learned_addr learned my addr 172.21.15.37:0/4231065498 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:01.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.223+0000 7fdbf3fff700 1 --2- 172.21.15.37:0/4231065498 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbfc0b8900 0x7fdbfc15a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:01.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.224+0000 7fdbfad9d700 1 -- 172.21.15.37:0/4231065498 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdbfc0b0ae0 msgr2=0x7fdbfc06be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:01.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.224+0000 7fdbfad9d700 1 --2- 172.21.15.37:0/4231065498 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdbfc0b0ae0 0x7fdbfc06be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:01.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.224+0000 7fdbfad9d700 1 -- 172.21.15.37:0/4231065498 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbfc0b8900 msgr2=0x7fdbfc15a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:01.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.224+0000 7fdbfad9d700 1 --2- 172.21.15.37:0/4231065498 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbfc0b8900 0x7fdbfc15a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:01.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.224+0000 7fdbfad9d700 1 -- 172.21.15.37:0/4231065498 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf4009b30 con 0x7fdbfc0d15c0 2023-07-14T15:57:01.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.224+0000 7fdbfad9d700 1 --2- 172.21.15.37:0/4231065498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbfc0d15c0 0x7fdbfc0cfb20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc066bb0 tx=0x7fdbf4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:01.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.224+0000 7fdbf2ffd700 1 -- 172.21.15.37:0/4231065498 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf4004800 con 0x7fdbfc0d15c0 2023-07-14T15:57:01.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.224+0000 7fdbf2ffd700 1 -- 172.21.15.37:0/4231065498 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf4004960 con 0x7fdbfc0d15c0 2023-07-14T15:57:01.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.224+0000 7fdbf2ffd700 1 -- 172.21.15.37:0/4231065498 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf401c680 con 0x7fdbfc0d15c0 2023-07-14T15:57:01.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.224+0000 7fdc009ff700 1 -- 172.21.15.37:0/4231065498 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbfc15d170 con 0x7fdbfc0d15c0 2023-07-14T15:57:01.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.224+0000 7fdc009ff700 1 -- 172.21.15.37:0/4231065498 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbfc15d410 con 0x7fdbfc0d15c0 2023-07-14T15:57:01.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.225+0000 7fdc009ff700 1 -- 172.21.15.37:0/4231065498 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbfc15def0 con 0x7fdbfc0d15c0 2023-07-14T15:57:01.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.226+0000 7fdbf2ffd700 1 -- 172.21.15.37:0/4231065498 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdbf401c7e0 con 0x7fdbfc0d15c0 2023-07-14T15:57:01.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.227+0000 7fdbf2ffd700 1 --2- 172.21.15.37:0/4231065498 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fdbdc06ace0 0x7fdbdc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:01.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.227+0000 7fdbf2ffd700 1 -- 172.21.15.37:0/4231065498 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdbf408afe0 con 0x7fdbfc0d15c0 2023-07-14T15:57:01.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.228+0000 7fdbfa59c700 1 --2- 172.21.15.37:0/4231065498 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fdbdc06ace0 0x7fdbdc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:01.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.228+0000 7fdbfa59c700 1 --2- 172.21.15.37:0/4231065498 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fdbdc06ace0 0x7fdbdc06d190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdbec000fb0 tx=0x7fdbec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:01.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.232+0000 7fdbf2ffd700 1 -- 172.21.15.37:0/4231065498 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fdbfc15def0 con 0x7fdbfc0d15c0 2023-07-14T15:57:01.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.456+0000 7fdc009ff700 1 -- 172.21.15.37:0/4231065498 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdbfc15def0 con 0x7fdbfc0d15c0 2023-07-14T15:57:01.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.457+0000 7fdbf2ffd700 1 -- 172.21.15.37:0/4231065498 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7fdbfc15def0 con 0x7fdbfc0d15c0 2023-07-14T15:57:01.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.459+0000 7fdc009ff700 1 -- 172.21.15.37:0/4231065498 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fdbdc06ace0 msgr2=0x7fdbdc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:01.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.459+0000 7fdc009ff700 1 --2- 172.21.15.37:0/4231065498 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fdbdc06ace0 0x7fdbdc06d190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdbec000fb0 tx=0x7fdbec009040 comp rx=0 tx=0).stop 2023-07-14T15:57:01.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.459+0000 7fdc009ff700 1 -- 172.21.15.37:0/4231065498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbfc0d15c0 msgr2=0x7fdbfc0cfb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:01.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.459+0000 7fdc009ff700 1 --2- 172.21.15.37:0/4231065498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbfc0d15c0 0x7fdbfc0cfb20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc066bb0 tx=0x7fdbf4004ad0 comp rx=0 tx=0).stop 2023-07-14T15:57:01.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.459+0000 7fdc009ff700 1 -- 172.21.15.37:0/4231065498 shutdown_connections 2023-07-14T15:57:01.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.459+0000 7fdc009ff700 1 --2- 172.21.15.37:0/4231065498 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fdbdc06ace0 0x7fdbdc06d190 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:01.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.459+0000 7fdc009ff700 1 --2- 172.21.15.37:0/4231065498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbfc0d15c0 0x7fdbfc0cfb20 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:01.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.459+0000 7fdc009ff700 1 --2- 172.21.15.37:0/4231065498 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdbfc0b0ae0 0x7fdbfc06be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:01.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.459+0000 7fdc009ff700 1 --2- 172.21.15.37:0/4231065498 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbfc0b8900 0x7fdbfc15a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:01.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.459+0000 7fdc009ff700 1 -- 172.21.15.37:0/4231065498 >> 172.21.15.37:0/4231065498 conn(0x7fdbfc09c1e0 msgr2=0x7fdbfc0cc000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:01.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.459+0000 7fdc009ff700 1 -- 172.21.15.37:0/4231065498 shutdown_connections 2023-07-14T15:57:01.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:01.459+0000 7fdc009ff700 1 -- 172.21.15.37:0/4231065498 wait complete. 2023-07-14T15:57:01.447 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2023-07-14T15:57:01.463 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-14T15:57:01.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:57:01.465 DEBUG:teuthology.orchestra.run.smithi098:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-07-14T15:57:01.572 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi098.front.sepia.ceph.com 2023-07-14T15:57:01.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:57:01.574 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-14T15:57:01.633 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-14T15:57:01.633 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T15:57:01.677 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-14T15:57:01.677 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T15:57:01.761 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-14T15:57:01.762 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T15:57:01.845 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T15:57:02.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.101+0000 7fd3d11ff700 1 Processor -- start 2023-07-14T15:57:02.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.101+0000 7fd3d11ff700 1 -- start start 2023-07-14T15:57:02.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.102+0000 7fd3d11ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd3cc0b85f0 0x7fd3cc15d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:02.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.102+0000 7fd3d11ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd3cc0b54b0 0x7fd3cc0cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:02.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.102+0000 7fd3d11ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd3cc0b4910 0x7fd3cc0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:02.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.102+0000 7fd3d11ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3cc0b52d0 con 0x7fd3cc0b4910 2023-07-14T15:57:02.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.102+0000 7fd3d11ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3cc0cf6b0 con 0x7fd3cc0b54b0 2023-07-14T15:57:02.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.102+0000 7fd3d11ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc0cdc40 con 0x7fd3cc0b85f0 2023-07-14T15:57:02.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.102+0000 7fd3cb59e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd3cc0b4910 0x7fd3cc0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:02.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.102+0000 7fd3cb59e700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd3cc0b4910 0x7fd3cc0b4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46662/0 (socket says 172.21.15.37:46662) 2023-07-14T15:57:02.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.102+0000 7fd3cb59e700 1 -- 172.21.15.37:0/2995267634 learned_addr learned my addr 172.21.15.37:0/2995267634 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:02.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.102+0000 7fd3ca59c700 1 --2- 172.21.15.37:0/2995267634 >> v2:172.21.15.98:3300/0 conn(0x7fd3cc0b54b0 0x7fd3cc0cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:02.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.102+0000 7fd3cad9d700 1 --2- 172.21.15.37:0/2995267634 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd3cc0b85f0 0x7fd3cc15d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:02.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.103+0000 7fd3cb59e700 1 -- 172.21.15.37:0/2995267634 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd3cc0b85f0 msgr2=0x7fd3cc15d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:02.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.103+0000 7fd3cb59e700 1 --2- 172.21.15.37:0/2995267634 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd3cc0b85f0 0x7fd3cc15d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:02.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.103+0000 7fd3cb59e700 1 -- 172.21.15.37:0/2995267634 >> v2:172.21.15.98:3300/0 conn(0x7fd3cc0b54b0 msgr2=0x7fd3cc0cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:02.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.103+0000 7fd3cb59e700 1 --2- 172.21.15.37:0/2995267634 >> v2:172.21.15.98:3300/0 conn(0x7fd3cc0b54b0 0x7fd3cc0cfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:02.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.103+0000 7fd3cb59e700 1 -- 172.21.15.37:0/2995267634 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3cc15dba0 con 0x7fd3cc0b4910 2023-07-14T15:57:02.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.103+0000 7fd3cb59e700 1 --2- 172.21.15.37:0/2995267634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3cc0b4910 0x7fd3cc0b4d90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc06bb10 tx=0x7fd3c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d766640da8cf837c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:02.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.103+0000 7fd3c9d9b700 1 -- 172.21.15.37:0/2995267634 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c400e070 con 0x7fd3cc0b4910 2023-07-14T15:57:02.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.104+0000 7fd3c9d9b700 1 -- 172.21.15.37:0/2995267634 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c400b910 con 0x7fd3cc0b4910 2023-07-14T15:57:02.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.104+0000 7fd3c9d9b700 1 -- 172.21.15.37:0/2995267634 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c400bcc0 con 0x7fd3cc0b4910 2023-07-14T15:57:02.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.104+0000 7fd3d11ff700 1 -- 172.21.15.37:0/2995267634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3cc0b4910 msgr2=0x7fd3cc0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:02.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.104+0000 7fd3d11ff700 1 --2- 172.21.15.37:0/2995267634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3cc0b4910 0x7fd3cc0b4d90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc06bb10 tx=0x7fd3c400b330 comp rx=0 tx=0).stop 2023-07-14T15:57:02.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.104+0000 7fd3d11ff700 1 -- 172.21.15.37:0/2995267634 shutdown_connections 2023-07-14T15:57:02.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.104+0000 7fd3d11ff700 1 --2- 172.21.15.37:0/2995267634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3cc0b4910 0x7fd3cc0b4d90 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:02.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.104+0000 7fd3d11ff700 1 --2- 172.21.15.37:0/2995267634 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd3cc0b85f0 0x7fd3cc15d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:02.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.104+0000 7fd3d11ff700 1 --2- 172.21.15.37:0/2995267634 >> v2:172.21.15.98:3300/0 conn(0x7fd3cc0b54b0 0x7fd3cc0cfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:02.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.104+0000 7fd3d11ff700 1 -- 172.21.15.37:0/2995267634 >> 172.21.15.37:0/2995267634 conn(0x7fd3cc06a580 msgr2=0x7fd3cc06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:02.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.104+0000 7fd3d11ff700 1 -- 172.21.15.37:0/2995267634 shutdown_connections 2023-07-14T15:57:02.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.104+0000 7fd3d11ff700 1 -- 172.21.15.37:0/2995267634 wait complete. 2023-07-14T15:57:02.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.106+0000 7fd3d11ff700 1 Processor -- start 2023-07-14T15:57:02.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.106+0000 7fd3d11ff700 1 -- start start 2023-07-14T15:57:02.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.107+0000 7fd3d11ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3cc0b4910 0x7fd3cc1f15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:02.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.107+0000 7fd3d11ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3cc0b54b0 0x7fd3cc14a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:02.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.107+0000 7fd3d11ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd3cc0b85f0 0x7fd3cc14c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:02.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.107+0000 7fd3d11ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc148f80 con 0x7fd3cc0b4910 2023-07-14T15:57:02.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.107+0000 7fd3d11ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc14f5c0 con 0x7fd3cc0b54b0 2023-07-14T15:57:02.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.107+0000 7fd3d11ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc149790 con 0x7fd3cc0b85f0 2023-07-14T15:57:02.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.107+0000 7fd3cad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3cc0b4910 0x7fd3cc1f15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:02.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.107+0000 7fd3cad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3cc0b4910 0x7fd3cc1f15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46668/0 (socket says 172.21.15.37:46668) 2023-07-14T15:57:02.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.107+0000 7fd3cad9d700 1 -- 172.21.15.37:0/2968056251 learned_addr learned my addr 172.21.15.37:0/2968056251 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:02.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.108+0000 7fd3cad9d700 1 -- 172.21.15.37:0/2968056251 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd3cc0b85f0 msgr2=0x7fd3cc14c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:02.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.108+0000 7fd3cad9d700 1 --2- 172.21.15.37:0/2968056251 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd3cc0b85f0 0x7fd3cc14c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:02.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.108+0000 7fd3cad9d700 1 -- 172.21.15.37:0/2968056251 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3cc0b54b0 msgr2=0x7fd3cc14a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:02.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.108+0000 7fd3cad9d700 1 --2- 172.21.15.37:0/2968056251 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3cc0b54b0 0x7fd3cc14a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:02.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.108+0000 7fd3cad9d700 1 -- 172.21.15.37:0/2968056251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c4009b30 con 0x7fd3cc0b4910 2023-07-14T15:57:02.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.108+0000 7fd3cad9d700 1 --2- 172.21.15.37:0/2968056251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3cc0b4910 0x7fd3cc1f15f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc00e9b0 tx=0x7fd3bc00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:02.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.108+0000 7fd3b37fe700 1 -- 172.21.15.37:0/2968056251 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc00c850 con 0x7fd3cc0b4910 2023-07-14T15:57:02.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.108+0000 7fd3b37fe700 1 -- 172.21.15.37:0/2968056251 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3bc00c9b0 con 0x7fd3cc0b4910 2023-07-14T15:57:02.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.108+0000 7fd3b37fe700 1 -- 172.21.15.37:0/2968056251 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc00cd20 con 0x7fd3cc0b4910 2023-07-14T15:57:02.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.108+0000 7fd3d11ff700 1 -- 172.21.15.37:0/2968056251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3cc149a70 con 0x7fd3cc0b4910 2023-07-14T15:57:02.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.108+0000 7fd3d11ff700 1 -- 172.21.15.37:0/2968056251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3cc14a030 con 0x7fd3cc0b4910 2023-07-14T15:57:02.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.109+0000 7fd3d11ff700 1 -- 172.21.15.37:0/2968056251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3cc067840 con 0x7fd3cc0b4910 2023-07-14T15:57:02.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.110+0000 7fd3b37fe700 1 -- 172.21.15.37:0/2968056251 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd3bc013470 con 0x7fd3cc0b4910 2023-07-14T15:57:02.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.111+0000 7fd3b37fe700 1 --2- 172.21.15.37:0/2968056251 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd3b806ace0 0x7fd3b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:02.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.111+0000 7fd3b37fe700 1 -- 172.21.15.37:0/2968056251 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd3bc089680 con 0x7fd3cc0b4910 2023-07-14T15:57:02.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.112+0000 7fd3ca59c700 1 --2- 172.21.15.37:0/2968056251 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd3b806ace0 0x7fd3b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:02.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.112+0000 7fd3ca59c700 1 --2- 172.21.15.37:0/2968056251 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd3b806ace0 0x7fd3b806d190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc0d19c0 tx=0x7fd3c00095a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:02.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.115+0000 7fd3b37fe700 1 -- 172.21.15.37:0/2968056251 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd3bc054690 con 0x7fd3cc0b4910 2023-07-14T15:57:02.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.325+0000 7fd3d11ff700 1 -- 172.21.15.37:0/2968056251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3cc06b440 con 0x7fd3cc0b4910 2023-07-14T15:57:02.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.327+0000 7fd3b37fe700 1 -- 172.21.15.37:0/2968056251 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18341 (secure 0 0 0) 0x7fd3bc057cb0 con 0x7fd3cc0b4910 2023-07-14T15:57:02.312 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:57:02.312 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"fsid":"9da30401-a779-4e46-aba6-00c2494c6c67","created":"2023-07-14T15:55:39.898867+0000","modified":"2023-07-14T15:56:09.959850+0000","last_up_change":"2023-07-14T15:55:53.025696+0000","last_in_change":"2023-07-14T15:55:43.388192+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T15:55:52.907261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T15:55:59.992839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T15:56:06.091064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T15:56:07.448694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d049535-7b87-4276-8fe5-0f74ba422d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6801","nonce":2783032392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6803","nonce":2783032392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6807","nonce":2783032392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6805","nonce":2783032392}]},"public_addr":"172.21.15.37:6801/2783032392","cluster_addr":"172.21.15.37:6803/2783032392","heartbeat_back_addr":"172.21.15.37:6807/2783032392","heartbeat_front_addr":"172.21.15.37:6805/2783032392","state":["exists","up"]},{"osd":1,"uuid":"79ec948d-ead2-4c2d-923a-dd6eeaac9dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6823","nonce":1190059746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6826","nonce":1190059746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6831","nonce":1190059746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6829","nonce":1190059746}]},"public_addr":"172.21.15.37:6823/1190059746","cluster_addr":"172.21.15.37:6826/1190059746","heartbeat_back_addr":"172.21.15.37:6831/1190059746","heartbeat_front_addr":"172.21.15.37:6829/1190059746","state":["exists","up"]},{"osd":2,"uuid":"a1db6690-c160-4366-9c82-2cca17e4bba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6809","nonce":2266223499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6813","nonce":2266223499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6820","nonce":2266223499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6816","nonce":2266223499}]},"public_addr":"172.21.15.37:6809/2266223499","cluster_addr":"172.21.15.37:6813/2266223499","heartbeat_back_addr":"172.21.15.37:6820/2266223499","heartbeat_front_addr":"172.21.15.37:6816/2266223499","state":["exists","up"]},{"osd":3,"uuid":"767b8220-e79a-4a86-a162-6b3b73198379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6812","nonce":4166694594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6817","nonce":4166694594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6828","nonce":4166694594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6822","nonce":4166694594}]},"public_addr":"172.21.15.37:6812/4166694594","cluster_addr":"172.21.15.37:6817/4166694594","heartbeat_back_addr":"172.21.15.37:6828/4166694594","heartbeat_front_addr":"172.21.15.37:6822/4166694594","state":["exists","up"]},{"osd":4,"uuid":"717bd773-ae7e-4236-ac79-900cf99a37c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6801","nonce":3529020407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6803","nonce":3529020407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6807","nonce":3529020407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6805","nonce":3529020407}]},"public_addr":"172.21.15.98:6801/3529020407","cluster_addr":"172.21.15.98:6803/3529020407","heartbeat_back_addr":"172.21.15.98:6807/3529020407","heartbeat_front_addr":"172.21.15.98:6805/3529020407","state":["exists","up"]},{"osd":5,"uuid":"a941d358-0f03-4136-a9b2-3a1c2e9358cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6817","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6819","nonce":2311501838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6821","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6823","nonce":2311501838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6829","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6831","nonce":2311501838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6825","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6827","nonce":2311501838}]},"public_addr":"172.21.15.98:6819/2311501838","cluster_addr":"172.21.15.98:6823/2311501838","heartbeat_back_addr":"172.21.15.98:6831/2311501838","heartbeat_front_addr":"172.21.15.98:6827/2311501838","state":["exists","up"]},{"osd":6,"uuid":"27153772-6d4b-479d-9953-0582e7b96743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6809","nonce":1144224691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6811","nonce":1144224691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6815","nonce":1144224691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6813","nonce":1144224691}]},"public_addr":"172.21.15.98:6809/1144224691","cluster_addr":"172.21.15.98:6811/1144224691","heartbeat_back_addr":"172.21.15.98:6815/1144224691","heartbeat_front_addr":"172.21.15.98:6813/1144224691","state":["exists","up"]},{"osd":7,"uuid":"d21ffc8e-40bb-47eb-af2c-e3e730d3fb76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6818","nonce":1144470927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6822","nonce":1144470927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6830","nonce":1144470927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6826","nonce":1144470927}]},"public_addr":"172.21.15.98:6818/1144470927","cluster_addr":"172.21.15.98:6822/1144470927","heartbeat_back_addr":"172.21.15.98:6830/1144470927","heartbeat_front_addr":"172.21.15.98:6826/1144470927","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.921114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.739210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.024016+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.002527+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.698127+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.813416+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.709351+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.815457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T15:57:02.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.329+0000 7fd3d11ff700 1 -- 172.21.15.37:0/2968056251 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd3b806ace0 msgr2=0x7fd3b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:02.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.329+0000 7fd3d11ff700 1 --2- 172.21.15.37:0/2968056251 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd3b806ace0 0x7fd3b806d190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc0d19c0 tx=0x7fd3c00095a0 comp rx=0 tx=0).stop 2023-07-14T15:57:02.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.329+0000 7fd3d11ff700 1 -- 172.21.15.37:0/2968056251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3cc0b4910 msgr2=0x7fd3cc1f15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:02.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.329+0000 7fd3d11ff700 1 --2- 172.21.15.37:0/2968056251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3cc0b4910 0x7fd3cc1f15f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc00e9b0 tx=0x7fd3bc00ed70 comp rx=0 tx=0).stop 2023-07-14T15:57:02.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.329+0000 7fd3d11ff700 1 -- 172.21.15.37:0/2968056251 shutdown_connections 2023-07-14T15:57:02.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.329+0000 7fd3d11ff700 1 --2- 172.21.15.37:0/2968056251 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd3b806ace0 0x7fd3b806d190 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:02.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.329+0000 7fd3d11ff700 1 --2- 172.21.15.37:0/2968056251 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd3cc0b85f0 0x7fd3cc14c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:02.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.329+0000 7fd3d11ff700 1 --2- 172.21.15.37:0/2968056251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3cc0b4910 0x7fd3cc1f15f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:02.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.329+0000 7fd3d11ff700 1 --2- 172.21.15.37:0/2968056251 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3cc0b54b0 0x7fd3cc14a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:02.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.329+0000 7fd3d11ff700 1 -- 172.21.15.37:0/2968056251 >> 172.21.15.37:0/2968056251 conn(0x7fd3cc06a580 msgr2=0x7fd3cc15cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:02.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.329+0000 7fd3d11ff700 1 -- 172.21.15.37:0/2968056251 shutdown_connections 2023-07-14T15:57:02.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.329+0000 7fd3d11ff700 1 -- 172.21.15.37:0/2968056251 wait complete. 2023-07-14T15:57:02.332 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T15:55:52.907261+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T15:55:59.992839+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T15:56:06.091064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T15:56:07.448694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T15:57:02.333 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T15:57:02.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.552+0000 7f76271ff700 1 Processor -- start 2023-07-14T15:57:02.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.552+0000 7f76271ff700 1 -- start start 2023-07-14T15:57:02.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.553+0000 7f76271ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f76200d1140 0x7f762015ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:02.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.553+0000 7f76271ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f76201603b0 0x7f76200b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:02.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.553+0000 7f76271ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f762015dc50 con 0x7f762015fee0 2023-07-14T15:57:02.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.553+0000 7f76271ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76200b2940 con 0x7f76201603b0 2023-07-14T15:57:02.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.553+0000 7f76271ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76200b2c20 con 0x7f76200d1140 2023-07-14T15:57:02.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.553+0000 7f762579c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f76201603b0 0x7f76200b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:02.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.553+0000 7f762579c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f76201603b0 0x7f76200b39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46678/0 (socket says 172.21.15.37:46678) 2023-07-14T15:57:02.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.553+0000 7f762579c700 1 -- 172.21.15.37:0/1671585834 learned_addr learned my addr 172.21.15.37:0/1671585834 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:02.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.553+0000 7f761ffff700 1 --2- 172.21.15.37:0/1671585834 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f76200d1140 0x7f762015ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:02.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.554+0000 7f762579c700 1 -- 172.21.15.37:0/1671585834 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f76200d1140 msgr2=0x7f762015ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:02.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.554+0000 7f762579c700 1 --2- 172.21.15.37:0/1671585834 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f76200d1140 0x7f762015ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:02.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.554+0000 7f762579c700 1 -- 172.21.15.37:0/1671585834 >> v1:172.21.15.98:6789/0 conn(0x7f762015fee0 legacy=0x7f76200d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:02.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.554+0000 7f762579c700 1 -- 172.21.15.37:0/1671585834 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76200b2f00 con 0x7f76201603b0 2023-07-14T15:57:02.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.554+0000 7f762579c700 1 --2- 172.21.15.37:0/1671585834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76201603b0 0x7f76200b39e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7618009e50 tx=0x7f761800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce94eab9eb2c6c28 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:02.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.554+0000 7f761f7fe700 1 -- 172.21.15.37:0/1671585834 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f761800e070 con 0x7f76201603b0 2023-07-14T15:57:02.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.554+0000 7f761f7fe700 1 -- 172.21.15.37:0/1671585834 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f761800b910 con 0x7f76201603b0 2023-07-14T15:57:02.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.554+0000 7f761f7fe700 1 -- 172.21.15.37:0/1671585834 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f761800bcc0 con 0x7f76201603b0 2023-07-14T15:57:02.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.555+0000 7f76271ff700 1 -- 172.21.15.37:0/1671585834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76201603b0 msgr2=0x7f76200b39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:02.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.555+0000 7f76271ff700 1 --2- 172.21.15.37:0/1671585834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76201603b0 0x7f76200b39e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7618009e50 tx=0x7f761800b330 comp rx=0 tx=0).stop 2023-07-14T15:57:02.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.555+0000 7f76271ff700 1 -- 172.21.15.37:0/1671585834 shutdown_connections 2023-07-14T15:57:02.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.555+0000 7f76271ff700 1 --2- 172.21.15.37:0/1671585834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76201603b0 0x7f76200b39e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:02.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.555+0000 7f76271ff700 1 --2- 172.21.15.37:0/1671585834 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f76200d1140 0x7f762015ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:02.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.555+0000 7f76271ff700 1 -- 172.21.15.37:0/1671585834 >> 172.21.15.37:0/1671585834 conn(0x7f762009c1b0 msgr2=0x7f76200d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:02.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.555+0000 7f76271ff700 1 -- 172.21.15.37:0/1671585834 shutdown_connections 2023-07-14T15:57:02.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.555+0000 7f76271ff700 1 -- 172.21.15.37:0/1671585834 wait complete. 2023-07-14T15:57:02.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.557+0000 7f76271ff700 1 Processor -- start 2023-07-14T15:57:02.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.557+0000 7f76271ff700 1 -- start start 2023-07-14T15:57:02.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.558+0000 7f76271ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f76200d1140 0x7f76200b8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:02.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.558+0000 7f76271ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f762015fee0 0x7f7620149de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:02.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.558+0000 7f76271ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76201603b0 0x7f76200b6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:02.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.558+0000 7f76271ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7620147f50 con 0x7f76201603b0 2023-07-14T15:57:02.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.558+0000 7f76271ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76200b82d0 con 0x7f762015fee0 2023-07-14T15:57:02.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.558+0000 7f76271ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f762014a4b0 con 0x7f76200d1140 2023-07-14T15:57:02.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.558+0000 7f762579c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76201603b0 0x7f76200b6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:02.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.558+0000 7f762579c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76201603b0 0x7f76200b6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46692/0 (socket says 172.21.15.37:46692) 2023-07-14T15:57:02.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.558+0000 7f762579c700 1 -- 172.21.15.37:0/782896922 learned_addr learned my addr 172.21.15.37:0/782896922 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:02.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.558+0000 7f7624f9b700 1 --2- 172.21.15.37:0/782896922 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f76200d1140 0x7f76200b8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:02.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.558+0000 7f761ffff700 1 --2- 172.21.15.37:0/782896922 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f762015fee0 0x7f7620149de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:02.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.559+0000 7f762579c700 1 -- 172.21.15.37:0/782896922 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f76200d1140 msgr2=0x7f76200b8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:02.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.559+0000 7f762579c700 1 --2- 172.21.15.37:0/782896922 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f76200d1140 0x7f76200b8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:02.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.559+0000 7f762579c700 1 -- 172.21.15.37:0/782896922 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f762015fee0 msgr2=0x7f7620149de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:02.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.559+0000 7f762579c700 1 --2- 172.21.15.37:0/782896922 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f762015fee0 0x7f7620149de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:02.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.559+0000 7f762579c700 1 -- 172.21.15.37:0/782896922 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7618009b30 con 0x7f76201603b0 2023-07-14T15:57:02.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.559+0000 7f7624f9b700 1 --2- 172.21.15.37:0/782896922 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f76200d1140 0x7f76200b8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:57:02.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.559+0000 7f762579c700 1 --2- 172.21.15.37:0/782896922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76201603b0 0x7f76200b6460 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f762008b260 tx=0x7f7618004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:02.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.559+0000 7f761d7fa700 1 -- 172.21.15.37:0/782896922 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76180048b0 con 0x7f76201603b0 2023-07-14T15:57:02.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.559+0000 7f761d7fa700 1 -- 172.21.15.37:0/782896922 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76180099b0 con 0x7f76201603b0 2023-07-14T15:57:02.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.559+0000 7f76271ff700 1 -- 172.21.15.37:0/782896922 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f762014a790 con 0x7f76201603b0 2023-07-14T15:57:02.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.559+0000 7f761d7fa700 1 -- 172.21.15.37:0/782896922 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f761801c680 con 0x7f76201603b0 2023-07-14T15:57:02.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.559+0000 7f76271ff700 1 -- 172.21.15.37:0/782896922 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f762014ad50 con 0x7f76201603b0 2023-07-14T15:57:02.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.560+0000 7f76271ff700 1 -- 172.21.15.37:0/782896922 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7620067840 con 0x7f76201603b0 2023-07-14T15:57:02.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.561+0000 7f761d7fa700 1 -- 172.21.15.37:0/782896922 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f761801c7e0 con 0x7f76201603b0 2023-07-14T15:57:02.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.563+0000 7f761d7fa700 1 --2- 172.21.15.37:0/782896922 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f760406ace0 0x7f760406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:02.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.563+0000 7f761d7fa700 1 -- 172.21.15.37:0/782896922 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f761808b0b0 con 0x7f76201603b0 2023-07-14T15:57:02.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.564+0000 7f7624f9b700 1 --2- 172.21.15.37:0/782896922 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f760406ace0 0x7f760406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:02.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.564+0000 7f7624f9b700 1 --2- 172.21.15.37:0/782896922 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f760406ace0 0x7f760406d190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7614000f60 tx=0x7f7614009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:02.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.567+0000 7f761d7fa700 1 -- 172.21.15.37:0/782896922 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f76180561f0 con 0x7f76201603b0 2023-07-14T15:57:02.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.776+0000 7f76271ff700 1 -- 172.21.15.37:0/782896922 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f762006a720 con 0x7f76201603b0 2023-07-14T15:57:02.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.776+0000 7f761d7fa700 1 -- 172.21.15.37:0/782896922 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7618059810 con 0x7f76201603b0 2023-07-14T15:57:02.762 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-14T15:57:02.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.778+0000 7f76271ff700 1 -- 172.21.15.37:0/782896922 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f760406ace0 msgr2=0x7f760406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:02.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.778+0000 7f76271ff700 1 --2- 172.21.15.37:0/782896922 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f760406ace0 0x7f760406d190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7614000f60 tx=0x7f7614009040 comp rx=0 tx=0).stop 2023-07-14T15:57:02.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.778+0000 7f76271ff700 1 -- 172.21.15.37:0/782896922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76201603b0 msgr2=0x7f76200b6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:02.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.778+0000 7f76271ff700 1 --2- 172.21.15.37:0/782896922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76201603b0 0x7f76200b6460 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f762008b260 tx=0x7f7618004ad0 comp rx=0 tx=0).stop 2023-07-14T15:57:02.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.779+0000 7f76271ff700 1 -- 172.21.15.37:0/782896922 shutdown_connections 2023-07-14T15:57:02.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.779+0000 7f76271ff700 1 --2- 172.21.15.37:0/782896922 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f760406ace0 0x7f760406d190 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:02.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.779+0000 7f76271ff700 1 --2- 172.21.15.37:0/782896922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76201603b0 0x7f76200b6460 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:02.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.779+0000 7f76271ff700 1 --2- 172.21.15.37:0/782896922 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f76200d1140 0x7f76200b8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:02.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.779+0000 7f76271ff700 1 --2- 172.21.15.37:0/782896922 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f762015fee0 0x7f7620149de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:02.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.779+0000 7f76271ff700 1 -- 172.21.15.37:0/782896922 >> 172.21.15.37:0/782896922 conn(0x7f762009c1b0 msgr2=0x7f76200d1560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:02.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.779+0000 7f76271ff700 1 -- 172.21.15.37:0/782896922 shutdown_connections 2023-07-14T15:57:02.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:02.779+0000 7f76271ff700 1 -- 172.21.15.37:0/782896922 wait complete. 2023-07-14T15:57:02.781 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T15:57:02.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.001+0000 7fe6129ff700 1 Processor -- start 2023-07-14T15:57:02.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.001+0000 7fe6129ff700 1 -- start start 2023-07-14T15:57:02.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.002+0000 7fe6129ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe60c0cfd50 0x7fe60c0d2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:02.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.002+0000 7fe6129ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe60c0b1e80 0x7fe60c0b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:02.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.002+0000 7fe6129ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe60c0b3290 0x7fe60c0b3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:02.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.002+0000 7fe6129ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe60c15ccf0 con 0x7fe60c0b1e80 2023-07-14T15:57:02.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.002+0000 7fe6129ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe60c0b1840 con 0x7fe60c0cfd50 2023-07-14T15:57:02.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.002+0000 7fe6129ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe60c0b2550 con 0x7fe60c0b3290 2023-07-14T15:57:02.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.002+0000 7fe60b7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe60c0b1e80 0x7fe60c0b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:02.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.002+0000 7fe60b7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe60c0b1e80 0x7fe60c0b2d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46700/0 (socket says 172.21.15.37:46700) 2023-07-14T15:57:02.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.002+0000 7fe60b7fe700 1 -- 172.21.15.37:0/4116635721 learned_addr learned my addr 172.21.15.37:0/4116635721 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:02.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.003+0000 7fe60bfff700 1 --2- 172.21.15.37:0/4116635721 >> v2:172.21.15.98:3300/0 conn(0x7fe60c0cfd50 0x7fe60c0d2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:02.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.003+0000 7fe610f9c700 1 --2- 172.21.15.37:0/4116635721 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe60c0b3290 0x7fe60c0b3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:02.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.003+0000 7fe60b7fe700 1 -- 172.21.15.37:0/4116635721 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe60c0b3290 msgr2=0x7fe60c0b3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:02.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.003+0000 7fe60b7fe700 1 --2- 172.21.15.37:0/4116635721 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe60c0b3290 0x7fe60c0b3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:02.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.003+0000 7fe60b7fe700 1 -- 172.21.15.37:0/4116635721 >> v2:172.21.15.98:3300/0 conn(0x7fe60c0cfd50 msgr2=0x7fe60c0d2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:02.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.003+0000 7fe60b7fe700 1 --2- 172.21.15.37:0/4116635721 >> v2:172.21.15.98:3300/0 conn(0x7fe60c0cfd50 0x7fe60c0d2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:02.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.003+0000 7fe60b7fe700 1 -- 172.21.15.37:0/4116635721 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe60c0b2830 con 0x7fe60c0b1e80 2023-07-14T15:57:02.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.003+0000 7fe60b7fe700 1 --2- 172.21.15.37:0/4116635721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe60c0b1e80 0x7fe60c0b2d50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe60c08b170 tx=0x7fe600009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=377e2934198e4140 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:02.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.003+0000 7fe60affd700 1 -- 172.21.15.37:0/4116635721 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe600011830 con 0x7fe60c0b1e80 2023-07-14T15:57:02.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.004+0000 7fe60affd700 1 -- 172.21.15.37:0/4116635721 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe600011990 con 0x7fe60c0b1e80 2023-07-14T15:57:02.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.004+0000 7fe60affd700 1 -- 172.21.15.37:0/4116635721 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe600011d20 con 0x7fe60c0b1e80 2023-07-14T15:57:02.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.004+0000 7fe6129ff700 1 -- 172.21.15.37:0/4116635721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe60c0b1e80 msgr2=0x7fe60c0b2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:02.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.004+0000 7fe6129ff700 1 --2- 172.21.15.37:0/4116635721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe60c0b1e80 0x7fe60c0b2d50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe60c08b170 tx=0x7fe600009bd0 comp rx=0 tx=0).stop 2023-07-14T15:57:02.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.004+0000 7fe6129ff700 1 -- 172.21.15.37:0/4116635721 shutdown_connections 2023-07-14T15:57:02.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.004+0000 7fe6129ff700 1 --2- 172.21.15.37:0/4116635721 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe60c0b3290 0x7fe60c0b3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:02.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.004+0000 7fe6129ff700 1 --2- 172.21.15.37:0/4116635721 >> v2:172.21.15.98:3300/0 conn(0x7fe60c0cfd50 0x7fe60c0d2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:02.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.004+0000 7fe6129ff700 1 --2- 172.21.15.37:0/4116635721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe60c0b1e80 0x7fe60c0b2d50 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:02.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.004+0000 7fe6129ff700 1 -- 172.21.15.37:0/4116635721 >> 172.21.15.37:0/4116635721 conn(0x7fe60c09c1c0 msgr2=0x7fe60c0d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:02.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.004+0000 7fe6129ff700 1 -- 172.21.15.37:0/4116635721 shutdown_connections 2023-07-14T15:57:02.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.004+0000 7fe6129ff700 1 -- 172.21.15.37:0/4116635721 wait complete. 2023-07-14T15:57:02.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.006+0000 7fe6129ff700 1 Processor -- start 2023-07-14T15:57:02.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.006+0000 7fe6129ff700 1 -- start start 2023-07-14T15:57:03.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.007+0000 7fe6129ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe60c0b1e80 0x7fe60c1f1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:03.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.007+0000 7fe6129ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe60c0b3290 0x7fe60c1e4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:03.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.007+0000 7fe6129ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe60c0cfd50 0x7fe60c1583d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:03.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.007+0000 7fe6129ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60c0c6960 con 0x7fe60c0cfd50 2023-07-14T15:57:03.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.007+0000 7fe6129ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60c0c74e0 con 0x7fe60c0b1e80 2023-07-14T15:57:03.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.007+0000 7fe6129ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe60c0c6bb0 con 0x7fe60c0b3290 2023-07-14T15:57:03.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.007+0000 7fe610f9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe60c0cfd50 0x7fe60c1583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:03.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.007+0000 7fe610f9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe60c0cfd50 0x7fe60c1583d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46702/0 (socket says 172.21.15.37:46702) 2023-07-14T15:57:03.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.008+0000 7fe610f9c700 1 -- 172.21.15.37:0/2129676889 learned_addr learned my addr 172.21.15.37:0/2129676889 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:03.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.008+0000 7fe60bfff700 1 --2- 172.21.15.37:0/2129676889 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe60c0b1e80 0x7fe60c1f1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:03.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.008+0000 7fe60b7fe700 1 --2- 172.21.15.37:0/2129676889 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe60c0b3290 0x7fe60c1e4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:03.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.008+0000 7fe610f9c700 1 -- 172.21.15.37:0/2129676889 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe60c0b3290 msgr2=0x7fe60c1e4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:03.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.008+0000 7fe610f9c700 1 --2- 172.21.15.37:0/2129676889 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe60c0b3290 0x7fe60c1e4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:03.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.008+0000 7fe610f9c700 1 -- 172.21.15.37:0/2129676889 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe60c0b1e80 msgr2=0x7fe60c1f1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:03.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.008+0000 7fe610f9c700 1 --2- 172.21.15.37:0/2129676889 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe60c0b1e80 0x7fe60c1f1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:03.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.008+0000 7fe610f9c700 1 -- 172.21.15.37:0/2129676889 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe600009550 con 0x7fe60c0cfd50 2023-07-14T15:57:03.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.008+0000 7fe610f9c700 1 --2- 172.21.15.37:0/2129676889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe60c0cfd50 0x7fe60c1583d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe60400eed0 tx=0x7fe60400b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:03.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.008+0000 7fe608ff9700 1 -- 172.21.15.37:0/2129676889 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe604010040 con 0x7fe60c0cfd50 2023-07-14T15:57:03.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.008+0000 7fe608ff9700 1 -- 172.21.15.37:0/2129676889 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60400bd30 con 0x7fe60c0cfd50 2023-07-14T15:57:03.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.008+0000 7fe608ff9700 1 -- 172.21.15.37:0/2129676889 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe604009ea0 con 0x7fe60c0cfd50 2023-07-14T15:57:03.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.009+0000 7fe6129ff700 1 -- 172.21.15.37:0/2129676889 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe60c0d02a0 con 0x7fe60c0cfd50 2023-07-14T15:57:03.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.009+0000 7fe6129ff700 1 -- 172.21.15.37:0/2129676889 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe60c0c7170 con 0x7fe60c0cfd50 2023-07-14T15:57:03.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.010+0000 7fe6129ff700 1 -- 172.21.15.37:0/2129676889 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe60c0c7650 con 0x7fe60c0cfd50 2023-07-14T15:57:03.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.011+0000 7fe608ff9700 1 -- 172.21.15.37:0/2129676889 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe604014640 con 0x7fe60c0cfd50 2023-07-14T15:57:03.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.011+0000 7fe608ff9700 1 --2- 172.21.15.37:0/2129676889 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe5f806ace0 0x7fe5f806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:03.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.012+0000 7fe608ff9700 1 -- 172.21.15.37:0/2129676889 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe604089b70 con 0x7fe60c0cfd50 2023-07-14T15:57:03.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.012+0000 7fe60bfff700 1 --2- 172.21.15.37:0/2129676889 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe5f806ace0 0x7fe5f806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:03.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.013+0000 7fe60bfff700 1 --2- 172.21.15.37:0/2129676889 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe5f806ace0 0x7fe5f806d190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc009ad0 tx=0x7fe5fc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:03.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.016+0000 7fe608ff9700 1 -- 172.21.15.37:0/2129676889 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe604054b80 con 0x7fe60c0cfd50 2023-07-14T15:57:03.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.226+0000 7fe6129ff700 1 -- 172.21.15.37:0/2129676889 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe60c067840 con 0x7fe60c0cfd50 2023-07-14T15:57:03.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.226+0000 7fe608ff9700 1 -- 172.21.15.37:0/2129676889 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe604018020 con 0x7fe60c0cfd50 2023-07-14T15:57:03.212 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-14T15:57:03.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.228+0000 7fe6129ff700 1 -- 172.21.15.37:0/2129676889 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe5f806ace0 msgr2=0x7fe5f806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:03.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.228+0000 7fe6129ff700 1 --2- 172.21.15.37:0/2129676889 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe5f806ace0 0x7fe5f806d190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc009ad0 tx=0x7fe5fc008040 comp rx=0 tx=0).stop 2023-07-14T15:57:03.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.228+0000 7fe6129ff700 1 -- 172.21.15.37:0/2129676889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe60c0cfd50 msgr2=0x7fe60c1583d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:03.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.228+0000 7fe6129ff700 1 --2- 172.21.15.37:0/2129676889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe60c0cfd50 0x7fe60c1583d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe60400eed0 tx=0x7fe60400b390 comp rx=0 tx=0).stop 2023-07-14T15:57:03.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.228+0000 7fe6129ff700 1 -- 172.21.15.37:0/2129676889 shutdown_connections 2023-07-14T15:57:03.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.228+0000 7fe6129ff700 1 --2- 172.21.15.37:0/2129676889 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe60c0b1e80 0x7fe60c1f1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:03.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.228+0000 7fe6129ff700 1 --2- 172.21.15.37:0/2129676889 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe5f806ace0 0x7fe5f806d190 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:03.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.228+0000 7fe6129ff700 1 --2- 172.21.15.37:0/2129676889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe60c0cfd50 0x7fe60c1583d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:03.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.228+0000 7fe6129ff700 1 --2- 172.21.15.37:0/2129676889 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe60c0b3290 0x7fe60c1e4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:03.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.228+0000 7fe6129ff700 1 -- 172.21.15.37:0/2129676889 >> 172.21.15.37:0/2129676889 conn(0x7fe60c09c1c0 msgr2=0x7fe60c0d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:03.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.228+0000 7fe6129ff700 1 -- 172.21.15.37:0/2129676889 shutdown_connections 2023-07-14T15:57:03.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.228+0000 7fe6129ff700 1 -- 172.21.15.37:0/2129676889 wait complete. 2023-07-14T15:57:03.231 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T15:57:03.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.450+0000 7fd023dff700 1 Processor -- start 2023-07-14T15:57:03.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.450+0000 7fd023dff700 1 -- start start 2023-07-14T15:57:03.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.452+0000 7fd023dff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd01c15fee0 0x7fd01c15ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:03.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.452+0000 7fd023dff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd01c0d1140 0x7fd01c0b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:03.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.452+0000 7fd023dff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd01c15dc50 con 0x7fd01c1603b0 2023-07-14T15:57:03.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.452+0000 7fd023dff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd01c0b2940 con 0x7fd01c0d1140 2023-07-14T15:57:03.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.452+0000 7fd023dff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd01c0b2c20 con 0x7fd01c15fee0 2023-07-14T15:57:03.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.452+0000 7fd02239c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd01c0d1140 0x7fd01c0b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:03.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.452+0000 7fd02139a700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd01c1603b0 0x7fd01c0d0a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42688/0 (socket says 172.21.15.37:42688) 2023-07-14T15:57:03.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.452+0000 7fd02139a700 1 -- 172.21.15.37:0/1994274745 learned_addr learned my addr 172.21.15.37:0/1994274745 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:03.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.452+0000 7fd021b9b700 1 --2- 172.21.15.37:0/1994274745 >> v2:172.21.15.98:3300/0 conn(0x7fd01c15fee0 0x7fd01c15ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:03.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.452+0000 7fd02239c700 1 -- 172.21.15.37:0/1994274745 >> v2:172.21.15.98:3300/0 conn(0x7fd01c15fee0 msgr2=0x7fd01c15ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:03.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.452+0000 7fd02239c700 1 --2- 172.21.15.37:0/1994274745 >> v2:172.21.15.98:3300/0 conn(0x7fd01c15fee0 0x7fd01c15ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:03.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.452+0000 7fd02239c700 1 -- 172.21.15.37:0/1994274745 >> v1:172.21.15.37:6789/0 conn(0x7fd01c1603b0 legacy=0x7fd01c0d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:03.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.452+0000 7fd02239c700 1 -- 172.21.15.37:0/1994274745 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd01c0b2f00 con 0x7fd01c0d1140 2023-07-14T15:57:03.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.452+0000 7fd020b99700 1 -- 172.21.15.37:0/1994274745 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 457937877 0 0) 0x7fd01c15dc50 con 0x7fd01c1603b0 2023-07-14T15:57:03.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.453+0000 7fd02239c700 1 --2- 172.21.15.37:0/1994274745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd01c0d1140 0x7fd01c0b39e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd01c0d2dc0 tx=0x7fd01400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcc44e8344ef6f74 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:03.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.453+0000 7fd020b99700 1 -- 172.21.15.37:0/1994274745 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01400e070 con 0x7fd01c0d1140 2023-07-14T15:57:03.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.453+0000 7fd020b99700 1 -- 172.21.15.37:0/1994274745 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd01400bbd0 con 0x7fd01c0d1140 2023-07-14T15:57:03.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.453+0000 7fd020b99700 1 -- 172.21.15.37:0/1994274745 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd014012430 con 0x7fd01c0d1140 2023-07-14T15:57:03.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.453+0000 7fd023dff700 1 -- 172.21.15.37:0/1994274745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd01c0d1140 msgr2=0x7fd01c0b39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:03.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.453+0000 7fd023dff700 1 --2- 172.21.15.37:0/1994274745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd01c0d1140 0x7fd01c0b39e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd01c0d2dc0 tx=0x7fd01400b330 comp rx=0 tx=0).stop 2023-07-14T15:57:03.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.454+0000 7fd023dff700 1 -- 172.21.15.37:0/1994274745 shutdown_connections 2023-07-14T15:57:03.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.454+0000 7fd023dff700 1 --2- 172.21.15.37:0/1994274745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd01c0d1140 0x7fd01c0b39e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:03.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.454+0000 7fd023dff700 1 --2- 172.21.15.37:0/1994274745 >> v2:172.21.15.98:3300/0 conn(0x7fd01c15fee0 0x7fd01c15ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:03.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.454+0000 7fd023dff700 1 -- 172.21.15.37:0/1994274745 >> 172.21.15.37:0/1994274745 conn(0x7fd01c09c1b0 msgr2=0x7fd01c0d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:03.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.454+0000 7fd023dff700 1 -- 172.21.15.37:0/1994274745 shutdown_connections 2023-07-14T15:57:03.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.454+0000 7fd023dff700 1 -- 172.21.15.37:0/1994274745 wait complete. 2023-07-14T15:57:03.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.456+0000 7fd023dff700 1 Processor -- start 2023-07-14T15:57:03.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.456+0000 7fd023dff700 1 -- start start 2023-07-14T15:57:03.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.457+0000 7fd023dff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd01c0d1140 0x7fd01c0c6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:03.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.457+0000 7fd023dff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd01c15fee0 0x7fd01c158570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:03.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.457+0000 7fd023dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd01c1603b0 0x7fd01c1f2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:03.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.458+0000 7fd023dff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd01c158ab0 con 0x7fd01c0d1140 2023-07-14T15:57:03.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.458+0000 7fd023dff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd01c1f2f40 con 0x7fd01c15fee0 2023-07-14T15:57:03.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.458+0000 7fd023dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd01c1f2cb0 con 0x7fd01c1603b0 2023-07-14T15:57:03.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.458+0000 7fd021b9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd01c0d1140 0x7fd01c0c6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:03.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.458+0000 7fd021b9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd01c0d1140 0x7fd01c0c6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46716/0 (socket says 172.21.15.37:46716) 2023-07-14T15:57:03.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.458+0000 7fd021b9b700 1 -- 172.21.15.37:0/2092350804 learned_addr learned my addr 172.21.15.37:0/2092350804 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:03.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.458+0000 7fd02139a700 1 --2- 172.21.15.37:0/2092350804 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd01c15fee0 0x7fd01c158570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:03.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.458+0000 7fd02239c700 1 --2- 172.21.15.37:0/2092350804 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd01c1603b0 0x7fd01c1f2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:03.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.458+0000 7fd021b9b700 1 -- 172.21.15.37:0/2092350804 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd01c1603b0 msgr2=0x7fd01c1f2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:03.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.458+0000 7fd021b9b700 1 --2- 172.21.15.37:0/2092350804 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd01c1603b0 0x7fd01c1f2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:03.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.458+0000 7fd021b9b700 1 -- 172.21.15.37:0/2092350804 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd01c15fee0 msgr2=0x7fd01c158570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:03.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.458+0000 7fd021b9b700 1 --2- 172.21.15.37:0/2092350804 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd01c15fee0 0x7fd01c158570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:03.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.458+0000 7fd021b9b700 1 -- 172.21.15.37:0/2092350804 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd014009a70 con 0x7fd01c0d1140 2023-07-14T15:57:03.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.458+0000 7fd021b9b700 1 --2- 172.21.15.37:0/2092350804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd01c0d1140 0x7fd01c0c6bf0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd01800e840 tx=0x7fd01800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:03.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.459+0000 7fd0127fc700 1 -- 172.21.15.37:0/2092350804 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd018013610 con 0x7fd01c0d1140 2023-07-14T15:57:03.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.459+0000 7fd0127fc700 1 -- 172.21.15.37:0/2092350804 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd018013770 con 0x7fd01c0d1140 2023-07-14T15:57:03.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.459+0000 7fd0127fc700 1 -- 172.21.15.37:0/2092350804 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd018013b20 con 0x7fd01c0d1140 2023-07-14T15:57:03.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.459+0000 7fd023dff700 1 -- 172.21.15.37:0/2092350804 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd01c0c71d0 con 0x7fd01c0d1140 2023-07-14T15:57:03.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.459+0000 7fd023dff700 1 -- 172.21.15.37:0/2092350804 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd01c0c7790 con 0x7fd01c0d1140 2023-07-14T15:57:03.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.460+0000 7fd023dff700 1 -- 172.21.15.37:0/2092350804 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd01c067840 con 0x7fd01c0d1140 2023-07-14T15:57:03.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.461+0000 7fd0127fc700 1 -- 172.21.15.37:0/2092350804 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd018013c80 con 0x7fd01c0d1140 2023-07-14T15:57:03.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.462+0000 7fd0127fc700 1 --2- 172.21.15.37:0/2092350804 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd00006ace0 0x7fd00006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:03.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.462+0000 7fd0127fc700 1 -- 172.21.15.37:0/2092350804 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd018089180 con 0x7fd01c0d1140 2023-07-14T15:57:03.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.462+0000 7fd02139a700 1 --2- 172.21.15.37:0/2092350804 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd00006ace0 0x7fd00006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:03.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.463+0000 7fd02139a700 1 --2- 172.21.15.37:0/2092350804 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd00006ace0 0x7fd00006d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd01c0b1cb0 tx=0x7fd00c007be0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:03.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.466+0000 7fd0127fc700 1 -- 172.21.15.37:0/2092350804 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd018054190 con 0x7fd01c0d1140 2023-07-14T15:57:03.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.676+0000 7fd023dff700 1 -- 172.21.15.37:0/2092350804 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd01c0b1ce0 con 0x7fd01c0d1140 2023-07-14T15:57:03.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.676+0000 7fd0127fc700 1 -- 172.21.15.37:0/2092350804 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd0180577b0 con 0x7fd01c0d1140 2023-07-14T15:57:03.662 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-14T15:57:03.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.679+0000 7fd023dff700 1 -- 172.21.15.37:0/2092350804 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd00006ace0 msgr2=0x7fd00006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:03.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.679+0000 7fd023dff700 1 --2- 172.21.15.37:0/2092350804 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd00006ace0 0x7fd00006d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd01c0b1cb0 tx=0x7fd00c007be0 comp rx=0 tx=0).stop 2023-07-14T15:57:03.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.679+0000 7fd023dff700 1 -- 172.21.15.37:0/2092350804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd01c0d1140 msgr2=0x7fd01c0c6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:03.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.679+0000 7fd023dff700 1 --2- 172.21.15.37:0/2092350804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd01c0d1140 0x7fd01c0c6bf0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd01800e840 tx=0x7fd01800ec00 comp rx=0 tx=0).stop 2023-07-14T15:57:03.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.679+0000 7fd023dff700 1 -- 172.21.15.37:0/2092350804 shutdown_connections 2023-07-14T15:57:03.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.679+0000 7fd023dff700 1 --2- 172.21.15.37:0/2092350804 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd00006ace0 0x7fd00006d190 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:03.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.679+0000 7fd023dff700 1 --2- 172.21.15.37:0/2092350804 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd01c1603b0 0x7fd01c1f2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:03.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.679+0000 7fd023dff700 1 --2- 172.21.15.37:0/2092350804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd01c0d1140 0x7fd01c0c6bf0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:03.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.679+0000 7fd023dff700 1 --2- 172.21.15.37:0/2092350804 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd01c15fee0 0x7fd01c158570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:03.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.679+0000 7fd023dff700 1 -- 172.21.15.37:0/2092350804 >> 172.21.15.37:0/2092350804 conn(0x7fd01c09c1b0 msgr2=0x7fd01c06ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:03.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.679+0000 7fd023dff700 1 -- 172.21.15.37:0/2092350804 shutdown_connections 2023-07-14T15:57:03.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.679+0000 7fd023dff700 1 -- 172.21.15.37:0/2092350804 wait complete. 2023-07-14T15:57:03.682 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T15:57:03.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.904+0000 7f74193ff700 1 Processor -- start 2023-07-14T15:57:03.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.905+0000 7f74193ff700 1 -- start start 2023-07-14T15:57:03.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.906+0000 7f74193ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7414071730 0x7f741406f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:03.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.906+0000 7f74193ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f74140ae000 0x7f741406b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:03.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.906+0000 7f74193ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f741406bf00 0x7f74140cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:03.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.906+0000 7f74193ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74140ae4a0 con 0x7f7414071730 2023-07-14T15:57:03.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.906+0000 7f74193ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7414159870 con 0x7f74140ae000 2023-07-14T15:57:03.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.906+0000 7f74193ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74140ca790 con 0x7f741406bf00 2023-07-14T15:57:03.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.906+0000 7f7412ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7414071730 0x7f741406f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:03.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.906+0000 7f7412ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7414071730 0x7f741406f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46724/0 (socket says 172.21.15.37:46724) 2023-07-14T15:57:03.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.906+0000 7f7412ffd700 1 -- 172.21.15.37:0/4163953032 learned_addr learned my addr 172.21.15.37:0/4163953032 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:03.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.906+0000 7f74137fe700 1 --2- 172.21.15.37:0/4163953032 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f741406bf00 0x7f74140cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:03.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.906+0000 7f74127fc700 1 --2- 172.21.15.37:0/4163953032 >> v2:172.21.15.98:3300/0 conn(0x7f74140ae000 0x7f741406b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:03.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.906+0000 7f7412ffd700 1 -- 172.21.15.37:0/4163953032 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f741406bf00 msgr2=0x7f74140cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:03.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.906+0000 7f7412ffd700 1 --2- 172.21.15.37:0/4163953032 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f741406bf00 0x7f74140cd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:03.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.906+0000 7f7412ffd700 1 -- 172.21.15.37:0/4163953032 >> v2:172.21.15.98:3300/0 conn(0x7f74140ae000 msgr2=0x7f741406b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:03.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.906+0000 7f7412ffd700 1 --2- 172.21.15.37:0/4163953032 >> v2:172.21.15.98:3300/0 conn(0x7f74140ae000 0x7f741406b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:03.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.906+0000 7f7412ffd700 1 -- 172.21.15.37:0/4163953032 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f741406c300 con 0x7f7414071730 2023-07-14T15:57:03.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.906+0000 7f74127fc700 1 --2- 172.21.15.37:0/4163953032 >> v2:172.21.15.98:3300/0 conn(0x7f74140ae000 0x7f741406b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:57:03.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.907+0000 7f7412ffd700 1 --2- 172.21.15.37:0/4163953032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7414071730 0x7f741406f740 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f74140cab30 tx=0x7f7404009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b8282d77caed922 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:03.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.907+0000 7f7411ffb700 1 -- 172.21.15.37:0/4163953032 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740400f8a0 con 0x7f7414071730 2023-07-14T15:57:03.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.907+0000 7f7411ffb700 1 -- 172.21.15.37:0/4163953032 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f740400fa00 con 0x7f7414071730 2023-07-14T15:57:03.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.907+0000 7f7411ffb700 1 -- 172.21.15.37:0/4163953032 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740400fd90 con 0x7f7414071730 2023-07-14T15:57:03.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.907+0000 7f74193ff700 1 -- 172.21.15.37:0/4163953032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7414071730 msgr2=0x7f741406f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:03.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.907+0000 7f74193ff700 1 --2- 172.21.15.37:0/4163953032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7414071730 0x7f741406f740 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f74140cab30 tx=0x7f7404009bd0 comp rx=0 tx=0).stop 2023-07-14T15:57:03.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.908+0000 7f74193ff700 1 -- 172.21.15.37:0/4163953032 shutdown_connections 2023-07-14T15:57:03.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.908+0000 7f74193ff700 1 --2- 172.21.15.37:0/4163953032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7414071730 0x7f741406f740 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:03.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.908+0000 7f74193ff700 1 --2- 172.21.15.37:0/4163953032 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f741406bf00 0x7f74140cd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:03.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.908+0000 7f74193ff700 1 --2- 172.21.15.37:0/4163953032 >> v2:172.21.15.98:3300/0 conn(0x7f74140ae000 0x7f741406b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:03.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.908+0000 7f74193ff700 1 -- 172.21.15.37:0/4163953032 >> 172.21.15.37:0/4163953032 conn(0x7f741406aac0 msgr2=0x7f74140b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:03.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.908+0000 7f74193ff700 1 -- 172.21.15.37:0/4163953032 shutdown_connections 2023-07-14T15:57:03.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.908+0000 7f74193ff700 1 -- 172.21.15.37:0/4163953032 wait complete. 2023-07-14T15:57:03.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.909+0000 7f74193ff700 1 Processor -- start 2023-07-14T15:57:03.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.910+0000 7f74193ff700 1 -- start start 2023-07-14T15:57:03.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.910+0000 7f74193ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f741406bf00 0x7f74141599b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:03.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.911+0000 7f74193ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7414071730 0x7f741415c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:03.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.911+0000 7f74193ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74140ae000 0x7f741414c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:03.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.911+0000 7f74193ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741415a2b0 con 0x7f74140ae000 2023-07-14T15:57:03.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.911+0000 7f74193ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741415a590 con 0x7f7414071730 2023-07-14T15:57:03.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.911+0000 7f74193ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f741415a870 con 0x7f741406bf00 2023-07-14T15:57:03.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.911+0000 7f74137fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74140ae000 0x7f741414c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:03.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.911+0000 7f7412ffd700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f741406bf00 0x7f74141599b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:03.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.911+0000 7f74137fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74140ae000 0x7f741414c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46726/0 (socket says 172.21.15.37:46726) 2023-07-14T15:57:03.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.911+0000 7f74137fe700 1 -- 172.21.15.37:0/2228415782 learned_addr learned my addr 172.21.15.37:0/2228415782 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:03.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.911+0000 7f74127fc700 1 --2- 172.21.15.37:0/2228415782 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7414071730 0x7f741415c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:03.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.911+0000 7f74137fe700 1 -- 172.21.15.37:0/2228415782 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f741406bf00 msgr2=0x7f74141599b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:03.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.911+0000 7f74137fe700 1 --2- 172.21.15.37:0/2228415782 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f741406bf00 0x7f74141599b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:03.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.911+0000 7f74137fe700 1 -- 172.21.15.37:0/2228415782 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7414071730 msgr2=0x7f741415c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:03.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.911+0000 7f74137fe700 1 --2- 172.21.15.37:0/2228415782 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7414071730 0x7f741415c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:03.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.911+0000 7f74137fe700 1 -- 172.21.15.37:0/2228415782 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7404009550 con 0x7f74140ae000 2023-07-14T15:57:03.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.912+0000 7f74137fe700 1 --2- 172.21.15.37:0/2228415782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74140ae000 0x7f741414c940 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f740c007e60 tx=0x7f740c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:03.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.912+0000 7f73fb7fe700 1 -- 172.21.15.37:0/2228415782 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740c00ed30 con 0x7f74140ae000 2023-07-14T15:57:03.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.912+0000 7f73fb7fe700 1 -- 172.21.15.37:0/2228415782 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f740c014420 con 0x7f74140ae000 2023-07-14T15:57:03.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.912+0000 7f73fb7fe700 1 -- 172.21.15.37:0/2228415782 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740c0147d0 con 0x7f74140ae000 2023-07-14T15:57:03.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.912+0000 7f74193ff700 1 -- 172.21.15.37:0/2228415782 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f741415ab50 con 0x7f74140ae000 2023-07-14T15:57:03.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.912+0000 7f74193ff700 1 -- 172.21.15.37:0/2228415782 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7414159ef0 con 0x7f74140ae000 2023-07-14T15:57:03.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.913+0000 7f74193ff700 1 -- 172.21.15.37:0/2228415782 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74140cb300 con 0x7f74140ae000 2023-07-14T15:57:03.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.914+0000 7f73fb7fe700 1 -- 172.21.15.37:0/2228415782 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f740c014930 con 0x7f74140ae000 2023-07-14T15:57:03.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.915+0000 7f73fb7fe700 1 --2- 172.21.15.37:0/2228415782 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f740006ace0 0x7f740006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:03.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.915+0000 7f73fb7fe700 1 -- 172.21.15.37:0/2228415782 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f740c089a70 con 0x7f74140ae000 2023-07-14T15:57:03.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.916+0000 7f7412ffd700 1 --2- 172.21.15.37:0/2228415782 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f740006ace0 0x7f740006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:03.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.916+0000 7f7412ffd700 1 --2- 172.21.15.37:0/2228415782 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f740006ace0 0x7f740006d190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7404000c00 tx=0x7f740401b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:03.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:03.919+0000 7f73fb7fe700 1 -- 172.21.15.37:0/2228415782 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f740c054b10 con 0x7f74140ae000 2023-07-14T15:57:04.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.127+0000 7f74193ff700 1 -- 172.21.15.37:0/2228415782 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f74140ce880 con 0x7f74140ae000 2023-07-14T15:57:04.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.127+0000 7f73fb7fe700 1 -- 172.21.15.37:0/2228415782 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f740c058130 con 0x7f74140ae000 2023-07-14T15:57:04.112 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-14T15:57:04.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.130+0000 7f74193ff700 1 -- 172.21.15.37:0/2228415782 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f740006ace0 msgr2=0x7f740006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:04.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.130+0000 7f74193ff700 1 --2- 172.21.15.37:0/2228415782 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f740006ace0 0x7f740006d190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7404000c00 tx=0x7f740401b040 comp rx=0 tx=0).stop 2023-07-14T15:57:04.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.130+0000 7f74193ff700 1 -- 172.21.15.37:0/2228415782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74140ae000 msgr2=0x7f741414c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:04.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.130+0000 7f74193ff700 1 --2- 172.21.15.37:0/2228415782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74140ae000 0x7f741414c940 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f740c007e60 tx=0x7f740c00e3c0 comp rx=0 tx=0).stop 2023-07-14T15:57:04.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.130+0000 7f74193ff700 1 -- 172.21.15.37:0/2228415782 shutdown_connections 2023-07-14T15:57:04.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.130+0000 7f74193ff700 1 --2- 172.21.15.37:0/2228415782 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f740006ace0 0x7f740006d190 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:04.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.130+0000 7f74193ff700 1 --2- 172.21.15.37:0/2228415782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74140ae000 0x7f741414c940 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:04.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.130+0000 7f74193ff700 1 --2- 172.21.15.37:0/2228415782 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f741406bf00 0x7f74141599b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:04.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.130+0000 7f74193ff700 1 --2- 172.21.15.37:0/2228415782 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7414071730 0x7f741415c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:04.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.130+0000 7f74193ff700 1 -- 172.21.15.37:0/2228415782 >> 172.21.15.37:0/2228415782 conn(0x7f741406aac0 msgr2=0x7f74140c9890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:04.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.130+0000 7f74193ff700 1 -- 172.21.15.37:0/2228415782 shutdown_connections 2023-07-14T15:57:04.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.130+0000 7f74193ff700 1 -- 172.21.15.37:0/2228415782 wait complete. 2023-07-14T15:57:04.133 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-14T15:57:04.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.351+0000 7f601ffff700 1 Processor -- start 2023-07-14T15:57:04.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.351+0000 7f601ffff700 1 -- start start 2023-07-14T15:57:04.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.352+0000 7f601ffff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f60180d15c0 0x7f60180cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:04.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.353+0000 7f601ffff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f60180b0ae0 0x7f60180b5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:04.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.353+0000 7f601ffff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60180cdb50 con 0x7f60180b8900 2023-07-14T15:57:04.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.353+0000 7f601ffff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f601815d030 con 0x7f60180b0ae0 2023-07-14T15:57:04.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.353+0000 7f601ffff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60180cde30 con 0x7f60180d15c0 2023-07-14T15:57:04.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.353+0000 7f601e59c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f60180b0ae0 0x7f60180b5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:04.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.353+0000 7f601e59c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f60180b0ae0 0x7f60180b5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46736/0 (socket says 172.21.15.37:46736) 2023-07-14T15:57:04.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.353+0000 7f601e59c700 1 -- 172.21.15.37:0/2244599765 learned_addr learned my addr 172.21.15.37:0/2244599765 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:04.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.353+0000 7f601d59a700 1 --2- 172.21.15.37:0/2244599765 >> v2:172.21.15.98:3300/0 conn(0x7f60180d15c0 0x7f60180cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:04.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.353+0000 7f601e59c700 1 -- 172.21.15.37:0/2244599765 >> v2:172.21.15.98:3300/0 conn(0x7f60180d15c0 msgr2=0x7f60180cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:04.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.353+0000 7f601e59c700 1 --2- 172.21.15.37:0/2244599765 >> v2:172.21.15.98:3300/0 conn(0x7f60180d15c0 0x7f60180cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:04.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.353+0000 7f601e59c700 1 -- 172.21.15.37:0/2244599765 >> v1:172.21.15.37:6789/0 conn(0x7f60180b8900 legacy=0x7f60180d0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:04.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.353+0000 7f601e59c700 1 -- 172.21.15.37:0/2244599765 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60180ce110 con 0x7f60180b0ae0 2023-07-14T15:57:04.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.354+0000 7f601e59c700 1 --2- 172.21.15.37:0/2244599765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60180b0ae0 0x7f60180b5e00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f60180684b0 tx=0x7f601000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f681226b55f4c490 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:04.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.354+0000 7f601cd99700 1 -- 172.21.15.37:0/2244599765 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601000e070 con 0x7f60180b0ae0 2023-07-14T15:57:04.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.354+0000 7f601cd99700 1 -- 172.21.15.37:0/2244599765 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601000b9c0 con 0x7f60180b0ae0 2023-07-14T15:57:04.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.354+0000 7f601cd99700 1 -- 172.21.15.37:0/2244599765 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601000bd70 con 0x7f60180b0ae0 2023-07-14T15:57:04.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.354+0000 7f601ffff700 1 -- 172.21.15.37:0/2244599765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60180b0ae0 msgr2=0x7f60180b5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:04.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.354+0000 7f601ffff700 1 --2- 172.21.15.37:0/2244599765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60180b0ae0 0x7f60180b5e00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f60180684b0 tx=0x7f601000b330 comp rx=0 tx=0).stop 2023-07-14T15:57:04.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.354+0000 7f601ffff700 1 -- 172.21.15.37:0/2244599765 shutdown_connections 2023-07-14T15:57:04.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.354+0000 7f601ffff700 1 --2- 172.21.15.37:0/2244599765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60180b0ae0 0x7f60180b5e00 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:04.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.354+0000 7f601ffff700 1 --2- 172.21.15.37:0/2244599765 >> v2:172.21.15.98:3300/0 conn(0x7f60180d15c0 0x7f60180cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:04.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.354+0000 7f601ffff700 1 -- 172.21.15.37:0/2244599765 >> 172.21.15.37:0/2244599765 conn(0x7f601809c1e0 msgr2=0x7f60180d2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:04.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.355+0000 7f601ffff700 1 -- 172.21.15.37:0/2244599765 shutdown_connections 2023-07-14T15:57:04.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.355+0000 7f601ffff700 1 -- 172.21.15.37:0/2244599765 wait complete. 2023-07-14T15:57:04.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.357+0000 7f601ffff700 1 Processor -- start 2023-07-14T15:57:04.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.357+0000 7f601ffff700 1 -- start start 2023-07-14T15:57:04.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.358+0000 7f601ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60180b0ae0 0x7f60181f2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:04.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.358+0000 7f601ffff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f60180b8900 0x7f601815f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:04.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.358+0000 7f601ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60180d15c0 0x7f60181f1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:04.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.358+0000 7f601ffff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60181f3110 con 0x7f60180d15c0 2023-07-14T15:57:04.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.358+0000 7f601ffff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60180cb410 con 0x7f60180b0ae0 2023-07-14T15:57:04.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.358+0000 7f601ffff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60180ca370 con 0x7f60180b8900 2023-07-14T15:57:04.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.359+0000 7f601e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60180d15c0 0x7f60181f1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:04.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.359+0000 7f601e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60180d15c0 0x7f60181f1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46738/0 (socket says 172.21.15.37:46738) 2023-07-14T15:57:04.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.359+0000 7f601e59c700 1 -- 172.21.15.37:0/2261829330 learned_addr learned my addr 172.21.15.37:0/2261829330 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:04.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.359+0000 7f601d59a700 1 --2- 172.21.15.37:0/2261829330 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f60180b8900 0x7f601815f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:04.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.359+0000 7f601dd9b700 1 --2- 172.21.15.37:0/2261829330 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60180b0ae0 0x7f60181f2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:04.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.359+0000 7f601e59c700 1 -- 172.21.15.37:0/2261829330 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f60180b8900 msgr2=0x7f601815f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:04.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.359+0000 7f601e59c700 1 --2- 172.21.15.37:0/2261829330 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f60180b8900 0x7f601815f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:04.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.359+0000 7f601e59c700 1 -- 172.21.15.37:0/2261829330 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60180b0ae0 msgr2=0x7f60181f2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:04.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.359+0000 7f601e59c700 1 --2- 172.21.15.37:0/2261829330 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60180b0ae0 0x7f60181f2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:04.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.359+0000 7f601e59c700 1 -- 172.21.15.37:0/2261829330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6010009b30 con 0x7f60180d15c0 2023-07-14T15:57:04.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.359+0000 7f601dd9b700 1 --2- 172.21.15.37:0/2261829330 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60180b0ae0 0x7f60181f2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:57:04.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.359+0000 7f601e59c700 1 --2- 172.21.15.37:0/2261829330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60180d15c0 0x7f60181f1610 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6018066bb0 tx=0x7f6010004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:04.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.360+0000 7f600e7fc700 1 -- 172.21.15.37:0/2261829330 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6010004930 con 0x7f60180d15c0 2023-07-14T15:57:04.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.360+0000 7f600e7fc700 1 -- 172.21.15.37:0/2261829330 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60100099b0 con 0x7f60180d15c0 2023-07-14T15:57:04.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.360+0000 7f601ffff700 1 -- 172.21.15.37:0/2261829330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60180ca650 con 0x7f60180d15c0 2023-07-14T15:57:04.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.360+0000 7f600e7fc700 1 -- 172.21.15.37:0/2261829330 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601001c680 con 0x7f60180d15c0 2023-07-14T15:57:04.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.360+0000 7f601ffff700 1 -- 172.21.15.37:0/2261829330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60180cac10 con 0x7f60180d15c0 2023-07-14T15:57:04.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.361+0000 7f601ffff700 1 -- 172.21.15.37:0/2261829330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f601804e210 con 0x7f60180d15c0 2023-07-14T15:57:04.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.362+0000 7f600e7fc700 1 -- 172.21.15.37:0/2261829330 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f601001c7e0 con 0x7f60180d15c0 2023-07-14T15:57:04.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.363+0000 7f600e7fc700 1 --2- 172.21.15.37:0/2261829330 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f5ffc06ace0 0x7f5ffc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:04.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.363+0000 7f600e7fc700 1 -- 172.21.15.37:0/2261829330 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f601008ae40 con 0x7f60180d15c0 2023-07-14T15:57:04.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.363+0000 7f601dd9b700 1 --2- 172.21.15.37:0/2261829330 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f5ffc06ace0 0x7f5ffc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:04.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.364+0000 7f601dd9b700 1 --2- 172.21.15.37:0/2261829330 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f5ffc06ace0 0x7f5ffc06d190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f60181f6800 tx=0x7f6014009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:04.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.367+0000 7f600e7fc700 1 -- 172.21.15.37:0/2261829330 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6010055ee0 con 0x7f60180d15c0 2023-07-14T15:57:04.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.592+0000 7f601ffff700 1 -- 172.21.15.37:0/2261829330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f60180d3cf0 con 0x7f60180d15c0 2023-07-14T15:57:04.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.592+0000 7f600e7fc700 1 -- 172.21.15.37:0/2261829330 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6010059500 con 0x7f60180d15c0 2023-07-14T15:57:04.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.594+0000 7f601ffff700 1 -- 172.21.15.37:0/2261829330 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f5ffc06ace0 msgr2=0x7f5ffc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:04.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.594+0000 7f601ffff700 1 --2- 172.21.15.37:0/2261829330 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f5ffc06ace0 0x7f5ffc06d190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f60181f6800 tx=0x7f6014009040 comp rx=0 tx=0).stop 2023-07-14T15:57:04.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.594+0000 7f601ffff700 1 -- 172.21.15.37:0/2261829330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60180d15c0 msgr2=0x7f60181f1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:04.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.594+0000 7f601ffff700 1 --2- 172.21.15.37:0/2261829330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60180d15c0 0x7f60181f1610 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6018066bb0 tx=0x7f6010004ad0 comp rx=0 tx=0).stop 2023-07-14T15:57:04.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.595+0000 7f601ffff700 1 -- 172.21.15.37:0/2261829330 shutdown_connections 2023-07-14T15:57:04.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.595+0000 7f601ffff700 1 --2- 172.21.15.37:0/2261829330 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60180b0ae0 0x7f60181f2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:04.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.595+0000 7f601ffff700 1 --2- 172.21.15.37:0/2261829330 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f5ffc06ace0 0x7f5ffc06d190 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:04.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.595+0000 7f601ffff700 1 --2- 172.21.15.37:0/2261829330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60180d15c0 0x7f60181f1610 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:04.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.595+0000 7f601ffff700 1 --2- 172.21.15.37:0/2261829330 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f60180b8900 0x7f601815f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:04.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.595+0000 7f601ffff700 1 -- 172.21.15.37:0/2261829330 >> 172.21.15.37:0/2261829330 conn(0x7f601809c1e0 msgr2=0x7f60180d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:04.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.595+0000 7f601ffff700 1 -- 172.21.15.37:0/2261829330 shutdown_connections 2023-07-14T15:57:04.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:04.595+0000 7f601ffff700 1 -- 172.21.15.37:0/2261829330 wait complete. 2023-07-14T15:57:04.582 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2023-07-14T15:57:04.597 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-07-14T15:57:04.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:57:04.598 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-07-14T15:57:04.683 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-07-14T15:57:04.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:57:04.684 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-07-14T15:57:04.728 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-14T15:57:04.729 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T15:57:04.777 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-14T15:57:04.778 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T15:57:04.862 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-14T15:57:04.863 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T15:57:04.946 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T15:57:05.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.165+0000 7f5ec4fff700 1 Processor -- start 2023-07-14T15:57:05.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.165+0000 7f5ec4fff700 1 -- start start 2023-07-14T15:57:05.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.167+0000 7f5ec4fff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5ec015a440 0x7f5ec00cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:05.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.167+0000 7f5ec4fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f5ec015a810 0x7f5ec00ce230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:05.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.167+0000 7f5ec4fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5ec00afae0 0x7f5ec00aff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:05.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.167+0000 7f5ec4fff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ec00cb5e0 con 0x7f5ec00afae0 2023-07-14T15:57:05.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.167+0000 7f5ec4fff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ec00cb880 con 0x7f5ec015a810 2023-07-14T15:57:05.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.167+0000 7f5ec4fff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec00cbb60 con 0x7f5ec015a440 2023-07-14T15:57:05.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.167+0000 7f5ebed9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5ec00afae0 0x7f5ec00aff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:05.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.167+0000 7f5ebe59c700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5ec015a440 0x7f5ec00cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:05.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.167+0000 7f5ebdd9b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f5ec015a810 0x7f5ec00ce230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:05.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.167+0000 7f5ebed9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5ec00afae0 0x7f5ec00aff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46754/0 (socket says 172.21.15.37:46754) 2023-07-14T15:57:05.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.167+0000 7f5ebed9d700 1 -- 172.21.15.37:0/3840542096 learned_addr learned my addr 172.21.15.37:0/3840542096 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:05.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.167+0000 7f5ebed9d700 1 -- 172.21.15.37:0/3840542096 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5ec015a440 msgr2=0x7f5ec00cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:05.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.167+0000 7f5ebed9d700 1 --2- 172.21.15.37:0/3840542096 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5ec015a440 0x7f5ec00cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:05.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.167+0000 7f5ebed9d700 1 -- 172.21.15.37:0/3840542096 >> v2:172.21.15.98:3300/0 conn(0x7f5ec015a810 msgr2=0x7f5ec00ce230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:05.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.167+0000 7f5ebed9d700 1 --2- 172.21.15.37:0/3840542096 >> v2:172.21.15.98:3300/0 conn(0x7f5ec015a810 0x7f5ec00ce230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:05.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.167+0000 7f5ebed9d700 1 -- 172.21.15.37:0/3840542096 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec00cbe40 con 0x7f5ec00afae0 2023-07-14T15:57:05.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.168+0000 7f5ebed9d700 1 --2- 172.21.15.37:0/3840542096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ec00afae0 0x7f5ec00aff40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5ec00cb5b0 tx=0x7f5eb800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f579e985d7c0e0ab server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:05.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.168+0000 7f5ebd59a700 1 -- 172.21.15.37:0/3840542096 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb800e070 con 0x7f5ec00afae0 2023-07-14T15:57:05.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.168+0000 7f5ebd59a700 1 -- 172.21.15.37:0/3840542096 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb800b910 con 0x7f5ec00afae0 2023-07-14T15:57:05.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.168+0000 7f5ebd59a700 1 -- 172.21.15.37:0/3840542096 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb800bcc0 con 0x7f5ec00afae0 2023-07-14T15:57:05.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.168+0000 7f5ec4fff700 1 -- 172.21.15.37:0/3840542096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ec00afae0 msgr2=0x7f5ec00aff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:05.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.168+0000 7f5ec4fff700 1 --2- 172.21.15.37:0/3840542096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ec00afae0 0x7f5ec00aff40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5ec00cb5b0 tx=0x7f5eb800b330 comp rx=0 tx=0).stop 2023-07-14T15:57:05.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.169+0000 7f5ec4fff700 1 -- 172.21.15.37:0/3840542096 shutdown_connections 2023-07-14T15:57:05.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.169+0000 7f5ec4fff700 1 --2- 172.21.15.37:0/3840542096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ec00afae0 0x7f5ec00aff40 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:05.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.169+0000 7f5ec4fff700 1 --2- 172.21.15.37:0/3840542096 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5ec015a440 0x7f5ec00cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:05.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.169+0000 7f5ec4fff700 1 --2- 172.21.15.37:0/3840542096 >> v2:172.21.15.98:3300/0 conn(0x7f5ec015a810 0x7f5ec00ce230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:05.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.169+0000 7f5ec4fff700 1 -- 172.21.15.37:0/3840542096 >> 172.21.15.37:0/3840542096 conn(0x7f5ec00b08c0 msgr2=0x7f5ec00b0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:05.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.169+0000 7f5ec4fff700 1 -- 172.21.15.37:0/3840542096 shutdown_connections 2023-07-14T15:57:05.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.169+0000 7f5ec4fff700 1 -- 172.21.15.37:0/3840542096 wait complete. 2023-07-14T15:57:05.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.170+0000 7f5ec4fff700 1 Processor -- start 2023-07-14T15:57:05.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.171+0000 7f5ec4fff700 1 -- start start 2023-07-14T15:57:05.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.171+0000 7f5ec4fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ec00afae0 0x7f5ec00b37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:05.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.172+0000 7f5ec4fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ec015a440 0x7f5ec0144420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:05.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.172+0000 7f5ec4fff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5ec015a810 0x7f5ec014ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:05.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.172+0000 7f5ec4fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec00b3040 con 0x7f5ec015a440 2023-07-14T15:57:05.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.172+0000 7f5ec4fff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec015daa0 con 0x7f5ec00afae0 2023-07-14T15:57:05.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.172+0000 7f5ec4fff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec00b23c0 con 0x7f5ec015a810 2023-07-14T15:57:05.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.172+0000 7f5ebdd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ec015a440 0x7f5ec0144420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:05.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.172+0000 7f5ebdd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ec015a440 0x7f5ec0144420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46760/0 (socket says 172.21.15.37:46760) 2023-07-14T15:57:05.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.172+0000 7f5ebdd9b700 1 -- 172.21.15.37:0/3783829850 learned_addr learned my addr 172.21.15.37:0/3783829850 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:05.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.172+0000 7f5ebe59c700 1 --2- 172.21.15.37:0/3783829850 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ec00afae0 0x7f5ec00b37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:05.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.172+0000 7f5ebed9d700 1 --2- 172.21.15.37:0/3783829850 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5ec015a810 0x7f5ec014ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:05.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.172+0000 7f5ebdd9b700 1 -- 172.21.15.37:0/3783829850 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5ec015a810 msgr2=0x7f5ec014ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:05.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.172+0000 7f5ebdd9b700 1 --2- 172.21.15.37:0/3783829850 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5ec015a810 0x7f5ec014ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:05.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.172+0000 7f5ebdd9b700 1 -- 172.21.15.37:0/3783829850 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ec00afae0 msgr2=0x7f5ec00b37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:05.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.172+0000 7f5ebdd9b700 1 --2- 172.21.15.37:0/3783829850 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ec00afae0 0x7f5ec00b37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:05.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.172+0000 7f5ebdd9b700 1 -- 172.21.15.37:0/3783829850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb8009b30 con 0x7f5ec015a440 2023-07-14T15:57:05.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.172+0000 7f5ebe59c700 1 --2- 172.21.15.37:0/3783829850 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ec00afae0 0x7f5ec00b37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:57:05.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.173+0000 7f5ebdd9b700 1 --2- 172.21.15.37:0/3783829850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ec015a440 0x7f5ec0144420 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5eb400e870 tx=0x7f5eb400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:05.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.173+0000 7f5eaeffd700 1 -- 172.21.15.37:0/3783829850 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb4009590 con 0x7f5ec015a440 2023-07-14T15:57:05.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.173+0000 7f5eaeffd700 1 -- 172.21.15.37:0/3783829850 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb400ee70 con 0x7f5ec015a440 2023-07-14T15:57:05.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.173+0000 7f5eaeffd700 1 -- 172.21.15.37:0/3783829850 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb400ca50 con 0x7f5ec015a440 2023-07-14T15:57:05.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.173+0000 7f5ec4fff700 1 -- 172.21.15.37:0/3783829850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ec00b26a0 con 0x7f5ec015a440 2023-07-14T15:57:05.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.173+0000 7f5ec4fff700 1 -- 172.21.15.37:0/3783829850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ec00b2c60 con 0x7f5ec015a440 2023-07-14T15:57:05.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.174+0000 7f5ec4fff700 1 -- 172.21.15.37:0/3783829850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ec00b3180 con 0x7f5ec015a440 2023-07-14T15:57:05.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.175+0000 7f5eaeffd700 1 -- 172.21.15.37:0/3783829850 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5eb400cbb0 con 0x7f5ec015a440 2023-07-14T15:57:05.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.176+0000 7f5eaeffd700 1 --2- 172.21.15.37:0/3783829850 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f5ea006ace0 0x7f5ea006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:05.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.176+0000 7f5eaeffd700 1 -- 172.21.15.37:0/3783829850 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5eb40894f0 con 0x7f5ec015a440 2023-07-14T15:57:05.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.176+0000 7f5ebe59c700 1 --2- 172.21.15.37:0/3783829850 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f5ea006ace0 0x7f5ea006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:05.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.177+0000 7f5ebe59c700 1 --2- 172.21.15.37:0/3783829850 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f5ea006ace0 0x7f5ea006d190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5ec014d690 tx=0x7f5eb0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:05.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.180+0000 7f5eaeffd700 1 -- 172.21.15.37:0/3783829850 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5ec00b3180 con 0x7f5ec015a440 2023-07-14T15:57:05.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.389+0000 7f5ec4fff700 1 -- 172.21.15.37:0/3783829850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ec00b3180 con 0x7f5ec015a440 2023-07-14T15:57:05.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.390+0000 7f5eaeffd700 1 -- 172.21.15.37:0/3783829850 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18341 (secure 0 0 0) 0x7f5ec00b3180 con 0x7f5ec015a440 2023-07-14T15:57:05.376 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:57:05.376 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"fsid":"9da30401-a779-4e46-aba6-00c2494c6c67","created":"2023-07-14T15:55:39.898867+0000","modified":"2023-07-14T15:56:09.959850+0000","last_up_change":"2023-07-14T15:55:53.025696+0000","last_in_change":"2023-07-14T15:55:43.388192+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T15:55:52.907261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T15:55:59.992839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T15:56:06.091064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T15:56:07.448694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d049535-7b87-4276-8fe5-0f74ba422d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6801","nonce":2783032392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6803","nonce":2783032392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6807","nonce":2783032392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6805","nonce":2783032392}]},"public_addr":"172.21.15.37:6801/2783032392","cluster_addr":"172.21.15.37:6803/2783032392","heartbeat_back_addr":"172.21.15.37:6807/2783032392","heartbeat_front_addr":"172.21.15.37:6805/2783032392","state":["exists","up"]},{"osd":1,"uuid":"79ec948d-ead2-4c2d-923a-dd6eeaac9dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6823","nonce":1190059746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6826","nonce":1190059746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6831","nonce":1190059746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6829","nonce":1190059746}]},"public_addr":"172.21.15.37:6823/1190059746","cluster_addr":"172.21.15.37:6826/1190059746","heartbeat_back_addr":"172.21.15.37:6831/1190059746","heartbeat_front_addr":"172.21.15.37:6829/1190059746","state":["exists","up"]},{"osd":2,"uuid":"a1db6690-c160-4366-9c82-2cca17e4bba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6809","nonce":2266223499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6813","nonce":2266223499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6820","nonce":2266223499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6816","nonce":2266223499}]},"public_addr":"172.21.15.37:6809/2266223499","cluster_addr":"172.21.15.37:6813/2266223499","heartbeat_back_addr":"172.21.15.37:6820/2266223499","heartbeat_front_addr":"172.21.15.37:6816/2266223499","state":["exists","up"]},{"osd":3,"uuid":"767b8220-e79a-4a86-a162-6b3b73198379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6812","nonce":4166694594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6817","nonce":4166694594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6828","nonce":4166694594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6822","nonce":4166694594}]},"public_addr":"172.21.15.37:6812/4166694594","cluster_addr":"172.21.15.37:6817/4166694594","heartbeat_back_addr":"172.21.15.37:6828/4166694594","heartbeat_front_addr":"172.21.15.37:6822/4166694594","state":["exists","up"]},{"osd":4,"uuid":"717bd773-ae7e-4236-ac79-900cf99a37c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6801","nonce":3529020407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6803","nonce":3529020407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6807","nonce":3529020407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6805","nonce":3529020407}]},"public_addr":"172.21.15.98:6801/3529020407","cluster_addr":"172.21.15.98:6803/3529020407","heartbeat_back_addr":"172.21.15.98:6807/3529020407","heartbeat_front_addr":"172.21.15.98:6805/3529020407","state":["exists","up"]},{"osd":5,"uuid":"a941d358-0f03-4136-a9b2-3a1c2e9358cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6817","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6819","nonce":2311501838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6821","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6823","nonce":2311501838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6829","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6831","nonce":2311501838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6825","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6827","nonce":2311501838}]},"public_addr":"172.21.15.98:6819/2311501838","cluster_addr":"172.21.15.98:6823/2311501838","heartbeat_back_addr":"172.21.15.98:6831/2311501838","heartbeat_front_addr":"172.21.15.98:6827/2311501838","state":["exists","up"]},{"osd":6,"uuid":"27153772-6d4b-479d-9953-0582e7b96743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6809","nonce":1144224691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6811","nonce":1144224691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6815","nonce":1144224691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6813","nonce":1144224691}]},"public_addr":"172.21.15.98:6809/1144224691","cluster_addr":"172.21.15.98:6811/1144224691","heartbeat_back_addr":"172.21.15.98:6815/1144224691","heartbeat_front_addr":"172.21.15.98:6813/1144224691","state":["exists","up"]},{"osd":7,"uuid":"d21ffc8e-40bb-47eb-af2c-e3e730d3fb76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6818","nonce":1144470927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6822","nonce":1144470927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6830","nonce":1144470927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6826","nonce":1144470927}]},"public_addr":"172.21.15.98:6818/1144470927","cluster_addr":"172.21.15.98:6822/1144470927","heartbeat_back_addr":"172.21.15.98:6830/1144470927","heartbeat_front_addr":"172.21.15.98:6826/1144470927","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.921114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.739210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.024016+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.002527+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.698127+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.813416+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.709351+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.815457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T15:57:05.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.393+0000 7f5ec4fff700 1 -- 172.21.15.37:0/3783829850 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f5ea006ace0 msgr2=0x7f5ea006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:05.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.393+0000 7f5ec4fff700 1 --2- 172.21.15.37:0/3783829850 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f5ea006ace0 0x7f5ea006d190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5ec014d690 tx=0x7f5eb0008040 comp rx=0 tx=0).stop 2023-07-14T15:57:05.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.393+0000 7f5ec4fff700 1 -- 172.21.15.37:0/3783829850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ec015a440 msgr2=0x7f5ec0144420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:05.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.393+0000 7f5ec4fff700 1 --2- 172.21.15.37:0/3783829850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ec015a440 0x7f5ec0144420 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5eb400e870 tx=0x7f5eb400ec30 comp rx=0 tx=0).stop 2023-07-14T15:57:05.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.393+0000 7f5ec4fff700 1 -- 172.21.15.37:0/3783829850 shutdown_connections 2023-07-14T15:57:05.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.393+0000 7f5ec4fff700 1 --2- 172.21.15.37:0/3783829850 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ec00afae0 0x7f5ec00b37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:05.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.393+0000 7f5ec4fff700 1 --2- 172.21.15.37:0/3783829850 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f5ea006ace0 0x7f5ea006d190 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:05.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.393+0000 7f5ec4fff700 1 --2- 172.21.15.37:0/3783829850 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5ec015a810 0x7f5ec014ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:05.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.393+0000 7f5ec4fff700 1 --2- 172.21.15.37:0/3783829850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ec015a440 0x7f5ec0144420 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:05.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.393+0000 7f5ec4fff700 1 -- 172.21.15.37:0/3783829850 >> 172.21.15.37:0/3783829850 conn(0x7f5ec00b08c0 msgr2=0x7f5ec00c85b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:05.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.393+0000 7f5ec4fff700 1 -- 172.21.15.37:0/3783829850 shutdown_connections 2023-07-14T15:57:05.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.393+0000 7f5ec4fff700 1 -- 172.21.15.37:0/3783829850 wait complete. 2023-07-14T15:57:05.397 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T15:55:52.907261+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T15:55:59.992839+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T15:56:06.091064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T15:56:07.448694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T15:57:05.397 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T15:57:05.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.617+0000 7f105e7ff700 1 Processor -- start 2023-07-14T15:57:05.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.618+0000 7f105e7ff700 1 -- start start 2023-07-14T15:57:05.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.619+0000 7f105e7ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f10580ce640 0x7f105806b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:05.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.619+0000 7f105e7ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f10580cb490 0x7f10580cb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:05.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.619+0000 7f105e7ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10581595b0 con 0x7f1058158b70 2023-07-14T15:57:05.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.619+0000 7f105e7ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f105806db00 con 0x7f10580ce640 2023-07-14T15:57:05.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.619+0000 7f105e7ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10580cbe00 con 0x7f10580cb490 2023-07-14T15:57:05.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.619+0000 7f10577fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f10580ce640 0x7f105806b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:05.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.619+0000 7f1057fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1058158b70 0x7f1058159a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42720/0 (socket says 172.21.15.37:42720) 2023-07-14T15:57:05.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.619+0000 7f1057fff700 1 -- 172.21.15.37:0/1062756810 learned_addr learned my addr 172.21.15.37:0/1062756810 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:05.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.619+0000 7f10577fe700 1 -- 172.21.15.37:0/1062756810 >> v2:172.21.15.98:3300/0 conn(0x7f10580cb490 msgr2=0x7f10580cb8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:05.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.619+0000 7f105cd9c700 1 --2- 172.21.15.37:0/1062756810 >> v2:172.21.15.98:3300/0 conn(0x7f10580cb490 0x7f10580cb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:05.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.620+0000 7f10577fe700 1 --2- 172.21.15.37:0/1062756810 >> v2:172.21.15.98:3300/0 conn(0x7f10580cb490 0x7f10580cb8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:05.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.620+0000 7f10577fe700 1 -- 172.21.15.37:0/1062756810 >> v1:172.21.15.37:6789/0 conn(0x7f1058158b70 legacy=0x7f1058159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:05.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.620+0000 7f10577fe700 1 -- 172.21.15.37:0/1062756810 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1058159280 con 0x7f10580ce640 2023-07-14T15:57:05.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.620+0000 7f105cd9c700 1 --2- 172.21.15.37:0/1062756810 >> v2:172.21.15.98:3300/0 conn(0x7f10580cb490 0x7f10580cb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:57:05.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.620+0000 7f1056ffd700 1 -- 172.21.15.37:0/1062756810 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3232993946 0 0) 0x7f10581595b0 con 0x7f1058158b70 2023-07-14T15:57:05.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.620+0000 7f10577fe700 1 --2- 172.21.15.37:0/1062756810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10580ce640 0x7f105806b7b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f10580cdfe0 tx=0x7f104c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3a1b5610c91c613 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:05.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.620+0000 7f1056ffd700 1 -- 172.21.15.37:0/1062756810 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104c011830 con 0x7f10580ce640 2023-07-14T15:57:05.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.620+0000 7f1056ffd700 1 -- 172.21.15.37:0/1062756810 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f104c011990 con 0x7f10580ce640 2023-07-14T15:57:05.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.620+0000 7f1056ffd700 1 -- 172.21.15.37:0/1062756810 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104c011d20 con 0x7f10580ce640 2023-07-14T15:57:05.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.621+0000 7f105e7ff700 1 -- 172.21.15.37:0/1062756810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10580ce640 msgr2=0x7f105806b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:05.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.621+0000 7f105e7ff700 1 --2- 172.21.15.37:0/1062756810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10580ce640 0x7f105806b7b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f10580cdfe0 tx=0x7f104c009b20 comp rx=0 tx=0).stop 2023-07-14T15:57:05.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.621+0000 7f105e7ff700 1 -- 172.21.15.37:0/1062756810 shutdown_connections 2023-07-14T15:57:05.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.621+0000 7f105e7ff700 1 --2- 172.21.15.37:0/1062756810 >> v2:172.21.15.98:3300/0 conn(0x7f10580cb490 0x7f10580cb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:05.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.621+0000 7f105e7ff700 1 --2- 172.21.15.37:0/1062756810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10580ce640 0x7f105806b7b0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:05.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.621+0000 7f105e7ff700 1 -- 172.21.15.37:0/1062756810 >> 172.21.15.37:0/1062756810 conn(0x7f105806aac0 msgr2=0x7f10580b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:05.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.621+0000 7f105e7ff700 1 -- 172.21.15.37:0/1062756810 shutdown_connections 2023-07-14T15:57:05.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.621+0000 7f105e7ff700 1 -- 172.21.15.37:0/1062756810 wait complete. 2023-07-14T15:57:05.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.623+0000 7f105e7ff700 1 Processor -- start 2023-07-14T15:57:05.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.623+0000 7f105e7ff700 1 -- start start 2023-07-14T15:57:05.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.624+0000 7f105e7ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10580cb490 0x7f10581518d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:05.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.624+0000 7f105e7ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f10580ce640 0x7f10580c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:05.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.624+0000 7f105e7ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1058158b70 0x7f10580acb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:05.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.624+0000 7f105e7ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10581f27b0 con 0x7f10580cb490 2023-07-14T15:57:05.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.624+0000 7f105e7ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10581f2a90 con 0x7f1058158b70 2023-07-14T15:57:05.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.624+0000 7f105e7ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10581f2d70 con 0x7f10580ce640 2023-07-14T15:57:05.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.624+0000 7f1057fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10580cb490 0x7f10581518d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:05.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.624+0000 7f1057fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10580cb490 0x7f10581518d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46780/0 (socket says 172.21.15.37:46780) 2023-07-14T15:57:05.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.624+0000 7f1057fff700 1 -- 172.21.15.37:0/1172050316 learned_addr learned my addr 172.21.15.37:0/1172050316 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:05.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.624+0000 7f1057fff700 1 -- 172.21.15.37:0/1172050316 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f10580ce640 msgr2=0x7f10580c5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:05.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.624+0000 7f1057fff700 1 --2- 172.21.15.37:0/1172050316 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f10580ce640 0x7f10580c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:05.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.624+0000 7f1057fff700 1 -- 172.21.15.37:0/1172050316 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1058158b70 msgr2=0x7f10580acb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:05.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.624+0000 7f1057fff700 1 --2- 172.21.15.37:0/1172050316 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1058158b70 0x7f10580acb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:05.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.624+0000 7f1057fff700 1 -- 172.21.15.37:0/1172050316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f104c0094a0 con 0x7f10580cb490 2023-07-14T15:57:05.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.625+0000 7f1057fff700 1 --2- 172.21.15.37:0/1172050316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10580cb490 0x7f10581518d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f104800c550 tx=0x7f104800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:05.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.625+0000 7f1054ff9700 1 -- 172.21.15.37:0/1172050316 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1048004c80 con 0x7f10580cb490 2023-07-14T15:57:05.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.625+0000 7f1054ff9700 1 -- 172.21.15.37:0/1172050316 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1048004e00 con 0x7f10580cb490 2023-07-14T15:57:05.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.625+0000 7f1054ff9700 1 -- 172.21.15.37:0/1172050316 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1048007310 con 0x7f10580cb490 2023-07-14T15:57:05.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.625+0000 7f105e7ff700 1 -- 172.21.15.37:0/1172050316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10581f3050 con 0x7f10580cb490 2023-07-14T15:57:05.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.625+0000 7f105e7ff700 1 -- 172.21.15.37:0/1172050316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10580c6250 con 0x7f10580cb490 2023-07-14T15:57:05.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.626+0000 7f105e7ff700 1 -- 172.21.15.37:0/1172050316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10580c64a0 con 0x7f10580cb490 2023-07-14T15:57:05.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.627+0000 7f1054ff9700 1 -- 172.21.15.37:0/1172050316 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1048007470 con 0x7f10580cb490 2023-07-14T15:57:05.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.628+0000 7f1054ff9700 1 --2- 172.21.15.37:0/1172050316 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f104406ace0 0x7f104406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:05.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.628+0000 7f1054ff9700 1 -- 172.21.15.37:0/1172050316 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f10480891d0 con 0x7f10580cb490 2023-07-14T15:57:05.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.628+0000 7f10577fe700 1 --2- 172.21.15.37:0/1172050316 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f104406ace0 0x7f104406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:05.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.629+0000 7f10577fe700 1 --2- 172.21.15.37:0/1172050316 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f104406ace0 0x7f104406d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f10580cdfe0 tx=0x7f104c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:05.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.632+0000 7f1054ff9700 1 -- 172.21.15.37:0/1172050316 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1048054270 con 0x7f10580cb490 2023-07-14T15:57:05.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.839+0000 7f105e7ff700 1 -- 172.21.15.37:0/1172050316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1058067840 con 0x7f10580cb490 2023-07-14T15:57:05.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.839+0000 7f1054ff9700 1 -- 172.21.15.37:0/1172050316 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1048057890 con 0x7f10580cb490 2023-07-14T15:57:05.825 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-14T15:57:05.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.842+0000 7f105e7ff700 1 -- 172.21.15.37:0/1172050316 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f104406ace0 msgr2=0x7f104406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:05.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.842+0000 7f105e7ff700 1 --2- 172.21.15.37:0/1172050316 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f104406ace0 0x7f104406d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f10580cdfe0 tx=0x7f104c010000 comp rx=0 tx=0).stop 2023-07-14T15:57:05.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.842+0000 7f105e7ff700 1 -- 172.21.15.37:0/1172050316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10580cb490 msgr2=0x7f10581518d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:05.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.842+0000 7f105e7ff700 1 --2- 172.21.15.37:0/1172050316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10580cb490 0x7f10581518d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f104800c550 tx=0x7f104800c910 comp rx=0 tx=0).stop 2023-07-14T15:57:05.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.842+0000 7f105e7ff700 1 -- 172.21.15.37:0/1172050316 shutdown_connections 2023-07-14T15:57:05.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.842+0000 7f105e7ff700 1 --2- 172.21.15.37:0/1172050316 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1058158b70 0x7f10580acb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:05.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.842+0000 7f105e7ff700 1 --2- 172.21.15.37:0/1172050316 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f104406ace0 0x7f104406d190 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:05.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.842+0000 7f105e7ff700 1 --2- 172.21.15.37:0/1172050316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10580cb490 0x7f10581518d0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:05.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.842+0000 7f105e7ff700 1 --2- 172.21.15.37:0/1172050316 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f10580ce640 0x7f10580c5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:05.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.842+0000 7f105e7ff700 1 -- 172.21.15.37:0/1172050316 >> 172.21.15.37:0/1172050316 conn(0x7f105806aac0 msgr2=0x7f105806f720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:05.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.842+0000 7f105e7ff700 1 -- 172.21.15.37:0/1172050316 shutdown_connections 2023-07-14T15:57:05.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:05.842+0000 7f105e7ff700 1 -- 172.21.15.37:0/1172050316 wait complete. 2023-07-14T15:57:05.847 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T15:57:06.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.067+0000 7f81a31ff700 1 Processor -- start 2023-07-14T15:57:06.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.068+0000 7f81a31ff700 1 -- start start 2023-07-14T15:57:06.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.069+0000 7f81a31ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f819c0d1140 0x7f819c15ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:06.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.069+0000 7f81a31ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f819c15dc50 con 0x7f819c1603b0 2023-07-14T15:57:06.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.069+0000 7f81a31ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f819c0b2940 con 0x7f819c15fee0 2023-07-14T15:57:06.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.069+0000 7f81a31ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f819c0b2c20 con 0x7f819c0d1140 2023-07-14T15:57:06.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.069+0000 7f81a179c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f819c1603b0 0x7f819c0b39e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42730/0 (socket says 172.21.15.37:42730) 2023-07-14T15:57:06.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.069+0000 7f81a179c700 1 -- 172.21.15.37:0/258254538 learned_addr learned my addr 172.21.15.37:0/258254538 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:06.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.069+0000 7f819bfff700 1 --2- 172.21.15.37:0/258254538 >> v2:172.21.15.98:3300/0 conn(0x7f819c0d1140 0x7f819c15ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:06.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.070+0000 7f819b7fe700 1 -- 172.21.15.37:0/258254538 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2974393754 0 0) 0x7f819c15dc50 con 0x7f819c1603b0 2023-07-14T15:57:06.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.070+0000 7f819b7fe700 1 -- 172.21.15.37:0/258254538 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f818c0035b0 con 0x7f819c1603b0 2023-07-14T15:57:06.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.070+0000 7f819bfff700 1 -- 172.21.15.37:0/258254538 >> v1:172.21.15.98:6789/0 conn(0x7f819c15fee0 legacy=0x7f819c0d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:06.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.070+0000 7f819b7fe700 1 -- 172.21.15.37:0/258254538 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 568861788 0 0) 0x7f819c0b2940 con 0x7f819c15fee0 2023-07-14T15:57:06.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.070+0000 7f819bfff700 1 -- 172.21.15.37:0/258254538 >> v1:172.21.15.37:6789/0 conn(0x7f819c1603b0 legacy=0x7f819c0b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:06.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.070+0000 7f819bfff700 1 -- 172.21.15.37:0/258254538 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f819c0b2f00 con 0x7f819c0d1140 2023-07-14T15:57:06.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.070+0000 7f819bfff700 1 --2- 172.21.15.37:0/258254538 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f819c0d1140 0x7f819c15ded0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8188009840 tx=0x7f8188009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e3d99f60398eb4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:06.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.070+0000 7f819b7fe700 1 -- 172.21.15.37:0/258254538 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81940019f0 con 0x7f819c0d1140 2023-07-14T15:57:06.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.071+0000 7f819b7fe700 1 -- 172.21.15.37:0/258254538 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8188004030 con 0x7f819c0d1140 2023-07-14T15:57:06.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.071+0000 7f819b7fe700 1 -- 172.21.15.37:0/258254538 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81880043c0 con 0x7f819c0d1140 2023-07-14T15:57:06.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.071+0000 7f81a31ff700 1 -- 172.21.15.37:0/258254538 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f819c0d1140 msgr2=0x7f819c15ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:06.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.071+0000 7f81a31ff700 1 --2- 172.21.15.37:0/258254538 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f819c0d1140 0x7f819c15ded0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8188009840 tx=0x7f8188009b50 comp rx=0 tx=0).stop 2023-07-14T15:57:06.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.071+0000 7f81a31ff700 1 -- 172.21.15.37:0/258254538 shutdown_connections 2023-07-14T15:57:06.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.071+0000 7f81a31ff700 1 --2- 172.21.15.37:0/258254538 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f819c0d1140 0x7f819c15ded0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:06.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.071+0000 7f81a31ff700 1 -- 172.21.15.37:0/258254538 >> 172.21.15.37:0/258254538 conn(0x7f819c09c1b0 msgr2=0x7f819c0d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:06.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.071+0000 7f81a31ff700 1 -- 172.21.15.37:0/258254538 shutdown_connections 2023-07-14T15:57:06.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.071+0000 7f81a31ff700 1 -- 172.21.15.37:0/258254538 wait complete. 2023-07-14T15:57:06.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.073+0000 7f81a31ff700 1 Processor -- start 2023-07-14T15:57:06.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.073+0000 7f81a31ff700 1 -- start start 2023-07-14T15:57:06.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.074+0000 7f81a31ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f819c0d1140 0x7f819c144a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:06.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.074+0000 7f81a31ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f819c15fee0 0x7f819c0b4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:06.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.074+0000 7f81a31ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f819c1603b0 0x7f819c1f1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:06.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.074+0000 7f81a31ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819c0aff80 con 0x7f819c1603b0 2023-07-14T15:57:06.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.074+0000 7f81a31ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819c0b0260 con 0x7f819c15fee0 2023-07-14T15:57:06.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.074+0000 7f81a31ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f819c0b0540 con 0x7f819c0d1140 2023-07-14T15:57:06.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.074+0000 7f81a179c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f819c1603b0 0x7f819c1f1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:06.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.074+0000 7f81a179c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f819c1603b0 0x7f819c1f1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46788/0 (socket says 172.21.15.37:46788) 2023-07-14T15:57:06.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.075+0000 7f81a179c700 1 -- 172.21.15.37:0/1750939939 learned_addr learned my addr 172.21.15.37:0/1750939939 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:06.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.075+0000 7f819bfff700 1 --2- 172.21.15.37:0/1750939939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f819c15fee0 0x7f819c0b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:06.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.075+0000 7f81a0f9b700 1 --2- 172.21.15.37:0/1750939939 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f819c0d1140 0x7f819c144a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:06.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.075+0000 7f81a179c700 1 -- 172.21.15.37:0/1750939939 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f819c0d1140 msgr2=0x7f819c144a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:06.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.075+0000 7f81a179c700 1 --2- 172.21.15.37:0/1750939939 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f819c0d1140 0x7f819c144a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:06.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.075+0000 7f81a179c700 1 -- 172.21.15.37:0/1750939939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f819c15fee0 msgr2=0x7f819c0b4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:06.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.075+0000 7f81a179c700 1 --2- 172.21.15.37:0/1750939939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f819c15fee0 0x7f819c0b4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:06.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.075+0000 7f81a179c700 1 -- 172.21.15.37:0/1750939939 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81880094a0 con 0x7f819c1603b0 2023-07-14T15:57:06.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.075+0000 7f81a179c700 1 --2- 172.21.15.37:0/1750939939 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f819c1603b0 0x7f819c1f1a10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8194001560 tx=0x7f819400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:06.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.075+0000 7f81997fa700 1 -- 172.21.15.37:0/1750939939 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819400ada0 con 0x7f819c1603b0 2023-07-14T15:57:06.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.076+0000 7f81997fa700 1 -- 172.21.15.37:0/1750939939 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81940070d0 con 0x7f819c1603b0 2023-07-14T15:57:06.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.076+0000 7f81a31ff700 1 -- 172.21.15.37:0/1750939939 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f819c0b0820 con 0x7f819c1603b0 2023-07-14T15:57:06.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.076+0000 7f81997fa700 1 -- 172.21.15.37:0/1750939939 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8194007480 con 0x7f819c1603b0 2023-07-14T15:57:06.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.076+0000 7f81a31ff700 1 -- 172.21.15.37:0/1750939939 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f819c0b4ac0 con 0x7f819c1603b0 2023-07-14T15:57:06.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.077+0000 7f81a31ff700 1 -- 172.21.15.37:0/1750939939 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f819c0b0d40 con 0x7f819c1603b0 2023-07-14T15:57:06.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.078+0000 7f81997fa700 1 -- 172.21.15.37:0/1750939939 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f81940075e0 con 0x7f819c1603b0 2023-07-14T15:57:06.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.079+0000 7f81997fa700 1 --2- 172.21.15.37:0/1750939939 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f818006ace0 0x7f818006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:06.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.079+0000 7f81997fa700 1 -- 172.21.15.37:0/1750939939 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8194089490 con 0x7f819c1603b0 2023-07-14T15:57:06.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.080+0000 7f81a0f9b700 1 --2- 172.21.15.37:0/1750939939 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f818006ace0 0x7f818006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:06.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.080+0000 7f81a0f9b700 1 --2- 172.21.15.37:0/1750939939 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f818006ace0 0x7f818006d190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8190000f60 tx=0x7f8190009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:06.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.083+0000 7f81997fa700 1 -- 172.21.15.37:0/1750939939 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f819c0b0d40 con 0x7f819c1603b0 2023-07-14T15:57:06.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.287+0000 7f81a31ff700 1 -- 172.21.15.37:0/1750939939 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f819c0b0d40 con 0x7f819c1603b0 2023-07-14T15:57:06.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.287+0000 7f81997fa700 1 -- 172.21.15.37:0/1750939939 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f819c0b0d40 con 0x7f819c1603b0 2023-07-14T15:57:06.274 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-14T15:57:06.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.290+0000 7f81a31ff700 1 -- 172.21.15.37:0/1750939939 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f818006ace0 msgr2=0x7f818006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:06.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.290+0000 7f81a31ff700 1 --2- 172.21.15.37:0/1750939939 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f818006ace0 0x7f818006d190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8190000f60 tx=0x7f8190009040 comp rx=0 tx=0).stop 2023-07-14T15:57:06.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.290+0000 7f81a31ff700 1 -- 172.21.15.37:0/1750939939 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f819c1603b0 msgr2=0x7f819c1f1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:06.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.290+0000 7f81a31ff700 1 --2- 172.21.15.37:0/1750939939 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f819c1603b0 0x7f819c1f1a10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8194001560 tx=0x7f819400a340 comp rx=0 tx=0).stop 2023-07-14T15:57:06.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.290+0000 7f81a31ff700 1 -- 172.21.15.37:0/1750939939 shutdown_connections 2023-07-14T15:57:06.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.290+0000 7f81a31ff700 1 --2- 172.21.15.37:0/1750939939 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f818006ace0 0x7f818006d190 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:06.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.290+0000 7f81a31ff700 1 --2- 172.21.15.37:0/1750939939 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f819c1603b0 0x7f819c1f1a10 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:06.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.290+0000 7f81a31ff700 1 --2- 172.21.15.37:0/1750939939 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f819c0d1140 0x7f819c144a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:06.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.290+0000 7f81a31ff700 1 --2- 172.21.15.37:0/1750939939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f819c15fee0 0x7f819c0b4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:06.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.290+0000 7f81a31ff700 1 -- 172.21.15.37:0/1750939939 >> 172.21.15.37:0/1750939939 conn(0x7f819c09c1b0 msgr2=0x7f819c15aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:06.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.290+0000 7f81a31ff700 1 -- 172.21.15.37:0/1750939939 shutdown_connections 2023-07-14T15:57:06.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.290+0000 7f81a31ff700 1 -- 172.21.15.37:0/1750939939 wait complete. 2023-07-14T15:57:06.293 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T15:57:06.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.512+0000 7f1527fff700 1 Processor -- start 2023-07-14T15:57:06.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.512+0000 7f1527fff700 1 -- start start 2023-07-14T15:57:06.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.513+0000 7f1527fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f152015c990 0x7f15200ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:06.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.513+0000 7f1527fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f15200cc440 0x7f15200cf040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:06.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.513+0000 7f1527fff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f152006b310 con 0x7f152015cd60 2023-07-14T15:57:06.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.513+0000 7f1527fff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15200cc8a0 con 0x7f15200cc440 2023-07-14T15:57:06.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.513+0000 7f1527fff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15200ccab0 con 0x7f152015c990 2023-07-14T15:57:06.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.514+0000 7f152659c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f15200cc440 0x7f15200cf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:06.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.514+0000 7f152659c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f15200cc440 0x7f15200cf040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46796/0 (socket says 172.21.15.37:46796) 2023-07-14T15:57:06.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.514+0000 7f152659c700 1 -- 172.21.15.37:0/2404006918 learned_addr learned my addr 172.21.15.37:0/2404006918 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:06.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.514+0000 7f1525d9b700 1 --2- 172.21.15.37:0/2404006918 >> v2:172.21.15.98:3300/0 conn(0x7f152015c990 0x7f15200ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:06.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.514+0000 7f152659c700 1 -- 172.21.15.37:0/2404006918 >> v2:172.21.15.98:3300/0 conn(0x7f152015c990 msgr2=0x7f15200ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:06.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.514+0000 7f152659c700 1 --2- 172.21.15.37:0/2404006918 >> v2:172.21.15.98:3300/0 conn(0x7f152015c990 0x7f15200ceb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:06.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.514+0000 7f152659c700 1 -- 172.21.15.37:0/2404006918 >> v1:172.21.15.98:6789/0 conn(0x7f152015cd60 legacy=0x7f15200cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:06.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.514+0000 7f152659c700 1 -- 172.21.15.37:0/2404006918 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15200ccd90 con 0x7f15200cc440 2023-07-14T15:57:06.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.514+0000 7f152659c700 1 --2- 172.21.15.37:0/2404006918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15200cc440 0x7f15200cf040 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f15200b38e0 tx=0x7f151800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2814df4444490211 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:06.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.515+0000 7f1524d99700 1 -- 172.21.15.37:0/2404006918 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151800e070 con 0x7f15200cc440 2023-07-14T15:57:06.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.515+0000 7f1524d99700 1 -- 172.21.15.37:0/2404006918 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1518003a20 con 0x7f15200cc440 2023-07-14T15:57:06.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.515+0000 7f1524d99700 1 -- 172.21.15.37:0/2404006918 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1518003dd0 con 0x7f15200cc440 2023-07-14T15:57:06.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.515+0000 7f1527fff700 1 -- 172.21.15.37:0/2404006918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15200cc440 msgr2=0x7f15200cf040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:06.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.515+0000 7f1527fff700 1 --2- 172.21.15.37:0/2404006918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15200cc440 0x7f15200cf040 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f15200b38e0 tx=0x7f151800b330 comp rx=0 tx=0).stop 2023-07-14T15:57:06.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.515+0000 7f1527fff700 1 -- 172.21.15.37:0/2404006918 shutdown_connections 2023-07-14T15:57:06.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.515+0000 7f1527fff700 1 --2- 172.21.15.37:0/2404006918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15200cc440 0x7f15200cf040 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:06.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.515+0000 7f1527fff700 1 --2- 172.21.15.37:0/2404006918 >> v2:172.21.15.98:3300/0 conn(0x7f152015c990 0x7f15200ceb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:06.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.515+0000 7f1527fff700 1 -- 172.21.15.37:0/2404006918 >> 172.21.15.37:0/2404006918 conn(0x7f1520099ff0 msgr2=0x7f15200d0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:06.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.515+0000 7f1527fff700 1 -- 172.21.15.37:0/2404006918 shutdown_connections 2023-07-14T15:57:06.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.515+0000 7f1527fff700 1 -- 172.21.15.37:0/2404006918 wait complete. 2023-07-14T15:57:06.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.518+0000 7f1527fff700 1 Processor -- start 2023-07-14T15:57:06.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.518+0000 7f1527fff700 1 -- start start 2023-07-14T15:57:06.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.519+0000 7f1527fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15200cc440 0x7f15200b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:06.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.519+0000 7f1527fff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f152015c990 0x7f15201552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:06.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.519+0000 7f1527fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f152015cd60 0x7f15200c5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:06.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.519+0000 7f1527fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15201f2f70 con 0x7f15200cc440 2023-07-14T15:57:06.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.519+0000 7f1527fff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1520155820 con 0x7f152015cd60 2023-07-14T15:57:06.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.519+0000 7f1527fff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15201f23f0 con 0x7f152015c990 2023-07-14T15:57:06.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.519+0000 7f1525d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15200cc440 0x7f15200b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:06.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.520+0000 7f1525d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15200cc440 0x7f15200b3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46810/0 (socket says 172.21.15.37:46810) 2023-07-14T15:57:06.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.520+0000 7f1525d9b700 1 -- 172.21.15.37:0/2697248726 learned_addr learned my addr 172.21.15.37:0/2697248726 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:06.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.520+0000 7f152559a700 1 --2- 172.21.15.37:0/2697248726 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f152015c990 0x7f15201552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:06.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.520+0000 7f152659c700 1 --2- 172.21.15.37:0/2697248726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f152015cd60 0x7f15200c5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:06.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.520+0000 7f1525d9b700 1 -- 172.21.15.37:0/2697248726 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f152015c990 msgr2=0x7f15201552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:06.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.520+0000 7f1525d9b700 1 --2- 172.21.15.37:0/2697248726 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f152015c990 0x7f15201552e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:06.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.520+0000 7f1525d9b700 1 -- 172.21.15.37:0/2697248726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f152015cd60 msgr2=0x7f15200c5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:06.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.520+0000 7f1525d9b700 1 --2- 172.21.15.37:0/2697248726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f152015cd60 0x7f15200c5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:06.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.520+0000 7f1525d9b700 1 -- 172.21.15.37:0/2697248726 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1518009b30 con 0x7f15200cc440 2023-07-14T15:57:06.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.520+0000 7f1525d9b700 1 --2- 172.21.15.37:0/2697248726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15200cc440 0x7f15200b3b50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f151c00e810 tx=0x7f151c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:06.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.520+0000 7f15167fc700 1 -- 172.21.15.37:0/2697248726 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c00c070 con 0x7f15200cc440 2023-07-14T15:57:06.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.520+0000 7f15167fc700 1 -- 172.21.15.37:0/2697248726 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f151c013610 con 0x7f15200cc440 2023-07-14T15:57:06.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.520+0000 7f1527fff700 1 -- 172.21.15.37:0/2697248726 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15201f26d0 con 0x7f15200cc440 2023-07-14T15:57:06.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.520+0000 7f15167fc700 1 -- 172.21.15.37:0/2697248726 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c0139c0 con 0x7f15200cc440 2023-07-14T15:57:06.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.521+0000 7f1527fff700 1 -- 172.21.15.37:0/2697248726 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15201f2c90 con 0x7f15200cc440 2023-07-14T15:57:06.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.521+0000 7f1527fff700 1 -- 172.21.15.37:0/2697248726 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1520067840 con 0x7f15200cc440 2023-07-14T15:57:06.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.523+0000 7f15167fc700 1 -- 172.21.15.37:0/2697248726 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f151c013b20 con 0x7f15200cc440 2023-07-14T15:57:06.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.523+0000 7f15167fc700 1 --2- 172.21.15.37:0/2697248726 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f150406ace0 0x7f150406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:06.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.524+0000 7f15167fc700 1 -- 172.21.15.37:0/2697248726 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f151c089260 con 0x7f15200cc440 2023-07-14T15:57:06.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.524+0000 7f152559a700 1 --2- 172.21.15.37:0/2697248726 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f150406ace0 0x7f150406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:06.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.525+0000 7f152559a700 1 --2- 172.21.15.37:0/2697248726 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f150406ace0 0x7f150406d190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f15201f65e0 tx=0x7f15100090e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:06.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.528+0000 7f15167fc700 1 -- 172.21.15.37:0/2697248726 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f151c057d10 con 0x7f15200cc440 2023-07-14T15:57:06.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.735+0000 7f1527fff700 1 -- 172.21.15.37:0/2697248726 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f15200d0fc0 con 0x7f15200cc440 2023-07-14T15:57:06.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.736+0000 7f15167fc700 1 -- 172.21.15.37:0/2697248726 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f151c0578a0 con 0x7f15200cc440 2023-07-14T15:57:06.721 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-14T15:57:06.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.738+0000 7f1527fff700 1 -- 172.21.15.37:0/2697248726 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f150406ace0 msgr2=0x7f150406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:06.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.738+0000 7f1527fff700 1 --2- 172.21.15.37:0/2697248726 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f150406ace0 0x7f150406d190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f15201f65e0 tx=0x7f15100090e0 comp rx=0 tx=0).stop 2023-07-14T15:57:06.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.738+0000 7f1527fff700 1 -- 172.21.15.37:0/2697248726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15200cc440 msgr2=0x7f15200b3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:06.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.738+0000 7f1527fff700 1 --2- 172.21.15.37:0/2697248726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15200cc440 0x7f15200b3b50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f151c00e810 tx=0x7f151c00eb20 comp rx=0 tx=0).stop 2023-07-14T15:57:06.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.738+0000 7f1527fff700 1 -- 172.21.15.37:0/2697248726 shutdown_connections 2023-07-14T15:57:06.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.738+0000 7f1527fff700 1 --2- 172.21.15.37:0/2697248726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f152015cd60 0x7f15200c5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:06.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.738+0000 7f1527fff700 1 --2- 172.21.15.37:0/2697248726 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f150406ace0 0x7f150406d190 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:06.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.738+0000 7f1527fff700 1 --2- 172.21.15.37:0/2697248726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15200cc440 0x7f15200b3b50 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:06.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.738+0000 7f1527fff700 1 --2- 172.21.15.37:0/2697248726 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f152015c990 0x7f15201552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:06.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.738+0000 7f1527fff700 1 -- 172.21.15.37:0/2697248726 >> 172.21.15.37:0/2697248726 conn(0x7f1520099ff0 msgr2=0x7f15200d14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:06.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.738+0000 7f1527fff700 1 -- 172.21.15.37:0/2697248726 shutdown_connections 2023-07-14T15:57:06.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.738+0000 7f1527fff700 1 -- 172.21.15.37:0/2697248726 wait complete. 2023-07-14T15:57:06.742 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T15:57:06.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.961+0000 7f5df6bff700 1 Processor -- start 2023-07-14T15:57:06.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.961+0000 7f5df6bff700 1 -- start start 2023-07-14T15:57:06.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.963+0000 7f5df6bff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5df015fee0 0x7f5df015ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:06.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.963+0000 7f5df6bff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f5df01603b0 0x7f5df00d0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:06.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.963+0000 7f5df6bff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5df00d1370 con 0x7f5df00d0f70 2023-07-14T15:57:06.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.963+0000 7f5df6bff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5df015dc50 con 0x7f5df015fee0 2023-07-14T15:57:06.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.963+0000 7f5df6bff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5df00b2940 con 0x7f5df01603b0 2023-07-14T15:57:06.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.963+0000 7f5df499b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5df015fee0 0x7f5df015ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:06.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.963+0000 7f5df519c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5df00d0f70 0x7f5df00b39e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42738/0 (socket says 172.21.15.37:42738) 2023-07-14T15:57:06.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.963+0000 7f5df519c700 1 -- 172.21.15.37:0/679246089 learned_addr learned my addr 172.21.15.37:0/679246089 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:06.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.963+0000 7f5deffff700 1 --2- 172.21.15.37:0/679246089 >> v2:172.21.15.98:3300/0 conn(0x7f5df01603b0 0x7f5df00d0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:06.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.963+0000 7f5df499b700 1 -- 172.21.15.37:0/679246089 >> v2:172.21.15.98:3300/0 conn(0x7f5df01603b0 msgr2=0x7f5df00d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:06.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.963+0000 7f5df499b700 1 --2- 172.21.15.37:0/679246089 >> v2:172.21.15.98:3300/0 conn(0x7f5df01603b0 0x7f5df00d0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:06.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.963+0000 7f5df499b700 1 -- 172.21.15.37:0/679246089 >> v1:172.21.15.37:6789/0 conn(0x7f5df00d0f70 legacy=0x7f5df00b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:06.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.964+0000 7f5df499b700 1 -- 172.21.15.37:0/679246089 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df00b2c20 con 0x7f5df015fee0 2023-07-14T15:57:06.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.964+0000 7f5df499b700 1 --2- 172.21.15.37:0/679246089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5df015fee0 0x7f5df015ded0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5df008d510 tx=0x7f5de4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e058e1edd5518f69 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:06.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.964+0000 7f5def7fe700 1 -- 172.21.15.37:0/679246089 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de4011830 con 0x7f5df015fee0 2023-07-14T15:57:06.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.964+0000 7f5def7fe700 1 -- 172.21.15.37:0/679246089 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de4011990 con 0x7f5df015fee0 2023-07-14T15:57:06.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.964+0000 7f5def7fe700 1 -- 172.21.15.37:0/679246089 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de4011d20 con 0x7f5df015fee0 2023-07-14T15:57:06.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.965+0000 7f5df6bff700 1 -- 172.21.15.37:0/679246089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5df015fee0 msgr2=0x7f5df015ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:06.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.965+0000 7f5df6bff700 1 --2- 172.21.15.37:0/679246089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5df015fee0 0x7f5df015ded0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5df008d510 tx=0x7f5de4009b20 comp rx=0 tx=0).stop 2023-07-14T15:57:06.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.965+0000 7f5df6bff700 1 -- 172.21.15.37:0/679246089 shutdown_connections 2023-07-14T15:57:06.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.965+0000 7f5df6bff700 1 --2- 172.21.15.37:0/679246089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5df015fee0 0x7f5df015ded0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:06.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.965+0000 7f5df6bff700 1 --2- 172.21.15.37:0/679246089 >> v2:172.21.15.98:3300/0 conn(0x7f5df01603b0 0x7f5df00d0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:06.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.965+0000 7f5df6bff700 1 -- 172.21.15.37:0/679246089 >> 172.21.15.37:0/679246089 conn(0x7f5df009c1b0 msgr2=0x7f5df00d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:06.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.965+0000 7f5df6bff700 1 -- 172.21.15.37:0/679246089 shutdown_connections 2023-07-14T15:57:06.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.965+0000 7f5df6bff700 1 -- 172.21.15.37:0/679246089 wait complete. 2023-07-14T15:57:06.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.966+0000 7f5df6bff700 1 Processor -- start 2023-07-14T15:57:06.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.967+0000 7f5df6bff700 1 -- start start 2023-07-14T15:57:06.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.968+0000 7f5df6bff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5df00d0f70 0x7f5df0154ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:06.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.968+0000 7f5df6bff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5df015fee0 0x7f5df00c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:06.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.968+0000 7f5df6bff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5df01603b0 0x7f5df00c8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:06.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.968+0000 7f5df6bff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df00b66a0 con 0x7f5df01603b0 2023-07-14T15:57:06.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.968+0000 7f5df6bff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df00b6980 con 0x7f5df015fee0 2023-07-14T15:57:06.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.968+0000 7f5df6bff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df00b6c60 con 0x7f5df00d0f70 2023-07-14T15:57:06.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.968+0000 7f5df519c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5df01603b0 0x7f5df00c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:06.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.968+0000 7f5df519c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5df01603b0 0x7f5df00c8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46840/0 (socket says 172.21.15.37:46840) 2023-07-14T15:57:06.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.968+0000 7f5df519c700 1 -- 172.21.15.37:0/799954829 learned_addr learned my addr 172.21.15.37:0/799954829 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:06.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.968+0000 7f5df499b700 1 --2- 172.21.15.37:0/799954829 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5df00d0f70 0x7f5df0154ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:06.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.968+0000 7f5deffff700 1 --2- 172.21.15.37:0/799954829 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5df015fee0 0x7f5df00c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:06.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.968+0000 7f5df519c700 1 -- 172.21.15.37:0/799954829 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5df00d0f70 msgr2=0x7f5df0154ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:06.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.968+0000 7f5df519c700 1 --2- 172.21.15.37:0/799954829 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5df00d0f70 0x7f5df0154ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:06.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.968+0000 7f5df519c700 1 -- 172.21.15.37:0/799954829 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5df015fee0 msgr2=0x7f5df00c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:06.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.968+0000 7f5df519c700 1 --2- 172.21.15.37:0/799954829 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5df015fee0 0x7f5df00c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:06.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.968+0000 7f5df519c700 1 -- 172.21.15.37:0/799954829 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de40094a0 con 0x7f5df01603b0 2023-07-14T15:57:06.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.969+0000 7f5df519c700 1 --2- 172.21.15.37:0/799954829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5df01603b0 0x7f5df00c8580 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5de800cbc0 tx=0x7f5de800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:06.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.969+0000 7f5ded7fa700 1 -- 172.21.15.37:0/799954829 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de800a9e0 con 0x7f5df01603b0 2023-07-14T15:57:06.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.969+0000 7f5ded7fa700 1 -- 172.21.15.37:0/799954829 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de800ab40 con 0x7f5df01603b0 2023-07-14T15:57:06.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.969+0000 7f5ded7fa700 1 -- 172.21.15.37:0/799954829 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de8012400 con 0x7f5df01603b0 2023-07-14T15:57:06.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.969+0000 7f5df6bff700 1 -- 172.21.15.37:0/799954829 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5df00b6f40 con 0x7f5df01603b0 2023-07-14T15:57:06.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.969+0000 7f5df6bff700 1 -- 172.21.15.37:0/799954829 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df00b7740 con 0x7f5df01603b0 2023-07-14T15:57:06.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.970+0000 7f5df6bff700 1 -- 172.21.15.37:0/799954829 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5df0067840 con 0x7f5df01603b0 2023-07-14T15:57:06.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.971+0000 7f5ded7fa700 1 -- 172.21.15.37:0/799954829 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5de801b3b0 con 0x7f5df01603b0 2023-07-14T15:57:06.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.972+0000 7f5ded7fa700 1 --2- 172.21.15.37:0/799954829 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f5dd406ace0 0x7f5dd406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:06.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.972+0000 7f5ded7fa700 1 -- 172.21.15.37:0/799954829 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5de8088f20 con 0x7f5df01603b0 2023-07-14T15:57:06.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.973+0000 7f5df499b700 1 --2- 172.21.15.37:0/799954829 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f5dd406ace0 0x7f5dd406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:06.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.973+0000 7f5df499b700 1 --2- 172.21.15.37:0/799954829 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f5dd406ace0 0x7f5dd406d190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5de40090b0 tx=0x7f5de4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:06.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:06.976+0000 7f5ded7fa700 1 -- 172.21.15.37:0/799954829 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5de8054070 con 0x7f5df01603b0 2023-07-14T15:57:07.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.186+0000 7f5df6bff700 1 -- 172.21.15.37:0/799954829 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5df00d21c0 con 0x7f5df01603b0 2023-07-14T15:57:07.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.186+0000 7f5ded7fa700 1 -- 172.21.15.37:0/799954829 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5de8017020 con 0x7f5df01603b0 2023-07-14T15:57:07.171 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-14T15:57:07.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.188+0000 7f5df6bff700 1 -- 172.21.15.37:0/799954829 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f5dd406ace0 msgr2=0x7f5dd406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:07.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.188+0000 7f5df6bff700 1 --2- 172.21.15.37:0/799954829 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f5dd406ace0 0x7f5dd406d190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5de40090b0 tx=0x7f5de4008030 comp rx=0 tx=0).stop 2023-07-14T15:57:07.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.188+0000 7f5df6bff700 1 -- 172.21.15.37:0/799954829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5df01603b0 msgr2=0x7f5df00c8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:07.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.188+0000 7f5df6bff700 1 --2- 172.21.15.37:0/799954829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5df01603b0 0x7f5df00c8580 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5de800cbc0 tx=0x7f5de800ced0 comp rx=0 tx=0).stop 2023-07-14T15:57:07.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.189+0000 7f5df6bff700 1 -- 172.21.15.37:0/799954829 shutdown_connections 2023-07-14T15:57:07.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.189+0000 7f5df6bff700 1 --2- 172.21.15.37:0/799954829 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f5dd406ace0 0x7f5dd406d190 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:07.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.189+0000 7f5df6bff700 1 --2- 172.21.15.37:0/799954829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5df01603b0 0x7f5df00c8580 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:07.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.189+0000 7f5df6bff700 1 --2- 172.21.15.37:0/799954829 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5df00d0f70 0x7f5df0154ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:07.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.189+0000 7f5df6bff700 1 --2- 172.21.15.37:0/799954829 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5df015fee0 0x7f5df00c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:07.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.189+0000 7f5df6bff700 1 -- 172.21.15.37:0/799954829 >> 172.21.15.37:0/799954829 conn(0x7f5df009c1b0 msgr2=0x7f5df00b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:07.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.189+0000 7f5df6bff700 1 -- 172.21.15.37:0/799954829 shutdown_connections 2023-07-14T15:57:07.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.189+0000 7f5df6bff700 1 -- 172.21.15.37:0/799954829 wait complete. 2023-07-14T15:57:07.193 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-14T15:57:07.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.411+0000 7f6f4b1ff700 1 Processor -- start 2023-07-14T15:57:07.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.411+0000 7f6f4b1ff700 1 -- start start 2023-07-14T15:57:07.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.412+0000 7f6f4b1ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6f440b8900 0x7f6f440cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:07.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.412+0000 7f6f4b1ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f440b6270 con 0x7f6f440b5e00 2023-07-14T15:57:07.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.412+0000 7f6f4b1ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f440cdb50 con 0x7f6f440d15c0 2023-07-14T15:57:07.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.412+0000 7f6f4b1ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f4415d030 con 0x7f6f440b8900 2023-07-14T15:57:07.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.413+0000 7f6f43fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6f440b5e00 0x7f6f440d0eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42744/0 (socket says 172.21.15.37:42744) 2023-07-14T15:57:07.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.413+0000 7f6f43fff700 1 -- 172.21.15.37:0/1523811388 learned_addr learned my addr 172.21.15.37:0/1523811388 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:07.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.413+0000 7f6f48f9b700 1 --2- 172.21.15.37:0/1523811388 >> v2:172.21.15.37:3300/0 conn(0x7f6f440b8900 0x7f6f440cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:07.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.413+0000 7f6f437fe700 1 -- 172.21.15.37:0/1523811388 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 349269161 0 0) 0x7f6f440b6270 con 0x7f6f440b5e00 2023-07-14T15:57:07.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.413+0000 7f6f48f9b700 1 -- 172.21.15.37:0/1523811388 >> v1:172.21.15.98:6789/0 conn(0x7f6f440d15c0 legacy=0x7f6f440cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:07.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.413+0000 7f6f48f9b700 1 -- 172.21.15.37:0/1523811388 >> v1:172.21.15.37:6789/0 conn(0x7f6f440b5e00 legacy=0x7f6f440d0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:07.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.413+0000 7f6f48f9b700 1 -- 172.21.15.37:0/1523811388 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f440cde30 con 0x7f6f440b8900 2023-07-14T15:57:07.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.413+0000 7f6f48f9b700 1 --2- 172.21.15.37:0/1523811388 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f440b8900 0x7f6f440cd570 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6f38009820 tx=0x7f6f38009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eca384a9942ada5d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:07.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.414+0000 7f6f437fe700 1 -- 172.21.15.37:0/1523811388 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f38005e30 con 0x7f6f440b8900 2023-07-14T15:57:07.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.414+0000 7f6f437fe700 1 -- 172.21.15.37:0/1523811388 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f38004030 con 0x7f6f440b8900 2023-07-14T15:57:07.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.414+0000 7f6f437fe700 1 -- 172.21.15.37:0/1523811388 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f380043c0 con 0x7f6f440b8900 2023-07-14T15:57:07.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.414+0000 7f6f4b1ff700 1 -- 172.21.15.37:0/1523811388 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f440b8900 msgr2=0x7f6f440cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:07.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.414+0000 7f6f4b1ff700 1 --2- 172.21.15.37:0/1523811388 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f440b8900 0x7f6f440cd570 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6f38009820 tx=0x7f6f38009b30 comp rx=0 tx=0).stop 2023-07-14T15:57:07.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.414+0000 7f6f4b1ff700 1 -- 172.21.15.37:0/1523811388 shutdown_connections 2023-07-14T15:57:07.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.414+0000 7f6f4b1ff700 1 --2- 172.21.15.37:0/1523811388 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f440b8900 0x7f6f440cd570 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:07.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.414+0000 7f6f4b1ff700 1 -- 172.21.15.37:0/1523811388 >> 172.21.15.37:0/1523811388 conn(0x7f6f4409c1e0 msgr2=0x7f6f440d2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:07.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.414+0000 7f6f4b1ff700 1 -- 172.21.15.37:0/1523811388 shutdown_connections 2023-07-14T15:57:07.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.414+0000 7f6f4b1ff700 1 -- 172.21.15.37:0/1523811388 wait complete. 2023-07-14T15:57:07.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.416+0000 7f6f4b1ff700 1 Processor -- start 2023-07-14T15:57:07.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.416+0000 7f6f4b1ff700 1 -- start start 2023-07-14T15:57:07.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.417+0000 7f6f4b1ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f440b5e00 0x7f6f440c9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:07.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.417+0000 7f6f4b1ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6f440b8900 0x7f6f440b2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:07.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.417+0000 7f6f4b1ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6f440d15c0 0x7f6f440ccc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:07.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.417+0000 7f6f4b1ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f440b3fb0 con 0x7f6f440b5e00 2023-07-14T15:57:07.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.417+0000 7f6f4b1ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f440b3330 con 0x7f6f440d15c0 2023-07-14T15:57:07.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.417+0000 7f6f4b1ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f440b3610 con 0x7f6f440b8900 2023-07-14T15:57:07.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.417+0000 7f6f48f9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f440b5e00 0x7f6f440c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:07.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.418+0000 7f6f48f9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f440b5e00 0x7f6f440c9440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46854/0 (socket says 172.21.15.37:46854) 2023-07-14T15:57:07.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.418+0000 7f6f48f9b700 1 -- 172.21.15.37:0/2707051014 learned_addr learned my addr 172.21.15.37:0/2707051014 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:07.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.418+0000 7f6f43fff700 1 --2- 172.21.15.37:0/2707051014 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6f440b8900 0x7f6f440b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:07.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.418+0000 7f6f4979c700 1 --2- 172.21.15.37:0/2707051014 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6f440d15c0 0x7f6f440ccc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:07.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.418+0000 7f6f48f9b700 1 -- 172.21.15.37:0/2707051014 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6f440b8900 msgr2=0x7f6f440b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:07.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.418+0000 7f6f48f9b700 1 --2- 172.21.15.37:0/2707051014 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6f440b8900 0x7f6f440b2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:07.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.418+0000 7f6f48f9b700 1 -- 172.21.15.37:0/2707051014 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6f440d15c0 msgr2=0x7f6f440ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:07.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.418+0000 7f6f48f9b700 1 --2- 172.21.15.37:0/2707051014 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6f440d15c0 0x7f6f440ccc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:07.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.418+0000 7f6f48f9b700 1 -- 172.21.15.37:0/2707051014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f38009430 con 0x7f6f440b5e00 2023-07-14T15:57:07.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.418+0000 7f6f43fff700 1 --2- 172.21.15.37:0/2707051014 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6f440b8900 0x7f6f440b2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:57:07.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.418+0000 7f6f4979c700 1 --2- 172.21.15.37:0/2707051014 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6f440d15c0 0x7f6f440ccc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:57:07.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.418+0000 7f6f48f9b700 1 --2- 172.21.15.37:0/2707051014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f440b5e00 0x7f6f440c9440 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6f38000c00 tx=0x7f6f38004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:07.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.418+0000 7f6f417fa700 1 -- 172.21.15.37:0/2707051014 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3801d630 con 0x7f6f440b5e00 2023-07-14T15:57:07.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.419+0000 7f6f417fa700 1 -- 172.21.15.37:0/2707051014 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f3801d790 con 0x7f6f440b5e00 2023-07-14T15:57:07.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.419+0000 7f6f417fa700 1 -- 172.21.15.37:0/2707051014 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3801db40 con 0x7f6f440b5e00 2023-07-14T15:57:07.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.419+0000 7f6f4b1ff700 1 -- 172.21.15.37:0/2707051014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f440b38f0 con 0x7f6f440b5e00 2023-07-14T15:57:07.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.419+0000 7f6f4b1ff700 1 -- 172.21.15.37:0/2707051014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f441f23b0 con 0x7f6f440b5e00 2023-07-14T15:57:07.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.420+0000 7f6f4b1ff700 1 -- 172.21.15.37:0/2707051014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f440b40f0 con 0x7f6f440b5e00 2023-07-14T15:57:07.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.421+0000 7f6f417fa700 1 -- 172.21.15.37:0/2707051014 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6f3801dca0 con 0x7f6f440b5e00 2023-07-14T15:57:07.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.422+0000 7f6f417fa700 1 --2- 172.21.15.37:0/2707051014 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f6f2806ace0 0x7f6f2806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:07.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.423+0000 7f6f417fa700 1 -- 172.21.15.37:0/2707051014 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6f3808ac80 con 0x7f6f440b5e00 2023-07-14T15:57:07.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.423+0000 7f6f43fff700 1 --2- 172.21.15.37:0/2707051014 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f6f2806ace0 0x7f6f2806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:07.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.423+0000 7f6f43fff700 1 --2- 172.21.15.37:0/2707051014 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f6f2806ace0 0x7f6f2806d190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6f441f3220 tx=0x7f6f30007ca0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:07.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.427+0000 7f6f417fa700 1 -- 172.21.15.37:0/2707051014 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6f440b40f0 con 0x7f6f440b5e00 2023-07-14T15:57:07.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.653+0000 7f6f4b1ff700 1 -- 172.21.15.37:0/2707051014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6f440b40f0 con 0x7f6f440b5e00 2023-07-14T15:57:07.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.653+0000 7f6f417fa700 1 -- 172.21.15.37:0/2707051014 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6f440b40f0 con 0x7f6f440b5e00 2023-07-14T15:57:07.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.655+0000 7f6f4b1ff700 1 -- 172.21.15.37:0/2707051014 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f6f2806ace0 msgr2=0x7f6f2806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:07.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.655+0000 7f6f4b1ff700 1 --2- 172.21.15.37:0/2707051014 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f6f2806ace0 0x7f6f2806d190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6f441f3220 tx=0x7f6f30007ca0 comp rx=0 tx=0).stop 2023-07-14T15:57:07.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.655+0000 7f6f4b1ff700 1 -- 172.21.15.37:0/2707051014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f440b5e00 msgr2=0x7f6f440c9440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:07.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.655+0000 7f6f4b1ff700 1 --2- 172.21.15.37:0/2707051014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f440b5e00 0x7f6f440c9440 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6f38000c00 tx=0x7f6f38004750 comp rx=0 tx=0).stop 2023-07-14T15:57:07.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.656+0000 7f6f4b1ff700 1 -- 172.21.15.37:0/2707051014 shutdown_connections 2023-07-14T15:57:07.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.656+0000 7f6f4b1ff700 1 --2- 172.21.15.37:0/2707051014 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6f440d15c0 0x7f6f440ccc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:07.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.656+0000 7f6f4b1ff700 1 --2- 172.21.15.37:0/2707051014 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f6f2806ace0 0x7f6f2806d190 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:07.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.656+0000 7f6f4b1ff700 1 --2- 172.21.15.37:0/2707051014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f440b5e00 0x7f6f440c9440 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:07.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.656+0000 7f6f4b1ff700 1 --2- 172.21.15.37:0/2707051014 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6f440b8900 0x7f6f440b2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:07.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.656+0000 7f6f4b1ff700 1 -- 172.21.15.37:0/2707051014 >> 172.21.15.37:0/2707051014 conn(0x7f6f4409c1e0 msgr2=0x7f6f440b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:07.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.656+0000 7f6f4b1ff700 1 -- 172.21.15.37:0/2707051014 shutdown_connections 2023-07-14T15:57:07.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:07.656+0000 7f6f4b1ff700 1 -- 172.21.15.37:0/2707051014 wait complete. 2023-07-14T15:57:07.643 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2023-07-14T15:57:07.658 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-07-14T15:57:07.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:57:07.659 DEBUG:teuthology.orchestra.run.smithi098:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-07-14T15:57:07.748 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi098.front.sepia.ceph.com 2023-07-14T15:57:07.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:57:07.749 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-07-14T15:57:07.794 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-14T15:57:07.794 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T15:57:07.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.011+0000 7f41babff700 1 Processor -- start 2023-07-14T15:57:07.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.012+0000 7f41babff700 1 -- start start 2023-07-14T15:57:07.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.013+0000 7f41babff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f41b40b54b0 0x7f41b40cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:07.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.013+0000 7f41babff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f41b40b4910 0x7f41b40b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:07.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.013+0000 7f41babff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41b40cf6b0 con 0x7f41b40b85f0 2023-07-14T15:57:07.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.013+0000 7f41babff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41b40b52d0 con 0x7f41b40b4910 2023-07-14T15:57:07.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.013+0000 7f41babff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41b40cdc40 con 0x7f41b40b54b0 2023-07-14T15:57:07.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.013+0000 7f41b899b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f41b40b85f0 0x7f41b415d660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42760/0 (socket says 172.21.15.37:42760) 2023-07-14T15:57:07.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.013+0000 7f41b899b700 1 -- 172.21.15.37:0/204205612 learned_addr learned my addr 172.21.15.37:0/204205612 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:08.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.013+0000 7f41b919c700 1 --2- 172.21.15.37:0/204205612 >> v2:172.21.15.98:3300/0 conn(0x7f41b40b4910 0x7f41b40b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:08.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.013+0000 7f41b3fff700 1 --2- 172.21.15.37:0/204205612 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f41b40b54b0 0x7f41b40cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:08.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.013+0000 7f41b37fe700 1 -- 172.21.15.37:0/204205612 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 79059720 0 0) 0x7f41b40cf6b0 con 0x7f41b40b85f0 2023-07-14T15:57:08.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.014+0000 7f41b37fe700 1 -- 172.21.15.37:0/204205612 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41a40035b0 con 0x7f41b40b85f0 2023-07-14T15:57:08.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.014+0000 7f41b37fe700 1 -- 172.21.15.37:0/204205612 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2396774484 0 0) 0x7f41a40035b0 con 0x7f41b40b85f0 2023-07-14T15:57:08.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.014+0000 7f41b919c700 1 -- 172.21.15.37:0/204205612 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f41b40b54b0 msgr2=0x7f41b40cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:08.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.014+0000 7f41b919c700 1 --2- 172.21.15.37:0/204205612 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f41b40b54b0 0x7f41b40cfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:08.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.014+0000 7f41b919c700 1 -- 172.21.15.37:0/204205612 >> v1:172.21.15.37:6789/0 conn(0x7f41b40b85f0 legacy=0x7f41b415d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:08.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.014+0000 7f41b919c700 1 -- 172.21.15.37:0/204205612 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b40cf0a0 con 0x7f41b40b4910 2023-07-14T15:57:08.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.014+0000 7f41b3fff700 1 --2- 172.21.15.37:0/204205612 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f41b40b54b0 0x7f41b40cfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:57:08.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.014+0000 7f41b919c700 1 --2- 172.21.15.37:0/204205612 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41b40b4910 0x7f41b40b4d90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f41ac009d90 tx=0x7f41ac00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3b9e5c3745330bd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:08.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.014+0000 7f41b37fe700 1 -- 172.21.15.37:0/204205612 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ac00e070 con 0x7f41b40b4910 2023-07-14T15:57:08.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.014+0000 7f41b37fe700 1 -- 172.21.15.37:0/204205612 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41ac003a20 con 0x7f41b40b4910 2023-07-14T15:57:08.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.014+0000 7f41b37fe700 1 -- 172.21.15.37:0/204205612 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a8001670 con 0x7f41b40b4910 2023-07-14T15:57:08.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.015+0000 7f41babff700 1 -- 172.21.15.37:0/204205612 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41b40b4910 msgr2=0x7f41b40b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:08.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.015+0000 7f41babff700 1 --2- 172.21.15.37:0/204205612 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41b40b4910 0x7f41b40b4d90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f41ac009d90 tx=0x7f41ac00b330 comp rx=0 tx=0).stop 2023-07-14T15:57:08.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.015+0000 7f41babff700 1 -- 172.21.15.37:0/204205612 shutdown_connections 2023-07-14T15:57:08.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.015+0000 7f41babff700 1 --2- 172.21.15.37:0/204205612 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41b40b4910 0x7f41b40b4d90 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:08.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.015+0000 7f41babff700 1 --2- 172.21.15.37:0/204205612 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f41b40b54b0 0x7f41b40cfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:08.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.015+0000 7f41babff700 1 -- 172.21.15.37:0/204205612 >> 172.21.15.37:0/204205612 conn(0x7f41b406a580 msgr2=0x7f41b406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:08.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.015+0000 7f41babff700 1 -- 172.21.15.37:0/204205612 shutdown_connections 2023-07-14T15:57:08.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.015+0000 7f41babff700 1 -- 172.21.15.37:0/204205612 wait complete. 2023-07-14T15:57:08.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.017+0000 7f41babff700 1 Processor -- start 2023-07-14T15:57:08.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.017+0000 7f41babff700 1 -- start start 2023-07-14T15:57:08.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.018+0000 7f41babff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41b40b4910 0x7f41b41f5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:08.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.018+0000 7f41babff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f41b40b54b0 0x7f41b4155450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:08.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.018+0000 7f41babff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41b40b85f0 0x7f41b41563a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:08.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.018+0000 7f41babff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b41f6450 con 0x7f41b40b4910 2023-07-14T15:57:08.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.018+0000 7f41babff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b40c6b20 con 0x7f41b40b85f0 2023-07-14T15:57:08.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.018+0000 7f41babff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41b40c6e00 con 0x7f41b40b54b0 2023-07-14T15:57:08.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.018+0000 7f41b899b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41b40b4910 0x7f41b41f5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:08.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.018+0000 7f41b899b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41b40b4910 0x7f41b41f5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46860/0 (socket says 172.21.15.37:46860) 2023-07-14T15:57:08.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.018+0000 7f41b899b700 1 -- 172.21.15.37:0/2220077731 learned_addr learned my addr 172.21.15.37:0/2220077731 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:08.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.018+0000 7f41b919c700 1 --2- 172.21.15.37:0/2220077731 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41b40b85f0 0x7f41b41563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:08.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.018+0000 7f41b3fff700 1 --2- 172.21.15.37:0/2220077731 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f41b40b54b0 0x7f41b4155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:08.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.018+0000 7f41b899b700 1 -- 172.21.15.37:0/2220077731 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f41b40b54b0 msgr2=0x7f41b4155450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:08.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.018+0000 7f41b899b700 1 --2- 172.21.15.37:0/2220077731 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f41b40b54b0 0x7f41b4155450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:08.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.018+0000 7f41b899b700 1 -- 172.21.15.37:0/2220077731 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41b40b85f0 msgr2=0x7f41b41563a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:08.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.018+0000 7f41b899b700 1 --2- 172.21.15.37:0/2220077731 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41b40b85f0 0x7f41b41563a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:08.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.018+0000 7f41b899b700 1 -- 172.21.15.37:0/2220077731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a00094a0 con 0x7f41b40b4910 2023-07-14T15:57:08.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.018+0000 7f41b3fff700 1 --2- 172.21.15.37:0/2220077731 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f41b40b54b0 0x7f41b4155450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:57:08.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.019+0000 7f41b899b700 1 --2- 172.21.15.37:0/2220077731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41b40b4910 0x7f41b41f5f10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f41a800c750 tx=0x7f41a800ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:08.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.019+0000 7f41b17fa700 1 -- 172.21.15.37:0/2220077731 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a8004c80 con 0x7f41b40b4910 2023-07-14T15:57:08.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.019+0000 7f41b17fa700 1 -- 172.21.15.37:0/2220077731 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a8004de0 con 0x7f41b40b4910 2023-07-14T15:57:08.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.019+0000 7f41b17fa700 1 -- 172.21.15.37:0/2220077731 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a8007310 con 0x7f41b40b4910 2023-07-14T15:57:08.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.019+0000 7f41babff700 1 -- 172.21.15.37:0/2220077731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41ac009a70 con 0x7f41b40b4910 2023-07-14T15:57:08.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.019+0000 7f41babff700 1 -- 172.21.15.37:0/2220077731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41b40c73c0 con 0x7f41b40b4910 2023-07-14T15:57:08.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.020+0000 7f41babff700 1 -- 172.21.15.37:0/2220077731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41b4067840 con 0x7f41b40b4910 2023-07-14T15:57:08.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.021+0000 7f41b17fa700 1 -- 172.21.15.37:0/2220077731 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f41a8007470 con 0x7f41b40b4910 2023-07-14T15:57:08.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.023+0000 7f41b17fa700 1 --2- 172.21.15.37:0/2220077731 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f419806ace0 0x7f419806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:08.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.023+0000 7f41b17fa700 1 -- 172.21.15.37:0/2220077731 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f41a80891f0 con 0x7f41b40b4910 2023-07-14T15:57:08.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.023+0000 7f41b3fff700 1 --2- 172.21.15.37:0/2220077731 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f419806ace0 0x7f419806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:08.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.024+0000 7f41b3fff700 1 --2- 172.21.15.37:0/2220077731 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f419806ace0 0x7f419806d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f41b40b4d90 tx=0x7f41a0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:08.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.027+0000 7f41b17fa700 1 -- 172.21.15.37:0/2220077731 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f41a8054200 con 0x7f41b40b4910 2023-07-14T15:57:08.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.280+0000 7f41babff700 1 -- 172.21.15.37:0/2220077731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f41b406b440 con 0x7f41b40b4910 2023-07-14T15:57:08.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.281+0000 7f41b17fa700 1 -- 172.21.15.37:0/2220077731 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4697 (secure 0 0 0) 0x7f41a8057820 con 0x7f41b40b4910 2023-07-14T15:57:08.266 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:57:08.266 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/596800720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":596800720},{"type":"v1","addr":"172.21.15.37:6835","nonce":596800720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4318,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/1611780456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1611780456},{"type":"v1","addr":"172.21.15.37:6834","nonce":1611780456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4324,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/586880065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":586880065},{"type":"v1","addr":"172.21.15.98:6835","nonce":586880065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T15:56:08.459886+0000","modified":"2023-07-14T15:56:11.974298+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4327},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4327":{"gid":4327,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6837/2731892479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2731892479},{"type":"v1","addr":"172.21.15.98:6837","nonce":2731892479}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T15:57:08.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.283+0000 7f41babff700 1 -- 172.21.15.37:0/2220077731 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f419806ace0 msgr2=0x7f419806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:08.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.283+0000 7f41babff700 1 --2- 172.21.15.37:0/2220077731 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f419806ace0 0x7f419806d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f41b40b4d90 tx=0x7f41a0008040 comp rx=0 tx=0).stop 2023-07-14T15:57:08.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.283+0000 7f41babff700 1 -- 172.21.15.37:0/2220077731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41b40b4910 msgr2=0x7f41b41f5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:08.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.283+0000 7f41babff700 1 --2- 172.21.15.37:0/2220077731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41b40b4910 0x7f41b41f5f10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f41a800c750 tx=0x7f41a800ca60 comp rx=0 tx=0).stop 2023-07-14T15:57:08.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.284+0000 7f41babff700 1 -- 172.21.15.37:0/2220077731 shutdown_connections 2023-07-14T15:57:08.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.284+0000 7f41babff700 1 --2- 172.21.15.37:0/2220077731 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41b40b85f0 0x7f41b41563a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:08.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.284+0000 7f41babff700 1 --2- 172.21.15.37:0/2220077731 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f419806ace0 0x7f419806d190 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:08.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.284+0000 7f41babff700 1 --2- 172.21.15.37:0/2220077731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41b40b4910 0x7f41b41f5f10 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:08.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.284+0000 7f41babff700 1 --2- 172.21.15.37:0/2220077731 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f41b40b54b0 0x7f41b4155450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:08.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.284+0000 7f41babff700 1 -- 172.21.15.37:0/2220077731 >> 172.21.15.37:0/2220077731 conn(0x7f41b406a580 msgr2=0x7f41b41600f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:08.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.284+0000 7f41babff700 1 -- 172.21.15.37:0/2220077731 shutdown_connections 2023-07-14T15:57:08.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.284+0000 7f41babff700 1 -- 172.21.15.37:0/2220077731 wait complete. 2023-07-14T15:57:08.270 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 7 2023-07-14T15:57:08.287 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T15:57:08.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.503+0000 7fafe07ff700 1 Processor -- start 2023-07-14T15:57:08.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.504+0000 7fafe07ff700 1 -- start start 2023-07-14T15:57:08.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.505+0000 7fafe07ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fafd815cc40 0x7fafd8160eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:08.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.505+0000 7fafe07ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fafd80ca170 0x7fafd8071120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:08.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.505+0000 7fafe07ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fafd8069e70 0x7fafd806a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:08.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.505+0000 7fafe07ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafd806a830 con 0x7fafd80ca170 2023-07-14T15:57:08.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.505+0000 7fafe07ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafd80cbb40 con 0x7fafd8069e70 2023-07-14T15:57:08.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.505+0000 7fafe07ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd8070c90 con 0x7fafd815cc40 2023-07-14T15:57:08.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.505+0000 7fafddd9a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fafd80ca170 0x7fafd8071120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:08.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.505+0000 7fafde59b700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fafd815cc40 0x7fafd8160eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:08.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.505+0000 7fafded9c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fafd8069e70 0x7fafd806a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:08.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.505+0000 7fafddd9a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fafd80ca170 0x7fafd8071120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46868/0 (socket says 172.21.15.37:46868) 2023-07-14T15:57:08.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.505+0000 7fafddd9a700 1 -- 172.21.15.37:0/339683410 learned_addr learned my addr 172.21.15.37:0/339683410 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:08.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.505+0000 7fafde59b700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fafd815cc40 0x7fafd8160eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3301/0 says I am v2:172.21.15.37:58902/0 (socket says 172.21.15.37:58902) 2023-07-14T15:57:08.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.506+0000 7fafddd9a700 1 -- 172.21.15.37:0/339683410 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fafd815cc40 msgr2=0x7fafd8160eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:08.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.506+0000 7fafddd9a700 1 --2- 172.21.15.37:0/339683410 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fafd815cc40 0x7fafd8160eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:08.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.506+0000 7fafddd9a700 1 -- 172.21.15.37:0/339683410 >> v2:172.21.15.98:3300/0 conn(0x7fafd8069e70 msgr2=0x7fafd806a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:08.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.506+0000 7fafddd9a700 1 --2- 172.21.15.37:0/339683410 >> v2:172.21.15.98:3300/0 conn(0x7fafd8069e70 0x7fafd806a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:08.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.506+0000 7fafddd9a700 1 -- 172.21.15.37:0/339683410 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd80cc330 con 0x7fafd80ca170 2023-07-14T15:57:08.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.506+0000 7fafded9c700 1 --2- 172.21.15.37:0/339683410 >> v2:172.21.15.98:3300/0 conn(0x7fafd8069e70 0x7fafd806a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:57:08.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.506+0000 7fafde59b700 1 --2- 172.21.15.37:0/339683410 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fafd815cc40 0x7fafd8160eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:57:08.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.506+0000 7fafddd9a700 1 --2- 172.21.15.37:0/339683410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafd80ca170 0x7fafd8071120 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fafd8071c90 tx=0x7fafc8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96aff9b01ba5a2fc server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:08.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.506+0000 7fafdd599700 1 -- 172.21.15.37:0/339683410 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc8011830 con 0x7fafd80ca170 2023-07-14T15:57:08.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.506+0000 7fafdd599700 1 -- 172.21.15.37:0/339683410 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc8011990 con 0x7fafd80ca170 2023-07-14T15:57:08.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.506+0000 7fafdd599700 1 -- 172.21.15.37:0/339683410 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc8011d20 con 0x7fafd80ca170 2023-07-14T15:57:08.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.507+0000 7fafe07ff700 1 -- 172.21.15.37:0/339683410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafd80ca170 msgr2=0x7fafd8071120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:08.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.507+0000 7fafe07ff700 1 --2- 172.21.15.37:0/339683410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafd80ca170 0x7fafd8071120 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fafd8071c90 tx=0x7fafc8009bd0 comp rx=0 tx=0).stop 2023-07-14T15:57:08.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.507+0000 7fafe07ff700 1 -- 172.21.15.37:0/339683410 shutdown_connections 2023-07-14T15:57:08.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.507+0000 7fafe07ff700 1 --2- 172.21.15.37:0/339683410 >> v2:172.21.15.98:3300/0 conn(0x7fafd8069e70 0x7fafd806a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:08.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.507+0000 7fafe07ff700 1 --2- 172.21.15.37:0/339683410 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fafd815cc40 0x7fafd8160eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:08.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.507+0000 7fafe07ff700 1 --2- 172.21.15.37:0/339683410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafd80ca170 0x7fafd8071120 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:08.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.507+0000 7fafe07ff700 1 -- 172.21.15.37:0/339683410 >> 172.21.15.37:0/339683410 conn(0x7fafd80cd230 msgr2=0x7fafd80cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:08.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.507+0000 7fafe07ff700 1 -- 172.21.15.37:0/339683410 shutdown_connections 2023-07-14T15:57:08.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.507+0000 7fafe07ff700 1 -- 172.21.15.37:0/339683410 wait complete. 2023-07-14T15:57:08.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.509+0000 7fafe07ff700 1 Processor -- start 2023-07-14T15:57:08.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.509+0000 7fafe07ff700 1 -- start start 2023-07-14T15:57:08.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.510+0000 7fafe07ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafd8069e70 0x7fafd80b5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:08.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.510+0000 7fafe07ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fafd80ca170 0x7fafd80b1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:08.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.510+0000 7fafe07ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafd815cc40 0x7fafd80b1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:08.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.510+0000 7fafe07ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd80c8510 con 0x7fafd815cc40 2023-07-14T15:57:08.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.510+0000 7fafe07ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd81f2010 con 0x7fafd8069e70 2023-07-14T15:57:08.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.510+0000 7fafe07ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd80b2950 con 0x7fafd80ca170 2023-07-14T15:57:08.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.510+0000 7fafde59b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafd8069e70 0x7fafd80b5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:08.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.510+0000 7fafded9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafd815cc40 0x7fafd80b1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:08.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.510+0000 7fafde59b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafd8069e70 0x7fafd80b5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.37:48468/0 (socket says 172.21.15.37:48468) 2023-07-14T15:57:08.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.510+0000 7fafde59b700 1 -- 172.21.15.37:0/1458852140 learned_addr learned my addr 172.21.15.37:0/1458852140 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:08.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.510+0000 7fafddd9a700 1 --2- 172.21.15.37:0/1458852140 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fafd80ca170 0x7fafd80b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:08.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.510+0000 7fafde59b700 1 -- 172.21.15.37:0/1458852140 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fafd80ca170 msgr2=0x7fafd80b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:08.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.510+0000 7fafde59b700 1 --2- 172.21.15.37:0/1458852140 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fafd80ca170 0x7fafd80b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:08.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.510+0000 7fafde59b700 1 -- 172.21.15.37:0/1458852140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafd815cc40 msgr2=0x7fafd80b1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:08.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.510+0000 7fafde59b700 1 --2- 172.21.15.37:0/1458852140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafd815cc40 0x7fafd80b1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:08.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.510+0000 7fafde59b700 1 -- 172.21.15.37:0/1458852140 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd0009a70 con 0x7fafd8069e70 2023-07-14T15:57:08.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.510+0000 7fafded9c700 1 --2- 172.21.15.37:0/1458852140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafd815cc40 0x7fafd80b1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:57:08.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.511+0000 7fafddd9a700 1 --2- 172.21.15.37:0/1458852140 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fafd80ca170 0x7fafd80b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:57:08.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.511+0000 7fafde59b700 1 --2- 172.21.15.37:0/1458852140 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafd8069e70 0x7fafd80b5350 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fafd400ebe0 tx=0x7fafd400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:08.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.511+0000 7fafceffd700 1 -- 172.21.15.37:0/1458852140 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd4009760 con 0x7fafd8069e70 2023-07-14T15:57:08.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.511+0000 7fafceffd700 1 -- 172.21.15.37:0/1458852140 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd400c850 con 0x7fafd8069e70 2023-07-14T15:57:08.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.511+0000 7fafceffd700 1 -- 172.21.15.37:0/1458852140 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd400cbe0 con 0x7fafd8069e70 2023-07-14T15:57:08.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.511+0000 7fafe07ff700 1 -- 172.21.15.37:0/1458852140 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafd40094a0 con 0x7fafd8069e70 2023-07-14T15:57:08.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.511+0000 7fafe07ff700 1 -- 172.21.15.37:0/1458852140 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafc8009550 con 0x7fafd8069e70 2023-07-14T15:57:08.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.512+0000 7fafe07ff700 1 -- 172.21.15.37:0/1458852140 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafd8067840 con 0x7fafd8069e70 2023-07-14T15:57:08.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.513+0000 7fafceffd700 1 -- 172.21.15.37:0/1458852140 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fafd400cd40 con 0x7fafd8069e70 2023-07-14T15:57:08.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.514+0000 7fafceffd700 1 --2- 172.21.15.37:0/1458852140 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fafbc06ace0 0x7fafbc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:08.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.514+0000 7fafceffd700 1 -- 172.21.15.37:0/1458852140 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fafd4089640 con 0x7fafd8069e70 2023-07-14T15:57:08.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.515+0000 7fafddd9a700 1 --2- 172.21.15.37:0/1458852140 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fafbc06ace0 0x7fafbc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:08.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.515+0000 7fafddd9a700 1 --2- 172.21.15.37:0/1458852140 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fafbc06ace0 0x7fafbc06d190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fafc8009c10 tx=0x7fafc8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:08.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.518+0000 7fafceffd700 1 -- 172.21.15.37:0/1458852140 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fafd4054760 con 0x7fafd8069e70 2023-07-14T15:57:08.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.728+0000 7fafe07ff700 1 -- 172.21.15.37:0/1458852140 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fafd80b2ba0 con 0x7fafd8069e70 2023-07-14T15:57:08.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.730+0000 7fafceffd700 1 -- 172.21.15.37:0/1458852140 <== mon.1 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18341 (secure 0 0 0) 0x7fafd4057d80 con 0x7fafd8069e70 2023-07-14T15:57:08.715 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:57:08.716 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"fsid":"9da30401-a779-4e46-aba6-00c2494c6c67","created":"2023-07-14T15:55:39.898867+0000","modified":"2023-07-14T15:56:09.959850+0000","last_up_change":"2023-07-14T15:55:53.025696+0000","last_in_change":"2023-07-14T15:55:43.388192+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T15:55:52.907261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T15:55:59.992839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T15:56:06.091064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T15:56:07.448694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d049535-7b87-4276-8fe5-0f74ba422d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6801","nonce":2783032392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6803","nonce":2783032392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6807","nonce":2783032392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6805","nonce":2783032392}]},"public_addr":"172.21.15.37:6801/2783032392","cluster_addr":"172.21.15.37:6803/2783032392","heartbeat_back_addr":"172.21.15.37:6807/2783032392","heartbeat_front_addr":"172.21.15.37:6805/2783032392","state":["exists","up"]},{"osd":1,"uuid":"79ec948d-ead2-4c2d-923a-dd6eeaac9dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6823","nonce":1190059746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6826","nonce":1190059746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6831","nonce":1190059746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6829","nonce":1190059746}]},"public_addr":"172.21.15.37:6823/1190059746","cluster_addr":"172.21.15.37:6826/1190059746","heartbeat_back_addr":"172.21.15.37:6831/1190059746","heartbeat_front_addr":"172.21.15.37:6829/1190059746","state":["exists","up"]},{"osd":2,"uuid":"a1db6690-c160-4366-9c82-2cca17e4bba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6809","nonce":2266223499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6813","nonce":2266223499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6820","nonce":2266223499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6816","nonce":2266223499}]},"public_addr":"172.21.15.37:6809/2266223499","cluster_addr":"172.21.15.37:6813/2266223499","heartbeat_back_addr":"172.21.15.37:6820/2266223499","heartbeat_front_addr":"172.21.15.37:6816/2266223499","state":["exists","up"]},{"osd":3,"uuid":"767b8220-e79a-4a86-a162-6b3b73198379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6812","nonce":4166694594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6817","nonce":4166694594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6828","nonce":4166694594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6822","nonce":4166694594}]},"public_addr":"172.21.15.37:6812/4166694594","cluster_addr":"172.21.15.37:6817/4166694594","heartbeat_back_addr":"172.21.15.37:6828/4166694594","heartbeat_front_addr":"172.21.15.37:6822/4166694594","state":["exists","up"]},{"osd":4,"uuid":"717bd773-ae7e-4236-ac79-900cf99a37c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6801","nonce":3529020407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6803","nonce":3529020407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6807","nonce":3529020407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6805","nonce":3529020407}]},"public_addr":"172.21.15.98:6801/3529020407","cluster_addr":"172.21.15.98:6803/3529020407","heartbeat_back_addr":"172.21.15.98:6807/3529020407","heartbeat_front_addr":"172.21.15.98:6805/3529020407","state":["exists","up"]},{"osd":5,"uuid":"a941d358-0f03-4136-a9b2-3a1c2e9358cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6817","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6819","nonce":2311501838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6821","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6823","nonce":2311501838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6829","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6831","nonce":2311501838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6825","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6827","nonce":2311501838}]},"public_addr":"172.21.15.98:6819/2311501838","cluster_addr":"172.21.15.98:6823/2311501838","heartbeat_back_addr":"172.21.15.98:6831/2311501838","heartbeat_front_addr":"172.21.15.98:6827/2311501838","state":["exists","up"]},{"osd":6,"uuid":"27153772-6d4b-479d-9953-0582e7b96743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6809","nonce":1144224691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6811","nonce":1144224691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6815","nonce":1144224691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6813","nonce":1144224691}]},"public_addr":"172.21.15.98:6809/1144224691","cluster_addr":"172.21.15.98:6811/1144224691","heartbeat_back_addr":"172.21.15.98:6815/1144224691","heartbeat_front_addr":"172.21.15.98:6813/1144224691","state":["exists","up"]},{"osd":7,"uuid":"d21ffc8e-40bb-47eb-af2c-e3e730d3fb76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6818","nonce":1144470927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6822","nonce":1144470927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6830","nonce":1144470927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6826","nonce":1144470927}]},"public_addr":"172.21.15.98:6818/1144470927","cluster_addr":"172.21.15.98:6822/1144470927","heartbeat_back_addr":"172.21.15.98:6830/1144470927","heartbeat_front_addr":"172.21.15.98:6826/1144470927","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.921114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.739210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.024016+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.002527+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.698127+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.813416+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.709351+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.815457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T15:57:08.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.732+0000 7fafe07ff700 1 -- 172.21.15.37:0/1458852140 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fafbc06ace0 msgr2=0x7fafbc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:08.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.732+0000 7fafe07ff700 1 --2- 172.21.15.37:0/1458852140 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fafbc06ace0 0x7fafbc06d190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fafc8009c10 tx=0x7fafc8008030 comp rx=0 tx=0).stop 2023-07-14T15:57:08.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.732+0000 7fafe07ff700 1 -- 172.21.15.37:0/1458852140 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafd8069e70 msgr2=0x7fafd80b5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:08.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.732+0000 7fafe07ff700 1 --2- 172.21.15.37:0/1458852140 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafd8069e70 0x7fafd80b5350 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fafd400ebe0 tx=0x7fafd400eef0 comp rx=0 tx=0).stop 2023-07-14T15:57:08.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.732+0000 7fafe07ff700 1 -- 172.21.15.37:0/1458852140 shutdown_connections 2023-07-14T15:57:08.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.732+0000 7fafe07ff700 1 --2- 172.21.15.37:0/1458852140 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafd8069e70 0x7fafd80b5350 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:08.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.732+0000 7fafe07ff700 1 --2- 172.21.15.37:0/1458852140 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fafbc06ace0 0x7fafbc06d190 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:08.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.732+0000 7fafe07ff700 1 --2- 172.21.15.37:0/1458852140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafd815cc40 0x7fafd80b1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:08.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.732+0000 7fafe07ff700 1 --2- 172.21.15.37:0/1458852140 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fafd80ca170 0x7fafd80b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:08.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.732+0000 7fafe07ff700 1 -- 172.21.15.37:0/1458852140 >> 172.21.15.37:0/1458852140 conn(0x7fafd80cd230 msgr2=0x7fafd80cd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:08.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.732+0000 7fafe07ff700 1 -- 172.21.15.37:0/1458852140 shutdown_connections 2023-07-14T15:57:08.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.732+0000 7fafe07ff700 1 -- 172.21.15.37:0/1458852140 wait complete. 2023-07-14T15:57:08.735 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T15:55:52.907261+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T15:55:59.992839+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T15:56:06.091064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T15:56:07.448694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T15:57:08.737 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T15:57:08.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.957+0000 7fe463bff700 1 Processor -- start 2023-07-14T15:57:08.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.957+0000 7fe463bff700 1 -- start start 2023-07-14T15:57:08.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.958+0000 7fe463bff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe45c0cb430 0x7fe45c0cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:08.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.958+0000 7fe463bff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe45c071820 0x7fe45c06cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:08.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.958+0000 7fe463bff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe45c0707f0 con 0x7fe45c06d0c0 2023-07-14T15:57:08.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.958+0000 7fe463bff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe45c0cbd40 con 0x7fe45c0cb430 2023-07-14T15:57:08.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.958+0000 7fe463bff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c070a60 con 0x7fe45c071820 2023-07-14T15:57:08.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.959+0000 7fe46219c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe45c06d0c0 0x7fe45c06b7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42774/0 (socket says 172.21.15.37:42774) 2023-07-14T15:57:08.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.959+0000 7fe46219c700 1 -- 172.21.15.37:0/295295670 learned_addr learned my addr 172.21.15.37:0/295295670 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:08.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.959+0000 7fe46199b700 1 --2- 172.21.15.37:0/295295670 >> v2:172.21.15.98:3300/0 conn(0x7fe45c0cb430 0x7fe45c0cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:08.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.959+0000 7fe46119a700 1 --2- 172.21.15.37:0/295295670 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe45c071820 0x7fe45c06cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:08.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.959+0000 7fe460999700 1 -- 172.21.15.37:0/295295670 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3389617474 0 0) 0x7fe45c0707f0 con 0x7fe45c06d0c0 2023-07-14T15:57:08.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.959+0000 7fe460999700 1 -- 172.21.15.37:0/295295670 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4480035b0 con 0x7fe45c06d0c0 2023-07-14T15:57:08.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.959+0000 7fe460999700 1 -- 172.21.15.37:0/295295670 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1004727909 0 0) 0x7fe4480035b0 con 0x7fe45c06d0c0 2023-07-14T15:57:08.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.959+0000 7fe460999700 1 -- 172.21.15.37:0/295295670 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe45c071820 msgr2=0x7fe45c06cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:08.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.959+0000 7fe460999700 1 --2- 172.21.15.37:0/295295670 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe45c071820 0x7fe45c06cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:08.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.959+0000 7fe460999700 1 -- 172.21.15.37:0/295295670 >> v2:172.21.15.98:3300/0 conn(0x7fe45c0cb430 msgr2=0x7fe45c0cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:08.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.959+0000 7fe460999700 1 --2- 172.21.15.37:0/295295670 >> v2:172.21.15.98:3300/0 conn(0x7fe45c0cb430 0x7fe45c0cb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:08.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.959+0000 7fe460999700 1 -- 172.21.15.37:0/295295670 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe45c070d40 con 0x7fe45c06d0c0 2023-07-14T15:57:08.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.959+0000 7fe460999700 1 -- 172.21.15.37:0/295295670 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48633207 0 0) 0x7fe4540019f0 con 0x7fe45c06d0c0 2023-07-14T15:57:08.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.959+0000 7fe460999700 1 -- 172.21.15.37:0/295295670 >> v1:172.21.15.37:6789/0 conn(0x7fe45c06d0c0 legacy=0x7fe45c06b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:08.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.960+0000 7fe460999700 1 --2- 172.21.15.37:0/295295670 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe448003a00 0x7fe448003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:08.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.960+0000 7fe460999700 1 --2- 172.21.15.37:0/295295670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe448004430 0x7fe4480048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:08.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.960+0000 7fe460999700 1 --2- 172.21.15.37:0/295295670 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe45c071820 0x7fe448004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:08.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.960+0000 7fe460999700 1 -- 172.21.15.37:0/295295670 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c0cbd40 con 0x7fe448004430 2023-07-14T15:57:08.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.960+0000 7fe460999700 1 -- 172.21.15.37:0/295295670 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c070a60 con 0x7fe448003a00 2023-07-14T15:57:08.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.960+0000 7fe460999700 1 -- 172.21.15.37:0/295295670 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe44800ba10 con 0x7fe45c071820 2023-07-14T15:57:08.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.960+0000 7fe46119a700 1 --2- 172.21.15.37:0/295295670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe448004430 0x7fe4480048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:08.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.960+0000 7fe46199b700 1 --2- 172.21.15.37:0/295295670 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe448003a00 0x7fe448003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:08.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.960+0000 7fe46219c700 1 --2- 172.21.15.37:0/295295670 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe45c071820 0x7fe448004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:08.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.960+0000 7fe46119a700 1 -- 172.21.15.37:0/295295670 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe45c071820 msgr2=0x7fe448004fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:08.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.960+0000 7fe46119a700 1 --2- 172.21.15.37:0/295295670 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe45c071820 0x7fe448004fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:08.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.960+0000 7fe46119a700 1 -- 172.21.15.37:0/295295670 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe448003a00 msgr2=0x7fe448003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:08.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.960+0000 7fe46119a700 1 --2- 172.21.15.37:0/295295670 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe448003a00 0x7fe448003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:08.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.960+0000 7fe46119a700 1 -- 172.21.15.37:0/295295670 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4480035b0 con 0x7fe448004430 2023-07-14T15:57:08.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.961+0000 7fe46119a700 1 --2- 172.21.15.37:0/295295670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe448004430 0x7fe4480048f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe44c009b30 tx=0x7fe448005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44d49eb632ae4fcf server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:08.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.961+0000 7fe460999700 1 -- 172.21.15.37:0/295295670 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44c00e6c0 con 0x7fe448004430 2023-07-14T15:57:08.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.961+0000 7fe460999700 1 -- 172.21.15.37:0/295295670 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe44c00e820 con 0x7fe448004430 2023-07-14T15:57:08.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.961+0000 7fe460999700 1 -- 172.21.15.37:0/295295670 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44c00eb90 con 0x7fe448004430 2023-07-14T15:57:08.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.961+0000 7fe463bff700 1 -- 172.21.15.37:0/295295670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe448004430 msgr2=0x7fe4480048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:08.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.961+0000 7fe463bff700 1 --2- 172.21.15.37:0/295295670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe448004430 0x7fe4480048f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe44c009b30 tx=0x7fe448005880 comp rx=0 tx=0).stop 2023-07-14T15:57:08.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.961+0000 7fe46219c700 1 -- 172.21.15.37:0/295295670 reap_dead start 2023-07-14T15:57:08.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.961+0000 7fe463bff700 1 -- 172.21.15.37:0/295295670 shutdown_connections 2023-07-14T15:57:08.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.961+0000 7fe463bff700 1 -- 172.21.15.37:0/295295670 >> 172.21.15.37:0/295295670 conn(0x7fe45c06aac0 msgr2=0x7fe45c0b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:08.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.962+0000 7fe463bff700 1 -- 172.21.15.37:0/295295670 shutdown_connections 2023-07-14T15:57:08.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.962+0000 7fe463bff700 1 -- 172.21.15.37:0/295295670 wait complete. 2023-07-14T15:57:08.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.963+0000 7fe463bff700 1 Processor -- start 2023-07-14T15:57:08.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.963+0000 7fe463bff700 1 -- start start 2023-07-14T15:57:08.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.964+0000 7fe463bff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe448004430 0x7fe45c0ad370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:08.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.964+0000 7fe463bff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe45c0cd2f0 0x7fe45c0cd740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:08.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.964+0000 7fe463bff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe45c1f5890 0x7fe45c1f5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:08.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.964+0000 7fe463bff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c0ad8b0 con 0x7fe45c1f5890 2023-07-14T15:57:08.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.964+0000 7fe463bff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c0cdc80 con 0x7fe45c0cd2f0 2023-07-14T15:57:08.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.964+0000 7fe463bff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c0cdf30 con 0x7fe448004430 2023-07-14T15:57:08.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.965+0000 7fe46219c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe45c1f5890 0x7fe45c1f5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:08.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.965+0000 7fe46219c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe45c1f5890 0x7fe45c1f5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46902/0 (socket says 172.21.15.37:46902) 2023-07-14T15:57:08.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.965+0000 7fe46219c700 1 -- 172.21.15.37:0/729105656 learned_addr learned my addr 172.21.15.37:0/729105656 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:08.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.965+0000 7fe46119a700 1 --2- 172.21.15.37:0/729105656 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe45c0cd2f0 0x7fe45c0cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:08.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.965+0000 7fe46199b700 1 --2- 172.21.15.37:0/729105656 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe448004430 0x7fe45c0ad370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:08.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.965+0000 7fe46219c700 1 -- 172.21.15.37:0/729105656 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe448004430 msgr2=0x7fe45c0ad370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:08.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.965+0000 7fe46219c700 1 --2- 172.21.15.37:0/729105656 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe448004430 0x7fe45c0ad370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:08.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.965+0000 7fe46219c700 1 -- 172.21.15.37:0/729105656 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe45c0cd2f0 msgr2=0x7fe45c0cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:08.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.965+0000 7fe46219c700 1 --2- 172.21.15.37:0/729105656 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe45c0cd2f0 0x7fe45c0cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:08.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.965+0000 7fe46219c700 1 -- 172.21.15.37:0/729105656 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe45c0c8500 con 0x7fe45c1f5890 2023-07-14T15:57:08.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.965+0000 7fe46119a700 1 --2- 172.21.15.37:0/729105656 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe45c0cd2f0 0x7fe45c0cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:57:08.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.965+0000 7fe46199b700 1 --2- 172.21.15.37:0/729105656 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe448004430 0x7fe45c0ad370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:57:08.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.965+0000 7fe46219c700 1 --2- 172.21.15.37:0/729105656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe45c1f5890 0x7fe45c1f5d10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe45c06b500 tx=0x7fe45400a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:08.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.966+0000 7fe4527fc700 1 -- 172.21.15.37:0/729105656 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45400adb0 con 0x7fe45c1f5890 2023-07-14T15:57:08.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.966+0000 7fe4527fc700 1 -- 172.21.15.37:0/729105656 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4540133f0 con 0x7fe45c1f5890 2023-07-14T15:57:08.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.966+0000 7fe463bff700 1 -- 172.21.15.37:0/729105656 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe45c0c87e0 con 0x7fe45c1f5890 2023-07-14T15:57:08.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.966+0000 7fe4527fc700 1 -- 172.21.15.37:0/729105656 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4540137a0 con 0x7fe45c1f5890 2023-07-14T15:57:08.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.966+0000 7fe463bff700 1 -- 172.21.15.37:0/729105656 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe45c1f6250 con 0x7fe45c1f5890 2023-07-14T15:57:08.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.967+0000 7fe463bff700 1 -- 172.21.15.37:0/729105656 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe45c0ca640 con 0x7fe45c1f5890 2023-07-14T15:57:08.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.968+0000 7fe4527fc700 1 -- 172.21.15.37:0/729105656 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe454013900 con 0x7fe45c1f5890 2023-07-14T15:57:08.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.969+0000 7fe4527fc700 1 --2- 172.21.15.37:0/729105656 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe44006ace0 0x7fe44006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:08.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.969+0000 7fe4527fc700 1 -- 172.21.15.37:0/729105656 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe454089df0 con 0x7fe45c1f5890 2023-07-14T15:57:08.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.970+0000 7fe46199b700 1 --2- 172.21.15.37:0/729105656 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe44006ace0 0x7fe44006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:08.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.970+0000 7fe46199b700 1 --2- 172.21.15.37:0/729105656 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe44006ace0 0x7fe44006d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe45c06bf40 tx=0x7fe458008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:08.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:08.973+0000 7fe4527fc700 1 -- 172.21.15.37:0/729105656 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe454054e00 con 0x7fe45c1f5890 2023-07-14T15:57:09.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.181+0000 7fe463bff700 1 -- 172.21.15.37:0/729105656 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe45c070290 con 0x7fe45c1f5890 2023-07-14T15:57:09.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.181+0000 7fe4527fc700 1 -- 172.21.15.37:0/729105656 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe454058420 con 0x7fe45c1f5890 2023-07-14T15:57:09.167 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-14T15:57:09.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.183+0000 7fe463bff700 1 -- 172.21.15.37:0/729105656 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe44006ace0 msgr2=0x7fe44006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:09.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.183+0000 7fe463bff700 1 --2- 172.21.15.37:0/729105656 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe44006ace0 0x7fe44006d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe45c06bf40 tx=0x7fe458008040 comp rx=0 tx=0).stop 2023-07-14T15:57:09.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.183+0000 7fe463bff700 1 -- 172.21.15.37:0/729105656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe45c1f5890 msgr2=0x7fe45c1f5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:09.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.183+0000 7fe463bff700 1 --2- 172.21.15.37:0/729105656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe45c1f5890 0x7fe45c1f5d10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe45c06b500 tx=0x7fe45400a640 comp rx=0 tx=0).stop 2023-07-14T15:57:09.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.183+0000 7fe463bff700 1 -- 172.21.15.37:0/729105656 shutdown_connections 2023-07-14T15:57:09.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.183+0000 7fe463bff700 1 --2- 172.21.15.37:0/729105656 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe44006ace0 0x7fe44006d190 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:09.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.183+0000 7fe463bff700 1 --2- 172.21.15.37:0/729105656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe45c1f5890 0x7fe45c1f5d10 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:09.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.183+0000 7fe463bff700 1 --2- 172.21.15.37:0/729105656 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe448004430 0x7fe45c0ad370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:09.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.184+0000 7fe463bff700 1 --2- 172.21.15.37:0/729105656 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe45c0cd2f0 0x7fe45c0cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:09.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.184+0000 7fe463bff700 1 -- 172.21.15.37:0/729105656 >> 172.21.15.37:0/729105656 conn(0x7fe45c06aac0 msgr2=0x7fe45c0c9ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:09.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.184+0000 7fe463bff700 1 -- 172.21.15.37:0/729105656 shutdown_connections 2023-07-14T15:57:09.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.184+0000 7fe463bff700 1 -- 172.21.15.37:0/729105656 wait complete. 2023-07-14T15:57:09.186 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T15:57:09.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.406+0000 7f61ce9ff700 1 Processor -- start 2023-07-14T15:57:09.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.407+0000 7f61ce9ff700 1 -- start start 2023-07-14T15:57:09.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.408+0000 7f61ce9ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f61c80cb430 0x7f61c80cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:09.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.408+0000 7f61ce9ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61c80707f0 con 0x7f61c806d290 2023-07-14T15:57:09.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.408+0000 7f61ce9ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61c80cbd40 con 0x7f61c8071820 2023-07-14T15:57:09.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.408+0000 7f61ce9ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61c8070a60 con 0x7f61c80cb430 2023-07-14T15:57:09.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.408+0000 7f61c7fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f61c80cb430 0x7f61c80cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:09.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.408+0000 7f61ccf9c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f61c806d290 0x7f61c80c90d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42790/0 (socket says 172.21.15.37:42790) 2023-07-14T15:57:09.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.408+0000 7f61ccf9c700 1 -- 172.21.15.37:0/3474912354 learned_addr learned my addr 172.21.15.37:0/3474912354 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:09.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.409+0000 7f61c7fff700 1 -- 172.21.15.37:0/3474912354 >> v1:172.21.15.98:6789/0 conn(0x7f61c8071820 legacy=0x7f61c806cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:09.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.409+0000 7f61c7fff700 1 -- 172.21.15.37:0/3474912354 >> v1:172.21.15.37:6789/0 conn(0x7f61c806d290 legacy=0x7f61c80c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:09.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.409+0000 7f61c77fe700 1 -- 172.21.15.37:0/3474912354 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2590646545 0 0) 0x7f61c80707f0 con 0x7f61c806d290 2023-07-14T15:57:09.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.409+0000 7f61c7fff700 1 -- 172.21.15.37:0/3474912354 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c8070d40 con 0x7f61c80cb430 2023-07-14T15:57:09.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.409+0000 7f61c7fff700 1 --2- 172.21.15.37:0/3474912354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61c80cb430 0x7f61c80cb800 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f61b8009840 tx=0x7f61b8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=706988337f3574f0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:09.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.409+0000 7f61c77fe700 1 -- 172.21.15.37:0/3474912354 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b8004230 con 0x7f61c80cb430 2023-07-14T15:57:09.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.409+0000 7f61c77fe700 1 -- 172.21.15.37:0/3474912354 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b8004390 con 0x7f61c80cb430 2023-07-14T15:57:09.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.409+0000 7f61c77fe700 1 -- 172.21.15.37:0/3474912354 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b80036a0 con 0x7f61c80cb430 2023-07-14T15:57:09.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.410+0000 7f61ce9ff700 1 -- 172.21.15.37:0/3474912354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61c80cb430 msgr2=0x7f61c80cb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:09.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.410+0000 7f61ce9ff700 1 --2- 172.21.15.37:0/3474912354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61c80cb430 0x7f61c80cb800 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f61b8009840 tx=0x7f61b8009b50 comp rx=0 tx=0).stop 2023-07-14T15:57:09.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.410+0000 7f61ce9ff700 1 -- 172.21.15.37:0/3474912354 shutdown_connections 2023-07-14T15:57:09.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.410+0000 7f61ce9ff700 1 --2- 172.21.15.37:0/3474912354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61c80cb430 0x7f61c80cb800 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:09.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.410+0000 7f61ce9ff700 1 -- 172.21.15.37:0/3474912354 >> 172.21.15.37:0/3474912354 conn(0x7f61c806aac0 msgr2=0x7f61c80b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:09.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.410+0000 7f61ce9ff700 1 -- 172.21.15.37:0/3474912354 shutdown_connections 2023-07-14T15:57:09.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.410+0000 7f61ce9ff700 1 -- 172.21.15.37:0/3474912354 wait complete. 2023-07-14T15:57:09.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.412+0000 7f61ce9ff700 1 Processor -- start 2023-07-14T15:57:09.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.412+0000 7f61ce9ff700 1 -- start start 2023-07-14T15:57:09.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.413+0000 7f61ce9ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61c806d290 0x7f61c80c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:09.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.413+0000 7f61ce9ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f61c8071820 0x7f61c80c9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:09.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.413+0000 7f61ce9ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61c80cb430 0x7f61c80c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:09.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.413+0000 7f61ce9ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c813e2b0 con 0x7f61c806d290 2023-07-14T15:57:09.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.413+0000 7f61ce9ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c813dc80 con 0x7f61c80cb430 2023-07-14T15:57:09.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.413+0000 7f61ce9ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c81408c0 con 0x7f61c8071820 2023-07-14T15:57:09.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.413+0000 7f61c7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61c806d290 0x7f61c80c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:09.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.413+0000 7f61c7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61c806d290 0x7f61c80c47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46918/0 (socket says 172.21.15.37:46918) 2023-07-14T15:57:09.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.413+0000 7f61c7fff700 1 -- 172.21.15.37:0/2358987719 learned_addr learned my addr 172.21.15.37:0/2358987719 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:09.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.413+0000 7f61ccf9c700 1 --2- 172.21.15.37:0/2358987719 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61c80cb430 0x7f61c80c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:09.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.413+0000 7f61bffff700 1 --2- 172.21.15.37:0/2358987719 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f61c8071820 0x7f61c80c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:09.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.414+0000 7f61c7fff700 1 -- 172.21.15.37:0/2358987719 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f61c8071820 msgr2=0x7f61c80c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:09.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.414+0000 7f61c7fff700 1 --2- 172.21.15.37:0/2358987719 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f61c8071820 0x7f61c80c9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:09.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.414+0000 7f61c7fff700 1 -- 172.21.15.37:0/2358987719 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61c80cb430 msgr2=0x7f61c80c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:09.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.414+0000 7f61c7fff700 1 --2- 172.21.15.37:0/2358987719 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61c80cb430 0x7f61c80c9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:09.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.414+0000 7f61c7fff700 1 -- 172.21.15.37:0/2358987719 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b80094a0 con 0x7f61c806d290 2023-07-14T15:57:09.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.414+0000 7f61c7fff700 1 --2- 172.21.15.37:0/2358987719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61c806d290 0x7f61c80c47e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f61b80090b0 tx=0x7f61b80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:09.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.414+0000 7f61c57fa700 1 -- 172.21.15.37:0/2358987719 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b8011830 con 0x7f61c806d290 2023-07-14T15:57:09.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.414+0000 7f61c57fa700 1 -- 172.21.15.37:0/2358987719 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b8011990 con 0x7f61c806d290 2023-07-14T15:57:09.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.414+0000 7f61c57fa700 1 -- 172.21.15.37:0/2358987719 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b8011d40 con 0x7f61c806d290 2023-07-14T15:57:09.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.414+0000 7f61ce9ff700 1 -- 172.21.15.37:0/2358987719 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61c813df40 con 0x7f61c806d290 2023-07-14T15:57:09.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.414+0000 7f61ce9ff700 1 -- 172.21.15.37:0/2358987719 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61c813fb90 con 0x7f61c806d290 2023-07-14T15:57:09.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.415+0000 7f61ce9ff700 1 -- 172.21.15.37:0/2358987719 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61c80ca640 con 0x7f61c806d290 2023-07-14T15:57:09.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.416+0000 7f61c57fa700 1 -- 172.21.15.37:0/2358987719 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f61b801b440 con 0x7f61c806d290 2023-07-14T15:57:09.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.417+0000 7f61c57fa700 1 --2- 172.21.15.37:0/2358987719 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f61a806ad10 0x7f61a806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:09.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.417+0000 7f61c57fa700 1 -- 172.21.15.37:0/2358987719 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f61b808af30 con 0x7f61c806d290 2023-07-14T15:57:09.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.418+0000 7f61bffff700 1 --2- 172.21.15.37:0/2358987719 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f61a806ad10 0x7f61a806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:09.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.418+0000 7f61bffff700 1 --2- 172.21.15.37:0/2358987719 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f61a806ad10 0x7f61a806d1c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f61c8151730 tx=0x7f61b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:09.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.421+0000 7f61c57fa700 1 -- 172.21.15.37:0/2358987719 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f61b80560f0 con 0x7f61c806d290 2023-07-14T15:57:09.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.625+0000 7f61ce9ff700 1 -- 172.21.15.37:0/2358987719 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f61c8067840 con 0x7f61c806d290 2023-07-14T15:57:09.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.626+0000 7f61c57fa700 1 -- 172.21.15.37:0/2358987719 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f61b8059710 con 0x7f61c806d290 2023-07-14T15:57:09.611 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-14T15:57:09.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.628+0000 7f61ce9ff700 1 -- 172.21.15.37:0/2358987719 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f61a806ad10 msgr2=0x7f61a806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:09.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.628+0000 7f61ce9ff700 1 --2- 172.21.15.37:0/2358987719 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f61a806ad10 0x7f61a806d1c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f61c8151730 tx=0x7f61b0009040 comp rx=0 tx=0).stop 2023-07-14T15:57:09.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.628+0000 7f61ce9ff700 1 -- 172.21.15.37:0/2358987719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61c806d290 msgr2=0x7f61c80c47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:09.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.628+0000 7f61ce9ff700 1 --2- 172.21.15.37:0/2358987719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61c806d290 0x7f61c80c47e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f61b80090b0 tx=0x7f61b80047c0 comp rx=0 tx=0).stop 2023-07-14T15:57:09.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.628+0000 7f61ce9ff700 1 -- 172.21.15.37:0/2358987719 shutdown_connections 2023-07-14T15:57:09.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.628+0000 7f61ce9ff700 1 --2- 172.21.15.37:0/2358987719 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61c80cb430 0x7f61c80c9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:09.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.628+0000 7f61ce9ff700 1 --2- 172.21.15.37:0/2358987719 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f61a806ad10 0x7f61a806d1c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:09.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.628+0000 7f61ce9ff700 1 --2- 172.21.15.37:0/2358987719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61c806d290 0x7f61c80c47e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:09.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.628+0000 7f61ce9ff700 1 --2- 172.21.15.37:0/2358987719 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f61c8071820 0x7f61c80c9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:09.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.628+0000 7f61ce9ff700 1 -- 172.21.15.37:0/2358987719 >> 172.21.15.37:0/2358987719 conn(0x7f61c806aac0 msgr2=0x7f61c80b4270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:09.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.628+0000 7f61ce9ff700 1 -- 172.21.15.37:0/2358987719 shutdown_connections 2023-07-14T15:57:09.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.628+0000 7f61ce9ff700 1 -- 172.21.15.37:0/2358987719 wait complete. 2023-07-14T15:57:09.632 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T15:57:09.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.853+0000 7fc9ddfff700 1 Processor -- start 2023-07-14T15:57:09.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.853+0000 7fc9ddfff700 1 -- start start 2023-07-14T15:57:09.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.854+0000 7fc9ddfff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc9d80cfd50 0x7fc9d80d2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:09.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.854+0000 7fc9ddfff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc9d80b1e80 0x7fc9d80b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:09.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.854+0000 7fc9ddfff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fc9d80b3290 0x7fc9d80b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:09.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.854+0000 7fc9ddfff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9d815ccf0 con 0x7fc9d80cfd50 2023-07-14T15:57:09.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.854+0000 7fc9ddfff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9d80b1840 con 0x7fc9d80b3290 2023-07-14T15:57:09.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.854+0000 7fc9ddfff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d80b2550 con 0x7fc9d80b1e80 2023-07-14T15:57:09.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.854+0000 7fc9d77fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc9d80cfd50 0x7fc9d80d2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:09.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.854+0000 7fc9d77fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc9d80cfd50 0x7fc9d80d2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46920/0 (socket says 172.21.15.37:46920) 2023-07-14T15:57:09.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.854+0000 7fc9d77fe700 1 -- 172.21.15.37:0/2308601648 learned_addr learned my addr 172.21.15.37:0/2308601648 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:09.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.855+0000 7fc9d7fff700 1 --2- 172.21.15.37:0/2308601648 >> v2:172.21.15.98:3300/0 conn(0x7fc9d80b3290 0x7fc9d80b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:09.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.855+0000 7fc9d6ffd700 1 --2- 172.21.15.37:0/2308601648 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc9d80b1e80 0x7fc9d80b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:09.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.855+0000 7fc9d77fe700 1 -- 172.21.15.37:0/2308601648 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc9d80b1e80 msgr2=0x7fc9d80b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:09.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.855+0000 7fc9d77fe700 1 --2- 172.21.15.37:0/2308601648 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc9d80b1e80 0x7fc9d80b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:09.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.855+0000 7fc9d77fe700 1 -- 172.21.15.37:0/2308601648 >> v2:172.21.15.98:3300/0 conn(0x7fc9d80b3290 msgr2=0x7fc9d80b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:09.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.855+0000 7fc9d77fe700 1 --2- 172.21.15.37:0/2308601648 >> v2:172.21.15.98:3300/0 conn(0x7fc9d80b3290 0x7fc9d80b36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:09.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.855+0000 7fc9d77fe700 1 -- 172.21.15.37:0/2308601648 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d80b2830 con 0x7fc9d80cfd50 2023-07-14T15:57:09.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.855+0000 7fc9d6ffd700 1 --2- 172.21.15.37:0/2308601648 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc9d80b1e80 0x7fc9d80b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:57:09.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.855+0000 7fc9d77fe700 1 --2- 172.21.15.37:0/2308601648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9d80cfd50 0x7fc9d80d2880 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8066b40 tx=0x7fc9c8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48e7a7469d90bf42 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:09.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.855+0000 7fc9d67fc700 1 -- 172.21.15.37:0/2308601648 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c800b870 con 0x7fc9d80cfd50 2023-07-14T15:57:09.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.855+0000 7fc9d67fc700 1 -- 172.21.15.37:0/2308601648 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c800b9d0 con 0x7fc9d80cfd50 2023-07-14T15:57:09.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.855+0000 7fc9d67fc700 1 -- 172.21.15.37:0/2308601648 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c800bd60 con 0x7fc9d80cfd50 2023-07-14T15:57:09.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.856+0000 7fc9ddfff700 1 -- 172.21.15.37:0/2308601648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9d80cfd50 msgr2=0x7fc9d80d2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:09.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.856+0000 7fc9ddfff700 1 --2- 172.21.15.37:0/2308601648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9d80cfd50 0x7fc9d80d2880 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8066b40 tx=0x7fc9c8009bd0 comp rx=0 tx=0).stop 2023-07-14T15:57:09.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.856+0000 7fc9ddfff700 1 -- 172.21.15.37:0/2308601648 shutdown_connections 2023-07-14T15:57:09.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.856+0000 7fc9ddfff700 1 --2- 172.21.15.37:0/2308601648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9d80cfd50 0x7fc9d80d2880 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:09.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.856+0000 7fc9ddfff700 1 --2- 172.21.15.37:0/2308601648 >> v2:172.21.15.98:3300/0 conn(0x7fc9d80b3290 0x7fc9d80b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:09.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.856+0000 7fc9ddfff700 1 --2- 172.21.15.37:0/2308601648 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc9d80b1e80 0x7fc9d80b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:09.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.856+0000 7fc9ddfff700 1 -- 172.21.15.37:0/2308601648 >> 172.21.15.37:0/2308601648 conn(0x7fc9d809c1c0 msgr2=0x7fc9d80d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:09.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.856+0000 7fc9ddfff700 1 -- 172.21.15.37:0/2308601648 shutdown_connections 2023-07-14T15:57:09.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.856+0000 7fc9ddfff700 1 -- 172.21.15.37:0/2308601648 wait complete. 2023-07-14T15:57:09.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.858+0000 7fc9ddfff700 1 Processor -- start 2023-07-14T15:57:09.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.858+0000 7fc9ddfff700 1 -- start start 2023-07-14T15:57:09.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.859+0000 7fc9ddfff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc9d80b1e80 0x7fc9d80b6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:09.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.859+0000 7fc9ddfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9d80b3290 0x7fc9d80c6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:09.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.859+0000 7fc9ddfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9d80cfd50 0x7fc9d8150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:09.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.859+0000 7fc9ddfff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d80c81a0 con 0x7fc9d80cfd50 2023-07-14T15:57:09.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.859+0000 7fc9ddfff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d8150330 con 0x7fc9d80b3290 2023-07-14T15:57:09.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.859+0000 7fc9ddfff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d8151bb0 con 0x7fc9d80b1e80 2023-07-14T15:57:09.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.859+0000 7fc9d7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9d80cfd50 0x7fc9d8150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:09.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.859+0000 7fc9d7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9d80cfd50 0x7fc9d8150d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46926/0 (socket says 172.21.15.37:46926) 2023-07-14T15:57:09.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.859+0000 7fc9d7fff700 1 -- 172.21.15.37:0/1027678676 learned_addr learned my addr 172.21.15.37:0/1027678676 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:09.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.859+0000 7fc9d77fe700 1 --2- 172.21.15.37:0/1027678676 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc9d80b1e80 0x7fc9d80b6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:09.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.859+0000 7fc9d6ffd700 1 --2- 172.21.15.37:0/1027678676 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9d80b3290 0x7fc9d80c6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:09.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.860+0000 7fc9d7fff700 1 -- 172.21.15.37:0/1027678676 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc9d80b1e80 msgr2=0x7fc9d80b6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:09.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.860+0000 7fc9d7fff700 1 --2- 172.21.15.37:0/1027678676 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc9d80b1e80 0x7fc9d80b6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:09.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.860+0000 7fc9d7fff700 1 -- 172.21.15.37:0/1027678676 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9d80b3290 msgr2=0x7fc9d80c6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:09.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.860+0000 7fc9d7fff700 1 --2- 172.21.15.37:0/1027678676 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9d80b3290 0x7fc9d80c6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:09.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.860+0000 7fc9d7fff700 1 -- 172.21.15.37:0/1027678676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c8009550 con 0x7fc9d80cfd50 2023-07-14T15:57:09.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.860+0000 7fc9d7fff700 1 --2- 172.21.15.37:0/1027678676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9d80cfd50 0x7fc9d8150d80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc9d0007e40 tx=0x7fc9d000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:09.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.860+0000 7fc9bffff700 1 -- 172.21.15.37:0/1027678676 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d000ed30 con 0x7fc9d80cfd50 2023-07-14T15:57:09.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.860+0000 7fc9bffff700 1 -- 172.21.15.37:0/1027678676 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d0014420 con 0x7fc9d80cfd50 2023-07-14T15:57:09.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.860+0000 7fc9bffff700 1 -- 172.21.15.37:0/1027678676 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d00147d0 con 0x7fc9d80cfd50 2023-07-14T15:57:09.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.860+0000 7fc9ddfff700 1 -- 172.21.15.37:0/1027678676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9d80d02a0 con 0x7fc9d80cfd50 2023-07-14T15:57:09.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.860+0000 7fc9ddfff700 1 -- 172.21.15.37:0/1027678676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9d80b8910 con 0x7fc9d80cfd50 2023-07-14T15:57:09.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.862+0000 7fc9ddfff700 1 -- 172.21.15.37:0/1027678676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9d8067840 con 0x7fc9d80cfd50 2023-07-14T15:57:09.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.863+0000 7fc9bffff700 1 -- 172.21.15.37:0/1027678676 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc9d0014930 con 0x7fc9d80cfd50 2023-07-14T15:57:09.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.863+0000 7fc9bffff700 1 --2- 172.21.15.37:0/1027678676 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc9c406ace0 0x7fc9c406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:09.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.864+0000 7fc9bffff700 1 -- 172.21.15.37:0/1027678676 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc9d0089b50 con 0x7fc9d80cfd50 2023-07-14T15:57:09.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.864+0000 7fc9d77fe700 1 --2- 172.21.15.37:0/1027678676 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc9c406ace0 0x7fc9c406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:09.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.865+0000 7fc9d77fe700 1 --2- 172.21.15.37:0/1027678676 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc9c406ace0 0x7fc9c406d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc9c8014040 tx=0x7fc9c8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:09.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:09.868+0000 7fc9bffff700 1 -- 172.21.15.37:0/1027678676 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc9d0054bf0 con 0x7fc9d80cfd50 2023-07-14T15:57:10.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.072+0000 7fc9ddfff700 1 -- 172.21.15.37:0/1027678676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc9d80cf360 con 0x7fc9d80cfd50 2023-07-14T15:57:10.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.073+0000 7fc9bffff700 1 -- 172.21.15.37:0/1027678676 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc9d0058210 con 0x7fc9d80cfd50 2023-07-14T15:57:10.059 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-14T15:57:10.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.075+0000 7fc9ddfff700 1 -- 172.21.15.37:0/1027678676 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc9c406ace0 msgr2=0x7fc9c406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:10.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.075+0000 7fc9ddfff700 1 --2- 172.21.15.37:0/1027678676 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc9c406ace0 0x7fc9c406d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc9c8014040 tx=0x7fc9c8008030 comp rx=0 tx=0).stop 2023-07-14T15:57:10.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.075+0000 7fc9ddfff700 1 -- 172.21.15.37:0/1027678676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9d80cfd50 msgr2=0x7fc9d8150d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:10.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.075+0000 7fc9ddfff700 1 --2- 172.21.15.37:0/1027678676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9d80cfd50 0x7fc9d8150d80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc9d0007e40 tx=0x7fc9d000e3c0 comp rx=0 tx=0).stop 2023-07-14T15:57:10.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.075+0000 7fc9ddfff700 1 -- 172.21.15.37:0/1027678676 shutdown_connections 2023-07-14T15:57:10.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.075+0000 7fc9ddfff700 1 --2- 172.21.15.37:0/1027678676 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc9c406ace0 0x7fc9c406d190 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:10.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.075+0000 7fc9ddfff700 1 --2- 172.21.15.37:0/1027678676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9d80cfd50 0x7fc9d8150d80 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:10.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.075+0000 7fc9ddfff700 1 --2- 172.21.15.37:0/1027678676 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc9d80b1e80 0x7fc9d80b6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:10.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.075+0000 7fc9ddfff700 1 --2- 172.21.15.37:0/1027678676 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9d80b3290 0x7fc9d80c6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:10.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.075+0000 7fc9ddfff700 1 -- 172.21.15.37:0/1027678676 >> 172.21.15.37:0/1027678676 conn(0x7fc9d809c1c0 msgr2=0x7fc9d80b3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:10.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.075+0000 7fc9ddfff700 1 -- 172.21.15.37:0/1027678676 shutdown_connections 2023-07-14T15:57:10.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.075+0000 7fc9ddfff700 1 -- 172.21.15.37:0/1027678676 wait complete. 2023-07-14T15:57:10.080 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T15:57:10.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.299+0000 7f90fefff700 1 Processor -- start 2023-07-14T15:57:10.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.299+0000 7f90fefff700 1 -- start start 2023-07-14T15:57:10.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.301+0000 7f90fefff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f90f80cfd50 0x7f90f80d2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:10.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.301+0000 7f90fefff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f90f80b1e80 0x7f90f80b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:10.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.301+0000 7f90fefff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90f80b1840 con 0x7f90f80b3290 2023-07-14T15:57:10.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.301+0000 7f90fefff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90f815ccf0 con 0x7f90f80cfd50 2023-07-14T15:57:10.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.301+0000 7f90fefff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f80b2550 con 0x7f90f80b1e80 2023-07-14T15:57:10.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.301+0000 7f90fd59c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f90f80b3290 0x7f90f80b36f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46280/0 (socket says 172.21.15.37:46280) 2023-07-14T15:57:10.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.301+0000 7f90fd59c700 1 -- 172.21.15.37:0/4155056657 learned_addr learned my addr 172.21.15.37:0/4155056657 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:10.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.301+0000 7f90f7fff700 1 --2- 172.21.15.37:0/4155056657 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f90f80b1e80 0x7f90f80b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:10.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.301+0000 7f90fcd9b700 1 --2- 172.21.15.37:0/4155056657 >> v2:172.21.15.98:3300/0 conn(0x7f90f80cfd50 0x7f90f80d2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:10.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.301+0000 7f90f77fe700 1 -- 172.21.15.37:0/4155056657 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2271208482 0 0) 0x7f90f80b1840 con 0x7f90f80b3290 2023-07-14T15:57:10.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.301+0000 7f90f77fe700 1 -- 172.21.15.37:0/4155056657 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90e80035b0 con 0x7f90f80b3290 2023-07-14T15:57:10.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.302+0000 7f90fcd9b700 1 -- 172.21.15.37:0/4155056657 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f90f80b1e80 msgr2=0x7f90f80b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:10.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.302+0000 7f90fcd9b700 1 --2- 172.21.15.37:0/4155056657 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f90f80b1e80 0x7f90f80b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:10.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.302+0000 7f90fcd9b700 1 -- 172.21.15.37:0/4155056657 >> v1:172.21.15.37:6789/0 conn(0x7f90f80b3290 legacy=0x7f90f80b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:10.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.302+0000 7f90fcd9b700 1 -- 172.21.15.37:0/4155056657 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f80b2830 con 0x7f90f80cfd50 2023-07-14T15:57:10.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.302+0000 7f90f7fff700 1 --2- 172.21.15.37:0/4155056657 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f90f80b1e80 0x7f90f80b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:57:10.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.302+0000 7f90fcd9b700 1 --2- 172.21.15.37:0/4155056657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90f80cfd50 0x7f90f80d2880 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f90ec009840 tx=0x7f90ec009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f39299066cb25b5c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:10.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.302+0000 7f90f77fe700 1 -- 172.21.15.37:0/4155056657 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ec011830 con 0x7f90f80cfd50 2023-07-14T15:57:10.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.302+0000 7f90f77fe700 1 -- 172.21.15.37:0/4155056657 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90ec011990 con 0x7f90f80cfd50 2023-07-14T15:57:10.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.302+0000 7f90f77fe700 1 -- 172.21.15.37:0/4155056657 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ec011d20 con 0x7f90f80cfd50 2023-07-14T15:57:10.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.303+0000 7f90fefff700 1 -- 172.21.15.37:0/4155056657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90f80cfd50 msgr2=0x7f90f80d2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:10.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.303+0000 7f90fefff700 1 --2- 172.21.15.37:0/4155056657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90f80cfd50 0x7f90f80d2880 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f90ec009840 tx=0x7f90ec009b50 comp rx=0 tx=0).stop 2023-07-14T15:57:10.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.303+0000 7f90fefff700 1 -- 172.21.15.37:0/4155056657 shutdown_connections 2023-07-14T15:57:10.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.303+0000 7f90fefff700 1 --2- 172.21.15.37:0/4155056657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90f80cfd50 0x7f90f80d2880 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:10.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.303+0000 7f90fefff700 1 --2- 172.21.15.37:0/4155056657 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f90f80b1e80 0x7f90f80b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:10.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.303+0000 7f90fefff700 1 -- 172.21.15.37:0/4155056657 >> 172.21.15.37:0/4155056657 conn(0x7f90f809c1c0 msgr2=0x7f90f80d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:10.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.303+0000 7f90fefff700 1 -- 172.21.15.37:0/4155056657 shutdown_connections 2023-07-14T15:57:10.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.303+0000 7f90fefff700 1 -- 172.21.15.37:0/4155056657 wait complete. 2023-07-14T15:57:10.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.305+0000 7f90fefff700 1 Processor -- start 2023-07-14T15:57:10.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.305+0000 7f90fefff700 1 -- start start 2023-07-14T15:57:10.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.306+0000 7f90fefff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90f80b1e80 0x7f90f81548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:10.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.306+0000 7f90fefff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f90f80b3290 0x7f90f81f2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:10.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.306+0000 7f90fefff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90f80cfd50 0x7f90f8159980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:10.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.306+0000 7f90fefff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f81f28b0 con 0x7f90f80b1e80 2023-07-14T15:57:10.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.306+0000 7f90fefff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f8157320 con 0x7f90f80cfd50 2023-07-14T15:57:10.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.306+0000 7f90fefff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f815a420 con 0x7f90f80b3290 2023-07-14T15:57:10.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.306+0000 7f90fcd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90f80b1e80 0x7f90f81548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:10.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.306+0000 7f90fcd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90f80b1e80 0x7f90f81548f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60156/0 (socket says 172.21.15.37:60156) 2023-07-14T15:57:10.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.306+0000 7f90fcd9b700 1 -- 172.21.15.37:0/1587944164 learned_addr learned my addr 172.21.15.37:0/1587944164 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:10.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.306+0000 7f90fd59c700 1 --2- 172.21.15.37:0/1587944164 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90f80cfd50 0x7f90f8159980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:10.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.306+0000 7f90f7fff700 1 --2- 172.21.15.37:0/1587944164 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f90f80b3290 0x7f90f81f2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:10.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.306+0000 7f90fcd9b700 1 -- 172.21.15.37:0/1587944164 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f90f80b3290 msgr2=0x7f90f81f2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:10.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.306+0000 7f90fcd9b700 1 --2- 172.21.15.37:0/1587944164 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f90f80b3290 0x7f90f81f2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:10.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.306+0000 7f90fcd9b700 1 -- 172.21.15.37:0/1587944164 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90f80cfd50 msgr2=0x7f90f8159980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:10.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.306+0000 7f90fcd9b700 1 --2- 172.21.15.37:0/1587944164 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90f80cfd50 0x7f90f8159980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:10.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.306+0000 7f90fcd9b700 1 -- 172.21.15.37:0/1587944164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e40094a0 con 0x7f90f80b1e80 2023-07-14T15:57:10.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.306+0000 7f90fd59c700 1 --2- 172.21.15.37:0/1587944164 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90f80cfd50 0x7f90f8159980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:57:10.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.306+0000 7f90f7fff700 1 --2- 172.21.15.37:0/1587944164 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f90f80b3290 0x7f90f81f2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:57:10.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.307+0000 7f90fcd9b700 1 --2- 172.21.15.37:0/1587944164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90f80b1e80 0x7f90f81548f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f90ec0090b0 tx=0x7f90ec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:10.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.307+0000 7f90f57fa700 1 -- 172.21.15.37:0/1587944164 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ec0036a0 con 0x7f90f80b1e80 2023-07-14T15:57:10.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.307+0000 7f90f57fa700 1 -- 172.21.15.37:0/1587944164 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90ec01e070 con 0x7f90f80b1e80 2023-07-14T15:57:10.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.307+0000 7f90f57fa700 1 -- 172.21.15.37:0/1587944164 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ec003a60 con 0x7f90f80b1e80 2023-07-14T15:57:10.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.307+0000 7f90fefff700 1 -- 172.21.15.37:0/1587944164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90ec0094a0 con 0x7f90f80b1e80 2023-07-14T15:57:10.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.307+0000 7f90fefff700 1 -- 172.21.15.37:0/1587944164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f80d02a0 con 0x7f90f80b1e80 2023-07-14T15:57:10.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.308+0000 7f90fefff700 1 -- 172.21.15.37:0/1587944164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90f8067840 con 0x7f90f80b1e80 2023-07-14T15:57:10.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.309+0000 7f90f57fa700 1 -- 172.21.15.37:0/1587944164 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f90ec003bc0 con 0x7f90f80b1e80 2023-07-14T15:57:10.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.310+0000 7f90f57fa700 1 --2- 172.21.15.37:0/1587944164 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f90dc06ace0 0x7f90dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:10.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.310+0000 7f90f57fa700 1 -- 172.21.15.37:0/1587944164 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f90ec08a3d0 con 0x7f90f80b1e80 2023-07-14T15:57:10.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.311+0000 7f90f7fff700 1 --2- 172.21.15.37:0/1587944164 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f90dc06ace0 0x7f90dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:10.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.312+0000 7f90f7fff700 1 --2- 172.21.15.37:0/1587944164 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f90dc06ace0 0x7f90dc06d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f90f80c98b0 tx=0x7f90e4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:10.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.315+0000 7f90f57fa700 1 -- 172.21.15.37:0/1587944164 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f90ec055470 con 0x7f90f80b1e80 2023-07-14T15:57:10.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.519+0000 7f90fefff700 1 -- 172.21.15.37:0/1587944164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f90f808bf50 con 0x7f90f80b1e80 2023-07-14T15:57:10.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.520+0000 7f90f57fa700 1 -- 172.21.15.37:0/1587944164 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f90ec058a90 con 0x7f90f80b1e80 2023-07-14T15:57:10.506 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-14T15:57:10.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.522+0000 7f90fefff700 1 -- 172.21.15.37:0/1587944164 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f90dc06ace0 msgr2=0x7f90dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:10.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.522+0000 7f90fefff700 1 --2- 172.21.15.37:0/1587944164 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f90dc06ace0 0x7f90dc06d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f90f80c98b0 tx=0x7f90e4008040 comp rx=0 tx=0).stop 2023-07-14T15:57:10.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.522+0000 7f90fefff700 1 -- 172.21.15.37:0/1587944164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90f80b1e80 msgr2=0x7f90f81548f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:10.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.522+0000 7f90fefff700 1 --2- 172.21.15.37:0/1587944164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90f80b1e80 0x7f90f81548f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f90ec0090b0 tx=0x7f90ec004750 comp rx=0 tx=0).stop 2023-07-14T15:57:10.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.522+0000 7f90fefff700 1 -- 172.21.15.37:0/1587944164 shutdown_connections 2023-07-14T15:57:10.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.522+0000 7f90fefff700 1 --2- 172.21.15.37:0/1587944164 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90f80cfd50 0x7f90f8159980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:10.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.522+0000 7f90fefff700 1 --2- 172.21.15.37:0/1587944164 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f90dc06ace0 0x7f90dc06d190 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:10.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.522+0000 7f90fefff700 1 --2- 172.21.15.37:0/1587944164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90f80b1e80 0x7f90f81548f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:10.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.522+0000 7f90fefff700 1 --2- 172.21.15.37:0/1587944164 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f90f80b3290 0x7f90f81f2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:10.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.522+0000 7f90fefff700 1 -- 172.21.15.37:0/1587944164 >> 172.21.15.37:0/1587944164 conn(0x7f90f809c1c0 msgr2=0x7f90f806bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:10.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.522+0000 7f90fefff700 1 -- 172.21.15.37:0/1587944164 shutdown_connections 2023-07-14T15:57:10.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.522+0000 7f90fefff700 1 -- 172.21.15.37:0/1587944164 wait complete. 2023-07-14T15:57:10.528 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T15:57:10.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.745+0000 7fa8acbff700 1 Processor -- start 2023-07-14T15:57:10.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.746+0000 7fa8acbff700 1 -- start start 2023-07-14T15:57:10.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.747+0000 7fa8acbff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa8a80b85f0 0x7fa8a815d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:10.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.747+0000 7fa8acbff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa8a80b4910 0x7fa8a80b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:10.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.747+0000 7fa8acbff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a80b52b0 con 0x7fa8a80b54b0 2023-07-14T15:57:10.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.747+0000 7fa8acbff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8a80cf6b0 con 0x7fa8a80b85f0 2023-07-14T15:57:10.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.747+0000 7fa8acbff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a80cdc40 con 0x7fa8a80b4910 2023-07-14T15:57:10.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.747+0000 7fa89ffff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa8a80b54b0 0x7fa8a80cfb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46286/0 (socket says 172.21.15.37:46286) 2023-07-14T15:57:10.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.747+0000 7fa89ffff700 1 -- 172.21.15.37:0/3258648583 learned_addr learned my addr 172.21.15.37:0/3258648583 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:10.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.747+0000 7fa8a659c700 1 --2- 172.21.15.37:0/3258648583 >> v2:172.21.15.98:3300/0 conn(0x7fa8a80b85f0 0x7fa8a815d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:10.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.747+0000 7fa8a6d9d700 1 --2- 172.21.15.37:0/3258648583 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa8a80b4910 0x7fa8a80b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:10.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.748+0000 7fa8a5d9b700 1 -- 172.21.15.37:0/3258648583 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1946414548 0 0) 0x7fa8a80b52b0 con 0x7fa8a80b54b0 2023-07-14T15:57:10.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.748+0000 7fa8a5d9b700 1 -- 172.21.15.37:0/3258648583 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8940035b0 con 0x7fa8a80b54b0 2023-07-14T15:57:10.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.748+0000 7fa8a659c700 1 -- 172.21.15.37:0/3258648583 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa8a80b4910 msgr2=0x7fa8a80b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:10.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.748+0000 7fa8a659c700 1 --2- 172.21.15.37:0/3258648583 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa8a80b4910 0x7fa8a80b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:10.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.748+0000 7fa8a659c700 1 -- 172.21.15.37:0/3258648583 >> v1:172.21.15.37:6789/0 conn(0x7fa8a80b54b0 legacy=0x7fa8a80cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:10.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.748+0000 7fa8a659c700 1 -- 172.21.15.37:0/3258648583 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a815dba0 con 0x7fa8a80b85f0 2023-07-14T15:57:10.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.748+0000 7fa8a659c700 1 --2- 172.21.15.37:0/3258648583 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8a80b85f0 0x7fa8a815d660 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa898009840 tx=0x7fa898009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91b0ca7c14ba5cd4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:10.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.749+0000 7fa8a5d9b700 1 -- 172.21.15.37:0/3258648583 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa898011830 con 0x7fa8a80b85f0 2023-07-14T15:57:10.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.749+0000 7fa8a5d9b700 1 -- 172.21.15.37:0/3258648583 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa898011990 con 0x7fa8a80b85f0 2023-07-14T15:57:10.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.749+0000 7fa8a5d9b700 1 -- 172.21.15.37:0/3258648583 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa898011d20 con 0x7fa8a80b85f0 2023-07-14T15:57:10.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.749+0000 7fa8acbff700 1 -- 172.21.15.37:0/3258648583 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8a80b85f0 msgr2=0x7fa8a815d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:10.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.749+0000 7fa8acbff700 1 --2- 172.21.15.37:0/3258648583 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8a80b85f0 0x7fa8a815d660 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa898009840 tx=0x7fa898009b50 comp rx=0 tx=0).stop 2023-07-14T15:57:10.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.749+0000 7fa8acbff700 1 -- 172.21.15.37:0/3258648583 shutdown_connections 2023-07-14T15:57:10.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.749+0000 7fa8acbff700 1 --2- 172.21.15.37:0/3258648583 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa8a80b4910 0x7fa8a80b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:10.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.749+0000 7fa8acbff700 1 --2- 172.21.15.37:0/3258648583 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8a80b85f0 0x7fa8a815d660 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:10.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.749+0000 7fa8acbff700 1 -- 172.21.15.37:0/3258648583 >> 172.21.15.37:0/3258648583 conn(0x7fa8a806a580 msgr2=0x7fa8a806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:10.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.749+0000 7fa8acbff700 1 -- 172.21.15.37:0/3258648583 shutdown_connections 2023-07-14T15:57:10.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.749+0000 7fa8acbff700 1 -- 172.21.15.37:0/3258648583 wait complete. 2023-07-14T15:57:10.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.752+0000 7fa8acbff700 1 Processor -- start 2023-07-14T15:57:10.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.752+0000 7fa8acbff700 1 -- start start 2023-07-14T15:57:10.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.753+0000 7fa8acbff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa8a80b4910 0x7fa8a80cab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:10.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.753+0000 7fa8acbff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8a80b54b0 0x7fa8a81560a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:10.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.753+0000 7fa8acbff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8a80b85f0 0x7fa8a815fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:10.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.753+0000 7fa8acbff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a80c7410 con 0x7fa8a80b54b0 2023-07-14T15:57:10.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.753+0000 7fa8acbff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a81565e0 con 0x7fa8a80b85f0 2023-07-14T15:57:10.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.753+0000 7fa8acbff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a8160310 con 0x7fa8a80b4910 2023-07-14T15:57:10.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.754+0000 7fa89ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8a80b54b0 0x7fa8a81560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:10.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.754+0000 7fa8a659c700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa8a80b4910 0x7fa8a80cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:10.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.754+0000 7fa89ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8a80b54b0 0x7fa8a81560a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60162/0 (socket says 172.21.15.37:60162) 2023-07-14T15:57:10.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.754+0000 7fa89ffff700 1 -- 172.21.15.37:0/2504921418 learned_addr learned my addr 172.21.15.37:0/2504921418 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:10.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.754+0000 7fa8a6d9d700 1 --2- 172.21.15.37:0/2504921418 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8a80b85f0 0x7fa8a815fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:10.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.754+0000 7fa89ffff700 1 -- 172.21.15.37:0/2504921418 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa8a80b4910 msgr2=0x7fa8a80cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:10.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.754+0000 7fa89ffff700 1 --2- 172.21.15.37:0/2504921418 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa8a80b4910 0x7fa8a80cab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:10.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.754+0000 7fa89ffff700 1 -- 172.21.15.37:0/2504921418 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8a80b85f0 msgr2=0x7fa8a815fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:10.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.754+0000 7fa89ffff700 1 --2- 172.21.15.37:0/2504921418 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8a80b85f0 0x7fa8a815fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:10.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.754+0000 7fa89ffff700 1 -- 172.21.15.37:0/2504921418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8980094a0 con 0x7fa8a80b54b0 2023-07-14T15:57:10.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.754+0000 7fa89ffff700 1 --2- 172.21.15.37:0/2504921418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8a80b54b0 0x7fa8a81560a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa89000c700 tx=0x7fa89000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:10.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.754+0000 7fa89effd700 1 -- 172.21.15.37:0/2504921418 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa890005d70 con 0x7fa8a80b54b0 2023-07-14T15:57:10.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.755+0000 7fa89effd700 1 -- 172.21.15.37:0/2504921418 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8900070d0 con 0x7fa8a80b54b0 2023-07-14T15:57:10.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.755+0000 7fa89effd700 1 -- 172.21.15.37:0/2504921418 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa890007460 con 0x7fa8a80b54b0 2023-07-14T15:57:10.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.755+0000 7fa8acbff700 1 -- 172.21.15.37:0/2504921418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8a80c6ab0 con 0x7fa8a80b54b0 2023-07-14T15:57:10.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.755+0000 7fa8acbff700 1 -- 172.21.15.37:0/2504921418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8a80c6d50 con 0x7fa8a80b54b0 2023-07-14T15:57:10.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.756+0000 7fa8acbff700 1 -- 172.21.15.37:0/2504921418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8a80c7550 con 0x7fa8a80b54b0 2023-07-14T15:57:10.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.757+0000 7fa89effd700 1 -- 172.21.15.37:0/2504921418 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa8900075c0 con 0x7fa8a80b54b0 2023-07-14T15:57:10.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.758+0000 7fa89effd700 1 --2- 172.21.15.37:0/2504921418 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa88806ace0 0x7fa88806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:10.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.758+0000 7fa89effd700 1 -- 172.21.15.37:0/2504921418 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa890088830 con 0x7fa8a80b54b0 2023-07-14T15:57:10.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.758+0000 7fa8a659c700 1 --2- 172.21.15.37:0/2504921418 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa88806ace0 0x7fa88806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:10.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.759+0000 7fa8a659c700 1 --2- 172.21.15.37:0/2504921418 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa88806ace0 0x7fa88806d190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa898000c00 tx=0x7fa89801c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:10.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:10.762+0000 7fa89effd700 1 -- 172.21.15.37:0/2504921418 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa8a80c7550 con 0x7fa8a80b54b0 2023-07-14T15:57:11.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.018+0000 7fa8acbff700 1 -- 172.21.15.37:0/2504921418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa8a80c7550 con 0x7fa8a80b54b0 2023-07-14T15:57:11.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.018+0000 7fa89effd700 1 -- 172.21.15.37:0/2504921418 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4697 (secure 0 0 0) 0x7fa8a80c7550 con 0x7fa8a80b54b0 2023-07-14T15:57:11.005 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:57:11.005 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/596800720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":596800720},{"type":"v1","addr":"172.21.15.37:6835","nonce":596800720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4318,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/1611780456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1611780456},{"type":"v1","addr":"172.21.15.37:6834","nonce":1611780456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4324,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/586880065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":586880065},{"type":"v1","addr":"172.21.15.98:6835","nonce":586880065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T15:56:08.459886+0000","modified":"2023-07-14T15:56:11.974298+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4327},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4327":{"gid":4327,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6837/2731892479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2731892479},{"type":"v1","addr":"172.21.15.98:6837","nonce":2731892479}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T15:57:11.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.020+0000 7fa8acbff700 1 -- 172.21.15.37:0/2504921418 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa88806ace0 msgr2=0x7fa88806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:11.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.020+0000 7fa8acbff700 1 --2- 172.21.15.37:0/2504921418 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa88806ace0 0x7fa88806d190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa898000c00 tx=0x7fa89801c040 comp rx=0 tx=0).stop 2023-07-14T15:57:11.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.020+0000 7fa8acbff700 1 -- 172.21.15.37:0/2504921418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8a80b54b0 msgr2=0x7fa8a81560a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:11.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.020+0000 7fa8acbff700 1 --2- 172.21.15.37:0/2504921418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8a80b54b0 0x7fa8a81560a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa89000c700 tx=0x7fa89000ca10 comp rx=0 tx=0).stop 2023-07-14T15:57:11.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.021+0000 7fa8acbff700 1 -- 172.21.15.37:0/2504921418 shutdown_connections 2023-07-14T15:57:11.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.021+0000 7fa8acbff700 1 --2- 172.21.15.37:0/2504921418 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8a80b85f0 0x7fa8a815fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:11.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.021+0000 7fa8acbff700 1 --2- 172.21.15.37:0/2504921418 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa88806ace0 0x7fa88806d190 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:11.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.021+0000 7fa8acbff700 1 --2- 172.21.15.37:0/2504921418 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa8a80b4910 0x7fa8a80cab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:11.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.021+0000 7fa8acbff700 1 --2- 172.21.15.37:0/2504921418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8a80b54b0 0x7fa8a81560a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:11.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.021+0000 7fa8acbff700 1 -- 172.21.15.37:0/2504921418 >> 172.21.15.37:0/2504921418 conn(0x7fa8a806a580 msgr2=0x7fa8a80d2360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:11.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.021+0000 7fa8acbff700 1 -- 172.21.15.37:0/2504921418 shutdown_connections 2023-07-14T15:57:11.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.021+0000 7fa8acbff700 1 -- 172.21.15.37:0/2504921418 wait complete. 2023-07-14T15:57:11.008 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 7 2023-07-14T15:57:11.025 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T15:57:11.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.242+0000 7f6bad9ff700 1 Processor -- start 2023-07-14T15:57:11.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.242+0000 7f6bad9ff700 1 -- start start 2023-07-14T15:57:11.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.243+0000 7f6bad9ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6ba80b85f0 0x7f6ba815d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:11.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.243+0000 7f6bad9ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f6ba80b4910 0x7f6ba80b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:11.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.243+0000 7f6bad9ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ba80cf6b0 con 0x7f6ba80b54b0 2023-07-14T15:57:11.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.243+0000 7f6bad9ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ba80b52d0 con 0x7f6ba80b4910 2023-07-14T15:57:11.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.243+0000 7f6bad9ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba80cdc40 con 0x7f6ba80b85f0 2023-07-14T15:57:11.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.244+0000 7f6ba67fc700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6ba80b54b0 0x7f6ba80cfb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46288/0 (socket says 172.21.15.37:46288) 2023-07-14T15:57:11.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.244+0000 7f6ba67fc700 1 -- 172.21.15.37:0/2477071 learned_addr learned my addr 172.21.15.37:0/2477071 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:11.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.244+0000 7f6ba6ffd700 1 --2- 172.21.15.37:0/2477071 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6ba80b85f0 0x7f6ba815d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:11.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.244+0000 7f6ba77fe700 1 --2- 172.21.15.37:0/2477071 >> v2:172.21.15.98:3300/0 conn(0x7f6ba80b4910 0x7f6ba80b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:11.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.244+0000 7f6ba5ffb700 1 -- 172.21.15.37:0/2477071 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2401938422 0 0) 0x7f6ba80cf6b0 con 0x7f6ba80b54b0 2023-07-14T15:57:11.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.244+0000 7f6ba5ffb700 1 -- 172.21.15.37:0/2477071 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b900035b0 con 0x7f6ba80b54b0 2023-07-14T15:57:11.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.244+0000 7f6ba5ffb700 1 -- 172.21.15.37:0/2477071 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3076733603 0 0) 0x7f6b900035b0 con 0x7f6ba80b54b0 2023-07-14T15:57:11.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.244+0000 7f6ba5ffb700 1 -- 172.21.15.37:0/2477071 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6ba80b85f0 msgr2=0x7f6ba815d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:11.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.245+0000 7f6ba5ffb700 1 --2- 172.21.15.37:0/2477071 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6ba80b85f0 0x7f6ba815d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:11.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.245+0000 7f6ba5ffb700 1 -- 172.21.15.37:0/2477071 >> v2:172.21.15.98:3300/0 conn(0x7f6ba80b4910 msgr2=0x7f6ba80b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:11.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.245+0000 7f6ba5ffb700 1 --2- 172.21.15.37:0/2477071 >> v2:172.21.15.98:3300/0 conn(0x7f6ba80b4910 0x7f6ba80b4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:11.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.245+0000 7f6ba5ffb700 1 -- 172.21.15.37:0/2477071 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba815dba0 con 0x7f6ba80b54b0 2023-07-14T15:57:11.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.245+0000 7f6ba5ffb700 1 -- 172.21.15.37:0/2477071 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48633207 0 0) 0x7f6b9c001670 con 0x7f6ba80b54b0 2023-07-14T15:57:11.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.245+0000 7f6ba5ffb700 1 -- 172.21.15.37:0/2477071 >> v1:172.21.15.37:6789/0 conn(0x7f6ba80b54b0 legacy=0x7f6ba80cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:11.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.245+0000 7f6ba5ffb700 1 --2- 172.21.15.37:0/2477071 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b90003a00 0x7f6b90003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:11.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.245+0000 7f6ba5ffb700 1 --2- 172.21.15.37:0/2477071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b90004430 0x7f6b900048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:11.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.245+0000 7f6ba5ffb700 1 --2- 172.21.15.37:0/2477071 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6ba80b85f0 0x7f6b90005060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:11.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.245+0000 7f6ba5ffb700 1 -- 172.21.15.37:0/2477071 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba80b52d0 con 0x7f6b90004430 2023-07-14T15:57:11.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.245+0000 7f6ba5ffb700 1 -- 172.21.15.37:0/2477071 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba80cdc40 con 0x7f6b90003a00 2023-07-14T15:57:11.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.245+0000 7f6ba5ffb700 1 -- 172.21.15.37:0/2477071 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9000ba10 con 0x7f6ba80b85f0 2023-07-14T15:57:11.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.245+0000 7f6ba77fe700 1 --2- 172.21.15.37:0/2477071 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6ba80b85f0 0x7f6b90005060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:11.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.245+0000 7f6ba6ffd700 1 --2- 172.21.15.37:0/2477071 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b90003a00 0x7f6b90003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:11.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.245+0000 7f6ba67fc700 1 --2- 172.21.15.37:0/2477071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b90004430 0x7f6b900048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:11.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.245+0000 7f6ba77fe700 1 -- 172.21.15.37:0/2477071 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b90003a00 msgr2=0x7f6b90003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:11.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.245+0000 7f6ba77fe700 1 --2- 172.21.15.37:0/2477071 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b90003a00 0x7f6b90003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:11.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.245+0000 7f6ba77fe700 1 -- 172.21.15.37:0/2477071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b90004430 msgr2=0x7f6b900048f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:11.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.245+0000 7f6ba77fe700 1 --2- 172.21.15.37:0/2477071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b90004430 0x7f6b900048f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:11.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.245+0000 7f6ba77fe700 1 -- 172.21.15.37:0/2477071 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b900035b0 con 0x7f6ba80b85f0 2023-07-14T15:57:11.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.245+0000 7f6ba67fc700 1 --2- 172.21.15.37:0/2477071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b90004430 0x7f6b900048f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:57:11.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.246+0000 7f6ba6ffd700 1 --2- 172.21.15.37:0/2477071 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b90003a00 0x7f6b90003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:57:11.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.246+0000 7f6ba77fe700 1 --2- 172.21.15.37:0/2477071 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6ba80b85f0 0x7f6b90005060 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0009fc0 tx=0x7f6b90005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7b3078c36a0e454 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:11.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.246+0000 7f6ba5ffb700 1 -- 172.21.15.37:0/2477071 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba000ec30 con 0x7f6ba80b85f0 2023-07-14T15:57:11.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.246+0000 7f6ba5ffb700 1 -- 172.21.15.37:0/2477071 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba000f040 con 0x7f6ba80b85f0 2023-07-14T15:57:11.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.246+0000 7f6ba5ffb700 1 -- 172.21.15.37:0/2477071 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba0014480 con 0x7f6ba80b85f0 2023-07-14T15:57:11.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.247+0000 7f6bad9ff700 1 -- 172.21.15.37:0/2477071 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6ba80b85f0 msgr2=0x7f6b90005060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:11.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.247+0000 7f6bad9ff700 1 --2- 172.21.15.37:0/2477071 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6ba80b85f0 0x7f6b90005060 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0009fc0 tx=0x7f6b90005880 comp rx=0 tx=0).stop 2023-07-14T15:57:11.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.247+0000 7f6ba77fe700 1 -- 172.21.15.37:0/2477071 reap_dead start 2023-07-14T15:57:11.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.247+0000 7f6bad9ff700 1 -- 172.21.15.37:0/2477071 shutdown_connections 2023-07-14T15:57:11.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.247+0000 7f6bad9ff700 1 -- 172.21.15.37:0/2477071 >> 172.21.15.37:0/2477071 conn(0x7f6ba806a580 msgr2=0x7f6ba806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:11.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.247+0000 7f6bad9ff700 1 -- 172.21.15.37:0/2477071 shutdown_connections 2023-07-14T15:57:11.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.247+0000 7f6bad9ff700 1 -- 172.21.15.37:0/2477071 wait complete. 2023-07-14T15:57:11.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.249+0000 7f6bad9ff700 1 Processor -- start 2023-07-14T15:57:11.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.249+0000 7f6bad9ff700 1 -- start start 2023-07-14T15:57:11.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.250+0000 7f6bad9ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ba80b85f0 0x7f6ba8160880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:11.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.250+0000 7f6bad9ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ba815fac0 0x7f6ba814d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:11.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.250+0000 7f6bad9ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6ba80cc6f0 0x7f6ba80ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:11.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.250+0000 7f6bad9ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba80cd0a0 con 0x7f6ba80b85f0 2023-07-14T15:57:11.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.250+0000 7f6bad9ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba8160dc0 con 0x7f6ba815fac0 2023-07-14T15:57:11.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.250+0000 7f6bad9ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba815e740 con 0x7f6ba80cc6f0 2023-07-14T15:57:11.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.250+0000 7f6ba6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ba80b85f0 0x7f6ba8160880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:11.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.250+0000 7f6ba6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ba80b85f0 0x7f6ba8160880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60178/0 (socket says 172.21.15.37:60178) 2023-07-14T15:57:11.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.250+0000 7f6ba6ffd700 1 -- 172.21.15.37:0/3263840852 learned_addr learned my addr 172.21.15.37:0/3263840852 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:11.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.250+0000 7f6ba67fc700 1 --2- 172.21.15.37:0/3263840852 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ba815fac0 0x7f6ba814d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:11.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.250+0000 7f6ba77fe700 1 --2- 172.21.15.37:0/3263840852 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6ba80cc6f0 0x7f6ba80ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:11.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.250+0000 7f6ba6ffd700 1 -- 172.21.15.37:0/3263840852 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6ba80cc6f0 msgr2=0x7f6ba80ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:11.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.250+0000 7f6ba6ffd700 1 --2- 172.21.15.37:0/3263840852 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6ba80cc6f0 0x7f6ba80ccb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:11.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.250+0000 7f6ba6ffd700 1 -- 172.21.15.37:0/3263840852 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ba815fac0 msgr2=0x7f6ba814d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:11.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.250+0000 7f6ba6ffd700 1 --2- 172.21.15.37:0/3263840852 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ba815fac0 0x7f6ba814d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:11.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.250+0000 7f6ba6ffd700 1 -- 172.21.15.37:0/3263840852 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba815ea20 con 0x7f6ba80b85f0 2023-07-14T15:57:11.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.251+0000 7f6ba6ffd700 1 --2- 172.21.15.37:0/3263840852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ba80b85f0 0x7f6ba8160880 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6b98011ca0 tx=0x7f6b9800f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:11.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.251+0000 7f6b8ffff700 1 -- 172.21.15.37:0/3263840852 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b98011e40 con 0x7f6ba80b85f0 2023-07-14T15:57:11.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.251+0000 7f6b8ffff700 1 -- 172.21.15.37:0/3263840852 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b9800fce0 con 0x7f6ba80b85f0 2023-07-14T15:57:11.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.251+0000 7f6b8ffff700 1 -- 172.21.15.37:0/3263840852 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b98004260 con 0x7f6ba80b85f0 2023-07-14T15:57:11.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.251+0000 7f6bad9ff700 1 -- 172.21.15.37:0/3263840852 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ba815ed00 con 0x7f6ba80b85f0 2023-07-14T15:57:11.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.251+0000 7f6bad9ff700 1 -- 172.21.15.37:0/3263840852 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ba815f2c0 con 0x7f6ba80b85f0 2023-07-14T15:57:11.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.252+0000 7f6bad9ff700 1 -- 172.21.15.37:0/3263840852 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ba80cf060 con 0x7f6ba80b85f0 2023-07-14T15:57:11.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.253+0000 7f6b8ffff700 1 -- 172.21.15.37:0/3263840852 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6b980043c0 con 0x7f6ba80b85f0 2023-07-14T15:57:11.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.254+0000 7f6b8ffff700 1 --2- 172.21.15.37:0/3263840852 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f6b9406ace0 0x7f6b9406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:11.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.254+0000 7f6b8ffff700 1 -- 172.21.15.37:0/3263840852 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6b98089a80 con 0x7f6ba80b85f0 2023-07-14T15:57:11.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.254+0000 7f6ba67fc700 1 --2- 172.21.15.37:0/3263840852 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f6b9406ace0 0x7f6b9406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:11.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.255+0000 7f6ba67fc700 1 --2- 172.21.15.37:0/3263840852 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f6b9406ace0 0x7f6b9406d190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6ba80cd290 tx=0x7f6b9c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:11.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.258+0000 7f6b8ffff700 1 -- 172.21.15.37:0/3263840852 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6b98054b20 con 0x7f6ba80b85f0 2023-07-14T15:57:11.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.471+0000 7f6bad9ff700 1 -- 172.21.15.37:0/3263840852 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ba80cece0 con 0x7f6ba80b85f0 2023-07-14T15:57:11.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.472+0000 7f6b8ffff700 1 -- 172.21.15.37:0/3263840852 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18341 (secure 0 0 0) 0x7f6b98022020 con 0x7f6ba80b85f0 2023-07-14T15:57:11.458 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:57:11.458 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"fsid":"9da30401-a779-4e46-aba6-00c2494c6c67","created":"2023-07-14T15:55:39.898867+0000","modified":"2023-07-14T15:56:09.959850+0000","last_up_change":"2023-07-14T15:55:53.025696+0000","last_in_change":"2023-07-14T15:55:43.388192+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T15:55:52.907261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T15:55:59.992839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T15:56:06.091064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T15:56:07.448694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d049535-7b87-4276-8fe5-0f74ba422d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6801","nonce":2783032392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6803","nonce":2783032392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6807","nonce":2783032392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6805","nonce":2783032392}]},"public_addr":"172.21.15.37:6801/2783032392","cluster_addr":"172.21.15.37:6803/2783032392","heartbeat_back_addr":"172.21.15.37:6807/2783032392","heartbeat_front_addr":"172.21.15.37:6805/2783032392","state":["exists","up"]},{"osd":1,"uuid":"79ec948d-ead2-4c2d-923a-dd6eeaac9dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6823","nonce":1190059746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6826","nonce":1190059746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6831","nonce":1190059746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6829","nonce":1190059746}]},"public_addr":"172.21.15.37:6823/1190059746","cluster_addr":"172.21.15.37:6826/1190059746","heartbeat_back_addr":"172.21.15.37:6831/1190059746","heartbeat_front_addr":"172.21.15.37:6829/1190059746","state":["exists","up"]},{"osd":2,"uuid":"a1db6690-c160-4366-9c82-2cca17e4bba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6809","nonce":2266223499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6813","nonce":2266223499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6820","nonce":2266223499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6816","nonce":2266223499}]},"public_addr":"172.21.15.37:6809/2266223499","cluster_addr":"172.21.15.37:6813/2266223499","heartbeat_back_addr":"172.21.15.37:6820/2266223499","heartbeat_front_addr":"172.21.15.37:6816/2266223499","state":["exists","up"]},{"osd":3,"uuid":"767b8220-e79a-4a86-a162-6b3b73198379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6812","nonce":4166694594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6817","nonce":4166694594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6828","nonce":4166694594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6822","nonce":4166694594}]},"public_addr":"172.21.15.37:6812/4166694594","cluster_addr":"172.21.15.37:6817/4166694594","heartbeat_back_addr":"172.21.15.37:6828/4166694594","heartbeat_front_addr":"172.21.15.37:6822/4166694594","state":["exists","up"]},{"osd":4,"uuid":"717bd773-ae7e-4236-ac79-900cf99a37c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6801","nonce":3529020407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6803","nonce":3529020407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6807","nonce":3529020407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6805","nonce":3529020407}]},"public_addr":"172.21.15.98:6801/3529020407","cluster_addr":"172.21.15.98:6803/3529020407","heartbeat_back_addr":"172.21.15.98:6807/3529020407","heartbeat_front_addr":"172.21.15.98:6805/3529020407","state":["exists","up"]},{"osd":5,"uuid":"a941d358-0f03-4136-a9b2-3a1c2e9358cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6817","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6819","nonce":2311501838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6821","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6823","nonce":2311501838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6829","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6831","nonce":2311501838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6825","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6827","nonce":2311501838}]},"public_addr":"172.21.15.98:6819/2311501838","cluster_addr":"172.21.15.98:6823/2311501838","heartbeat_back_addr":"172.21.15.98:6831/2311501838","heartbeat_front_addr":"172.21.15.98:6827/2311501838","state":["exists","up"]},{"osd":6,"uuid":"27153772-6d4b-479d-9953-0582e7b96743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6809","nonce":1144224691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6811","nonce":1144224691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6815","nonce":1144224691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6813","nonce":1144224691}]},"public_addr":"172.21.15.98:6809/1144224691","cluster_addr":"172.21.15.98:6811/1144224691","heartbeat_back_addr":"172.21.15.98:6815/1144224691","heartbeat_front_addr":"172.21.15.98:6813/1144224691","state":["exists","up"]},{"osd":7,"uuid":"d21ffc8e-40bb-47eb-af2c-e3e730d3fb76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6818","nonce":1144470927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6822","nonce":1144470927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6830","nonce":1144470927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6826","nonce":1144470927}]},"public_addr":"172.21.15.98:6818/1144470927","cluster_addr":"172.21.15.98:6822/1144470927","heartbeat_back_addr":"172.21.15.98:6830/1144470927","heartbeat_front_addr":"172.21.15.98:6826/1144470927","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.921114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.739210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.024016+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.002527+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.698127+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.813416+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.709351+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.815457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T15:57:11.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.474+0000 7f6bad9ff700 1 -- 172.21.15.37:0/3263840852 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f6b9406ace0 msgr2=0x7f6b9406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:11.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.474+0000 7f6bad9ff700 1 --2- 172.21.15.37:0/3263840852 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f6b9406ace0 0x7f6b9406d190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6ba80cd290 tx=0x7f6b9c009040 comp rx=0 tx=0).stop 2023-07-14T15:57:11.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.474+0000 7f6bad9ff700 1 -- 172.21.15.37:0/3263840852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ba80b85f0 msgr2=0x7f6ba8160880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:11.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.474+0000 7f6bad9ff700 1 --2- 172.21.15.37:0/3263840852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ba80b85f0 0x7f6ba8160880 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6b98011ca0 tx=0x7f6b9800f520 comp rx=0 tx=0).stop 2023-07-14T15:57:11.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.474+0000 7f6bad9ff700 1 -- 172.21.15.37:0/3263840852 shutdown_connections 2023-07-14T15:57:11.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.474+0000 7f6bad9ff700 1 --2- 172.21.15.37:0/3263840852 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f6b9406ace0 0x7f6b9406d190 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:11.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.474+0000 7f6bad9ff700 1 --2- 172.21.15.37:0/3263840852 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6ba80cc6f0 0x7f6ba80ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:11.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.474+0000 7f6bad9ff700 1 --2- 172.21.15.37:0/3263840852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ba80b85f0 0x7f6ba8160880 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:11.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.474+0000 7f6bad9ff700 1 --2- 172.21.15.37:0/3263840852 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ba815fac0 0x7f6ba814d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:11.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.475+0000 7f6bad9ff700 1 -- 172.21.15.37:0/3263840852 >> 172.21.15.37:0/3263840852 conn(0x7f6ba806a580 msgr2=0x7f6ba80d0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:11.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.475+0000 7f6bad9ff700 1 -- 172.21.15.37:0/3263840852 shutdown_connections 2023-07-14T15:57:11.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.475+0000 7f6bad9ff700 1 -- 172.21.15.37:0/3263840852 wait complete. 2023-07-14T15:57:11.479 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-14T15:57:11.480 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T15:57:11.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.695+0000 7fed7c1ff700 1 Processor -- start 2023-07-14T15:57:11.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.695+0000 7fed7c1ff700 1 -- start start 2023-07-14T15:57:11.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.696+0000 7fed7c1ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fed740cffc0 0x7fed740b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:11.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.696+0000 7fed7c1ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed740d0de0 con 0x7fed740b8b80 2023-07-14T15:57:11.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.696+0000 7fed7c1ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed741610f0 con 0x7fed74160c50 2023-07-14T15:57:11.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.696+0000 7fed7c1ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed740cd590 con 0x7fed740cffc0 2023-07-14T15:57:11.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.697+0000 7fed79f9b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fed740b8b80 0x7fed740cf8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46304/0 (socket says 172.21.15.37:46304) 2023-07-14T15:57:11.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.697+0000 7fed79f9b700 1 -- 172.21.15.37:0/1827370458 learned_addr learned my addr 172.21.15.37:0/1827370458 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:11.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.697+0000 7fed7979a700 1 --2- 172.21.15.37:0/1827370458 >> v2:172.21.15.98:3300/0 conn(0x7fed740cffc0 0x7fed740b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:11.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.697+0000 7fed78f99700 1 -- 172.21.15.37:0/1827370458 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3314644507 0 0) 0x7fed740d0de0 con 0x7fed740b8b80 2023-07-14T15:57:11.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.697+0000 7fed78f99700 1 -- 172.21.15.37:0/1827370458 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed600035b0 con 0x7fed740b8b80 2023-07-14T15:57:11.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.697+0000 7fed7979a700 1 -- 172.21.15.37:0/1827370458 >> v1:172.21.15.98:6789/0 conn(0x7fed74160c50 legacy=0x7fed740d1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:11.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.697+0000 7fed7979a700 1 -- 172.21.15.37:0/1827370458 >> v1:172.21.15.37:6789/0 conn(0x7fed740b8b80 legacy=0x7fed740cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:11.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.697+0000 7fed7979a700 1 -- 172.21.15.37:0/1827370458 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed740cd870 con 0x7fed740cffc0 2023-07-14T15:57:11.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.698+0000 7fed7979a700 1 --2- 172.21.15.37:0/1827370458 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed740cffc0 0x7fed740b5cf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fed64009840 tx=0x7fed64009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d27fc960bd004173 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:11.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.698+0000 7fed78f99700 1 -- 172.21.15.37:0/1827370458 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed64011830 con 0x7fed740cffc0 2023-07-14T15:57:11.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.698+0000 7fed78f99700 1 -- 172.21.15.37:0/1827370458 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed64011990 con 0x7fed740cffc0 2023-07-14T15:57:11.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.698+0000 7fed78f99700 1 -- 172.21.15.37:0/1827370458 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed64011d20 con 0x7fed740cffc0 2023-07-14T15:57:11.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.698+0000 7fed7c1ff700 1 -- 172.21.15.37:0/1827370458 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed740cffc0 msgr2=0x7fed740b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:11.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.698+0000 7fed7c1ff700 1 --2- 172.21.15.37:0/1827370458 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed740cffc0 0x7fed740b5cf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fed64009840 tx=0x7fed64009b50 comp rx=0 tx=0).stop 2023-07-14T15:57:11.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.698+0000 7fed7c1ff700 1 -- 172.21.15.37:0/1827370458 shutdown_connections 2023-07-14T15:57:11.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.698+0000 7fed7c1ff700 1 --2- 172.21.15.37:0/1827370458 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed740cffc0 0x7fed740b5cf0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:11.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.698+0000 7fed7c1ff700 1 -- 172.21.15.37:0/1827370458 >> 172.21.15.37:0/1827370458 conn(0x7fed7406b150 msgr2=0x7fed7406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:11.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.698+0000 7fed7c1ff700 1 -- 172.21.15.37:0/1827370458 shutdown_connections 2023-07-14T15:57:11.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.699+0000 7fed7c1ff700 1 -- 172.21.15.37:0/1827370458 wait complete. 2023-07-14T15:57:11.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.701+0000 7fed7c1ff700 1 Processor -- start 2023-07-14T15:57:11.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.701+0000 7fed7c1ff700 1 -- start start 2023-07-14T15:57:11.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.702+0000 7fed7c1ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed740b8b80 0x7fed740cb190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:11.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.702+0000 7fed7c1ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed740cffc0 0x7fed74155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:11.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.702+0000 7fed7c1ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fed74160c50 0x7fed740cc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:11.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.702+0000 7fed7c1ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed741559c0 con 0x7fed740b8b80 2023-07-14T15:57:11.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.702+0000 7fed7c1ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed740ca0f0 con 0x7fed740cffc0 2023-07-14T15:57:11.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.702+0000 7fed7c1ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed740ca3d0 con 0x7fed74160c50 2023-07-14T15:57:11.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.703+0000 7fed79f9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed740b8b80 0x7fed740cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:11.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.703+0000 7fed79f9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed740b8b80 0x7fed740cb190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60186/0 (socket says 172.21.15.37:60186) 2023-07-14T15:57:11.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.703+0000 7fed79f9b700 1 -- 172.21.15.37:0/3049339742 learned_addr learned my addr 172.21.15.37:0/3049339742 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:11.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.703+0000 7fed7979a700 1 --2- 172.21.15.37:0/3049339742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed740cffc0 0x7fed74155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:11.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.703+0000 7fed7a79c700 1 --2- 172.21.15.37:0/3049339742 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fed74160c50 0x7fed740cc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:11.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.703+0000 7fed79f9b700 1 -- 172.21.15.37:0/3049339742 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fed74160c50 msgr2=0x7fed740cc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:11.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.703+0000 7fed79f9b700 1 --2- 172.21.15.37:0/3049339742 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fed74160c50 0x7fed740cc5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:11.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.703+0000 7fed79f9b700 1 -- 172.21.15.37:0/3049339742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed740cffc0 msgr2=0x7fed74155030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:11.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.703+0000 7fed79f9b700 1 --2- 172.21.15.37:0/3049339742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed740cffc0 0x7fed74155030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:11.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.703+0000 7fed79f9b700 1 -- 172.21.15.37:0/3049339742 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed640094a0 con 0x7fed740b8b80 2023-07-14T15:57:11.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.703+0000 7fed79f9b700 1 --2- 172.21.15.37:0/3049339742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed740b8b80 0x7fed740cb190 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fed7000c700 tx=0x7fed7000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:11.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.704+0000 7fed6a7fc700 1 -- 172.21.15.37:0/3049339742 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed70005d70 con 0x7fed740b8b80 2023-07-14T15:57:11.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.704+0000 7fed6a7fc700 1 -- 172.21.15.37:0/3049339742 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed700070d0 con 0x7fed740b8b80 2023-07-14T15:57:11.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.704+0000 7fed6a7fc700 1 -- 172.21.15.37:0/3049339742 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed70007460 con 0x7fed740b8b80 2023-07-14T15:57:11.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.704+0000 7fed7c1ff700 1 -- 172.21.15.37:0/3049339742 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed740ca6b0 con 0x7fed740b8b80 2023-07-14T15:57:11.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.704+0000 7fed7c1ff700 1 -- 172.21.15.37:0/3049339742 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed740cac70 con 0x7fed740b8b80 2023-07-14T15:57:11.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.705+0000 7fed7c1ff700 1 -- 172.21.15.37:0/3049339742 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed74067840 con 0x7fed740b8b80 2023-07-14T15:57:11.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.706+0000 7fed6a7fc700 1 -- 172.21.15.37:0/3049339742 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fed700075c0 con 0x7fed740b8b80 2023-07-14T15:57:11.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.707+0000 7fed6a7fc700 1 --2- 172.21.15.37:0/3049339742 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fed5806ace0 0x7fed5806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:11.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.707+0000 7fed6a7fc700 1 -- 172.21.15.37:0/3049339742 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fed700889a0 con 0x7fed740b8b80 2023-07-14T15:57:11.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.707+0000 7fed7979a700 1 --2- 172.21.15.37:0/3049339742 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fed5806ace0 0x7fed5806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:11.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.708+0000 7fed7979a700 1 --2- 172.21.15.37:0/3049339742 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fed5806ace0 0x7fed5806d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fed740d03b0 tx=0x7fed64008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:11.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.711+0000 7fed6a7fc700 1 -- 172.21.15.37:0/3049339742 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fed700539b0 con 0x7fed740b8b80 2023-07-14T15:57:11.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.964+0000 7fed7c1ff700 1 -- 172.21.15.37:0/3049339742 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed74155b60 con 0x7fed740b8b80 2023-07-14T15:57:11.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.964+0000 7fed6a7fc700 1 -- 172.21.15.37:0/3049339742 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4697 (secure 0 0 0) 0x7fed70017090 con 0x7fed740b8b80 2023-07-14T15:57:11.951 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:57:11.951 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/596800720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":596800720},{"type":"v1","addr":"172.21.15.37:6835","nonce":596800720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4318,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/1611780456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1611780456},{"type":"v1","addr":"172.21.15.37:6834","nonce":1611780456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4324,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/586880065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":586880065},{"type":"v1","addr":"172.21.15.98:6835","nonce":586880065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T15:56:08.459886+0000","modified":"2023-07-14T15:56:11.974298+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4327},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4327":{"gid":4327,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6837/2731892479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2731892479},{"type":"v1","addr":"172.21.15.98:6837","nonce":2731892479}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T15:57:11.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.967+0000 7fed7c1ff700 1 -- 172.21.15.37:0/3049339742 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fed5806ace0 msgr2=0x7fed5806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:11.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.967+0000 7fed7c1ff700 1 --2- 172.21.15.37:0/3049339742 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fed5806ace0 0x7fed5806d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fed740d03b0 tx=0x7fed64008030 comp rx=0 tx=0).stop 2023-07-14T15:57:11.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.967+0000 7fed7c1ff700 1 -- 172.21.15.37:0/3049339742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed740b8b80 msgr2=0x7fed740cb190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:11.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.967+0000 7fed7c1ff700 1 --2- 172.21.15.37:0/3049339742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed740b8b80 0x7fed740cb190 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fed7000c700 tx=0x7fed7000ca10 comp rx=0 tx=0).stop 2023-07-14T15:57:11.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.967+0000 7fed7c1ff700 1 -- 172.21.15.37:0/3049339742 shutdown_connections 2023-07-14T15:57:11.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.967+0000 7fed7c1ff700 1 --2- 172.21.15.37:0/3049339742 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fed5806ace0 0x7fed5806d190 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:11.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.967+0000 7fed7c1ff700 1 --2- 172.21.15.37:0/3049339742 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fed74160c50 0x7fed740cc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:11.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.967+0000 7fed7c1ff700 1 --2- 172.21.15.37:0/3049339742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed740b8b80 0x7fed740cb190 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:11.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.967+0000 7fed7c1ff700 1 --2- 172.21.15.37:0/3049339742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed740cffc0 0x7fed74155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:11.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.967+0000 7fed7c1ff700 1 -- 172.21.15.37:0/3049339742 >> 172.21.15.37:0/3049339742 conn(0x7fed7406b150 msgr2=0x7fed7415bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:11.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.967+0000 7fed7c1ff700 1 -- 172.21.15.37:0/3049339742 shutdown_connections 2023-07-14T15:57:11.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:11.967+0000 7fed7c1ff700 1 -- 172.21.15.37:0/3049339742 wait complete. 2023-07-14T15:57:11.955 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 7 2023-07-14T15:57:11.972 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T15:57:12.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.187+0000 7fd7e9fff700 1 Processor -- start 2023-07-14T15:57:12.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.187+0000 7fd7e9fff700 1 -- start start 2023-07-14T15:57:12.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.188+0000 7fd7e9fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd7e40b0050 0x7fd7e40ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:12.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.188+0000 7fd7e9fff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7e40c9540 con 0x7fd7e41593c0 2023-07-14T15:57:12.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.188+0000 7fd7e9fff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7e40c9ff0 con 0x7fd7e40c9b30 2023-07-14T15:57:12.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.188+0000 7fd7e9fff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7e40ce3d0 con 0x7fd7e40b0050 2023-07-14T15:57:12.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.189+0000 7fd7e37fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd7e41593c0 0x7fd7e415db60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46314/0 (socket says 172.21.15.37:46314) 2023-07-14T15:57:12.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.189+0000 7fd7e37fe700 1 -- 172.21.15.37:0/2913254603 learned_addr learned my addr 172.21.15.37:0/2913254603 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:12.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.189+0000 7fd7e3fff700 1 --2- 172.21.15.37:0/2913254603 >> v2:172.21.15.98:3300/0 conn(0x7fd7e40b0050 0x7fd7e40ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:12.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.189+0000 7fd7e27fc700 1 -- 172.21.15.37:0/2913254603 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 405750595 0 0) 0x7fd7e40c9540 con 0x7fd7e41593c0 2023-07-14T15:57:12.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.189+0000 7fd7e27fc700 1 -- 172.21.15.37:0/2913254603 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7cc0057c0 con 0x7fd7e41593c0 2023-07-14T15:57:12.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.189+0000 7fd7e3fff700 1 -- 172.21.15.37:0/2913254603 >> v1:172.21.15.98:6789/0 conn(0x7fd7e40c9b30 legacy=0x7fd7e40af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:12.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.189+0000 7fd7e27fc700 1 -- 172.21.15.37:0/2913254603 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 220808543 0 0) 0x7fd7cc0057c0 con 0x7fd7e41593c0 2023-07-14T15:57:12.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.189+0000 7fd7e3fff700 1 -- 172.21.15.37:0/2913254603 >> v1:172.21.15.37:6789/0 conn(0x7fd7e41593c0 legacy=0x7fd7e415db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:12.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.189+0000 7fd7e3fff700 1 -- 172.21.15.37:0/2913254603 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e40ce6b0 con 0x7fd7e40b0050 2023-07-14T15:57:12.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.190+0000 7fd7e3fff700 1 --2- 172.21.15.37:0/2913254603 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7e40b0050 0x7fd7e40ccce0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc009d90 tx=0x7fd7dc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2187e8b3bd5dc414 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:12.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.190+0000 7fd7e27fc700 1 -- 172.21.15.37:0/2913254603 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc00e070 con 0x7fd7e40b0050 2023-07-14T15:57:12.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.190+0000 7fd7e27fc700 1 -- 172.21.15.37:0/2913254603 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7dc003a20 con 0x7fd7e40b0050 2023-07-14T15:57:12.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.190+0000 7fd7e27fc700 1 -- 172.21.15.37:0/2913254603 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d4001670 con 0x7fd7e40b0050 2023-07-14T15:57:12.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.190+0000 7fd7e9fff700 1 -- 172.21.15.37:0/2913254603 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7e40b0050 msgr2=0x7fd7e40ccce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:12.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.190+0000 7fd7e9fff700 1 --2- 172.21.15.37:0/2913254603 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7e40b0050 0x7fd7e40ccce0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc009d90 tx=0x7fd7dc00b330 comp rx=0 tx=0).stop 2023-07-14T15:57:12.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.191+0000 7fd7e9fff700 1 -- 172.21.15.37:0/2913254603 shutdown_connections 2023-07-14T15:57:12.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.191+0000 7fd7e9fff700 1 --2- 172.21.15.37:0/2913254603 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7e40b0050 0x7fd7e40ccce0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:12.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.191+0000 7fd7e9fff700 1 -- 172.21.15.37:0/2913254603 >> 172.21.15.37:0/2913254603 conn(0x7fd7e40b08c0 msgr2=0x7fd7e40b0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:12.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.191+0000 7fd7e9fff700 1 -- 172.21.15.37:0/2913254603 shutdown_connections 2023-07-14T15:57:12.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.191+0000 7fd7e9fff700 1 -- 172.21.15.37:0/2913254603 wait complete. 2023-07-14T15:57:12.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.192+0000 7fd7e9fff700 1 Processor -- start 2023-07-14T15:57:12.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.193+0000 7fd7e9fff700 1 -- start start 2023-07-14T15:57:12.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.194+0000 7fd7e9fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7e40b0050 0x7fd7e41ef080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:12.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.194+0000 7fd7e9fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7e40c9b30 0x7fd7e41f0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:12.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.194+0000 7fd7e9fff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd7e41593c0 0x7fd7e40b3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:12.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.194+0000 7fd7e9fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e40b4a40 con 0x7fd7e40b0050 2023-07-14T15:57:12.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.194+0000 7fd7e9fff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e4156a50 con 0x7fd7e40c9b30 2023-07-14T15:57:12.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.194+0000 7fd7e9fff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e4156d30 con 0x7fd7e41593c0 2023-07-14T15:57:12.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.194+0000 7fd7e37fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7e40b0050 0x7fd7e41ef080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:12.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.194+0000 7fd7e37fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7e40b0050 0x7fd7e41ef080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60196/0 (socket says 172.21.15.37:60196) 2023-07-14T15:57:12.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.194+0000 7fd7e37fe700 1 -- 172.21.15.37:0/4013034370 learned_addr learned my addr 172.21.15.37:0/4013034370 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:12.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.194+0000 7fd7e3fff700 1 --2- 172.21.15.37:0/4013034370 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd7e41593c0 0x7fd7e40b3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:12.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.194+0000 7fd7e2ffd700 1 --2- 172.21.15.37:0/4013034370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7e40c9b30 0x7fd7e41f0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:12.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.194+0000 7fd7e37fe700 1 -- 172.21.15.37:0/4013034370 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd7e41593c0 msgr2=0x7fd7e40b3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:12.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.194+0000 7fd7e37fe700 1 --2- 172.21.15.37:0/4013034370 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd7e41593c0 0x7fd7e40b3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:12.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.194+0000 7fd7e37fe700 1 -- 172.21.15.37:0/4013034370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7e40c9b30 msgr2=0x7fd7e41f0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:12.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.194+0000 7fd7e37fe700 1 --2- 172.21.15.37:0/4013034370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7e40c9b30 0x7fd7e41f0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:12.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.194+0000 7fd7e37fe700 1 -- 172.21.15.37:0/4013034370 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7dc009a70 con 0x7fd7e40b0050 2023-07-14T15:57:12.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.194+0000 7fd7e3fff700 1 --2- 172.21.15.37:0/4013034370 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd7e41593c0 0x7fd7e40b3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:57:12.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.195+0000 7fd7e37fe700 1 --2- 172.21.15.37:0/4013034370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7e40b0050 0x7fd7e41ef080 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd7d400c750 tx=0x7fd7d400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:12.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.195+0000 7fd7cbfff700 1 -- 172.21.15.37:0/4013034370 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d4004c80 con 0x7fd7e40b0050 2023-07-14T15:57:12.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.195+0000 7fd7cbfff700 1 -- 172.21.15.37:0/4013034370 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d4004e00 con 0x7fd7e40b0050 2023-07-14T15:57:12.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.195+0000 7fd7e9fff700 1 -- 172.21.15.37:0/4013034370 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7e4157010 con 0x7fd7e40b0050 2023-07-14T15:57:12.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.195+0000 7fd7cbfff700 1 -- 172.21.15.37:0/4013034370 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d4007310 con 0x7fd7e40b0050 2023-07-14T15:57:12.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.195+0000 7fd7e9fff700 1 -- 172.21.15.37:0/4013034370 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7e41ef5c0 con 0x7fd7e40b0050 2023-07-14T15:57:12.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.196+0000 7fd7e9fff700 1 -- 172.21.15.37:0/4013034370 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7e4067840 con 0x7fd7e40b0050 2023-07-14T15:57:12.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.197+0000 7fd7cbfff700 1 -- 172.21.15.37:0/4013034370 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd7d4007470 con 0x7fd7e40b0050 2023-07-14T15:57:12.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.198+0000 7fd7cbfff700 1 --2- 172.21.15.37:0/4013034370 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd7d006ace0 0x7fd7d006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:12.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.198+0000 7fd7cbfff700 1 -- 172.21.15.37:0/4013034370 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd7d40892f0 con 0x7fd7e40b0050 2023-07-14T15:57:12.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.198+0000 7fd7e2ffd700 1 --2- 172.21.15.37:0/4013034370 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd7d006ace0 0x7fd7d006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:12.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.199+0000 7fd7e2ffd700 1 --2- 172.21.15.37:0/4013034370 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd7d006ace0 0x7fd7d006d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd7e40b4ca0 tx=0x7fd7d8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:12.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.202+0000 7fd7cbfff700 1 -- 172.21.15.37:0/4013034370 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd7d4054280 con 0x7fd7e40b0050 2023-07-14T15:57:12.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.453+0000 7fd7e9fff700 1 -- 172.21.15.37:0/4013034370 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd7e40b16e0 con 0x7fd7e40b0050 2023-07-14T15:57:12.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.454+0000 7fd7cbfff700 1 -- 172.21.15.37:0/4013034370 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4697 (secure 0 0 0) 0x7fd7d40578a0 con 0x7fd7e40b0050 2023-07-14T15:57:12.440 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:57:12.440 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/596800720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":596800720},{"type":"v1","addr":"172.21.15.37:6835","nonce":596800720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4318,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/1611780456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1611780456},{"type":"v1","addr":"172.21.15.37:6834","nonce":1611780456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4324,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/586880065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":586880065},{"type":"v1","addr":"172.21.15.98:6835","nonce":586880065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T15:56:08.459886+0000","modified":"2023-07-14T15:56:11.974298+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4327},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4327":{"gid":4327,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6837/2731892479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2731892479},{"type":"v1","addr":"172.21.15.98:6837","nonce":2731892479}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T15:57:12.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.456+0000 7fd7e9fff700 1 -- 172.21.15.37:0/4013034370 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd7d006ace0 msgr2=0x7fd7d006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:12.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.456+0000 7fd7e9fff700 1 --2- 172.21.15.37:0/4013034370 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd7d006ace0 0x7fd7d006d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd7e40b4ca0 tx=0x7fd7d8009040 comp rx=0 tx=0).stop 2023-07-14T15:57:12.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.456+0000 7fd7e9fff700 1 -- 172.21.15.37:0/4013034370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7e40b0050 msgr2=0x7fd7e41ef080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:12.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.456+0000 7fd7e9fff700 1 --2- 172.21.15.37:0/4013034370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7e40b0050 0x7fd7e41ef080 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd7d400c750 tx=0x7fd7d400cb10 comp rx=0 tx=0).stop 2023-07-14T15:57:12.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.456+0000 7fd7e9fff700 1 -- 172.21.15.37:0/4013034370 shutdown_connections 2023-07-14T15:57:12.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.456+0000 7fd7e9fff700 1 --2- 172.21.15.37:0/4013034370 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd7d006ace0 0x7fd7d006d190 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:12.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.456+0000 7fd7e9fff700 1 --2- 172.21.15.37:0/4013034370 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd7e41593c0 0x7fd7e40b3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:12.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.456+0000 7fd7e9fff700 1 --2- 172.21.15.37:0/4013034370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7e40b0050 0x7fd7e41ef080 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:12.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.456+0000 7fd7e9fff700 1 --2- 172.21.15.37:0/4013034370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7e40c9b30 0x7fd7e41f0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:12.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.456+0000 7fd7e9fff700 1 -- 172.21.15.37:0/4013034370 >> 172.21.15.37:0/4013034370 conn(0x7fd7e40b08c0 msgr2=0x7fd7e40ae830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:12.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.456+0000 7fd7e9fff700 1 -- 172.21.15.37:0/4013034370 shutdown_connections 2023-07-14T15:57:12.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.456+0000 7fd7e9fff700 1 -- 172.21.15.37:0/4013034370 wait complete. 2023-07-14T15:57:12.444 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 7 2023-07-14T15:57:12.460 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T15:57:12.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.675+0000 7fda78dff700 1 Processor -- start 2023-07-14T15:57:12.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.675+0000 7fda78dff700 1 -- start start 2023-07-14T15:57:12.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.676+0000 7fda78dff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fda740b8650 0x7fda740d0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:12.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.677+0000 7fda78dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fda740b24e0 0x7fda740cf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:12.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.677+0000 7fda78dff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda740cd540 con 0x7fda740cfbd0 2023-07-14T15:57:12.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.677+0000 7fda78dff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda740d1000 con 0x7fda740b8650 2023-07-14T15:57:12.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.677+0000 7fda78dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda74160f70 con 0x7fda740b24e0 2023-07-14T15:57:12.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.677+0000 7fda72d9d700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fda740cfbd0 0x7fda740b4970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46318/0 (socket says 172.21.15.37:46318) 2023-07-14T15:57:12.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.677+0000 7fda72d9d700 1 -- 172.21.15.37:0/253333102 learned_addr learned my addr 172.21.15.37:0/253333102 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:12.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.677+0000 7fda6bfff700 1 --2- 172.21.15.37:0/253333102 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fda740b24e0 0x7fda740cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:12.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.677+0000 7fda7259c700 1 --2- 172.21.15.37:0/253333102 >> v2:172.21.15.98:3300/0 conn(0x7fda740b8650 0x7fda740d0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:12.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.677+0000 7fda71d9b700 1 -- 172.21.15.37:0/253333102 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1203311470 0 0) 0x7fda740cd540 con 0x7fda740cfbd0 2023-07-14T15:57:12.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.677+0000 7fda71d9b700 1 -- 172.21.15.37:0/253333102 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda600035b0 con 0x7fda740cfbd0 2023-07-14T15:57:12.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.678+0000 7fda71d9b700 1 -- 172.21.15.37:0/253333102 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 158179548 0 0) 0x7fda600035b0 con 0x7fda740cfbd0 2023-07-14T15:57:12.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.678+0000 7fda71d9b700 1 -- 172.21.15.37:0/253333102 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fda740b24e0 msgr2=0x7fda740cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:12.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.678+0000 7fda71d9b700 1 --2- 172.21.15.37:0/253333102 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fda740b24e0 0x7fda740cf690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:12.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.678+0000 7fda71d9b700 1 -- 172.21.15.37:0/253333102 >> v2:172.21.15.98:3300/0 conn(0x7fda740b8650 msgr2=0x7fda740d0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:12.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.678+0000 7fda71d9b700 1 --2- 172.21.15.37:0/253333102 >> v2:172.21.15.98:3300/0 conn(0x7fda740b8650 0x7fda740d0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:12.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.678+0000 7fda71d9b700 1 -- 172.21.15.37:0/253333102 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda740cd790 con 0x7fda740cfbd0 2023-07-14T15:57:12.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.678+0000 7fda71d9b700 1 -- 172.21.15.37:0/253333102 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48633207 0 0) 0x7fda6c0019f0 con 0x7fda740cfbd0 2023-07-14T15:57:12.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.678+0000 7fda7259c700 1 --2- 172.21.15.37:0/253333102 >> v2:172.21.15.98:3300/0 conn(0x7fda740b8650 0x7fda740d0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:57:12.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.678+0000 7fda6bfff700 1 --2- 172.21.15.37:0/253333102 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fda740b24e0 0x7fda740cf690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:57:12.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.678+0000 7fda71d9b700 1 -- 172.21.15.37:0/253333102 >> v1:172.21.15.37:6789/0 conn(0x7fda740cfbd0 legacy=0x7fda740b4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:12.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.678+0000 7fda71d9b700 1 --2- 172.21.15.37:0/253333102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda60003a00 0x7fda60003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:12.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.678+0000 7fda71d9b700 1 --2- 172.21.15.37:0/253333102 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda60004430 0x7fda600048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:12.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.678+0000 7fda71d9b700 1 --2- 172.21.15.37:0/253333102 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fda740b24e0 0x7fda60004f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:12.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.678+0000 7fda71d9b700 1 -- 172.21.15.37:0/253333102 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda740d1000 con 0x7fda60003a00 2023-07-14T15:57:12.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.678+0000 7fda71d9b700 1 -- 172.21.15.37:0/253333102 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda74160f70 con 0x7fda60004430 2023-07-14T15:57:12.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.678+0000 7fda71d9b700 1 -- 172.21.15.37:0/253333102 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda6000ba10 con 0x7fda740b24e0 2023-07-14T15:57:12.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.678+0000 7fda7259c700 1 --2- 172.21.15.37:0/253333102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda60003a00 0x7fda60003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:12.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.678+0000 7fda6bfff700 1 --2- 172.21.15.37:0/253333102 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda60004430 0x7fda600048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:12.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.679+0000 7fda72d9d700 1 --2- 172.21.15.37:0/253333102 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fda740b24e0 0x7fda60004f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:12.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.679+0000 7fda7259c700 1 -- 172.21.15.37:0/253333102 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fda740b24e0 msgr2=0x7fda60004f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:12.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.679+0000 7fda7259c700 1 --2- 172.21.15.37:0/253333102 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fda740b24e0 0x7fda60004f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:12.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.679+0000 7fda7259c700 1 -- 172.21.15.37:0/253333102 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda60004430 msgr2=0x7fda600048f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:12.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.679+0000 7fda7259c700 1 --2- 172.21.15.37:0/253333102 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda60004430 0x7fda600048f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:12.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.679+0000 7fda7259c700 1 -- 172.21.15.37:0/253333102 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda5c0094a0 con 0x7fda60003a00 2023-07-14T15:57:12.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.679+0000 7fda7259c700 1 --2- 172.21.15.37:0/253333102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda60003a00 0x7fda60003e10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fda64009d30 tx=0x7fda60005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=446b77be455823b3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:12.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.679+0000 7fda71d9b700 1 -- 172.21.15.37:0/253333102 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda64009e80 con 0x7fda60003a00 2023-07-14T15:57:12.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.679+0000 7fda71d9b700 1 -- 172.21.15.37:0/253333102 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda6400e9a0 con 0x7fda60003a00 2023-07-14T15:57:12.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.679+0000 7fda71d9b700 1 -- 172.21.15.37:0/253333102 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6400ed30 con 0x7fda60003a00 2023-07-14T15:57:12.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.680+0000 7fda78dff700 1 -- 172.21.15.37:0/253333102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda60003a00 msgr2=0x7fda60003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:12.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.680+0000 7fda78dff700 1 --2- 172.21.15.37:0/253333102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda60003a00 0x7fda60003e10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fda64009d30 tx=0x7fda60005880 comp rx=0 tx=0).stop 2023-07-14T15:57:12.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.680+0000 7fda72d9d700 1 -- 172.21.15.37:0/253333102 reap_dead start 2023-07-14T15:57:12.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.680+0000 7fda78dff700 1 -- 172.21.15.37:0/253333102 shutdown_connections 2023-07-14T15:57:12.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.680+0000 7fda78dff700 1 -- 172.21.15.37:0/253333102 >> 172.21.15.37:0/253333102 conn(0x7fda7406c0f0 msgr2=0x7fda7406c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:12.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.680+0000 7fda78dff700 1 -- 172.21.15.37:0/253333102 shutdown_connections 2023-07-14T15:57:12.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.680+0000 7fda78dff700 1 -- 172.21.15.37:0/253333102 wait complete. 2023-07-14T15:57:12.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.682+0000 7fda78dff700 1 Processor -- start 2023-07-14T15:57:12.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.682+0000 7fda78dff700 1 -- start start 2023-07-14T15:57:12.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.683+0000 7fda78dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fda60003a00 0x7fda741ef690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:12.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.683+0000 7fda78dff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda741f2ec0 0x7fda740d1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:12.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.683+0000 7fda78dff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda740d1b80 0x7fda741f57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:12.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.683+0000 7fda78dff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda741f21f0 con 0x7fda741f2ec0 2023-07-14T15:57:12.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.683+0000 7fda78dff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda740d2020 con 0x7fda740d1b80 2023-07-14T15:57:12.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.683+0000 7fda78dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda741f67b0 con 0x7fda60003a00 2023-07-14T15:57:12.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.683+0000 7fda6bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda741f2ec0 0x7fda740d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:12.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.683+0000 7fda6bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda741f2ec0 0x7fda740d1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60228/0 (socket says 172.21.15.37:60228) 2023-07-14T15:57:12.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.683+0000 7fda6bfff700 1 -- 172.21.15.37:0/818944198 learned_addr learned my addr 172.21.15.37:0/818944198 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:12.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.683+0000 7fda7259c700 1 --2- 172.21.15.37:0/818944198 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fda60003a00 0x7fda741ef690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:12.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.683+0000 7fda72d9d700 1 --2- 172.21.15.37:0/818944198 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda740d1b80 0x7fda741f57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:12.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.683+0000 7fda6bfff700 1 -- 172.21.15.37:0/818944198 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fda60003a00 msgr2=0x7fda741ef690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:12.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.683+0000 7fda6bfff700 1 --2- 172.21.15.37:0/818944198 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fda60003a00 0x7fda741ef690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:12.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.683+0000 7fda6bfff700 1 -- 172.21.15.37:0/818944198 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda740d1b80 msgr2=0x7fda741f57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:12.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.683+0000 7fda6bfff700 1 --2- 172.21.15.37:0/818944198 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda740d1b80 0x7fda741f57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:12.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.683+0000 7fda6bfff700 1 -- 172.21.15.37:0/818944198 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda741f64d0 con 0x7fda741f2ec0 2023-07-14T15:57:12.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.684+0000 7fda6bfff700 1 --2- 172.21.15.37:0/818944198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda741f2ec0 0x7fda740d1640 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fda5c011cd0 tx=0x7fda5c00f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:12.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.684+0000 7fda6affd700 1 -- 172.21.15.37:0/818944198 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5c011e70 con 0x7fda741f2ec0 2023-07-14T15:57:12.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.684+0000 7fda6affd700 1 -- 172.21.15.37:0/818944198 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda5c00fce0 con 0x7fda741f2ec0 2023-07-14T15:57:12.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.684+0000 7fda6affd700 1 -- 172.21.15.37:0/818944198 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5c004240 con 0x7fda741f2ec0 2023-07-14T15:57:12.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.684+0000 7fda78dff700 1 -- 172.21.15.37:0/818944198 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda741f23e0 con 0x7fda741f2ec0 2023-07-14T15:57:12.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.684+0000 7fda78dff700 1 -- 172.21.15.37:0/818944198 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda741f29a0 con 0x7fda741f2ec0 2023-07-14T15:57:12.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.685+0000 7fda78dff700 1 -- 172.21.15.37:0/818944198 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda74067840 con 0x7fda741f2ec0 2023-07-14T15:57:12.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.686+0000 7fda6affd700 1 -- 172.21.15.37:0/818944198 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fda5c0043a0 con 0x7fda741f2ec0 2023-07-14T15:57:12.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.687+0000 7fda6affd700 1 --2- 172.21.15.37:0/818944198 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fda5406ace0 0x7fda5406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:12.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.687+0000 7fda6affd700 1 -- 172.21.15.37:0/818944198 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fda5c089c30 con 0x7fda741f2ec0 2023-07-14T15:57:12.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.688+0000 7fda7259c700 1 --2- 172.21.15.37:0/818944198 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fda5406ace0 0x7fda5406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:12.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.688+0000 7fda7259c700 1 --2- 172.21.15.37:0/818944198 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fda5406ace0 0x7fda5406d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fda640090b0 tx=0x7fda6401e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:12.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.691+0000 7fda6affd700 1 -- 172.21.15.37:0/818944198 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fda5c054c40 con 0x7fda741f2ec0 2023-07-14T15:57:12.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.902+0000 7fda78dff700 1 -- 172.21.15.37:0/818944198 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda7406af10 con 0x7fda741f2ec0 2023-07-14T15:57:12.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.903+0000 7fda6affd700 1 -- 172.21.15.37:0/818944198 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18341 (secure 0 0 0) 0x7fda5c022020 con 0x7fda741f2ec0 2023-07-14T15:57:12.889 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:57:12.890 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"fsid":"9da30401-a779-4e46-aba6-00c2494c6c67","created":"2023-07-14T15:55:39.898867+0000","modified":"2023-07-14T15:56:09.959850+0000","last_up_change":"2023-07-14T15:55:53.025696+0000","last_in_change":"2023-07-14T15:55:43.388192+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T15:55:52.907261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T15:55:59.992839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T15:56:06.091064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T15:56:07.448694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d049535-7b87-4276-8fe5-0f74ba422d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6801","nonce":2783032392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6803","nonce":2783032392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6807","nonce":2783032392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6805","nonce":2783032392}]},"public_addr":"172.21.15.37:6801/2783032392","cluster_addr":"172.21.15.37:6803/2783032392","heartbeat_back_addr":"172.21.15.37:6807/2783032392","heartbeat_front_addr":"172.21.15.37:6805/2783032392","state":["exists","up"]},{"osd":1,"uuid":"79ec948d-ead2-4c2d-923a-dd6eeaac9dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6823","nonce":1190059746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6826","nonce":1190059746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6831","nonce":1190059746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6829","nonce":1190059746}]},"public_addr":"172.21.15.37:6823/1190059746","cluster_addr":"172.21.15.37:6826/1190059746","heartbeat_back_addr":"172.21.15.37:6831/1190059746","heartbeat_front_addr":"172.21.15.37:6829/1190059746","state":["exists","up"]},{"osd":2,"uuid":"a1db6690-c160-4366-9c82-2cca17e4bba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6809","nonce":2266223499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6813","nonce":2266223499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6820","nonce":2266223499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6816","nonce":2266223499}]},"public_addr":"172.21.15.37:6809/2266223499","cluster_addr":"172.21.15.37:6813/2266223499","heartbeat_back_addr":"172.21.15.37:6820/2266223499","heartbeat_front_addr":"172.21.15.37:6816/2266223499","state":["exists","up"]},{"osd":3,"uuid":"767b8220-e79a-4a86-a162-6b3b73198379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6812","nonce":4166694594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6817","nonce":4166694594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6828","nonce":4166694594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6822","nonce":4166694594}]},"public_addr":"172.21.15.37:6812/4166694594","cluster_addr":"172.21.15.37:6817/4166694594","heartbeat_back_addr":"172.21.15.37:6828/4166694594","heartbeat_front_addr":"172.21.15.37:6822/4166694594","state":["exists","up"]},{"osd":4,"uuid":"717bd773-ae7e-4236-ac79-900cf99a37c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6801","nonce":3529020407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6803","nonce":3529020407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6807","nonce":3529020407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6805","nonce":3529020407}]},"public_addr":"172.21.15.98:6801/3529020407","cluster_addr":"172.21.15.98:6803/3529020407","heartbeat_back_addr":"172.21.15.98:6807/3529020407","heartbeat_front_addr":"172.21.15.98:6805/3529020407","state":["exists","up"]},{"osd":5,"uuid":"a941d358-0f03-4136-a9b2-3a1c2e9358cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6817","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6819","nonce":2311501838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6821","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6823","nonce":2311501838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6829","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6831","nonce":2311501838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6825","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6827","nonce":2311501838}]},"public_addr":"172.21.15.98:6819/2311501838","cluster_addr":"172.21.15.98:6823/2311501838","heartbeat_back_addr":"172.21.15.98:6831/2311501838","heartbeat_front_addr":"172.21.15.98:6827/2311501838","state":["exists","up"]},{"osd":6,"uuid":"27153772-6d4b-479d-9953-0582e7b96743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6809","nonce":1144224691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6811","nonce":1144224691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6815","nonce":1144224691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6813","nonce":1144224691}]},"public_addr":"172.21.15.98:6809/1144224691","cluster_addr":"172.21.15.98:6811/1144224691","heartbeat_back_addr":"172.21.15.98:6815/1144224691","heartbeat_front_addr":"172.21.15.98:6813/1144224691","state":["exists","up"]},{"osd":7,"uuid":"d21ffc8e-40bb-47eb-af2c-e3e730d3fb76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6818","nonce":1144470927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6822","nonce":1144470927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6830","nonce":1144470927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6826","nonce":1144470927}]},"public_addr":"172.21.15.98:6818/1144470927","cluster_addr":"172.21.15.98:6822/1144470927","heartbeat_back_addr":"172.21.15.98:6830/1144470927","heartbeat_front_addr":"172.21.15.98:6826/1144470927","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.921114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.739210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.024016+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.002527+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.698127+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.813416+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.709351+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.815457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T15:57:12.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.906+0000 7fda78dff700 1 -- 172.21.15.37:0/818944198 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fda5406ace0 msgr2=0x7fda5406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:12.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.906+0000 7fda78dff700 1 --2- 172.21.15.37:0/818944198 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fda5406ace0 0x7fda5406d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fda640090b0 tx=0x7fda6401e040 comp rx=0 tx=0).stop 2023-07-14T15:57:12.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.906+0000 7fda78dff700 1 -- 172.21.15.37:0/818944198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda741f2ec0 msgr2=0x7fda740d1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:12.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.906+0000 7fda78dff700 1 --2- 172.21.15.37:0/818944198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda741f2ec0 0x7fda740d1640 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fda5c011cd0 tx=0x7fda5c00f520 comp rx=0 tx=0).stop 2023-07-14T15:57:12.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.906+0000 7fda78dff700 1 -- 172.21.15.37:0/818944198 shutdown_connections 2023-07-14T15:57:12.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.906+0000 7fda78dff700 1 --2- 172.21.15.37:0/818944198 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda740d1b80 0x7fda741f57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:12.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.906+0000 7fda78dff700 1 --2- 172.21.15.37:0/818944198 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fda5406ace0 0x7fda5406d190 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:12.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.906+0000 7fda78dff700 1 --2- 172.21.15.37:0/818944198 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fda60003a00 0x7fda741ef690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:12.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.906+0000 7fda78dff700 1 --2- 172.21.15.37:0/818944198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda741f2ec0 0x7fda740d1640 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:12.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.906+0000 7fda78dff700 1 -- 172.21.15.37:0/818944198 >> 172.21.15.37:0/818944198 conn(0x7fda7406c0f0 msgr2=0x7fda740c9860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:12.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.906+0000 7fda78dff700 1 -- 172.21.15.37:0/818944198 shutdown_connections 2023-07-14T15:57:12.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:12.906+0000 7fda78dff700 1 -- 172.21.15.37:0/818944198 wait complete. 2023-07-14T15:57:12.910 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-14T15:57:13.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.130+0000 7f0d86bff700 1 Processor -- start 2023-07-14T15:57:13.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.130+0000 7f0d86bff700 1 -- start start 2023-07-14T15:57:13.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.132+0000 7f0d86bff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0d800b8900 0x7f0d800cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:13.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.132+0000 7f0d86bff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0d800d15c0 0x7f0d800cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:13.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.132+0000 7f0d86bff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d800b6270 con 0x7f0d800b5e00 2023-07-14T15:57:13.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.132+0000 7f0d86bff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d8015d030 con 0x7f0d800d15c0 2023-07-14T15:57:13.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.132+0000 7f0d86bff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d800cdb50 con 0x7f0d800b8900 2023-07-14T15:57:13.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.132+0000 7f0d8519c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0d800d15c0 0x7f0d800cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:13.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.132+0000 7f0d8519c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0d800d15c0 0x7f0d800cebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60232/0 (socket says 172.21.15.37:60232) 2023-07-14T15:57:13.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.132+0000 7f0d8519c700 1 -- 172.21.15.37:0/3173299790 learned_addr learned my addr 172.21.15.37:0/3173299790 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:13.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.132+0000 7f0d8519c700 1 -- 172.21.15.37:0/3173299790 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0d800b8900 msgr2=0x7f0d800cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:13.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.132+0000 7f0d8499b700 1 --2- 172.21.15.37:0/3173299790 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0d800b8900 0x7f0d800cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:13.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.132+0000 7f0d8519c700 1 --2- 172.21.15.37:0/3173299790 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0d800b8900 0x7f0d800cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:13.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.132+0000 7f0d8519c700 1 -- 172.21.15.37:0/3173299790 >> v1:172.21.15.98:6789/0 conn(0x7f0d800b5e00 legacy=0x7f0d800d0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:13.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.132+0000 7f0d8519c700 1 -- 172.21.15.37:0/3173299790 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d800cde30 con 0x7f0d800d15c0 2023-07-14T15:57:13.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.133+0000 7f0d8499b700 1 --2- 172.21.15.37:0/3173299790 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0d800b8900 0x7f0d800cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:57:13.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.133+0000 7f0d8519c700 1 --2- 172.21.15.37:0/3173299790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d800d15c0 0x7f0d800cebf0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0d78009e50 tx=0x7f0d7800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f38be098fa66e92 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:13.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.133+0000 7f0d7f7fe700 1 -- 172.21.15.37:0/3173299790 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7800e070 con 0x7f0d800d15c0 2023-07-14T15:57:13.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.133+0000 7f0d7f7fe700 1 -- 172.21.15.37:0/3173299790 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d78003a20 con 0x7f0d800d15c0 2023-07-14T15:57:13.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.133+0000 7f0d7f7fe700 1 -- 172.21.15.37:0/3173299790 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d78003dd0 con 0x7f0d800d15c0 2023-07-14T15:57:13.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.133+0000 7f0d86bff700 1 -- 172.21.15.37:0/3173299790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d800d15c0 msgr2=0x7f0d800cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:13.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.133+0000 7f0d86bff700 1 --2- 172.21.15.37:0/3173299790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d800d15c0 0x7f0d800cebf0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0d78009e50 tx=0x7f0d7800b330 comp rx=0 tx=0).stop 2023-07-14T15:57:13.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.134+0000 7f0d86bff700 1 -- 172.21.15.37:0/3173299790 shutdown_connections 2023-07-14T15:57:13.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.134+0000 7f0d86bff700 1 --2- 172.21.15.37:0/3173299790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d800d15c0 0x7f0d800cebf0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:13.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.134+0000 7f0d86bff700 1 --2- 172.21.15.37:0/3173299790 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0d800b8900 0x7f0d800cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:13.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.134+0000 7f0d86bff700 1 -- 172.21.15.37:0/3173299790 >> 172.21.15.37:0/3173299790 conn(0x7f0d8009c1e0 msgr2=0x7f0d800d2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:13.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.134+0000 7f0d86bff700 1 -- 172.21.15.37:0/3173299790 shutdown_connections 2023-07-14T15:57:13.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.134+0000 7f0d86bff700 1 -- 172.21.15.37:0/3173299790 wait complete. 2023-07-14T15:57:13.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.135+0000 7f0d86bff700 1 Processor -- start 2023-07-14T15:57:13.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.136+0000 7f0d86bff700 1 -- start start 2023-07-14T15:57:13.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.136+0000 7f0d86bff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d800b5e00 0x7f0d800d39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:13.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.136+0000 7f0d86bff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d800b8900 0x7f0d800ccca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:13.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.136+0000 7f0d86bff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0d800d15c0 0x7f0d8015c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:13.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.136+0000 7f0d86bff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d800cd1e0 con 0x7f0d800b8900 2023-07-14T15:57:13.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.136+0000 7f0d86bff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d800c8ad0 con 0x7f0d800b5e00 2023-07-14T15:57:13.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.136+0000 7f0d86bff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d800c8db0 con 0x7f0d800d15c0 2023-07-14T15:57:13.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.137+0000 7f0d7ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d800b8900 0x7f0d800ccca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:13.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.137+0000 7f0d7ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d800b8900 0x7f0d800ccca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60240/0 (socket says 172.21.15.37:60240) 2023-07-14T15:57:13.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.137+0000 7f0d7ffff700 1 -- 172.21.15.37:0/3673806251 learned_addr learned my addr 172.21.15.37:0/3673806251 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:13.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.137+0000 7f0d8519c700 1 --2- 172.21.15.37:0/3673806251 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0d800d15c0 0x7f0d8015c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:13.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.137+0000 7f0d8499b700 1 --2- 172.21.15.37:0/3673806251 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d800b5e00 0x7f0d800d39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:13.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.137+0000 7f0d7ffff700 1 -- 172.21.15.37:0/3673806251 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0d800d15c0 msgr2=0x7f0d8015c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:13.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.137+0000 7f0d7ffff700 1 --2- 172.21.15.37:0/3673806251 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0d800d15c0 0x7f0d8015c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:13.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.137+0000 7f0d7ffff700 1 -- 172.21.15.37:0/3673806251 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d800b5e00 msgr2=0x7f0d800d39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:13.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.137+0000 7f0d7ffff700 1 --2- 172.21.15.37:0/3673806251 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d800b5e00 0x7f0d800d39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:13.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.137+0000 7f0d7ffff700 1 -- 172.21.15.37:0/3673806251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d78009b30 con 0x7f0d800b8900 2023-07-14T15:57:13.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.138+0000 7f0d7ffff700 1 --2- 172.21.15.37:0/3673806251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d800b8900 0x7f0d800ccca0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c00b4a0 tx=0x7f0d6c00b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:13.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.138+0000 7f0d7d7fa700 1 -- 172.21.15.37:0/3673806251 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c011830 con 0x7f0d800b8900 2023-07-14T15:57:13.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.138+0000 7f0d7d7fa700 1 -- 172.21.15.37:0/3673806251 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6c011990 con 0x7f0d800b8900 2023-07-14T15:57:13.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.138+0000 7f0d7d7fa700 1 -- 172.21.15.37:0/3673806251 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c011d40 con 0x7f0d800b8900 2023-07-14T15:57:13.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.138+0000 7f0d86bff700 1 -- 172.21.15.37:0/3673806251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d800c9090 con 0x7f0d800b8900 2023-07-14T15:57:13.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.138+0000 7f0d86bff700 1 -- 172.21.15.37:0/3673806251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d8015c990 con 0x7f0d800b8900 2023-07-14T15:57:13.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.139+0000 7f0d86bff700 1 -- 172.21.15.37:0/3673806251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d800c96a0 con 0x7f0d800b8900 2023-07-14T15:57:13.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.140+0000 7f0d7d7fa700 1 -- 172.21.15.37:0/3673806251 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0d6c01a400 con 0x7f0d800b8900 2023-07-14T15:57:13.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.141+0000 7f0d7d7fa700 1 --2- 172.21.15.37:0/3673806251 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0d6406ace0 0x7f0d6406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:13.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.141+0000 7f0d7d7fa700 1 -- 172.21.15.37:0/3673806251 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0d6c0890c0 con 0x7f0d800b8900 2023-07-14T15:57:13.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.142+0000 7f0d8499b700 1 --2- 172.21.15.37:0/3673806251 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0d6406ace0 0x7f0d6406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:13.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.142+0000 7f0d8499b700 1 --2- 172.21.15.37:0/3673806251 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0d6406ace0 0x7f0d6406d190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0d7400abe0 tx=0x7f0d74008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:13.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.145+0000 7f0d7d7fa700 1 -- 172.21.15.37:0/3673806251 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0d6c0540d0 con 0x7f0d800b8900 2023-07-14T15:57:13.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.395+0000 7f0d86bff700 1 -- 172.21.15.37:0/3673806251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0d8004e210 con 0x7f0d800b8900 2023-07-14T15:57:13.382 INFO:tasks.ceph.mon.a.smithi037.stderr:2023-07-14T15:57:13.396+0000 7f853c3f4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-14T15:57:13.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.400+0000 7f0d7d7fa700 1 -- 172.21.15.37:0/3673806251 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0d6c0576f0 con 0x7f0d800b8900 2023-07-14T15:57:13.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.403+0000 7f0d86bff700 1 -- 172.21.15.37:0/3673806251 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0d6406ace0 msgr2=0x7f0d6406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:13.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.403+0000 7f0d86bff700 1 --2- 172.21.15.37:0/3673806251 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0d6406ace0 0x7f0d6406d190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0d7400abe0 tx=0x7f0d74008040 comp rx=0 tx=0).stop 2023-07-14T15:57:13.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.403+0000 7f0d86bff700 1 -- 172.21.15.37:0/3673806251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d800b8900 msgr2=0x7f0d800ccca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:13.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.403+0000 7f0d86bff700 1 --2- 172.21.15.37:0/3673806251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d800b8900 0x7f0d800ccca0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c00b4a0 tx=0x7f0d6c00b7b0 comp rx=0 tx=0).stop 2023-07-14T15:57:13.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.403+0000 7f0d86bff700 1 -- 172.21.15.37:0/3673806251 shutdown_connections 2023-07-14T15:57:13.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.403+0000 7f0d86bff700 1 --2- 172.21.15.37:0/3673806251 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d800b5e00 0x7f0d800d39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:13.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.403+0000 7f0d86bff700 1 --2- 172.21.15.37:0/3673806251 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0d6406ace0 0x7f0d6406d190 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:13.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.403+0000 7f0d86bff700 1 --2- 172.21.15.37:0/3673806251 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0d800d15c0 0x7f0d8015c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:13.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.404+0000 7f0d86bff700 1 --2- 172.21.15.37:0/3673806251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d800b8900 0x7f0d800ccca0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:13.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.404+0000 7f0d86bff700 1 -- 172.21.15.37:0/3673806251 >> 172.21.15.37:0/3673806251 conn(0x7f0d8009c1e0 msgr2=0x7f0d800ceaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:13.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.404+0000 7f0d86bff700 1 -- 172.21.15.37:0/3673806251 shutdown_connections 2023-07-14T15:57:13.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.404+0000 7f0d86bff700 1 -- 172.21.15.37:0/3673806251 wait complete. 2023-07-14T15:57:13.391 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-14T15:57:13.407 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-14T15:57:13.457 INFO:tasks.ceph.mds.d.smithi098.stdout:starting mds.d at 2023-07-14T15:57:13.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.626+0000 7fd29cdff700 1 Processor -- start 2023-07-14T15:57:13.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.626+0000 7fd29cdff700 1 -- start start 2023-07-14T15:57:13.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.628+0000 7fd29cdff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd2980cfd50 0x7fd2980d2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:13.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.628+0000 7fd29cdff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd2980b0ac0 0x7fd2980b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:13.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.628+0000 7fd29cdff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2980b1840 con 0x7fd2980b1e80 2023-07-14T15:57:13.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.628+0000 7fd29cdff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd29815ccf0 con 0x7fd2980b0ac0 2023-07-14T15:57:13.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.628+0000 7fd29cdff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2980b2550 con 0x7fd2980cfd50 2023-07-14T15:57:13.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.628+0000 7fd29659c700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd2980cfd50 0x7fd2980d2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:13.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.628+0000 7fd28ffff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fd2980b1e80 0x7fd2980b2d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.37:35800/0 (socket says 172.21.15.37:35800) 2023-07-14T15:57:13.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.628+0000 7fd28ffff700 1 -- 172.21.15.37:0/2984489894 learned_addr learned my addr 172.21.15.37:0/2984489894 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:13.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.628+0000 7fd296d9d700 1 --2- 172.21.15.37:0/2984489894 >> v2:172.21.15.98:3300/0 conn(0x7fd2980b0ac0 0x7fd2980b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:13.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.629+0000 7fd295d9b700 1 -- 172.21.15.37:0/2984489894 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2629900511 0 0) 0x7fd2980b1840 con 0x7fd2980b1e80 2023-07-14T15:57:13.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.629+0000 7fd295d9b700 1 -- 172.21.15.37:0/2984489894 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2840035b0 con 0x7fd2980b1e80 2023-07-14T15:57:13.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.629+0000 7fd29659c700 1 -- 172.21.15.37:0/2984489894 >> v2:172.21.15.98:3300/0 conn(0x7fd2980b0ac0 msgr2=0x7fd2980b0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:13.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.629+0000 7fd29659c700 1 --2- 172.21.15.37:0/2984489894 >> v2:172.21.15.98:3300/0 conn(0x7fd2980b0ac0 0x7fd2980b0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:13.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.629+0000 7fd29659c700 1 -- 172.21.15.37:0/2984489894 >> v1:172.21.15.98:6789/0 conn(0x7fd2980b1e80 legacy=0x7fd2980b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:13.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.629+0000 7fd29659c700 1 -- 172.21.15.37:0/2984489894 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2980b2830 con 0x7fd2980cfd50 2023-07-14T15:57:13.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.629+0000 7fd296d9d700 1 --2- 172.21.15.37:0/2984489894 >> v2:172.21.15.98:3300/0 conn(0x7fd2980b0ac0 0x7fd2980b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:57:13.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.629+0000 7fd29659c700 1 --2- 172.21.15.37:0/2984489894 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd2980cfd50 0x7fd2980d2880 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd288009870 tx=0x7fd288009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=889728c855927976 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:13.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.629+0000 7fd295d9b700 1 -- 172.21.15.37:0/2984489894 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd288011830 con 0x7fd2980cfd50 2023-07-14T15:57:13.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.630+0000 7fd295d9b700 1 -- 172.21.15.37:0/2984489894 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd288011990 con 0x7fd2980cfd50 2023-07-14T15:57:13.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.630+0000 7fd295d9b700 1 -- 172.21.15.37:0/2984489894 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd288011d20 con 0x7fd2980cfd50 2023-07-14T15:57:13.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.630+0000 7fd29cdff700 1 -- 172.21.15.37:0/2984489894 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd2980cfd50 msgr2=0x7fd2980d2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:13.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.630+0000 7fd29cdff700 1 --2- 172.21.15.37:0/2984489894 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd2980cfd50 0x7fd2980d2880 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd288009870 tx=0x7fd288009b80 comp rx=0 tx=0).stop 2023-07-14T15:57:13.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.630+0000 7fd29cdff700 1 -- 172.21.15.37:0/2984489894 shutdown_connections 2023-07-14T15:57:13.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.630+0000 7fd29cdff700 1 --2- 172.21.15.37:0/2984489894 >> v2:172.21.15.98:3300/0 conn(0x7fd2980b0ac0 0x7fd2980b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:13.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.630+0000 7fd29cdff700 1 --2- 172.21.15.37:0/2984489894 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd2980cfd50 0x7fd2980d2880 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:13.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.630+0000 7fd29cdff700 1 -- 172.21.15.37:0/2984489894 >> 172.21.15.37:0/2984489894 conn(0x7fd29809c1c0 msgr2=0x7fd2980d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:13.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.630+0000 7fd29cdff700 1 -- 172.21.15.37:0/2984489894 shutdown_connections 2023-07-14T15:57:13.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.630+0000 7fd29cdff700 1 -- 172.21.15.37:0/2984489894 wait complete. 2023-07-14T15:57:13.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.632+0000 7fd29cdff700 1 Processor -- start 2023-07-14T15:57:13.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.632+0000 7fd29cdff700 1 -- start start 2023-07-14T15:57:13.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.633+0000 7fd29cdff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2980b0ac0 0x7fd2981e6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:13.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.633+0000 7fd29cdff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd2980b1e80 0x7fd29814e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:13.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.633+0000 7fd29cdff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2980cfd50 0x7fd29806b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:13.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.633+0000 7fd29cdff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd29806b280 con 0x7fd2980b0ac0 2023-07-14T15:57:13.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.633+0000 7fd29cdff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2981e7250 con 0x7fd2980cfd50 2023-07-14T15:57:13.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.633+0000 7fd29cdff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2981e4430 con 0x7fd2980b1e80 2023-07-14T15:57:13.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.633+0000 7fd29659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2980b0ac0 0x7fd2981e6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:13.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.633+0000 7fd29659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2980b0ac0 0x7fd2981e6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60242/0 (socket says 172.21.15.37:60242) 2023-07-14T15:57:13.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.633+0000 7fd29659c700 1 -- 172.21.15.37:0/1393244129 learned_addr learned my addr 172.21.15.37:0/1393244129 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:13.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.634+0000 7fd296d9d700 1 --2- 172.21.15.37:0/1393244129 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2980cfd50 0x7fd29806b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:13.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.634+0000 7fd28ffff700 1 --2- 172.21.15.37:0/1393244129 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd2980b1e80 0x7fd29814e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:13.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.634+0000 7fd29659c700 1 -- 172.21.15.37:0/1393244129 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd2980b1e80 msgr2=0x7fd29814e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:13.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.634+0000 7fd29659c700 1 --2- 172.21.15.37:0/1393244129 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd2980b1e80 0x7fd29814e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:13.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.634+0000 7fd29659c700 1 -- 172.21.15.37:0/1393244129 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2980cfd50 msgr2=0x7fd29806b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:13.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.634+0000 7fd29659c700 1 --2- 172.21.15.37:0/1393244129 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2980cfd50 0x7fd29806b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:13.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.634+0000 7fd29659c700 1 -- 172.21.15.37:0/1393244129 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd290009a70 con 0x7fd2980b0ac0 2023-07-14T15:57:13.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.634+0000 7fd29659c700 1 --2- 172.21.15.37:0/1393244129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2980b0ac0 0x7fd2981e6d10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd288009840 tx=0x7fd288004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:13.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.634+0000 7fd28effd700 1 -- 172.21.15.37:0/1393244129 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2880044d0 con 0x7fd2980b0ac0 2023-07-14T15:57:13.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.634+0000 7fd28effd700 1 -- 172.21.15.37:0/1393244129 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd28801e070 con 0x7fd2980b0ac0 2023-07-14T15:57:13.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.634+0000 7fd29cdff700 1 -- 172.21.15.37:0/1393244129 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2880094a0 con 0x7fd2980b0ac0 2023-07-14T15:57:13.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.634+0000 7fd28effd700 1 -- 172.21.15.37:0/1393244129 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2880038c0 con 0x7fd2980b0ac0 2023-07-14T15:57:13.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.635+0000 7fd29cdff700 1 -- 172.21.15.37:0/1393244129 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2980d02a0 con 0x7fd2980b0ac0 2023-07-14T15:57:13.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.636+0000 7fd29cdff700 1 -- 172.21.15.37:0/1393244129 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd298067840 con 0x7fd2980b0ac0 2023-07-14T15:57:13.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.636+0000 7fd28effd700 1 -- 172.21.15.37:0/1393244129 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd288003a20 con 0x7fd2980b0ac0 2023-07-14T15:57:13.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.637+0000 7fd28effd700 1 --2- 172.21.15.37:0/1393244129 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd27806ad10 0x7fd27806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:13.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.637+0000 7fd28effd700 1 -- 172.21.15.37:0/1393244129 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fd28808a320 con 0x7fd2980b0ac0 2023-07-14T15:57:13.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.638+0000 7fd28ffff700 1 --2- 172.21.15.37:0/1393244129 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd27806ad10 0x7fd27806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:13.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.638+0000 7fd28ffff700 1 --2- 172.21.15.37:0/1393244129 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd27806ad10 0x7fd27806d1c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd2980d2260 tx=0x7fd280007dc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:13.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.642+0000 7fd28effd700 1 -- 172.21.15.37:0/1393244129 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd288055360 con 0x7fd2980b0ac0 2023-07-14T15:57:13.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:13.898+0000 7fd29cdff700 1 -- 172.21.15.37:0/1393244129 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd2980c6530 con 0x7fd2980b0ac0 2023-07-14T15:57:14.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.402+0000 7fd28effd700 1 -- 172.21.15.37:0/1393244129 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd288058980 con 0x7fd2980b0ac0 2023-07-14T15:57:14.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.405+0000 7fd29cdff700 1 -- 172.21.15.37:0/1393244129 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd27806ad10 msgr2=0x7fd27806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:14.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.405+0000 7fd29cdff700 1 --2- 172.21.15.37:0/1393244129 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd27806ad10 0x7fd27806d1c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd2980d2260 tx=0x7fd280007dc0 comp rx=0 tx=0).stop 2023-07-14T15:57:14.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.405+0000 7fd29cdff700 1 -- 172.21.15.37:0/1393244129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2980b0ac0 msgr2=0x7fd2981e6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:14.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.405+0000 7fd29cdff700 1 --2- 172.21.15.37:0/1393244129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2980b0ac0 0x7fd2981e6d10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd288009840 tx=0x7fd288004750 comp rx=0 tx=0).stop 2023-07-14T15:57:14.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.405+0000 7fd29cdff700 1 -- 172.21.15.37:0/1393244129 shutdown_connections 2023-07-14T15:57:14.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.405+0000 7fd29cdff700 1 --2- 172.21.15.37:0/1393244129 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2980cfd50 0x7fd29806b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:14.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.405+0000 7fd29cdff700 1 --2- 172.21.15.37:0/1393244129 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd27806ad10 0x7fd27806d1c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:14.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.405+0000 7fd29cdff700 1 --2- 172.21.15.37:0/1393244129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2980b0ac0 0x7fd2981e6d10 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:14.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.405+0000 7fd29cdff700 1 --2- 172.21.15.37:0/1393244129 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd2980b1e80 0x7fd29814e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:14.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.405+0000 7fd29cdff700 1 -- 172.21.15.37:0/1393244129 >> 172.21.15.37:0/1393244129 conn(0x7fd29809c1c0 msgr2=0x7fd2980d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:14.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.405+0000 7fd29cdff700 1 -- 172.21.15.37:0/1393244129 shutdown_connections 2023-07-14T15:57:14.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.405+0000 7fd29cdff700 1 -- 172.21.15.37:0/1393244129 wait complete. 2023-07-14T15:57:14.410 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-14T15:57:14.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.630+0000 7fcae35ff700 1 Processor -- start 2023-07-14T15:57:14.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.631+0000 7fcae35ff700 1 -- start start 2023-07-14T15:57:14.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.632+0000 7fcae35ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcadc1462d0 0x7fcadc0cd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:14.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.632+0000 7fcae35ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcadc0d1270 con 0x7fcadc0cf780 2023-07-14T15:57:14.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.632+0000 7fcae35ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcadc0d1550 con 0x7fcadc0d2310 2023-07-14T15:57:14.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.632+0000 7fcae35ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcadc0d1830 con 0x7fcadc1462d0 2023-07-14T15:57:14.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.632+0000 7fcae1b9c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fcadc0cf780 0x7fcadc0cfba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46330/0 (socket says 172.21.15.37:46330) 2023-07-14T15:57:14.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.632+0000 7fcae1b9c700 1 -- 172.21.15.37:0/230067174 learned_addr learned my addr 172.21.15.37:0/230067174 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:14.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.632+0000 7fcae139b700 1 --2- 172.21.15.37:0/230067174 >> v2:172.21.15.37:3300/0 conn(0x7fcadc1462d0 0x7fcadc0cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:14.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.632+0000 7fcad3fff700 1 -- 172.21.15.37:0/230067174 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2899245327 0 0) 0x7fcadc0d1270 con 0x7fcadc0cf780 2023-07-14T15:57:14.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.633+0000 7fcad3fff700 1 -- 172.21.15.37:0/230067174 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcac80035b0 con 0x7fcadc0cf780 2023-07-14T15:57:14.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.633+0000 7fcae139b700 1 -- 172.21.15.37:0/230067174 >> v1:172.21.15.98:6789/0 conn(0x7fcadc0d2310 legacy=0x7fcadc0d09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:14.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.633+0000 7fcae139b700 1 -- 172.21.15.37:0/230067174 >> v1:172.21.15.37:6789/0 conn(0x7fcadc0cf780 legacy=0x7fcadc0cfba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:14.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.633+0000 7fcae139b700 1 -- 172.21.15.37:0/230067174 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcadc0d1b10 con 0x7fcadc1462d0 2023-07-14T15:57:14.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.633+0000 7fcae139b700 1 --2- 172.21.15.37:0/230067174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcadc1462d0 0x7fcadc0cd890 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fcad8009840 tx=0x7fcad8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3e8ca0000ac1fea server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:14.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.633+0000 7fcad3fff700 1 -- 172.21.15.37:0/230067174 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad8011830 con 0x7fcadc1462d0 2023-07-14T15:57:14.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.633+0000 7fcad3fff700 1 -- 172.21.15.37:0/230067174 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad8011990 con 0x7fcadc1462d0 2023-07-14T15:57:14.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.633+0000 7fcad3fff700 1 -- 172.21.15.37:0/230067174 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad8011d20 con 0x7fcadc1462d0 2023-07-14T15:57:14.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.634+0000 7fcae35ff700 1 -- 172.21.15.37:0/230067174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcadc1462d0 msgr2=0x7fcadc0cd890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:14.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.634+0000 7fcae35ff700 1 --2- 172.21.15.37:0/230067174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcadc1462d0 0x7fcadc0cd890 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fcad8009840 tx=0x7fcad8009b50 comp rx=0 tx=0).stop 2023-07-14T15:57:14.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.634+0000 7fcae35ff700 1 -- 172.21.15.37:0/230067174 shutdown_connections 2023-07-14T15:57:14.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.634+0000 7fcae35ff700 1 --2- 172.21.15.37:0/230067174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcadc1462d0 0x7fcadc0cd890 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:14.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.634+0000 7fcae35ff700 1 -- 172.21.15.37:0/230067174 >> 172.21.15.37:0/230067174 conn(0x7fcadc06a4d0 msgr2=0x7fcadc06a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:14.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.634+0000 7fcae35ff700 1 -- 172.21.15.37:0/230067174 shutdown_connections 2023-07-14T15:57:14.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.634+0000 7fcae35ff700 1 -- 172.21.15.37:0/230067174 wait complete. 2023-07-14T15:57:14.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.635+0000 7fcae35ff700 1 Processor -- start 2023-07-14T15:57:14.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.636+0000 7fcae35ff700 1 -- start start 2023-07-14T15:57:14.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.637+0000 7fcae35ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcadc0cf780 0x7fcadc1f3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:14.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.637+0000 7fcae35ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcadc0d2310 0x7fcadc15b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:14.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.637+0000 7fcae35ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcadc1462d0 0x7fcadc0cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:14.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.637+0000 7fcae35ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcadc0cc620 con 0x7fcadc0d2310 2023-07-14T15:57:14.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.637+0000 7fcae35ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcadc0c7450 con 0x7fcadc0cf780 2023-07-14T15:57:14.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.637+0000 7fcae35ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcadc1f6610 con 0x7fcadc1462d0 2023-07-14T15:57:14.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.637+0000 7fcae0b9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcadc0d2310 0x7fcadc15b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:14.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.637+0000 7fcae0b9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcadc0d2310 0x7fcadc15b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60256/0 (socket says 172.21.15.37:60256) 2023-07-14T15:57:14.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.637+0000 7fcae0b9a700 1 -- 172.21.15.37:0/818546575 learned_addr learned my addr 172.21.15.37:0/818546575 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:14.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.637+0000 7fcae139b700 1 --2- 172.21.15.37:0/818546575 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcadc0cf780 0x7fcadc1f3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:14.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.637+0000 7fcae1b9c700 1 --2- 172.21.15.37:0/818546575 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcadc1462d0 0x7fcadc0cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:14.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.637+0000 7fcae0b9a700 1 -- 172.21.15.37:0/818546575 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcadc1462d0 msgr2=0x7fcadc0cb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:14.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.637+0000 7fcae0b9a700 1 --2- 172.21.15.37:0/818546575 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcadc1462d0 0x7fcadc0cb9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:14.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.637+0000 7fcae0b9a700 1 -- 172.21.15.37:0/818546575 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcadc0cf780 msgr2=0x7fcadc1f3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:14.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.637+0000 7fcae0b9a700 1 --2- 172.21.15.37:0/818546575 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcadc0cf780 0x7fcadc1f3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:14.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.637+0000 7fcae0b9a700 1 -- 172.21.15.37:0/818546575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad80094a0 con 0x7fcadc0d2310 2023-07-14T15:57:14.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.637+0000 7fcae1b9c700 1 --2- 172.21.15.37:0/818546575 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcadc1462d0 0x7fcadc0cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:57:14.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.638+0000 7fcae0b9a700 1 --2- 172.21.15.37:0/818546575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcadc0d2310 0x7fcadc15b1d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fcacc00c510 tx=0x7fcacc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:14.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.638+0000 7fcad1ffb700 1 -- 172.21.15.37:0/818546575 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcacc0052d0 con 0x7fcadc0d2310 2023-07-14T15:57:14.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.638+0000 7fcad1ffb700 1 -- 172.21.15.37:0/818546575 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcacc005430 con 0x7fcadc0d2310 2023-07-14T15:57:14.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.638+0000 7fcae35ff700 1 -- 172.21.15.37:0/818546575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcadc0c6ab0 con 0x7fcadc0d2310 2023-07-14T15:57:14.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.638+0000 7fcad1ffb700 1 -- 172.21.15.37:0/818546575 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcacc0038c0 con 0x7fcadc0d2310 2023-07-14T15:57:14.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.638+0000 7fcae35ff700 1 -- 172.21.15.37:0/818546575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcadc0c7070 con 0x7fcadc0d2310 2023-07-14T15:57:14.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.639+0000 7fcae35ff700 1 -- 172.21.15.37:0/818546575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcadc0c7590 con 0x7fcadc0d2310 2023-07-14T15:57:14.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.640+0000 7fcad1ffb700 1 -- 172.21.15.37:0/818546575 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcacc003a20 con 0x7fcadc0d2310 2023-07-14T15:57:14.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.641+0000 7fcad1ffb700 1 --2- 172.21.15.37:0/818546575 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fcac006ace0 0x7fcac006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:14.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.641+0000 7fcad1ffb700 1 -- 172.21.15.37:0/818546575 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fcacc088a00 con 0x7fcadc0d2310 2023-07-14T15:57:14.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.642+0000 7fcae139b700 1 --2- 172.21.15.37:0/818546575 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fcac006ace0 0x7fcac006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:14.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.642+0000 7fcae139b700 1 --2- 172.21.15.37:0/818546575 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fcac006ace0 0x7fcac006d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcad80090b0 tx=0x7fcad801c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:14.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.646+0000 7fcad1ffb700 1 -- 172.21.15.37:0/818546575 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fcadc0c7590 con 0x7fcadc0d2310 2023-07-14T15:57:14.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:14.856+0000 7fcae35ff700 1 -- 172.21.15.37:0/818546575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcadc0c7590 con 0x7fcadc0d2310 2023-07-14T15:57:15.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:15.796+0000 7fcad1ffb700 1 -- 172.21.15.37:0/818546575 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v27) v1 ==== 181+0+0 (secure 0 0 0) 0x7fcadc0c7590 con 0x7fcadc0d2310 2023-07-14T15:57:15.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:15.801+0000 7fcae35ff700 1 -- 172.21.15.37:0/818546575 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fcac006ace0 msgr2=0x7fcac006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:15.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:15.801+0000 7fcae35ff700 1 --2- 172.21.15.37:0/818546575 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fcac006ace0 0x7fcac006d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcad80090b0 tx=0x7fcad801c040 comp rx=0 tx=0).stop 2023-07-14T15:57:15.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:15.801+0000 7fcae35ff700 1 -- 172.21.15.37:0/818546575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcadc0d2310 msgr2=0x7fcadc15b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:15.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:15.801+0000 7fcae35ff700 1 --2- 172.21.15.37:0/818546575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcadc0d2310 0x7fcadc15b1d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fcacc00c510 tx=0x7fcacc00c8d0 comp rx=0 tx=0).stop 2023-07-14T15:57:15.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:15.801+0000 7fcae35ff700 1 -- 172.21.15.37:0/818546575 shutdown_connections 2023-07-14T15:57:15.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:15.801+0000 7fcae35ff700 1 --2- 172.21.15.37:0/818546575 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcadc0cf780 0x7fcadc1f3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:15.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:15.801+0000 7fcae35ff700 1 --2- 172.21.15.37:0/818546575 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fcac006ace0 0x7fcac006d190 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:15.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:15.801+0000 7fcae35ff700 1 --2- 172.21.15.37:0/818546575 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcadc1462d0 0x7fcadc0cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:15.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:15.801+0000 7fcae35ff700 1 --2- 172.21.15.37:0/818546575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcadc0d2310 0x7fcadc15b1d0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:15.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:15.801+0000 7fcae35ff700 1 -- 172.21.15.37:0/818546575 >> 172.21.15.37:0/818546575 conn(0x7fcadc06a4d0 msgr2=0x7fcadc0d3520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:15.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:15.801+0000 7fcae35ff700 1 -- 172.21.15.37:0/818546575 shutdown_connections 2023-07-14T15:57:15.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:15.801+0000 7fcae35ff700 1 -- 172.21.15.37:0/818546575 wait complete. 2023-07-14T15:57:15.789 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2023-07-14T15:57:15.809 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-14T15:57:16.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.034+0000 7f9828fff700 1 Processor -- start 2023-07-14T15:57:16.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.034+0000 7f9828fff700 1 -- start start 2023-07-14T15:57:16.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.035+0000 7f9828fff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f98241462d0 0x7f98240cd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:16.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.035+0000 7f9828fff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98240d1270 con 0x7f98240cf780 2023-07-14T15:57:16.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.035+0000 7f9828fff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98240d1550 con 0x7f98240d2310 2023-07-14T15:57:16.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.035+0000 7f9828fff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98240d1830 con 0x7f98241462d0 2023-07-14T15:57:16.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.036+0000 7f9822d9d700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f98240cf780 0x7f98240cfc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46336/0 (socket says 172.21.15.37:46336) 2023-07-14T15:57:16.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.036+0000 7f9822d9d700 1 -- 172.21.15.37:0/3600372202 learned_addr learned my addr 172.21.15.37:0/3600372202 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:16.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.036+0000 7f982259c700 1 --2- 172.21.15.37:0/3600372202 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f98241462d0 0x7f98240cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:16.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.036+0000 7f982159a700 1 -- 172.21.15.37:0/3600372202 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3520985658 0 0) 0x7f98240d1270 con 0x7f98240cf780 2023-07-14T15:57:16.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.036+0000 7f982159a700 1 -- 172.21.15.37:0/3600372202 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f980c0035b0 con 0x7f98240cf780 2023-07-14T15:57:16.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.036+0000 7f982159a700 1 -- 172.21.15.37:0/3600372202 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1887188489 0 0) 0x7f98240d1550 con 0x7f98240d2310 2023-07-14T15:57:16.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.036+0000 7f982159a700 1 -- 172.21.15.37:0/3600372202 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98240d1270 con 0x7f98240d2310 2023-07-14T15:57:16.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.036+0000 7f982259c700 1 -- 172.21.15.37:0/3600372202 >> v1:172.21.15.98:6789/0 conn(0x7f98240d2310 legacy=0x7f98240d09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:16.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.036+0000 7f982259c700 1 -- 172.21.15.37:0/3600372202 >> v1:172.21.15.37:6789/0 conn(0x7f98240cf780 legacy=0x7f98240cfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:16.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.036+0000 7f982259c700 1 -- 172.21.15.37:0/3600372202 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98240d1b10 con 0x7f98241462d0 2023-07-14T15:57:16.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.037+0000 7f982259c700 1 --2- 172.21.15.37:0/3600372202 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f98241462d0 0x7f98240cd890 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9814009870 tx=0x7f9814009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=537a8d9e57e6678b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:16.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.037+0000 7f982159a700 1 -- 172.21.15.37:0/3600372202 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9814011830 con 0x7f98241462d0 2023-07-14T15:57:16.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.037+0000 7f982159a700 1 -- 172.21.15.37:0/3600372202 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9814011990 con 0x7f98241462d0 2023-07-14T15:57:16.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.037+0000 7f982159a700 1 -- 172.21.15.37:0/3600372202 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9814011d20 con 0x7f98241462d0 2023-07-14T15:57:16.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.037+0000 7f9828fff700 1 -- 172.21.15.37:0/3600372202 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f98241462d0 msgr2=0x7f98240cd890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:16.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.037+0000 7f9828fff700 1 --2- 172.21.15.37:0/3600372202 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f98241462d0 0x7f98240cd890 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9814009870 tx=0x7f9814009b80 comp rx=0 tx=0).stop 2023-07-14T15:57:16.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.038+0000 7f9828fff700 1 -- 172.21.15.37:0/3600372202 shutdown_connections 2023-07-14T15:57:16.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.038+0000 7f9828fff700 1 --2- 172.21.15.37:0/3600372202 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f98241462d0 0x7f98240cd890 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:16.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.038+0000 7f9828fff700 1 -- 172.21.15.37:0/3600372202 >> 172.21.15.37:0/3600372202 conn(0x7f982406a4d0 msgr2=0x7f982406a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:16.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.038+0000 7f9828fff700 1 -- 172.21.15.37:0/3600372202 shutdown_connections 2023-07-14T15:57:16.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.038+0000 7f9828fff700 1 -- 172.21.15.37:0/3600372202 wait complete. 2023-07-14T15:57:16.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.040+0000 7f9828fff700 1 Processor -- start 2023-07-14T15:57:16.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.040+0000 7f9828fff700 1 -- start start 2023-07-14T15:57:16.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.041+0000 7f9828fff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f98240cf780 0x7f98240c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:16.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.042+0000 7f9828fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98240d2310 0x7f9824156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:16.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.042+0000 7f9828fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98241462d0 0x7f98240ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:16.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.042+0000 7f9828fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98240cbaf0 con 0x7f98241462d0 2023-07-14T15:57:16.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.042+0000 7f9828fff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98240cbd90 con 0x7f98240d2310 2023-07-14T15:57:16.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.042+0000 7f9828fff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98240cc070 con 0x7f98240cf780 2023-07-14T15:57:16.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.042+0000 7f9822d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98241462d0 0x7f98240ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:16.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.042+0000 7f9822d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98241462d0 0x7f98240ccb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60264/0 (socket says 172.21.15.37:60264) 2023-07-14T15:57:16.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.042+0000 7f9822d9d700 1 -- 172.21.15.37:0/2557293721 learned_addr learned my addr 172.21.15.37:0/2557293721 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:16.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.042+0000 7f982259c700 1 --2- 172.21.15.37:0/2557293721 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f98240cf780 0x7f98240c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:16.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.042+0000 7f9821d9b700 1 --2- 172.21.15.37:0/2557293721 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98240d2310 0x7f9824156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:16.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.042+0000 7f9822d9d700 1 -- 172.21.15.37:0/2557293721 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f98240cf780 msgr2=0x7f98240c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:16.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.042+0000 7f9822d9d700 1 --2- 172.21.15.37:0/2557293721 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f98240cf780 0x7f98240c9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:16.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.042+0000 7f9822d9d700 1 -- 172.21.15.37:0/2557293721 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98240d2310 msgr2=0x7f9824156180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:16.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.042+0000 7f9822d9d700 1 --2- 172.21.15.37:0/2557293721 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98240d2310 0x7f9824156180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:16.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.042+0000 7f9822d9d700 1 -- 172.21.15.37:0/2557293721 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98140094a0 con 0x7f98241462d0 2023-07-14T15:57:16.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.043+0000 7f9822d9d700 1 --2- 172.21.15.37:0/2557293721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98241462d0 0x7f98240ccb50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f981c00cb70 tx=0x7f981c00cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:16.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.043+0000 7f9812ffd700 1 -- 172.21.15.37:0/2557293721 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c00aaf0 con 0x7f98241462d0 2023-07-14T15:57:16.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.043+0000 7f9812ffd700 1 -- 172.21.15.37:0/2557293721 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981c00ac50 con 0x7f98241462d0 2023-07-14T15:57:16.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.043+0000 7f9828fff700 1 -- 172.21.15.37:0/2557293721 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98240cc350 con 0x7f98241462d0 2023-07-14T15:57:16.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.043+0000 7f9812ffd700 1 -- 172.21.15.37:0/2557293721 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c012400 con 0x7f98241462d0 2023-07-14T15:57:16.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.043+0000 7f9828fff700 1 -- 172.21.15.37:0/2557293721 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98240ca410 con 0x7f98241462d0 2023-07-14T15:57:16.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.044+0000 7f9828fff700 1 -- 172.21.15.37:0/2557293721 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98240cc870 con 0x7f98241462d0 2023-07-14T15:57:16.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.045+0000 7f9812ffd700 1 -- 172.21.15.37:0/2557293721 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f981c01b3b0 con 0x7f98241462d0 2023-07-14T15:57:16.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.046+0000 7f9812ffd700 1 --2- 172.21.15.37:0/2557293721 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f980406ace0 0x7f980406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:16.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.046+0000 7f9812ffd700 1 -- 172.21.15.37:0/2557293721 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5710+0+0 (secure 0 0 0) 0x7f981c0891c0 con 0x7f98241462d0 2023-07-14T15:57:16.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.046+0000 7f982259c700 1 --2- 172.21.15.37:0/2557293721 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f980406ace0 0x7f980406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:16.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.047+0000 7f982259c700 1 --2- 172.21.15.37:0/2557293721 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f980406ace0 0x7f980406d190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f98140097c0 tx=0x7f981401c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:16.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.050+0000 7f9812ffd700 1 -- 172.21.15.37:0/2557293721 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f98240cc870 con 0x7f98241462d0 2023-07-14T15:57:16.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.258+0000 7f9828fff700 1 -- 172.21.15.37:0/2557293721 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f98240cc870 con 0x7f98241462d0 2023-07-14T15:57:16.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.806+0000 7f9812ffd700 1 -- 172.21.15.37:0/2557293721 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v28) v1 ==== 169+0+0 (secure 0 0 0) 0x7f98240cc870 con 0x7f98241462d0 2023-07-14T15:57:16.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.810+0000 7f9828fff700 1 -- 172.21.15.37:0/2557293721 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f980406ace0 msgr2=0x7f980406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:16.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.810+0000 7f9828fff700 1 --2- 172.21.15.37:0/2557293721 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f980406ace0 0x7f980406d190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f98140097c0 tx=0x7f981401c040 comp rx=0 tx=0).stop 2023-07-14T15:57:16.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.810+0000 7f9828fff700 1 -- 172.21.15.37:0/2557293721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98241462d0 msgr2=0x7f98240ccb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:16.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.810+0000 7f9828fff700 1 --2- 172.21.15.37:0/2557293721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98241462d0 0x7f98240ccb50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f981c00cb70 tx=0x7f981c00cf30 comp rx=0 tx=0).stop 2023-07-14T15:57:16.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.811+0000 7f9828fff700 1 -- 172.21.15.37:0/2557293721 shutdown_connections 2023-07-14T15:57:16.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.811+0000 7f9828fff700 1 --2- 172.21.15.37:0/2557293721 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f980406ace0 0x7f980406d190 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:16.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.811+0000 7f9828fff700 1 --2- 172.21.15.37:0/2557293721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98241462d0 0x7f98240ccb50 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:16.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.811+0000 7f9828fff700 1 --2- 172.21.15.37:0/2557293721 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f98240cf780 0x7f98240c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:16.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.811+0000 7f9828fff700 1 --2- 172.21.15.37:0/2557293721 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98240d2310 0x7f9824156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:16.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.811+0000 7f9828fff700 1 -- 172.21.15.37:0/2557293721 >> 172.21.15.37:0/2557293721 conn(0x7f982406a4d0 msgr2=0x7f982415e450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:16.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.811+0000 7f9828fff700 1 -- 172.21.15.37:0/2557293721 shutdown_connections 2023-07-14T15:57:16.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:16.811+0000 7f9828fff700 1 -- 172.21.15.37:0/2557293721 wait complete. 2023-07-14T15:57:16.805 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2023-07-14T15:57:16.825 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-14T15:57:16.826 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-14T15:57:16.826 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-14T15:57:16.826 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T15:57:16.827 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-14T15:57:16.827 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-14T15:57:16.827 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-14T15:57:16.827 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T15:57:16.828 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-14T15:57:16.828 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-14T15:57:16.828 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-14T15:57:16.828 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T15:57:16.828 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-14T15:57:16.829 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-14T15:57:16.829 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-14T15:57:16.829 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T15:57:16.844 INFO:tasks.ceph.mds.a:Stopped 2023-07-14T15:57:16.844 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-14T15:57:16.846 INFO:tasks.ceph.mds.d:Stopped 2023-07-14T15:57:16.846 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-14T15:57:16.847 INFO:tasks.ceph.mds.c:Stopped 2023-07-14T15:57:16.847 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-14T15:57:16.848 INFO:tasks.ceph.mds.b:Stopped 2023-07-14T15:57:16.848 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-14T15:57:16.890 INFO:tasks.ceph.mds.a:Started 2023-07-14T15:57:16.891 DEBUG:teuthology.parallel:result is None 2023-07-14T15:57:16.892 INFO:tasks.ceph.mds.d:Started 2023-07-14T15:57:16.892 DEBUG:teuthology.parallel:result is None 2023-07-14T15:57:16.894 INFO:tasks.ceph.mds.b:Started 2023-07-14T15:57:16.894 DEBUG:teuthology.parallel:result is None 2023-07-14T15:57:16.895 INFO:tasks.ceph.mds.c:Started 2023-07-14T15:57:16.895 DEBUG:teuthology.parallel:result is None 2023-07-14T15:57:16.895 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-14T15:57:17.040 INFO:tasks.ceph.mds.b.smithi098.stdout:starting mds.b at 2023-07-14T15:57:17.040 INFO:tasks.ceph.mds.d.smithi098.stdout:starting mds.d at 2023-07-14T15:57:17.049 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-07-14T15:57:17.050 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2023-07-14T15:57:17.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.139+0000 7fd0a8dff700 1 Processor -- start 2023-07-14T15:57:17.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.139+0000 7fd0a8dff700 1 -- start start 2023-07-14T15:57:17.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.140+0000 7fd0a8dff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd0a40af4b0 0x7fd0a40ce890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:17.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.140+0000 7fd0a8dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd0a415e7f0 0x7fd0a40ad890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:17.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.140+0000 7fd0a8dff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0a40cf220 con 0x7fd0a40cedd0 2023-07-14T15:57:17.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.140+0000 7fd0a8dff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0a415a980 con 0x7fd0a40af4b0 2023-07-14T15:57:17.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.140+0000 7fd0a8dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a415ec70 con 0x7fd0a415e7f0 2023-07-14T15:57:17.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.141+0000 7fd0a259c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd0a40af4b0 0x7fd0a40ce890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:17.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.141+0000 7fd0a259c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd0a40af4b0 0x7fd0a40ce890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60316/0 (socket says 172.21.15.37:60316) 2023-07-14T15:57:17.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.141+0000 7fd0a259c700 1 -- 172.21.15.37:0/635729204 learned_addr learned my addr 172.21.15.37:0/635729204 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:17.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.141+0000 7fd0a2d9d700 1 --2- 172.21.15.37:0/635729204 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd0a415e7f0 0x7fd0a40ad890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:17.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.141+0000 7fd0a259c700 1 -- 172.21.15.37:0/635729204 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd0a415e7f0 msgr2=0x7fd0a40ad890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:17.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.141+0000 7fd0a259c700 1 --2- 172.21.15.37:0/635729204 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd0a415e7f0 0x7fd0a40ad890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:17.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.141+0000 7fd0a259c700 1 -- 172.21.15.37:0/635729204 >> v1:172.21.15.98:6789/0 conn(0x7fd0a40cedd0 legacy=0x7fd0a415e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:17.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.141+0000 7fd0a259c700 1 -- 172.21.15.37:0/635729204 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a415ee50 con 0x7fd0a40af4b0 2023-07-14T15:57:17.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.142+0000 7fd0a259c700 1 --2- 172.21.15.37:0/635729204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0a40af4b0 0x7fd0a40ce890 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd0940098f0 tx=0x7fd094009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5f2690823d542ba server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:17.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.142+0000 7fd0a1d9b700 1 -- 172.21.15.37:0/635729204 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09400b8a0 con 0x7fd0a40af4b0 2023-07-14T15:57:17.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.142+0000 7fd0a1d9b700 1 -- 172.21.15.37:0/635729204 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd09400ba00 con 0x7fd0a40af4b0 2023-07-14T15:57:17.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.142+0000 7fd0a1d9b700 1 -- 172.21.15.37:0/635729204 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09400bd90 con 0x7fd0a40af4b0 2023-07-14T15:57:17.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.142+0000 7fd0a8dff700 1 -- 172.21.15.37:0/635729204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0a40af4b0 msgr2=0x7fd0a40ce890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:17.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.142+0000 7fd0a8dff700 1 --2- 172.21.15.37:0/635729204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0a40af4b0 0x7fd0a40ce890 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd0940098f0 tx=0x7fd094009c00 comp rx=0 tx=0).stop 2023-07-14T15:57:17.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.142+0000 7fd0a8dff700 1 -- 172.21.15.37:0/635729204 shutdown_connections 2023-07-14T15:57:17.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.142+0000 7fd0a8dff700 1 --2- 172.21.15.37:0/635729204 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd0a415e7f0 0x7fd0a40ad890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:17.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.142+0000 7fd0a8dff700 1 --2- 172.21.15.37:0/635729204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0a40af4b0 0x7fd0a40ce890 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:17.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.142+0000 7fd0a8dff700 1 -- 172.21.15.37:0/635729204 >> 172.21.15.37:0/635729204 conn(0x7fd0a40664f0 msgr2=0x7fd0a409a030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:17.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.143+0000 7fd0a8dff700 1 -- 172.21.15.37:0/635729204 shutdown_connections 2023-07-14T15:57:17.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.143+0000 7fd0a8dff700 1 -- 172.21.15.37:0/635729204 wait complete. 2023-07-14T15:57:17.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.144+0000 7fd0a8dff700 1 Processor -- start 2023-07-14T15:57:17.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.145+0000 7fd0a8dff700 1 -- start start 2023-07-14T15:57:17.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.145+0000 7fd0a8dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd0a40af4b0 0x7fd0a40b4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:17.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.145+0000 7fd0a8dff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0a40cedd0 0x7fd0a41558b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:17.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.145+0000 7fd0a8dff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0a415e7f0 0x7fd0a4151c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:17.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.146+0000 7fd0a8dff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a415bed0 con 0x7fd0a415e7f0 2023-07-14T15:57:17.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.146+0000 7fd0a8dff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a415c1b0 con 0x7fd0a40cedd0 2023-07-14T15:57:17.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.146+0000 7fd0a8dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a415c490 con 0x7fd0a40af4b0 2023-07-14T15:57:17.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.146+0000 7fd0a2d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0a415e7f0 0x7fd0a4151c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:17.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.146+0000 7fd0a259c700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd0a40af4b0 0x7fd0a40b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:17.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.146+0000 7fd0a259c700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd0a40af4b0 0x7fd0a40b4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3301/0 says I am v2:172.21.15.37:45054/0 (socket says 172.21.15.37:45054) 2023-07-14T15:57:17.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.146+0000 7fd0a259c700 1 -- 172.21.15.37:0/3089665250 learned_addr learned my addr 172.21.15.37:0/3089665250 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:17.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.146+0000 7fd0a2d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0a415e7f0 0x7fd0a4151c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60320/0 (socket says 172.21.15.37:60320) 2023-07-14T15:57:17.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.146+0000 7fd09bfff700 1 --2- 172.21.15.37:0/3089665250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0a40cedd0 0x7fd0a41558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:17.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.146+0000 7fd0a259c700 1 -- 172.21.15.37:0/3089665250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0a40cedd0 msgr2=0x7fd0a41558b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:17.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.146+0000 7fd0a259c700 1 --2- 172.21.15.37:0/3089665250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0a40cedd0 0x7fd0a41558b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:17.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.146+0000 7fd0a259c700 1 -- 172.21.15.37:0/3089665250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0a415e7f0 msgr2=0x7fd0a4151c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:17.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.146+0000 7fd0a259c700 1 --2- 172.21.15.37:0/3089665250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0a415e7f0 0x7fd0a4151c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:17.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.146+0000 7fd0a259c700 1 -- 172.21.15.37:0/3089665250 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd094009550 con 0x7fd0a40af4b0 2023-07-14T15:57:17.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.146+0000 7fd0a2d9d700 1 --2- 172.21.15.37:0/3089665250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0a415e7f0 0x7fd0a4151c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:57:17.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.147+0000 7fd0a259c700 1 --2- 172.21.15.37:0/3089665250 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd0a40af4b0 0x7fd0a40b4950 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd094000c00 tx=0x7fd094004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:17.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.147+0000 7fd09affd700 1 -- 172.21.15.37:0/3089665250 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd094004300 con 0x7fd0a40af4b0 2023-07-14T15:57:17.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.147+0000 7fd09affd700 1 -- 172.21.15.37:0/3089665250 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd09401f070 con 0x7fd0a40af4b0 2023-07-14T15:57:17.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.147+0000 7fd09affd700 1 -- 172.21.15.37:0/3089665250 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0940036a0 con 0x7fd0a40af4b0 2023-07-14T15:57:17.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.147+0000 7fd0a8dff700 1 -- 172.21.15.37:0/3089665250 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0a415c770 con 0x7fd0a40af4b0 2023-07-14T15:57:17.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.147+0000 7fd0a8dff700 1 -- 172.21.15.37:0/3089665250 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0a4154070 con 0x7fd0a40af4b0 2023-07-14T15:57:17.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.148+0000 7fd0a8dff700 1 -- 172.21.15.37:0/3089665250 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0a415b900 con 0x7fd0a40af4b0 2023-07-14T15:57:17.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.149+0000 7fd09affd700 1 -- 172.21.15.37:0/3089665250 <== mon.2 v2:172.21.15.98:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd094021030 con 0x7fd0a40af4b0 2023-07-14T15:57:17.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.150+0000 7fd09affd700 1 --2- 172.21.15.37:0/3089665250 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd08406ace0 0x7fd08406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:17.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.150+0000 7fd09affd700 1 -- 172.21.15.37:0/3089665250 <== mon.2 v2:172.21.15.98:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fd09408a7b0 con 0x7fd0a40af4b0 2023-07-14T15:57:17.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.150+0000 7fd09bfff700 1 --2- 172.21.15.37:0/3089665250 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd08406ace0 0x7fd08406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:17.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.151+0000 7fd09bfff700 1 --2- 172.21.15.37:0/3089665250 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd08406ace0 0x7fd08406d190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd0a40b4460 tx=0x7fd08c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:17.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.154+0000 7fd09affd700 1 -- 172.21.15.37:0/3089665250 <== mon.2 v2:172.21.15.98:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd094055b70 con 0x7fd0a40af4b0 2023-07-14T15:57:17.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.381+0000 7fd0a8dff700 1 -- 172.21.15.37:0/3089665250 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fd0a415c9b0 con 0x7fd0a40af4b0 2023-07-14T15:57:17.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.826+0000 7fd09affd700 1 -- 172.21.15.37:0/3089665250 <== mon.2 v2:172.21.15.98:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v30) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd0a415c9b0 con 0x7fd0a40af4b0 2023-07-14T15:57:17.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.829+0000 7fd0a8dff700 1 -- 172.21.15.37:0/3089665250 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd08406ace0 msgr2=0x7fd08406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:17.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.829+0000 7fd0a8dff700 1 --2- 172.21.15.37:0/3089665250 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd08406ace0 0x7fd08406d190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd0a40b4460 tx=0x7fd08c009040 comp rx=0 tx=0).stop 2023-07-14T15:57:17.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.829+0000 7fd0a8dff700 1 -- 172.21.15.37:0/3089665250 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd0a40af4b0 msgr2=0x7fd0a40b4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:17.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.829+0000 7fd0a8dff700 1 --2- 172.21.15.37:0/3089665250 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd0a40af4b0 0x7fd0a40b4950 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd094000c00 tx=0x7fd094004750 comp rx=0 tx=0).stop 2023-07-14T15:57:17.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.829+0000 7fd0a8dff700 1 -- 172.21.15.37:0/3089665250 shutdown_connections 2023-07-14T15:57:17.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.829+0000 7fd0a8dff700 1 --2- 172.21.15.37:0/3089665250 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd08406ace0 0x7fd08406d190 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:17.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.829+0000 7fd0a8dff700 1 --2- 172.21.15.37:0/3089665250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0a415e7f0 0x7fd0a4151c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:17.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.829+0000 7fd0a8dff700 1 --2- 172.21.15.37:0/3089665250 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd0a40af4b0 0x7fd0a40b4950 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:17.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.829+0000 7fd0a8dff700 1 --2- 172.21.15.37:0/3089665250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0a40cedd0 0x7fd0a41558b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:17.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.829+0000 7fd0a8dff700 1 -- 172.21.15.37:0/3089665250 >> 172.21.15.37:0/3089665250 conn(0x7fd0a40664f0 msgr2=0x7fd0a40b15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:17.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.829+0000 7fd0a8dff700 1 -- 172.21.15.37:0/3089665250 shutdown_connections 2023-07-14T15:57:17.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:17.829+0000 7fd0a8dff700 1 -- 172.21.15.37:0/3089665250 wait complete. 2023-07-14T15:57:17.817 INFO:teuthology.orchestra.run.smithi037.stderr: removed all blocklist entries 2023-07-14T15:57:17.837 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-14T15:57:18.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.057+0000 7f7dbadff700 1 Processor -- start 2023-07-14T15:57:18.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.057+0000 7f7dbadff700 1 -- start start 2023-07-14T15:57:18.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.058+0000 7f7dbadff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f7db40b54b0 0x7f7db40cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:18.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.058+0000 7f7dbadff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7db40b4910 0x7f7db40b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:18.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.058+0000 7f7dbadff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7db40b52b0 con 0x7f7db40b85f0 2023-07-14T15:57:18.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.058+0000 7f7dbadff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7db40cf6b0 con 0x7f7db40b54b0 2023-07-14T15:57:18.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.058+0000 7f7dbadff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7db40cdc40 con 0x7f7db40b4910 2023-07-14T15:57:18.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.058+0000 7f7db3fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f7db40b54b0 0x7f7db40cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:18.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.058+0000 7f7db939c700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7db40b4910 0x7f7db40b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:18.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.059+0000 7f7db3fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f7db40b54b0 0x7f7db40cfb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.37:52522/0 (socket says 172.21.15.37:52522) 2023-07-14T15:57:18.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.059+0000 7f7db3fff700 1 -- 172.21.15.37:0/1979939440 learned_addr learned my addr 172.21.15.37:0/1979939440 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:18.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.059+0000 7f7db939c700 1 -- 172.21.15.37:0/1979939440 >> v2:172.21.15.98:3300/0 conn(0x7f7db40b54b0 msgr2=0x7f7db40cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:18.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.059+0000 7f7db939c700 1 --2- 172.21.15.37:0/1979939440 >> v2:172.21.15.98:3300/0 conn(0x7f7db40b54b0 0x7f7db40cfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:18.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.059+0000 7f7db939c700 1 -- 172.21.15.37:0/1979939440 >> v1:172.21.15.98:6789/0 conn(0x7f7db40b85f0 legacy=0x7f7db415d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:18.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.059+0000 7f7db939c700 1 -- 172.21.15.37:0/1979939440 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db40cf0a0 con 0x7f7db40b4910 2023-07-14T15:57:18.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.059+0000 7f7db3fff700 1 --2- 172.21.15.37:0/1979939440 >> v2:172.21.15.98:3300/0 conn(0x7f7db40b54b0 0x7f7db40cfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:57:18.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.059+0000 7f7db37fe700 1 -- 172.21.15.37:0/1979939440 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 193330063 0 0) 0x7f7db40b52b0 con 0x7f7db40b85f0 2023-07-14T15:57:18.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.059+0000 7f7db939c700 1 --2- 172.21.15.37:0/1979939440 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7db40b4910 0x7f7db40b4d70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7dac009d90 tx=0x7f7dac00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e8abd685308a148 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:18.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.060+0000 7f7db37fe700 1 -- 172.21.15.37:0/1979939440 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dac00e070 con 0x7f7db40b4910 2023-07-14T15:57:18.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.060+0000 7f7db37fe700 1 -- 172.21.15.37:0/1979939440 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dac00bb20 con 0x7f7db40b4910 2023-07-14T15:57:18.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.060+0000 7f7db37fe700 1 -- 172.21.15.37:0/1979939440 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dac012430 con 0x7f7db40b4910 2023-07-14T15:57:18.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.060+0000 7f7dbadff700 1 -- 172.21.15.37:0/1979939440 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7db40b4910 msgr2=0x7f7db40b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:18.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.060+0000 7f7dbadff700 1 --2- 172.21.15.37:0/1979939440 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7db40b4910 0x7f7db40b4d70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7dac009d90 tx=0x7f7dac00b330 comp rx=0 tx=0).stop 2023-07-14T15:57:18.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.060+0000 7f7dbadff700 1 -- 172.21.15.37:0/1979939440 shutdown_connections 2023-07-14T15:57:18.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.060+0000 7f7dbadff700 1 --2- 172.21.15.37:0/1979939440 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7db40b4910 0x7f7db40b4d70 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:18.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.060+0000 7f7dbadff700 1 --2- 172.21.15.37:0/1979939440 >> v2:172.21.15.98:3300/0 conn(0x7f7db40b54b0 0x7f7db40cfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:18.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.060+0000 7f7dbadff700 1 -- 172.21.15.37:0/1979939440 >> 172.21.15.37:0/1979939440 conn(0x7f7db406a580 msgr2=0x7f7db406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:18.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.060+0000 7f7dbadff700 1 -- 172.21.15.37:0/1979939440 shutdown_connections 2023-07-14T15:57:18.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.060+0000 7f7dbadff700 1 -- 172.21.15.37:0/1979939440 wait complete. 2023-07-14T15:57:18.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.062+0000 7f7dbadff700 1 Processor -- start 2023-07-14T15:57:18.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.062+0000 7f7dbadff700 1 -- start start 2023-07-14T15:57:18.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.063+0000 7f7dbadff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7db40b4910 0x7f7db41554e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:18.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.063+0000 7f7dbadff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7db40b54b0 0x7f7db41f2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:18.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.063+0000 7f7dbadff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7db40b85f0 0x7f7db415e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:18.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.063+0000 7f7dbadff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db41f2ca0 con 0x7f7db40b54b0 2023-07-14T15:57:18.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.063+0000 7f7dbadff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db40cba20 con 0x7f7db40b85f0 2023-07-14T15:57:18.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.063+0000 7f7dbadff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7db41f5870 con 0x7f7db40b4910 2023-07-14T15:57:18.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.063+0000 7f7db3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7db40b54b0 0x7f7db41f2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:18.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.063+0000 7f7db3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7db40b54b0 0x7f7db41f2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60322/0 (socket says 172.21.15.37:60322) 2023-07-14T15:57:18.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.063+0000 7f7db3fff700 1 -- 172.21.15.37:0/2574009136 learned_addr learned my addr 172.21.15.37:0/2574009136 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:18.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.064+0000 7f7db939c700 1 --2- 172.21.15.37:0/2574009136 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7db40b85f0 0x7f7db415e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:18.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.064+0000 7f7db8b9b700 1 --2- 172.21.15.37:0/2574009136 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7db40b4910 0x7f7db41554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:18.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.064+0000 7f7db3fff700 1 -- 172.21.15.37:0/2574009136 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7db40b4910 msgr2=0x7f7db41554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:18.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.064+0000 7f7db3fff700 1 --2- 172.21.15.37:0/2574009136 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7db40b4910 0x7f7db41554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:18.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.064+0000 7f7db3fff700 1 -- 172.21.15.37:0/2574009136 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7db40b85f0 msgr2=0x7f7db415e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:18.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.064+0000 7f7db3fff700 1 --2- 172.21.15.37:0/2574009136 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7db40b85f0 0x7f7db415e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:18.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.064+0000 7f7db3fff700 1 -- 172.21.15.37:0/2574009136 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da0009550 con 0x7f7db40b54b0 2023-07-14T15:57:18.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.064+0000 7f7db3fff700 1 --2- 172.21.15.37:0/2574009136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7db40b54b0 0x7f7db41f2760 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7da000ebe0 tx=0x7f7da000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:18.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.064+0000 7f7db17fa700 1 -- 172.21.15.37:0/2574009136 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da000c850 con 0x7f7db40b54b0 2023-07-14T15:57:18.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.064+0000 7f7db17fa700 1 -- 172.21.15.37:0/2574009136 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7da000c9b0 con 0x7f7db40b54b0 2023-07-14T15:57:18.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.064+0000 7f7dbadff700 1 -- 172.21.15.37:0/2574009136 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dac009a70 con 0x7f7db40b54b0 2023-07-14T15:57:18.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.064+0000 7f7db17fa700 1 -- 172.21.15.37:0/2574009136 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da000cd40 con 0x7f7db40b54b0 2023-07-14T15:57:18.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.065+0000 7f7dbadff700 1 -- 172.21.15.37:0/2574009136 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7db41f5e30 con 0x7f7db40b54b0 2023-07-14T15:57:18.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.066+0000 7f7dbadff700 1 -- 172.21.15.37:0/2574009136 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7db4067840 con 0x7f7db40b54b0 2023-07-14T15:57:18.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.067+0000 7f7db17fa700 1 -- 172.21.15.37:0/2574009136 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7da0013470 con 0x7f7db40b54b0 2023-07-14T15:57:18.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.068+0000 7f7db17fa700 1 --2- 172.21.15.37:0/2574009136 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f7d9806ace0 0x7f7d9806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:18.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.068+0000 7f7db17fa700 1 -- 172.21.15.37:0/2574009136 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7da00891d0 con 0x7f7db40b54b0 2023-07-14T15:57:18.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.068+0000 7f7db8b9b700 1 --2- 172.21.15.37:0/2574009136 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f7d9806ace0 0x7f7d9806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:18.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.069+0000 7f7db8b9b700 1 --2- 172.21.15.37:0/2574009136 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f7d9806ace0 0x7f7d9806d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7da8000f60 tx=0x7f7da8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:18.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.072+0000 7f7db17fa700 1 -- 172.21.15.37:0/2574009136 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7da0054660 con 0x7f7db40b54b0 2023-07-14T15:57:18.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.361+0000 7f7dbadff700 1 -- 172.21.15.37:0/2574009136 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f7db40c9c70 con 0x7f7db40b54b0 2023-07-14T15:57:18.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.361+0000 7f7db17fa700 1 -- 172.21.15.37:0/2574009136 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f7da0057c80 con 0x7f7db40b54b0 2023-07-14T15:57:18.347 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:57:18.347 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-14T15:57:18.348 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_dump": [ 2023-07-14T15:57:18.348 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:57:18.348 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.a", 2023-07-14T15:57:18.348 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDVb7FkSxzFNhAAhrnBBg5xGqPBvvevPq4vZA==", 2023-07-14T15:57:18.348 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-14T15:57:18.348 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-14T15:57:18.348 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-14T15:57:18.349 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-14T15:57:18.349 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-14T15:57:18.349 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:57:18.349 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-14T15:57:18.349 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:57:18.349 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.b", 2023-07-14T15:57:18.349 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDWb7FkZalZExAAqIzmfWzer/rftvB+irYM5w==", 2023-07-14T15:57:18.349 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-14T15:57:18.350 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-14T15:57:18.350 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-14T15:57:18.350 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-14T15:57:18.350 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-14T15:57:18.350 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:57:18.350 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-14T15:57:18.350 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:57:18.350 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.c", 2023-07-14T15:57:18.351 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDWb7FkbJCQBxAAO/cHg6ZdojgzYGv21flqgQ==", 2023-07-14T15:57:18.351 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-14T15:57:18.351 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-14T15:57:18.351 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-14T15:57:18.351 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-14T15:57:18.351 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-14T15:57:18.351 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:57:18.352 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-14T15:57:18.352 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:57:18.352 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.d", 2023-07-14T15:57:18.353 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDWb7FkxQ7WHhAAeMQ+8/ypEagYuBalxTGYew==", 2023-07-14T15:57:18.353 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-14T15:57:18.353 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-14T15:57:18.353 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-14T15:57:18.353 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-14T15:57:18.353 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-14T15:57:18.353 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:57:18.353 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-14T15:57:18.354 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:57:18.354 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.0", 2023-07-14T15:57:18.354 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDab7FkNzKhIBAAen9vSEkCJn7EoBVXNfnboA==", 2023-07-14T15:57:18.354 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-14T15:57:18.355 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-14T15:57:18.355 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-14T15:57:18.355 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-14T15:57:18.355 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:57:18.355 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-14T15:57:18.355 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:57:18.355 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.1", 2023-07-14T15:57:18.356 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDdb7FkTRmBNhAA15XBAQ7LMuahPxyg3bzAQA==", 2023-07-14T15:57:18.356 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-14T15:57:18.356 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-14T15:57:18.356 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-14T15:57:18.356 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-14T15:57:18.356 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:57:18.356 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-14T15:57:18.357 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:57:18.357 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.2", 2023-07-14T15:57:18.357 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDhb7FkLa6hARAAj31Jgen/BeAnuRrGAbQAmw==", 2023-07-14T15:57:18.357 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-14T15:57:18.357 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-14T15:57:18.357 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-14T15:57:18.357 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-14T15:57:18.358 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:57:18.358 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-14T15:57:18.358 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:57:18.358 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.3", 2023-07-14T15:57:18.358 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDkb7FkenwSCRAAW0MIsfBqfycPzHB6Pdwl6w==", 2023-07-14T15:57:18.358 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-14T15:57:18.359 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-14T15:57:18.359 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-14T15:57:18.359 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-14T15:57:18.359 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:57:18.359 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-14T15:57:18.359 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:57:18.359 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.4", 2023-07-14T15:57:18.360 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDqb7FkjSHhJBAAR61S7ufnwHSiG5gPeEt9mQ==", 2023-07-14T15:57:18.360 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-14T15:57:18.360 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-14T15:57:18.360 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-14T15:57:18.361 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-14T15:57:18.361 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:57:18.361 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-14T15:57:18.361 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:57:18.362 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.5", 2023-07-14T15:57:18.362 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDtb7Fke+lwKBAAry9Kdgwm+H6t2DdcOJ3g4w==", 2023-07-14T15:57:18.362 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-14T15:57:18.362 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-14T15:57:18.363 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-14T15:57:18.363 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-14T15:57:18.363 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:57:18.363 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-14T15:57:18.364 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:57:18.364 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.6", 2023-07-14T15:57:18.364 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDwb7FkJDxaKxAAZvh6zl1Yl1+r6Cp4jvpL/w==", 2023-07-14T15:57:18.365 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-14T15:57:18.365 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-14T15:57:18.365 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-14T15:57:18.365 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-14T15:57:18.366 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:57:18.366 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-14T15:57:18.366 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:57:18.366 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.7", 2023-07-14T15:57:18.367 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDzb7FkY3CbLhAAZ2N8iigUMGTFAXYIcWLk7g==", 2023-07-14T15:57:18.367 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-14T15:57:18.367 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-14T15:57:18.367 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-14T15:57:18.368 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-14T15:57:18.368 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:57:18.368 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-14T15:57:18.368 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:57:18.369 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.0", 2023-07-14T15:57:18.369 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDWb7Fk8l4jKRAAD40aK9YW0bgBjt3LF5EM2Q==", 2023-07-14T15:57:18.369 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-14T15:57:18.369 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-14T15:57:18.370 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-07-14T15:57:18.370 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-07-14T15:57:18.370 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-07-14T15:57:18.370 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:57:18.371 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-14T15:57:18.371 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:57:18.371 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.1", 2023-07-14T15:57:18.372 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDWb7FkGMrgOBAA5c0LB2Z158/t57ZiKLSM/A==", 2023-07-14T15:57:18.372 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-14T15:57:18.372 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-14T15:57:18.372 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-07-14T15:57:18.373 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-07-14T15:57:18.373 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-07-14T15:57:18.373 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:57:18.373 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-14T15:57:18.374 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:57:18.374 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.2", 2023-07-14T15:57:18.374 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDWb7FktFUuMRAA3DeSj/TCt1iOd1L5LjlLNA==", 2023-07-14T15:57:18.374 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-14T15:57:18.375 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-14T15:57:18.375 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-07-14T15:57:18.375 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-07-14T15:57:18.375 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-07-14T15:57:18.376 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:57:18.376 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-14T15:57:18.376 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:57:18.376 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.3", 2023-07-14T15:57:18.377 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDXb7FkmG/QBBAA8xqYve+K8TfT94oNGgVcuA==", 2023-07-14T15:57:18.377 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-14T15:57:18.377 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-14T15:57:18.378 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-07-14T15:57:18.378 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-07-14T15:57:18.378 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-07-14T15:57:18.378 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:57:18.379 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-14T15:57:18.379 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:57:18.379 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.admin", 2023-07-14T15:57:18.379 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDUb7FkahD2ORAAoGbK+5qqIEgbFF44lku8nA==", 2023-07-14T15:57:18.380 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-14T15:57:18.380 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-07-14T15:57:18.380 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-14T15:57:18.380 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-14T15:57:18.381 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-14T15:57:18.381 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:57:18.381 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-14T15:57:18.382 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:57:18.382 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-mds", 2023-07-14T15:57:18.382 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQD7b7FkPjabNRAA2F3OIKcKVj+/VuASVkqejQ==", 2023-07-14T15:57:18.382 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-14T15:57:18.383 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-mds" 2023-07-14T15:57:18.383 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:57:18.383 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-14T15:57:18.383 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:57:18.384 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-mgr", 2023-07-14T15:57:18.384 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQD7b7FkJkGbNRAAU4KQKi3DFvlf5cjMzV5oJA==", 2023-07-14T15:57:18.384 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-14T15:57:18.384 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-mgr" 2023-07-14T15:57:18.385 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:57:18.385 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-14T15:57:18.385 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:57:18.385 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-osd", 2023-07-14T15:57:18.385 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQD7b7Fk50ubNRAA3/piwAzzPo91JgPdfg2Qmg==", 2023-07-14T15:57:18.386 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-14T15:57:18.386 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-osd" 2023-07-14T15:57:18.386 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:57:18.386 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-14T15:57:18.386 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:57:18.386 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-rbd", 2023-07-14T15:57:18.386 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQD7b7FkWlSbNRAAhDG6QvyBdU1TuooeJwQX2w==", 2023-07-14T15:57:18.387 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-14T15:57:18.387 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-rbd" 2023-07-14T15:57:18.387 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:57:18.387 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-14T15:57:18.387 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:57:18.387 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-07-14T15:57:18.388 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQD7b7FkHF2bNRAARcP8fwfyf+pLxnoitq86Ug==", 2023-07-14T15:57:18.388 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-14T15:57:18.388 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-07-14T15:57:18.388 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:57:18.388 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-14T15:57:18.389 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:57:18.389 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-rgw", 2023-07-14T15:57:18.389 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQD7b7Fkt2WbNRAA+jZqxyzs4WhNjizGnj1ipQ==", 2023-07-14T15:57:18.389 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-14T15:57:18.389 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-rgw" 2023-07-14T15:57:18.389 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:57:18.389 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-14T15:57:18.390 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:57:18.390 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.x", 2023-07-14T15:57:18.390 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDVb7FkfzV7LhAAg+oMjrhI7XaOhlYDUSa9ug==", 2023-07-14T15:57:18.390 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-14T15:57:18.390 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-07-14T15:57:18.390 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-07-14T15:57:18.391 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-14T15:57:18.391 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:57:18.391 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-14T15:57:18.391 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:57:18.391 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.y", 2023-07-14T15:57:18.391 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDVb7FkCOFSJhAAyIE5jprQPjAID/yxt6h/hw==", 2023-07-14T15:57:18.391 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-14T15:57:18.392 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-07-14T15:57:18.392 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-07-14T15:57:18.392 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-14T15:57:18.392 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:57:18.393 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:57:18.393 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-07-14T15:57:18.393 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-14T15:57:18.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.363+0000 7f7dbadff700 1 -- 172.21.15.37:0/2574009136 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f7d9806ace0 msgr2=0x7f7d9806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:18.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.363+0000 7f7dbadff700 1 --2- 172.21.15.37:0/2574009136 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f7d9806ace0 0x7f7d9806d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7da8000f60 tx=0x7f7da8009040 comp rx=0 tx=0).stop 2023-07-14T15:57:18.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.363+0000 7f7dbadff700 1 -- 172.21.15.37:0/2574009136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7db40b54b0 msgr2=0x7f7db41f2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:18.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.363+0000 7f7dbadff700 1 --2- 172.21.15.37:0/2574009136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7db40b54b0 0x7f7db41f2760 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7da000ebe0 tx=0x7f7da000eef0 comp rx=0 tx=0).stop 2023-07-14T15:57:18.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.363+0000 7f7dbadff700 1 -- 172.21.15.37:0/2574009136 shutdown_connections 2023-07-14T15:57:18.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.363+0000 7f7dbadff700 1 --2- 172.21.15.37:0/2574009136 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7db40b85f0 0x7f7db415e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:18.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.363+0000 7f7dbadff700 1 --2- 172.21.15.37:0/2574009136 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f7d9806ace0 0x7f7d9806d190 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:18.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.363+0000 7f7dbadff700 1 --2- 172.21.15.37:0/2574009136 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7db40b4910 0x7f7db41554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:18.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.363+0000 7f7dbadff700 1 --2- 172.21.15.37:0/2574009136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7db40b54b0 0x7f7db41f2760 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:18.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.363+0000 7f7dbadff700 1 -- 172.21.15.37:0/2574009136 >> 172.21.15.37:0/2574009136 conn(0x7f7db406a580 msgr2=0x7f7db40d2e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:18.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.363+0000 7f7dbadff700 1 -- 172.21.15.37:0/2574009136 shutdown_connections 2023-07-14T15:57:18.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.364+0000 7f7dbadff700 1 -- 172.21.15.37:0/2574009136 wait complete. 2023-07-14T15:57:18.396 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-07-14T15:57:18.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.613+0000 7f405adff700 1 Processor -- start 2023-07-14T15:57:18.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.613+0000 7f405adff700 1 -- start start 2023-07-14T15:57:18.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.614+0000 7f405adff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f40540b25e0 0x7f40540b0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:18.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.614+0000 7f405adff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f40540b2090 0x7f40540b0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:18.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.614+0000 7f405adff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40540b4600 con 0x7f40540b12f0 2023-07-14T15:57:18.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.614+0000 7f405adff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40540afab0 con 0x7f40540b25e0 2023-07-14T15:57:18.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.614+0000 7f405adff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40540afd90 con 0x7f40540b2090 2023-07-14T15:57:18.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.615+0000 7f4058b9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f40540b25e0 0x7f40540b0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:18.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.615+0000 7f4058b9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f40540b25e0 0x7f40540b0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60326/0 (socket says 172.21.15.37:60326) 2023-07-14T15:57:18.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.615+0000 7f4058b9b700 1 -- 172.21.15.37:0/3745741691 learned_addr learned my addr 172.21.15.37:0/3745741691 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:18.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.615+0000 7f405939c700 1 --1- 172.21.15.37:0/3745741691 >> v1:172.21.15.37:6789/0 conn(0x7f40540b12f0 0x7f40540b29b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46360/0 (socket says 172.21.15.37:46360) 2023-07-14T15:57:18.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.615+0000 7f4053fff700 1 --2- 172.21.15.37:0/3745741691 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f40540b2090 0x7f40540b0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:18.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.615+0000 7f4058b9b700 1 -- 172.21.15.37:0/3745741691 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f40540b2090 msgr2=0x7f40540b0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:18.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.615+0000 7f4058b9b700 1 --2- 172.21.15.37:0/3745741691 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f40540b2090 0x7f40540b0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:18.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.615+0000 7f4058b9b700 1 -- 172.21.15.37:0/3745741691 >> v1:172.21.15.37:6789/0 conn(0x7f40540b12f0 legacy=0x7f40540b29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:18.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.615+0000 7f4058b9b700 1 -- 172.21.15.37:0/3745741691 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40540b0070 con 0x7f40540b25e0 2023-07-14T15:57:18.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.615+0000 7f40537fe700 1 -- 172.21.15.37:0/3745741691 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2614573547 0 0) 0x7f40540b4600 con 0x7f40540b12f0 2023-07-14T15:57:18.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.615+0000 7f4058b9b700 1 --2- 172.21.15.37:0/3745741691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40540b25e0 0x7f40540b0870 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f40480098f0 tx=0x7f4048009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=297d40439617cbde server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:18.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.616+0000 7f40537fe700 1 -- 172.21.15.37:0/3745741691 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404800b8a0 con 0x7f40540b25e0 2023-07-14T15:57:18.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.616+0000 7f40537fe700 1 -- 172.21.15.37:0/3745741691 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f404800ba00 con 0x7f40540b25e0 2023-07-14T15:57:18.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.616+0000 7f40537fe700 1 -- 172.21.15.37:0/3745741691 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404800bd90 con 0x7f40540b25e0 2023-07-14T15:57:18.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.616+0000 7f405adff700 1 -- 172.21.15.37:0/3745741691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40540b25e0 msgr2=0x7f40540b0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:18.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.616+0000 7f405adff700 1 --2- 172.21.15.37:0/3745741691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40540b25e0 0x7f40540b0870 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f40480098f0 tx=0x7f4048009c00 comp rx=0 tx=0).stop 2023-07-14T15:57:18.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.616+0000 7f405adff700 1 -- 172.21.15.37:0/3745741691 shutdown_connections 2023-07-14T15:57:18.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.616+0000 7f405adff700 1 --2- 172.21.15.37:0/3745741691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40540b25e0 0x7f40540b0870 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:18.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.616+0000 7f405adff700 1 --2- 172.21.15.37:0/3745741691 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f40540b2090 0x7f40540b0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:18.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.616+0000 7f405adff700 1 -- 172.21.15.37:0/3745741691 >> 172.21.15.37:0/3745741691 conn(0x7f405409c150 msgr2=0x7f40540d2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:18.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.616+0000 7f405adff700 1 -- 172.21.15.37:0/3745741691 shutdown_connections 2023-07-14T15:57:18.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.616+0000 7f405adff700 1 -- 172.21.15.37:0/3745741691 wait complete. 2023-07-14T15:57:18.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.618+0000 7f405adff700 1 Processor -- start 2023-07-14T15:57:18.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.618+0000 7f405adff700 1 -- start start 2023-07-14T15:57:18.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.619+0000 7f405adff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f40540b12f0 0x7f40541583f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:18.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.619+0000 7f405adff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40540b2090 0x7f40540b7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:18.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.619+0000 7f405adff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40540b25e0 0x7f40541e6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:18.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.619+0000 7f405adff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4054158930 con 0x7f40540b2090 2023-07-14T15:57:18.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.619+0000 7f405adff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40540b8ab0 con 0x7f40540b25e0 2023-07-14T15:57:18.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.619+0000 7f405adff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4054158fd0 con 0x7f40540b12f0 2023-07-14T15:57:18.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.620+0000 7f4053fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40540b2090 0x7f40540b7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:18.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.620+0000 7f4053fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40540b2090 0x7f40540b7ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60334/0 (socket says 172.21.15.37:60334) 2023-07-14T15:57:18.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.620+0000 7f4053fff700 1 -- 172.21.15.37:0/472789413 learned_addr learned my addr 172.21.15.37:0/472789413 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:18.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.620+0000 7f405939c700 1 --2- 172.21.15.37:0/472789413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40540b25e0 0x7f40541e6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:18.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.620+0000 7f4058b9b700 1 --2- 172.21.15.37:0/472789413 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f40540b12f0 0x7f40541583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:18.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.620+0000 7f4053fff700 1 -- 172.21.15.37:0/472789413 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f40540b12f0 msgr2=0x7f40541583f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:18.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.620+0000 7f4053fff700 1 --2- 172.21.15.37:0/472789413 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f40540b12f0 0x7f40541583f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:18.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.620+0000 7f4053fff700 1 -- 172.21.15.37:0/472789413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40540b25e0 msgr2=0x7f40541e6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:18.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.620+0000 7f4053fff700 1 --2- 172.21.15.37:0/472789413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40540b25e0 0x7f40541e6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:18.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.620+0000 7f4053fff700 1 -- 172.21.15.37:0/472789413 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4048009550 con 0x7f40540b2090 2023-07-14T15:57:18.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.620+0000 7f405939c700 1 --2- 172.21.15.37:0/472789413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40540b25e0 0x7f40541e6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:57:18.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.620+0000 7f4053fff700 1 --2- 172.21.15.37:0/472789413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40540b2090 0x7f40540b7ca0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f404000e840 tx=0x7f404000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:18.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.620+0000 7f40517fa700 1 -- 172.21.15.37:0/472789413 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4040013610 con 0x7f40540b2090 2023-07-14T15:57:18.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.620+0000 7f40517fa700 1 -- 172.21.15.37:0/472789413 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4040013770 con 0x7f40540b2090 2023-07-14T15:57:18.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.620+0000 7f40517fa700 1 -- 172.21.15.37:0/472789413 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4040013b20 con 0x7f40540b2090 2023-07-14T15:57:18.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.620+0000 7f405adff700 1 -- 172.21.15.37:0/472789413 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40540b84f0 con 0x7f40540b2090 2023-07-14T15:57:18.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.621+0000 7f405adff700 1 -- 172.21.15.37:0/472789413 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4054158c60 con 0x7f40540b2090 2023-07-14T15:57:18.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.622+0000 7f405adff700 1 -- 172.21.15.37:0/472789413 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4054158ac0 con 0x7f40540b2090 2023-07-14T15:57:18.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.623+0000 7f40517fa700 1 -- 172.21.15.37:0/472789413 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4040013c80 con 0x7f40540b2090 2023-07-14T15:57:18.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.624+0000 7f40517fa700 1 --2- 172.21.15.37:0/472789413 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f403806ace0 0x7f403806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:18.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.625+0000 7f40517fa700 1 -- 172.21.15.37:0/472789413 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4040088ec0 con 0x7f40540b2090 2023-07-14T15:57:18.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.625+0000 7f4058b9b700 1 --2- 172.21.15.37:0/472789413 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f403806ace0 0x7f403806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:18.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.626+0000 7f4058b9b700 1 --2- 172.21.15.37:0/472789413 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f403806ace0 0x7f403806d190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4048014040 tx=0x7f4048008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:18.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.628+0000 7f40517fa700 1 -- 172.21.15.37:0/472789413 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4054158ac0 con 0x7f40540b2090 2023-07-14T15:57:18.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.922+0000 7f405adff700 1 -- 172.21.15.37:0/472789413 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f4054158ac0 con 0x7f40540b2090 2023-07-14T15:57:18.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.926+0000 7f40517fa700 1 -- 172.21.15.37:0/472789413 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f4054158ac0 con 0x7f40540b2090 2023-07-14T15:57:18.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.928+0000 7f405adff700 1 -- 172.21.15.37:0/472789413 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f403806ace0 msgr2=0x7f403806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:18.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.928+0000 7f405adff700 1 --2- 172.21.15.37:0/472789413 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f403806ace0 0x7f403806d190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4048014040 tx=0x7f4048008030 comp rx=0 tx=0).stop 2023-07-14T15:57:18.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.928+0000 7f405adff700 1 -- 172.21.15.37:0/472789413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40540b2090 msgr2=0x7f40540b7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:18.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.928+0000 7f405adff700 1 --2- 172.21.15.37:0/472789413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40540b2090 0x7f40540b7ca0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f404000e840 tx=0x7f404000ec00 comp rx=0 tx=0).stop 2023-07-14T15:57:18.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.928+0000 7f405adff700 1 -- 172.21.15.37:0/472789413 shutdown_connections 2023-07-14T15:57:18.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.928+0000 7f405adff700 1 --2- 172.21.15.37:0/472789413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40540b25e0 0x7f40541e6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:18.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.928+0000 7f405adff700 1 --2- 172.21.15.37:0/472789413 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f403806ace0 0x7f403806d190 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:18.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.928+0000 7f405adff700 1 --2- 172.21.15.37:0/472789413 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f40540b12f0 0x7f40541583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:18.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.928+0000 7f405adff700 1 --2- 172.21.15.37:0/472789413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40540b2090 0x7f40540b7ca0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:18.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.928+0000 7f405adff700 1 -- 172.21.15.37:0/472789413 >> 172.21.15.37:0/472789413 conn(0x7f405409c150 msgr2=0x7f405406b600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:18.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.929+0000 7f405adff700 1 -- 172.21.15.37:0/472789413 shutdown_connections 2023-07-14T15:57:18.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:18.929+0000 7f405adff700 1 -- 172.21.15.37:0/472789413 wait complete. 2023-07-14T15:57:18.932 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-07-14T15:57:19.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.149+0000 7f7dc65ff700 1 Processor -- start 2023-07-14T15:57:19.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.149+0000 7f7dc65ff700 1 -- start start 2023-07-14T15:57:19.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.150+0000 7f7dc65ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7dc00c9830 0x7f7dc00cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:19.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.150+0000 7f7dc65ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dc01598c0 con 0x7f7dc00cda10 2023-07-14T15:57:19.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.150+0000 7f7dc65ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dc015dec0 con 0x7f7dc00adfe0 2023-07-14T15:57:19.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.150+0000 7f7dc65ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dc00ccc50 con 0x7f7dc00c9830 2023-07-14T15:57:19.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.151+0000 7f7dbf7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7dc00c9830 0x7f7dc00cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:19.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.151+0000 7f7dbf7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7dc00c9830 0x7f7dc00cb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60344/0 (socket says 172.21.15.37:60344) 2023-07-14T15:57:19.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.151+0000 7f7dbf7fe700 1 -- 172.21.15.37:0/3989495468 learned_addr learned my addr 172.21.15.37:0/3989495468 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:19.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.151+0000 7f7dc4b9c700 1 --1- 172.21.15.37:0/3989495468 >> v1:172.21.15.37:6789/0 conn(0x7f7dc00cda10 0x7f7dc006f7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46362/0 (socket says 172.21.15.37:46362) 2023-07-14T15:57:19.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.151+0000 7f7dbf7fe700 1 -- 172.21.15.37:0/3989495468 >> v1:172.21.15.98:6789/0 conn(0x7f7dc00adfe0 legacy=0x7f7dc00c9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:19.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.151+0000 7f7dbf7fe700 1 -- 172.21.15.37:0/3989495468 >> v1:172.21.15.37:6789/0 conn(0x7f7dc00cda10 legacy=0x7f7dc006f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:19.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.151+0000 7f7dbf7fe700 1 -- 172.21.15.37:0/3989495468 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc00ccf30 con 0x7f7dc00c9830 2023-07-14T15:57:19.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.151+0000 7f7dbf7fe700 1 --2- 172.21.15.37:0/3989495468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7dc00c9830 0x7f7dc00cb4e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7db40098f0 tx=0x7f7db4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=991bef660d96ce14 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:19.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.152+0000 7f7dbeffd700 1 -- 172.21.15.37:0/3989495468 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db400b8a0 con 0x7f7dc00c9830 2023-07-14T15:57:19.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.152+0000 7f7dbeffd700 1 -- 172.21.15.37:0/3989495468 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db400ba00 con 0x7f7dc00c9830 2023-07-14T15:57:19.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.152+0000 7f7dbeffd700 1 -- 172.21.15.37:0/3989495468 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db400bd90 con 0x7f7dc00c9830 2023-07-14T15:57:19.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.152+0000 7f7dc65ff700 1 -- 172.21.15.37:0/3989495468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7dc00c9830 msgr2=0x7f7dc00cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:19.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.152+0000 7f7dc65ff700 1 --2- 172.21.15.37:0/3989495468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7dc00c9830 0x7f7dc00cb4e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7db40098f0 tx=0x7f7db4009c00 comp rx=0 tx=0).stop 2023-07-14T15:57:19.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.152+0000 7f7dc65ff700 1 -- 172.21.15.37:0/3989495468 shutdown_connections 2023-07-14T15:57:19.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.152+0000 7f7dc65ff700 1 --2- 172.21.15.37:0/3989495468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7dc00c9830 0x7f7dc00cb4e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:19.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.152+0000 7f7dc65ff700 1 -- 172.21.15.37:0/3989495468 >> 172.21.15.37:0/3989495468 conn(0x7f7dc00b0620 msgr2=0x7f7dc00b0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:19.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.152+0000 7f7dc65ff700 1 -- 172.21.15.37:0/3989495468 shutdown_connections 2023-07-14T15:57:19.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.152+0000 7f7dc65ff700 1 -- 172.21.15.37:0/3989495468 wait complete. 2023-07-14T15:57:19.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.154+0000 7f7dc65ff700 1 Processor -- start 2023-07-14T15:57:19.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.154+0000 7f7dc65ff700 1 -- start start 2023-07-14T15:57:19.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.155+0000 7f7dc65ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7dc00adfe0 0x7f7dc00b3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:19.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.155+0000 7f7dc65ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7dc00c9830 0x7f7dc0070e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:19.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.155+0000 7f7dc65ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7dc00cda10 0x7f7dc006f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:19.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.155+0000 7f7dc65ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc01f1ff0 con 0x7f7dc00cda10 2023-07-14T15:57:19.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.155+0000 7f7dc65ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc00b3dc0 con 0x7f7dc00c9830 2023-07-14T15:57:19.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.155+0000 7f7dc65ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc01f5a00 con 0x7f7dc00adfe0 2023-07-14T15:57:19.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.155+0000 7f7dc4b9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7dc00cda10 0x7f7dc006f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:19.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.155+0000 7f7dc4b9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7dc00cda10 0x7f7dc006f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60348/0 (socket says 172.21.15.37:60348) 2023-07-14T15:57:19.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.155+0000 7f7dc4b9c700 1 -- 172.21.15.37:0/487369065 learned_addr learned my addr 172.21.15.37:0/487369065 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:19.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.155+0000 7f7dbf7fe700 1 --2- 172.21.15.37:0/487369065 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7dc00c9830 0x7f7dc0070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:19.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.155+0000 7f7dbffff700 1 --2- 172.21.15.37:0/487369065 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7dc00adfe0 0x7f7dc00b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:19.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.156+0000 7f7dc4b9c700 1 -- 172.21.15.37:0/487369065 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7dc00adfe0 msgr2=0x7f7dc00b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:19.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.156+0000 7f7dc4b9c700 1 --2- 172.21.15.37:0/487369065 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7dc00adfe0 0x7f7dc00b3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:19.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.156+0000 7f7dc4b9c700 1 -- 172.21.15.37:0/487369065 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7dc00c9830 msgr2=0x7f7dc0070e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:19.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.156+0000 7f7dc4b9c700 1 --2- 172.21.15.37:0/487369065 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7dc00c9830 0x7f7dc0070e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:19.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.156+0000 7f7dc4b9c700 1 -- 172.21.15.37:0/487369065 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db4009550 con 0x7f7dc00cda10 2023-07-14T15:57:19.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.156+0000 7f7dbffff700 1 --2- 172.21.15.37:0/487369065 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7dc00adfe0 0x7f7dc00b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:57:19.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.156+0000 7f7dc4b9c700 1 --2- 172.21.15.37:0/487369065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7dc00cda10 0x7f7dc006f6c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7db800cbc0 tx=0x7f7db800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:19.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.156+0000 7f7dbcff9700 1 -- 172.21.15.37:0/487369065 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db800aaa0 con 0x7f7dc00cda10 2023-07-14T15:57:19.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.156+0000 7f7dbcff9700 1 -- 172.21.15.37:0/487369065 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db800ac00 con 0x7f7dc00cda10 2023-07-14T15:57:19.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.156+0000 7f7dc65ff700 1 -- 172.21.15.37:0/487369065 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dc01f5ce0 con 0x7f7dc00cda10 2023-07-14T15:57:19.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.156+0000 7f7dbcff9700 1 -- 172.21.15.37:0/487369065 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db8007070 con 0x7f7dc00cda10 2023-07-14T15:57:19.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.156+0000 7f7dc65ff700 1 -- 172.21.15.37:0/487369065 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dc01f62a0 con 0x7f7dc00cda10 2023-07-14T15:57:19.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.158+0000 7f7dc65ff700 1 -- 172.21.15.37:0/487369065 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dc01f2160 con 0x7f7dc00cda10 2023-07-14T15:57:19.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.158+0000 7f7dbcff9700 1 -- 172.21.15.37:0/487369065 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7db80071d0 con 0x7f7dc00cda10 2023-07-14T15:57:19.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.159+0000 7f7dbcff9700 1 --2- 172.21.15.37:0/487369065 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f7dac06ace0 0x7f7dac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:19.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.159+0000 7f7dbcff9700 1 -- 172.21.15.37:0/487369065 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7db8088c90 con 0x7f7dc00cda10 2023-07-14T15:57:19.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.160+0000 7f7dbffff700 1 --2- 172.21.15.37:0/487369065 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f7dac06ace0 0x7f7dac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:19.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.160+0000 7f7dbffff700 1 --2- 172.21.15.37:0/487369065 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f7dac06ace0 0x7f7dac06d190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7db0000f60 tx=0x7f7db0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:19.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.163+0000 7f7dbcff9700 1 -- 172.21.15.37:0/487369065 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7db80540a0 con 0x7f7dc00cda10 2023-07-14T15:57:19.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.458+0000 7f7dc65ff700 1 -- 172.21.15.37:0/487369065 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f7dc01598c0 con 0x7f7dc00cda10 2023-07-14T15:57:19.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.462+0000 7f7dbcff9700 1 -- 172.21.15.37:0/487369065 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7dc01598c0 con 0x7f7dc00cda10 2023-07-14T15:57:19.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.464+0000 7f7dc65ff700 1 -- 172.21.15.37:0/487369065 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f7dac06ace0 msgr2=0x7f7dac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:19.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.464+0000 7f7dc65ff700 1 --2- 172.21.15.37:0/487369065 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f7dac06ace0 0x7f7dac06d190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7db0000f60 tx=0x7f7db0009040 comp rx=0 tx=0).stop 2023-07-14T15:57:19.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.464+0000 7f7dc65ff700 1 -- 172.21.15.37:0/487369065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7dc00cda10 msgr2=0x7f7dc006f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:19.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.464+0000 7f7dc65ff700 1 --2- 172.21.15.37:0/487369065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7dc00cda10 0x7f7dc006f6c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7db800cbc0 tx=0x7f7db800ced0 comp rx=0 tx=0).stop 2023-07-14T15:57:19.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.465+0000 7f7dc65ff700 1 -- 172.21.15.37:0/487369065 shutdown_connections 2023-07-14T15:57:19.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.465+0000 7f7dc65ff700 1 --2- 172.21.15.37:0/487369065 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f7dac06ace0 0x7f7dac06d190 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:19.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.465+0000 7f7dc65ff700 1 --2- 172.21.15.37:0/487369065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7dc00cda10 0x7f7dc006f6c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:19.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.465+0000 7f7dc65ff700 1 --2- 172.21.15.37:0/487369065 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7dc00adfe0 0x7f7dc00b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:19.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.465+0000 7f7dc65ff700 1 --2- 172.21.15.37:0/487369065 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7dc00c9830 0x7f7dc0070e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:19.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.465+0000 7f7dc65ff700 1 -- 172.21.15.37:0/487369065 >> 172.21.15.37:0/487369065 conn(0x7f7dc00b0620 msgr2=0x7f7dc00ce1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:19.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.465+0000 7f7dc65ff700 1 -- 172.21.15.37:0/487369065 shutdown_connections 2023-07-14T15:57:19.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.465+0000 7f7dc65ff700 1 -- 172.21.15.37:0/487369065 wait complete. 2023-07-14T15:57:19.468 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-07-14T15:57:19.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.684+0000 7f739e5ff700 1 Processor -- start 2023-07-14T15:57:19.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.684+0000 7f739e5ff700 1 -- start start 2023-07-14T15:57:19.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.685+0000 7f739e5ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f73980d15c0 0x7f73980cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:19.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.685+0000 7f739e5ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73980cdb50 con 0x7f73980b8900 2023-07-14T15:57:19.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.685+0000 7f739e5ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73980cde30 con 0x7f73980b0ae0 2023-07-14T15:57:19.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.685+0000 7f739e5ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f739815d030 con 0x7f73980d15c0 2023-07-14T15:57:19.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.686+0000 7f7397fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f73980b8900 0x7f73980d0eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46366/0 (socket says 172.21.15.37:46366) 2023-07-14T15:57:19.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.686+0000 7f7397fff700 1 -- 172.21.15.37:0/1067159332 learned_addr learned my addr 172.21.15.37:0/1067159332 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:19.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.686+0000 7f73977fe700 1 --2- 172.21.15.37:0/1067159332 >> v2:172.21.15.98:3300/0 conn(0x7f73980d15c0 0x7f73980cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:19.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.686+0000 7f7396ffd700 1 -- 172.21.15.37:0/1067159332 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2620204944 0 0) 0x7f73980cdb50 con 0x7f73980b8900 2023-07-14T15:57:19.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.686+0000 7f7396ffd700 1 -- 172.21.15.37:0/1067159332 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73800035b0 con 0x7f73980b8900 2023-07-14T15:57:19.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.686+0000 7f73977fe700 1 -- 172.21.15.37:0/1067159332 >> v1:172.21.15.98:6789/0 conn(0x7f73980b0ae0 legacy=0x7f73980cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:19.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.686+0000 7f73977fe700 1 -- 172.21.15.37:0/1067159332 >> v1:172.21.15.37:6789/0 conn(0x7f73980b8900 legacy=0x7f73980d0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:19.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.686+0000 7f73977fe700 1 -- 172.21.15.37:0/1067159332 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73980ce110 con 0x7f73980d15c0 2023-07-14T15:57:19.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.687+0000 7f73977fe700 1 --2- 172.21.15.37:0/1067159332 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73980d15c0 0x7f73980cd570 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f738c009840 tx=0x7f738c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcc2af9eb027efc6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:19.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.687+0000 7f7396ffd700 1 -- 172.21.15.37:0/1067159332 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738c011830 con 0x7f73980d15c0 2023-07-14T15:57:19.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.687+0000 7f7396ffd700 1 -- 172.21.15.37:0/1067159332 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f738c011990 con 0x7f73980d15c0 2023-07-14T15:57:19.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.687+0000 7f7396ffd700 1 -- 172.21.15.37:0/1067159332 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738c011d20 con 0x7f73980d15c0 2023-07-14T15:57:19.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.687+0000 7f739e5ff700 1 -- 172.21.15.37:0/1067159332 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73980d15c0 msgr2=0x7f73980cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:19.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.687+0000 7f739e5ff700 1 --2- 172.21.15.37:0/1067159332 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73980d15c0 0x7f73980cd570 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f738c009840 tx=0x7f738c009b50 comp rx=0 tx=0).stop 2023-07-14T15:57:19.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.688+0000 7f739e5ff700 1 -- 172.21.15.37:0/1067159332 shutdown_connections 2023-07-14T15:57:19.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.688+0000 7f739e5ff700 1 --2- 172.21.15.37:0/1067159332 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73980d15c0 0x7f73980cd570 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:19.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.688+0000 7f739e5ff700 1 -- 172.21.15.37:0/1067159332 >> 172.21.15.37:0/1067159332 conn(0x7f739809c1e0 msgr2=0x7f73980d2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:19.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.688+0000 7f739e5ff700 1 -- 172.21.15.37:0/1067159332 shutdown_connections 2023-07-14T15:57:19.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.688+0000 7f739e5ff700 1 -- 172.21.15.37:0/1067159332 wait complete. 2023-07-14T15:57:19.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.689+0000 7f739e5ff700 1 Processor -- start 2023-07-14T15:57:19.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.689+0000 7f739e5ff700 1 -- start start 2023-07-14T15:57:19.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.690+0000 7f739e5ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73980b0ae0 0x7f73981f1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:19.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.690+0000 7f739e5ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f73980b8900 0x7f73980cc890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:19.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.690+0000 7f739e5ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73980d15c0 0x7f73980cf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:19.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.690+0000 7f739e5ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73981f2060 con 0x7f73980d15c0 2023-07-14T15:57:19.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.690+0000 7f739e5ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73980cb400 con 0x7f73980b0ae0 2023-07-14T15:57:19.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.690+0000 7f739e5ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73980b45a0 con 0x7f73980b8900 2023-07-14T15:57:19.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.691+0000 7f739cb9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73980d15c0 0x7f73980cf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:19.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.691+0000 7f739cb9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73980d15c0 0x7f73980cf2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60352/0 (socket says 172.21.15.37:60352) 2023-07-14T15:57:19.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.691+0000 7f739cb9c700 1 -- 172.21.15.37:0/2814968652 learned_addr learned my addr 172.21.15.37:0/2814968652 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:19.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.691+0000 7f7397fff700 1 --2- 172.21.15.37:0/2814968652 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73980b0ae0 0x7f73981f1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:19.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.691+0000 7f73977fe700 1 --2- 172.21.15.37:0/2814968652 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f73980b8900 0x7f73980cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:19.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.691+0000 7f739cb9c700 1 -- 172.21.15.37:0/2814968652 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f73980b8900 msgr2=0x7f73980cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:19.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.691+0000 7f739cb9c700 1 --2- 172.21.15.37:0/2814968652 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f73980b8900 0x7f73980cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:19.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.691+0000 7f739cb9c700 1 -- 172.21.15.37:0/2814968652 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73980b0ae0 msgr2=0x7f73981f1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:19.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.691+0000 7f739cb9c700 1 --2- 172.21.15.37:0/2814968652 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73980b0ae0 0x7f73981f1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:19.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.691+0000 7f739cb9c700 1 -- 172.21.15.37:0/2814968652 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f738c0094a0 con 0x7f73980d15c0 2023-07-14T15:57:19.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.691+0000 7f739cb9c700 1 --2- 172.21.15.37:0/2814968652 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73980d15c0 0x7f73980cf2c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f739000cc50 tx=0x7f739000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:19.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.692+0000 7f7394ff9700 1 -- 172.21.15.37:0/2814968652 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739000ad80 con 0x7f73980d15c0 2023-07-14T15:57:19.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.692+0000 7f7394ff9700 1 -- 172.21.15.37:0/2814968652 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f739000ce50 con 0x7f73980d15c0 2023-07-14T15:57:19.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.692+0000 7f739e5ff700 1 -- 172.21.15.37:0/2814968652 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73980ca7f0 con 0x7f73980d15c0 2023-07-14T15:57:19.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.692+0000 7f7394ff9700 1 -- 172.21.15.37:0/2814968652 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7390003c40 con 0x7f73980d15c0 2023-07-14T15:57:19.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.692+0000 7f739e5ff700 1 -- 172.21.15.37:0/2814968652 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73980cadb0 con 0x7f73980d15c0 2023-07-14T15:57:19.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.693+0000 7f739e5ff700 1 -- 172.21.15.37:0/2814968652 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73980cb570 con 0x7f73980d15c0 2023-07-14T15:57:19.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.694+0000 7f7394ff9700 1 -- 172.21.15.37:0/2814968652 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f73900050d0 con 0x7f73980d15c0 2023-07-14T15:57:19.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.695+0000 7f7394ff9700 1 --2- 172.21.15.37:0/2814968652 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f738406ace0 0x7f738406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:19.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.695+0000 7f7394ff9700 1 -- 172.21.15.37:0/2814968652 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f73900892e0 con 0x7f73980d15c0 2023-07-14T15:57:19.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.695+0000 7f7397fff700 1 --2- 172.21.15.37:0/2814968652 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f738406ace0 0x7f738406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:19.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.696+0000 7f7397fff700 1 --2- 172.21.15.37:0/2814968652 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f738406ace0 0x7f738406d190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7388007fd0 tx=0x7f7388009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:19.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.699+0000 7f7394ff9700 1 -- 172.21.15.37:0/2814968652 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7390054640 con 0x7f73980d15c0 2023-07-14T15:57:19.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.993+0000 7f739e5ff700 1 -- 172.21.15.37:0/2814968652 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f739804e210 con 0x7f73980d15c0 2023-07-14T15:57:19.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.997+0000 7f7394ff9700 1 -- 172.21.15.37:0/2814968652 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7390057c60 con 0x7f73980d15c0 2023-07-14T15:57:19.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.999+0000 7f739e5ff700 1 -- 172.21.15.37:0/2814968652 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f738406ace0 msgr2=0x7f738406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:19.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.999+0000 7f739e5ff700 1 --2- 172.21.15.37:0/2814968652 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f738406ace0 0x7f738406d190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7388007fd0 tx=0x7f7388009040 comp rx=0 tx=0).stop 2023-07-14T15:57:19.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.999+0000 7f739e5ff700 1 -- 172.21.15.37:0/2814968652 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73980d15c0 msgr2=0x7f73980cf2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:19.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.999+0000 7f739e5ff700 1 --2- 172.21.15.37:0/2814968652 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73980d15c0 0x7f73980cf2c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f739000cc50 tx=0x7f739000a340 comp rx=0 tx=0).stop 2023-07-14T15:57:19.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.999+0000 7f739e5ff700 1 -- 172.21.15.37:0/2814968652 shutdown_connections 2023-07-14T15:57:19.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.999+0000 7f739e5ff700 1 --2- 172.21.15.37:0/2814968652 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73980b0ae0 0x7f73981f1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:19.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.999+0000 7f739e5ff700 1 --2- 172.21.15.37:0/2814968652 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f738406ace0 0x7f738406d190 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:19.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.999+0000 7f739e5ff700 1 --2- 172.21.15.37:0/2814968652 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73980d15c0 0x7f73980cf2c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:19.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.999+0000 7f739e5ff700 1 --2- 172.21.15.37:0/2814968652 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f73980b8900 0x7f73980cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:19.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:19.999+0000 7f739e5ff700 1 -- 172.21.15.37:0/2814968652 >> 172.21.15.37:0/2814968652 conn(0x7f739809c1e0 msgr2=0x7f73980d0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:19.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.000+0000 7f739e5ff700 1 -- 172.21.15.37:0/2814968652 shutdown_connections 2023-07-14T15:57:19.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.000+0000 7f739e5ff700 1 -- 172.21.15.37:0/2814968652 wait complete. 2023-07-14T15:57:20.003 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-07-14T15:57:20.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.219+0000 7fd3af3ff700 1 Processor -- start 2023-07-14T15:57:20.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.219+0000 7fd3af3ff700 1 -- start start 2023-07-14T15:57:20.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.221+0000 7fd3af3ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd3a8158990 0x7fd3a80cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:20.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.221+0000 7fd3af3ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd3a80cd2d0 0x7fd3a80cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:20.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.221+0000 7fd3af3ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3a80cd950 con 0x7fd3a8158d60 2023-07-14T15:57:20.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.221+0000 7fd3af3ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3a80cc530 con 0x7fd3a8158990 2023-07-14T15:57:20.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.221+0000 7fd3af3ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a80cdc10 con 0x7fd3a80cd2d0 2023-07-14T15:57:20.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.221+0000 7fd3ad19b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd3a8158990 0x7fd3a80cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:20.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.221+0000 7fd3ac99a700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd3a80cd2d0 0x7fd3a80cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:20.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.222+0000 7fd3ad19b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd3a8158990 0x7fd3a80cbff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.37:53386/0 (socket says 172.21.15.37:53386) 2023-07-14T15:57:20.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.222+0000 7fd3ad19b700 1 -- 172.21.15.37:0/4287968148 learned_addr learned my addr 172.21.15.37:0/4287968148 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:20.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.222+0000 7fd3ad99c700 1 --1- 172.21.15.37:0/4287968148 >> v1:172.21.15.98:6789/0 conn(0x7fd3a8158d60 0x7fd3a80707d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.37:42980/0 (socket says 172.21.15.37:42980) 2023-07-14T15:57:20.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.222+0000 7fd3ac99a700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd3a80cd2d0 0x7fd3a80cc6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3301/0 says I am v2:172.21.15.37:60858/0 (socket says 172.21.15.37:60858) 2023-07-14T15:57:20.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.222+0000 7fd3ad19b700 1 -- 172.21.15.37:0/4287968148 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd3a80cd2d0 msgr2=0x7fd3a80cc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:20.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.222+0000 7fd3ad19b700 1 --2- 172.21.15.37:0/4287968148 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd3a80cd2d0 0x7fd3a80cc6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:20.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.222+0000 7fd3ad19b700 1 -- 172.21.15.37:0/4287968148 >> v1:172.21.15.98:6789/0 conn(0x7fd3a8158d60 legacy=0x7fd3a80707d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:20.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.222+0000 7fd3ad19b700 1 -- 172.21.15.37:0/4287968148 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a80cdef0 con 0x7fd3a8158990 2023-07-14T15:57:20.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.222+0000 7fd3ad19b700 1 --2- 172.21.15.37:0/4287968148 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3a8158990 0x7fd3a80cbff0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd3a400bb90 tx=0x7fd3a400bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c20bb29613ec230 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:20.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.223+0000 7fd39ffff700 1 -- 172.21.15.37:0/4287968148 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a400dc20 con 0x7fd3a8158990 2023-07-14T15:57:20.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.223+0000 7fd39ffff700 1 -- 172.21.15.37:0/4287968148 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a400dd80 con 0x7fd3a8158990 2023-07-14T15:57:20.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.223+0000 7fd39ffff700 1 -- 172.21.15.37:0/4287968148 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a4017630 con 0x7fd3a8158990 2023-07-14T15:57:20.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.223+0000 7fd3af3ff700 1 -- 172.21.15.37:0/4287968148 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3a8158990 msgr2=0x7fd3a80cbff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:20.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.223+0000 7fd3af3ff700 1 --2- 172.21.15.37:0/4287968148 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3a8158990 0x7fd3a80cbff0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd3a400bb90 tx=0x7fd3a400bea0 comp rx=0 tx=0).stop 2023-07-14T15:57:20.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.223+0000 7fd3af3ff700 1 -- 172.21.15.37:0/4287968148 shutdown_connections 2023-07-14T15:57:20.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.223+0000 7fd3af3ff700 1 --2- 172.21.15.37:0/4287968148 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3a8158990 0x7fd3a80cbff0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:20.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.223+0000 7fd3af3ff700 1 --2- 172.21.15.37:0/4287968148 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd3a80cd2d0 0x7fd3a80cc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:20.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.223+0000 7fd3af3ff700 1 -- 172.21.15.37:0/4287968148 >> 172.21.15.37:0/4287968148 conn(0x7fd3a80b0620 msgr2=0x7fd3a80b0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:20.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.223+0000 7fd3af3ff700 1 -- 172.21.15.37:0/4287968148 shutdown_connections 2023-07-14T15:57:20.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.223+0000 7fd3af3ff700 1 -- 172.21.15.37:0/4287968148 wait complete. 2023-07-14T15:57:20.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.225+0000 7fd3af3ff700 1 Processor -- start 2023-07-14T15:57:20.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.225+0000 7fd3af3ff700 1 -- start start 2023-07-14T15:57:20.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.226+0000 7fd3af3ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd3a80cd2d0 0x7fd3a80b09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:20.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.226+0000 7fd3af3ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3a8158990 0x7fd3a80b0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:20.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.226+0000 7fd3af3ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3a8158d60 0x7fd3a80b1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:20.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.226+0000 7fd3af3ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a814d890 con 0x7fd3a8158990 2023-07-14T15:57:20.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.226+0000 7fd3af3ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a80c7670 con 0x7fd3a8158d60 2023-07-14T15:57:20.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.226+0000 7fd3af3ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a80c7950 con 0x7fd3a80cd2d0 2023-07-14T15:57:20.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.226+0000 7fd3ac99a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3a8158990 0x7fd3a80b0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:20.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.226+0000 7fd3ac99a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3a8158990 0x7fd3a80b0f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36288/0 (socket says 172.21.15.37:36288) 2023-07-14T15:57:20.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.226+0000 7fd3ac99a700 1 -- 172.21.15.37:0/1642318103 learned_addr learned my addr 172.21.15.37:0/1642318103 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:20.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.227+0000 7fd3ad19b700 1 --2- 172.21.15.37:0/1642318103 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd3a80cd2d0 0x7fd3a80b09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:20.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.227+0000 7fd3ad99c700 1 --2- 172.21.15.37:0/1642318103 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3a8158d60 0x7fd3a80b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:20.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.227+0000 7fd3ac99a700 1 -- 172.21.15.37:0/1642318103 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd3a80cd2d0 msgr2=0x7fd3a80b09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:20.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.227+0000 7fd3ac99a700 1 --2- 172.21.15.37:0/1642318103 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd3a80cd2d0 0x7fd3a80b09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:20.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.227+0000 7fd3ac99a700 1 -- 172.21.15.37:0/1642318103 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3a8158d60 msgr2=0x7fd3a80b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:20.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.227+0000 7fd3ac99a700 1 --2- 172.21.15.37:0/1642318103 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3a8158d60 0x7fd3a80b1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:20.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.227+0000 7fd3ac99a700 1 -- 172.21.15.37:0/1642318103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a400b7f0 con 0x7fd3a8158990 2023-07-14T15:57:20.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.227+0000 7fd3ac99a700 1 --2- 172.21.15.37:0/1642318103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3a8158990 0x7fd3a80b0f30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd39800e9b0 tx=0x7fd39800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:20.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.227+0000 7fd39dffb700 1 -- 172.21.15.37:0/1642318103 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd398009710 con 0x7fd3a8158990 2023-07-14T15:57:20.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.227+0000 7fd39dffb700 1 -- 172.21.15.37:0/1642318103 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd39800ee50 con 0x7fd3a8158990 2023-07-14T15:57:20.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.227+0000 7fd3af3ff700 1 -- 172.21.15.37:0/1642318103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3a80c7c30 con 0x7fd3a8158990 2023-07-14T15:57:20.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.227+0000 7fd39dffb700 1 -- 172.21.15.37:0/1642318103 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39800ca50 con 0x7fd3a8158990 2023-07-14T15:57:20.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.228+0000 7fd3af3ff700 1 -- 172.21.15.37:0/1642318103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3a80c81f0 con 0x7fd3a8158990 2023-07-14T15:57:20.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.229+0000 7fd3af3ff700 1 -- 172.21.15.37:0/1642318103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3a804e210 con 0x7fd3a8158990 2023-07-14T15:57:20.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.230+0000 7fd39dffb700 1 -- 172.21.15.37:0/1642318103 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd39800cbb0 con 0x7fd3a8158990 2023-07-14T15:57:20.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.231+0000 7fd39dffb700 1 --2- 172.21.15.37:0/1642318103 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd38c06ace0 0x7fd38c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:20.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.231+0000 7fd39dffb700 1 -- 172.21.15.37:0/1642318103 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd398089100 con 0x7fd3a8158990 2023-07-14T15:57:20.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.232+0000 7fd3ad19b700 1 --2- 172.21.15.37:0/1642318103 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd38c06ace0 0x7fd38c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:20.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.232+0000 7fd3ad19b700 1 --2- 172.21.15.37:0/1642318103 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd38c06ace0 0x7fd38c06d190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4019040 tx=0x7fd3a4014000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:20.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.236+0000 7fd39dffb700 1 -- 172.21.15.37:0/1642318103 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd398057f90 con 0x7fd3a8158990 2023-07-14T15:57:20.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.521+0000 7fd3af3ff700 1 -- 172.21.15.37:0/1642318103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fd3a8070470 con 0x7fd3a8158990 2023-07-14T15:57:20.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.525+0000 7fd39dffb700 1 -- 172.21.15.37:0/1642318103 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd39800ce60 con 0x7fd3a8158990 2023-07-14T15:57:20.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.528+0000 7fd3af3ff700 1 -- 172.21.15.37:0/1642318103 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd38c06ace0 msgr2=0x7fd38c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:20.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.528+0000 7fd3af3ff700 1 --2- 172.21.15.37:0/1642318103 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd38c06ace0 0x7fd38c06d190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4019040 tx=0x7fd3a4014000 comp rx=0 tx=0).stop 2023-07-14T15:57:20.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.528+0000 7fd3af3ff700 1 -- 172.21.15.37:0/1642318103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3a8158990 msgr2=0x7fd3a80b0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:20.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.528+0000 7fd3af3ff700 1 --2- 172.21.15.37:0/1642318103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3a8158990 0x7fd3a80b0f30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd39800e9b0 tx=0x7fd39800ecc0 comp rx=0 tx=0).stop 2023-07-14T15:57:20.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.528+0000 7fd3af3ff700 1 -- 172.21.15.37:0/1642318103 shutdown_connections 2023-07-14T15:57:20.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.528+0000 7fd3af3ff700 1 --2- 172.21.15.37:0/1642318103 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3a8158d60 0x7fd3a80b1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:20.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.528+0000 7fd3af3ff700 1 --2- 172.21.15.37:0/1642318103 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd38c06ace0 0x7fd38c06d190 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:20.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.528+0000 7fd3af3ff700 1 --2- 172.21.15.37:0/1642318103 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd3a80cd2d0 0x7fd3a80b09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:20.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.528+0000 7fd3af3ff700 1 --2- 172.21.15.37:0/1642318103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3a8158990 0x7fd3a80b0f30 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:20.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.528+0000 7fd3af3ff700 1 -- 172.21.15.37:0/1642318103 >> 172.21.15.37:0/1642318103 conn(0x7fd3a80b0620 msgr2=0x7fd3a80acde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:20.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.528+0000 7fd3af3ff700 1 -- 172.21.15.37:0/1642318103 shutdown_connections 2023-07-14T15:57:20.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.528+0000 7fd3af3ff700 1 -- 172.21.15.37:0/1642318103 wait complete. 2023-07-14T15:57:20.531 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-07-14T15:57:20.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.748+0000 7f655b5ff700 1 Processor -- start 2023-07-14T15:57:20.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.748+0000 7f655b5ff700 1 -- start start 2023-07-14T15:57:20.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.749+0000 7f655b5ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f65540717a0 0x7f65540ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:20.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.749+0000 7f655b5ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65540cec40 con 0x7f655406a580 2023-07-14T15:57:20.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.749+0000 7f655b5ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f655415cbd0 con 0x7f65540cf690 2023-07-14T15:57:20.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.749+0000 7f655b5ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6554071be0 con 0x7f65540717a0 2023-07-14T15:57:20.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.749+0000 7f6558b9a700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f655406a580 0x7f6554071090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44740/0 (socket says 172.21.15.37:44740) 2023-07-14T15:57:20.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.749+0000 7f6558b9a700 1 -- 172.21.15.37:0/1446907233 learned_addr learned my addr 172.21.15.37:0/1446907233 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:20.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.750+0000 7f6559b9c700 1 --2- 172.21.15.37:0/1446907233 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f65540717a0 0x7f65540ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:20.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.750+0000 7f654bfff700 1 -- 172.21.15.37:0/1446907233 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2984095473 0 0) 0x7f65540cec40 con 0x7f655406a580 2023-07-14T15:57:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.750+0000 7f654bfff700 1 -- 172.21.15.37:0/1446907233 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65400035b0 con 0x7f655406a580 2023-07-14T15:57:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.750+0000 7f654bfff700 1 -- 172.21.15.37:0/1446907233 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3486211832 0 0) 0x7f655415cbd0 con 0x7f65540cf690 2023-07-14T15:57:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.750+0000 7f654bfff700 1 -- 172.21.15.37:0/1446907233 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65540cec40 con 0x7f65540cf690 2023-07-14T15:57:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.750+0000 7f6559b9c700 1 -- 172.21.15.37:0/1446907233 >> v1:172.21.15.98:6789/0 conn(0x7f65540cf690 legacy=0x7f6554069e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.750+0000 7f6559b9c700 1 -- 172.21.15.37:0/1446907233 >> v1:172.21.15.37:6789/0 conn(0x7f655406a580 legacy=0x7f6554071090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.750+0000 7f6559b9c700 1 -- 172.21.15.37:0/1446907233 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65540b1740 con 0x7f65540717a0 2023-07-14T15:57:20.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.751+0000 7f6559b9c700 1 --2- 172.21.15.37:0/1446907233 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f65540717a0 0x7f65540ce700 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f654c009dc0 tx=0x7f654c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2af473f181fec7ab server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:20.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.751+0000 7f654bfff700 1 -- 172.21.15.37:0/1446907233 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654c00e070 con 0x7f65540717a0 2023-07-14T15:57:20.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.751+0000 7f654bfff700 1 -- 172.21.15.37:0/1446907233 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f654c00bb20 con 0x7f65540717a0 2023-07-14T15:57:20.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.751+0000 7f654bfff700 1 -- 172.21.15.37:0/1446907233 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654c012430 con 0x7f65540717a0 2023-07-14T15:57:20.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.751+0000 7f655b5ff700 1 -- 172.21.15.37:0/1446907233 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f65540717a0 msgr2=0x7f65540ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:20.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.751+0000 7f655b5ff700 1 --2- 172.21.15.37:0/1446907233 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f65540717a0 0x7f65540ce700 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f654c009dc0 tx=0x7f654c00b330 comp rx=0 tx=0).stop 2023-07-14T15:57:20.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.751+0000 7f655b5ff700 1 -- 172.21.15.37:0/1446907233 shutdown_connections 2023-07-14T15:57:20.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.751+0000 7f655b5ff700 1 --2- 172.21.15.37:0/1446907233 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f65540717a0 0x7f65540ce700 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:20.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.751+0000 7f655b5ff700 1 -- 172.21.15.37:0/1446907233 >> 172.21.15.37:0/1446907233 conn(0x7f655406bbd0 msgr2=0x7f65540cc610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:20.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.752+0000 7f655b5ff700 1 -- 172.21.15.37:0/1446907233 shutdown_connections 2023-07-14T15:57:20.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.752+0000 7f655b5ff700 1 -- 172.21.15.37:0/1446907233 wait complete. 2023-07-14T15:57:20.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.753+0000 7f655b5ff700 1 Processor -- start 2023-07-14T15:57:20.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.754+0000 7f655b5ff700 1 -- start start 2023-07-14T15:57:20.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.754+0000 7f655b5ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f655406a580 0x7f6554153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:20.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.754+0000 7f655b5ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65540717a0 0x7f6554158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:20.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.755+0000 7f655b5ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f65540cf690 0x7f6554158570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:20.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.755+0000 7f655b5ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65541e8800 con 0x7f65540717a0 2023-07-14T15:57:20.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.755+0000 7f655b5ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f655415d890 con 0x7f655406a580 2023-07-14T15:57:20.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.755+0000 7f655b5ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f655415cf60 con 0x7f65540cf690 2023-07-14T15:57:20.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.755+0000 7f6558b9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65540717a0 0x7f6554158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:20.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.755+0000 7f6558b9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65540717a0 0x7f6554158030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36292/0 (socket says 172.21.15.37:36292) 2023-07-14T15:57:20.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.755+0000 7f6558b9a700 1 -- 172.21.15.37:0/3148379328 learned_addr learned my addr 172.21.15.37:0/3148379328 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:20.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.755+0000 7f655939b700 1 --2- 172.21.15.37:0/3148379328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f655406a580 0x7f6554153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:20.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.755+0000 7f6559b9c700 1 --2- 172.21.15.37:0/3148379328 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f65540cf690 0x7f6554158570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:20.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.755+0000 7f6558b9a700 1 -- 172.21.15.37:0/3148379328 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f65540cf690 msgr2=0x7f6554158570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:20.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.755+0000 7f6558b9a700 1 --2- 172.21.15.37:0/3148379328 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f65540cf690 0x7f6554158570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:20.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.755+0000 7f6558b9a700 1 -- 172.21.15.37:0/3148379328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f655406a580 msgr2=0x7f6554153d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:20.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.755+0000 7f6558b9a700 1 --2- 172.21.15.37:0/3148379328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f655406a580 0x7f6554153d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:20.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.755+0000 7f6558b9a700 1 -- 172.21.15.37:0/3148379328 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f654c009a70 con 0x7f65540717a0 2023-07-14T15:57:20.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.755+0000 7f6558b9a700 1 --2- 172.21.15.37:0/3148379328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65540717a0 0x7f6554158030 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6544005910 tx=0x7f654400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:20.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.756+0000 7f6549ffb700 1 -- 172.21.15.37:0/3148379328 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6544005d70 con 0x7f65540717a0 2023-07-14T15:57:20.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.756+0000 7f6549ffb700 1 -- 172.21.15.37:0/3148379328 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65440070d0 con 0x7f65540717a0 2023-07-14T15:57:20.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.756+0000 7f655b5ff700 1 -- 172.21.15.37:0/3148379328 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f655415d240 con 0x7f65540717a0 2023-07-14T15:57:20.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.756+0000 7f6549ffb700 1 -- 172.21.15.37:0/3148379328 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6544007460 con 0x7f65540717a0 2023-07-14T15:57:20.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.756+0000 7f655b5ff700 1 -- 172.21.15.37:0/3148379328 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6554154280 con 0x7f65540717a0 2023-07-14T15:57:20.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.757+0000 7f655b5ff700 1 -- 172.21.15.37:0/3148379328 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f655404e210 con 0x7f65540717a0 2023-07-14T15:57:20.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.758+0000 7f6549ffb700 1 -- 172.21.15.37:0/3148379328 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f65440075c0 con 0x7f65540717a0 2023-07-14T15:57:20.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.759+0000 7f6549ffb700 1 --2- 172.21.15.37:0/3148379328 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f653806ace0 0x7f653806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:20.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.759+0000 7f6549ffb700 1 -- 172.21.15.37:0/3148379328 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6544088640 con 0x7f65540717a0 2023-07-14T15:57:20.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.759+0000 7f655939b700 1 --2- 172.21.15.37:0/3148379328 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f653806ace0 0x7f653806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:20.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.760+0000 7f655939b700 1 --2- 172.21.15.37:0/3148379328 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f653806ace0 0x7f653806d190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f65500011e0 tx=0x7f6550009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:20.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:20.763+0000 7f6549ffb700 1 -- 172.21.15.37:0/3148379328 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f65440539a0 con 0x7f65540717a0 2023-07-14T15:57:21.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.060+0000 7f655b5ff700 1 -- 172.21.15.37:0/3148379328 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f65540cce20 con 0x7f65540717a0 2023-07-14T15:57:21.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.064+0000 7f6549ffb700 1 -- 172.21.15.37:0/3148379328 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6544056fc0 con 0x7f65540717a0 2023-07-14T15:57:21.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.066+0000 7f655b5ff700 1 -- 172.21.15.37:0/3148379328 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f653806ace0 msgr2=0x7f653806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:21.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.066+0000 7f655b5ff700 1 --2- 172.21.15.37:0/3148379328 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f653806ace0 0x7f653806d190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f65500011e0 tx=0x7f6550009040 comp rx=0 tx=0).stop 2023-07-14T15:57:21.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.066+0000 7f655b5ff700 1 -- 172.21.15.37:0/3148379328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65540717a0 msgr2=0x7f6554158030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:21.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.066+0000 7f655b5ff700 1 --2- 172.21.15.37:0/3148379328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65540717a0 0x7f6554158030 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6544005910 tx=0x7f654400c9e0 comp rx=0 tx=0).stop 2023-07-14T15:57:21.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.067+0000 7f655b5ff700 1 -- 172.21.15.37:0/3148379328 shutdown_connections 2023-07-14T15:57:21.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.067+0000 7f655b5ff700 1 --2- 172.21.15.37:0/3148379328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f655406a580 0x7f6554153d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:21.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.067+0000 7f655b5ff700 1 --2- 172.21.15.37:0/3148379328 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f653806ace0 0x7f653806d190 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:21.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.067+0000 7f655b5ff700 1 --2- 172.21.15.37:0/3148379328 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f65540cf690 0x7f6554158570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:21.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.067+0000 7f655b5ff700 1 --2- 172.21.15.37:0/3148379328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65540717a0 0x7f6554158030 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:21.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.067+0000 7f655b5ff700 1 -- 172.21.15.37:0/3148379328 >> 172.21.15.37:0/3148379328 conn(0x7f655406bbd0 msgr2=0x7f6554069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:21.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.067+0000 7f655b5ff700 1 -- 172.21.15.37:0/3148379328 shutdown_connections 2023-07-14T15:57:21.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.067+0000 7f655b5ff700 1 -- 172.21.15.37:0/3148379328 wait complete. 2023-07-14T15:57:21.071 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-07-14T15:57:21.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.287+0000 7fdbb73ff700 1 Processor -- start 2023-07-14T15:57:21.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.287+0000 7fdbb73ff700 1 -- start start 2023-07-14T15:57:21.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.288+0000 7fdbb73ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fdbb00adfe0 0x7fdbb00c9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:21.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.288+0000 7fdbb73ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdbb00cda10 0x7fdbb00c9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:21.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.288+0000 7fdbb73ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdbb00cb4e0 0x7fdbb00cb940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:21.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.288+0000 7fdbb73ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbb00cbe80 con 0x7fdbb00cb4e0 2023-07-14T15:57:21.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.288+0000 7fdbb73ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbb01598c0 con 0x7fdbb00adfe0 2023-07-14T15:57:21.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.288+0000 7fdbb73ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb015dec0 con 0x7fdbb00cda10 2023-07-14T15:57:21.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.288+0000 7fdbb599c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdbb00cb4e0 0x7fdbb00cb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:21.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.288+0000 7fdbb599c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdbb00cb4e0 0x7fdbb00cb940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36300/0 (socket says 172.21.15.37:36300) 2023-07-14T15:57:21.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.288+0000 7fdbb599c700 1 -- 172.21.15.37:0/2413180333 learned_addr learned my addr 172.21.15.37:0/2413180333 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:21.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.289+0000 7fdbb499a700 1 --2- 172.21.15.37:0/2413180333 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdbb00cda10 0x7fdbb00c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:21.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.289+0000 7fdbb519b700 1 --2- 172.21.15.37:0/2413180333 >> v2:172.21.15.98:3300/0 conn(0x7fdbb00adfe0 0x7fdbb00c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:21.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.289+0000 7fdbb599c700 1 -- 172.21.15.37:0/2413180333 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdbb00cda10 msgr2=0x7fdbb00c9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:21.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.289+0000 7fdbb599c700 1 --2- 172.21.15.37:0/2413180333 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdbb00cda10 0x7fdbb00c9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:21.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.289+0000 7fdbb599c700 1 -- 172.21.15.37:0/2413180333 >> v2:172.21.15.98:3300/0 conn(0x7fdbb00adfe0 msgr2=0x7fdbb00c9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:21.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.289+0000 7fdbb599c700 1 --2- 172.21.15.37:0/2413180333 >> v2:172.21.15.98:3300/0 conn(0x7fdbb00adfe0 0x7fdbb00c9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:21.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.289+0000 7fdbb599c700 1 -- 172.21.15.37:0/2413180333 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb00ccc50 con 0x7fdbb00cb4e0 2023-07-14T15:57:21.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.289+0000 7fdbb519b700 1 --2- 172.21.15.37:0/2413180333 >> v2:172.21.15.98:3300/0 conn(0x7fdbb00adfe0 0x7fdbb00c9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:57:21.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.289+0000 7fdbb499a700 1 --2- 172.21.15.37:0/2413180333 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdbb00cda10 0x7fdbb00c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:57:21.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.289+0000 7fdbb599c700 1 --2- 172.21.15.37:0/2413180333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbb00cb4e0 0x7fdbb00cb940 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fdbb00cb4b0 tx=0x7fdba800d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f06c01ba441eb829 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:21.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.289+0000 7fdba7fff700 1 -- 172.21.15.37:0/2413180333 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba8010070 con 0x7fdbb00cb4e0 2023-07-14T15:57:21.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.289+0000 7fdba7fff700 1 -- 172.21.15.37:0/2413180333 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba800dd90 con 0x7fdbb00cb4e0 2023-07-14T15:57:21.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.289+0000 7fdba7fff700 1 -- 172.21.15.37:0/2413180333 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba800b310 con 0x7fdbb00cb4e0 2023-07-14T15:57:21.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.290+0000 7fdbb73ff700 1 -- 172.21.15.37:0/2413180333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbb00cb4e0 msgr2=0x7fdbb00cb940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:21.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.290+0000 7fdbb73ff700 1 --2- 172.21.15.37:0/2413180333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbb00cb4e0 0x7fdbb00cb940 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fdbb00cb4b0 tx=0x7fdba800d430 comp rx=0 tx=0).stop 2023-07-14T15:57:21.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.290+0000 7fdbb73ff700 1 -- 172.21.15.37:0/2413180333 shutdown_connections 2023-07-14T15:57:21.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.290+0000 7fdbb73ff700 1 --2- 172.21.15.37:0/2413180333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbb00cb4e0 0x7fdbb00cb940 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:21.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.290+0000 7fdbb73ff700 1 --2- 172.21.15.37:0/2413180333 >> v2:172.21.15.98:3300/0 conn(0x7fdbb00adfe0 0x7fdbb00c9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:21.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.290+0000 7fdbb73ff700 1 --2- 172.21.15.37:0/2413180333 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdbb00cda10 0x7fdbb00c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:21.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.290+0000 7fdbb73ff700 1 -- 172.21.15.37:0/2413180333 >> 172.21.15.37:0/2413180333 conn(0x7fdbb00b0620 msgr2=0x7fdbb00b0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:21.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.290+0000 7fdbb73ff700 1 -- 172.21.15.37:0/2413180333 shutdown_connections 2023-07-14T15:57:21.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.290+0000 7fdbb73ff700 1 -- 172.21.15.37:0/2413180333 wait complete. 2023-07-14T15:57:21.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.292+0000 7fdbb73ff700 1 Processor -- start 2023-07-14T15:57:21.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.292+0000 7fdbb73ff700 1 -- start start 2023-07-14T15:57:21.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.293+0000 7fdbb73ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdbb00adfe0 0x7fdbb00c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:21.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.293+0000 7fdbb73ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbb00cb4e0 0x7fdbb0155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:21.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.293+0000 7fdbb73ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbb00cda10 0x7fdbb00b2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:21.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.293+0000 7fdbb73ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb01f1f30 con 0x7fdbb00cb4e0 2023-07-14T15:57:21.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.293+0000 7fdbb73ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb0155a60 con 0x7fdbb00cda10 2023-07-14T15:57:21.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.293+0000 7fdbb73ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb00c81d0 con 0x7fdbb00adfe0 2023-07-14T15:57:21.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.293+0000 7fdbb499a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbb00cb4e0 0x7fdbb0155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:21.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.293+0000 7fdbb499a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbb00cb4e0 0x7fdbb0155520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36310/0 (socket says 172.21.15.37:36310) 2023-07-14T15:57:21.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.293+0000 7fdbb499a700 1 -- 172.21.15.37:0/3740799100 learned_addr learned my addr 172.21.15.37:0/3740799100 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:21.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.293+0000 7fdbb599c700 1 --2- 172.21.15.37:0/3740799100 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbb00cda10 0x7fdbb00b2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:21.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.293+0000 7fdbb519b700 1 --2- 172.21.15.37:0/3740799100 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdbb00adfe0 0x7fdbb00c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:21.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.294+0000 7fdbb499a700 1 -- 172.21.15.37:0/3740799100 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdbb00adfe0 msgr2=0x7fdbb00c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:21.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.294+0000 7fdbb499a700 1 --2- 172.21.15.37:0/3740799100 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdbb00adfe0 0x7fdbb00c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:21.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.294+0000 7fdbb499a700 1 -- 172.21.15.37:0/3740799100 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbb00cda10 msgr2=0x7fdbb00b2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:21.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.294+0000 7fdbb499a700 1 --2- 172.21.15.37:0/3740799100 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbb00cda10 0x7fdbb00b2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:21.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.294+0000 7fdbb499a700 1 -- 172.21.15.37:0/3740799100 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba800bd40 con 0x7fdbb00cb4e0 2023-07-14T15:57:21.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.294+0000 7fdbb499a700 1 --2- 172.21.15.37:0/3740799100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbb00cb4e0 0x7fdbb0155520 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fdba000c750 tx=0x7fdba000cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:21.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.294+0000 7fdba5ffb700 1 -- 172.21.15.37:0/3740799100 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba0011800 con 0x7fdbb00cb4e0 2023-07-14T15:57:21.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.294+0000 7fdba5ffb700 1 -- 172.21.15.37:0/3740799100 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba0011960 con 0x7fdbb00cb4e0 2023-07-14T15:57:21.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.294+0000 7fdba5ffb700 1 -- 172.21.15.37:0/3740799100 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba0011cd0 con 0x7fdbb00cb4e0 2023-07-14T15:57:21.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.294+0000 7fdbb73ff700 1 -- 172.21.15.37:0/3740799100 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbb01f59c0 con 0x7fdbb00cb4e0 2023-07-14T15:57:21.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.294+0000 7fdbb73ff700 1 -- 172.21.15.37:0/3740799100 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbb01f5f80 con 0x7fdbb00cb4e0 2023-07-14T15:57:21.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.295+0000 7fdbb73ff700 1 -- 172.21.15.37:0/3740799100 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbb004e210 con 0x7fdbb00cb4e0 2023-07-14T15:57:21.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.296+0000 7fdba5ffb700 1 -- 172.21.15.37:0/3740799100 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdba0021350 con 0x7fdbb00cb4e0 2023-07-14T15:57:21.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.297+0000 7fdba5ffb700 1 --2- 172.21.15.37:0/3740799100 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fdb9406ace0 0x7fdb9406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:21.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.297+0000 7fdba5ffb700 1 -- 172.21.15.37:0/3740799100 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fdba00891b0 con 0x7fdbb00cb4e0 2023-07-14T15:57:21.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.298+0000 7fdbb519b700 1 --2- 172.21.15.37:0/3740799100 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fdb9406ace0 0x7fdb9406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:21.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.298+0000 7fdbb519b700 1 --2- 172.21.15.37:0/3740799100 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fdb9406ace0 0x7fdb9406d190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdbac00aa10 tx=0x7fdbac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:21.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.302+0000 7fdba5ffb700 1 -- 172.21.15.37:0/3740799100 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fdba0057fa0 con 0x7fdbb00cb4e0 2023-07-14T15:57:21.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.589+0000 7fdbb73ff700 1 -- 172.21.15.37:0/3740799100 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fdbb01f2070 con 0x7fdbb00cb4e0 2023-07-14T15:57:21.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.593+0000 7fdba5ffb700 1 -- 172.21.15.37:0/3740799100 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7fdba0057b30 con 0x7fdbb00cb4e0 2023-07-14T15:57:21.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.595+0000 7fdbb73ff700 1 -- 172.21.15.37:0/3740799100 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fdb9406ace0 msgr2=0x7fdb9406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:21.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.595+0000 7fdbb73ff700 1 --2- 172.21.15.37:0/3740799100 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fdb9406ace0 0x7fdb9406d190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdbac00aa10 tx=0x7fdbac008040 comp rx=0 tx=0).stop 2023-07-14T15:57:21.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.595+0000 7fdbb73ff700 1 -- 172.21.15.37:0/3740799100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbb00cb4e0 msgr2=0x7fdbb0155520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:21.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.595+0000 7fdbb73ff700 1 --2- 172.21.15.37:0/3740799100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbb00cb4e0 0x7fdbb0155520 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fdba000c750 tx=0x7fdba000cb10 comp rx=0 tx=0).stop 2023-07-14T15:57:21.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.595+0000 7fdbb73ff700 1 -- 172.21.15.37:0/3740799100 shutdown_connections 2023-07-14T15:57:21.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.595+0000 7fdbb73ff700 1 --2- 172.21.15.37:0/3740799100 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbb00cda10 0x7fdbb00b2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:21.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.595+0000 7fdbb73ff700 1 --2- 172.21.15.37:0/3740799100 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fdb9406ace0 0x7fdb9406d190 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:21.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.595+0000 7fdbb73ff700 1 --2- 172.21.15.37:0/3740799100 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdbb00adfe0 0x7fdbb00c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:21.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.595+0000 7fdbb73ff700 1 --2- 172.21.15.37:0/3740799100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbb00cb4e0 0x7fdbb0155520 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:21.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.595+0000 7fdbb73ff700 1 -- 172.21.15.37:0/3740799100 >> 172.21.15.37:0/3740799100 conn(0x7fdbb00b0620 msgr2=0x7fdbb00c5190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:21.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.595+0000 7fdbb73ff700 1 -- 172.21.15.37:0/3740799100 shutdown_connections 2023-07-14T15:57:21.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.596+0000 7fdbb73ff700 1 -- 172.21.15.37:0/3740799100 wait complete. 2023-07-14T15:57:21.599 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T15:57:21.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.814+0000 7f6bbf7ff700 1 Processor -- start 2023-07-14T15:57:21.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.814+0000 7f6bbf7ff700 1 -- start start 2023-07-14T15:57:21.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.815+0000 7f6bbf7ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f6bb815cc40 0x7f6bb8160eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:21.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.815+0000 7f6bbf7ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6bb80ca170 0x7f6bb8071120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:21.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.815+0000 7f6bbf7ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6bb8069e70 0x7f6bb806a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:21.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.815+0000 7f6bbf7ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bb806a830 con 0x7f6bb8069e70 2023-07-14T15:57:21.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.815+0000 7f6bbf7ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bb80cbb40 con 0x7f6bb815cc40 2023-07-14T15:57:21.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.815+0000 7f6bbf7ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb8070c90 con 0x7f6bb80ca170 2023-07-14T15:57:21.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.816+0000 7f6bbdd9c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6bb8069e70 0x7f6bb806a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:21.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.816+0000 7f6bbdd9c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6bb8069e70 0x7f6bb806a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36322/0 (socket says 172.21.15.37:36322) 2023-07-14T15:57:21.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.816+0000 7f6bbdd9c700 1 -- 172.21.15.37:0/3955446653 learned_addr learned my addr 172.21.15.37:0/3955446653 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:21.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.816+0000 7f6bbd59b700 1 --2- 172.21.15.37:0/3955446653 >> v2:172.21.15.98:3300/0 conn(0x7f6bb815cc40 0x7f6bb8160eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:21.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.816+0000 7f6bbcd9a700 1 --2- 172.21.15.37:0/3955446653 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6bb80ca170 0x7f6bb8071120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:21.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.816+0000 7f6bbdd9c700 1 -- 172.21.15.37:0/3955446653 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6bb80ca170 msgr2=0x7f6bb8071120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:21.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.816+0000 7f6bbdd9c700 1 --2- 172.21.15.37:0/3955446653 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6bb80ca170 0x7f6bb8071120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:21.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.816+0000 7f6bbdd9c700 1 -- 172.21.15.37:0/3955446653 >> v2:172.21.15.98:3300/0 conn(0x7f6bb815cc40 msgr2=0x7f6bb8160eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:21.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.816+0000 7f6bbdd9c700 1 --2- 172.21.15.37:0/3955446653 >> v2:172.21.15.98:3300/0 conn(0x7f6bb815cc40 0x7f6bb8160eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:21.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.816+0000 7f6bbdd9c700 1 -- 172.21.15.37:0/3955446653 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb80cc330 con 0x7f6bb8069e70 2023-07-14T15:57:21.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.816+0000 7f6bbdd9c700 1 --2- 172.21.15.37:0/3955446653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bb8069e70 0x7f6bb806a2f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8071bb0 tx=0x7f6bb000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7723e1dcccf52356 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:21.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.817+0000 7f6baffff700 1 -- 172.21.15.37:0/3955446653 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb000e070 con 0x7f6bb8069e70 2023-07-14T15:57:21.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.817+0000 7f6baffff700 1 -- 172.21.15.37:0/3955446653 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb000b910 con 0x7f6bb8069e70 2023-07-14T15:57:21.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.817+0000 7f6baffff700 1 -- 172.21.15.37:0/3955446653 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb000bcc0 con 0x7f6bb8069e70 2023-07-14T15:57:21.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.817+0000 7f6bbf7ff700 1 -- 172.21.15.37:0/3955446653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bb8069e70 msgr2=0x7f6bb806a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:21.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.817+0000 7f6bbf7ff700 1 --2- 172.21.15.37:0/3955446653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bb8069e70 0x7f6bb806a2f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8071bb0 tx=0x7f6bb000b330 comp rx=0 tx=0).stop 2023-07-14T15:57:21.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.817+0000 7f6bbf7ff700 1 -- 172.21.15.37:0/3955446653 shutdown_connections 2023-07-14T15:57:21.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.817+0000 7f6bbf7ff700 1 --2- 172.21.15.37:0/3955446653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bb8069e70 0x7f6bb806a2f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:21.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.817+0000 7f6bbf7ff700 1 --2- 172.21.15.37:0/3955446653 >> v2:172.21.15.98:3300/0 conn(0x7f6bb815cc40 0x7f6bb8160eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:21.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.817+0000 7f6bbf7ff700 1 --2- 172.21.15.37:0/3955446653 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6bb80ca170 0x7f6bb8071120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:21.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.817+0000 7f6bbf7ff700 1 -- 172.21.15.37:0/3955446653 >> 172.21.15.37:0/3955446653 conn(0x7f6bb80cd230 msgr2=0x7f6bb80cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:21.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.817+0000 7f6bbf7ff700 1 -- 172.21.15.37:0/3955446653 shutdown_connections 2023-07-14T15:57:21.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.817+0000 7f6bbf7ff700 1 -- 172.21.15.37:0/3955446653 wait complete. 2023-07-14T15:57:21.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.819+0000 7f6bbf7ff700 1 Processor -- start 2023-07-14T15:57:21.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.819+0000 7f6bbf7ff700 1 -- start start 2023-07-14T15:57:21.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.820+0000 7f6bbf7ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bb8069e70 0x7f6bb81e6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:21.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.820+0000 7f6bbf7ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bb80ca170 0x7f6bb80c7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:21.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.820+0000 7f6bbf7ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6bb815cc40 0x7f6bb80c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:21.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.820+0000 7f6bbf7ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb80b38c0 con 0x7f6bb8069e70 2023-07-14T15:57:21.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.820+0000 7f6bbf7ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb80b3ba0 con 0x7f6bb80ca170 2023-07-14T15:57:21.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.820+0000 7f6bbf7ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb80b3e80 con 0x7f6bb815cc40 2023-07-14T15:57:21.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.820+0000 7f6bbd59b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bb8069e70 0x7f6bb81e6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:21.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.821+0000 7f6bbd59b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bb8069e70 0x7f6bb81e6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36332/0 (socket says 172.21.15.37:36332) 2023-07-14T15:57:21.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.821+0000 7f6bbd59b700 1 -- 172.21.15.37:0/125654776 learned_addr learned my addr 172.21.15.37:0/125654776 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:21.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.821+0000 7f6bbcd9a700 1 --2- 172.21.15.37:0/125654776 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bb80ca170 0x7f6bb80c7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:21.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.821+0000 7f6bbdd9c700 1 --2- 172.21.15.37:0/125654776 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6bb815cc40 0x7f6bb80c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:21.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.821+0000 7f6bbd59b700 1 -- 172.21.15.37:0/125654776 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6bb815cc40 msgr2=0x7f6bb80c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:21.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.821+0000 7f6bbd59b700 1 --2- 172.21.15.37:0/125654776 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6bb815cc40 0x7f6bb80c8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:21.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.821+0000 7f6bbd59b700 1 -- 172.21.15.37:0/125654776 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bb80ca170 msgr2=0x7f6bb80c7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:21.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.821+0000 7f6bbd59b700 1 --2- 172.21.15.37:0/125654776 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bb80ca170 0x7f6bb80c7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:21.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.821+0000 7f6bbd59b700 1 -- 172.21.15.37:0/125654776 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb0009b30 con 0x7f6bb8069e70 2023-07-14T15:57:21.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.821+0000 7f6bbcd9a700 1 --2- 172.21.15.37:0/125654776 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bb80ca170 0x7f6bb80c7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:57:21.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.821+0000 7f6bbdd9c700 1 --2- 172.21.15.37:0/125654776 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6bb815cc40 0x7f6bb80c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:57:21.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.821+0000 7f6bbd59b700 1 --2- 172.21.15.37:0/125654776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bb8069e70 0x7f6bb81e6540 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6bb400e870 tx=0x7f6bb400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:21.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.821+0000 7f6badffb700 1 -- 172.21.15.37:0/125654776 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb4009590 con 0x7f6bb8069e70 2023-07-14T15:57:21.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.821+0000 7f6badffb700 1 -- 172.21.15.37:0/125654776 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb400ee70 con 0x7f6bb8069e70 2023-07-14T15:57:21.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.821+0000 7f6badffb700 1 -- 172.21.15.37:0/125654776 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb400ca50 con 0x7f6bb8069e70 2023-07-14T15:57:21.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.821+0000 7f6bbf7ff700 1 -- 172.21.15.37:0/125654776 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb80b4160 con 0x7f6bb8069e70 2023-07-14T15:57:21.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.822+0000 7f6bbf7ff700 1 -- 172.21.15.37:0/125654776 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb814ba50 con 0x7f6bb8069e70 2023-07-14T15:57:21.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.823+0000 7f6bbf7ff700 1 -- 172.21.15.37:0/125654776 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bb80b47b0 con 0x7f6bb8069e70 2023-07-14T15:57:21.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.824+0000 7f6badffb700 1 -- 172.21.15.37:0/125654776 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6bb400cbb0 con 0x7f6bb8069e70 2023-07-14T15:57:21.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.825+0000 7f6badffb700 1 --2- 172.21.15.37:0/125654776 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f6b9c06ace0 0x7f6b9c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:21.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.825+0000 7f6badffb700 1 -- 172.21.15.37:0/125654776 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6bb4089090 con 0x7f6bb8069e70 2023-07-14T15:57:21.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.825+0000 7f6bbcd9a700 1 --2- 172.21.15.37:0/125654776 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f6b9c06ace0 0x7f6b9c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:21.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.826+0000 7f6bbcd9a700 1 --2- 172.21.15.37:0/125654776 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f6b9c06ace0 0x7f6b9c06d190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6bb815c7e0 tx=0x7f6ba8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:21.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:21.829+0000 7f6badffb700 1 -- 172.21.15.37:0/125654776 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6bb4057f20 con 0x7f6bb8069e70 2023-07-14T15:57:22.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.040+0000 7f6bbf7ff700 1 -- 172.21.15.37:0/125654776 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6bb806a650 con 0x7f6bb8069e70 2023-07-14T15:57:22.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.041+0000 7f6badffb700 1 -- 172.21.15.37:0/125654776 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+14629 (secure 0 0 0) 0x7f6bb400ce60 con 0x7f6bb8069e70 2023-07-14T15:57:22.028 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:57:22.028 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":32,"fsid":"9da30401-a779-4e46-aba6-00c2494c6c67","created":"2023-07-14T15:55:39.898867+0000","modified":"2023-07-14T15:57:17.830886+0000","last_up_change":"2023-07-14T15:55:53.025696+0000","last_in_change":"2023-07-14T15:55:43.388192+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T15:55:52.907261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T15:55:59.992839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d049535-7b87-4276-8fe5-0f74ba422d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6801","nonce":2783032392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6803","nonce":2783032392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6807","nonce":2783032392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6805","nonce":2783032392}]},"public_addr":"172.21.15.37:6801/2783032392","cluster_addr":"172.21.15.37:6803/2783032392","heartbeat_back_addr":"172.21.15.37:6807/2783032392","heartbeat_front_addr":"172.21.15.37:6805/2783032392","state":["exists","up"]},{"osd":1,"uuid":"79ec948d-ead2-4c2d-923a-dd6eeaac9dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6823","nonce":1190059746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6826","nonce":1190059746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6831","nonce":1190059746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6829","nonce":1190059746}]},"public_addr":"172.21.15.37:6823/1190059746","cluster_addr":"172.21.15.37:6826/1190059746","heartbeat_back_addr":"172.21.15.37:6831/1190059746","heartbeat_front_addr":"172.21.15.37:6829/1190059746","state":["exists","up"]},{"osd":2,"uuid":"a1db6690-c160-4366-9c82-2cca17e4bba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6809","nonce":2266223499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6813","nonce":2266223499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6820","nonce":2266223499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6816","nonce":2266223499}]},"public_addr":"172.21.15.37:6809/2266223499","cluster_addr":"172.21.15.37:6813/2266223499","heartbeat_back_addr":"172.21.15.37:6820/2266223499","heartbeat_front_addr":"172.21.15.37:6816/2266223499","state":["exists","up"]},{"osd":3,"uuid":"767b8220-e79a-4a86-a162-6b3b73198379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6812","nonce":4166694594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6817","nonce":4166694594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6828","nonce":4166694594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6822","nonce":4166694594}]},"public_addr":"172.21.15.37:6812/4166694594","cluster_addr":"172.21.15.37:6817/4166694594","heartbeat_back_addr":"172.21.15.37:6828/4166694594","heartbeat_front_addr":"172.21.15.37:6822/4166694594","state":["exists","up"]},{"osd":4,"uuid":"717bd773-ae7e-4236-ac79-900cf99a37c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6801","nonce":3529020407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6803","nonce":3529020407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6807","nonce":3529020407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6805","nonce":3529020407}]},"public_addr":"172.21.15.98:6801/3529020407","cluster_addr":"172.21.15.98:6803/3529020407","heartbeat_back_addr":"172.21.15.98:6807/3529020407","heartbeat_front_addr":"172.21.15.98:6805/3529020407","state":["exists","up"]},{"osd":5,"uuid":"a941d358-0f03-4136-a9b2-3a1c2e9358cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6817","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6819","nonce":2311501838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6821","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6823","nonce":2311501838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6829","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6831","nonce":2311501838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6825","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6827","nonce":2311501838}]},"public_addr":"172.21.15.98:6819/2311501838","cluster_addr":"172.21.15.98:6823/2311501838","heartbeat_back_addr":"172.21.15.98:6831/2311501838","heartbeat_front_addr":"172.21.15.98:6827/2311501838","state":["exists","up"]},{"osd":6,"uuid":"27153772-6d4b-479d-9953-0582e7b96743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6809","nonce":1144224691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6811","nonce":1144224691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6815","nonce":1144224691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6813","nonce":1144224691}]},"public_addr":"172.21.15.98:6809/1144224691","cluster_addr":"172.21.15.98:6811/1144224691","heartbeat_back_addr":"172.21.15.98:6815/1144224691","heartbeat_front_addr":"172.21.15.98:6813/1144224691","state":["exists","up"]},{"osd":7,"uuid":"d21ffc8e-40bb-47eb-af2c-e3e730d3fb76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6818","nonce":1144470927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6822","nonce":1144470927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6830","nonce":1144470927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6826","nonce":1144470927}]},"public_addr":"172.21.15.98:6818/1144470927","cluster_addr":"172.21.15.98:6822/1144470927","heartbeat_back_addr":"172.21.15.98:6830/1144470927","heartbeat_front_addr":"172.21.15.98:6826/1144470927","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.921114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.739210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.024016+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.002527+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.698127+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.813416+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.709351+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.815457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T15:57:22.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.043+0000 7f6bbf7ff700 1 -- 172.21.15.37:0/125654776 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f6b9c06ace0 msgr2=0x7f6b9c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:22.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.043+0000 7f6bbf7ff700 1 --2- 172.21.15.37:0/125654776 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f6b9c06ace0 0x7f6b9c06d190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6bb815c7e0 tx=0x7f6ba8008040 comp rx=0 tx=0).stop 2023-07-14T15:57:22.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.043+0000 7f6bbf7ff700 1 -- 172.21.15.37:0/125654776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bb8069e70 msgr2=0x7f6bb81e6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:22.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.043+0000 7f6bbf7ff700 1 --2- 172.21.15.37:0/125654776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bb8069e70 0x7f6bb81e6540 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6bb400e870 tx=0x7f6bb400ec30 comp rx=0 tx=0).stop 2023-07-14T15:57:22.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.043+0000 7f6bbf7ff700 1 -- 172.21.15.37:0/125654776 shutdown_connections 2023-07-14T15:57:22.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.043+0000 7f6bbf7ff700 1 --2- 172.21.15.37:0/125654776 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f6b9c06ace0 0x7f6b9c06d190 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:22.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.043+0000 7f6bbf7ff700 1 --2- 172.21.15.37:0/125654776 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6bb815cc40 0x7f6bb80c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:22.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.043+0000 7f6bbf7ff700 1 --2- 172.21.15.37:0/125654776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bb8069e70 0x7f6bb81e6540 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:22.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.043+0000 7f6bbf7ff700 1 --2- 172.21.15.37:0/125654776 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bb80ca170 0x7f6bb80c7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:22.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.043+0000 7f6bbf7ff700 1 -- 172.21.15.37:0/125654776 >> 172.21.15.37:0/125654776 conn(0x7f6bb80cd230 msgr2=0x7f6bb80cedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:22.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.043+0000 7f6bbf7ff700 1 -- 172.21.15.37:0/125654776 shutdown_connections 2023-07-14T15:57:22.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.043+0000 7f6bbf7ff700 1 -- 172.21.15.37:0/125654776 wait complete. 2023-07-14T15:57:22.047 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T15:55:52.907261+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T15:55:59.992839+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T15:57:22.048 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T15:57:22.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.267+0000 7fac9cfff700 1 Processor -- start 2023-07-14T15:57:22.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.267+0000 7fac9cfff700 1 -- start start 2023-07-14T15:57:22.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.268+0000 7fac9cfff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fac980d1140 0x7fac9815ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:22.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.268+0000 7fac9cfff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fac981603b0 0x7fac980b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:22.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.268+0000 7fac9cfff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac9815dc50 con 0x7fac9815fee0 2023-07-14T15:57:22.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.268+0000 7fac9cfff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac980b2940 con 0x7fac981603b0 2023-07-14T15:57:22.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.268+0000 7fac9cfff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac980b2c20 con 0x7fac980d1140 2023-07-14T15:57:22.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.268+0000 7fac96d9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fac981603b0 0x7fac980b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:22.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.269+0000 7fac9659c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fac9815fee0 0x7fac980d0a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44746/0 (socket says 172.21.15.37:44746) 2023-07-14T15:57:22.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.269+0000 7fac9659c700 1 -- 172.21.15.37:0/4058596220 learned_addr learned my addr 172.21.15.37:0/4058596220 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:22.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.269+0000 7fac96d9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fac981603b0 0x7fac980b39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36342/0 (socket says 172.21.15.37:36342) 2023-07-14T15:57:22.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.269+0000 7fac95d9b700 1 --2- 172.21.15.37:0/4058596220 >> v2:172.21.15.98:3300/0 conn(0x7fac980d1140 0x7fac9815ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:22.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.269+0000 7fac96d9d700 1 -- 172.21.15.37:0/4058596220 >> v2:172.21.15.98:3300/0 conn(0x7fac980d1140 msgr2=0x7fac9815ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:22.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.269+0000 7fac96d9d700 1 --2- 172.21.15.37:0/4058596220 >> v2:172.21.15.98:3300/0 conn(0x7fac980d1140 0x7fac9815ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:22.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.269+0000 7fac96d9d700 1 -- 172.21.15.37:0/4058596220 >> v1:172.21.15.37:6789/0 conn(0x7fac9815fee0 legacy=0x7fac980d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:22.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.269+0000 7fac96d9d700 1 -- 172.21.15.37:0/4058596220 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac980b2f00 con 0x7fac981603b0 2023-07-14T15:57:22.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.269+0000 7fac9559a700 1 -- 172.21.15.37:0/4058596220 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2411460456 0 0) 0x7fac9815dc50 con 0x7fac9815fee0 2023-07-14T15:57:22.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.269+0000 7fac96d9d700 1 --2- 172.21.15.37:0/4058596220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac981603b0 0x7fac980b39e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fac9809c850 tx=0x7fac9000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=957c3f8bca716759 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:22.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.270+0000 7fac9559a700 1 -- 172.21.15.37:0/4058596220 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9000e070 con 0x7fac981603b0 2023-07-14T15:57:22.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.270+0000 7fac9559a700 1 -- 172.21.15.37:0/4058596220 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac9000bb20 con 0x7fac981603b0 2023-07-14T15:57:22.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.270+0000 7fac9559a700 1 -- 172.21.15.37:0/4058596220 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac90012430 con 0x7fac981603b0 2023-07-14T15:57:22.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.270+0000 7fac9cfff700 1 -- 172.21.15.37:0/4058596220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac981603b0 msgr2=0x7fac980b39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:22.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.270+0000 7fac9cfff700 1 --2- 172.21.15.37:0/4058596220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac981603b0 0x7fac980b39e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fac9809c850 tx=0x7fac9000b330 comp rx=0 tx=0).stop 2023-07-14T15:57:22.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.270+0000 7fac9cfff700 1 -- 172.21.15.37:0/4058596220 shutdown_connections 2023-07-14T15:57:22.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.270+0000 7fac9cfff700 1 --2- 172.21.15.37:0/4058596220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac981603b0 0x7fac980b39e0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:22.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.270+0000 7fac9cfff700 1 --2- 172.21.15.37:0/4058596220 >> v2:172.21.15.98:3300/0 conn(0x7fac980d1140 0x7fac9815ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:22.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.270+0000 7fac9cfff700 1 -- 172.21.15.37:0/4058596220 >> 172.21.15.37:0/4058596220 conn(0x7fac9809c1b0 msgr2=0x7fac980d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:22.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.270+0000 7fac9cfff700 1 -- 172.21.15.37:0/4058596220 shutdown_connections 2023-07-14T15:57:22.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.270+0000 7fac9cfff700 1 -- 172.21.15.37:0/4058596220 wait complete. 2023-07-14T15:57:22.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.272+0000 7fac9cfff700 1 Processor -- start 2023-07-14T15:57:22.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.272+0000 7fac9cfff700 1 -- start start 2023-07-14T15:57:22.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.273+0000 7fac9cfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fac980d1140 0x7fac981588a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:22.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.273+0000 7fac9cfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac9815fee0 0x7fac980c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:22.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.273+0000 7fac9cfff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fac981603b0 0x7fac980b7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:22.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.273+0000 7fac9cfff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac980b7760 con 0x7fac9815fee0 2023-07-14T15:57:22.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.273+0000 7fac9cfff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac980b79c0 con 0x7fac980d1140 2023-07-14T15:57:22.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.273+0000 7fac9cfff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac980b7ca0 con 0x7fac981603b0 2023-07-14T15:57:22.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.274+0000 7fac95d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac9815fee0 0x7fac980c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:22.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.274+0000 7fac95d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac9815fee0 0x7fac980c7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36354/0 (socket says 172.21.15.37:36354) 2023-07-14T15:57:22.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.274+0000 7fac95d9b700 1 -- 172.21.15.37:0/393862909 learned_addr learned my addr 172.21.15.37:0/393862909 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:22.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.274+0000 7fac9659c700 1 --2- 172.21.15.37:0/393862909 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fac980d1140 0x7fac981588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:22.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.274+0000 7fac96d9d700 1 --2- 172.21.15.37:0/393862909 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fac981603b0 0x7fac980b7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:22.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.274+0000 7fac95d9b700 1 -- 172.21.15.37:0/393862909 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fac981603b0 msgr2=0x7fac980b7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:22.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.274+0000 7fac95d9b700 1 --2- 172.21.15.37:0/393862909 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fac981603b0 0x7fac980b7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:22.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.274+0000 7fac95d9b700 1 -- 172.21.15.37:0/393862909 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fac980d1140 msgr2=0x7fac981588a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:22.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.274+0000 7fac95d9b700 1 --2- 172.21.15.37:0/393862909 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fac980d1140 0x7fac981588a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:22.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.274+0000 7fac95d9b700 1 -- 172.21.15.37:0/393862909 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac90009a70 con 0x7fac9815fee0 2023-07-14T15:57:22.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.274+0000 7fac95d9b700 1 --2- 172.21.15.37:0/393862909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac9815fee0 0x7fac980c7a70 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fac8c00e840 tx=0x7fac8c00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:22.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.274+0000 7fac86ffd700 1 -- 172.21.15.37:0/393862909 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac8c009590 con 0x7fac9815fee0 2023-07-14T15:57:22.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.275+0000 7fac86ffd700 1 -- 172.21.15.37:0/393862909 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac8c013680 con 0x7fac9815fee0 2023-07-14T15:57:22.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.275+0000 7fac9cfff700 1 -- 172.21.15.37:0/393862909 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac980b7f80 con 0x7fac9815fee0 2023-07-14T15:57:22.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.275+0000 7fac86ffd700 1 -- 172.21.15.37:0/393862909 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac8c013a30 con 0x7fac9815fee0 2023-07-14T15:57:22.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.275+0000 7fac9cfff700 1 -- 172.21.15.37:0/393862909 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac980b8540 con 0x7fac9815fee0 2023-07-14T15:57:22.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.276+0000 7fac9cfff700 1 -- 172.21.15.37:0/393862909 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac980b8700 con 0x7fac9815fee0 2023-07-14T15:57:22.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.277+0000 7fac86ffd700 1 -- 172.21.15.37:0/393862909 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fac8c013b90 con 0x7fac9815fee0 2023-07-14T15:57:22.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.277+0000 7fac86ffd700 1 --2- 172.21.15.37:0/393862909 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fac7806ace0 0x7fac7806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:22.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.278+0000 7fac86ffd700 1 -- 172.21.15.37:0/393862909 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fac8c088f90 con 0x7fac9815fee0 2023-07-14T15:57:22.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.278+0000 7fac9659c700 1 --2- 172.21.15.37:0/393862909 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fac7806ace0 0x7fac7806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:22.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.279+0000 7fac9659c700 1 --2- 172.21.15.37:0/393862909 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fac7806ace0 0x7fac7806d190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fac88007fd0 tx=0x7fac88007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:22.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.282+0000 7fac86ffd700 1 -- 172.21.15.37:0/393862909 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fac8c057d90 con 0x7fac9815fee0 2023-07-14T15:57:22.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.490+0000 7fac9cfff700 1 -- 172.21.15.37:0/393862909 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fac98067840 con 0x7fac9815fee0 2023-07-14T15:57:22.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.491+0000 7fac86ffd700 1 -- 172.21.15.37:0/393862909 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) v1 ==== 93+0+10 (secure 0 0 0) 0x7fac8c057920 con 0x7fac9815fee0 2023-07-14T15:57:22.476 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-14T15:57:22.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.493+0000 7fac9cfff700 1 -- 172.21.15.37:0/393862909 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fac7806ace0 msgr2=0x7fac7806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:22.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.493+0000 7fac9cfff700 1 --2- 172.21.15.37:0/393862909 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fac7806ace0 0x7fac7806d190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fac88007fd0 tx=0x7fac88007de0 comp rx=0 tx=0).stop 2023-07-14T15:57:22.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.493+0000 7fac9cfff700 1 -- 172.21.15.37:0/393862909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac9815fee0 msgr2=0x7fac980c7a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:22.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.493+0000 7fac9cfff700 1 --2- 172.21.15.37:0/393862909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac9815fee0 0x7fac980c7a70 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fac8c00e840 tx=0x7fac8c00eb50 comp rx=0 tx=0).stop 2023-07-14T15:57:22.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.493+0000 7fac9cfff700 1 -- 172.21.15.37:0/393862909 shutdown_connections 2023-07-14T15:57:22.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.493+0000 7fac9cfff700 1 --2- 172.21.15.37:0/393862909 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fac980d1140 0x7fac981588a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:22.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.493+0000 7fac9cfff700 1 --2- 172.21.15.37:0/393862909 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fac7806ace0 0x7fac7806d190 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:22.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.493+0000 7fac9cfff700 1 --2- 172.21.15.37:0/393862909 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fac981603b0 0x7fac980b7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:22.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.493+0000 7fac9cfff700 1 --2- 172.21.15.37:0/393862909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac9815fee0 0x7fac980c7a70 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:22.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.493+0000 7fac9cfff700 1 -- 172.21.15.37:0/393862909 >> 172.21.15.37:0/393862909 conn(0x7fac9809c1b0 msgr2=0x7fac9815d650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:22.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.493+0000 7fac9cfff700 1 -- 172.21.15.37:0/393862909 shutdown_connections 2023-07-14T15:57:22.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.493+0000 7fac9cfff700 1 -- 172.21.15.37:0/393862909 wait complete. 2023-07-14T15:57:22.497 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T15:57:22.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.716+0000 7f865e1ff700 1 Processor -- start 2023-07-14T15:57:22.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.716+0000 7f865e1ff700 1 -- start start 2023-07-14T15:57:22.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.717+0000 7f865e1ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f86580cb430 0x7f86580cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:22.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.717+0000 7f865e1ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8658071820 0x7f865806cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:22.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.717+0000 7f865e1ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86580707f0 con 0x7f865806d0c0 2023-07-14T15:57:22.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.717+0000 7f865e1ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86580cbd40 con 0x7f8658071820 2023-07-14T15:57:22.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.717+0000 7f865e1ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8658070a60 con 0x7f86580cb430 2023-07-14T15:57:22.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.718+0000 7f8656ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8658071820 0x7f865806cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:22.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.718+0000 7f86577fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f86580cb430 0x7f86580cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:22.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.718+0000 7f8657fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f865806d0c0 0x7f865806b7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44762/0 (socket says 172.21.15.37:44762) 2023-07-14T15:57:22.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.718+0000 7f8657fff700 1 -- 172.21.15.37:0/2610236912 learned_addr learned my addr 172.21.15.37:0/2610236912 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:22.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.718+0000 7f8656ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8658071820 0x7f865806cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36358/0 (socket says 172.21.15.37:36358) 2023-07-14T15:57:22.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.718+0000 7f8656ffd700 1 -- 172.21.15.37:0/2610236912 >> v2:172.21.15.98:3300/0 conn(0x7f86580cb430 msgr2=0x7f86580cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:22.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.718+0000 7f8656ffd700 1 --2- 172.21.15.37:0/2610236912 >> v2:172.21.15.98:3300/0 conn(0x7f86580cb430 0x7f86580cb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:22.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.718+0000 7f8656ffd700 1 -- 172.21.15.37:0/2610236912 >> v1:172.21.15.37:6789/0 conn(0x7f865806d0c0 legacy=0x7f865806b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:22.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.718+0000 7f8656ffd700 1 -- 172.21.15.37:0/2610236912 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8658070d40 con 0x7f8658071820 2023-07-14T15:57:22.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.718+0000 7f86567fc700 1 -- 172.21.15.37:0/2610236912 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3900305077 0 0) 0x7f86580707f0 con 0x7f865806d0c0 2023-07-14T15:57:22.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.718+0000 7f86577fe700 1 --2- 172.21.15.37:0/2610236912 >> v2:172.21.15.98:3300/0 conn(0x7f86580cb430 0x7f86580cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:57:22.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.718+0000 7f8656ffd700 1 --2- 172.21.15.37:0/2610236912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8658071820 0x7f865806cb80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f865806f540 tx=0x7f864c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=260e36eac636899e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:22.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.719+0000 7f86567fc700 1 -- 172.21.15.37:0/2610236912 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c011830 con 0x7f8658071820 2023-07-14T15:57:22.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.719+0000 7f86567fc700 1 -- 172.21.15.37:0/2610236912 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864c011990 con 0x7f8658071820 2023-07-14T15:57:22.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.719+0000 7f86567fc700 1 -- 172.21.15.37:0/2610236912 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c011d20 con 0x7f8658071820 2023-07-14T15:57:22.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.719+0000 7f865e1ff700 1 -- 172.21.15.37:0/2610236912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8658071820 msgr2=0x7f865806cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:22.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.719+0000 7f865e1ff700 1 --2- 172.21.15.37:0/2610236912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8658071820 0x7f865806cb80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f865806f540 tx=0x7f864c009b20 comp rx=0 tx=0).stop 2023-07-14T15:57:22.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.719+0000 7f865e1ff700 1 -- 172.21.15.37:0/2610236912 shutdown_connections 2023-07-14T15:57:22.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.719+0000 7f865e1ff700 1 --2- 172.21.15.37:0/2610236912 >> v2:172.21.15.98:3300/0 conn(0x7f86580cb430 0x7f86580cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:22.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.719+0000 7f865e1ff700 1 --2- 172.21.15.37:0/2610236912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8658071820 0x7f865806cb80 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:22.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.719+0000 7f865e1ff700 1 -- 172.21.15.37:0/2610236912 >> 172.21.15.37:0/2610236912 conn(0x7f865806aac0 msgr2=0x7f86580b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:22.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.719+0000 7f865e1ff700 1 -- 172.21.15.37:0/2610236912 shutdown_connections 2023-07-14T15:57:22.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.719+0000 7f865e1ff700 1 -- 172.21.15.37:0/2610236912 wait complete. 2023-07-14T15:57:22.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.721+0000 7f865e1ff700 1 Processor -- start 2023-07-14T15:57:22.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.721+0000 7f865e1ff700 1 -- start start 2023-07-14T15:57:22.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.722+0000 7f865e1ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f865806d0c0 0x7f86580c4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:22.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.722+0000 7f865e1ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8658071820 0x7f86580c5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:22.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.722+0000 7f865e1ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f86580cb430 0x7f865814f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:22.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.722+0000 7f865e1ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8658150d60 con 0x7f8658071820 2023-07-14T15:57:22.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.722+0000 7f865e1ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86581500e0 con 0x7f865806d0c0 2023-07-14T15:57:22.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.722+0000 7f865e1ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86581503c0 con 0x7f86580cb430 2023-07-14T15:57:22.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.723+0000 7f8656ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8658071820 0x7f86580c5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:22.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.723+0000 7f8656ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8658071820 0x7f86580c5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36362/0 (socket says 172.21.15.37:36362) 2023-07-14T15:57:22.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.723+0000 7f8656ffd700 1 -- 172.21.15.37:0/2831788092 learned_addr learned my addr 172.21.15.37:0/2831788092 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:22.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.723+0000 7f86577fe700 1 --2- 172.21.15.37:0/2831788092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f865806d0c0 0x7f86580c4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:22.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.723+0000 7f8657fff700 1 --2- 172.21.15.37:0/2831788092 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f86580cb430 0x7f865814f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:22.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.723+0000 7f8656ffd700 1 -- 172.21.15.37:0/2831788092 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f86580cb430 msgr2=0x7f865814f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:22.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.723+0000 7f8656ffd700 1 --2- 172.21.15.37:0/2831788092 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f86580cb430 0x7f865814f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:22.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.723+0000 7f8656ffd700 1 -- 172.21.15.37:0/2831788092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f865806d0c0 msgr2=0x7f86580c4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:22.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.723+0000 7f8656ffd700 1 --2- 172.21.15.37:0/2831788092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f865806d0c0 0x7f86580c4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:22.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.723+0000 7f8656ffd700 1 -- 172.21.15.37:0/2831788092 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86480094a0 con 0x7f8658071820 2023-07-14T15:57:22.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.723+0000 7f8656ffd700 1 --2- 172.21.15.37:0/2831788092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8658071820 0x7f86580c5b50 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f864c009b60 tx=0x7f864c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:22.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.724+0000 7f863ffff700 1 -- 172.21.15.37:0/2831788092 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c0036a0 con 0x7f8658071820 2023-07-14T15:57:22.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.724+0000 7f863ffff700 1 -- 172.21.15.37:0/2831788092 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864c01f070 con 0x7f8658071820 2023-07-14T15:57:22.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.724+0000 7f863ffff700 1 -- 172.21.15.37:0/2831788092 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c003a40 con 0x7f8658071820 2023-07-14T15:57:22.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.724+0000 7f865e1ff700 1 -- 172.21.15.37:0/2831788092 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f864c0094a0 con 0x7f8658071820 2023-07-14T15:57:22.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.724+0000 7f865e1ff700 1 -- 172.21.15.37:0/2831788092 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8658150980 con 0x7f8658071820 2023-07-14T15:57:22.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.725+0000 7f865e1ff700 1 -- 172.21.15.37:0/2831788092 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86580ca640 con 0x7f8658071820 2023-07-14T15:57:22.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.726+0000 7f863ffff700 1 -- 172.21.15.37:0/2831788092 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f864c003ba0 con 0x7f8658071820 2023-07-14T15:57:22.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.727+0000 7f863ffff700 1 --2- 172.21.15.37:0/2831788092 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f864406ace0 0x7f864406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:22.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.727+0000 7f863ffff700 1 -- 172.21.15.37:0/2831788092 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f864c021070 con 0x7f8658071820 2023-07-14T15:57:22.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.728+0000 7f86577fe700 1 --2- 172.21.15.37:0/2831788092 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f864406ace0 0x7f864406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:22.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.728+0000 7f86577fe700 1 --2- 172.21.15.37:0/2831788092 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f864406ace0 0x7f864406d190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8648009c60 tx=0x7f8648008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:22.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.732+0000 7f863ffff700 1 -- 172.21.15.37:0/2831788092 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f864c055e90 con 0x7f8658071820 2023-07-14T15:57:22.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.939+0000 7f865e1ff700 1 -- 172.21.15.37:0/2831788092 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8658067840 con 0x7f8658071820 2023-07-14T15:57:22.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.939+0000 7f863ffff700 1 -- 172.21.15.37:0/2831788092 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v32) v1 ==== 92+0+10 (secure 0 0 0) 0x7f864c0150a0 con 0x7f8658071820 2023-07-14T15:57:22.925 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-14T15:57:22.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.941+0000 7f865e1ff700 1 -- 172.21.15.37:0/2831788092 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f864406ace0 msgr2=0x7f864406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:22.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.941+0000 7f865e1ff700 1 --2- 172.21.15.37:0/2831788092 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f864406ace0 0x7f864406d190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8648009c60 tx=0x7f8648008040 comp rx=0 tx=0).stop 2023-07-14T15:57:22.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.941+0000 7f865e1ff700 1 -- 172.21.15.37:0/2831788092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8658071820 msgr2=0x7f86580c5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:22.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.941+0000 7f865e1ff700 1 --2- 172.21.15.37:0/2831788092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8658071820 0x7f86580c5b50 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f864c009b60 tx=0x7f864c004750 comp rx=0 tx=0).stop 2023-07-14T15:57:22.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.941+0000 7f865e1ff700 1 -- 172.21.15.37:0/2831788092 shutdown_connections 2023-07-14T15:57:22.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.941+0000 7f865e1ff700 1 --2- 172.21.15.37:0/2831788092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f865806d0c0 0x7f86580c4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:22.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.941+0000 7f865e1ff700 1 --2- 172.21.15.37:0/2831788092 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f864406ace0 0x7f864406d190 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:22.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.941+0000 7f865e1ff700 1 --2- 172.21.15.37:0/2831788092 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f86580cb430 0x7f865814f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:22.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.941+0000 7f865e1ff700 1 --2- 172.21.15.37:0/2831788092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8658071820 0x7f86580c5b50 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:22.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.941+0000 7f865e1ff700 1 -- 172.21.15.37:0/2831788092 >> 172.21.15.37:0/2831788092 conn(0x7f865806aac0 msgr2=0x7f86580c97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:22.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.941+0000 7f865e1ff700 1 -- 172.21.15.37:0/2831788092 shutdown_connections 2023-07-14T15:57:22.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:22.941+0000 7f865e1ff700 1 -- 172.21.15.37:0/2831788092 wait complete. 2023-07-14T15:57:22.945 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-14T15:57:23.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.160+0000 7f94819ff700 1 Processor -- start 2023-07-14T15:57:23.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.160+0000 7f94819ff700 1 -- start start 2023-07-14T15:57:23.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.162+0000 7f94819ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f947c0b85f0 0x7f947c15d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:23.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.162+0000 7f94819ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f947c0b54b0 0x7f947c0cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:23.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.162+0000 7f94819ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f947c0cf6b0 con 0x7f947c0b4910 2023-07-14T15:57:23.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.162+0000 7f94819ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f947c0cdc40 con 0x7f947c0b54b0 2023-07-14T15:57:23.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.162+0000 7f94819ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f947c15dba0 con 0x7f947c0b85f0 2023-07-14T15:57:23.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.162+0000 7f947a7fc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f947c0b54b0 0x7f947c0cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:23.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.162+0000 7f947a7fc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f947c0b54b0 0x7f947c0cfb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36370/0 (socket says 172.21.15.37:36370) 2023-07-14T15:57:23.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.162+0000 7f947a7fc700 1 -- 172.21.15.37:0/699089580 learned_addr learned my addr 172.21.15.37:0/699089580 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:23.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.163+0000 7f947affd700 1 --2- 172.21.15.37:0/699089580 >> v2:172.21.15.98:3300/0 conn(0x7f947c0b85f0 0x7f947c15d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:23.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.163+0000 7f947a7fc700 1 -- 172.21.15.37:0/699089580 >> v2:172.21.15.98:3300/0 conn(0x7f947c0b85f0 msgr2=0x7f947c15d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:23.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.163+0000 7f947a7fc700 1 --2- 172.21.15.37:0/699089580 >> v2:172.21.15.98:3300/0 conn(0x7f947c0b85f0 0x7f947c15d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:23.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.163+0000 7f947a7fc700 1 -- 172.21.15.37:0/699089580 >> v1:172.21.15.98:6789/0 conn(0x7f947c0b4910 legacy=0x7f947c0b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:23.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.163+0000 7f947a7fc700 1 -- 172.21.15.37:0/699089580 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f947c0cf0a0 con 0x7f947c0b54b0 2023-07-14T15:57:23.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.163+0000 7f947a7fc700 1 --2- 172.21.15.37:0/699089580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f947c0b54b0 0x7f947c0cfb40 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f947c06a110 tx=0x7f9470009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c352f5f7e9e40c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:23.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.163+0000 7f9479ffb700 1 -- 172.21.15.37:0/699089580 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9470004230 con 0x7f947c0b54b0 2023-07-14T15:57:23.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.163+0000 7f9479ffb700 1 -- 172.21.15.37:0/699089580 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9470004390 con 0x7f947c0b54b0 2023-07-14T15:57:23.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.163+0000 7f9479ffb700 1 -- 172.21.15.37:0/699089580 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94700036a0 con 0x7f947c0b54b0 2023-07-14T15:57:23.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.164+0000 7f94819ff700 1 -- 172.21.15.37:0/699089580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f947c0b54b0 msgr2=0x7f947c0cfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:23.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.164+0000 7f94819ff700 1 --2- 172.21.15.37:0/699089580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f947c0b54b0 0x7f947c0cfb40 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f947c06a110 tx=0x7f9470009bd0 comp rx=0 tx=0).stop 2023-07-14T15:57:23.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.164+0000 7f94819ff700 1 -- 172.21.15.37:0/699089580 shutdown_connections 2023-07-14T15:57:23.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.164+0000 7f94819ff700 1 --2- 172.21.15.37:0/699089580 >> v2:172.21.15.98:3300/0 conn(0x7f947c0b85f0 0x7f947c15d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:23.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.164+0000 7f94819ff700 1 --2- 172.21.15.37:0/699089580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f947c0b54b0 0x7f947c0cfb40 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:23.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.164+0000 7f94819ff700 1 -- 172.21.15.37:0/699089580 >> 172.21.15.37:0/699089580 conn(0x7f947c06a580 msgr2=0x7f947c06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:23.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.164+0000 7f94819ff700 1 -- 172.21.15.37:0/699089580 shutdown_connections 2023-07-14T15:57:23.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.164+0000 7f94819ff700 1 -- 172.21.15.37:0/699089580 wait complete. 2023-07-14T15:57:23.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.166+0000 7f94819ff700 1 Processor -- start 2023-07-14T15:57:23.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.166+0000 7f94819ff700 1 -- start start 2023-07-14T15:57:23.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.167+0000 7f94819ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f947c0b4910 0x7f947c1f2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:23.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.167+0000 7f94819ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f947c0b54b0 0x7f947c159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:23.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.167+0000 7f94819ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f947c0b85f0 0x7f947c0cca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:23.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.167+0000 7f94819ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947c159690 con 0x7f947c0b54b0 2023-07-14T15:57:23.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.167+0000 7f94819ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947c1f3180 con 0x7f947c0b85f0 2023-07-14T15:57:23.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.167+0000 7f94819ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f947c158a80 con 0x7f947c0b4910 2023-07-14T15:57:23.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.167+0000 7f947a7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f947c0b54b0 0x7f947c159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:23.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.167+0000 7f947a7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f947c0b54b0 0x7f947c159b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36376/0 (socket says 172.21.15.37:36376) 2023-07-14T15:57:23.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.167+0000 7f947a7fc700 1 -- 172.21.15.37:0/1108576734 learned_addr learned my addr 172.21.15.37:0/1108576734 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:23.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.167+0000 7f947b7fe700 1 --2- 172.21.15.37:0/1108576734 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f947c0b85f0 0x7f947c0cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:23.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.167+0000 7f947affd700 1 --2- 172.21.15.37:0/1108576734 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f947c0b4910 0x7f947c1f2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:23.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.167+0000 7f947a7fc700 1 -- 172.21.15.37:0/1108576734 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f947c0b4910 msgr2=0x7f947c1f2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:23.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.168+0000 7f947a7fc700 1 --2- 172.21.15.37:0/1108576734 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f947c0b4910 0x7f947c1f2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:23.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.168+0000 7f947a7fc700 1 -- 172.21.15.37:0/1108576734 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f947c0b85f0 msgr2=0x7f947c0cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:23.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.168+0000 7f947a7fc700 1 --2- 172.21.15.37:0/1108576734 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f947c0b85f0 0x7f947c0cca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:23.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.168+0000 7f947a7fc700 1 -- 172.21.15.37:0/1108576734 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9470009550 con 0x7f947c0b54b0 2023-07-14T15:57:23.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.168+0000 7f947a7fc700 1 --2- 172.21.15.37:0/1108576734 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f947c0b54b0 0x7f947c159b20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9470009130 tx=0x7f9470004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:23.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.168+0000 7f9463fff700 1 -- 172.21.15.37:0/1108576734 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9470003d40 con 0x7f947c0b54b0 2023-07-14T15:57:23.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.168+0000 7f9463fff700 1 -- 172.21.15.37:0/1108576734 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f947001f070 con 0x7f947c0b54b0 2023-07-14T15:57:23.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.168+0000 7f9463fff700 1 -- 172.21.15.37:0/1108576734 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9470011870 con 0x7f947c0b54b0 2023-07-14T15:57:23.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.168+0000 7f94819ff700 1 -- 172.21.15.37:0/1108576734 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f947c158d60 con 0x7f947c0b54b0 2023-07-14T15:57:23.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.168+0000 7f94819ff700 1 -- 172.21.15.37:0/1108576734 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f947c159320 con 0x7f947c0b54b0 2023-07-14T15:57:23.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.169+0000 7f94819ff700 1 -- 172.21.15.37:0/1108576734 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f947c159840 con 0x7f947c0b54b0 2023-07-14T15:57:23.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.170+0000 7f9463fff700 1 -- 172.21.15.37:0/1108576734 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9470021030 con 0x7f947c0b54b0 2023-07-14T15:57:23.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.171+0000 7f9463fff700 1 --2- 172.21.15.37:0/1108576734 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f946806ace0 0x7f946806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:23.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.171+0000 7f9463fff700 1 -- 172.21.15.37:0/1108576734 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f947008a700 con 0x7f947c0b54b0 2023-07-14T15:57:23.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.171+0000 7f947affd700 1 --2- 172.21.15.37:0/1108576734 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f946806ace0 0x7f946806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:23.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.172+0000 7f947affd700 1 --2- 172.21.15.37:0/1108576734 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f946806ace0 0x7f946806d190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f946c00b9b0 tx=0x7f946c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:23.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.175+0000 7f9463fff700 1 -- 172.21.15.37:0/1108576734 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f947c159840 con 0x7f947c0b54b0 2023-07-14T15:57:23.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.382+0000 7f94819ff700 1 -- 172.21.15.37:0/1108576734 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f947c067840 con 0x7f947c0b54b0 2023-07-14T15:57:23.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.383+0000 7f9463fff700 1 -- 172.21.15.37:0/1108576734 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v32) v1 ==== 84+0+126 (secure 0 0 0) 0x7f9470055af0 con 0x7f947c0b54b0 2023-07-14T15:57:23.369 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:57:23.370 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-07-14T15:57:23.370 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:57:23.370 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2023-07-14T15:57:23.371 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2023-07-14T15:57:23.371 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-14T15:57:23.371 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:57:23.371 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 2, 2023-07-14T15:57:23.372 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": "rbd" 2023-07-14T15:57:23.372 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:57:23.372 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-07-14T15:57:23.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.385+0000 7f94819ff700 1 -- 172.21.15.37:0/1108576734 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f946806ace0 msgr2=0x7f946806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:23.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.385+0000 7f94819ff700 1 --2- 172.21.15.37:0/1108576734 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f946806ace0 0x7f946806d190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f946c00b9b0 tx=0x7f946c008040 comp rx=0 tx=0).stop 2023-07-14T15:57:23.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.385+0000 7f94819ff700 1 -- 172.21.15.37:0/1108576734 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f947c0b54b0 msgr2=0x7f947c159b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:23.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.385+0000 7f94819ff700 1 --2- 172.21.15.37:0/1108576734 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f947c0b54b0 0x7f947c159b20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9470009130 tx=0x7f9470004750 comp rx=0 tx=0).stop 2023-07-14T15:57:23.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.385+0000 7f94819ff700 1 -- 172.21.15.37:0/1108576734 shutdown_connections 2023-07-14T15:57:23.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.385+0000 7f94819ff700 1 --2- 172.21.15.37:0/1108576734 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f947c0b85f0 0x7f947c0cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:23.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.385+0000 7f94819ff700 1 --2- 172.21.15.37:0/1108576734 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f946806ace0 0x7f946806d190 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:23.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.385+0000 7f94819ff700 1 --2- 172.21.15.37:0/1108576734 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f947c0b4910 0x7f947c1f2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:23.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.385+0000 7f94819ff700 1 --2- 172.21.15.37:0/1108576734 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f947c0b54b0 0x7f947c159b20 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:23.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.385+0000 7f94819ff700 1 -- 172.21.15.37:0/1108576734 >> 172.21.15.37:0/1108576734 conn(0x7f947c06a580 msgr2=0x7f947c0d2e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:23.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.385+0000 7f94819ff700 1 -- 172.21.15.37:0/1108576734 shutdown_connections 2023-07-14T15:57:23.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.385+0000 7f94819ff700 1 -- 172.21.15.37:0/1108576734 wait complete. 2023-07-14T15:57:23.389 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-14T15:57:23.389 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-14T15:57:23.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.609+0000 7fe9ebdff700 1 Processor -- start 2023-07-14T15:57:23.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.610+0000 7fe9ebdff700 1 -- start start 2023-07-14T15:57:23.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.611+0000 7fe9ebdff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe9e406a580 0x7fe9e415ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:23.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.611+0000 7fe9ebdff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe9e415d3f0 0x7fe9e40ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:23.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.611+0000 7fe9ebdff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9e406e4f0 con 0x7fe9e40b1f30 2023-07-14T15:57:23.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.611+0000 7fe9ebdff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9e415dbe0 con 0x7fe9e406a580 2023-07-14T15:57:23.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.611+0000 7fe9ebdff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e41603a0 con 0x7fe9e415d3f0 2023-07-14T15:57:23.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.611+0000 7fe9e939a700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe9e406a580 0x7fe9e415ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:23.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.612+0000 7fe9ea39c700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe9e415d3f0 0x7fe9e40ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:23.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.612+0000 7fe9e939a700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe9e406a580 0x7fe9e415ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.37:53514/0 (socket says 172.21.15.37:53514) 2023-07-14T15:57:23.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.612+0000 7fe9e939a700 1 -- 172.21.15.37:0/3656554919 learned_addr learned my addr 172.21.15.37:0/3656554919 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:23.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.612+0000 7fe9e9b9b700 1 --1- 172.21.15.37:0/3656554919 >> v1:172.21.15.98:6789/0 conn(0x7fe9e40b1f30 0x7fe9e4069e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.37:43016/0 (socket says 172.21.15.37:43016) 2023-07-14T15:57:23.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.612+0000 7fe9ea39c700 1 -- 172.21.15.37:0/3656554919 >> v2:172.21.15.98:3300/0 conn(0x7fe9e406a580 msgr2=0x7fe9e415ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:23.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.612+0000 7fe9ea39c700 1 --2- 172.21.15.37:0/3656554919 >> v2:172.21.15.98:3300/0 conn(0x7fe9e406a580 0x7fe9e415ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:23.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.612+0000 7fe9ea39c700 1 -- 172.21.15.37:0/3656554919 >> v1:172.21.15.98:6789/0 conn(0x7fe9e40b1f30 legacy=0x7fe9e4069e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:23.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.612+0000 7fe9ea39c700 1 -- 172.21.15.37:0/3656554919 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e4160680 con 0x7fe9e415d3f0 2023-07-14T15:57:23.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.612+0000 7fe9e939a700 1 --2- 172.21.15.37:0/3656554919 >> v2:172.21.15.98:3300/0 conn(0x7fe9e406a580 0x7fe9e415ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:57:23.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.612+0000 7fe9e8b99700 1 -- 172.21.15.37:0/3656554919 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1281487609 0 0) 0x7fe9e0001110 con 0x7fe9e40b1f30 2023-07-14T15:57:23.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.612+0000 7fe9ea39c700 1 --2- 172.21.15.37:0/3656554919 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe9e415d3f0 0x7fe9e40ce6a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc009d90 tx=0x7fe9dc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32c71ba110b216ec server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:23.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.613+0000 7fe9e8b99700 1 -- 172.21.15.37:0/3656554919 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc00e070 con 0x7fe9e415d3f0 2023-07-14T15:57:23.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.613+0000 7fe9e8b99700 1 -- 172.21.15.37:0/3656554919 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9dc00bb20 con 0x7fe9e415d3f0 2023-07-14T15:57:23.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.613+0000 7fe9e8b99700 1 -- 172.21.15.37:0/3656554919 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc012430 con 0x7fe9e415d3f0 2023-07-14T15:57:23.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.613+0000 7fe9ebdff700 1 -- 172.21.15.37:0/3656554919 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe9e415d3f0 msgr2=0x7fe9e40ce6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:23.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.613+0000 7fe9ebdff700 1 --2- 172.21.15.37:0/3656554919 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe9e415d3f0 0x7fe9e40ce6a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc009d90 tx=0x7fe9dc00b330 comp rx=0 tx=0).stop 2023-07-14T15:57:23.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.613+0000 7fe9ebdff700 1 -- 172.21.15.37:0/3656554919 shutdown_connections 2023-07-14T15:57:23.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.613+0000 7fe9ebdff700 1 --2- 172.21.15.37:0/3656554919 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe9e415d3f0 0x7fe9e40ce6a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:23.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.613+0000 7fe9ebdff700 1 --2- 172.21.15.37:0/3656554919 >> v2:172.21.15.98:3300/0 conn(0x7fe9e406a580 0x7fe9e415ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:23.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.613+0000 7fe9ebdff700 1 -- 172.21.15.37:0/3656554919 >> 172.21.15.37:0/3656554919 conn(0x7fe9e40cc580 msgr2=0x7fe9e40cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:23.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.613+0000 7fe9ebdff700 1 -- 172.21.15.37:0/3656554919 shutdown_connections 2023-07-14T15:57:23.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.613+0000 7fe9ebdff700 1 -- 172.21.15.37:0/3656554919 wait complete. 2023-07-14T15:57:23.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.615+0000 7fe9ebdff700 1 Processor -- start 2023-07-14T15:57:23.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.615+0000 7fe9ebdff700 1 -- start start 2023-07-14T15:57:23.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.616+0000 7fe9ebdff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe9e406a580 0x7fe9e414ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:23.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.616+0000 7fe9ebdff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9e40b1f30 0x7fe9e40cfa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:23.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.616+0000 7fe9ebdff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9e415d3f0 0x7fe9e40cffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:23.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.616+0000 7fe9ebdff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e41e5f80 con 0x7fe9e415d3f0 2023-07-14T15:57:23.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.616+0000 7fe9ebdff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e41e6260 con 0x7fe9e40b1f30 2023-07-14T15:57:23.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.616+0000 7fe9ebdff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e41e6540 con 0x7fe9e406a580 2023-07-14T15:57:23.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.617+0000 7fe9e9b9b700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe9e406a580 0x7fe9e414ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:23.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.617+0000 7fe9ea39c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9e415d3f0 0x7fe9e40cffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:23.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.617+0000 7fe9e939a700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9e40b1f30 0x7fe9e40cfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:23.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.617+0000 7fe9e9b9b700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe9e406a580 0x7fe9e414ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3301/0 says I am v2:172.21.15.37:60966/0 (socket says 172.21.15.37:60966) 2023-07-14T15:57:23.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.617+0000 7fe9e9b9b700 1 -- 172.21.15.37:0/3066633832 learned_addr learned my addr 172.21.15.37:0/3066633832 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:23.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.617+0000 7fe9ea39c700 1 -- 172.21.15.37:0/3066633832 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe9e406a580 msgr2=0x7fe9e414ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:23.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.617+0000 7fe9ea39c700 1 --2- 172.21.15.37:0/3066633832 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe9e406a580 0x7fe9e414ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:23.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.617+0000 7fe9ea39c700 1 -- 172.21.15.37:0/3066633832 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9e40b1f30 msgr2=0x7fe9e40cfa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:23.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.617+0000 7fe9ea39c700 1 --2- 172.21.15.37:0/3066633832 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9e40b1f30 0x7fe9e40cfa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:23.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.617+0000 7fe9ea39c700 1 -- 172.21.15.37:0/3066633832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d4009550 con 0x7fe9e415d3f0 2023-07-14T15:57:23.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.617+0000 7fe9ea39c700 1 --2- 172.21.15.37:0/3066633832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9e415d3f0 0x7fe9e40cffc0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc016000 tx=0x7fe9dc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:23.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.618+0000 7fe9da7fc700 1 -- 172.21.15.37:0/3066633832 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc012430 con 0x7fe9e415d3f0 2023-07-14T15:57:23.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.618+0000 7fe9da7fc700 1 -- 172.21.15.37:0/3066633832 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9dc020070 con 0x7fe9e415d3f0 2023-07-14T15:57:23.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.618+0000 7fe9da7fc700 1 -- 172.21.15.37:0/3066633832 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc004280 con 0x7fe9e415d3f0 2023-07-14T15:57:23.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.618+0000 7fe9ebdff700 1 -- 172.21.15.37:0/3066633832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9dc009a70 con 0x7fe9e415d3f0 2023-07-14T15:57:23.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.618+0000 7fe9ebdff700 1 -- 172.21.15.37:0/3066633832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9e41e6b00 con 0x7fe9e415d3f0 2023-07-14T15:57:23.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.619+0000 7fe9ebdff700 1 -- 172.21.15.37:0/3066633832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9e4067840 con 0x7fe9e415d3f0 2023-07-14T15:57:23.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.620+0000 7fe9da7fc700 1 -- 172.21.15.37:0/3066633832 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe9dc0043e0 con 0x7fe9e415d3f0 2023-07-14T15:57:23.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.621+0000 7fe9da7fc700 1 --2- 172.21.15.37:0/3066633832 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe9c806ad10 0x7fe9c806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:23.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.621+0000 7fe9da7fc700 1 -- 172.21.15.37:0/3066633832 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe9dc022070 con 0x7fe9e415d3f0 2023-07-14T15:57:23.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.621+0000 7fe9e9b9b700 1 --2- 172.21.15.37:0/3066633832 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe9c806ad10 0x7fe9c806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:23.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.622+0000 7fe9e9b9b700 1 --2- 172.21.15.37:0/3066633832 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe9c806ad10 0x7fe9c806d1c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0007fd0 tx=0x7fe9e0007ce0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:23.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.625+0000 7fe9da7fc700 1 -- 172.21.15.37:0/3066633832 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe9dc0560c0 con 0x7fe9e415d3f0 2023-07-14T15:57:23.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.831+0000 7fe9ebdff700 1 -- 172.21.15.37:0/3066633832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fe9e40cd410 con 0x7fe9e415d3f0 2023-07-14T15:57:23.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.926+0000 7fe9da7fc700 1 -- 172.21.15.37:0/3066633832 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v33) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe9dc012e60 con 0x7fe9e415d3f0 2023-07-14T15:57:23.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.930+0000 7fe9ebdff700 1 -- 172.21.15.37:0/3066633832 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe9c806ad10 msgr2=0x7fe9c806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:23.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.930+0000 7fe9ebdff700 1 --2- 172.21.15.37:0/3066633832 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe9c806ad10 0x7fe9c806d1c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0007fd0 tx=0x7fe9e0007ce0 comp rx=0 tx=0).stop 2023-07-14T15:57:23.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.930+0000 7fe9ebdff700 1 -- 172.21.15.37:0/3066633832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9e415d3f0 msgr2=0x7fe9e40cffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:23.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.930+0000 7fe9ebdff700 1 --2- 172.21.15.37:0/3066633832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9e415d3f0 0x7fe9e40cffc0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc016000 tx=0x7fe9dc004ad0 comp rx=0 tx=0).stop 2023-07-14T15:57:23.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.931+0000 7fe9ebdff700 1 -- 172.21.15.37:0/3066633832 shutdown_connections 2023-07-14T15:57:23.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.931+0000 7fe9ebdff700 1 --2- 172.21.15.37:0/3066633832 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe9c806ad10 0x7fe9c806d1c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:23.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.931+0000 7fe9ebdff700 1 --2- 172.21.15.37:0/3066633832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9e415d3f0 0x7fe9e40cffc0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:23.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.931+0000 7fe9ebdff700 1 --2- 172.21.15.37:0/3066633832 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe9e406a580 0x7fe9e414ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:23.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.931+0000 7fe9ebdff700 1 --2- 172.21.15.37:0/3066633832 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9e40b1f30 0x7fe9e40cfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:23.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.931+0000 7fe9ebdff700 1 -- 172.21.15.37:0/3066633832 >> 172.21.15.37:0/3066633832 conn(0x7fe9e40cc580 msgr2=0x7fe9e415dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:23.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.932+0000 7fe9ebdff700 1 -- 172.21.15.37:0/3066633832 shutdown_connections 2023-07-14T15:57:23.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:23.932+0000 7fe9ebdff700 1 -- 172.21.15.37:0/3066633832 wait complete. 2023-07-14T15:57:23.919 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2023-07-14T15:57:23.937 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-14T15:57:24.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.159+0000 7f100f1ff700 1 Processor -- start 2023-07-14T15:57:24.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.159+0000 7f100f1ff700 1 -- start start 2023-07-14T15:57:24.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.160+0000 7f100f1ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f10080d2ab0 0x7f10080b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:24.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.160+0000 7f100f1ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f10080d11a0 0x7f10080b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:24.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.160+0000 7f100f1ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10080b4720 con 0x7f100815ff50 2023-07-14T15:57:24.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.160+0000 7f100f1ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10080b3a50 con 0x7f10080d2ab0 2023-07-14T15:57:24.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.161+0000 7f100f1ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10080b0560 con 0x7f10080d11a0 2023-07-14T15:57:24.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.161+0000 7f1007fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f10080d2ab0 0x7f10080b0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:24.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.161+0000 7f100d79c700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f10080d11a0 0x7f10080b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:24.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.161+0000 7f100d79c700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f10080d11a0 0x7f10080b14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3301/0 says I am v2:172.21.15.37:60978/0 (socket says 172.21.15.37:60978) 2023-07-14T15:57:24.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.161+0000 7f1007fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f10080d2ab0 0x7f10080b0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.37:53524/0 (socket says 172.21.15.37:53524) 2023-07-14T15:57:24.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.161+0000 7f100d79c700 1 -- 172.21.15.37:0/3285136122 learned_addr learned my addr 172.21.15.37:0/3285136122 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:24.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.161+0000 7f100d79c700 1 -- 172.21.15.37:0/3285136122 >> v2:172.21.15.98:3300/0 conn(0x7f10080d2ab0 msgr2=0x7f10080b0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:24.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.161+0000 7f10077fe700 1 -- 172.21.15.37:0/3285136122 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3209192942 0 0) 0x7f0ffc001110 con 0x7f100815ff50 2023-07-14T15:57:24.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.161+0000 7f100d79c700 1 --2- 172.21.15.37:0/3285136122 >> v2:172.21.15.98:3300/0 conn(0x7f10080d2ab0 0x7f10080b0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:24.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.161+0000 7f100d79c700 1 -- 172.21.15.37:0/3285136122 >> v1:172.21.15.98:6789/0 conn(0x7f100815ff50 legacy=0x7f10080d0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:24.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.161+0000 7f100d79c700 1 -- 172.21.15.37:0/3285136122 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10080b0b20 con 0x7f10080d11a0 2023-07-14T15:57:24.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.161+0000 7f1007fff700 1 --2- 172.21.15.37:0/3285136122 >> v2:172.21.15.98:3300/0 conn(0x7f10080d2ab0 0x7f10080b0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:57:24.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.162+0000 7f100d79c700 1 --2- 172.21.15.37:0/3285136122 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f10080d11a0 0x7f10080b14f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1000009e50 tx=0x7f100000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6dbcc62d5228660 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:24.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.162+0000 7f10077fe700 1 -- 172.21.15.37:0/3285136122 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100000e070 con 0x7f10080d11a0 2023-07-14T15:57:24.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.162+0000 7f10077fe700 1 -- 172.21.15.37:0/3285136122 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100000b910 con 0x7f10080d11a0 2023-07-14T15:57:24.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.162+0000 7f10077fe700 1 -- 172.21.15.37:0/3285136122 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100000bcc0 con 0x7f10080d11a0 2023-07-14T15:57:24.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.163+0000 7f100f1ff700 1 -- 172.21.15.37:0/3285136122 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f10080d11a0 msgr2=0x7f10080b14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:24.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.163+0000 7f100f1ff700 1 --2- 172.21.15.37:0/3285136122 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f10080d11a0 0x7f10080b14f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1000009e50 tx=0x7f100000b330 comp rx=0 tx=0).stop 2023-07-14T15:57:24.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.163+0000 7f100f1ff700 1 -- 172.21.15.37:0/3285136122 shutdown_connections 2023-07-14T15:57:24.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.163+0000 7f100f1ff700 1 --2- 172.21.15.37:0/3285136122 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f10080d11a0 0x7f10080b14f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:24.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.163+0000 7f100f1ff700 1 --2- 172.21.15.37:0/3285136122 >> v2:172.21.15.98:3300/0 conn(0x7f10080d2ab0 0x7f10080b0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:24.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.163+0000 7f100f1ff700 1 -- 172.21.15.37:0/3285136122 >> 172.21.15.37:0/3285136122 conn(0x7f100809c1f0 msgr2=0x7f10080d2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:24.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.163+0000 7f100f1ff700 1 -- 172.21.15.37:0/3285136122 shutdown_connections 2023-07-14T15:57:24.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.163+0000 7f100f1ff700 1 -- 172.21.15.37:0/3285136122 wait complete. 2023-07-14T15:57:24.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.164+0000 7f100f1ff700 1 Processor -- start 2023-07-14T15:57:24.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.165+0000 7f100f1ff700 1 -- start start 2023-07-14T15:57:24.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.166+0000 7f100f1ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f10080d11a0 0x7f10081f2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:24.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.166+0000 7f100f1ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f100815ff50 0x7f10080c9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:24.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.166+0000 7f100f1ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10081f3010 0x7f10080ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:24.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.166+0000 7f100f1ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10080ccd50 con 0x7f10081f3010 2023-07-14T15:57:24.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.166+0000 7f100f1ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10080cc140 con 0x7f100815ff50 2023-07-14T15:57:24.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.166+0000 7f100f1ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10080cc420 con 0x7f10080d11a0 2023-07-14T15:57:24.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.166+0000 7f100d79c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10081f3010 0x7f10080ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:24.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.166+0000 7f100d79c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10081f3010 0x7f10080ca4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36390/0 (socket says 172.21.15.37:36390) 2023-07-14T15:57:24.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.166+0000 7f100d79c700 1 -- 172.21.15.37:0/1351013601 learned_addr learned my addr 172.21.15.37:0/1351013601 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:24.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.166+0000 7f100cf9b700 1 --2- 172.21.15.37:0/1351013601 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f10080d11a0 0x7f10081f2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:24.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.166+0000 7f1007fff700 1 --2- 172.21.15.37:0/1351013601 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f100815ff50 0x7f10080c9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:24.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.166+0000 7f100d79c700 1 -- 172.21.15.37:0/1351013601 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f10080d11a0 msgr2=0x7f10081f2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:24.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.166+0000 7f100d79c700 1 --2- 172.21.15.37:0/1351013601 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f10080d11a0 0x7f10081f2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:24.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.166+0000 7f100d79c700 1 -- 172.21.15.37:0/1351013601 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f100815ff50 msgr2=0x7f10080c9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:24.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.166+0000 7f100d79c700 1 --2- 172.21.15.37:0/1351013601 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f100815ff50 0x7f10080c9f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:24.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.166+0000 7f100d79c700 1 -- 172.21.15.37:0/1351013601 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff40094a0 con 0x7f10081f3010 2023-07-14T15:57:24.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.167+0000 7f100d79c700 1 --2- 172.21.15.37:0/1351013601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10081f3010 0x7f10080ca4d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1000012000 tx=0x7f1000004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:24.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.167+0000 7f10057fa700 1 -- 172.21.15.37:0/1351013601 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1000003ea0 con 0x7f10081f3010 2023-07-14T15:57:24.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.167+0000 7f100f1ff700 1 -- 172.21.15.37:0/1351013601 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1000009b30 con 0x7f10081f3010 2023-07-14T15:57:24.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.167+0000 7f10057fa700 1 -- 172.21.15.37:0/1351013601 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10000048e0 con 0x7f10081f3010 2023-07-14T15:57:24.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.167+0000 7f10057fa700 1 -- 172.21.15.37:0/1351013601 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100001c680 con 0x7f10081f3010 2023-07-14T15:57:24.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.167+0000 7f100f1ff700 1 -- 172.21.15.37:0/1351013601 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10080cc9e0 con 0x7f10081f3010 2023-07-14T15:57:24.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.168+0000 7f100f1ff700 1 -- 172.21.15.37:0/1351013601 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10080b2690 con 0x7f10081f3010 2023-07-14T15:57:24.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.170+0000 7f10057fa700 1 -- 172.21.15.37:0/1351013601 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f100001c7e0 con 0x7f10081f3010 2023-07-14T15:57:24.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.171+0000 7f10057fa700 1 --2- 172.21.15.37:0/1351013601 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0fec06ace0 0x7f0fec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:24.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.171+0000 7f10057fa700 1 -- 172.21.15.37:0/1351013601 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f100008b490 con 0x7f10081f3010 2023-07-14T15:57:24.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.171+0000 7f100cf9b700 1 --2- 172.21.15.37:0/1351013601 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0fec06ace0 0x7f0fec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:24.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.172+0000 7f100cf9b700 1 --2- 172.21.15.37:0/1351013601 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0fec06ace0 0x7f0fec06d190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc007fd0 tx=0x7f0ffc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:24.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.174+0000 7f10057fa700 1 -- 172.21.15.37:0/1351013601 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1000056830 con 0x7f10081f3010 2023-07-14T15:57:24.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.381+0000 7f100f1ff700 1 -- 172.21.15.37:0/1351013601 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f1008067840 con 0x7f10081f3010 2023-07-14T15:57:24.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.928+0000 7f10057fa700 1 -- 172.21.15.37:0/1351013601 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v34) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1000059e50 con 0x7f10081f3010 2023-07-14T15:57:24.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.934+0000 7f100f1ff700 1 -- 172.21.15.37:0/1351013601 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0fec06ace0 msgr2=0x7f0fec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:24.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.934+0000 7f100f1ff700 1 --2- 172.21.15.37:0/1351013601 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0fec06ace0 0x7f0fec06d190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc007fd0 tx=0x7f0ffc009040 comp rx=0 tx=0).stop 2023-07-14T15:57:24.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.934+0000 7f100f1ff700 1 -- 172.21.15.37:0/1351013601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10081f3010 msgr2=0x7f10080ca4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:24.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.934+0000 7f100f1ff700 1 --2- 172.21.15.37:0/1351013601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10081f3010 0x7f10080ca4d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1000012000 tx=0x7f1000004ad0 comp rx=0 tx=0).stop 2023-07-14T15:57:24.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.943+0000 7f100f1ff700 1 -- 172.21.15.37:0/1351013601 shutdown_connections 2023-07-14T15:57:24.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.943+0000 7f100f1ff700 1 --2- 172.21.15.37:0/1351013601 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0fec06ace0 0x7f0fec06d190 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:24.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.943+0000 7f100f1ff700 1 --2- 172.21.15.37:0/1351013601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10081f3010 0x7f10080ca4d0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:24.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.943+0000 7f100f1ff700 1 --2- 172.21.15.37:0/1351013601 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f10080d11a0 0x7f10081f2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:24.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.943+0000 7f100f1ff700 1 --2- 172.21.15.37:0/1351013601 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f100815ff50 0x7f10080c9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:24.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.943+0000 7f100f1ff700 1 -- 172.21.15.37:0/1351013601 >> 172.21.15.37:0/1351013601 conn(0x7f100809c1f0 msgr2=0x7f100806b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:24.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.944+0000 7f100f1ff700 1 -- 172.21.15.37:0/1351013601 shutdown_connections 2023-07-14T15:57:24.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:24.945+0000 7f100f1ff700 1 -- 172.21.15.37:0/1351013601 wait complete. 2023-07-14T15:57:24.937 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2023-07-14T15:57:24.956 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-14T15:57:25.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.179+0000 7f3bab9ff700 1 Processor -- start 2023-07-14T15:57:25.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.179+0000 7f3bab9ff700 1 -- start start 2023-07-14T15:57:25.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.180+0000 7f3bab9ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3ba415fee0 0x7f3ba415ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:25.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.180+0000 7f3bab9ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3ba40d1140 0x7f3ba40b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:25.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.180+0000 7f3bab9ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ba415dc50 con 0x7f3ba41603b0 2023-07-14T15:57:25.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.180+0000 7f3bab9ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ba40b2940 con 0x7f3ba40d1140 2023-07-14T15:57:25.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.180+0000 7f3bab9ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba40b2c20 con 0x7f3ba415fee0 2023-07-14T15:57:25.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.181+0000 7f3ba9f9c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3ba40d1140 0x7f3ba40b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:25.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.181+0000 7f3ba9f9c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3ba40d1140 0x7f3ba40b39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36402/0 (socket says 172.21.15.37:36402) 2023-07-14T15:57:25.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.181+0000 7f3ba9f9c700 1 -- 172.21.15.37:0/2415766290 learned_addr learned my addr 172.21.15.37:0/2415766290 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:25.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.181+0000 7f3ba979b700 1 --2- 172.21.15.37:0/2415766290 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3ba415fee0 0x7f3ba415ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:25.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.181+0000 7f3ba9f9c700 1 -- 172.21.15.37:0/2415766290 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3ba415fee0 msgr2=0x7f3ba415ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:25.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.181+0000 7f3ba9f9c700 1 --2- 172.21.15.37:0/2415766290 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3ba415fee0 0x7f3ba415ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:25.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.181+0000 7f3ba9f9c700 1 -- 172.21.15.37:0/2415766290 >> v1:172.21.15.98:6789/0 conn(0x7f3ba41603b0 legacy=0x7f3ba40d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:25.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.181+0000 7f3ba9f9c700 1 -- 172.21.15.37:0/2415766290 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba40b2f00 con 0x7f3ba40d1140 2023-07-14T15:57:25.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.182+0000 7f3ba9f9c700 1 --2- 172.21.15.37:0/2415766290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ba40d1140 0x7f3ba40b39e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c009e50 tx=0x7f3b9c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e9ef5c9f1bb3484 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:25.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.182+0000 7f3b9bfff700 1 -- 172.21.15.37:0/2415766290 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c00e070 con 0x7f3ba40d1140 2023-07-14T15:57:25.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.182+0000 7f3b9bfff700 1 -- 172.21.15.37:0/2415766290 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b9c00b9c0 con 0x7f3ba40d1140 2023-07-14T15:57:25.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.182+0000 7f3b9bfff700 1 -- 172.21.15.37:0/2415766290 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c00bd70 con 0x7f3ba40d1140 2023-07-14T15:57:25.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.182+0000 7f3bab9ff700 1 -- 172.21.15.37:0/2415766290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ba40d1140 msgr2=0x7f3ba40b39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:25.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.182+0000 7f3bab9ff700 1 --2- 172.21.15.37:0/2415766290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ba40d1140 0x7f3ba40b39e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c009e50 tx=0x7f3b9c00b330 comp rx=0 tx=0).stop 2023-07-14T15:57:25.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.182+0000 7f3bab9ff700 1 -- 172.21.15.37:0/2415766290 shutdown_connections 2023-07-14T15:57:25.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.182+0000 7f3bab9ff700 1 --2- 172.21.15.37:0/2415766290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ba40d1140 0x7f3ba40b39e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:25.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.182+0000 7f3bab9ff700 1 --2- 172.21.15.37:0/2415766290 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3ba415fee0 0x7f3ba415ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:25.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.182+0000 7f3bab9ff700 1 -- 172.21.15.37:0/2415766290 >> 172.21.15.37:0/2415766290 conn(0x7f3ba409c1b0 msgr2=0x7f3ba40d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:25.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.183+0000 7f3bab9ff700 1 -- 172.21.15.37:0/2415766290 shutdown_connections 2023-07-14T15:57:25.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.183+0000 7f3bab9ff700 1 -- 172.21.15.37:0/2415766290 wait complete. 2023-07-14T15:57:25.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.184+0000 7f3bab9ff700 1 Processor -- start 2023-07-14T15:57:25.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.184+0000 7f3bab9ff700 1 -- start start 2023-07-14T15:57:25.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.185+0000 7f3bab9ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3ba40d1140 0x7f3ba41f28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:25.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.185+0000 7f3bab9ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ba415fee0 0x7f3ba406b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:25.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.185+0000 7f3bab9ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ba41603b0 0x7f3ba41f53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:25.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.186+0000 7f3bab9ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba41f1e00 con 0x7f3ba41603b0 2023-07-14T15:57:25.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.186+0000 7f3bab9ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba41f5e40 con 0x7f3ba415fee0 2023-07-14T15:57:25.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.186+0000 7f3bab9ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba41f6120 con 0x7f3ba40d1140 2023-07-14T15:57:25.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.186+0000 7f3ba9f9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ba41603b0 0x7f3ba41f53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:25.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.186+0000 7f3ba9f9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ba41603b0 0x7f3ba41f53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36416/0 (socket says 172.21.15.37:36416) 2023-07-14T15:57:25.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.186+0000 7f3ba9f9c700 1 -- 172.21.15.37:0/2845148621 learned_addr learned my addr 172.21.15.37:0/2845148621 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:25.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.186+0000 7f3ba8f9a700 1 --2- 172.21.15.37:0/2845148621 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ba415fee0 0x7f3ba406b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:25.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.186+0000 7f3ba979b700 1 --2- 172.21.15.37:0/2845148621 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3ba40d1140 0x7f3ba41f28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:25.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.186+0000 7f3ba9f9c700 1 -- 172.21.15.37:0/2845148621 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3ba40d1140 msgr2=0x7f3ba41f28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:25.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.186+0000 7f3ba9f9c700 1 --2- 172.21.15.37:0/2845148621 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3ba40d1140 0x7f3ba41f28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:25.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.186+0000 7f3ba9f9c700 1 -- 172.21.15.37:0/2845148621 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ba415fee0 msgr2=0x7f3ba406b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:25.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.186+0000 7f3ba9f9c700 1 --2- 172.21.15.37:0/2845148621 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ba415fee0 0x7f3ba406b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:25.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.186+0000 7f3ba9f9c700 1 -- 172.21.15.37:0/2845148621 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b9c009b30 con 0x7f3ba41603b0 2023-07-14T15:57:25.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.187+0000 7f3ba9f9c700 1 --2- 172.21.15.37:0/2845148621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ba41603b0 0x7f3ba41f53f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c012000 tx=0x7f3b9c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:25.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.187+0000 7f3b99ffb700 1 -- 172.21.15.37:0/2845148621 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c004800 con 0x7f3ba41603b0 2023-07-14T15:57:25.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.187+0000 7f3b99ffb700 1 -- 172.21.15.37:0/2845148621 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b9c004960 con 0x7f3ba41603b0 2023-07-14T15:57:25.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.187+0000 7f3b99ffb700 1 -- 172.21.15.37:0/2845148621 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c01c680 con 0x7f3ba41603b0 2023-07-14T15:57:25.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.187+0000 7f3bab9ff700 1 -- 172.21.15.37:0/2845148621 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ba41f20c0 con 0x7f3ba41603b0 2023-07-14T15:57:25.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.187+0000 7f3bab9ff700 1 -- 172.21.15.37:0/2845148621 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ba406b6b0 con 0x7f3ba41603b0 2023-07-14T15:57:25.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.188+0000 7f3bab9ff700 1 -- 172.21.15.37:0/2845148621 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ba406b870 con 0x7f3ba41603b0 2023-07-14T15:57:25.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.189+0000 7f3b99ffb700 1 -- 172.21.15.37:0/2845148621 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3b9c01c7e0 con 0x7f3ba41603b0 2023-07-14T15:57:25.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.190+0000 7f3b99ffb700 1 --2- 172.21.15.37:0/2845148621 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f3b8806ace0 0x7f3b8806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:25.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.190+0000 7f3b99ffb700 1 -- 172.21.15.37:0/2845148621 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f3b9c08ac60 con 0x7f3ba41603b0 2023-07-14T15:57:25.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.191+0000 7f3ba979b700 1 --2- 172.21.15.37:0/2845148621 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f3b8806ace0 0x7f3b8806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:25.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.191+0000 7f3ba979b700 1 --2- 172.21.15.37:0/2845148621 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f3b8806ace0 0x7f3b8806d190 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0006b20 tx=0x7f3ba0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:25.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.195+0000 7f3b99ffb700 1 -- 172.21.15.37:0/2845148621 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3b9c055d60 con 0x7f3ba41603b0 2023-07-14T15:57:25.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.444+0000 7f3bab9ff700 1 -- 172.21.15.37:0/2845148621 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3ba41f2580 con 0x7f3ba41603b0 2023-07-14T15:57:25.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.930+0000 7f3b99ffb700 1 -- 172.21.15.37:0/2845148621 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f3b9c059380 con 0x7f3ba41603b0 2023-07-14T15:57:25.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.936+0000 7f3bab9ff700 1 -- 172.21.15.37:0/2845148621 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f3b8806ace0 msgr2=0x7f3b8806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:25.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.937+0000 7f3bab9ff700 1 --2- 172.21.15.37:0/2845148621 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f3b8806ace0 0x7f3b8806d190 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0006b20 tx=0x7f3ba0008040 comp rx=0 tx=0).stop 2023-07-14T15:57:25.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.937+0000 7f3bab9ff700 1 -- 172.21.15.37:0/2845148621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ba41603b0 msgr2=0x7f3ba41f53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:25.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.937+0000 7f3bab9ff700 1 --2- 172.21.15.37:0/2845148621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ba41603b0 0x7f3ba41f53f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c012000 tx=0x7f3b9c004ad0 comp rx=0 tx=0).stop 2023-07-14T15:57:25.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.937+0000 7f3bab9ff700 1 -- 172.21.15.37:0/2845148621 shutdown_connections 2023-07-14T15:57:25.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.937+0000 7f3bab9ff700 1 --2- 172.21.15.37:0/2845148621 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f3b8806ace0 0x7f3b8806d190 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:25.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.937+0000 7f3bab9ff700 1 --2- 172.21.15.37:0/2845148621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ba41603b0 0x7f3ba41f53f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:25.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.937+0000 7f3bab9ff700 1 --2- 172.21.15.37:0/2845148621 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3ba40d1140 0x7f3ba41f28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:25.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.937+0000 7f3bab9ff700 1 --2- 172.21.15.37:0/2845148621 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ba415fee0 0x7f3ba406b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:25.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.937+0000 7f3bab9ff700 1 -- 172.21.15.37:0/2845148621 >> 172.21.15.37:0/2845148621 conn(0x7f3ba409c1b0 msgr2=0x7f3ba415b180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:25.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.937+0000 7f3bab9ff700 1 -- 172.21.15.37:0/2845148621 shutdown_connections 2023-07-14T15:57:25.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:25.937+0000 7f3bab9ff700 1 -- 172.21.15.37:0/2845148621 wait complete. 2023-07-14T15:57:25.926 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 5 and data pool 6 2023-07-14T15:57:25.947 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T15:57:26.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.164+0000 7fbf391ff700 1 Processor -- start 2023-07-14T15:57:26.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.165+0000 7fbf391ff700 1 -- start start 2023-07-14T15:57:26.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.166+0000 7fbf391ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbf340b8b80 0x7fbf340b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:26.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.166+0000 7fbf391ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fbf340cffc0 0x7fbf340cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:26.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.166+0000 7fbf391ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf340cf6f0 con 0x7fbf34160c50 2023-07-14T15:57:26.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.166+0000 7fbf391ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf340d0de0 con 0x7fbf340cffc0 2023-07-14T15:57:26.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.166+0000 7fbf391ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf340cd590 con 0x7fbf340b8b80 2023-07-14T15:57:26.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.166+0000 7fbf3359e700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fbf340cffc0 0x7fbf340cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:26.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.166+0000 7fbf32d9d700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbf340b8b80 0x7fbf340b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:26.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.166+0000 7fbf3359e700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fbf340cffc0 0x7fbf340cf1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.37:53544/0 (socket says 172.21.15.37:53544) 2023-07-14T15:57:26.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.166+0000 7fbf3359e700 1 -- 172.21.15.37:0/3359434284 learned_addr learned my addr 172.21.15.37:0/3359434284 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:26.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.167+0000 7fbf3359e700 1 -- 172.21.15.37:0/3359434284 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbf340b8b80 msgr2=0x7fbf340b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:26.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.167+0000 7fbf3359e700 1 --2- 172.21.15.37:0/3359434284 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbf340b8b80 0x7fbf340b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:26.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.167+0000 7fbf3359e700 1 -- 172.21.15.37:0/3359434284 >> v1:172.21.15.98:6789/0 conn(0x7fbf34160c50 legacy=0x7fbf340cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:26.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.167+0000 7fbf3359e700 1 -- 172.21.15.37:0/3359434284 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf340cd870 con 0x7fbf340cffc0 2023-07-14T15:57:26.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.167+0000 7fbf32d9d700 1 --2- 172.21.15.37:0/3359434284 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbf340b8b80 0x7fbf340b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:57:26.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.167+0000 7fbf3359e700 1 --2- 172.21.15.37:0/3359434284 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf340cffc0 0x7fbf340cf1b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c009e50 tx=0x7fbf2c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d43659a8279a4cba server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:26.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.167+0000 7fbf3259c700 1 -- 172.21.15.37:0/3359434284 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c00e070 con 0x7fbf340cffc0 2023-07-14T15:57:26.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.167+0000 7fbf3259c700 1 -- 172.21.15.37:0/3359434284 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf2c00b910 con 0x7fbf340cffc0 2023-07-14T15:57:26.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.167+0000 7fbf3259c700 1 -- 172.21.15.37:0/3359434284 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c00bcc0 con 0x7fbf340cffc0 2023-07-14T15:57:26.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.168+0000 7fbf391ff700 1 -- 172.21.15.37:0/3359434284 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf340cffc0 msgr2=0x7fbf340cf1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:26.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.168+0000 7fbf391ff700 1 --2- 172.21.15.37:0/3359434284 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf340cffc0 0x7fbf340cf1b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c009e50 tx=0x7fbf2c00b330 comp rx=0 tx=0).stop 2023-07-14T15:57:26.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.168+0000 7fbf391ff700 1 -- 172.21.15.37:0/3359434284 shutdown_connections 2023-07-14T15:57:26.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.168+0000 7fbf391ff700 1 --2- 172.21.15.37:0/3359434284 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf340cffc0 0x7fbf340cf1b0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:26.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.168+0000 7fbf391ff700 1 --2- 172.21.15.37:0/3359434284 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbf340b8b80 0x7fbf340b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:26.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.168+0000 7fbf391ff700 1 -- 172.21.15.37:0/3359434284 >> 172.21.15.37:0/3359434284 conn(0x7fbf3406b150 msgr2=0x7fbf3406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:26.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.168+0000 7fbf391ff700 1 -- 172.21.15.37:0/3359434284 shutdown_connections 2023-07-14T15:57:26.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.168+0000 7fbf391ff700 1 -- 172.21.15.37:0/3359434284 wait complete. 2023-07-14T15:57:26.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.170+0000 7fbf391ff700 1 Processor -- start 2023-07-14T15:57:26.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.170+0000 7fbf391ff700 1 -- start start 2023-07-14T15:57:26.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.171+0000 7fbf391ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf340b8b80 0x7fbf3415b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:26.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.171+0000 7fbf391ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbf340cffc0 0x7fbf3415c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:26.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.171+0000 7fbf391ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf34160c50 0x7fbf3415c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:26.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.171+0000 7fbf391ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf340c8eb0 con 0x7fbf340b8b80 2023-07-14T15:57:26.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.171+0000 7fbf391ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3415ba00 con 0x7fbf34160c50 2023-07-14T15:57:26.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.171+0000 7fbf391ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf340cc8d0 con 0x7fbf340cffc0 2023-07-14T15:57:26.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.171+0000 7fbf32d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf340b8b80 0x7fbf3415b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:26.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.171+0000 7fbf32d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf340b8b80 0x7fbf3415b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36418/0 (socket says 172.21.15.37:36418) 2023-07-14T15:57:26.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.171+0000 7fbf32d9d700 1 -- 172.21.15.37:0/1047106354 learned_addr learned my addr 172.21.15.37:0/1047106354 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:26.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.171+0000 7fbf3359e700 1 --2- 172.21.15.37:0/1047106354 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf34160c50 0x7fbf3415c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:26.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.171+0000 7fbf2bfff700 1 --2- 172.21.15.37:0/1047106354 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbf340cffc0 0x7fbf3415c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:26.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.171+0000 7fbf32d9d700 1 -- 172.21.15.37:0/1047106354 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbf340cffc0 msgr2=0x7fbf3415c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:26.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.171+0000 7fbf32d9d700 1 --2- 172.21.15.37:0/1047106354 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbf340cffc0 0x7fbf3415c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:26.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.171+0000 7fbf32d9d700 1 -- 172.21.15.37:0/1047106354 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf34160c50 msgr2=0x7fbf3415c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:26.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.171+0000 7fbf32d9d700 1 --2- 172.21.15.37:0/1047106354 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf34160c50 0x7fbf3415c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:26.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.171+0000 7fbf32d9d700 1 -- 172.21.15.37:0/1047106354 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf240094a0 con 0x7fbf340b8b80 2023-07-14T15:57:26.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.171+0000 7fbf3359e700 1 --2- 172.21.15.37:0/1047106354 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf34160c50 0x7fbf3415c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:57:26.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.171+0000 7fbf2bfff700 1 --2- 172.21.15.37:0/1047106354 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbf340cffc0 0x7fbf3415c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:57:26.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.172+0000 7fbf32d9d700 1 --2- 172.21.15.37:0/1047106354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf340b8b80 0x7fbf3415b4c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fbf2400ebe0 tx=0x7fbf24009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:26.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.172+0000 7fbf2b7fe700 1 -- 172.21.15.37:0/1047106354 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2400c910 con 0x7fbf340b8b80 2023-07-14T15:57:26.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.172+0000 7fbf2b7fe700 1 -- 172.21.15.37:0/1047106354 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf2400ca70 con 0x7fbf340b8b80 2023-07-14T15:57:26.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.172+0000 7fbf2b7fe700 1 -- 172.21.15.37:0/1047106354 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2400cde0 con 0x7fbf340b8b80 2023-07-14T15:57:26.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.172+0000 7fbf391ff700 1 -- 172.21.15.37:0/1047106354 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf2c009b30 con 0x7fbf340b8b80 2023-07-14T15:57:26.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.172+0000 7fbf391ff700 1 -- 172.21.15.37:0/1047106354 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf341e6460 con 0x7fbf340b8b80 2023-07-14T15:57:26.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.173+0000 7fbf391ff700 1 -- 172.21.15.37:0/1047106354 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf340b6050 con 0x7fbf340b8b80 2023-07-14T15:57:26.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.174+0000 7fbf2b7fe700 1 -- 172.21.15.37:0/1047106354 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbf24013470 con 0x7fbf340b8b80 2023-07-14T15:57:26.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.175+0000 7fbf2b7fe700 1 --2- 172.21.15.37:0/1047106354 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbf1406ad30 0x7fbf1406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:26.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.175+0000 7fbf2b7fe700 1 -- 172.21.15.37:0/1047106354 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbf24089a90 con 0x7fbf340b8b80 2023-07-14T15:57:26.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.175+0000 7fbf2bfff700 1 --2- 172.21.15.37:0/1047106354 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbf1406ad30 0x7fbf1406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:26.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.176+0000 7fbf2bfff700 1 --2- 172.21.15.37:0/1047106354 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbf1406ad30 0x7fbf1406d1e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbf340ce090 tx=0x7fbf1c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:26.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.179+0000 7fbf2b7fe700 1 -- 172.21.15.37:0/1047106354 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fbf24054a90 con 0x7fbf340b8b80 2023-07-14T15:57:26.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.390+0000 7fbf391ff700 1 -- 172.21.15.37:0/1047106354 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbf341e6d90 con 0x7fbf340b8b80 2023-07-14T15:57:26.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.392+0000 7fbf2b7fe700 1 -- 172.21.15.37:0/1047106354 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+18354 (secure 0 0 0) 0x7fbf24017090 con 0x7fbf340b8b80 2023-07-14T15:57:26.382 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:57:26.382 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":35,"fsid":"9da30401-a779-4e46-aba6-00c2494c6c67","created":"2023-07-14T15:55:39.898867+0000","modified":"2023-07-14T15:57:25.446410+0000","last_up_change":"2023-07-14T15:55:53.025696+0000","last_in_change":"2023-07-14T15:55:43.388192+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T15:55:52.907261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T15:55:59.992839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-14T15:57:23.872384+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-14T15:57:24.423055+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d049535-7b87-4276-8fe5-0f74ba422d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6801","nonce":2783032392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6803","nonce":2783032392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6807","nonce":2783032392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6805","nonce":2783032392}]},"public_addr":"172.21.15.37:6801/2783032392","cluster_addr":"172.21.15.37:6803/2783032392","heartbeat_back_addr":"172.21.15.37:6807/2783032392","heartbeat_front_addr":"172.21.15.37:6805/2783032392","state":["exists","up"]},{"osd":1,"uuid":"79ec948d-ead2-4c2d-923a-dd6eeaac9dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6823","nonce":1190059746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6826","nonce":1190059746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6831","nonce":1190059746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6829","nonce":1190059746}]},"public_addr":"172.21.15.37:6823/1190059746","cluster_addr":"172.21.15.37:6826/1190059746","heartbeat_back_addr":"172.21.15.37:6831/1190059746","heartbeat_front_addr":"172.21.15.37:6829/1190059746","state":["exists","up"]},{"osd":2,"uuid":"a1db6690-c160-4366-9c82-2cca17e4bba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6809","nonce":2266223499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6813","nonce":2266223499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6820","nonce":2266223499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6816","nonce":2266223499}]},"public_addr":"172.21.15.37:6809/2266223499","cluster_addr":"172.21.15.37:6813/2266223499","heartbeat_back_addr":"172.21.15.37:6820/2266223499","heartbeat_front_addr":"172.21.15.37:6816/2266223499","state":["exists","up"]},{"osd":3,"uuid":"767b8220-e79a-4a86-a162-6b3b73198379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6812","nonce":4166694594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6817","nonce":4166694594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6828","nonce":4166694594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6822","nonce":4166694594}]},"public_addr":"172.21.15.37:6812/4166694594","cluster_addr":"172.21.15.37:6817/4166694594","heartbeat_back_addr":"172.21.15.37:6828/4166694594","heartbeat_front_addr":"172.21.15.37:6822/4166694594","state":["exists","up"]},{"osd":4,"uuid":"717bd773-ae7e-4236-ac79-900cf99a37c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6801","nonce":3529020407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6803","nonce":3529020407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6807","nonce":3529020407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6805","nonce":3529020407}]},"public_addr":"172.21.15.98:6801/3529020407","cluster_addr":"172.21.15.98:6803/3529020407","heartbeat_back_addr":"172.21.15.98:6807/3529020407","heartbeat_front_addr":"172.21.15.98:6805/3529020407","state":["exists","up"]},{"osd":5,"uuid":"a941d358-0f03-4136-a9b2-3a1c2e9358cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6817","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6819","nonce":2311501838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6821","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6823","nonce":2311501838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6829","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6831","nonce":2311501838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6825","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6827","nonce":2311501838}]},"public_addr":"172.21.15.98:6819/2311501838","cluster_addr":"172.21.15.98:6823/2311501838","heartbeat_back_addr":"172.21.15.98:6831/2311501838","heartbeat_front_addr":"172.21.15.98:6827/2311501838","state":["exists","up"]},{"osd":6,"uuid":"27153772-6d4b-479d-9953-0582e7b96743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6809","nonce":1144224691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6811","nonce":1144224691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6815","nonce":1144224691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6813","nonce":1144224691}]},"public_addr":"172.21.15.98:6809/1144224691","cluster_addr":"172.21.15.98:6811/1144224691","heartbeat_back_addr":"172.21.15.98:6815/1144224691","heartbeat_front_addr":"172.21.15.98:6813/1144224691","state":["exists","up"]},{"osd":7,"uuid":"d21ffc8e-40bb-47eb-af2c-e3e730d3fb76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6818","nonce":1144470927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6822","nonce":1144470927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6830","nonce":1144470927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6826","nonce":1144470927}]},"public_addr":"172.21.15.98:6818/1144470927","cluster_addr":"172.21.15.98:6822/1144470927","heartbeat_back_addr":"172.21.15.98:6830/1144470927","heartbeat_front_addr":"172.21.15.98:6826/1144470927","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.921114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.739210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.024016+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.002527+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.698127+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.813416+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.709351+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.815457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T15:57:26.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.394+0000 7fbf391ff700 1 -- 172.21.15.37:0/1047106354 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbf1406ad30 msgr2=0x7fbf1406d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:26.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.394+0000 7fbf391ff700 1 --2- 172.21.15.37:0/1047106354 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbf1406ad30 0x7fbf1406d1e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbf340ce090 tx=0x7fbf1c009040 comp rx=0 tx=0).stop 2023-07-14T15:57:26.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.394+0000 7fbf391ff700 1 -- 172.21.15.37:0/1047106354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf340b8b80 msgr2=0x7fbf3415b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:26.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.394+0000 7fbf391ff700 1 --2- 172.21.15.37:0/1047106354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf340b8b80 0x7fbf3415b4c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fbf2400ebe0 tx=0x7fbf24009ec0 comp rx=0 tx=0).stop 2023-07-14T15:57:26.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.394+0000 7fbf391ff700 1 -- 172.21.15.37:0/1047106354 shutdown_connections 2023-07-14T15:57:26.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.394+0000 7fbf391ff700 1 --2- 172.21.15.37:0/1047106354 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf34160c50 0x7fbf3415c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:26.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.394+0000 7fbf391ff700 1 --2- 172.21.15.37:0/1047106354 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbf1406ad30 0x7fbf1406d1e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:26.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.394+0000 7fbf391ff700 1 --2- 172.21.15.37:0/1047106354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf340b8b80 0x7fbf3415b4c0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:26.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.394+0000 7fbf391ff700 1 --2- 172.21.15.37:0/1047106354 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbf340cffc0 0x7fbf3415c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:26.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.394+0000 7fbf391ff700 1 -- 172.21.15.37:0/1047106354 >> 172.21.15.37:0/1047106354 conn(0x7fbf3406b150 msgr2=0x7fbf34072e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:26.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.394+0000 7fbf391ff700 1 -- 172.21.15.37:0/1047106354 shutdown_connections 2023-07-14T15:57:26.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.394+0000 7fbf391ff700 1 -- 172.21.15.37:0/1047106354 wait complete. 2023-07-14T15:57:26.398 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T15:57:26.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.614+0000 7fddd21ff700 1 Processor -- start 2023-07-14T15:57:26.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.614+0000 7fddd21ff700 1 -- start start 2023-07-14T15:57:26.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.615+0000 7fddd21ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fddcc0b85f0 0x7fddcc15d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:26.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.615+0000 7fddd21ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddcc0cf6b0 con 0x7fddcc0b54b0 2023-07-14T15:57:26.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.615+0000 7fddd21ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddcc0cdc40 con 0x7fddcc0b4910 2023-07-14T15:57:26.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.615+0000 7fddd21ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc15dba0 con 0x7fddcc0b85f0 2023-07-14T15:57:26.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.615+0000 7fddc3fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fddcc0b54b0 0x7fddcc0cfb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44764/0 (socket says 172.21.15.37:44764) 2023-07-14T15:57:26.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.615+0000 7fddc3fff700 1 -- 172.21.15.37:0/1442528765 learned_addr learned my addr 172.21.15.37:0/1442528765 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:26.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.616+0000 7fddcb7fe700 1 --2- 172.21.15.37:0/1442528765 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fddcc0b85f0 0x7fddcc15d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:26.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.616+0000 7fddcaffd700 1 -- 172.21.15.37:0/1442528765 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4182080771 0 0) 0x7fddcc0cf6b0 con 0x7fddcc0b54b0 2023-07-14T15:57:26.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.616+0000 7fddcaffd700 1 -- 172.21.15.37:0/1442528765 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddb80035b0 con 0x7fddcc0b54b0 2023-07-14T15:57:26.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.616+0000 7fddcaffd700 1 -- 172.21.15.37:0/1442528765 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3687878344 0 0) 0x7fddb80035b0 con 0x7fddcc0b54b0 2023-07-14T15:57:26.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.616+0000 7fddcaffd700 1 -- 172.21.15.37:0/1442528765 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fddcc0b85f0 msgr2=0x7fddcc15d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:26.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.616+0000 7fddcaffd700 1 --2- 172.21.15.37:0/1442528765 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fddcc0b85f0 0x7fddcc15d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:26.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.616+0000 7fddcaffd700 1 -- 172.21.15.37:0/1442528765 >> v1:172.21.15.98:6789/0 conn(0x7fddcc0b4910 legacy=0x7fddcc15dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:26.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.616+0000 7fddcaffd700 1 -- 172.21.15.37:0/1442528765 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddcc0d0250 con 0x7fddcc0b54b0 2023-07-14T15:57:26.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.616+0000 7fddcaffd700 1 -- 172.21.15.37:0/1442528765 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48633207 0 0) 0x7fddb4001670 con 0x7fddcc0b54b0 2023-07-14T15:57:26.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.616+0000 7fddcaffd700 1 -- 172.21.15.37:0/1442528765 >> v1:172.21.15.37:6789/0 conn(0x7fddcc0b54b0 legacy=0x7fddcc0cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:26.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.616+0000 7fddcaffd700 1 --2- 172.21.15.37:0/1442528765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddb8003a30 0x7fddb8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:26.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.616+0000 7fddcaffd700 1 --2- 172.21.15.37:0/1442528765 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fddcc0b85f0 0x7fddb8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:26.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.616+0000 7fddcaffd700 1 --2- 172.21.15.37:0/1442528765 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fddb8004d90 0x7fddb8005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:26.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.616+0000 7fddcaffd700 1 -- 172.21.15.37:0/1442528765 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc15dba0 con 0x7fddb8003a30 2023-07-14T15:57:26.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.616+0000 7fddcaffd700 1 -- 172.21.15.37:0/1442528765 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb800bba0 con 0x7fddb8004d90 2023-07-14T15:57:26.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.616+0000 7fddcaffd700 1 -- 172.21.15.37:0/1442528765 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb800bd10 con 0x7fddcc0b85f0 2023-07-14T15:57:26.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.616+0000 7fddcb7fe700 1 --2- 172.21.15.37:0/1442528765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddb8003a30 0x7fddb8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:26.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.616+0000 7fddc3fff700 1 --2- 172.21.15.37:0/1442528765 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fddcc0b85f0 0x7fddb8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:26.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.616+0000 7fddcbfff700 1 --2- 172.21.15.37:0/1442528765 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fddb8004d90 0x7fddb8005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:26.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.617+0000 7fddcb7fe700 1 -- 172.21.15.37:0/1442528765 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fddcc0b85f0 msgr2=0x7fddb8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:26.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.617+0000 7fddcb7fe700 1 --2- 172.21.15.37:0/1442528765 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fddcc0b85f0 0x7fddb8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:26.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.617+0000 7fddcb7fe700 1 -- 172.21.15.37:0/1442528765 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fddb8004d90 msgr2=0x7fddb8005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:26.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.617+0000 7fddcb7fe700 1 --2- 172.21.15.37:0/1442528765 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fddb8004d90 0x7fddb8005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:26.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.617+0000 7fddcb7fe700 1 -- 172.21.15.37:0/1442528765 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb80035b0 con 0x7fddb8003a30 2023-07-14T15:57:26.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.617+0000 7fddcb7fe700 1 --2- 172.21.15.37:0/1442528765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddb8003a30 0x7fddb8003e20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fddbc009b30 tx=0x7fddb8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a9e4c6a32ddf9d6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:26.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.617+0000 7fddcaffd700 1 -- 172.21.15.37:0/1442528765 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc00e6c0 con 0x7fddb8003a30 2023-07-14T15:57:26.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.617+0000 7fddcaffd700 1 -- 172.21.15.37:0/1442528765 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddbc00e820 con 0x7fddb8003a30 2023-07-14T15:57:26.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.617+0000 7fddcaffd700 1 -- 172.21.15.37:0/1442528765 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc00eb90 con 0x7fddb8003a30 2023-07-14T15:57:26.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.618+0000 7fddd21ff700 1 -- 172.21.15.37:0/1442528765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddb8003a30 msgr2=0x7fddb8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:26.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.618+0000 7fddd21ff700 1 --2- 172.21.15.37:0/1442528765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddb8003a30 0x7fddb8003e20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fddbc009b30 tx=0x7fddb8005880 comp rx=0 tx=0).stop 2023-07-14T15:57:26.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.618+0000 7fddcbfff700 1 -- 172.21.15.37:0/1442528765 reap_dead start 2023-07-14T15:57:26.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.618+0000 7fddd21ff700 1 -- 172.21.15.37:0/1442528765 shutdown_connections 2023-07-14T15:57:26.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.618+0000 7fddd21ff700 1 -- 172.21.15.37:0/1442528765 >> 172.21.15.37:0/1442528765 conn(0x7fddcc06a580 msgr2=0x7fddcc06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:26.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.618+0000 7fddd21ff700 1 -- 172.21.15.37:0/1442528765 shutdown_connections 2023-07-14T15:57:26.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.618+0000 7fddd21ff700 1 -- 172.21.15.37:0/1442528765 wait complete. 2023-07-14T15:57:26.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.620+0000 7fddd21ff700 1 Processor -- start 2023-07-14T15:57:26.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.620+0000 7fddd21ff700 1 -- start start 2023-07-14T15:57:26.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.621+0000 7fddd21ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddb8003a30 0x7fddcc1f2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:26.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.621+0000 7fddd21ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fddcc0ccaf0 0x7fddcc144db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:26.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.621+0000 7fddd21ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fddcc0cb1a0 0x7fddcc0cb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:26.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.621+0000 7fddd21ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc0ca100 con 0x7fddb8003a30 2023-07-14T15:57:26.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.621+0000 7fddd21ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc0ca3e0 con 0x7fddcc0cb1a0 2023-07-14T15:57:26.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.621+0000 7fddd21ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc0ca6c0 con 0x7fddcc0ccaf0 2023-07-14T15:57:26.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.621+0000 7fddcb7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddb8003a30 0x7fddcc1f2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:26.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.621+0000 7fddcb7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddb8003a30 0x7fddcc1f2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36434/0 (socket says 172.21.15.37:36434) 2023-07-14T15:57:26.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.621+0000 7fddcb7fe700 1 -- 172.21.15.37:0/4121769600 learned_addr learned my addr 172.21.15.37:0/4121769600 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:26.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.621+0000 7fddcb7fe700 1 -- 172.21.15.37:0/4121769600 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fddcc0ccaf0 msgr2=0x7fddcc144db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:26.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.621+0000 7fddcb7fe700 1 --2- 172.21.15.37:0/4121769600 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fddcc0ccaf0 0x7fddcc144db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:26.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.621+0000 7fddcb7fe700 1 -- 172.21.15.37:0/4121769600 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fddcc0cb1a0 msgr2=0x7fddcc0cb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:26.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.621+0000 7fddcbfff700 1 --2- 172.21.15.37:0/4121769600 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fddcc0cb1a0 0x7fddcc0cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:26.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.622+0000 7fddcb7fe700 1 --2- 172.21.15.37:0/4121769600 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fddcc0cb1a0 0x7fddcc0cb620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:26.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.622+0000 7fddcb7fe700 1 -- 172.21.15.37:0/4121769600 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddcc0ca9a0 con 0x7fddb8003a30 2023-07-14T15:57:26.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.622+0000 7fddcbfff700 1 --2- 172.21.15.37:0/4121769600 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fddcc0cb1a0 0x7fddcc0cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:57:26.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.622+0000 7fddcb7fe700 1 --2- 172.21.15.37:0/4121769600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddb8003a30 0x7fddcc1f2930 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fddb80057e0 tx=0x7fddbc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:26.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.622+0000 7fddc8ff9700 1 -- 172.21.15.37:0/4121769600 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc00e6c0 con 0x7fddb8003a30 2023-07-14T15:57:26.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.622+0000 7fddc8ff9700 1 -- 172.21.15.37:0/4121769600 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddbc003ab0 con 0x7fddb8003a30 2023-07-14T15:57:26.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.622+0000 7fddc8ff9700 1 -- 172.21.15.37:0/4121769600 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc003e60 con 0x7fddb8003a30 2023-07-14T15:57:26.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.622+0000 7fddd21ff700 1 -- 172.21.15.37:0/4121769600 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddcc0cac80 con 0x7fddb8003a30 2023-07-14T15:57:26.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.622+0000 7fddd21ff700 1 -- 172.21.15.37:0/4121769600 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddcc1f2e70 con 0x7fddb8003a30 2023-07-14T15:57:26.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.623+0000 7fddd21ff700 1 -- 172.21.15.37:0/4121769600 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddcc0cae40 con 0x7fddb8003a30 2023-07-14T15:57:26.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.624+0000 7fddc8ff9700 1 -- 172.21.15.37:0/4121769600 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fddbc013470 con 0x7fddb8003a30 2023-07-14T15:57:26.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.625+0000 7fddc8ff9700 1 --2- 172.21.15.37:0/4121769600 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fddac06ace0 0x7fddac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:26.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.625+0000 7fddc8ff9700 1 -- 172.21.15.37:0/4121769600 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fddbc08ac30 con 0x7fddb8003a30 2023-07-14T15:57:26.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.625+0000 7fddc3fff700 1 --2- 172.21.15.37:0/4121769600 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fddac06ace0 0x7fddac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:26.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.626+0000 7fddc3fff700 1 --2- 172.21.15.37:0/4121769600 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fddac06ace0 0x7fddac06d190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fddb4001050 tx=0x7fddb4001430 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:26.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.629+0000 7fddc8ff9700 1 -- 172.21.15.37:0/4121769600 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fddbc055df0 con 0x7fddb8003a30 2023-07-14T15:57:26.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.844+0000 7fddd21ff700 1 -- 172.21.15.37:0/4121769600 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fddcc067840 con 0x7fddb8003a30 2023-07-14T15:57:26.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.845+0000 7fddc8ff9700 1 -- 172.21.15.37:0/4121769600 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+18341 (secure 0 0 0) 0x7fddbc059410 con 0x7fddb8003a30 2023-07-14T15:57:26.831 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:57:26.831 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":36,"fsid":"9da30401-a779-4e46-aba6-00c2494c6c67","created":"2023-07-14T15:55:39.898867+0000","modified":"2023-07-14T15:57:26.688069+0000","last_up_change":"2023-07-14T15:55:53.025696+0000","last_in_change":"2023-07-14T15:55:43.388192+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T15:55:52.907261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T15:55:59.992839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-14T15:57:23.872384+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-14T15:57:24.423055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d049535-7b87-4276-8fe5-0f74ba422d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6801","nonce":2783032392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6803","nonce":2783032392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6807","nonce":2783032392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6805","nonce":2783032392}]},"public_addr":"172.21.15.37:6801/2783032392","cluster_addr":"172.21.15.37:6803/2783032392","heartbeat_back_addr":"172.21.15.37:6807/2783032392","heartbeat_front_addr":"172.21.15.37:6805/2783032392","state":["exists","up"]},{"osd":1,"uuid":"79ec948d-ead2-4c2d-923a-dd6eeaac9dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6823","nonce":1190059746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6826","nonce":1190059746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6831","nonce":1190059746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6829","nonce":1190059746}]},"public_addr":"172.21.15.37:6823/1190059746","cluster_addr":"172.21.15.37:6826/1190059746","heartbeat_back_addr":"172.21.15.37:6831/1190059746","heartbeat_front_addr":"172.21.15.37:6829/1190059746","state":["exists","up"]},{"osd":2,"uuid":"a1db6690-c160-4366-9c82-2cca17e4bba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6809","nonce":2266223499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6813","nonce":2266223499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6820","nonce":2266223499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6816","nonce":2266223499}]},"public_addr":"172.21.15.37:6809/2266223499","cluster_addr":"172.21.15.37:6813/2266223499","heartbeat_back_addr":"172.21.15.37:6820/2266223499","heartbeat_front_addr":"172.21.15.37:6816/2266223499","state":["exists","up"]},{"osd":3,"uuid":"767b8220-e79a-4a86-a162-6b3b73198379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6812","nonce":4166694594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6817","nonce":4166694594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6828","nonce":4166694594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6822","nonce":4166694594}]},"public_addr":"172.21.15.37:6812/4166694594","cluster_addr":"172.21.15.37:6817/4166694594","heartbeat_back_addr":"172.21.15.37:6828/4166694594","heartbeat_front_addr":"172.21.15.37:6822/4166694594","state":["exists","up"]},{"osd":4,"uuid":"717bd773-ae7e-4236-ac79-900cf99a37c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6801","nonce":3529020407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6803","nonce":3529020407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6807","nonce":3529020407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6805","nonce":3529020407}]},"public_addr":"172.21.15.98:6801/3529020407","cluster_addr":"172.21.15.98:6803/3529020407","heartbeat_back_addr":"172.21.15.98:6807/3529020407","heartbeat_front_addr":"172.21.15.98:6805/3529020407","state":["exists","up"]},{"osd":5,"uuid":"a941d358-0f03-4136-a9b2-3a1c2e9358cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6817","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6819","nonce":2311501838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6821","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6823","nonce":2311501838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6829","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6831","nonce":2311501838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6825","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6827","nonce":2311501838}]},"public_addr":"172.21.15.98:6819/2311501838","cluster_addr":"172.21.15.98:6823/2311501838","heartbeat_back_addr":"172.21.15.98:6831/2311501838","heartbeat_front_addr":"172.21.15.98:6827/2311501838","state":["exists","up"]},{"osd":6,"uuid":"27153772-6d4b-479d-9953-0582e7b96743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6809","nonce":1144224691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6811","nonce":1144224691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6815","nonce":1144224691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6813","nonce":1144224691}]},"public_addr":"172.21.15.98:6809/1144224691","cluster_addr":"172.21.15.98:6811/1144224691","heartbeat_back_addr":"172.21.15.98:6815/1144224691","heartbeat_front_addr":"172.21.15.98:6813/1144224691","state":["exists","up"]},{"osd":7,"uuid":"d21ffc8e-40bb-47eb-af2c-e3e730d3fb76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6818","nonce":1144470927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6822","nonce":1144470927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6830","nonce":1144470927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6826","nonce":1144470927}]},"public_addr":"172.21.15.98:6818/1144470927","cluster_addr":"172.21.15.98:6822/1144470927","heartbeat_back_addr":"172.21.15.98:6830/1144470927","heartbeat_front_addr":"172.21.15.98:6826/1144470927","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.921114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.739210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.024016+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.002527+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.698127+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.813416+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.709351+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.815457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T15:57:26.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.847+0000 7fddd21ff700 1 -- 172.21.15.37:0/4121769600 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fddac06ace0 msgr2=0x7fddac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:26.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.847+0000 7fddd21ff700 1 --2- 172.21.15.37:0/4121769600 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fddac06ace0 0x7fddac06d190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fddb4001050 tx=0x7fddb4001430 comp rx=0 tx=0).stop 2023-07-14T15:57:26.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.847+0000 7fddd21ff700 1 -- 172.21.15.37:0/4121769600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddb8003a30 msgr2=0x7fddcc1f2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:26.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.847+0000 7fddd21ff700 1 --2- 172.21.15.37:0/4121769600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddb8003a30 0x7fddcc1f2930 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fddb80057e0 tx=0x7fddbc0047c0 comp rx=0 tx=0).stop 2023-07-14T15:57:26.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.848+0000 7fddd21ff700 1 -- 172.21.15.37:0/4121769600 shutdown_connections 2023-07-14T15:57:26.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.848+0000 7fddd21ff700 1 --2- 172.21.15.37:0/4121769600 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fddcc0cb1a0 0x7fddcc0cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:26.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.848+0000 7fddd21ff700 1 --2- 172.21.15.37:0/4121769600 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fddac06ace0 0x7fddac06d190 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:26.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.848+0000 7fddd21ff700 1 --2- 172.21.15.37:0/4121769600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddb8003a30 0x7fddcc1f2930 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:26.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.848+0000 7fddd21ff700 1 --2- 172.21.15.37:0/4121769600 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fddcc0ccaf0 0x7fddcc144db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:26.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.848+0000 7fddd21ff700 1 -- 172.21.15.37:0/4121769600 >> 172.21.15.37:0/4121769600 conn(0x7fddcc06a580 msgr2=0x7fddcc0b7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:26.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.848+0000 7fddd21ff700 1 -- 172.21.15.37:0/4121769600 shutdown_connections 2023-07-14T15:57:26.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:26.848+0000 7fddd21ff700 1 -- 172.21.15.37:0/4121769600 wait complete. 2023-07-14T15:57:26.851 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-14T15:57:27.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.071+0000 7fa7be5ff700 1 Processor -- start 2023-07-14T15:57:27.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.071+0000 7fa7be5ff700 1 -- start start 2023-07-14T15:57:27.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.072+0000 7fa7be5ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa7b815fee0 0x7fa7b815ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:27.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.072+0000 7fa7be5ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa7b80d1140 0x7fa7b80b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:27.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.072+0000 7fa7be5ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7b815dc50 con 0x7fa7b81603b0 2023-07-14T15:57:27.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.072+0000 7fa7be5ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7b80b2940 con 0x7fa7b80d1140 2023-07-14T15:57:27.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.072+0000 7fa7be5ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b80b2c20 con 0x7fa7b815fee0 2023-07-14T15:57:27.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.072+0000 7fa7bcb9c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa7b80d1140 0x7fa7b80b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.072+0000 7fa7bcb9c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa7b80d1140 0x7fa7b80b39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36438/0 (socket says 172.21.15.37:36438) 2023-07-14T15:57:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.072+0000 7fa7b77fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa7b81603b0 0x7fa7b80d0a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44776/0 (socket says 172.21.15.37:44776) 2023-07-14T15:57:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.073+0000 7fa7b77fe700 1 -- 172.21.15.37:0/3217975209 learned_addr learned my addr 172.21.15.37:0/3217975209 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.073+0000 7fa7b7fff700 1 --2- 172.21.15.37:0/3217975209 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa7b815fee0 0x7fa7b815ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.073+0000 7fa7bcb9c700 1 -- 172.21.15.37:0/3217975209 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa7b815fee0 msgr2=0x7fa7b815ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.073+0000 7fa7bcb9c700 1 --2- 172.21.15.37:0/3217975209 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa7b815fee0 0x7fa7b815ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:27.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.073+0000 7fa7bcb9c700 1 -- 172.21.15.37:0/3217975209 >> v1:172.21.15.37:6789/0 conn(0x7fa7b81603b0 legacy=0x7fa7b80d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:27.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.073+0000 7fa7bcb9c700 1 -- 172.21.15.37:0/3217975209 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b80b2f00 con 0x7fa7b80d1140 2023-07-14T15:57:27.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.073+0000 7fa7b6ffd700 1 -- 172.21.15.37:0/3217975209 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1100614228 0 0) 0x7fa7b815dc50 con 0x7fa7b81603b0 2023-07-14T15:57:27.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.073+0000 7fa7bcb9c700 1 --2- 172.21.15.37:0/3217975209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7b80d1140 0x7fa7b80b39e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa7b0009d90 tx=0x7fa7b000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f2f71eaab03451b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:27.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.073+0000 7fa7b6ffd700 1 -- 172.21.15.37:0/3217975209 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b000e070 con 0x7fa7b80d1140 2023-07-14T15:57:27.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.074+0000 7fa7b6ffd700 1 -- 172.21.15.37:0/3217975209 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b000bbd0 con 0x7fa7b80d1140 2023-07-14T15:57:27.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.074+0000 7fa7b6ffd700 1 -- 172.21.15.37:0/3217975209 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b0012430 con 0x7fa7b80d1140 2023-07-14T15:57:27.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.074+0000 7fa7be5ff700 1 -- 172.21.15.37:0/3217975209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7b80d1140 msgr2=0x7fa7b80b39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:27.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.074+0000 7fa7be5ff700 1 --2- 172.21.15.37:0/3217975209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7b80d1140 0x7fa7b80b39e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa7b0009d90 tx=0x7fa7b000b330 comp rx=0 tx=0).stop 2023-07-14T15:57:27.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.074+0000 7fa7be5ff700 1 -- 172.21.15.37:0/3217975209 shutdown_connections 2023-07-14T15:57:27.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.074+0000 7fa7be5ff700 1 --2- 172.21.15.37:0/3217975209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7b80d1140 0x7fa7b80b39e0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:27.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.074+0000 7fa7be5ff700 1 --2- 172.21.15.37:0/3217975209 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa7b815fee0 0x7fa7b815ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:27.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.074+0000 7fa7be5ff700 1 -- 172.21.15.37:0/3217975209 >> 172.21.15.37:0/3217975209 conn(0x7fa7b809c1b0 msgr2=0x7fa7b80d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:27.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.074+0000 7fa7be5ff700 1 -- 172.21.15.37:0/3217975209 shutdown_connections 2023-07-14T15:57:27.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.074+0000 7fa7be5ff700 1 -- 172.21.15.37:0/3217975209 wait complete. 2023-07-14T15:57:27.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.076+0000 7fa7be5ff700 1 Processor -- start 2023-07-14T15:57:27.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.076+0000 7fa7be5ff700 1 -- start start 2023-07-14T15:57:27.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.078+0000 7fa7be5ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa7b80d1140 0x7fa7b806b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:27.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.078+0000 7fa7be5ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7b815fee0 0x7fa7b80c67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:27.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.078+0000 7fa7be5ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7b81603b0 0x7fa7b80c6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:27.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.078+0000 7fa7be5ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b81461e0 con 0x7fa7b815fee0 2023-07-14T15:57:27.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.078+0000 7fa7be5ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b81464c0 con 0x7fa7b81603b0 2023-07-14T15:57:27.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.078+0000 7fa7be5ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b81467a0 con 0x7fa7b80d1140 2023-07-14T15:57:27.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.078+0000 7fa7b7fff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa7b80d1140 0x7fa7b806b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:27.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.078+0000 7fa7b7fff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa7b80d1140 0x7fa7b806b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3301/0 says I am v2:172.21.15.37:32836/0 (socket says 172.21.15.37:32836) 2023-07-14T15:57:27.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.078+0000 7fa7b7fff700 1 -- 172.21.15.37:0/1218121044 learned_addr learned my addr 172.21.15.37:0/1218121044 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:27.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.078+0000 7fa7b77fe700 1 --2- 172.21.15.37:0/1218121044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7b815fee0 0x7fa7b80c67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:27.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.079+0000 7fa7b7fff700 1 -- 172.21.15.37:0/1218121044 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7b81603b0 msgr2=0x7fa7b80c6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:27.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.079+0000 7fa7b7fff700 1 --2- 172.21.15.37:0/1218121044 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7b81603b0 0x7fa7b80c6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:27.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.079+0000 7fa7b7fff700 1 -- 172.21.15.37:0/1218121044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7b815fee0 msgr2=0x7fa7b80c67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:27.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.079+0000 7fa7b7fff700 1 --2- 172.21.15.37:0/1218121044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7b815fee0 0x7fa7b80c67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:27.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.079+0000 7fa7b7fff700 1 -- 172.21.15.37:0/1218121044 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b0009a70 con 0x7fa7b80d1140 2023-07-14T15:57:27.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.079+0000 7fa7b7fff700 1 --2- 172.21.15.37:0/1218121044 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa7b80d1140 0x7fa7b806b900 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa7a800e810 tx=0x7fa7a800eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:27.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.079+0000 7fa7b4ff9700 1 -- 172.21.15.37:0/1218121044 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a8013610 con 0x7fa7b80d1140 2023-07-14T15:57:27.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.079+0000 7fa7b4ff9700 1 -- 172.21.15.37:0/1218121044 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a8013770 con 0x7fa7b80d1140 2023-07-14T15:57:27.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.079+0000 7fa7be5ff700 1 -- 172.21.15.37:0/1218121044 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7b8146a80 con 0x7fa7b80d1140 2023-07-14T15:57:27.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.079+0000 7fa7b4ff9700 1 -- 172.21.15.37:0/1218121044 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a8013b20 con 0x7fa7b80d1140 2023-07-14T15:57:27.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.079+0000 7fa7be5ff700 1 -- 172.21.15.37:0/1218121044 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7b806c020 con 0x7fa7b80d1140 2023-07-14T15:57:27.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.080+0000 7fa7be5ff700 1 -- 172.21.15.37:0/1218121044 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7b80b38e0 con 0x7fa7b80d1140 2023-07-14T15:57:27.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.082+0000 7fa7b4ff9700 1 -- 172.21.15.37:0/1218121044 <== mon.2 v2:172.21.15.98:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa7a8013c80 con 0x7fa7b80d1140 2023-07-14T15:57:27.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.082+0000 7fa7b4ff9700 1 --2- 172.21.15.37:0/1218121044 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa7a406ace0 0x7fa7a406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:27.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.083+0000 7fa7b4ff9700 1 -- 172.21.15.37:0/1218121044 <== mon.2 v2:172.21.15.98:3301/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa7a8088f30 con 0x7fa7b80d1140 2023-07-14T15:57:27.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.083+0000 7fa7b77fe700 1 --2- 172.21.15.37:0/1218121044 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa7a406ace0 0x7fa7a406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:27.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.084+0000 7fa7b77fe700 1 --2- 172.21.15.37:0/1218121044 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa7a406ace0 0x7fa7a406d190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa7b81f67c0 tx=0x7fa7ac007e70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:27.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.088+0000 7fa7b4ff9700 1 -- 172.21.15.37:0/1218121044 <== mon.2 v2:172.21.15.98:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa7a80579e0 con 0x7fa7b80d1140 2023-07-14T15:57:27.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.345+0000 7fa7be5ff700 1 -- 172.21.15.37:0/1218121044 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa7b806c020 con 0x7fa7b80d1140 2023-07-14T15:57:27.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.952+0000 7fa7b4ff9700 1 -- 172.21.15.37:0/1218121044 <== mon.2 v2:172.21.15.98:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa7b806c020 con 0x7fa7b80d1140 2023-07-14T15:57:27.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.955+0000 7fa7be5ff700 1 -- 172.21.15.37:0/1218121044 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa7a406ace0 msgr2=0x7fa7a406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:27.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.955+0000 7fa7be5ff700 1 --2- 172.21.15.37:0/1218121044 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa7a406ace0 0x7fa7a406d190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa7b81f67c0 tx=0x7fa7ac007e70 comp rx=0 tx=0).stop 2023-07-14T15:57:27.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.955+0000 7fa7be5ff700 1 -- 172.21.15.37:0/1218121044 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa7b80d1140 msgr2=0x7fa7b806b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:27.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.955+0000 7fa7be5ff700 1 --2- 172.21.15.37:0/1218121044 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa7b80d1140 0x7fa7b806b900 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa7a800e810 tx=0x7fa7a800eb20 comp rx=0 tx=0).stop 2023-07-14T15:57:27.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.956+0000 7fa7be5ff700 1 -- 172.21.15.37:0/1218121044 shutdown_connections 2023-07-14T15:57:27.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.956+0000 7fa7be5ff700 1 --2- 172.21.15.37:0/1218121044 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7b81603b0 0x7fa7b80c6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:27.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.956+0000 7fa7be5ff700 1 --2- 172.21.15.37:0/1218121044 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa7a406ace0 0x7fa7a406d190 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:27.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.956+0000 7fa7be5ff700 1 --2- 172.21.15.37:0/1218121044 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa7b80d1140 0x7fa7b806b900 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:27.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.956+0000 7fa7be5ff700 1 --2- 172.21.15.37:0/1218121044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7b815fee0 0x7fa7b80c67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:27.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.956+0000 7fa7be5ff700 1 -- 172.21.15.37:0/1218121044 >> 172.21.15.37:0/1218121044 conn(0x7fa7b809c1b0 msgr2=0x7fa7b815bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:27.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.956+0000 7fa7be5ff700 1 -- 172.21.15.37:0/1218121044 shutdown_connections 2023-07-14T15:57:27.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:27.956+0000 7fa7be5ff700 1 -- 172.21.15.37:0/1218121044 wait complete. 2023-07-14T15:57:27.962 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-14T15:57:27.963 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-14T15:57:28.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.186+0000 7fad719ff700 1 Processor -- start 2023-07-14T15:57:28.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.186+0000 7fad719ff700 1 -- start start 2023-07-14T15:57:28.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.188+0000 7fad719ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fad6c0b8750 0x7fad6c0cd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:28.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.188+0000 7fad719ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad6c0d0b30 con 0x7fad6c160d40 2023-07-14T15:57:28.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.188+0000 7fad719ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad6c0b8b20 con 0x7fad6c160190 2023-07-14T15:57:28.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.188+0000 7fad719ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad6c0cdd00 con 0x7fad6c0b8750 2023-07-14T15:57:28.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.188+0000 7fad6b7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fad6c160d40 0x7fad6c0d0fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44788/0 (socket says 172.21.15.37:44788) 2023-07-14T15:57:28.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.188+0000 7fad6b7fe700 1 -- 172.21.15.37:0/3992040214 learned_addr learned my addr 172.21.15.37:0/3992040214 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:28.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.188+0000 7fad6affd700 1 --2- 172.21.15.37:0/3992040214 >> v2:172.21.15.98:3300/0 conn(0x7fad6c0b8750 0x7fad6c0cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:28.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.188+0000 7fad69ffb700 1 -- 172.21.15.37:0/3992040214 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4203841365 0 0) 0x7fad6c0d0b30 con 0x7fad6c160d40 2023-07-14T15:57:28.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.189+0000 7fad69ffb700 1 -- 172.21.15.37:0/3992040214 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad540035b0 con 0x7fad6c160d40 2023-07-14T15:57:28.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.189+0000 7fad69ffb700 1 -- 172.21.15.37:0/3992040214 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 345250678 0 0) 0x7fad6c0b8b20 con 0x7fad6c160190 2023-07-14T15:57:28.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.189+0000 7fad69ffb700 1 -- 172.21.15.37:0/3992040214 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad6c0d0b30 con 0x7fad6c160190 2023-07-14T15:57:28.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.189+0000 7fad6affd700 1 -- 172.21.15.37:0/3992040214 >> v1:172.21.15.98:6789/0 conn(0x7fad6c160190 legacy=0x7fad6c160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:28.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.189+0000 7fad6affd700 1 -- 172.21.15.37:0/3992040214 >> v1:172.21.15.37:6789/0 conn(0x7fad6c160d40 legacy=0x7fad6c0d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:28.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.189+0000 7fad6affd700 1 -- 172.21.15.37:0/3992040214 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad6c0cda60 con 0x7fad6c0b8750 2023-07-14T15:57:28.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.189+0000 7fad6affd700 1 --2- 172.21.15.37:0/3992040214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad6c0b8750 0x7fad6c0cd520 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fad5c009840 tx=0x7fad5c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=931713c4d3cbe85e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:28.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.189+0000 7fad69ffb700 1 -- 172.21.15.37:0/3992040214 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5c011830 con 0x7fad6c0b8750 2023-07-14T15:57:28.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.189+0000 7fad69ffb700 1 -- 172.21.15.37:0/3992040214 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad5c011990 con 0x7fad6c0b8750 2023-07-14T15:57:28.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.189+0000 7fad69ffb700 1 -- 172.21.15.37:0/3992040214 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5c011d20 con 0x7fad6c0b8750 2023-07-14T15:57:28.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.190+0000 7fad719ff700 1 -- 172.21.15.37:0/3992040214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad6c0b8750 msgr2=0x7fad6c0cd520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:28.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.190+0000 7fad719ff700 1 --2- 172.21.15.37:0/3992040214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad6c0b8750 0x7fad6c0cd520 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fad5c009840 tx=0x7fad5c009b50 comp rx=0 tx=0).stop 2023-07-14T15:57:28.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.190+0000 7fad719ff700 1 -- 172.21.15.37:0/3992040214 shutdown_connections 2023-07-14T15:57:28.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.190+0000 7fad719ff700 1 --2- 172.21.15.37:0/3992040214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad6c0b8750 0x7fad6c0cd520 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:28.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.190+0000 7fad719ff700 1 -- 172.21.15.37:0/3992040214 >> 172.21.15.37:0/3992040214 conn(0x7fad6c06c0b0 msgr2=0x7fad6c06c480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:28.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.190+0000 7fad719ff700 1 -- 172.21.15.37:0/3992040214 shutdown_connections 2023-07-14T15:57:28.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.190+0000 7fad719ff700 1 -- 172.21.15.37:0/3992040214 wait complete. 2023-07-14T15:57:28.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.192+0000 7fad719ff700 1 Processor -- start 2023-07-14T15:57:28.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.193+0000 7fad719ff700 1 -- start start 2023-07-14T15:57:28.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.194+0000 7fad719ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad6c0b8750 0x7fad6c1f2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:28.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.194+0000 7fad719ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fad6c160190 0x7fad6c0b10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:28.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.194+0000 7fad719ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad6c160d40 0x7fad6c15f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:28.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.194+0000 7fad719ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6c1f2cd0 con 0x7fad6c0b8750 2023-07-14T15:57:28.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.194+0000 7fad719ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6c0a9940 con 0x7fad6c160d40 2023-07-14T15:57:28.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.194+0000 7fad719ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad6c0a9c20 con 0x7fad6c160190 2023-07-14T15:57:28.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.194+0000 7fad6affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad6c0b8750 0x7fad6c1f2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:28.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.194+0000 7fad6affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad6c0b8750 0x7fad6c1f2ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36450/0 (socket says 172.21.15.37:36450) 2023-07-14T15:57:28.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.194+0000 7fad6affd700 1 -- 172.21.15.37:0/54361924 learned_addr learned my addr 172.21.15.37:0/54361924 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:28.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.194+0000 7fad6b7fe700 1 --2- 172.21.15.37:0/54361924 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad6c160d40 0x7fad6c15f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:28.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.194+0000 7fad6a7fc700 1 --2- 172.21.15.37:0/54361924 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fad6c160190 0x7fad6c0b10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:28.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.195+0000 7fad6affd700 1 -- 172.21.15.37:0/54361924 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fad6c160190 msgr2=0x7fad6c0b10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:28.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.195+0000 7fad6affd700 1 --2- 172.21.15.37:0/54361924 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fad6c160190 0x7fad6c0b10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:28.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.195+0000 7fad6affd700 1 -- 172.21.15.37:0/54361924 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad6c160d40 msgr2=0x7fad6c15f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:28.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.195+0000 7fad6affd700 1 --2- 172.21.15.37:0/54361924 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad6c160d40 0x7fad6c15f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:28.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.195+0000 7fad6affd700 1 -- 172.21.15.37:0/54361924 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad5c0094a0 con 0x7fad6c0b8750 2023-07-14T15:57:28.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.195+0000 7fad6affd700 1 --2- 172.21.15.37:0/54361924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad6c0b8750 0x7fad6c1f2ec0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fad5c0090b0 tx=0x7fad5c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:28.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.195+0000 7fad53fff700 1 -- 172.21.15.37:0/54361924 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5c01a760 con 0x7fad6c0b8750 2023-07-14T15:57:28.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.195+0000 7fad53fff700 1 -- 172.21.15.37:0/54361924 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad5c01a8c0 con 0x7fad6c0b8750 2023-07-14T15:57:28.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.195+0000 7fad719ff700 1 -- 172.21.15.37:0/54361924 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad6c0a9f00 con 0x7fad6c0b8750 2023-07-14T15:57:28.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.195+0000 7fad53fff700 1 -- 172.21.15.37:0/54361924 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5c01ac30 con 0x7fad6c0b8750 2023-07-14T15:57:28.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.195+0000 7fad719ff700 1 -- 172.21.15.37:0/54361924 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad6c0b1610 con 0x7fad6c0b8750 2023-07-14T15:57:28.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.196+0000 7fad719ff700 1 -- 172.21.15.37:0/54361924 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad6c067840 con 0x7fad6c0b8750 2023-07-14T15:57:28.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.197+0000 7fad53fff700 1 -- 172.21.15.37:0/54361924 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fad5c022070 con 0x7fad6c0b8750 2023-07-14T15:57:28.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.198+0000 7fad53fff700 1 --2- 172.21.15.37:0/54361924 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fad5806ace0 0x7fad5806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:28.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.198+0000 7fad53fff700 1 -- 172.21.15.37:0/54361924 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fad5c08a5c0 con 0x7fad6c0b8750 2023-07-14T15:57:28.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.199+0000 7fad6a7fc700 1 --2- 172.21.15.37:0/54361924 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fad5806ace0 0x7fad5806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:28.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.199+0000 7fad6a7fc700 1 --2- 172.21.15.37:0/54361924 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fad5806ace0 0x7fad5806d190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fad6c1ef8f0 tx=0x7fad60009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:28.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.202+0000 7fad53fff700 1 -- 172.21.15.37:0/54361924 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fad5c055780 con 0x7fad6c0b8750 2023-07-14T15:57:28.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.453+0000 7fad719ff700 1 -- 172.21.15.37:0/54361924 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fad6c0b30b0 con 0x7fad6c0b8750 2023-07-14T15:57:28.600 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T15:57:28.605 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T15:57:28.809 INFO:tasks.ceph.mds.c.smithi037.stderr:2023-07-14T15:57:28.824+0000 7f158d5f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-14T15:57:28.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.961+0000 7fad53fff700 1 -- 172.21.15.37:0/54361924 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7fad5c058da0 con 0x7fad6c0b8750 2023-07-14T15:57:28.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.963+0000 7fad719ff700 1 -- 172.21.15.37:0/54361924 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fad5806ace0 msgr2=0x7fad5806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:28.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.963+0000 7fad719ff700 1 --2- 172.21.15.37:0/54361924 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fad5806ace0 0x7fad5806d190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fad6c1ef8f0 tx=0x7fad60009040 comp rx=0 tx=0).stop 2023-07-14T15:57:28.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.963+0000 7fad719ff700 1 -- 172.21.15.37:0/54361924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad6c0b8750 msgr2=0x7fad6c1f2ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:28.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.963+0000 7fad719ff700 1 --2- 172.21.15.37:0/54361924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad6c0b8750 0x7fad6c1f2ec0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fad5c0090b0 tx=0x7fad5c004750 comp rx=0 tx=0).stop 2023-07-14T15:57:28.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.963+0000 7fad719ff700 1 -- 172.21.15.37:0/54361924 shutdown_connections 2023-07-14T15:57:28.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.963+0000 7fad719ff700 1 --2- 172.21.15.37:0/54361924 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad6c160d40 0x7fad6c15f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:28.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.963+0000 7fad719ff700 1 --2- 172.21.15.37:0/54361924 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fad5806ace0 0x7fad5806d190 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:28.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.963+0000 7fad719ff700 1 --2- 172.21.15.37:0/54361924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad6c0b8750 0x7fad6c1f2ec0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:28.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.963+0000 7fad719ff700 1 --2- 172.21.15.37:0/54361924 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fad6c160190 0x7fad6c0b10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:28.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.963+0000 7fad719ff700 1 -- 172.21.15.37:0/54361924 >> 172.21.15.37:0/54361924 conn(0x7fad6c06c0b0 msgr2=0x7fad6c0d2220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:28.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.963+0000 7fad719ff700 1 -- 172.21.15.37:0/54361924 shutdown_connections 2023-07-14T15:57:28.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:28.963+0000 7fad719ff700 1 -- 172.21.15.37:0/54361924 wait complete. 2023-07-14T15:57:28.967 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-14T15:57:28.968 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T15:57:29.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.183+0000 7fc8c29ff700 1 Processor -- start 2023-07-14T15:57:29.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.184+0000 7fc8c29ff700 1 -- start start 2023-07-14T15:57:29.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.185+0000 7fc8c29ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc8bc0b0050 0x7fc8bc0ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:29.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.185+0000 7fc8c29ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8bc0c9540 con 0x7fc8bc0c9b30 2023-07-14T15:57:29.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.185+0000 7fc8c29ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8bc0c9ff0 con 0x7fc8bc1593c0 2023-07-14T15:57:29.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.185+0000 7fc8c29ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc0ce3d0 con 0x7fc8bc0b0050 2023-07-14T15:57:29.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.185+0000 7fc8bb7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc8bc0c9b30 0x7fc8bc0af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44794/0 (socket says 172.21.15.37:44794) 2023-07-14T15:57:29.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.185+0000 7fc8bb7fe700 1 -- 172.21.15.37:0/3860110396 learned_addr learned my addr 172.21.15.37:0/3860110396 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:29.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.186+0000 7fc8c0f9c700 1 --2- 172.21.15.37:0/3860110396 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc8bc0b0050 0x7fc8bc0ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:29.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.186+0000 7fc8baffd700 1 -- 172.21.15.37:0/3860110396 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2494946199 0 0) 0x7fc8bc0c9540 con 0x7fc8bc0c9b30 2023-07-14T15:57:29.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.186+0000 7fc8baffd700 1 -- 172.21.15.37:0/3860110396 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8a40035b0 con 0x7fc8bc0c9b30 2023-07-14T15:57:29.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.186+0000 7fc8baffd700 1 -- 172.21.15.37:0/3860110396 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 160245910 0 0) 0x7fc8bc0c9ff0 con 0x7fc8bc1593c0 2023-07-14T15:57:29.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.186+0000 7fc8baffd700 1 -- 172.21.15.37:0/3860110396 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8bc0c9540 con 0x7fc8bc1593c0 2023-07-14T15:57:29.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.186+0000 7fc8baffd700 1 -- 172.21.15.37:0/3860110396 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2153828358 0 0) 0x7fc8a40035b0 con 0x7fc8bc0c9b30 2023-07-14T15:57:29.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.186+0000 7fc8baffd700 1 -- 172.21.15.37:0/3860110396 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc8bc0b0050 msgr2=0x7fc8bc0ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:29.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.186+0000 7fc8baffd700 1 --2- 172.21.15.37:0/3860110396 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc8bc0b0050 0x7fc8bc0ccce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:29.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.186+0000 7fc8baffd700 1 -- 172.21.15.37:0/3860110396 >> v1:172.21.15.98:6789/0 conn(0x7fc8bc1593c0 legacy=0x7fc8bc15db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:29.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.186+0000 7fc8baffd700 1 -- 172.21.15.37:0/3860110396 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8bc0ce6b0 con 0x7fc8bc0c9b30 2023-07-14T15:57:29.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.186+0000 7fc8baffd700 1 -- 172.21.15.37:0/3860110396 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48633207 0 0) 0x7fc8b0001670 con 0x7fc8bc0c9b30 2023-07-14T15:57:29.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.186+0000 7fc8baffd700 1 -- 172.21.15.37:0/3860110396 >> v1:172.21.15.37:6789/0 conn(0x7fc8bc0c9b30 legacy=0x7fc8bc0af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:29.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.186+0000 7fc8baffd700 1 --2- 172.21.15.37:0/3860110396 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc8a4003bc0 0x7fc8a4003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:29.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.186+0000 7fc8baffd700 1 --2- 172.21.15.37:0/3860110396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8a4004850 0x7fc8a4004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:29.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.186+0000 7fc8baffd700 1 --2- 172.21.15.37:0/3860110396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8a4005200 0x7fc8a400dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:29.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.186+0000 7fc8baffd700 1 -- 172.21.15.37:0/3860110396 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc0ce3d0 con 0x7fc8a4005200 2023-07-14T15:57:29.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.186+0000 7fc8baffd700 1 -- 172.21.15.37:0/3860110396 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a400e160 con 0x7fc8a4004850 2023-07-14T15:57:29.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.186+0000 7fc8baffd700 1 -- 172.21.15.37:0/3860110396 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a400e2f0 con 0x7fc8a4003bc0 2023-07-14T15:57:29.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.186+0000 7fc8c0f9c700 1 --2- 172.21.15.37:0/3860110396 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc8bc0b0050 0x7fc8bc0ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:57:29.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.187+0000 7fc8bb7fe700 1 --2- 172.21.15.37:0/3860110396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8a4004850 0x7fc8a4004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:29.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.187+0000 7fc8c0f9c700 1 --2- 172.21.15.37:0/3860110396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8a4005200 0x7fc8a400dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:29.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.187+0000 7fc8bbfff700 1 --2- 172.21.15.37:0/3860110396 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc8a4003bc0 0x7fc8a4003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:29.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.187+0000 7fc8c0f9c700 1 -- 172.21.15.37:0/3860110396 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc8a4003bc0 msgr2=0x7fc8a4003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:29.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.187+0000 7fc8c0f9c700 1 --2- 172.21.15.37:0/3860110396 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc8a4003bc0 0x7fc8a4003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:29.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.187+0000 7fc8c0f9c700 1 -- 172.21.15.37:0/3860110396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8a4004850 msgr2=0x7fc8a4004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:29.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.187+0000 7fc8c0f9c700 1 --2- 172.21.15.37:0/3860110396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8a4004850 0x7fc8a4004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:29.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.187+0000 7fc8c0f9c700 1 -- 172.21.15.37:0/3860110396 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a40035b0 con 0x7fc8a4005200 2023-07-14T15:57:29.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.187+0000 7fc8bb7fe700 1 --2- 172.21.15.37:0/3860110396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8a4004850 0x7fc8a4004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:57:29.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.187+0000 7fc8c0f9c700 1 --2- 172.21.15.37:0/3860110396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8a4005200 0x7fc8a400dc20 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc0b0440 tx=0x7fc8a4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e8628bcd9a2db5f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:29.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.188+0000 7fc8baffd700 1 -- 172.21.15.37:0/3860110396 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b4003c20 con 0x7fc8a4005200 2023-07-14T15:57:29.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.188+0000 7fc8baffd700 1 -- 172.21.15.37:0/3860110396 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b400f040 con 0x7fc8a4005200 2023-07-14T15:57:29.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.188+0000 7fc8baffd700 1 -- 172.21.15.37:0/3860110396 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b400ea30 con 0x7fc8a4005200 2023-07-14T15:57:29.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.188+0000 7fc8c29ff700 1 -- 172.21.15.37:0/3860110396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8a4005200 msgr2=0x7fc8a400dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:29.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.188+0000 7fc8c29ff700 1 --2- 172.21.15.37:0/3860110396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8a4005200 0x7fc8a400dc20 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc0b0440 tx=0x7fc8a4005880 comp rx=0 tx=0).stop 2023-07-14T15:57:29.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.188+0000 7fc8c0f9c700 1 -- 172.21.15.37:0/3860110396 reap_dead start 2023-07-14T15:57:29.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.188+0000 7fc8c29ff700 1 -- 172.21.15.37:0/3860110396 shutdown_connections 2023-07-14T15:57:29.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.188+0000 7fc8c29ff700 1 -- 172.21.15.37:0/3860110396 >> 172.21.15.37:0/3860110396 conn(0x7fc8bc0b08c0 msgr2=0x7fc8bc0b0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:29.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.188+0000 7fc8c29ff700 1 -- 172.21.15.37:0/3860110396 shutdown_connections 2023-07-14T15:57:29.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.188+0000 7fc8c29ff700 1 -- 172.21.15.37:0/3860110396 wait complete. 2023-07-14T15:57:29.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.191+0000 7fc8c29ff700 1 Processor -- start 2023-07-14T15:57:29.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.191+0000 7fc8c29ff700 1 -- start start 2023-07-14T15:57:29.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.192+0000 7fc8c29ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8a4005200 0x7fc8bc1404e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:29.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.192+0000 7fc8c29ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8bc1e4260 0x7fc8bc1e5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:29.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.192+0000 7fc8c29ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc8bc14b660 0x7fc8bc1e6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:29.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.192+0000 7fc8c29ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc1e5450 con 0x7fc8bc1e4260 2023-07-14T15:57:29.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.192+0000 7fc8c29ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc140a20 con 0x7fc8a4005200 2023-07-14T15:57:29.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.192+0000 7fc8c29ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc1e5db0 con 0x7fc8bc14b660 2023-07-14T15:57:29.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.193+0000 7fc8bb7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8bc1e4260 0x7fc8bc1e5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:29.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.193+0000 7fc8bb7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8bc1e4260 0x7fc8bc1e5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36476/0 (socket says 172.21.15.37:36476) 2023-07-14T15:57:29.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.193+0000 7fc8bb7fe700 1 -- 172.21.15.37:0/882000395 learned_addr learned my addr 172.21.15.37:0/882000395 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:29.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.193+0000 7fc8bbfff700 1 --2- 172.21.15.37:0/882000395 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8a4005200 0x7fc8bc1404e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:29.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.193+0000 7fc8c0f9c700 1 --2- 172.21.15.37:0/882000395 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc8bc14b660 0x7fc8bc1e6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:29.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.193+0000 7fc8bb7fe700 1 -- 172.21.15.37:0/882000395 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc8bc14b660 msgr2=0x7fc8bc1e6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:29.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.193+0000 7fc8bb7fe700 1 --2- 172.21.15.37:0/882000395 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc8bc14b660 0x7fc8bc1e6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:29.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.193+0000 7fc8bb7fe700 1 -- 172.21.15.37:0/882000395 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8a4005200 msgr2=0x7fc8bc1404e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:29.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.193+0000 7fc8bb7fe700 1 --2- 172.21.15.37:0/882000395 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8a4005200 0x7fc8bc1404e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:29.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.193+0000 7fc8bb7fe700 1 -- 172.21.15.37:0/882000395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8bc1e47d0 con 0x7fc8bc1e4260 2023-07-14T15:57:29.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.193+0000 7fc8c0f9c700 1 --2- 172.21.15.37:0/882000395 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc8bc14b660 0x7fc8bc1e6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:57:29.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.193+0000 7fc8bb7fe700 1 --2- 172.21.15.37:0/882000395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8bc1e4260 0x7fc8bc1e5870 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0007310 tx=0x7fc8b0007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:29.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.194+0000 7fc8b8ff9700 1 -- 172.21.15.37:0/882000395 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b0007800 con 0x7fc8bc1e4260 2023-07-14T15:57:29.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.194+0000 7fc8b8ff9700 1 -- 172.21.15.37:0/882000395 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b000f870 con 0x7fc8bc1e4260 2023-07-14T15:57:29.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.194+0000 7fc8c29ff700 1 -- 172.21.15.37:0/882000395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8bc1e4ab0 con 0x7fc8bc1e4260 2023-07-14T15:57:29.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.194+0000 7fc8b8ff9700 1 -- 172.21.15.37:0/882000395 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b000fbe0 con 0x7fc8bc1e4260 2023-07-14T15:57:29.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.194+0000 7fc8c29ff700 1 -- 172.21.15.37:0/882000395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8bc1e5070 con 0x7fc8bc1e4260 2023-07-14T15:57:29.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.195+0000 7fc8c29ff700 1 -- 172.21.15.37:0/882000395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8bc1e5590 con 0x7fc8bc1e4260 2023-07-14T15:57:29.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.196+0000 7fc8b8ff9700 1 -- 172.21.15.37:0/882000395 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc8b000fd40 con 0x7fc8bc1e4260 2023-07-14T15:57:29.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.197+0000 7fc8b8ff9700 1 --2- 172.21.15.37:0/882000395 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc8a806ad10 0x7fc8a806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:29.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.197+0000 7fc8b8ff9700 1 -- 172.21.15.37:0/882000395 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc8b0089550 con 0x7fc8bc1e4260 2023-07-14T15:57:29.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.197+0000 7fc8bbfff700 1 --2- 172.21.15.37:0/882000395 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc8a806ad10 0x7fc8a806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:29.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.198+0000 7fc8bbfff700 1 --2- 172.21.15.37:0/882000395 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc8a806ad10 0x7fc8a806d1c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac007fd0 tx=0x7fc8ac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:29.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.201+0000 7fc8b8ff9700 1 -- 172.21.15.37:0/882000395 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc8bc1e5590 con 0x7fc8bc1e4260 2023-07-14T15:57:29.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.451+0000 7fc8c29ff700 1 -- 172.21.15.37:0/882000395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8bc1e5590 con 0x7fc8bc1e4260 2023-07-14T15:57:29.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.452+0000 7fc8b8ff9700 1 -- 172.21.15.37:0/882000395 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4709 (secure 0 0 0) 0x7fc8bc1e5590 con 0x7fc8bc1e4260 2023-07-14T15:57:29.438 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:57:29.439 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/1292294727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":1292294727},{"type":"v1","addr":"172.21.15.98:6837","nonce":1292294727}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4811,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1091097806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1091097806},{"type":"v1","addr":"172.21.15.37:6835","nonce":1091097806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5059,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/2838228048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2838228048},{"type":"v1","addr":"172.21.15.98:6836","nonce":2838228048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T15:57:25.446758+0000","modified":"2023-07-14T15:57:28.951927+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5121},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5121":{"gid":5121,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6834/2406398098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2406398098},{"type":"v1","addr":"172.21.15.37:6834","nonce":2406398098}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-14T15:57:29.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.454+0000 7fc8c29ff700 1 -- 172.21.15.37:0/882000395 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc8a806ad10 msgr2=0x7fc8a806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:29.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.454+0000 7fc8c29ff700 1 --2- 172.21.15.37:0/882000395 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc8a806ad10 0x7fc8a806d1c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac007fd0 tx=0x7fc8ac009040 comp rx=0 tx=0).stop 2023-07-14T15:57:29.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.454+0000 7fc8c29ff700 1 -- 172.21.15.37:0/882000395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8bc1e4260 msgr2=0x7fc8bc1e5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:29.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.454+0000 7fc8c29ff700 1 --2- 172.21.15.37:0/882000395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8bc1e4260 0x7fc8bc1e5870 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0007310 tx=0x7fc8b0007620 comp rx=0 tx=0).stop 2023-07-14T15:57:29.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.454+0000 7fc8c29ff700 1 -- 172.21.15.37:0/882000395 shutdown_connections 2023-07-14T15:57:29.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.454+0000 7fc8c29ff700 1 --2- 172.21.15.37:0/882000395 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8a4005200 0x7fc8bc1404e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:29.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.454+0000 7fc8c29ff700 1 --2- 172.21.15.37:0/882000395 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc8a806ad10 0x7fc8a806d1c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:29.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.454+0000 7fc8c29ff700 1 --2- 172.21.15.37:0/882000395 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc8bc14b660 0x7fc8bc1e6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:29.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.454+0000 7fc8c29ff700 1 --2- 172.21.15.37:0/882000395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8bc1e4260 0x7fc8bc1e5870 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:29.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.454+0000 7fc8c29ff700 1 -- 172.21.15.37:0/882000395 >> 172.21.15.37:0/882000395 conn(0x7fc8bc0b08c0 msgr2=0x7fc8bc0aec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:29.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.454+0000 7fc8c29ff700 1 -- 172.21.15.37:0/882000395 shutdown_connections 2023-07-14T15:57:29.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.454+0000 7fc8c29ff700 1 -- 172.21.15.37:0/882000395 wait complete. 2023-07-14T15:57:29.444 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 16 2023-07-14T15:57:29.458 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T15:57:29.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.673+0000 7fba693ff700 1 Processor -- start 2023-07-14T15:57:29.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.673+0000 7fba693ff700 1 -- start start 2023-07-14T15:57:29.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.674+0000 7fba693ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fba6415cc40 0x7fba64160eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:29.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.675+0000 7fba693ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fba640ca170 0x7fba64071120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:29.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.675+0000 7fba693ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fba64069e70 0x7fba6406a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:29.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.675+0000 7fba693ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba6406a830 con 0x7fba6415cc40 2023-07-14T15:57:29.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.675+0000 7fba693ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba640cbb40 con 0x7fba64069e70 2023-07-14T15:57:29.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.675+0000 7fba693ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba64070c90 con 0x7fba640ca170 2023-07-14T15:57:29.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.675+0000 7fba62ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fba6415cc40 0x7fba64160eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:29.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.675+0000 7fba62ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fba6415cc40 0x7fba64160eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36480/0 (socket says 172.21.15.37:36480) 2023-07-14T15:57:29.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.675+0000 7fba62ffd700 1 -- 172.21.15.37:0/345985244 learned_addr learned my addr 172.21.15.37:0/345985244 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:29.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.675+0000 7fba637fe700 1 --2- 172.21.15.37:0/345985244 >> v2:172.21.15.98:3300/0 conn(0x7fba64069e70 0x7fba6406a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:29.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.675+0000 7fba5bfff700 1 --2- 172.21.15.37:0/345985244 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fba640ca170 0x7fba64071120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:29.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.675+0000 7fba62ffd700 1 -- 172.21.15.37:0/345985244 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fba640ca170 msgr2=0x7fba64071120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:29.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.675+0000 7fba62ffd700 1 --2- 172.21.15.37:0/345985244 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fba640ca170 0x7fba64071120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:29.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.675+0000 7fba62ffd700 1 -- 172.21.15.37:0/345985244 >> v2:172.21.15.98:3300/0 conn(0x7fba64069e70 msgr2=0x7fba6406a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:29.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.675+0000 7fba62ffd700 1 --2- 172.21.15.37:0/345985244 >> v2:172.21.15.98:3300/0 conn(0x7fba64069e70 0x7fba6406a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:29.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.675+0000 7fba62ffd700 1 -- 172.21.15.37:0/345985244 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba640cc330 con 0x7fba6415cc40 2023-07-14T15:57:29.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.676+0000 7fba62ffd700 1 --2- 172.21.15.37:0/345985244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba6415cc40 0x7fba64160eb0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fba64071c90 tx=0x7fba54009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac5833ebf4138431 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:29.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.676+0000 7fba627fc700 1 -- 172.21.15.37:0/345985244 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba54011830 con 0x7fba6415cc40 2023-07-14T15:57:29.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.676+0000 7fba627fc700 1 -- 172.21.15.37:0/345985244 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba54011990 con 0x7fba6415cc40 2023-07-14T15:57:29.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.676+0000 7fba627fc700 1 -- 172.21.15.37:0/345985244 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba54011d20 con 0x7fba6415cc40 2023-07-14T15:57:29.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.676+0000 7fba693ff700 1 -- 172.21.15.37:0/345985244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba6415cc40 msgr2=0x7fba64160eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:29.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.676+0000 7fba693ff700 1 --2- 172.21.15.37:0/345985244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba6415cc40 0x7fba64160eb0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fba64071c90 tx=0x7fba54009bd0 comp rx=0 tx=0).stop 2023-07-14T15:57:29.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.676+0000 7fba693ff700 1 -- 172.21.15.37:0/345985244 shutdown_connections 2023-07-14T15:57:29.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.676+0000 7fba693ff700 1 --2- 172.21.15.37:0/345985244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba6415cc40 0x7fba64160eb0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:29.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.676+0000 7fba693ff700 1 --2- 172.21.15.37:0/345985244 >> v2:172.21.15.98:3300/0 conn(0x7fba64069e70 0x7fba6406a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:29.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.676+0000 7fba693ff700 1 --2- 172.21.15.37:0/345985244 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fba640ca170 0x7fba64071120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:29.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.676+0000 7fba693ff700 1 -- 172.21.15.37:0/345985244 >> 172.21.15.37:0/345985244 conn(0x7fba640cd230 msgr2=0x7fba640cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:29.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.677+0000 7fba693ff700 1 -- 172.21.15.37:0/345985244 shutdown_connections 2023-07-14T15:57:29.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.677+0000 7fba693ff700 1 -- 172.21.15.37:0/345985244 wait complete. 2023-07-14T15:57:29.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.678+0000 7fba693ff700 1 Processor -- start 2023-07-14T15:57:29.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.678+0000 7fba693ff700 1 -- start start 2023-07-14T15:57:29.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.679+0000 7fba693ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba64069e70 0x7fba640b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:29.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.679+0000 7fba693ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba640ca170 0x7fba640cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:29.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.679+0000 7fba693ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fba6415cc40 0x7fba64159200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:29.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.679+0000 7fba693ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba640b3810 con 0x7fba640ca170 2023-07-14T15:57:29.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.679+0000 7fba693ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba6415a680 con 0x7fba64069e70 2023-07-14T15:57:29.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.679+0000 7fba693ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba640b4020 con 0x7fba6415cc40 2023-07-14T15:57:29.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.680+0000 7fba5bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba640ca170 0x7fba640cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:29.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.680+0000 7fba5bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba640ca170 0x7fba640cfa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36482/0 (socket says 172.21.15.37:36482) 2023-07-14T15:57:29.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.680+0000 7fba5bfff700 1 -- 172.21.15.37:0/550049050 learned_addr learned my addr 172.21.15.37:0/550049050 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:29.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.680+0000 7fba62ffd700 1 --2- 172.21.15.37:0/550049050 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba64069e70 0x7fba640b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:29.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.680+0000 7fba637fe700 1 --2- 172.21.15.37:0/550049050 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fba6415cc40 0x7fba64159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:29.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.680+0000 7fba5bfff700 1 -- 172.21.15.37:0/550049050 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fba6415cc40 msgr2=0x7fba64159200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:29.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.680+0000 7fba5bfff700 1 --2- 172.21.15.37:0/550049050 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fba6415cc40 0x7fba64159200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:29.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.680+0000 7fba5bfff700 1 -- 172.21.15.37:0/550049050 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba64069e70 msgr2=0x7fba640b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:29.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.680+0000 7fba5bfff700 1 --2- 172.21.15.37:0/550049050 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba64069e70 0x7fba640b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:29.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.680+0000 7fba5bfff700 1 -- 172.21.15.37:0/550049050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba54009550 con 0x7fba640ca170 2023-07-14T15:57:29.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.681+0000 7fba5bfff700 1 --2- 172.21.15.37:0/550049050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba640ca170 0x7fba640cfa40 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fba4c00e9b0 tx=0x7fba4c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:29.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.681+0000 7fba5b7fe700 1 -- 172.21.15.37:0/550049050 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c009710 con 0x7fba640ca170 2023-07-14T15:57:29.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.681+0000 7fba5b7fe700 1 -- 172.21.15.37:0/550049050 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4c00ee50 con 0x7fba640ca170 2023-07-14T15:57:29.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.681+0000 7fba5b7fe700 1 -- 172.21.15.37:0/550049050 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c00ca50 con 0x7fba640ca170 2023-07-14T15:57:29.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.681+0000 7fba693ff700 1 -- 172.21.15.37:0/550049050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba64159f00 con 0x7fba640ca170 2023-07-14T15:57:29.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.681+0000 7fba693ff700 1 -- 172.21.15.37:0/550049050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba640b2db0 con 0x7fba640ca170 2023-07-14T15:57:29.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.682+0000 7fba693ff700 1 -- 172.21.15.37:0/550049050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba64067840 con 0x7fba640ca170 2023-07-14T15:57:29.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.683+0000 7fba5b7fe700 1 -- 172.21.15.37:0/550049050 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fba4c00cbb0 con 0x7fba640ca170 2023-07-14T15:57:29.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.684+0000 7fba5b7fe700 1 --2- 172.21.15.37:0/550049050 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fba4406ace0 0x7fba4406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:29.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.684+0000 7fba5b7fe700 1 -- 172.21.15.37:0/550049050 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fba4c089460 con 0x7fba640ca170 2023-07-14T15:57:29.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.684+0000 7fba62ffd700 1 --2- 172.21.15.37:0/550049050 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fba4406ace0 0x7fba4406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:29.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.685+0000 7fba62ffd700 1 --2- 172.21.15.37:0/550049050 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fba4406ace0 0x7fba4406d190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fba54014040 tx=0x7fba54008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:29.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.688+0000 7fba5b7fe700 1 -- 172.21.15.37:0/550049050 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fba4c057f90 con 0x7fba640ca170 2023-07-14T15:57:29.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.898+0000 7fba693ff700 1 -- 172.21.15.37:0/550049050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba640b5aa0 con 0x7fba640ca170 2023-07-14T15:57:29.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.900+0000 7fba5b7fe700 1 -- 172.21.15.37:0/550049050 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+18341 (secure 0 0 0) 0x7fba4c00ce60 con 0x7fba640ca170 2023-07-14T15:57:29.886 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:57:29.886 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":36,"fsid":"9da30401-a779-4e46-aba6-00c2494c6c67","created":"2023-07-14T15:55:39.898867+0000","modified":"2023-07-14T15:57:26.688069+0000","last_up_change":"2023-07-14T15:55:53.025696+0000","last_in_change":"2023-07-14T15:55:43.388192+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T15:55:52.907261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T15:55:59.992839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-14T15:57:23.872384+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-14T15:57:24.423055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d049535-7b87-4276-8fe5-0f74ba422d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6801","nonce":2783032392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6803","nonce":2783032392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6807","nonce":2783032392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6805","nonce":2783032392}]},"public_addr":"172.21.15.37:6801/2783032392","cluster_addr":"172.21.15.37:6803/2783032392","heartbeat_back_addr":"172.21.15.37:6807/2783032392","heartbeat_front_addr":"172.21.15.37:6805/2783032392","state":["exists","up"]},{"osd":1,"uuid":"79ec948d-ead2-4c2d-923a-dd6eeaac9dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6823","nonce":1190059746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6826","nonce":1190059746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6831","nonce":1190059746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6829","nonce":1190059746}]},"public_addr":"172.21.15.37:6823/1190059746","cluster_addr":"172.21.15.37:6826/1190059746","heartbeat_back_addr":"172.21.15.37:6831/1190059746","heartbeat_front_addr":"172.21.15.37:6829/1190059746","state":["exists","up"]},{"osd":2,"uuid":"a1db6690-c160-4366-9c82-2cca17e4bba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6809","nonce":2266223499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6813","nonce":2266223499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6820","nonce":2266223499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6816","nonce":2266223499}]},"public_addr":"172.21.15.37:6809/2266223499","cluster_addr":"172.21.15.37:6813/2266223499","heartbeat_back_addr":"172.21.15.37:6820/2266223499","heartbeat_front_addr":"172.21.15.37:6816/2266223499","state":["exists","up"]},{"osd":3,"uuid":"767b8220-e79a-4a86-a162-6b3b73198379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6812","nonce":4166694594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6817","nonce":4166694594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6828","nonce":4166694594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6822","nonce":4166694594}]},"public_addr":"172.21.15.37:6812/4166694594","cluster_addr":"172.21.15.37:6817/4166694594","heartbeat_back_addr":"172.21.15.37:6828/4166694594","heartbeat_front_addr":"172.21.15.37:6822/4166694594","state":["exists","up"]},{"osd":4,"uuid":"717bd773-ae7e-4236-ac79-900cf99a37c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6801","nonce":3529020407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6803","nonce":3529020407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6807","nonce":3529020407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6805","nonce":3529020407}]},"public_addr":"172.21.15.98:6801/3529020407","cluster_addr":"172.21.15.98:6803/3529020407","heartbeat_back_addr":"172.21.15.98:6807/3529020407","heartbeat_front_addr":"172.21.15.98:6805/3529020407","state":["exists","up"]},{"osd":5,"uuid":"a941d358-0f03-4136-a9b2-3a1c2e9358cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6817","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6819","nonce":2311501838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6821","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6823","nonce":2311501838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6829","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6831","nonce":2311501838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6825","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6827","nonce":2311501838}]},"public_addr":"172.21.15.98:6819/2311501838","cluster_addr":"172.21.15.98:6823/2311501838","heartbeat_back_addr":"172.21.15.98:6831/2311501838","heartbeat_front_addr":"172.21.15.98:6827/2311501838","state":["exists","up"]},{"osd":6,"uuid":"27153772-6d4b-479d-9953-0582e7b96743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6809","nonce":1144224691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6811","nonce":1144224691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6815","nonce":1144224691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6813","nonce":1144224691}]},"public_addr":"172.21.15.98:6809/1144224691","cluster_addr":"172.21.15.98:6811/1144224691","heartbeat_back_addr":"172.21.15.98:6815/1144224691","heartbeat_front_addr":"172.21.15.98:6813/1144224691","state":["exists","up"]},{"osd":7,"uuid":"d21ffc8e-40bb-47eb-af2c-e3e730d3fb76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6818","nonce":1144470927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6822","nonce":1144470927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6830","nonce":1144470927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6826","nonce":1144470927}]},"public_addr":"172.21.15.98:6818/1144470927","cluster_addr":"172.21.15.98:6822/1144470927","heartbeat_back_addr":"172.21.15.98:6830/1144470927","heartbeat_front_addr":"172.21.15.98:6826/1144470927","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.921114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.739210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.024016+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.002527+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.698127+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.813416+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.709351+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.815457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T15:57:29.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.902+0000 7fba693ff700 1 -- 172.21.15.37:0/550049050 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fba4406ace0 msgr2=0x7fba4406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:29.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.902+0000 7fba693ff700 1 --2- 172.21.15.37:0/550049050 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fba4406ace0 0x7fba4406d190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fba54014040 tx=0x7fba54008030 comp rx=0 tx=0).stop 2023-07-14T15:57:29.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.902+0000 7fba693ff700 1 -- 172.21.15.37:0/550049050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba640ca170 msgr2=0x7fba640cfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:29.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.902+0000 7fba693ff700 1 --2- 172.21.15.37:0/550049050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba640ca170 0x7fba640cfa40 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fba4c00e9b0 tx=0x7fba4c00ecc0 comp rx=0 tx=0).stop 2023-07-14T15:57:29.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.902+0000 7fba693ff700 1 -- 172.21.15.37:0/550049050 shutdown_connections 2023-07-14T15:57:29.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.902+0000 7fba693ff700 1 --2- 172.21.15.37:0/550049050 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba64069e70 0x7fba640b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:29.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.902+0000 7fba693ff700 1 --2- 172.21.15.37:0/550049050 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fba4406ace0 0x7fba4406d190 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:29.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.902+0000 7fba693ff700 1 --2- 172.21.15.37:0/550049050 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fba6415cc40 0x7fba64159200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:29.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.902+0000 7fba693ff700 1 --2- 172.21.15.37:0/550049050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba640ca170 0x7fba640cfa40 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:29.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.902+0000 7fba693ff700 1 -- 172.21.15.37:0/550049050 >> 172.21.15.37:0/550049050 conn(0x7fba640cd230 msgr2=0x7fba6415af90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:29.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.902+0000 7fba693ff700 1 -- 172.21.15.37:0/550049050 shutdown_connections 2023-07-14T15:57:29.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:29.902+0000 7fba693ff700 1 -- 172.21.15.37:0/550049050 wait complete. 2023-07-14T15:57:29.907 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-14T15:57:29.908 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T15:57:30.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.123+0000 7fab90bff700 1 Processor -- start 2023-07-14T15:57:30.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.123+0000 7fab90bff700 1 -- start start 2023-07-14T15:57:30.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.124+0000 7fab90bff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fab8c0b4910 0x7fab8c0b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:30.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.124+0000 7fab90bff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab8c0cf6b0 con 0x7fab8c0b54b0 2023-07-14T15:57:30.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.124+0000 7fab90bff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab8c0b5270 con 0x7fab8c0b85f0 2023-07-14T15:57:30.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.124+0000 7fab90bff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab8c0cdc40 con 0x7fab8c0b4910 2023-07-14T15:57:30.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.125+0000 7fab89d9b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fab8c0b54b0 0x7fab8c0cfb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56832/0 (socket says 172.21.15.37:56832) 2023-07-14T15:57:30.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.125+0000 7fab89d9b700 1 -- 172.21.15.37:0/389851343 learned_addr learned my addr 172.21.15.37:0/389851343 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:30.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.125+0000 7fab8ad9d700 1 --2- 172.21.15.37:0/389851343 >> v2:172.21.15.98:3300/0 conn(0x7fab8c0b4910 0x7fab8c0b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:30.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.125+0000 7fab8959a700 1 -- 172.21.15.37:0/389851343 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 563750682 0 0) 0x7fab8c0cf6b0 con 0x7fab8c0b54b0 2023-07-14T15:57:30.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.125+0000 7fab8959a700 1 -- 172.21.15.37:0/389851343 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab740035b0 con 0x7fab8c0b54b0 2023-07-14T15:57:30.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.125+0000 7fab8ad9d700 1 -- 172.21.15.37:0/389851343 >> v1:172.21.15.98:6789/0 conn(0x7fab8c0b85f0 legacy=0x7fab8c15d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:30.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.125+0000 7fab8ad9d700 1 -- 172.21.15.37:0/389851343 >> v1:172.21.15.37:6789/0 conn(0x7fab8c0b54b0 legacy=0x7fab8c0cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:30.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.125+0000 7fab8ad9d700 1 -- 172.21.15.37:0/389851343 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab8c0d0250 con 0x7fab8c0b4910 2023-07-14T15:57:30.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.126+0000 7fab8ad9d700 1 --2- 172.21.15.37:0/389851343 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fab8c0b4910 0x7fab8c0b4d30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fab84009d90 tx=0x7fab8400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24a9999a62a0dd6b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:30.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.126+0000 7fab8959a700 1 -- 172.21.15.37:0/389851343 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8400e070 con 0x7fab8c0b4910 2023-07-14T15:57:30.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.126+0000 7fab8959a700 1 -- 172.21.15.37:0/389851343 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab8400bb20 con 0x7fab8c0b4910 2023-07-14T15:57:30.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.126+0000 7fab8959a700 1 -- 172.21.15.37:0/389851343 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab84012430 con 0x7fab8c0b4910 2023-07-14T15:57:30.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.126+0000 7fab90bff700 1 -- 172.21.15.37:0/389851343 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fab8c0b4910 msgr2=0x7fab8c0b4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:30.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.126+0000 7fab90bff700 1 --2- 172.21.15.37:0/389851343 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fab8c0b4910 0x7fab8c0b4d30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fab84009d90 tx=0x7fab8400b330 comp rx=0 tx=0).stop 2023-07-14T15:57:30.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.126+0000 7fab90bff700 1 -- 172.21.15.37:0/389851343 shutdown_connections 2023-07-14T15:57:30.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.126+0000 7fab90bff700 1 --2- 172.21.15.37:0/389851343 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fab8c0b4910 0x7fab8c0b4d30 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:30.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.126+0000 7fab90bff700 1 -- 172.21.15.37:0/389851343 >> 172.21.15.37:0/389851343 conn(0x7fab8c06a580 msgr2=0x7fab8c06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:30.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.127+0000 7fab90bff700 1 -- 172.21.15.37:0/389851343 shutdown_connections 2023-07-14T15:57:30.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.127+0000 7fab90bff700 1 -- 172.21.15.37:0/389851343 wait complete. 2023-07-14T15:57:30.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.128+0000 7fab90bff700 1 Processor -- start 2023-07-14T15:57:30.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.128+0000 7fab90bff700 1 -- start start 2023-07-14T15:57:30.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.129+0000 7fab90bff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fab8c0b4910 0x7fab8c1f1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:30.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.129+0000 7fab90bff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fab8c0b54b0 0x7fab8c159150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:30.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.129+0000 7fab90bff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab8c0b85f0 0x7fab8c159690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:30.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.129+0000 7fab90bff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c1f2c90 con 0x7fab8c0b85f0 2023-07-14T15:57:30.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.129+0000 7fab90bff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c1f2360 con 0x7fab8c0b54b0 2023-07-14T15:57:30.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.129+0000 7fab90bff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c1f2640 con 0x7fab8c0b4910 2023-07-14T15:57:30.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.130+0000 7fab8ad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab8c0b85f0 0x7fab8c159690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:30.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.130+0000 7fab8ad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab8c0b85f0 0x7fab8c159690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38528/0 (socket says 172.21.15.37:38528) 2023-07-14T15:57:30.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.130+0000 7fab8ad9d700 1 -- 172.21.15.37:0/2318483889 learned_addr learned my addr 172.21.15.37:0/2318483889 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:30.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.130+0000 7fab89d9b700 1 --2- 172.21.15.37:0/2318483889 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fab8c0b54b0 0x7fab8c159150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:30.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.130+0000 7fab8a59c700 1 --2- 172.21.15.37:0/2318483889 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fab8c0b4910 0x7fab8c1f1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:30.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.130+0000 7fab8ad9d700 1 -- 172.21.15.37:0/2318483889 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fab8c0b4910 msgr2=0x7fab8c1f1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:30.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.130+0000 7fab8ad9d700 1 --2- 172.21.15.37:0/2318483889 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fab8c0b4910 0x7fab8c1f1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:30.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.130+0000 7fab8ad9d700 1 -- 172.21.15.37:0/2318483889 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fab8c0b54b0 msgr2=0x7fab8c159150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:30.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.130+0000 7fab8ad9d700 1 --2- 172.21.15.37:0/2318483889 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fab8c0b54b0 0x7fab8c159150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:30.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.130+0000 7fab8ad9d700 1 -- 172.21.15.37:0/2318483889 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab84009a70 con 0x7fab8c0b85f0 2023-07-14T15:57:30.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.130+0000 7fab8ad9d700 1 --2- 172.21.15.37:0/2318483889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab8c0b85f0 0x7fab8c159690 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fab8c0673c0 tx=0x7fab84004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:30.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.130+0000 7fab7affd700 1 -- 172.21.15.37:0/2318483889 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab84012430 con 0x7fab8c0b85f0 2023-07-14T15:57:30.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.131+0000 7fab7affd700 1 -- 172.21.15.37:0/2318483889 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab84020070 con 0x7fab8c0b85f0 2023-07-14T15:57:30.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.131+0000 7fab7affd700 1 -- 172.21.15.37:0/2318483889 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab84004280 con 0x7fab8c0b85f0 2023-07-14T15:57:30.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.131+0000 7fab90bff700 1 -- 172.21.15.37:0/2318483889 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab8c1f2920 con 0x7fab8c0b85f0 2023-07-14T15:57:30.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.131+0000 7fab90bff700 1 -- 172.21.15.37:0/2318483889 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab8c1f2040 con 0x7fab8c0b85f0 2023-07-14T15:57:30.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.132+0000 7fab90bff700 1 -- 172.21.15.37:0/2318483889 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab8c1f2e40 con 0x7fab8c0b85f0 2023-07-14T15:57:30.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.133+0000 7fab7affd700 1 -- 172.21.15.37:0/2318483889 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fab840043e0 con 0x7fab8c0b85f0 2023-07-14T15:57:30.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.134+0000 7fab7affd700 1 --2- 172.21.15.37:0/2318483889 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fab6c06acb0 0x7fab6c06d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:30.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.134+0000 7fab7affd700 1 -- 172.21.15.37:0/2318483889 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fab84022070 con 0x7fab8c0b85f0 2023-07-14T15:57:30.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.134+0000 7fab8a59c700 1 --2- 172.21.15.37:0/2318483889 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fab6c06acb0 0x7fab6c06d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:30.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.135+0000 7fab8a59c700 1 --2- 172.21.15.37:0/2318483889 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fab6c06acb0 0x7fab6c06d160 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fab7c007fd0 tx=0x7fab7c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:30.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.138+0000 7fab7affd700 1 -- 172.21.15.37:0/2318483889 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fab8c1f2e40 con 0x7fab8c0b85f0 2023-07-14T15:57:30.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.341+0000 7fab90bff700 1 -- 172.21.15.37:0/2318483889 --> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fab8c0b89c0 con 0x7fab6c06acb0 2023-07-14T15:57:30.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.352+0000 7fab7affd700 1 -- 172.21.15.37:0/2318483889 <== mgr.4100 v2:172.21.15.98:6832/3163748069 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309318 (secure 0 0 0) 0x7fab7c001cc0 con 0x7fab6c06acb0 2023-07-14T15:57:30.341 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:57:30.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.356+0000 7fab90bff700 1 -- 172.21.15.37:0/2318483889 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fab6c06acb0 msgr2=0x7fab6c06d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:30.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.356+0000 7fab90bff700 1 --2- 172.21.15.37:0/2318483889 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fab6c06acb0 0x7fab6c06d160 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fab7c007fd0 tx=0x7fab7c009040 comp rx=0 tx=0).stop 2023-07-14T15:57:30.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.356+0000 7fab90bff700 1 -- 172.21.15.37:0/2318483889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab8c0b85f0 msgr2=0x7fab8c159690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:30.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.356+0000 7fab90bff700 1 --2- 172.21.15.37:0/2318483889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab8c0b85f0 0x7fab8c159690 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fab8c0673c0 tx=0x7fab84004ad0 comp rx=0 tx=0).stop 2023-07-14T15:57:30.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.356+0000 7fab90bff700 1 -- 172.21.15.37:0/2318483889 shutdown_connections 2023-07-14T15:57:30.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.356+0000 7fab90bff700 1 --2- 172.21.15.37:0/2318483889 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fab6c06acb0 0x7fab6c06d160 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:30.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.356+0000 7fab90bff700 1 --2- 172.21.15.37:0/2318483889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab8c0b85f0 0x7fab8c159690 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:30.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.356+0000 7fab90bff700 1 --2- 172.21.15.37:0/2318483889 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fab8c0b4910 0x7fab8c1f1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:30.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.356+0000 7fab90bff700 1 --2- 172.21.15.37:0/2318483889 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fab8c0b54b0 0x7fab8c159150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:30.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.356+0000 7fab90bff700 1 -- 172.21.15.37:0/2318483889 >> 172.21.15.37:0/2318483889 conn(0x7fab8c06a580 msgr2=0x7fab8c0d3590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:30.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.356+0000 7fab90bff700 1 -- 172.21.15.37:0/2318483889 shutdown_connections 2023-07-14T15:57:30.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.356+0000 7fab90bff700 1 -- 172.21.15.37:0/2318483889 wait complete. 2023-07-14T15:57:30.346 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-14T15:57:30.360 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2023-07-14T15:57:28.872886+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":190,"acting":190,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":106,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223960,"kb_used_data":4248,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754750760,"statfs":{"total":773094113280,"available":772864778240,"internally_reserved":0,"allocated":4349952,"data_stored":2443563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.946282"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694788+0000","last_change":"2023-07-14T15:57:25.708719+0000","last_active":"2023-07-14T15:57:26.694788+0000","last_peered":"2023-07-14T15:57:26.694788+0000","last_clean":"2023-07-14T15:57:26.694788+0000","last_became_active":"2023-07-14T15:57:25.708107+0000","last_became_peered":"2023-07-14T15:57:25.708107+0000","last_unstale":"2023-07-14T15:57:26.694788+0000","last_undegraded":"2023-07-14T15:57:26.694788+0000","last_fullsized":"2023-07-14T15:57:26.694788+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:52:37.992568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.717421+0000","last_change":"2023-07-14T15:57:25.710340+0000","last_active":"2023-07-14T15:57:25.717421+0000","last_peered":"2023-07-14T15:57:25.717421+0000","last_clean":"2023-07-14T15:57:25.717421+0000","last_became_active":"2023-07-14T15:57:25.710113+0000","last_became_peered":"2023-07-14T15:57:25.710113+0000","last_unstale":"2023-07-14T15:57:25.717421+0000","last_undegraded":"2023-07-14T15:57:25.717421+0000","last_fullsized":"2023-07-14T15:57:25.717421+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:53:01.027835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694176+0000","last_change":"2023-07-14T15:57:25.707011+0000","last_active":"2023-07-14T15:57:26.694176+0000","last_peered":"2023-07-14T15:57:26.694176+0000","last_clean":"2023-07-14T15:57:26.694176+0000","last_became_active":"2023-07-14T15:57:25.706720+0000","last_became_peered":"2023-07-14T15:57:25.706720+0000","last_unstale":"2023-07-14T15:57:26.694176+0000","last_undegraded":"2023-07-14T15:57:26.694176+0000","last_fullsized":"2023-07-14T15:57:26.694176+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:11:43.491601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694227+0000","last_change":"2023-07-14T15:57:25.710983+0000","last_active":"2023-07-14T15:57:26.694227+0000","last_peered":"2023-07-14T15:57:26.694227+0000","last_clean":"2023-07-14T15:57:26.694227+0000","last_became_active":"2023-07-14T15:57:25.710549+0000","last_became_peered":"2023-07-14T15:57:25.710549+0000","last_unstale":"2023-07-14T15:57:26.694227+0000","last_undegraded":"2023-07-14T15:57:26.694227+0000","last_fullsized":"2023-07-14T15:57:26.694227+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:40:25.153466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.076832+0000","last_change":"2023-07-14T15:57:25.703749+0000","last_active":"2023-07-14T15:57:27.076832+0000","last_peered":"2023-07-14T15:57:27.076832+0000","last_clean":"2023-07-14T15:57:27.076832+0000","last_became_active":"2023-07-14T15:57:25.703455+0000","last_became_peered":"2023-07-14T15:57:25.703455+0000","last_unstale":"2023-07-14T15:57:27.076832+0000","last_undegraded":"2023-07-14T15:57:27.076832+0000","last_fullsized":"2023-07-14T15:57:27.076832+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:08:58.707250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.717512+0000","last_change":"2023-07-14T15:57:25.712112+0000","last_active":"2023-07-14T15:57:25.717512+0000","last_peered":"2023-07-14T15:57:25.717512+0000","last_clean":"2023-07-14T15:57:25.717512+0000","last_became_active":"2023-07-14T15:57:25.711731+0000","last_became_peered":"2023-07-14T15:57:25.711731+0000","last_unstale":"2023-07-14T15:57:25.717512+0000","last_undegraded":"2023-07-14T15:57:25.717512+0000","last_fullsized":"2023-07-14T15:57:25.717512+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:00:40.319113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.715576+0000","last_change":"2023-07-14T15:57:25.708346+0000","last_active":"2023-07-14T15:57:25.715576+0000","last_peered":"2023-07-14T15:57:25.715576+0000","last_clean":"2023-07-14T15:57:25.715576+0000","last_became_active":"2023-07-14T15:57:25.708048+0000","last_became_peered":"2023-07-14T15:57:25.708048+0000","last_unstale":"2023-07-14T15:57:25.715576+0000","last_undegraded":"2023-07-14T15:57:25.715576+0000","last_fullsized":"2023-07-14T15:57:25.715576+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:05:25.335710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694045+0000","last_change":"2023-07-14T15:57:25.706331+0000","last_active":"2023-07-14T15:57:26.694045+0000","last_peered":"2023-07-14T15:57:26.694045+0000","last_clean":"2023-07-14T15:57:26.694045+0000","last_became_active":"2023-07-14T15:57:25.705691+0000","last_became_peered":"2023-07-14T15:57:25.705691+0000","last_unstale":"2023-07-14T15:57:26.694045+0000","last_undegraded":"2023-07-14T15:57:26.694045+0000","last_fullsized":"2023-07-14T15:57:26.694045+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:24:52.499316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.077364+0000","last_change":"2023-07-14T15:57:25.713167+0000","last_active":"2023-07-14T15:57:27.077364+0000","last_peered":"2023-07-14T15:57:27.077364+0000","last_clean":"2023-07-14T15:57:27.077364+0000","last_became_active":"2023-07-14T15:57:25.712829+0000","last_became_peered":"2023-07-14T15:57:25.712829+0000","last_unstale":"2023-07-14T15:57:27.077364+0000","last_undegraded":"2023-07-14T15:57:27.077364+0000","last_fullsized":"2023-07-14T15:57:27.077364+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:53:49.977402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.714964+0000","last_change":"2023-07-14T15:57:25.707232+0000","last_active":"2023-07-14T15:57:25.714964+0000","last_peered":"2023-07-14T15:57:25.714964+0000","last_clean":"2023-07-14T15:57:25.714964+0000","last_became_active":"2023-07-14T15:57:25.706976+0000","last_became_peered":"2023-07-14T15:57:25.706976+0000","last_unstale":"2023-07-14T15:57:25.714964+0000","last_undegraded":"2023-07-14T15:57:25.714964+0000","last_fullsized":"2023-07-14T15:57:25.714964+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:48:00.956575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:57:24.924637+0000","last_change":"2023-07-14T15:57:24.924637+0000","last_active":"2023-07-14T15:57:24.924637+0000","last_peered":"2023-07-14T15:57:24.924637+0000","last_clean":"2023-07-14T15:57:24.924637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:57:24.924637+0000","last_undegraded":"2023-07-14T15:57:24.924637+0000","last_fullsized":"2023-07-14T15:57:24.924637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.077125+0000","last_change":"2023-07-14T15:57:25.709331+0000","last_active":"2023-07-14T15:57:27.077125+0000","last_peered":"2023-07-14T15:57:27.077125+0000","last_clean":"2023-07-14T15:57:27.077125+0000","last_became_active":"2023-07-14T15:57:25.709039+0000","last_became_peered":"2023-07-14T15:57:25.709039+0000","last_unstale":"2023-07-14T15:57:27.077125+0000","last_undegraded":"2023-07-14T15:57:27.077125+0000","last_fullsized":"2023-07-14T15:57:27.077125+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:05:25.335710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.717498+0000","last_change":"2023-07-14T15:57:25.715095+0000","last_active":"2023-07-14T15:57:25.717498+0000","last_peered":"2023-07-14T15:57:25.717498+0000","last_clean":"2023-07-14T15:57:25.717498+0000","last_became_active":"2023-07-14T15:57:25.714840+0000","last_became_peered":"2023-07-14T15:57:25.714840+0000","last_unstale":"2023-07-14T15:57:25.717498+0000","last_undegraded":"2023-07-14T15:57:25.717498+0000","last_fullsized":"2023-07-14T15:57:25.717498+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:38:24.688175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170148+0000","last_change":"2023-07-14T15:57:25.710052+0000","last_active":"2023-07-14T15:57:27.170148+0000","last_peered":"2023-07-14T15:57:27.170148+0000","last_clean":"2023-07-14T15:57:27.170148+0000","last_became_active":"2023-07-14T15:57:25.709808+0000","last_became_peered":"2023-07-14T15:57:25.709808+0000","last_unstale":"2023-07-14T15:57:27.170148+0000","last_undegraded":"2023-07-14T15:57:27.170148+0000","last_fullsized":"2023-07-14T15:57:27.170148+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:19:01.933649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693904+0000","last_change":"2023-07-14T15:57:25.709747+0000","last_active":"2023-07-14T15:57:26.693904+0000","last_peered":"2023-07-14T15:57:26.693904+0000","last_clean":"2023-07-14T15:57:26.693904+0000","last_became_active":"2023-07-14T15:57:25.709442+0000","last_became_peered":"2023-07-14T15:57:25.709442+0000","last_unstale":"2023-07-14T15:57:26.693904+0000","last_undegraded":"2023-07-14T15:57:26.693904+0000","last_fullsized":"2023-07-14T15:57:26.693904+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:30:18.330946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.715604+0000","last_change":"2023-07-14T15:57:25.712207+0000","last_active":"2023-07-14T15:57:25.715604+0000","last_peered":"2023-07-14T15:57:25.715604+0000","last_clean":"2023-07-14T15:57:25.715604+0000","last_became_active":"2023-07-14T15:57:25.711936+0000","last_became_peered":"2023-07-14T15:57:25.711936+0000","last_unstale":"2023-07-14T15:57:25.715604+0000","last_undegraded":"2023-07-14T15:57:25.715604+0000","last_fullsized":"2023-07-14T15:57:25.715604+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:08:58.707250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694397+0000","last_change":"2023-07-14T15:57:25.711637+0000","last_active":"2023-07-14T15:57:26.694397+0000","last_peered":"2023-07-14T15:57:26.694397+0000","last_clean":"2023-07-14T15:57:26.694397+0000","last_became_active":"2023-07-14T15:57:25.710975+0000","last_became_peered":"2023-07-14T15:57:25.710975+0000","last_unstale":"2023-07-14T15:57:26.694397+0000","last_undegraded":"2023-07-14T15:57:26.694397+0000","last_fullsized":"2023-07-14T15:57:26.694397+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:24:11.251154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694300+0000","last_change":"2023-07-14T15:57:25.711476+0000","last_active":"2023-07-14T15:57:26.694300+0000","last_peered":"2023-07-14T15:57:26.694300+0000","last_clean":"2023-07-14T15:57:26.694300+0000","last_became_active":"2023-07-14T15:57:25.711204+0000","last_became_peered":"2023-07-14T15:57:25.711204+0000","last_unstale":"2023-07-14T15:57:26.694300+0000","last_undegraded":"2023-07-14T15:57:26.694300+0000","last_fullsized":"2023-07-14T15:57:26.694300+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:27:16.753361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694835+0000","last_change":"2023-07-14T15:57:25.715333+0000","last_active":"2023-07-14T15:57:26.694835+0000","last_peered":"2023-07-14T15:57:26.694835+0000","last_clean":"2023-07-14T15:57:26.694835+0000","last_became_active":"2023-07-14T15:57:25.715044+0000","last_became_peered":"2023-07-14T15:57:25.715044+0000","last_unstale":"2023-07-14T15:57:26.694835+0000","last_undegraded":"2023-07-14T15:57:26.694835+0000","last_fullsized":"2023-07-14T15:57:26.694835+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:13:09.841632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:57:24.924637+0000","last_change":"2023-07-14T15:57:24.924637+0000","last_active":"2023-07-14T15:57:24.924637+0000","last_peered":"2023-07-14T15:57:24.924637+0000","last_clean":"2023-07-14T15:57:24.924637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:57:24.924637+0000","last_undegraded":"2023-07-14T15:57:24.924637+0000","last_fullsized":"2023-07-14T15:57:24.924637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:57:24.924637+0000","last_change":"2023-07-14T15:57:24.924637+0000","last_active":"2023-07-14T15:57:24.924637+0000","last_peered":"2023-07-14T15:57:24.924637+0000","last_clean":"2023-07-14T15:57:24.924637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:57:24.924637+0000","last_undegraded":"2023-07-14T15:57:24.924637+0000","last_fullsized":"2023-07-14T15:57:24.924637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:57:24.924637+0000","last_change":"2023-07-14T15:57:24.924637+0000","last_active":"2023-07-14T15:57:24.924637+0000","last_peered":"2023-07-14T15:57:24.924637+0000","last_clean":"2023-07-14T15:57:24.924637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:57:24.924637+0000","last_undegraded":"2023-07-14T15:57:24.924637+0000","last_fullsized":"2023-07-14T15:57:24.924637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693910+0000","last_change":"2023-07-14T15:57:25.716297+0000","last_active":"2023-07-14T15:57:26.693910+0000","last_peered":"2023-07-14T15:57:26.693910+0000","last_clean":"2023-07-14T15:57:26.693910+0000","last_became_active":"2023-07-14T15:57:25.716028+0000","last_became_peered":"2023-07-14T15:57:25.716028+0000","last_unstale":"2023-07-14T15:57:26.693910+0000","last_undegraded":"2023-07-14T15:57:26.693910+0000","last_fullsized":"2023-07-14T15:57:26.693910+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:50:57.963143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693902+0000","last_change":"2023-07-14T15:57:25.707324+0000","last_active":"2023-07-14T15:57:26.693902+0000","last_peered":"2023-07-14T15:57:26.693902+0000","last_clean":"2023-07-14T15:57:26.693902+0000","last_became_active":"2023-07-14T15:57:25.706434+0000","last_became_peered":"2023-07-14T15:57:25.706434+0000","last_unstale":"2023-07-14T15:57:26.693902+0000","last_undegraded":"2023-07-14T15:57:26.693902+0000","last_fullsized":"2023-07-14T15:57:26.693902+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:15:31.939973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170401+0000","last_change":"2023-07-14T15:57:25.711970+0000","last_active":"2023-07-14T15:57:27.170401+0000","last_peered":"2023-07-14T15:57:27.170401+0000","last_clean":"2023-07-14T15:57:27.170401+0000","last_became_active":"2023-07-14T15:57:25.711620+0000","last_became_peered":"2023-07-14T15:57:25.711620+0000","last_unstale":"2023-07-14T15:57:27.170401+0000","last_undegraded":"2023-07-14T15:57:27.170401+0000","last_fullsized":"2023-07-14T15:57:27.170401+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:25:29.672522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694804+0000","last_change":"2023-07-14T15:57:25.704116+0000","last_active":"2023-07-14T15:57:26.694804+0000","last_peered":"2023-07-14T15:57:26.694804+0000","last_clean":"2023-07-14T15:57:26.694804+0000","last_became_active":"2023-07-14T15:57:25.703738+0000","last_became_peered":"2023-07-14T15:57:25.703738+0000","last_unstale":"2023-07-14T15:57:26.694804+0000","last_undegraded":"2023-07-14T15:57:26.694804+0000","last_fullsized":"2023-07-14T15:57:26.694804+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:59:26.269692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:57:24.924637+0000","last_change":"2023-07-14T15:57:24.924637+0000","last_active":"2023-07-14T15:57:24.924637+0000","last_peered":"2023-07-14T15:57:24.924637+0000","last_clean":"2023-07-14T15:57:24.924637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:57:24.924637+0000","last_undegraded":"2023-07-14T15:57:24.924637+0000","last_fullsized":"2023-07-14T15:57:24.924637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.715018+0000","last_change":"2023-07-14T15:57:25.707017+0000","last_active":"2023-07-14T15:57:25.715018+0000","last_peered":"2023-07-14T15:57:25.715018+0000","last_clean":"2023-07-14T15:57:25.715018+0000","last_became_active":"2023-07-14T15:57:25.706670+0000","last_became_peered":"2023-07-14T15:57:25.706670+0000","last_unstale":"2023-07-14T15:57:25.715018+0000","last_undegraded":"2023-07-14T15:57:25.715018+0000","last_fullsized":"2023-07-14T15:57:25.715018+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:37:34.881300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694039+0000","last_change":"2023-07-14T15:57:25.716158+0000","last_active":"2023-07-14T15:57:26.694039+0000","last_peered":"2023-07-14T15:57:26.694039+0000","last_clean":"2023-07-14T15:57:26.694039+0000","last_became_active":"2023-07-14T15:57:25.715850+0000","last_became_peered":"2023-07-14T15:57:25.715850+0000","last_unstale":"2023-07-14T15:57:26.694039+0000","last_undegraded":"2023-07-14T15:57:26.694039+0000","last_fullsized":"2023-07-14T15:57:26.694039+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:30:09.595831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694008+0000","last_change":"2023-07-14T15:57:25.708658+0000","last_active":"2023-07-14T15:57:26.694008+0000","last_peered":"2023-07-14T15:57:26.694008+0000","last_clean":"2023-07-14T15:57:26.694008+0000","last_became_active":"2023-07-14T15:57:25.708289+0000","last_became_peered":"2023-07-14T15:57:25.708289+0000","last_unstale":"2023-07-14T15:57:26.694008+0000","last_undegraded":"2023-07-14T15:57:26.694008+0000","last_fullsized":"2023-07-14T15:57:26.694008+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:20:54.175890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.717615+0000","last_change":"2023-07-14T15:57:25.713419+0000","last_active":"2023-07-14T15:57:25.717615+0000","last_peered":"2023-07-14T15:57:25.717615+0000","last_clean":"2023-07-14T15:57:25.717615+0000","last_became_active":"2023-07-14T15:57:25.713093+0000","last_became_peered":"2023-07-14T15:57:25.713093+0000","last_unstale":"2023-07-14T15:57:25.717615+0000","last_undegraded":"2023-07-14T15:57:25.717615+0000","last_fullsized":"2023-07-14T15:57:25.717615+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:00:49.136871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693994+0000","last_change":"2023-07-14T15:57:25.706580+0000","last_active":"2023-07-14T15:57:26.693994+0000","last_peered":"2023-07-14T15:57:26.693994+0000","last_clean":"2023-07-14T15:57:26.693994+0000","last_became_active":"2023-07-14T15:57:25.706059+0000","last_became_peered":"2023-07-14T15:57:25.706059+0000","last_unstale":"2023-07-14T15:57:26.693994+0000","last_undegraded":"2023-07-14T15:57:26.693994+0000","last_fullsized":"2023-07-14T15:57:26.693994+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:16:24.805508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694193+0000","last_change":"2023-07-14T15:57:25.706488+0000","last_active":"2023-07-14T15:57:26.694193+0000","last_peered":"2023-07-14T15:57:26.694193+0000","last_clean":"2023-07-14T15:57:26.694193+0000","last_became_active":"2023-07-14T15:57:25.706198+0000","last_became_peered":"2023-07-14T15:57:25.706198+0000","last_unstale":"2023-07-14T15:57:26.694193+0000","last_undegraded":"2023-07-14T15:57:26.694193+0000","last_fullsized":"2023-07-14T15:57:26.694193+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:38:44.179763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"35'4","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170540+0000","last_change":"2023-07-14T15:57:24.951038+0000","last_active":"2023-07-14T15:57:27.170540+0000","last_peered":"2023-07-14T15:57:27.170540+0000","last_clean":"2023-07-14T15:57:27.170540+0000","last_became_active":"2023-07-14T15:57:24.950729+0000","last_became_peered":"2023-07-14T15:57:24.950729+0000","last_unstale":"2023-07-14T15:57:27.170540+0000","last_undegraded":"2023-07-14T15:57:27.170540+0000","last_fullsized":"2023-07-14T15:57:27.170540+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:50:06.189560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.717685+0000","last_change":"2023-07-14T15:57:25.713457+0000","last_active":"2023-07-14T15:57:25.717685+0000","last_peered":"2023-07-14T15:57:25.717685+0000","last_clean":"2023-07-14T15:57:25.717685+0000","last_became_active":"2023-07-14T15:57:25.713153+0000","last_became_peered":"2023-07-14T15:57:25.713153+0000","last_unstale":"2023-07-14T15:57:25.717685+0000","last_undegraded":"2023-07-14T15:57:25.717685+0000","last_fullsized":"2023-07-14T15:57:25.717685+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:06:47.964048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"35'1","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.944686+0000","last_change":"2023-07-14T15:57:24.950846+0000","last_active":"2023-07-14T15:57:25.944686+0000","last_peered":"2023-07-14T15:57:25.944686+0000","last_clean":"2023-07-14T15:57:25.944686+0000","last_became_active":"2023-07-14T15:57:24.948195+0000","last_became_peered":"2023-07-14T15:57:24.948195+0000","last_unstale":"2023-07-14T15:57:25.944686+0000","last_undegraded":"2023-07-14T15:57:25.944686+0000","last_fullsized":"2023-07-14T15:57:25.944686+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:11:06.906742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694467+0000","last_change":"2023-07-14T15:57:25.706821+0000","last_active":"2023-07-14T15:57:26.694467+0000","last_peered":"2023-07-14T15:57:26.694467+0000","last_clean":"2023-07-14T15:57:26.694467+0000","last_became_active":"2023-07-14T15:57:25.706544+0000","last_became_peered":"2023-07-14T15:57:25.706544+0000","last_unstale":"2023-07-14T15:57:26.694467+0000","last_undegraded":"2023-07-14T15:57:26.694467+0000","last_fullsized":"2023-07-14T15:57:26.694467+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:57:14.558950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694334+0000","last_change":"2023-07-14T15:57:24.946400+0000","last_active":"2023-07-14T15:57:26.694334+0000","last_peered":"2023-07-14T15:57:26.694334+0000","last_clean":"2023-07-14T15:57:26.694334+0000","last_became_active":"2023-07-14T15:57:24.944268+0000","last_became_peered":"2023-07-14T15:57:24.944268+0000","last_unstale":"2023-07-14T15:57:26.694334+0000","last_undegraded":"2023-07-14T15:57:26.694334+0000","last_fullsized":"2023-07-14T15:57:26.694334+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:19:27.823719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.717611+0000","last_change":"2023-07-14T15:57:25.713045+0000","last_active":"2023-07-14T15:57:25.717611+0000","last_peered":"2023-07-14T15:57:25.717611+0000","last_clean":"2023-07-14T15:57:25.717611+0000","last_became_active":"2023-07-14T15:57:25.712719+0000","last_became_peered":"2023-07-14T15:57:25.712719+0000","last_unstale":"2023-07-14T15:57:25.717611+0000","last_undegraded":"2023-07-14T15:57:25.717611+0000","last_fullsized":"2023-07-14T15:57:25.717611+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:29:07.098880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170349+0000","last_change":"2023-07-14T15:57:24.949781+0000","last_active":"2023-07-14T15:57:27.170349+0000","last_peered":"2023-07-14T15:57:27.170349+0000","last_clean":"2023-07-14T15:57:27.170349+0000","last_became_active":"2023-07-14T15:57:24.949496+0000","last_became_peered":"2023-07-14T15:57:24.949496+0000","last_unstale":"2023-07-14T15:57:27.170349+0000","last_undegraded":"2023-07-14T15:57:27.170349+0000","last_fullsized":"2023-07-14T15:57:27.170349+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:38:12.937516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693738+0000","last_change":"2023-07-14T15:57:25.712413+0000","last_active":"2023-07-14T15:57:26.693738+0000","last_peered":"2023-07-14T15:57:26.693738+0000","last_clean":"2023-07-14T15:57:26.693738+0000","last_became_active":"2023-07-14T15:57:25.712153+0000","last_became_peered":"2023-07-14T15:57:25.712153+0000","last_unstale":"2023-07-14T15:57:26.693738+0000","last_undegraded":"2023-07-14T15:57:26.693738+0000","last_fullsized":"2023-07-14T15:57:26.693738+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:48:28.785668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"35'1","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170210+0000","last_change":"2023-07-14T15:57:24.946938+0000","last_active":"2023-07-14T15:57:27.170210+0000","last_peered":"2023-07-14T15:57:27.170210+0000","last_clean":"2023-07-14T15:57:27.170210+0000","last_became_active":"2023-07-14T15:57:24.946611+0000","last_became_peered":"2023-07-14T15:57:24.946611+0000","last_unstale":"2023-07-14T15:57:27.170210+0000","last_undegraded":"2023-07-14T15:57:27.170210+0000","last_fullsized":"2023-07-14T15:57:27.170210+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:03:29.027256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:57:24.924637+0000","last_change":"2023-07-14T15:57:24.924637+0000","last_active":"2023-07-14T15:57:24.924637+0000","last_peered":"2023-07-14T15:57:24.924637+0000","last_clean":"2023-07-14T15:57:24.924637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:57:24.924637+0000","last_undegraded":"2023-07-14T15:57:24.924637+0000","last_fullsized":"2023-07-14T15:57:24.924637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"35'1","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.941681+0000","last_change":"2023-07-14T15:57:24.952640+0000","last_active":"2023-07-14T15:57:25.941681+0000","last_peered":"2023-07-14T15:57:25.941681+0000","last_clean":"2023-07-14T15:57:25.941681+0000","last_became_active":"2023-07-14T15:57:24.952305+0000","last_became_peered":"2023-07-14T15:57:24.952305+0000","last_unstale":"2023-07-14T15:57:25.941681+0000","last_undegraded":"2023-07-14T15:57:25.941681+0000","last_fullsized":"2023-07-14T15:57:25.941681+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:54:38.765166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694294+0000","last_change":"2023-07-14T15:57:25.714100+0000","last_active":"2023-07-14T15:57:26.694294+0000","last_peered":"2023-07-14T15:57:26.694294+0000","last_clean":"2023-07-14T15:57:26.694294+0000","last_became_active":"2023-07-14T15:57:25.713850+0000","last_became_peered":"2023-07-14T15:57:25.713850+0000","last_unstale":"2023-07-14T15:57:26.694294+0000","last_undegraded":"2023-07-14T15:57:26.694294+0000","last_fullsized":"2023-07-14T15:57:26.694294+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:17:22.305947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693561+0000","last_change":"2023-07-14T15:57:24.944873+0000","last_active":"2023-07-14T15:57:26.693561+0000","last_peered":"2023-07-14T15:57:26.693561+0000","last_clean":"2023-07-14T15:57:26.693561+0000","last_became_active":"2023-07-14T15:57:24.944406+0000","last_became_peered":"2023-07-14T15:57:24.944406+0000","last_unstale":"2023-07-14T15:57:26.693561+0000","last_undegraded":"2023-07-14T15:57:26.693561+0000","last_fullsized":"2023-07-14T15:57:26.693561+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:27:08.642795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.717649+0000","last_change":"2023-07-14T15:57:25.713086+0000","last_active":"2023-07-14T15:57:25.717649+0000","last_peered":"2023-07-14T15:57:25.717649+0000","last_clean":"2023-07-14T15:57:25.717649+0000","last_became_active":"2023-07-14T15:57:25.712650+0000","last_became_peered":"2023-07-14T15:57:25.712650+0000","last_unstale":"2023-07-14T15:57:25.717649+0000","last_undegraded":"2023-07-14T15:57:25.717649+0000","last_fullsized":"2023-07-14T15:57:25.717649+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:21:41.043364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.694205+0000","last_change":"2023-07-14T15:57:24.946452+0000","last_active":"2023-07-14T15:57:25.694205+0000","last_peered":"2023-07-14T15:57:25.694205+0000","last_clean":"2023-07-14T15:57:25.694205+0000","last_became_active":"2023-07-14T15:57:24.946176+0000","last_became_peered":"2023-07-14T15:57:24.946176+0000","last_unstale":"2023-07-14T15:57:25.694205+0000","last_undegraded":"2023-07-14T15:57:25.694205+0000","last_fullsized":"2023-07-14T15:57:25.694205+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:53:48.975299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694391+0000","last_change":"2023-07-14T15:57:25.710818+0000","last_active":"2023-07-14T15:57:26.694391+0000","last_peered":"2023-07-14T15:57:26.694391+0000","last_clean":"2023-07-14T15:57:26.694391+0000","last_became_active":"2023-07-14T15:57:25.710212+0000","last_became_peered":"2023-07-14T15:57:25.710212+0000","last_unstale":"2023-07-14T15:57:26.694391+0000","last_undegraded":"2023-07-14T15:57:26.694391+0000","last_fullsized":"2023-07-14T15:57:26.694391+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:39:17.831626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694697+0000","last_change":"2023-07-14T15:57:24.949982+0000","last_active":"2023-07-14T15:57:26.694697+0000","last_peered":"2023-07-14T15:57:26.694697+0000","last_clean":"2023-07-14T15:57:26.694697+0000","last_became_active":"2023-07-14T15:57:24.949690+0000","last_became_peered":"2023-07-14T15:57:24.949690+0000","last_unstale":"2023-07-14T15:57:26.694697+0000","last_undegraded":"2023-07-14T15:57:26.694697+0000","last_fullsized":"2023-07-14T15:57:26.694697+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:06:06.625225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170316+0000","last_change":"2023-07-14T15:57:25.703650+0000","last_active":"2023-07-14T15:57:27.170316+0000","last_peered":"2023-07-14T15:57:27.170316+0000","last_clean":"2023-07-14T15:57:27.170316+0000","last_became_active":"2023-07-14T15:57:25.703366+0000","last_became_peered":"2023-07-14T15:57:25.703366+0000","last_unstale":"2023-07-14T15:57:27.170316+0000","last_undegraded":"2023-07-14T15:57:27.170316+0000","last_fullsized":"2023-07-14T15:57:27.170316+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:38:49.336628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694197+0000","last_change":"2023-07-14T15:57:24.949161+0000","last_active":"2023-07-14T15:57:26.694197+0000","last_peered":"2023-07-14T15:57:26.694197+0000","last_clean":"2023-07-14T15:57:26.694197+0000","last_became_active":"2023-07-14T15:57:24.948793+0000","last_became_peered":"2023-07-14T15:57:24.948793+0000","last_unstale":"2023-07-14T15:57:26.694197+0000","last_undegraded":"2023-07-14T15:57:26.694197+0000","last_fullsized":"2023-07-14T15:57:26.694197+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:40:33.570630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694750+0000","last_change":"2023-07-14T15:57:25.708172+0000","last_active":"2023-07-14T15:57:26.694750+0000","last_peered":"2023-07-14T15:57:26.694750+0000","last_clean":"2023-07-14T15:57:26.694750+0000","last_became_active":"2023-07-14T15:57:25.707852+0000","last_became_peered":"2023-07-14T15:57:25.707852+0000","last_unstale":"2023-07-14T15:57:26.694750+0000","last_undegraded":"2023-07-14T15:57:26.694750+0000","last_fullsized":"2023-07-14T15:57:26.694750+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:35:14.571116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"35'3","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694081+0000","last_change":"2023-07-14T15:57:24.943596+0000","last_active":"2023-07-14T15:57:26.694081+0000","last_peered":"2023-07-14T15:57:26.694081+0000","last_clean":"2023-07-14T15:57:26.694081+0000","last_became_active":"2023-07-14T15:57:24.943283+0000","last_became_peered":"2023-07-14T15:57:24.943283+0000","last_unstale":"2023-07-14T15:57:26.694081+0000","last_undegraded":"2023-07-14T15:57:26.694081+0000","last_fullsized":"2023-07-14T15:57:26.694081+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:59:41.480965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.701436+0000","last_change":"2023-07-14T15:57:25.700392+0000","last_active":"2023-07-14T15:57:25.701436+0000","last_peered":"2023-07-14T15:57:25.701436+0000","last_clean":"2023-07-14T15:57:25.701436+0000","last_became_active":"2023-07-14T15:57:25.700004+0000","last_became_peered":"2023-07-14T15:57:25.700004+0000","last_unstale":"2023-07-14T15:57:25.701436+0000","last_undegraded":"2023-07-14T15:57:25.701436+0000","last_fullsized":"2023-07-14T15:57:25.701436+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:19:12.695328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"35'6","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694419+0000","last_change":"2023-07-14T15:57:24.947031+0000","last_active":"2023-07-14T15:57:26.694419+0000","last_peered":"2023-07-14T15:57:26.694419+0000","last_clean":"2023-07-14T15:57:26.694419+0000","last_became_active":"2023-07-14T15:57:24.946757+0000","last_became_peered":"2023-07-14T15:57:24.946757+0000","last_unstale":"2023-07-14T15:57:26.694419+0000","last_undegraded":"2023-07-14T15:57:26.694419+0000","last_fullsized":"2023-07-14T15:57:26.694419+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:53:11.648125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693550+0000","last_change":"2023-07-14T15:57:25.707515+0000","last_active":"2023-07-14T15:57:26.693550+0000","last_peered":"2023-07-14T15:57:26.693550+0000","last_clean":"2023-07-14T15:57:26.693550+0000","last_became_active":"2023-07-14T15:57:25.706851+0000","last_became_peered":"2023-07-14T15:57:25.706851+0000","last_unstale":"2023-07-14T15:57:26.693550+0000","last_undegraded":"2023-07-14T15:57:26.693550+0000","last_fullsized":"2023-07-14T15:57:26.693550+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:32:43.868693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693711+0000","last_change":"2023-07-14T15:57:24.950415+0000","last_active":"2023-07-14T15:57:26.693711+0000","last_peered":"2023-07-14T15:57:26.693711+0000","last_clean":"2023-07-14T15:57:26.693711+0000","last_became_active":"2023-07-14T15:57:24.950096+0000","last_became_peered":"2023-07-14T15:57:24.950096+0000","last_unstale":"2023-07-14T15:57:26.693711+0000","last_undegraded":"2023-07-14T15:57:26.693711+0000","last_fullsized":"2023-07-14T15:57:26.693711+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:40:32.381876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.717469+0000","last_change":"2023-07-14T15:57:25.709485+0000","last_active":"2023-07-14T15:57:25.717469+0000","last_peered":"2023-07-14T15:57:25.717469+0000","last_clean":"2023-07-14T15:57:25.717469+0000","last_became_active":"2023-07-14T15:57:25.709177+0000","last_became_peered":"2023-07-14T15:57:25.709177+0000","last_unstale":"2023-07-14T15:57:25.717469+0000","last_undegraded":"2023-07-14T15:57:25.717469+0000","last_fullsized":"2023-07-14T15:57:25.717469+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:26:49.722181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.703812+0000","last_change":"2023-07-14T15:57:24.950482+0000","last_active":"2023-07-14T15:57:25.703812+0000","last_peered":"2023-07-14T15:57:25.703812+0000","last_clean":"2023-07-14T15:57:25.703812+0000","last_became_active":"2023-07-14T15:57:24.950222+0000","last_became_peered":"2023-07-14T15:57:24.950222+0000","last_unstale":"2023-07-14T15:57:25.703812+0000","last_undegraded":"2023-07-14T15:57:25.703812+0000","last_fullsized":"2023-07-14T15:57:25.703812+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:02:33.348436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:57:24.924637+0000","last_change":"2023-07-14T15:57:24.924637+0000","last_active":"2023-07-14T15:57:24.924637+0000","last_peered":"2023-07-14T15:57:24.924637+0000","last_clean":"2023-07-14T15:57:24.924637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:57:24.924637+0000","last_undegraded":"2023-07-14T15:57:24.924637+0000","last_fullsized":"2023-07-14T15:57:24.924637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694231+0000","last_change":"2023-07-14T15:57:24.948415+0000","last_active":"2023-07-14T15:57:26.694231+0000","last_peered":"2023-07-14T15:57:26.694231+0000","last_clean":"2023-07-14T15:57:26.694231+0000","last_became_active":"2023-07-14T15:57:24.947719+0000","last_became_peered":"2023-07-14T15:57:24.947719+0000","last_unstale":"2023-07-14T15:57:26.694231+0000","last_undegraded":"2023-07-14T15:57:26.694231+0000","last_fullsized":"2023-07-14T15:57:26.694231+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:08:13.930103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.076982+0000","last_change":"2023-07-14T15:57:25.710816+0000","last_active":"2023-07-14T15:57:27.076982+0000","last_peered":"2023-07-14T15:57:27.076982+0000","last_clean":"2023-07-14T15:57:27.076982+0000","last_became_active":"2023-07-14T15:57:25.710525+0000","last_became_peered":"2023-07-14T15:57:25.710525+0000","last_unstale":"2023-07-14T15:57:27.076982+0000","last_undegraded":"2023-07-14T15:57:27.076982+0000","last_fullsized":"2023-07-14T15:57:27.076982+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:54:39.767268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"35'8","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170313+0000","last_change":"2023-07-14T15:57:24.949662+0000","last_active":"2023-07-14T15:57:27.170313+0000","last_peered":"2023-07-14T15:57:27.170313+0000","last_clean":"2023-07-14T15:57:27.170313+0000","last_became_active":"2023-07-14T15:57:24.949145+0000","last_became_peered":"2023-07-14T15:57:24.949145+0000","last_unstale":"2023-07-14T15:57:27.170313+0000","last_undegraded":"2023-07-14T15:57:27.170313+0000","last_fullsized":"2023-07-14T15:57:27.170313+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:41:33.784826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.714329+0000","last_change":"2023-07-14T15:57:25.708735+0000","last_active":"2023-07-14T15:57:25.714329+0000","last_peered":"2023-07-14T15:57:25.714329+0000","last_clean":"2023-07-14T15:57:25.714329+0000","last_became_active":"2023-07-14T15:57:25.708251+0000","last_became_peered":"2023-07-14T15:57:25.708251+0000","last_unstale":"2023-07-14T15:57:25.714329+0000","last_undegraded":"2023-07-14T15:57:25.714329+0000","last_fullsized":"2023-07-14T15:57:25.714329+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:48:43.914128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"35'1","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.944067+0000","last_change":"2023-07-14T15:57:24.950806+0000","last_active":"2023-07-14T15:57:25.944067+0000","last_peered":"2023-07-14T15:57:25.944067+0000","last_clean":"2023-07-14T15:57:25.944067+0000","last_became_active":"2023-07-14T15:57:24.950499+0000","last_became_peered":"2023-07-14T15:57:24.950499+0000","last_unstale":"2023-07-14T15:57:25.944067+0000","last_undegraded":"2023-07-14T15:57:25.944067+0000","last_fullsized":"2023-07-14T15:57:25.944067+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:44:44.559996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.715713+0000","last_change":"2023-07-14T15:57:25.707810+0000","last_active":"2023-07-14T15:57:25.715713+0000","last_peered":"2023-07-14T15:57:25.715713+0000","last_clean":"2023-07-14T15:57:25.715713+0000","last_became_active":"2023-07-14T15:57:25.707540+0000","last_became_peered":"2023-07-14T15:57:25.707540+0000","last_unstale":"2023-07-14T15:57:25.715713+0000","last_undegraded":"2023-07-14T15:57:25.715713+0000","last_fullsized":"2023-07-14T15:57:25.715713+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:47:29.092265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694350+0000","last_change":"2023-07-14T15:57:24.943847+0000","last_active":"2023-07-14T15:57:26.694350+0000","last_peered":"2023-07-14T15:57:26.694350+0000","last_clean":"2023-07-14T15:57:26.694350+0000","last_became_active":"2023-07-14T15:57:24.943377+0000","last_became_peered":"2023-07-14T15:57:24.943377+0000","last_unstale":"2023-07-14T15:57:26.694350+0000","last_undegraded":"2023-07-14T15:57:26.694350+0000","last_fullsized":"2023-07-14T15:57:26.694350+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:15:32.247155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.717587+0000","last_change":"2023-07-14T15:57:25.713671+0000","last_active":"2023-07-14T15:57:25.717587+0000","last_peered":"2023-07-14T15:57:25.717587+0000","last_clean":"2023-07-14T15:57:25.717587+0000","last_became_active":"2023-07-14T15:57:25.713277+0000","last_became_peered":"2023-07-14T15:57:25.713277+0000","last_unstale":"2023-07-14T15:57:25.717587+0000","last_undegraded":"2023-07-14T15:57:25.717587+0000","last_fullsized":"2023-07-14T15:57:25.717587+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:50:51.047340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"35'1","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.077142+0000","last_change":"2023-07-14T15:57:24.947575+0000","last_active":"2023-07-14T15:57:27.077142+0000","last_peered":"2023-07-14T15:57:27.077142+0000","last_clean":"2023-07-14T15:57:27.077142+0000","last_became_active":"2023-07-14T15:57:24.947236+0000","last_became_peered":"2023-07-14T15:57:24.947236+0000","last_unstale":"2023-07-14T15:57:27.077142+0000","last_undegraded":"2023-07-14T15:57:27.077142+0000","last_fullsized":"2023-07-14T15:57:27.077142+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:37:33.879198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694961+0000","last_change":"2023-07-14T15:57:25.715669+0000","last_active":"2023-07-14T15:57:26.694961+0000","last_peered":"2023-07-14T15:57:26.694961+0000","last_clean":"2023-07-14T15:57:26.694961+0000","last_became_active":"2023-07-14T15:57:25.715414+0000","last_became_peered":"2023-07-14T15:57:25.715414+0000","last_unstale":"2023-07-14T15:57:26.694961+0000","last_undegraded":"2023-07-14T15:57:26.694961+0000","last_fullsized":"2023-07-14T15:57:26.694961+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:11:15.367018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694919+0000","last_change":"2023-07-14T15:57:24.946879+0000","last_active":"2023-07-14T15:57:26.694919+0000","last_peered":"2023-07-14T15:57:26.694919+0000","last_clean":"2023-07-14T15:57:26.694919+0000","last_became_active":"2023-07-14T15:57:24.946470+0000","last_became_peered":"2023-07-14T15:57:24.946470+0000","last_unstale":"2023-07-14T15:57:26.694919+0000","last_undegraded":"2023-07-14T15:57:26.694919+0000","last_fullsized":"2023-07-14T15:57:26.694919+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:24:27.076859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693801+0000","last_change":"2023-07-14T15:57:25.709753+0000","last_active":"2023-07-14T15:57:26.693801+0000","last_peered":"2023-07-14T15:57:26.693801+0000","last_clean":"2023-07-14T15:57:26.693801+0000","last_became_active":"2023-07-14T15:57:25.709467+0000","last_became_peered":"2023-07-14T15:57:25.709467+0000","last_unstale":"2023-07-14T15:57:26.693801+0000","last_undegraded":"2023-07-14T15:57:26.693801+0000","last_fullsized":"2023-07-14T15:57:26.693801+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:54:59.872919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694767+0000","last_change":"2023-07-14T15:57:24.942184+0000","last_active":"2023-07-14T15:57:26.694767+0000","last_peered":"2023-07-14T15:57:26.694767+0000","last_clean":"2023-07-14T15:57:26.694767+0000","last_became_active":"2023-07-14T15:57:24.941875+0000","last_became_peered":"2023-07-14T15:57:24.941875+0000","last_unstale":"2023-07-14T15:57:26.694767+0000","last_undegraded":"2023-07-14T15:57:26.694767+0000","last_fullsized":"2023-07-14T15:57:26.694767+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:52:45.470519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693423+0000","last_change":"2023-07-14T15:57:25.704418+0000","last_active":"2023-07-14T15:57:26.693423+0000","last_peered":"2023-07-14T15:57:26.693423+0000","last_clean":"2023-07-14T15:57:26.693423+0000","last_became_active":"2023-07-14T15:57:25.704119+0000","last_became_peered":"2023-07-14T15:57:25.704119+0000","last_unstale":"2023-07-14T15:57:26.693423+0000","last_undegraded":"2023-07-14T15:57:26.693423+0000","last_fullsized":"2023-07-14T15:57:26.693423+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:45:31.081120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.704009+0000","last_change":"2023-07-14T15:57:24.949131+0000","last_active":"2023-07-14T15:57:25.704009+0000","last_peered":"2023-07-14T15:57:25.704009+0000","last_clean":"2023-07-14T15:57:25.704009+0000","last_became_active":"2023-07-14T15:57:24.948700+0000","last_became_peered":"2023-07-14T15:57:24.948700+0000","last_unstale":"2023-07-14T15:57:25.704009+0000","last_undegraded":"2023-07-14T15:57:25.704009+0000","last_fullsized":"2023-07-14T15:57:25.704009+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:05:50.727388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:57:24.924637+0000","last_change":"2023-07-14T15:57:24.924637+0000","last_active":"2023-07-14T15:57:24.924637+0000","last_peered":"2023-07-14T15:57:24.924637+0000","last_clean":"2023-07-14T15:57:24.924637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:57:24.924637+0000","last_undegraded":"2023-07-14T15:57:24.924637+0000","last_fullsized":"2023-07-14T15:57:24.924637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.695691+0000","last_change":"2023-07-14T15:57:24.950805+0000","last_active":"2023-07-14T15:57:25.695691+0000","last_peered":"2023-07-14T15:57:25.695691+0000","last_clean":"2023-07-14T15:57:25.695691+0000","last_became_active":"2023-07-14T15:57:24.950510+0000","last_became_peered":"2023-07-14T15:57:24.950510+0000","last_unstale":"2023-07-14T15:57:25.695691+0000","last_undegraded":"2023-07-14T15:57:25.695691+0000","last_fullsized":"2023-07-14T15:57:25.695691+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:10:30.682698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693849+0000","last_change":"2023-07-14T15:57:25.704591+0000","last_active":"2023-07-14T15:57:26.693849+0000","last_peered":"2023-07-14T15:57:26.693849+0000","last_clean":"2023-07-14T15:57:26.693849+0000","last_became_active":"2023-07-14T15:57:25.704350+0000","last_became_peered":"2023-07-14T15:57:25.704350+0000","last_unstale":"2023-07-14T15:57:26.693849+0000","last_undegraded":"2023-07-14T15:57:26.693849+0000","last_fullsized":"2023-07-14T15:57:26.693849+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:22:31.192902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.703273+0000","last_change":"2023-07-14T15:57:24.949538+0000","last_active":"2023-07-14T15:57:25.703273+0000","last_peered":"2023-07-14T15:57:25.703273+0000","last_clean":"2023-07-14T15:57:25.703273+0000","last_became_active":"2023-07-14T15:57:24.949233+0000","last_became_peered":"2023-07-14T15:57:24.949233+0000","last_unstale":"2023-07-14T15:57:25.703273+0000","last_undegraded":"2023-07-14T15:57:25.703273+0000","last_fullsized":"2023-07-14T15:57:25.703273+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:24:23.085848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.076745+0000","last_change":"2023-07-14T15:57:25.707893+0000","last_active":"2023-07-14T15:57:27.076745+0000","last_peered":"2023-07-14T15:57:27.076745+0000","last_clean":"2023-07-14T15:57:27.076745+0000","last_became_active":"2023-07-14T15:57:25.707515+0000","last_became_peered":"2023-07-14T15:57:25.707515+0000","last_unstale":"2023-07-14T15:57:27.076745+0000","last_undegraded":"2023-07-14T15:57:27.076745+0000","last_fullsized":"2023-07-14T15:57:27.076745+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:13:20.474319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693948+0000","last_change":"2023-07-14T15:57:24.944835+0000","last_active":"2023-07-14T15:57:26.693948+0000","last_peered":"2023-07-14T15:57:26.693948+0000","last_clean":"2023-07-14T15:57:26.693948+0000","last_became_active":"2023-07-14T15:57:24.944421+0000","last_became_peered":"2023-07-14T15:57:24.944421+0000","last_unstale":"2023-07-14T15:57:26.693948+0000","last_undegraded":"2023-07-14T15:57:26.693948+0000","last_fullsized":"2023-07-14T15:57:26.693948+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:36:20.633161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694805+0000","last_change":"2023-07-14T15:56:02.621850+0000","last_active":"2023-07-14T15:57:26.694805+0000","last_peered":"2023-07-14T15:57:26.694805+0000","last_clean":"2023-07-14T15:57:26.694805+0000","last_became_active":"2023-07-14T15:56:02.621471+0000","last_became_peered":"2023-07-14T15:56:02.621471+0000","last_unstale":"2023-07-14T15:57:26.694805+0000","last_undegraded":"2023-07-14T15:57:26.694805+0000","last_fullsized":"2023-07-14T15:57:26.694805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:31:52.328091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694678+0000","last_change":"2023-07-14T15:57:25.717543+0000","last_active":"2023-07-14T15:57:26.694678+0000","last_peered":"2023-07-14T15:57:26.694678+0000","last_clean":"2023-07-14T15:57:26.694678+0000","last_became_active":"2023-07-14T15:57:25.717185+0000","last_became_peered":"2023-07-14T15:57:25.717185+0000","last_unstale":"2023-07-14T15:57:26.694678+0000","last_undegraded":"2023-07-14T15:57:26.694678+0000","last_fullsized":"2023-07-14T15:57:26.694678+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:54:28.947637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.077156+0000","last_change":"2023-07-14T15:57:24.943282+0000","last_active":"2023-07-14T15:57:27.077156+0000","last_peered":"2023-07-14T15:57:27.077156+0000","last_clean":"2023-07-14T15:57:27.077156+0000","last_became_active":"2023-07-14T15:57:24.942964+0000","last_became_peered":"2023-07-14T15:57:24.942964+0000","last_unstale":"2023-07-14T15:57:27.077156+0000","last_undegraded":"2023-07-14T15:57:27.077156+0000","last_fullsized":"2023-07-14T15:57:27.077156+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:50:50.045238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694297+0000","last_change":"2023-07-14T15:56:02.621963+0000","last_active":"2023-07-14T15:57:26.694297+0000","last_peered":"2023-07-14T15:57:26.694297+0000","last_clean":"2023-07-14T15:57:26.694297+0000","last_became_active":"2023-07-14T15:56:02.621678+0000","last_became_peered":"2023-07-14T15:56:02.621678+0000","last_unstale":"2023-07-14T15:57:26.694297+0000","last_undegraded":"2023-07-14T15:57:26.694297+0000","last_fullsized":"2023-07-14T15:57:26.694297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:13:35.392704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:57:24.924637+0000","last_change":"2023-07-14T15:57:24.924637+0000","last_active":"2023-07-14T15:57:24.924637+0000","last_peered":"2023-07-14T15:57:24.924637+0000","last_clean":"2023-07-14T15:57:24.924637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:57:24.924637+0000","last_undegraded":"2023-07-14T15:57:24.924637+0000","last_fullsized":"2023-07-14T15:57:24.924637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"36'1","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.078951+0000","last_change":"2023-07-14T15:57:24.945667+0000","last_active":"2023-07-14T15:57:27.078951+0000","last_peered":"2023-07-14T15:57:27.078951+0000","last_clean":"2023-07-14T15:57:27.078951+0000","last_became_active":"2023-07-14T15:57:24.945404+0000","last_became_peered":"2023-07-14T15:57:24.945404+0000","last_unstale":"2023-07-14T15:57:27.078951+0000","last_undegraded":"2023-07-14T15:57:27.078951+0000","last_fullsized":"2023-07-14T15:57:27.078951+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:38:23.686073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.076753+0000","last_change":"2023-07-14T15:56:01.925110+0000","last_active":"2023-07-14T15:57:27.076753+0000","last_peered":"2023-07-14T15:57:27.076753+0000","last_clean":"2023-07-14T15:57:27.076753+0000","last_became_active":"2023-07-14T15:56:01.924723+0000","last_became_peered":"2023-07-14T15:56:01.924723+0000","last_unstale":"2023-07-14T15:57:27.076753+0000","last_undegraded":"2023-07-14T15:57:27.076753+0000","last_fullsized":"2023-07-14T15:57:27.076753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:03:05.866904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694461+0000","last_change":"2023-07-14T15:57:25.711424+0000","last_active":"2023-07-14T15:57:26.694461+0000","last_peered":"2023-07-14T15:57:26.694461+0000","last_clean":"2023-07-14T15:57:26.694461+0000","last_became_active":"2023-07-14T15:57:25.710670+0000","last_became_peered":"2023-07-14T15:57:25.710670+0000","last_unstale":"2023-07-14T15:57:26.694461+0000","last_undegraded":"2023-07-14T15:57:26.694461+0000","last_fullsized":"2023-07-14T15:57:26.694461+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:25:01.452256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-14T15:57:23.931783+0000","last_change":"2023-07-14T15:57:23.931783+0000","last_active":"2023-07-14T15:57:23.922534+0000","last_peered":"2023-07-14T15:57:23.922534+0000","last_clean":"2023-07-14T15:57:23.922534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:57:23.931783+0000","last_undegraded":"2023-07-14T15:57:23.931783+0000","last_fullsized":"2023-07-14T15:57:23.931783+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693926+0000","last_change":"2023-07-14T15:56:01.923465+0000","last_active":"2023-07-14T15:57:26.693926+0000","last_peered":"2023-07-14T15:57:26.693926+0000","last_clean":"2023-07-14T15:57:26.693926+0000","last_became_active":"2023-07-14T15:56:01.923160+0000","last_became_peered":"2023-07-14T15:56:01.923160+0000","last_unstale":"2023-07-14T15:57:26.693926+0000","last_undegraded":"2023-07-14T15:57:26.693926+0000","last_fullsized":"2023-07-14T15:57:26.693926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:59:26.813576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":189,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.694308+0000","last_change":"2023-07-14T15:55:54.040065+0000","last_active":"2023-07-14T15:57:25.694308+0000","last_peered":"2023-07-14T15:57:25.694308+0000","last_clean":"2023-07-14T15:57:25.694308+0000","last_became_active":"2023-07-14T15:55:54.038885+0000","last_became_peered":"2023-07-14T15:55:54.038885+0000","last_unstale":"2023-07-14T15:57:25.694308+0000","last_undegraded":"2023-07-14T15:57:25.694308+0000","last_fullsized":"2023-07-14T15:57:25.694308+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:55:53.025696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:55:53.025696+0000","last_clean_scrub_stamp":"2023-07-14T15:55:53.025696+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:23:24.719178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.076975+0000","last_change":"2023-07-14T15:57:25.703197+0000","last_active":"2023-07-14T15:57:27.076975+0000","last_peered":"2023-07-14T15:57:27.076975+0000","last_clean":"2023-07-14T15:57:27.076975+0000","last_became_active":"2023-07-14T15:57:25.702875+0000","last_became_peered":"2023-07-14T15:57:25.702875+0000","last_unstale":"2023-07-14T15:57:27.076975+0000","last_undegraded":"2023-07-14T15:57:27.076975+0000","last_fullsized":"2023-07-14T15:57:27.076975+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:00:49.136871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694484+0000","last_change":"2023-07-14T15:57:24.945870+0000","last_active":"2023-07-14T15:57:26.694484+0000","last_peered":"2023-07-14T15:57:26.694484+0000","last_clean":"2023-07-14T15:57:26.694484+0000","last_became_active":"2023-07-14T15:57:24.945590+0000","last_became_peered":"2023-07-14T15:57:24.945590+0000","last_unstale":"2023-07-14T15:57:26.694484+0000","last_undegraded":"2023-07-14T15:57:26.694484+0000","last_fullsized":"2023-07-14T15:57:26.694484+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:26:43.460807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693733+0000","last_change":"2023-07-14T15:56:01.920714+0000","last_active":"2023-07-14T15:57:26.693733+0000","last_peered":"2023-07-14T15:57:26.693733+0000","last_clean":"2023-07-14T15:57:26.693733+0000","last_became_active":"2023-07-14T15:56:01.920325+0000","last_became_peered":"2023-07-14T15:56:01.920325+0000","last_unstale":"2023-07-14T15:57:26.693733+0000","last_undegraded":"2023-07-14T15:57:26.693733+0000","last_fullsized":"2023-07-14T15:57:26.693733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:34:47.858129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.719013+0000","last_change":"2023-07-14T15:57:25.716751+0000","last_active":"2023-07-14T15:57:25.719013+0000","last_peered":"2023-07-14T15:57:25.719013+0000","last_clean":"2023-07-14T15:57:25.719013+0000","last_became_active":"2023-07-14T15:57:25.716471+0000","last_became_peered":"2023-07-14T15:57:25.716471+0000","last_unstale":"2023-07-14T15:57:25.719013+0000","last_undegraded":"2023-07-14T15:57:25.719013+0000","last_fullsized":"2023-07-14T15:57:25.719013+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:47:07.841527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-14T15:57:23.931840+0000","last_change":"2023-07-14T15:57:23.931840+0000","last_active":"2023-07-14T15:57:23.922534+0000","last_peered":"2023-07-14T15:57:23.922534+0000","last_clean":"2023-07-14T15:57:23.922534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:57:23.931840+0000","last_undegraded":"2023-07-14T15:57:23.931840+0000","last_fullsized":"2023-07-14T15:57:23.931840+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694065+0000","last_change":"2023-07-14T15:56:01.923631+0000","last_active":"2023-07-14T15:57:26.694065+0000","last_peered":"2023-07-14T15:57:26.694065+0000","last_clean":"2023-07-14T15:57:26.694065+0000","last_became_active":"2023-07-14T15:56:01.922783+0000","last_became_peered":"2023-07-14T15:56:01.922783+0000","last_unstale":"2023-07-14T15:57:26.694065+0000","last_undegraded":"2023-07-14T15:57:26.694065+0000","last_fullsized":"2023-07-14T15:57:26.694065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:31:16.123367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694160+0000","last_change":"2023-07-14T15:57:25.715467+0000","last_active":"2023-07-14T15:57:26.694160+0000","last_peered":"2023-07-14T15:57:26.694160+0000","last_clean":"2023-07-14T15:57:26.694160+0000","last_became_active":"2023-07-14T15:57:25.715169+0000","last_became_peered":"2023-07-14T15:57:25.715169+0000","last_unstale":"2023-07-14T15:57:26.694160+0000","last_undegraded":"2023-07-14T15:57:26.694160+0000","last_fullsized":"2023-07-14T15:57:26.694160+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:18:30.445378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694374+0000","last_change":"2023-07-14T15:57:24.948604+0000","last_active":"2023-07-14T15:57:26.694374+0000","last_peered":"2023-07-14T15:57:26.694374+0000","last_clean":"2023-07-14T15:57:26.694374+0000","last_became_active":"2023-07-14T15:57:24.948128+0000","last_became_peered":"2023-07-14T15:57:24.948128+0000","last_unstale":"2023-07-14T15:57:26.694374+0000","last_undegraded":"2023-07-14T15:57:26.694374+0000","last_fullsized":"2023-07-14T15:57:26.694374+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:56:33.930892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694844+0000","last_change":"2023-07-14T15:56:01.965649+0000","last_active":"2023-07-14T15:57:26.694844+0000","last_peered":"2023-07-14T15:57:26.694844+0000","last_clean":"2023-07-14T15:57:26.694844+0000","last_became_active":"2023-07-14T15:56:01.965344+0000","last_became_peered":"2023-07-14T15:56:01.965344+0000","last_unstale":"2023-07-14T15:57:26.694844+0000","last_undegraded":"2023-07-14T15:57:26.694844+0000","last_fullsized":"2023-07-14T15:57:26.694844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:30:36.061855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:57:24.924637+0000","last_change":"2023-07-14T15:57:24.924637+0000","last_active":"2023-07-14T15:57:24.924637+0000","last_peered":"2023-07-14T15:57:24.924637+0000","last_clean":"2023-07-14T15:57:24.924637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:57:24.924637+0000","last_undegraded":"2023-07-14T15:57:24.924637+0000","last_fullsized":"2023-07-14T15:57:24.924637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693419+0000","last_change":"2023-07-14T15:57:24.948449+0000","last_active":"2023-07-14T15:57:26.693419+0000","last_peered":"2023-07-14T15:57:26.693419+0000","last_clean":"2023-07-14T15:57:26.693419+0000","last_became_active":"2023-07-14T15:57:24.948145+0000","last_became_peered":"2023-07-14T15:57:24.948145+0000","last_unstale":"2023-07-14T15:57:26.693419+0000","last_undegraded":"2023-07-14T15:57:26.693419+0000","last_fullsized":"2023-07-14T15:57:26.693419+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:43:28.358856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694508+0000","last_change":"2023-07-14T15:56:01.966578+0000","last_active":"2023-07-14T15:57:26.694508+0000","last_peered":"2023-07-14T15:57:26.694508+0000","last_clean":"2023-07-14T15:57:26.694508+0000","last_became_active":"2023-07-14T15:56:01.966216+0000","last_became_peered":"2023-07-14T15:56:01.966216+0000","last_unstale":"2023-07-14T15:57:26.694508+0000","last_undegraded":"2023-07-14T15:57:26.694508+0000","last_fullsized":"2023-07-14T15:57:26.694508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:34:54.823729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":108,"acting":108,"num_store_stats":7},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476759,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":401408,"data_stored":162350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.35699999999999998}]},{"osd":1,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.48399999999999999}]},{"osd":2,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.57199999999999995}]},{"osd":4,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.59199999999999997}]},{"osd":5,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.73999999999999999}]},{"osd":6,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.61099999999999999}]},{"osd":7,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.629}]}]},{"osd":0,"up_from":16,"seq":68719476759,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":348160,"data_stored":135681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.33100000000000002}]},{"osd":2,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.44}]},{"osd":3,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.48799999999999999}]},{"osd":4,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.69899999999999995}]},{"osd":5,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.81699999999999995}]},{"osd":6,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.746},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.871}]},{"osd":7,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.72599999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542166,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":389120,"data_stored":155641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.65200000000000002}]},{"osd":1,"last update":"Fri Jul 14 15:56:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.76600000000000001}]},{"osd":2,"last update":"Fri Jul 14 15:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.87}]},{"osd":3,"last update":"Fri Jul 14 15:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":3.141,"5min":3.141,"15min":3.141},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.88800000000000001}]},{"osd":4,"last update":"Fri Jul 14 15:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.72399999999999998}]},{"osd":5,"last update":"Fri Jul 14 15:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.94499999999999995}]},{"osd":7,"last update":"Fri Jul 14 15:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.90800000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542165,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32008,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339832,"statfs":{"total":96636764160,"available":96603987968,"internally_reserved":0,"allocated":983040,"data_stored":745997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":4.5519999999999996,"5min":4.5519999999999996,"15min":4.5519999999999996},"last":0.39400000000000002},{"interface":"front","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":15.911,"5min":15.911,"15min":15.911},"last":0.46800000000000003}]},{"osd":2,"last update":"Fri Jul 14 15:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":4.5140000000000002,"5min":4.5140000000000002,"15min":4.5140000000000002},"last":0.44800000000000001}]},{"osd":3,"last update":"Fri Jul 14 15:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":4.452,"5min":4.452,"15min":4.452},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":4.2279999999999998,"5min":4.2279999999999998,"15min":4.2279999999999998},"last":0.42599999999999999}]},{"osd":4,"last update":"Fri Jul 14 15:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":4.6200000000000001,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":4.9109999999999996,"5min":4.9109999999999996,"15min":4.9109999999999996},"last":0.69399999999999995}]},{"osd":5,"last update":"Fri Jul 14 15:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":4.1269999999999998,"5min":4.1269999999999998,"15min":4.1269999999999998},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":4.585,"5min":4.585,"15min":4.585},"last":0.64000000000000001}]},{"osd":6,"last update":"Fri Jul 14 15:56:51 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":4.9880000000000004,"5min":4.9880000000000004,"15min":4.9880000000000004},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":4.1660000000000004,"5min":4.1660000000000004,"15min":4.1660000000000004},"last":0.68100000000000005}]},{"osd":7,"last update":"Fri Jul 14 15:56:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":4.9530000000000003,"5min":4.9530000000000003,"15min":4.9530000000000003},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":4.1959999999999997,"5min":4.1959999999999997,"15min":4.1959999999999997},"last":0.61799999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509463,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":413696,"data_stored":164406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:56:53 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.437}]},{"osd":1,"last update":"Fri Jul 14 15:56:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.315},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.46899999999999997}]},{"osd":3,"last update":"Fri Jul 14 15:56:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.498}]},{"osd":4,"last update":"Fri Jul 14 15:56:53 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.72699999999999998}]},{"osd":5,"last update":"Fri Jul 14 15:56:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.60999999999999999}]},{"osd":6,"last update":"Fri Jul 14 15:56:53 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.64600000000000002}]},{"osd":7,"last update":"Fri Jul 14 15:56:53 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.71099999999999997}]}]},{"osd":4,"up_from":15,"seq":64424509462,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":408,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":417792,"data_stored":163948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.88300000000000001}]},{"osd":1,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.748},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.82899999999999996}]},{"osd":2,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.80200000000000005}]},{"osd":3,"last update":"Fri Jul 14 15:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.94299999999999995}]},{"osd":5,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.84299999999999997}]},{"osd":6,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.63700000000000001}]},{"osd":7,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.61499999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509464,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27924,"kb_used_data":972,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343916,"statfs":{"total":96636764160,"available":96608169984,"internally_reserved":0,"allocated":995328,"data_stored":753210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":8.1500000000000004,"5min":8.1500000000000004,"15min":8.1500000000000004},"last":0.67500000000000004}]},{"osd":1,"last update":"Fri Jul 14 15:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.76800000000000002}]},{"osd":2,"last update":"Fri Jul 14 15:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.83899999999999997}]},{"osd":3,"last update":"Fri Jul 14 15:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.90600000000000003}]},{"osd":4,"last update":"Fri Jul 14 15:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.64400000000000002}]},{"osd":6,"last update":"Fri Jul 14 15:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.754},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.93799999999999994}]},{"osd":7,"last update":"Fri Jul 14 15:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.875},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.92300000000000004}]}]},{"osd":7,"up_from":15,"seq":64424509463,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":401408,"data_stored":162330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":4.5919999999999996,"5min":4.5919999999999996,"15min":4.5919999999999996},"last":0.624}]},{"osd":1,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1,"5min":1,"15min":1},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":4.665,"5min":4.665,"15min":4.665},"last":0.749}]},{"osd":2,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":5.4089999999999998,"5min":5.4089999999999998,"15min":5.4089999999999998},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":0.80400000000000005}]},{"osd":3,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":2.3380000000000001,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":2.3530000000000002,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":0.84199999999999997}]},{"osd":4,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.68899999999999995}]},{"osd":5,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.70399999999999996}]},{"osd":6,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.72599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T15:57:30.373 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T15:57:30.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.616+0000 7fd47c3ff700 1 Processor -- start 2023-07-14T15:57:30.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.616+0000 7fd47c3ff700 1 -- start start 2023-07-14T15:57:30.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.617+0000 7fd47c3ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd4740cffc0 0x7fd4740b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:30.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.618+0000 7fd47c3ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd474160c50 0x7fd4740cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:30.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.618+0000 7fd47c3ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4740cf6f0 con 0x7fd4740b8b80 2023-07-14T15:57:30.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.618+0000 7fd47c3ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4740d0de0 con 0x7fd474160c50 2023-07-14T15:57:30.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.618+0000 7fd47c3ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4741610f0 con 0x7fd4740cffc0 2023-07-14T15:57:30.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.618+0000 7fd47a99c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd474160c50 0x7fd4740cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:30.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.618+0000 7fd47999a700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd4740cffc0 0x7fd4740b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:30.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.618+0000 7fd47a19b700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fd4740b8b80 0x7fd4740cf8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.37:54002/0 (socket says 172.21.15.37:54002) 2023-07-14T15:57:30.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.618+0000 7fd47a19b700 1 -- 172.21.15.37:0/2011824713 learned_addr learned my addr 172.21.15.37:0/2011824713 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:30.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.619+0000 7fd479199700 1 -- 172.21.15.37:0/2011824713 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3408220294 0 0) 0x7fd4740cf6f0 con 0x7fd4740b8b80 2023-07-14T15:57:30.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.619+0000 7fd47999a700 1 -- 172.21.15.37:0/2011824713 >> v2:172.21.15.98:3300/0 conn(0x7fd474160c50 msgr2=0x7fd4740cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:30.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.619+0000 7fd47999a700 1 --2- 172.21.15.37:0/2011824713 >> v2:172.21.15.98:3300/0 conn(0x7fd474160c50 0x7fd4740cf1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:30.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.619+0000 7fd47999a700 1 -- 172.21.15.37:0/2011824713 >> v1:172.21.15.98:6789/0 conn(0x7fd4740b8b80 legacy=0x7fd4740cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:30.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.619+0000 7fd47999a700 1 -- 172.21.15.37:0/2011824713 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4740cd590 con 0x7fd4740cffc0 2023-07-14T15:57:30.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.619+0000 7fd47a99c700 1 --2- 172.21.15.37:0/2011824713 >> v2:172.21.15.98:3300/0 conn(0x7fd474160c50 0x7fd4740cf1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:57:30.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.619+0000 7fd47999a700 1 --2- 172.21.15.37:0/2011824713 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd4740cffc0 0x7fd4740b5cf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd464009840 tx=0x7fd464009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12fd77d73197fe47 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:30.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.619+0000 7fd479199700 1 -- 172.21.15.37:0/2011824713 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd464011830 con 0x7fd4740cffc0 2023-07-14T15:57:30.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.619+0000 7fd479199700 1 -- 172.21.15.37:0/2011824713 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd464011990 con 0x7fd4740cffc0 2023-07-14T15:57:30.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.619+0000 7fd479199700 1 -- 172.21.15.37:0/2011824713 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd464011d20 con 0x7fd4740cffc0 2023-07-14T15:57:30.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.620+0000 7fd47c3ff700 1 -- 172.21.15.37:0/2011824713 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd4740cffc0 msgr2=0x7fd4740b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:30.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.620+0000 7fd47c3ff700 1 --2- 172.21.15.37:0/2011824713 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd4740cffc0 0x7fd4740b5cf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd464009840 tx=0x7fd464009b50 comp rx=0 tx=0).stop 2023-07-14T15:57:30.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.620+0000 7fd47c3ff700 1 -- 172.21.15.37:0/2011824713 shutdown_connections 2023-07-14T15:57:30.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.620+0000 7fd47c3ff700 1 --2- 172.21.15.37:0/2011824713 >> v2:172.21.15.98:3300/0 conn(0x7fd474160c50 0x7fd4740cf1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:30.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.620+0000 7fd47c3ff700 1 --2- 172.21.15.37:0/2011824713 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd4740cffc0 0x7fd4740b5cf0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:30.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.620+0000 7fd47c3ff700 1 -- 172.21.15.37:0/2011824713 >> 172.21.15.37:0/2011824713 conn(0x7fd47406b150 msgr2=0x7fd47406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:30.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.620+0000 7fd47c3ff700 1 -- 172.21.15.37:0/2011824713 shutdown_connections 2023-07-14T15:57:30.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.620+0000 7fd47c3ff700 1 -- 172.21.15.37:0/2011824713 wait complete. 2023-07-14T15:57:30.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.622+0000 7fd47c3ff700 1 Processor -- start 2023-07-14T15:57:30.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.622+0000 7fd47c3ff700 1 -- start start 2023-07-14T15:57:30.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.623+0000 7fd47c3ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4740b8b80 0x7fd4741489b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:30.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.623+0000 7fd47c3ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd4740cffc0 0x7fd474149250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:30.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.623+0000 7fd47c3ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd474160c50 0x7fd4740c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:30.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.623+0000 7fd47c3ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4741f3150 con 0x7fd4740b8b80 2023-07-14T15:57:30.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.623+0000 7fd47c3ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4740b3f90 con 0x7fd474160c50 2023-07-14T15:57:30.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.623+0000 7fd47c3ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4740b3660 con 0x7fd4740cffc0 2023-07-14T15:57:30.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.623+0000 7fd47a19b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4740b8b80 0x7fd4741489b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:30.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.623+0000 7fd47a19b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4740b8b80 0x7fd4741489b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38540/0 (socket says 172.21.15.37:38540) 2023-07-14T15:57:30.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.623+0000 7fd47a19b700 1 -- 172.21.15.37:0/2527712802 learned_addr learned my addr 172.21.15.37:0/2527712802 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:30.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.623+0000 7fd47999a700 1 --2- 172.21.15.37:0/2527712802 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd4740cffc0 0x7fd474149250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:30.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.623+0000 7fd47a99c700 1 --2- 172.21.15.37:0/2527712802 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd474160c50 0x7fd4740c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:30.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.624+0000 7fd47a19b700 1 -- 172.21.15.37:0/2527712802 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd4740cffc0 msgr2=0x7fd474149250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:30.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.624+0000 7fd47a19b700 1 --2- 172.21.15.37:0/2527712802 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd4740cffc0 0x7fd474149250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:30.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.624+0000 7fd47a19b700 1 -- 172.21.15.37:0/2527712802 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd474160c50 msgr2=0x7fd4740c8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:30.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.624+0000 7fd47a19b700 1 --2- 172.21.15.37:0/2527712802 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd474160c50 0x7fd4740c8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:30.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.624+0000 7fd47a19b700 1 -- 172.21.15.37:0/2527712802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd46c009a70 con 0x7fd4740b8b80 2023-07-14T15:57:30.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.624+0000 7fd47a99c700 1 --2- 172.21.15.37:0/2527712802 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd474160c50 0x7fd4740c8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:57:30.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.624+0000 7fd47a19b700 1 --2- 172.21.15.37:0/2527712802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4740b8b80 0x7fd4741489b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd47000c520 tx=0x7fd47000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:30.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.624+0000 7fd46affd700 1 -- 172.21.15.37:0/2527712802 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd470004c80 con 0x7fd4740b8b80 2023-07-14T15:57:30.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.624+0000 7fd46affd700 1 -- 172.21.15.37:0/2527712802 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd470004de0 con 0x7fd4740b8b80 2023-07-14T15:57:30.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.624+0000 7fd46affd700 1 -- 172.21.15.37:0/2527712802 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd470007310 con 0x7fd4740b8b80 2023-07-14T15:57:30.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.624+0000 7fd47c3ff700 1 -- 172.21.15.37:0/2527712802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4640094a0 con 0x7fd4740b8b80 2023-07-14T15:57:30.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.624+0000 7fd47c3ff700 1 -- 172.21.15.37:0/2527712802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4740b3c20 con 0x7fd4740b8b80 2023-07-14T15:57:30.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.625+0000 7fd47c3ff700 1 -- 172.21.15.37:0/2527712802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd474067840 con 0x7fd4740b8b80 2023-07-14T15:57:30.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.626+0000 7fd46affd700 1 -- 172.21.15.37:0/2527712802 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd470007470 con 0x7fd4740b8b80 2023-07-14T15:57:30.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.627+0000 7fd46affd700 1 --2- 172.21.15.37:0/2527712802 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd45806ace0 0x7fd45806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:30.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.628+0000 7fd46affd700 1 -- 172.21.15.37:0/2527712802 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd470089080 con 0x7fd4740b8b80 2023-07-14T15:57:30.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.628+0000 7fd47999a700 1 --2- 172.21.15.37:0/2527712802 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd45806ace0 0x7fd45806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:30.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.628+0000 7fd47999a700 1 --2- 172.21.15.37:0/2527712802 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd45806ace0 0x7fd45806d190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd4740d03b0 tx=0x7fd464008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:30.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.631+0000 7fd46affd700 1 -- 172.21.15.37:0/2527712802 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd4700bb330 con 0x7fd4740b8b80 2023-07-14T15:57:30.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.835+0000 7fd47c3ff700 1 -- 172.21.15.37:0/2527712802 --> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd4740cdb50 con 0x7fd45806ace0 2023-07-14T15:57:30.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.844+0000 7fd46affd700 1 -- 172.21.15.37:0/2527712802 <== mgr.4100 v2:172.21.15.98:6832/3163748069 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309318 (secure 0 0 0) 0x7fd464011bb0 con 0x7fd45806ace0 2023-07-14T15:57:30.835 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:57:30.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.848+0000 7fd47c3ff700 1 -- 172.21.15.37:0/2527712802 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd45806ace0 msgr2=0x7fd45806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:30.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.848+0000 7fd47c3ff700 1 --2- 172.21.15.37:0/2527712802 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd45806ace0 0x7fd45806d190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd4740d03b0 tx=0x7fd464008030 comp rx=0 tx=0).stop 2023-07-14T15:57:30.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.848+0000 7fd47c3ff700 1 -- 172.21.15.37:0/2527712802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4740b8b80 msgr2=0x7fd4741489b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:30.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.848+0000 7fd47c3ff700 1 --2- 172.21.15.37:0/2527712802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4740b8b80 0x7fd4741489b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd47000c520 tx=0x7fd47000c830 comp rx=0 tx=0).stop 2023-07-14T15:57:30.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.848+0000 7fd47c3ff700 1 -- 172.21.15.37:0/2527712802 shutdown_connections 2023-07-14T15:57:30.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.848+0000 7fd47c3ff700 1 --2- 172.21.15.37:0/2527712802 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd474160c50 0x7fd4740c8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:30.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.848+0000 7fd47c3ff700 1 --2- 172.21.15.37:0/2527712802 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd45806ace0 0x7fd45806d190 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:30.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.848+0000 7fd47c3ff700 1 --2- 172.21.15.37:0/2527712802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4740b8b80 0x7fd4741489b0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:30.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.848+0000 7fd47c3ff700 1 --2- 172.21.15.37:0/2527712802 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd4740cffc0 0x7fd474149250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:30.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.848+0000 7fd47c3ff700 1 -- 172.21.15.37:0/2527712802 >> 172.21.15.37:0/2527712802 conn(0x7fd47406b150 msgr2=0x7fd47415a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:30.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.849+0000 7fd47c3ff700 1 -- 172.21.15.37:0/2527712802 shutdown_connections 2023-07-14T15:57:30.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:30.849+0000 7fd47c3ff700 1 -- 172.21.15.37:0/2527712802 wait complete. 2023-07-14T15:57:30.841 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-14T15:57:30.853 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2023-07-14T15:57:28.872886+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":190,"acting":190,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":106,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223960,"kb_used_data":4248,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754750760,"statfs":{"total":773094113280,"available":772864778240,"internally_reserved":0,"allocated":4349952,"data_stored":2443563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.946282"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694788+0000","last_change":"2023-07-14T15:57:25.708719+0000","last_active":"2023-07-14T15:57:26.694788+0000","last_peered":"2023-07-14T15:57:26.694788+0000","last_clean":"2023-07-14T15:57:26.694788+0000","last_became_active":"2023-07-14T15:57:25.708107+0000","last_became_peered":"2023-07-14T15:57:25.708107+0000","last_unstale":"2023-07-14T15:57:26.694788+0000","last_undegraded":"2023-07-14T15:57:26.694788+0000","last_fullsized":"2023-07-14T15:57:26.694788+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:52:37.992568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.717421+0000","last_change":"2023-07-14T15:57:25.710340+0000","last_active":"2023-07-14T15:57:25.717421+0000","last_peered":"2023-07-14T15:57:25.717421+0000","last_clean":"2023-07-14T15:57:25.717421+0000","last_became_active":"2023-07-14T15:57:25.710113+0000","last_became_peered":"2023-07-14T15:57:25.710113+0000","last_unstale":"2023-07-14T15:57:25.717421+0000","last_undegraded":"2023-07-14T15:57:25.717421+0000","last_fullsized":"2023-07-14T15:57:25.717421+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:53:01.027835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694176+0000","last_change":"2023-07-14T15:57:25.707011+0000","last_active":"2023-07-14T15:57:26.694176+0000","last_peered":"2023-07-14T15:57:26.694176+0000","last_clean":"2023-07-14T15:57:26.694176+0000","last_became_active":"2023-07-14T15:57:25.706720+0000","last_became_peered":"2023-07-14T15:57:25.706720+0000","last_unstale":"2023-07-14T15:57:26.694176+0000","last_undegraded":"2023-07-14T15:57:26.694176+0000","last_fullsized":"2023-07-14T15:57:26.694176+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:11:43.491601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694227+0000","last_change":"2023-07-14T15:57:25.710983+0000","last_active":"2023-07-14T15:57:26.694227+0000","last_peered":"2023-07-14T15:57:26.694227+0000","last_clean":"2023-07-14T15:57:26.694227+0000","last_became_active":"2023-07-14T15:57:25.710549+0000","last_became_peered":"2023-07-14T15:57:25.710549+0000","last_unstale":"2023-07-14T15:57:26.694227+0000","last_undegraded":"2023-07-14T15:57:26.694227+0000","last_fullsized":"2023-07-14T15:57:26.694227+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:40:25.153466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.076832+0000","last_change":"2023-07-14T15:57:25.703749+0000","last_active":"2023-07-14T15:57:27.076832+0000","last_peered":"2023-07-14T15:57:27.076832+0000","last_clean":"2023-07-14T15:57:27.076832+0000","last_became_active":"2023-07-14T15:57:25.703455+0000","last_became_peered":"2023-07-14T15:57:25.703455+0000","last_unstale":"2023-07-14T15:57:27.076832+0000","last_undegraded":"2023-07-14T15:57:27.076832+0000","last_fullsized":"2023-07-14T15:57:27.076832+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:08:58.707250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.717512+0000","last_change":"2023-07-14T15:57:25.712112+0000","last_active":"2023-07-14T15:57:25.717512+0000","last_peered":"2023-07-14T15:57:25.717512+0000","last_clean":"2023-07-14T15:57:25.717512+0000","last_became_active":"2023-07-14T15:57:25.711731+0000","last_became_peered":"2023-07-14T15:57:25.711731+0000","last_unstale":"2023-07-14T15:57:25.717512+0000","last_undegraded":"2023-07-14T15:57:25.717512+0000","last_fullsized":"2023-07-14T15:57:25.717512+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:00:40.319113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.715576+0000","last_change":"2023-07-14T15:57:25.708346+0000","last_active":"2023-07-14T15:57:25.715576+0000","last_peered":"2023-07-14T15:57:25.715576+0000","last_clean":"2023-07-14T15:57:25.715576+0000","last_became_active":"2023-07-14T15:57:25.708048+0000","last_became_peered":"2023-07-14T15:57:25.708048+0000","last_unstale":"2023-07-14T15:57:25.715576+0000","last_undegraded":"2023-07-14T15:57:25.715576+0000","last_fullsized":"2023-07-14T15:57:25.715576+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:05:25.335710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694045+0000","last_change":"2023-07-14T15:57:25.706331+0000","last_active":"2023-07-14T15:57:26.694045+0000","last_peered":"2023-07-14T15:57:26.694045+0000","last_clean":"2023-07-14T15:57:26.694045+0000","last_became_active":"2023-07-14T15:57:25.705691+0000","last_became_peered":"2023-07-14T15:57:25.705691+0000","last_unstale":"2023-07-14T15:57:26.694045+0000","last_undegraded":"2023-07-14T15:57:26.694045+0000","last_fullsized":"2023-07-14T15:57:26.694045+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:24:52.499316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.077364+0000","last_change":"2023-07-14T15:57:25.713167+0000","last_active":"2023-07-14T15:57:27.077364+0000","last_peered":"2023-07-14T15:57:27.077364+0000","last_clean":"2023-07-14T15:57:27.077364+0000","last_became_active":"2023-07-14T15:57:25.712829+0000","last_became_peered":"2023-07-14T15:57:25.712829+0000","last_unstale":"2023-07-14T15:57:27.077364+0000","last_undegraded":"2023-07-14T15:57:27.077364+0000","last_fullsized":"2023-07-14T15:57:27.077364+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:53:49.977402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.714964+0000","last_change":"2023-07-14T15:57:25.707232+0000","last_active":"2023-07-14T15:57:25.714964+0000","last_peered":"2023-07-14T15:57:25.714964+0000","last_clean":"2023-07-14T15:57:25.714964+0000","last_became_active":"2023-07-14T15:57:25.706976+0000","last_became_peered":"2023-07-14T15:57:25.706976+0000","last_unstale":"2023-07-14T15:57:25.714964+0000","last_undegraded":"2023-07-14T15:57:25.714964+0000","last_fullsized":"2023-07-14T15:57:25.714964+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:48:00.956575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:57:24.924637+0000","last_change":"2023-07-14T15:57:24.924637+0000","last_active":"2023-07-14T15:57:24.924637+0000","last_peered":"2023-07-14T15:57:24.924637+0000","last_clean":"2023-07-14T15:57:24.924637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:57:24.924637+0000","last_undegraded":"2023-07-14T15:57:24.924637+0000","last_fullsized":"2023-07-14T15:57:24.924637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.077125+0000","last_change":"2023-07-14T15:57:25.709331+0000","last_active":"2023-07-14T15:57:27.077125+0000","last_peered":"2023-07-14T15:57:27.077125+0000","last_clean":"2023-07-14T15:57:27.077125+0000","last_became_active":"2023-07-14T15:57:25.709039+0000","last_became_peered":"2023-07-14T15:57:25.709039+0000","last_unstale":"2023-07-14T15:57:27.077125+0000","last_undegraded":"2023-07-14T15:57:27.077125+0000","last_fullsized":"2023-07-14T15:57:27.077125+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:05:25.335710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.717498+0000","last_change":"2023-07-14T15:57:25.715095+0000","last_active":"2023-07-14T15:57:25.717498+0000","last_peered":"2023-07-14T15:57:25.717498+0000","last_clean":"2023-07-14T15:57:25.717498+0000","last_became_active":"2023-07-14T15:57:25.714840+0000","last_became_peered":"2023-07-14T15:57:25.714840+0000","last_unstale":"2023-07-14T15:57:25.717498+0000","last_undegraded":"2023-07-14T15:57:25.717498+0000","last_fullsized":"2023-07-14T15:57:25.717498+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:38:24.688175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170148+0000","last_change":"2023-07-14T15:57:25.710052+0000","last_active":"2023-07-14T15:57:27.170148+0000","last_peered":"2023-07-14T15:57:27.170148+0000","last_clean":"2023-07-14T15:57:27.170148+0000","last_became_active":"2023-07-14T15:57:25.709808+0000","last_became_peered":"2023-07-14T15:57:25.709808+0000","last_unstale":"2023-07-14T15:57:27.170148+0000","last_undegraded":"2023-07-14T15:57:27.170148+0000","last_fullsized":"2023-07-14T15:57:27.170148+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:19:01.933649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693904+0000","last_change":"2023-07-14T15:57:25.709747+0000","last_active":"2023-07-14T15:57:26.693904+0000","last_peered":"2023-07-14T15:57:26.693904+0000","last_clean":"2023-07-14T15:57:26.693904+0000","last_became_active":"2023-07-14T15:57:25.709442+0000","last_became_peered":"2023-07-14T15:57:25.709442+0000","last_unstale":"2023-07-14T15:57:26.693904+0000","last_undegraded":"2023-07-14T15:57:26.693904+0000","last_fullsized":"2023-07-14T15:57:26.693904+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:30:18.330946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.715604+0000","last_change":"2023-07-14T15:57:25.712207+0000","last_active":"2023-07-14T15:57:25.715604+0000","last_peered":"2023-07-14T15:57:25.715604+0000","last_clean":"2023-07-14T15:57:25.715604+0000","last_became_active":"2023-07-14T15:57:25.711936+0000","last_became_peered":"2023-07-14T15:57:25.711936+0000","last_unstale":"2023-07-14T15:57:25.715604+0000","last_undegraded":"2023-07-14T15:57:25.715604+0000","last_fullsized":"2023-07-14T15:57:25.715604+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:08:58.707250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694397+0000","last_change":"2023-07-14T15:57:25.711637+0000","last_active":"2023-07-14T15:57:26.694397+0000","last_peered":"2023-07-14T15:57:26.694397+0000","last_clean":"2023-07-14T15:57:26.694397+0000","last_became_active":"2023-07-14T15:57:25.710975+0000","last_became_peered":"2023-07-14T15:57:25.710975+0000","last_unstale":"2023-07-14T15:57:26.694397+0000","last_undegraded":"2023-07-14T15:57:26.694397+0000","last_fullsized":"2023-07-14T15:57:26.694397+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:24:11.251154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694300+0000","last_change":"2023-07-14T15:57:25.711476+0000","last_active":"2023-07-14T15:57:26.694300+0000","last_peered":"2023-07-14T15:57:26.694300+0000","last_clean":"2023-07-14T15:57:26.694300+0000","last_became_active":"2023-07-14T15:57:25.711204+0000","last_became_peered":"2023-07-14T15:57:25.711204+0000","last_unstale":"2023-07-14T15:57:26.694300+0000","last_undegraded":"2023-07-14T15:57:26.694300+0000","last_fullsized":"2023-07-14T15:57:26.694300+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:27:16.753361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694835+0000","last_change":"2023-07-14T15:57:25.715333+0000","last_active":"2023-07-14T15:57:26.694835+0000","last_peered":"2023-07-14T15:57:26.694835+0000","last_clean":"2023-07-14T15:57:26.694835+0000","last_became_active":"2023-07-14T15:57:25.715044+0000","last_became_peered":"2023-07-14T15:57:25.715044+0000","last_unstale":"2023-07-14T15:57:26.694835+0000","last_undegraded":"2023-07-14T15:57:26.694835+0000","last_fullsized":"2023-07-14T15:57:26.694835+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:13:09.841632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:57:24.924637+0000","last_change":"2023-07-14T15:57:24.924637+0000","last_active":"2023-07-14T15:57:24.924637+0000","last_peered":"2023-07-14T15:57:24.924637+0000","last_clean":"2023-07-14T15:57:24.924637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:57:24.924637+0000","last_undegraded":"2023-07-14T15:57:24.924637+0000","last_fullsized":"2023-07-14T15:57:24.924637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:57:24.924637+0000","last_change":"2023-07-14T15:57:24.924637+0000","last_active":"2023-07-14T15:57:24.924637+0000","last_peered":"2023-07-14T15:57:24.924637+0000","last_clean":"2023-07-14T15:57:24.924637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:57:24.924637+0000","last_undegraded":"2023-07-14T15:57:24.924637+0000","last_fullsized":"2023-07-14T15:57:24.924637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:57:24.924637+0000","last_change":"2023-07-14T15:57:24.924637+0000","last_active":"2023-07-14T15:57:24.924637+0000","last_peered":"2023-07-14T15:57:24.924637+0000","last_clean":"2023-07-14T15:57:24.924637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:57:24.924637+0000","last_undegraded":"2023-07-14T15:57:24.924637+0000","last_fullsized":"2023-07-14T15:57:24.924637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693910+0000","last_change":"2023-07-14T15:57:25.716297+0000","last_active":"2023-07-14T15:57:26.693910+0000","last_peered":"2023-07-14T15:57:26.693910+0000","last_clean":"2023-07-14T15:57:26.693910+0000","last_became_active":"2023-07-14T15:57:25.716028+0000","last_became_peered":"2023-07-14T15:57:25.716028+0000","last_unstale":"2023-07-14T15:57:26.693910+0000","last_undegraded":"2023-07-14T15:57:26.693910+0000","last_fullsized":"2023-07-14T15:57:26.693910+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:50:57.963143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693902+0000","last_change":"2023-07-14T15:57:25.707324+0000","last_active":"2023-07-14T15:57:26.693902+0000","last_peered":"2023-07-14T15:57:26.693902+0000","last_clean":"2023-07-14T15:57:26.693902+0000","last_became_active":"2023-07-14T15:57:25.706434+0000","last_became_peered":"2023-07-14T15:57:25.706434+0000","last_unstale":"2023-07-14T15:57:26.693902+0000","last_undegraded":"2023-07-14T15:57:26.693902+0000","last_fullsized":"2023-07-14T15:57:26.693902+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:15:31.939973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170401+0000","last_change":"2023-07-14T15:57:25.711970+0000","last_active":"2023-07-14T15:57:27.170401+0000","last_peered":"2023-07-14T15:57:27.170401+0000","last_clean":"2023-07-14T15:57:27.170401+0000","last_became_active":"2023-07-14T15:57:25.711620+0000","last_became_peered":"2023-07-14T15:57:25.711620+0000","last_unstale":"2023-07-14T15:57:27.170401+0000","last_undegraded":"2023-07-14T15:57:27.170401+0000","last_fullsized":"2023-07-14T15:57:27.170401+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:25:29.672522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694804+0000","last_change":"2023-07-14T15:57:25.704116+0000","last_active":"2023-07-14T15:57:26.694804+0000","last_peered":"2023-07-14T15:57:26.694804+0000","last_clean":"2023-07-14T15:57:26.694804+0000","last_became_active":"2023-07-14T15:57:25.703738+0000","last_became_peered":"2023-07-14T15:57:25.703738+0000","last_unstale":"2023-07-14T15:57:26.694804+0000","last_undegraded":"2023-07-14T15:57:26.694804+0000","last_fullsized":"2023-07-14T15:57:26.694804+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:59:26.269692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:57:24.924637+0000","last_change":"2023-07-14T15:57:24.924637+0000","last_active":"2023-07-14T15:57:24.924637+0000","last_peered":"2023-07-14T15:57:24.924637+0000","last_clean":"2023-07-14T15:57:24.924637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:57:24.924637+0000","last_undegraded":"2023-07-14T15:57:24.924637+0000","last_fullsized":"2023-07-14T15:57:24.924637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.715018+0000","last_change":"2023-07-14T15:57:25.707017+0000","last_active":"2023-07-14T15:57:25.715018+0000","last_peered":"2023-07-14T15:57:25.715018+0000","last_clean":"2023-07-14T15:57:25.715018+0000","last_became_active":"2023-07-14T15:57:25.706670+0000","last_became_peered":"2023-07-14T15:57:25.706670+0000","last_unstale":"2023-07-14T15:57:25.715018+0000","last_undegraded":"2023-07-14T15:57:25.715018+0000","last_fullsized":"2023-07-14T15:57:25.715018+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:37:34.881300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694039+0000","last_change":"2023-07-14T15:57:25.716158+0000","last_active":"2023-07-14T15:57:26.694039+0000","last_peered":"2023-07-14T15:57:26.694039+0000","last_clean":"2023-07-14T15:57:26.694039+0000","last_became_active":"2023-07-14T15:57:25.715850+0000","last_became_peered":"2023-07-14T15:57:25.715850+0000","last_unstale":"2023-07-14T15:57:26.694039+0000","last_undegraded":"2023-07-14T15:57:26.694039+0000","last_fullsized":"2023-07-14T15:57:26.694039+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:30:09.595831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694008+0000","last_change":"2023-07-14T15:57:25.708658+0000","last_active":"2023-07-14T15:57:26.694008+0000","last_peered":"2023-07-14T15:57:26.694008+0000","last_clean":"2023-07-14T15:57:26.694008+0000","last_became_active":"2023-07-14T15:57:25.708289+0000","last_became_peered":"2023-07-14T15:57:25.708289+0000","last_unstale":"2023-07-14T15:57:26.694008+0000","last_undegraded":"2023-07-14T15:57:26.694008+0000","last_fullsized":"2023-07-14T15:57:26.694008+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:20:54.175890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.717615+0000","last_change":"2023-07-14T15:57:25.713419+0000","last_active":"2023-07-14T15:57:25.717615+0000","last_peered":"2023-07-14T15:57:25.717615+0000","last_clean":"2023-07-14T15:57:25.717615+0000","last_became_active":"2023-07-14T15:57:25.713093+0000","last_became_peered":"2023-07-14T15:57:25.713093+0000","last_unstale":"2023-07-14T15:57:25.717615+0000","last_undegraded":"2023-07-14T15:57:25.717615+0000","last_fullsized":"2023-07-14T15:57:25.717615+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:00:49.136871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693994+0000","last_change":"2023-07-14T15:57:25.706580+0000","last_active":"2023-07-14T15:57:26.693994+0000","last_peered":"2023-07-14T15:57:26.693994+0000","last_clean":"2023-07-14T15:57:26.693994+0000","last_became_active":"2023-07-14T15:57:25.706059+0000","last_became_peered":"2023-07-14T15:57:25.706059+0000","last_unstale":"2023-07-14T15:57:26.693994+0000","last_undegraded":"2023-07-14T15:57:26.693994+0000","last_fullsized":"2023-07-14T15:57:26.693994+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:16:24.805508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694193+0000","last_change":"2023-07-14T15:57:25.706488+0000","last_active":"2023-07-14T15:57:26.694193+0000","last_peered":"2023-07-14T15:57:26.694193+0000","last_clean":"2023-07-14T15:57:26.694193+0000","last_became_active":"2023-07-14T15:57:25.706198+0000","last_became_peered":"2023-07-14T15:57:25.706198+0000","last_unstale":"2023-07-14T15:57:26.694193+0000","last_undegraded":"2023-07-14T15:57:26.694193+0000","last_fullsized":"2023-07-14T15:57:26.694193+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:38:44.179763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"35'4","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170540+0000","last_change":"2023-07-14T15:57:24.951038+0000","last_active":"2023-07-14T15:57:27.170540+0000","last_peered":"2023-07-14T15:57:27.170540+0000","last_clean":"2023-07-14T15:57:27.170540+0000","last_became_active":"2023-07-14T15:57:24.950729+0000","last_became_peered":"2023-07-14T15:57:24.950729+0000","last_unstale":"2023-07-14T15:57:27.170540+0000","last_undegraded":"2023-07-14T15:57:27.170540+0000","last_fullsized":"2023-07-14T15:57:27.170540+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:50:06.189560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.717685+0000","last_change":"2023-07-14T15:57:25.713457+0000","last_active":"2023-07-14T15:57:25.717685+0000","last_peered":"2023-07-14T15:57:25.717685+0000","last_clean":"2023-07-14T15:57:25.717685+0000","last_became_active":"2023-07-14T15:57:25.713153+0000","last_became_peered":"2023-07-14T15:57:25.713153+0000","last_unstale":"2023-07-14T15:57:25.717685+0000","last_undegraded":"2023-07-14T15:57:25.717685+0000","last_fullsized":"2023-07-14T15:57:25.717685+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:06:47.964048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"35'1","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.944686+0000","last_change":"2023-07-14T15:57:24.950846+0000","last_active":"2023-07-14T15:57:25.944686+0000","last_peered":"2023-07-14T15:57:25.944686+0000","last_clean":"2023-07-14T15:57:25.944686+0000","last_became_active":"2023-07-14T15:57:24.948195+0000","last_became_peered":"2023-07-14T15:57:24.948195+0000","last_unstale":"2023-07-14T15:57:25.944686+0000","last_undegraded":"2023-07-14T15:57:25.944686+0000","last_fullsized":"2023-07-14T15:57:25.944686+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:11:06.906742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694467+0000","last_change":"2023-07-14T15:57:25.706821+0000","last_active":"2023-07-14T15:57:26.694467+0000","last_peered":"2023-07-14T15:57:26.694467+0000","last_clean":"2023-07-14T15:57:26.694467+0000","last_became_active":"2023-07-14T15:57:25.706544+0000","last_became_peered":"2023-07-14T15:57:25.706544+0000","last_unstale":"2023-07-14T15:57:26.694467+0000","last_undegraded":"2023-07-14T15:57:26.694467+0000","last_fullsized":"2023-07-14T15:57:26.694467+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:57:14.558950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694334+0000","last_change":"2023-07-14T15:57:24.946400+0000","last_active":"2023-07-14T15:57:26.694334+0000","last_peered":"2023-07-14T15:57:26.694334+0000","last_clean":"2023-07-14T15:57:26.694334+0000","last_became_active":"2023-07-14T15:57:24.944268+0000","last_became_peered":"2023-07-14T15:57:24.944268+0000","last_unstale":"2023-07-14T15:57:26.694334+0000","last_undegraded":"2023-07-14T15:57:26.694334+0000","last_fullsized":"2023-07-14T15:57:26.694334+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:19:27.823719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.717611+0000","last_change":"2023-07-14T15:57:25.713045+0000","last_active":"2023-07-14T15:57:25.717611+0000","last_peered":"2023-07-14T15:57:25.717611+0000","last_clean":"2023-07-14T15:57:25.717611+0000","last_became_active":"2023-07-14T15:57:25.712719+0000","last_became_peered":"2023-07-14T15:57:25.712719+0000","last_unstale":"2023-07-14T15:57:25.717611+0000","last_undegraded":"2023-07-14T15:57:25.717611+0000","last_fullsized":"2023-07-14T15:57:25.717611+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:29:07.098880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170349+0000","last_change":"2023-07-14T15:57:24.949781+0000","last_active":"2023-07-14T15:57:27.170349+0000","last_peered":"2023-07-14T15:57:27.170349+0000","last_clean":"2023-07-14T15:57:27.170349+0000","last_became_active":"2023-07-14T15:57:24.949496+0000","last_became_peered":"2023-07-14T15:57:24.949496+0000","last_unstale":"2023-07-14T15:57:27.170349+0000","last_undegraded":"2023-07-14T15:57:27.170349+0000","last_fullsized":"2023-07-14T15:57:27.170349+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:38:12.937516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693738+0000","last_change":"2023-07-14T15:57:25.712413+0000","last_active":"2023-07-14T15:57:26.693738+0000","last_peered":"2023-07-14T15:57:26.693738+0000","last_clean":"2023-07-14T15:57:26.693738+0000","last_became_active":"2023-07-14T15:57:25.712153+0000","last_became_peered":"2023-07-14T15:57:25.712153+0000","last_unstale":"2023-07-14T15:57:26.693738+0000","last_undegraded":"2023-07-14T15:57:26.693738+0000","last_fullsized":"2023-07-14T15:57:26.693738+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:48:28.785668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"35'1","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170210+0000","last_change":"2023-07-14T15:57:24.946938+0000","last_active":"2023-07-14T15:57:27.170210+0000","last_peered":"2023-07-14T15:57:27.170210+0000","last_clean":"2023-07-14T15:57:27.170210+0000","last_became_active":"2023-07-14T15:57:24.946611+0000","last_became_peered":"2023-07-14T15:57:24.946611+0000","last_unstale":"2023-07-14T15:57:27.170210+0000","last_undegraded":"2023-07-14T15:57:27.170210+0000","last_fullsized":"2023-07-14T15:57:27.170210+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:03:29.027256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:57:24.924637+0000","last_change":"2023-07-14T15:57:24.924637+0000","last_active":"2023-07-14T15:57:24.924637+0000","last_peered":"2023-07-14T15:57:24.924637+0000","last_clean":"2023-07-14T15:57:24.924637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:57:24.924637+0000","last_undegraded":"2023-07-14T15:57:24.924637+0000","last_fullsized":"2023-07-14T15:57:24.924637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"35'1","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.941681+0000","last_change":"2023-07-14T15:57:24.952640+0000","last_active":"2023-07-14T15:57:25.941681+0000","last_peered":"2023-07-14T15:57:25.941681+0000","last_clean":"2023-07-14T15:57:25.941681+0000","last_became_active":"2023-07-14T15:57:24.952305+0000","last_became_peered":"2023-07-14T15:57:24.952305+0000","last_unstale":"2023-07-14T15:57:25.941681+0000","last_undegraded":"2023-07-14T15:57:25.941681+0000","last_fullsized":"2023-07-14T15:57:25.941681+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:54:38.765166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694294+0000","last_change":"2023-07-14T15:57:25.714100+0000","last_active":"2023-07-14T15:57:26.694294+0000","last_peered":"2023-07-14T15:57:26.694294+0000","last_clean":"2023-07-14T15:57:26.694294+0000","last_became_active":"2023-07-14T15:57:25.713850+0000","last_became_peered":"2023-07-14T15:57:25.713850+0000","last_unstale":"2023-07-14T15:57:26.694294+0000","last_undegraded":"2023-07-14T15:57:26.694294+0000","last_fullsized":"2023-07-14T15:57:26.694294+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:17:22.305947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693561+0000","last_change":"2023-07-14T15:57:24.944873+0000","last_active":"2023-07-14T15:57:26.693561+0000","last_peered":"2023-07-14T15:57:26.693561+0000","last_clean":"2023-07-14T15:57:26.693561+0000","last_became_active":"2023-07-14T15:57:24.944406+0000","last_became_peered":"2023-07-14T15:57:24.944406+0000","last_unstale":"2023-07-14T15:57:26.693561+0000","last_undegraded":"2023-07-14T15:57:26.693561+0000","last_fullsized":"2023-07-14T15:57:26.693561+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:27:08.642795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.717649+0000","last_change":"2023-07-14T15:57:25.713086+0000","last_active":"2023-07-14T15:57:25.717649+0000","last_peered":"2023-07-14T15:57:25.717649+0000","last_clean":"2023-07-14T15:57:25.717649+0000","last_became_active":"2023-07-14T15:57:25.712650+0000","last_became_peered":"2023-07-14T15:57:25.712650+0000","last_unstale":"2023-07-14T15:57:25.717649+0000","last_undegraded":"2023-07-14T15:57:25.717649+0000","last_fullsized":"2023-07-14T15:57:25.717649+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:21:41.043364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.694205+0000","last_change":"2023-07-14T15:57:24.946452+0000","last_active":"2023-07-14T15:57:25.694205+0000","last_peered":"2023-07-14T15:57:25.694205+0000","last_clean":"2023-07-14T15:57:25.694205+0000","last_became_active":"2023-07-14T15:57:24.946176+0000","last_became_peered":"2023-07-14T15:57:24.946176+0000","last_unstale":"2023-07-14T15:57:25.694205+0000","last_undegraded":"2023-07-14T15:57:25.694205+0000","last_fullsized":"2023-07-14T15:57:25.694205+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:53:48.975299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694391+0000","last_change":"2023-07-14T15:57:25.710818+0000","last_active":"2023-07-14T15:57:26.694391+0000","last_peered":"2023-07-14T15:57:26.694391+0000","last_clean":"2023-07-14T15:57:26.694391+0000","last_became_active":"2023-07-14T15:57:25.710212+0000","last_became_peered":"2023-07-14T15:57:25.710212+0000","last_unstale":"2023-07-14T15:57:26.694391+0000","last_undegraded":"2023-07-14T15:57:26.694391+0000","last_fullsized":"2023-07-14T15:57:26.694391+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:39:17.831626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694697+0000","last_change":"2023-07-14T15:57:24.949982+0000","last_active":"2023-07-14T15:57:26.694697+0000","last_peered":"2023-07-14T15:57:26.694697+0000","last_clean":"2023-07-14T15:57:26.694697+0000","last_became_active":"2023-07-14T15:57:24.949690+0000","last_became_peered":"2023-07-14T15:57:24.949690+0000","last_unstale":"2023-07-14T15:57:26.694697+0000","last_undegraded":"2023-07-14T15:57:26.694697+0000","last_fullsized":"2023-07-14T15:57:26.694697+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:06:06.625225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170316+0000","last_change":"2023-07-14T15:57:25.703650+0000","last_active":"2023-07-14T15:57:27.170316+0000","last_peered":"2023-07-14T15:57:27.170316+0000","last_clean":"2023-07-14T15:57:27.170316+0000","last_became_active":"2023-07-14T15:57:25.703366+0000","last_became_peered":"2023-07-14T15:57:25.703366+0000","last_unstale":"2023-07-14T15:57:27.170316+0000","last_undegraded":"2023-07-14T15:57:27.170316+0000","last_fullsized":"2023-07-14T15:57:27.170316+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:38:49.336628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694197+0000","last_change":"2023-07-14T15:57:24.949161+0000","last_active":"2023-07-14T15:57:26.694197+0000","last_peered":"2023-07-14T15:57:26.694197+0000","last_clean":"2023-07-14T15:57:26.694197+0000","last_became_active":"2023-07-14T15:57:24.948793+0000","last_became_peered":"2023-07-14T15:57:24.948793+0000","last_unstale":"2023-07-14T15:57:26.694197+0000","last_undegraded":"2023-07-14T15:57:26.694197+0000","last_fullsized":"2023-07-14T15:57:26.694197+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:40:33.570630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694750+0000","last_change":"2023-07-14T15:57:25.708172+0000","last_active":"2023-07-14T15:57:26.694750+0000","last_peered":"2023-07-14T15:57:26.694750+0000","last_clean":"2023-07-14T15:57:26.694750+0000","last_became_active":"2023-07-14T15:57:25.707852+0000","last_became_peered":"2023-07-14T15:57:25.707852+0000","last_unstale":"2023-07-14T15:57:26.694750+0000","last_undegraded":"2023-07-14T15:57:26.694750+0000","last_fullsized":"2023-07-14T15:57:26.694750+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:35:14.571116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"35'3","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694081+0000","last_change":"2023-07-14T15:57:24.943596+0000","last_active":"2023-07-14T15:57:26.694081+0000","last_peered":"2023-07-14T15:57:26.694081+0000","last_clean":"2023-07-14T15:57:26.694081+0000","last_became_active":"2023-07-14T15:57:24.943283+0000","last_became_peered":"2023-07-14T15:57:24.943283+0000","last_unstale":"2023-07-14T15:57:26.694081+0000","last_undegraded":"2023-07-14T15:57:26.694081+0000","last_fullsized":"2023-07-14T15:57:26.694081+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:59:41.480965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.701436+0000","last_change":"2023-07-14T15:57:25.700392+0000","last_active":"2023-07-14T15:57:25.701436+0000","last_peered":"2023-07-14T15:57:25.701436+0000","last_clean":"2023-07-14T15:57:25.701436+0000","last_became_active":"2023-07-14T15:57:25.700004+0000","last_became_peered":"2023-07-14T15:57:25.700004+0000","last_unstale":"2023-07-14T15:57:25.701436+0000","last_undegraded":"2023-07-14T15:57:25.701436+0000","last_fullsized":"2023-07-14T15:57:25.701436+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:19:12.695328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"35'6","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694419+0000","last_change":"2023-07-14T15:57:24.947031+0000","last_active":"2023-07-14T15:57:26.694419+0000","last_peered":"2023-07-14T15:57:26.694419+0000","last_clean":"2023-07-14T15:57:26.694419+0000","last_became_active":"2023-07-14T15:57:24.946757+0000","last_became_peered":"2023-07-14T15:57:24.946757+0000","last_unstale":"2023-07-14T15:57:26.694419+0000","last_undegraded":"2023-07-14T15:57:26.694419+0000","last_fullsized":"2023-07-14T15:57:26.694419+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:53:11.648125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693550+0000","last_change":"2023-07-14T15:57:25.707515+0000","last_active":"2023-07-14T15:57:26.693550+0000","last_peered":"2023-07-14T15:57:26.693550+0000","last_clean":"2023-07-14T15:57:26.693550+0000","last_became_active":"2023-07-14T15:57:25.706851+0000","last_became_peered":"2023-07-14T15:57:25.706851+0000","last_unstale":"2023-07-14T15:57:26.693550+0000","last_undegraded":"2023-07-14T15:57:26.693550+0000","last_fullsized":"2023-07-14T15:57:26.693550+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:32:43.868693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693711+0000","last_change":"2023-07-14T15:57:24.950415+0000","last_active":"2023-07-14T15:57:26.693711+0000","last_peered":"2023-07-14T15:57:26.693711+0000","last_clean":"2023-07-14T15:57:26.693711+0000","last_became_active":"2023-07-14T15:57:24.950096+0000","last_became_peered":"2023-07-14T15:57:24.950096+0000","last_unstale":"2023-07-14T15:57:26.693711+0000","last_undegraded":"2023-07-14T15:57:26.693711+0000","last_fullsized":"2023-07-14T15:57:26.693711+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:40:32.381876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.717469+0000","last_change":"2023-07-14T15:57:25.709485+0000","last_active":"2023-07-14T15:57:25.717469+0000","last_peered":"2023-07-14T15:57:25.717469+0000","last_clean":"2023-07-14T15:57:25.717469+0000","last_became_active":"2023-07-14T15:57:25.709177+0000","last_became_peered":"2023-07-14T15:57:25.709177+0000","last_unstale":"2023-07-14T15:57:25.717469+0000","last_undegraded":"2023-07-14T15:57:25.717469+0000","last_fullsized":"2023-07-14T15:57:25.717469+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:26:49.722181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.703812+0000","last_change":"2023-07-14T15:57:24.950482+0000","last_active":"2023-07-14T15:57:25.703812+0000","last_peered":"2023-07-14T15:57:25.703812+0000","last_clean":"2023-07-14T15:57:25.703812+0000","last_became_active":"2023-07-14T15:57:24.950222+0000","last_became_peered":"2023-07-14T15:57:24.950222+0000","last_unstale":"2023-07-14T15:57:25.703812+0000","last_undegraded":"2023-07-14T15:57:25.703812+0000","last_fullsized":"2023-07-14T15:57:25.703812+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:02:33.348436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:57:24.924637+0000","last_change":"2023-07-14T15:57:24.924637+0000","last_active":"2023-07-14T15:57:24.924637+0000","last_peered":"2023-07-14T15:57:24.924637+0000","last_clean":"2023-07-14T15:57:24.924637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:57:24.924637+0000","last_undegraded":"2023-07-14T15:57:24.924637+0000","last_fullsized":"2023-07-14T15:57:24.924637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694231+0000","last_change":"2023-07-14T15:57:24.948415+0000","last_active":"2023-07-14T15:57:26.694231+0000","last_peered":"2023-07-14T15:57:26.694231+0000","last_clean":"2023-07-14T15:57:26.694231+0000","last_became_active":"2023-07-14T15:57:24.947719+0000","last_became_peered":"2023-07-14T15:57:24.947719+0000","last_unstale":"2023-07-14T15:57:26.694231+0000","last_undegraded":"2023-07-14T15:57:26.694231+0000","last_fullsized":"2023-07-14T15:57:26.694231+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:08:13.930103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.076982+0000","last_change":"2023-07-14T15:57:25.710816+0000","last_active":"2023-07-14T15:57:27.076982+0000","last_peered":"2023-07-14T15:57:27.076982+0000","last_clean":"2023-07-14T15:57:27.076982+0000","last_became_active":"2023-07-14T15:57:25.710525+0000","last_became_peered":"2023-07-14T15:57:25.710525+0000","last_unstale":"2023-07-14T15:57:27.076982+0000","last_undegraded":"2023-07-14T15:57:27.076982+0000","last_fullsized":"2023-07-14T15:57:27.076982+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:54:39.767268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"35'8","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170313+0000","last_change":"2023-07-14T15:57:24.949662+0000","last_active":"2023-07-14T15:57:27.170313+0000","last_peered":"2023-07-14T15:57:27.170313+0000","last_clean":"2023-07-14T15:57:27.170313+0000","last_became_active":"2023-07-14T15:57:24.949145+0000","last_became_peered":"2023-07-14T15:57:24.949145+0000","last_unstale":"2023-07-14T15:57:27.170313+0000","last_undegraded":"2023-07-14T15:57:27.170313+0000","last_fullsized":"2023-07-14T15:57:27.170313+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:41:33.784826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.714329+0000","last_change":"2023-07-14T15:57:25.708735+0000","last_active":"2023-07-14T15:57:25.714329+0000","last_peered":"2023-07-14T15:57:25.714329+0000","last_clean":"2023-07-14T15:57:25.714329+0000","last_became_active":"2023-07-14T15:57:25.708251+0000","last_became_peered":"2023-07-14T15:57:25.708251+0000","last_unstale":"2023-07-14T15:57:25.714329+0000","last_undegraded":"2023-07-14T15:57:25.714329+0000","last_fullsized":"2023-07-14T15:57:25.714329+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:48:43.914128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"35'1","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.944067+0000","last_change":"2023-07-14T15:57:24.950806+0000","last_active":"2023-07-14T15:57:25.944067+0000","last_peered":"2023-07-14T15:57:25.944067+0000","last_clean":"2023-07-14T15:57:25.944067+0000","last_became_active":"2023-07-14T15:57:24.950499+0000","last_became_peered":"2023-07-14T15:57:24.950499+0000","last_unstale":"2023-07-14T15:57:25.944067+0000","last_undegraded":"2023-07-14T15:57:25.944067+0000","last_fullsized":"2023-07-14T15:57:25.944067+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:44:44.559996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.715713+0000","last_change":"2023-07-14T15:57:25.707810+0000","last_active":"2023-07-14T15:57:25.715713+0000","last_peered":"2023-07-14T15:57:25.715713+0000","last_clean":"2023-07-14T15:57:25.715713+0000","last_became_active":"2023-07-14T15:57:25.707540+0000","last_became_peered":"2023-07-14T15:57:25.707540+0000","last_unstale":"2023-07-14T15:57:25.715713+0000","last_undegraded":"2023-07-14T15:57:25.715713+0000","last_fullsized":"2023-07-14T15:57:25.715713+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:47:29.092265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694350+0000","last_change":"2023-07-14T15:57:24.943847+0000","last_active":"2023-07-14T15:57:26.694350+0000","last_peered":"2023-07-14T15:57:26.694350+0000","last_clean":"2023-07-14T15:57:26.694350+0000","last_became_active":"2023-07-14T15:57:24.943377+0000","last_became_peered":"2023-07-14T15:57:24.943377+0000","last_unstale":"2023-07-14T15:57:26.694350+0000","last_undegraded":"2023-07-14T15:57:26.694350+0000","last_fullsized":"2023-07-14T15:57:26.694350+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:15:32.247155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.717587+0000","last_change":"2023-07-14T15:57:25.713671+0000","last_active":"2023-07-14T15:57:25.717587+0000","last_peered":"2023-07-14T15:57:25.717587+0000","last_clean":"2023-07-14T15:57:25.717587+0000","last_became_active":"2023-07-14T15:57:25.713277+0000","last_became_peered":"2023-07-14T15:57:25.713277+0000","last_unstale":"2023-07-14T15:57:25.717587+0000","last_undegraded":"2023-07-14T15:57:25.717587+0000","last_fullsized":"2023-07-14T15:57:25.717587+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:50:51.047340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"35'1","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.077142+0000","last_change":"2023-07-14T15:57:24.947575+0000","last_active":"2023-07-14T15:57:27.077142+0000","last_peered":"2023-07-14T15:57:27.077142+0000","last_clean":"2023-07-14T15:57:27.077142+0000","last_became_active":"2023-07-14T15:57:24.947236+0000","last_became_peered":"2023-07-14T15:57:24.947236+0000","last_unstale":"2023-07-14T15:57:27.077142+0000","last_undegraded":"2023-07-14T15:57:27.077142+0000","last_fullsized":"2023-07-14T15:57:27.077142+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:37:33.879198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694961+0000","last_change":"2023-07-14T15:57:25.715669+0000","last_active":"2023-07-14T15:57:26.694961+0000","last_peered":"2023-07-14T15:57:26.694961+0000","last_clean":"2023-07-14T15:57:26.694961+0000","last_became_active":"2023-07-14T15:57:25.715414+0000","last_became_peered":"2023-07-14T15:57:25.715414+0000","last_unstale":"2023-07-14T15:57:26.694961+0000","last_undegraded":"2023-07-14T15:57:26.694961+0000","last_fullsized":"2023-07-14T15:57:26.694961+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:11:15.367018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694919+0000","last_change":"2023-07-14T15:57:24.946879+0000","last_active":"2023-07-14T15:57:26.694919+0000","last_peered":"2023-07-14T15:57:26.694919+0000","last_clean":"2023-07-14T15:57:26.694919+0000","last_became_active":"2023-07-14T15:57:24.946470+0000","last_became_peered":"2023-07-14T15:57:24.946470+0000","last_unstale":"2023-07-14T15:57:26.694919+0000","last_undegraded":"2023-07-14T15:57:26.694919+0000","last_fullsized":"2023-07-14T15:57:26.694919+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:24:27.076859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693801+0000","last_change":"2023-07-14T15:57:25.709753+0000","last_active":"2023-07-14T15:57:26.693801+0000","last_peered":"2023-07-14T15:57:26.693801+0000","last_clean":"2023-07-14T15:57:26.693801+0000","last_became_active":"2023-07-14T15:57:25.709467+0000","last_became_peered":"2023-07-14T15:57:25.709467+0000","last_unstale":"2023-07-14T15:57:26.693801+0000","last_undegraded":"2023-07-14T15:57:26.693801+0000","last_fullsized":"2023-07-14T15:57:26.693801+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:54:59.872919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694767+0000","last_change":"2023-07-14T15:57:24.942184+0000","last_active":"2023-07-14T15:57:26.694767+0000","last_peered":"2023-07-14T15:57:26.694767+0000","last_clean":"2023-07-14T15:57:26.694767+0000","last_became_active":"2023-07-14T15:57:24.941875+0000","last_became_peered":"2023-07-14T15:57:24.941875+0000","last_unstale":"2023-07-14T15:57:26.694767+0000","last_undegraded":"2023-07-14T15:57:26.694767+0000","last_fullsized":"2023-07-14T15:57:26.694767+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:52:45.470519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693423+0000","last_change":"2023-07-14T15:57:25.704418+0000","last_active":"2023-07-14T15:57:26.693423+0000","last_peered":"2023-07-14T15:57:26.693423+0000","last_clean":"2023-07-14T15:57:26.693423+0000","last_became_active":"2023-07-14T15:57:25.704119+0000","last_became_peered":"2023-07-14T15:57:25.704119+0000","last_unstale":"2023-07-14T15:57:26.693423+0000","last_undegraded":"2023-07-14T15:57:26.693423+0000","last_fullsized":"2023-07-14T15:57:26.693423+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:45:31.081120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.704009+0000","last_change":"2023-07-14T15:57:24.949131+0000","last_active":"2023-07-14T15:57:25.704009+0000","last_peered":"2023-07-14T15:57:25.704009+0000","last_clean":"2023-07-14T15:57:25.704009+0000","last_became_active":"2023-07-14T15:57:24.948700+0000","last_became_peered":"2023-07-14T15:57:24.948700+0000","last_unstale":"2023-07-14T15:57:25.704009+0000","last_undegraded":"2023-07-14T15:57:25.704009+0000","last_fullsized":"2023-07-14T15:57:25.704009+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:05:50.727388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:57:24.924637+0000","last_change":"2023-07-14T15:57:24.924637+0000","last_active":"2023-07-14T15:57:24.924637+0000","last_peered":"2023-07-14T15:57:24.924637+0000","last_clean":"2023-07-14T15:57:24.924637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:57:24.924637+0000","last_undegraded":"2023-07-14T15:57:24.924637+0000","last_fullsized":"2023-07-14T15:57:24.924637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.695691+0000","last_change":"2023-07-14T15:57:24.950805+0000","last_active":"2023-07-14T15:57:25.695691+0000","last_peered":"2023-07-14T15:57:25.695691+0000","last_clean":"2023-07-14T15:57:25.695691+0000","last_became_active":"2023-07-14T15:57:24.950510+0000","last_became_peered":"2023-07-14T15:57:24.950510+0000","last_unstale":"2023-07-14T15:57:25.695691+0000","last_undegraded":"2023-07-14T15:57:25.695691+0000","last_fullsized":"2023-07-14T15:57:25.695691+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:10:30.682698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693849+0000","last_change":"2023-07-14T15:57:25.704591+0000","last_active":"2023-07-14T15:57:26.693849+0000","last_peered":"2023-07-14T15:57:26.693849+0000","last_clean":"2023-07-14T15:57:26.693849+0000","last_became_active":"2023-07-14T15:57:25.704350+0000","last_became_peered":"2023-07-14T15:57:25.704350+0000","last_unstale":"2023-07-14T15:57:26.693849+0000","last_undegraded":"2023-07-14T15:57:26.693849+0000","last_fullsized":"2023-07-14T15:57:26.693849+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:22:31.192902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.703273+0000","last_change":"2023-07-14T15:57:24.949538+0000","last_active":"2023-07-14T15:57:25.703273+0000","last_peered":"2023-07-14T15:57:25.703273+0000","last_clean":"2023-07-14T15:57:25.703273+0000","last_became_active":"2023-07-14T15:57:24.949233+0000","last_became_peered":"2023-07-14T15:57:24.949233+0000","last_unstale":"2023-07-14T15:57:25.703273+0000","last_undegraded":"2023-07-14T15:57:25.703273+0000","last_fullsized":"2023-07-14T15:57:25.703273+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:24:23.085848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.076745+0000","last_change":"2023-07-14T15:57:25.707893+0000","last_active":"2023-07-14T15:57:27.076745+0000","last_peered":"2023-07-14T15:57:27.076745+0000","last_clean":"2023-07-14T15:57:27.076745+0000","last_became_active":"2023-07-14T15:57:25.707515+0000","last_became_peered":"2023-07-14T15:57:25.707515+0000","last_unstale":"2023-07-14T15:57:27.076745+0000","last_undegraded":"2023-07-14T15:57:27.076745+0000","last_fullsized":"2023-07-14T15:57:27.076745+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:13:20.474319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693948+0000","last_change":"2023-07-14T15:57:24.944835+0000","last_active":"2023-07-14T15:57:26.693948+0000","last_peered":"2023-07-14T15:57:26.693948+0000","last_clean":"2023-07-14T15:57:26.693948+0000","last_became_active":"2023-07-14T15:57:24.944421+0000","last_became_peered":"2023-07-14T15:57:24.944421+0000","last_unstale":"2023-07-14T15:57:26.693948+0000","last_undegraded":"2023-07-14T15:57:26.693948+0000","last_fullsized":"2023-07-14T15:57:26.693948+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:36:20.633161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694805+0000","last_change":"2023-07-14T15:56:02.621850+0000","last_active":"2023-07-14T15:57:26.694805+0000","last_peered":"2023-07-14T15:57:26.694805+0000","last_clean":"2023-07-14T15:57:26.694805+0000","last_became_active":"2023-07-14T15:56:02.621471+0000","last_became_peered":"2023-07-14T15:56:02.621471+0000","last_unstale":"2023-07-14T15:57:26.694805+0000","last_undegraded":"2023-07-14T15:57:26.694805+0000","last_fullsized":"2023-07-14T15:57:26.694805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:31:52.328091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694678+0000","last_change":"2023-07-14T15:57:25.717543+0000","last_active":"2023-07-14T15:57:26.694678+0000","last_peered":"2023-07-14T15:57:26.694678+0000","last_clean":"2023-07-14T15:57:26.694678+0000","last_became_active":"2023-07-14T15:57:25.717185+0000","last_became_peered":"2023-07-14T15:57:25.717185+0000","last_unstale":"2023-07-14T15:57:26.694678+0000","last_undegraded":"2023-07-14T15:57:26.694678+0000","last_fullsized":"2023-07-14T15:57:26.694678+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:54:28.947637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.077156+0000","last_change":"2023-07-14T15:57:24.943282+0000","last_active":"2023-07-14T15:57:27.077156+0000","last_peered":"2023-07-14T15:57:27.077156+0000","last_clean":"2023-07-14T15:57:27.077156+0000","last_became_active":"2023-07-14T15:57:24.942964+0000","last_became_peered":"2023-07-14T15:57:24.942964+0000","last_unstale":"2023-07-14T15:57:27.077156+0000","last_undegraded":"2023-07-14T15:57:27.077156+0000","last_fullsized":"2023-07-14T15:57:27.077156+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:50:50.045238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694297+0000","last_change":"2023-07-14T15:56:02.621963+0000","last_active":"2023-07-14T15:57:26.694297+0000","last_peered":"2023-07-14T15:57:26.694297+0000","last_clean":"2023-07-14T15:57:26.694297+0000","last_became_active":"2023-07-14T15:56:02.621678+0000","last_became_peered":"2023-07-14T15:56:02.621678+0000","last_unstale":"2023-07-14T15:57:26.694297+0000","last_undegraded":"2023-07-14T15:57:26.694297+0000","last_fullsized":"2023-07-14T15:57:26.694297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:13:35.392704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:57:24.924637+0000","last_change":"2023-07-14T15:57:24.924637+0000","last_active":"2023-07-14T15:57:24.924637+0000","last_peered":"2023-07-14T15:57:24.924637+0000","last_clean":"2023-07-14T15:57:24.924637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:57:24.924637+0000","last_undegraded":"2023-07-14T15:57:24.924637+0000","last_fullsized":"2023-07-14T15:57:24.924637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"36'1","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.078951+0000","last_change":"2023-07-14T15:57:24.945667+0000","last_active":"2023-07-14T15:57:27.078951+0000","last_peered":"2023-07-14T15:57:27.078951+0000","last_clean":"2023-07-14T15:57:27.078951+0000","last_became_active":"2023-07-14T15:57:24.945404+0000","last_became_peered":"2023-07-14T15:57:24.945404+0000","last_unstale":"2023-07-14T15:57:27.078951+0000","last_undegraded":"2023-07-14T15:57:27.078951+0000","last_fullsized":"2023-07-14T15:57:27.078951+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:38:23.686073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.076753+0000","last_change":"2023-07-14T15:56:01.925110+0000","last_active":"2023-07-14T15:57:27.076753+0000","last_peered":"2023-07-14T15:57:27.076753+0000","last_clean":"2023-07-14T15:57:27.076753+0000","last_became_active":"2023-07-14T15:56:01.924723+0000","last_became_peered":"2023-07-14T15:56:01.924723+0000","last_unstale":"2023-07-14T15:57:27.076753+0000","last_undegraded":"2023-07-14T15:57:27.076753+0000","last_fullsized":"2023-07-14T15:57:27.076753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:03:05.866904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694461+0000","last_change":"2023-07-14T15:57:25.711424+0000","last_active":"2023-07-14T15:57:26.694461+0000","last_peered":"2023-07-14T15:57:26.694461+0000","last_clean":"2023-07-14T15:57:26.694461+0000","last_became_active":"2023-07-14T15:57:25.710670+0000","last_became_peered":"2023-07-14T15:57:25.710670+0000","last_unstale":"2023-07-14T15:57:26.694461+0000","last_undegraded":"2023-07-14T15:57:26.694461+0000","last_fullsized":"2023-07-14T15:57:26.694461+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:25:01.452256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-14T15:57:23.931783+0000","last_change":"2023-07-14T15:57:23.931783+0000","last_active":"2023-07-14T15:57:23.922534+0000","last_peered":"2023-07-14T15:57:23.922534+0000","last_clean":"2023-07-14T15:57:23.922534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:57:23.931783+0000","last_undegraded":"2023-07-14T15:57:23.931783+0000","last_fullsized":"2023-07-14T15:57:23.931783+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693926+0000","last_change":"2023-07-14T15:56:01.923465+0000","last_active":"2023-07-14T15:57:26.693926+0000","last_peered":"2023-07-14T15:57:26.693926+0000","last_clean":"2023-07-14T15:57:26.693926+0000","last_became_active":"2023-07-14T15:56:01.923160+0000","last_became_peered":"2023-07-14T15:56:01.923160+0000","last_unstale":"2023-07-14T15:57:26.693926+0000","last_undegraded":"2023-07-14T15:57:26.693926+0000","last_fullsized":"2023-07-14T15:57:26.693926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:59:26.813576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":189,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.694308+0000","last_change":"2023-07-14T15:55:54.040065+0000","last_active":"2023-07-14T15:57:25.694308+0000","last_peered":"2023-07-14T15:57:25.694308+0000","last_clean":"2023-07-14T15:57:25.694308+0000","last_became_active":"2023-07-14T15:55:54.038885+0000","last_became_peered":"2023-07-14T15:55:54.038885+0000","last_unstale":"2023-07-14T15:57:25.694308+0000","last_undegraded":"2023-07-14T15:57:25.694308+0000","last_fullsized":"2023-07-14T15:57:25.694308+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:55:53.025696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:55:53.025696+0000","last_clean_scrub_stamp":"2023-07-14T15:55:53.025696+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:23:24.719178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.076975+0000","last_change":"2023-07-14T15:57:25.703197+0000","last_active":"2023-07-14T15:57:27.076975+0000","last_peered":"2023-07-14T15:57:27.076975+0000","last_clean":"2023-07-14T15:57:27.076975+0000","last_became_active":"2023-07-14T15:57:25.702875+0000","last_became_peered":"2023-07-14T15:57:25.702875+0000","last_unstale":"2023-07-14T15:57:27.076975+0000","last_undegraded":"2023-07-14T15:57:27.076975+0000","last_fullsized":"2023-07-14T15:57:27.076975+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:00:49.136871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694484+0000","last_change":"2023-07-14T15:57:24.945870+0000","last_active":"2023-07-14T15:57:26.694484+0000","last_peered":"2023-07-14T15:57:26.694484+0000","last_clean":"2023-07-14T15:57:26.694484+0000","last_became_active":"2023-07-14T15:57:24.945590+0000","last_became_peered":"2023-07-14T15:57:24.945590+0000","last_unstale":"2023-07-14T15:57:26.694484+0000","last_undegraded":"2023-07-14T15:57:26.694484+0000","last_fullsized":"2023-07-14T15:57:26.694484+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:26:43.460807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693733+0000","last_change":"2023-07-14T15:56:01.920714+0000","last_active":"2023-07-14T15:57:26.693733+0000","last_peered":"2023-07-14T15:57:26.693733+0000","last_clean":"2023-07-14T15:57:26.693733+0000","last_became_active":"2023-07-14T15:56:01.920325+0000","last_became_peered":"2023-07-14T15:56:01.920325+0000","last_unstale":"2023-07-14T15:57:26.693733+0000","last_undegraded":"2023-07-14T15:57:26.693733+0000","last_fullsized":"2023-07-14T15:57:26.693733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:34:47.858129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.719013+0000","last_change":"2023-07-14T15:57:25.716751+0000","last_active":"2023-07-14T15:57:25.719013+0000","last_peered":"2023-07-14T15:57:25.719013+0000","last_clean":"2023-07-14T15:57:25.719013+0000","last_became_active":"2023-07-14T15:57:25.716471+0000","last_became_peered":"2023-07-14T15:57:25.716471+0000","last_unstale":"2023-07-14T15:57:25.719013+0000","last_undegraded":"2023-07-14T15:57:25.719013+0000","last_fullsized":"2023-07-14T15:57:25.719013+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:47:07.841527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-14T15:57:23.931840+0000","last_change":"2023-07-14T15:57:23.931840+0000","last_active":"2023-07-14T15:57:23.922534+0000","last_peered":"2023-07-14T15:57:23.922534+0000","last_clean":"2023-07-14T15:57:23.922534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:57:23.931840+0000","last_undegraded":"2023-07-14T15:57:23.931840+0000","last_fullsized":"2023-07-14T15:57:23.931840+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694065+0000","last_change":"2023-07-14T15:56:01.923631+0000","last_active":"2023-07-14T15:57:26.694065+0000","last_peered":"2023-07-14T15:57:26.694065+0000","last_clean":"2023-07-14T15:57:26.694065+0000","last_became_active":"2023-07-14T15:56:01.922783+0000","last_became_peered":"2023-07-14T15:56:01.922783+0000","last_unstale":"2023-07-14T15:57:26.694065+0000","last_undegraded":"2023-07-14T15:57:26.694065+0000","last_fullsized":"2023-07-14T15:57:26.694065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:31:16.123367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694160+0000","last_change":"2023-07-14T15:57:25.715467+0000","last_active":"2023-07-14T15:57:26.694160+0000","last_peered":"2023-07-14T15:57:26.694160+0000","last_clean":"2023-07-14T15:57:26.694160+0000","last_became_active":"2023-07-14T15:57:25.715169+0000","last_became_peered":"2023-07-14T15:57:25.715169+0000","last_unstale":"2023-07-14T15:57:26.694160+0000","last_undegraded":"2023-07-14T15:57:26.694160+0000","last_fullsized":"2023-07-14T15:57:26.694160+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:18:30.445378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694374+0000","last_change":"2023-07-14T15:57:24.948604+0000","last_active":"2023-07-14T15:57:26.694374+0000","last_peered":"2023-07-14T15:57:26.694374+0000","last_clean":"2023-07-14T15:57:26.694374+0000","last_became_active":"2023-07-14T15:57:24.948128+0000","last_became_peered":"2023-07-14T15:57:24.948128+0000","last_unstale":"2023-07-14T15:57:26.694374+0000","last_undegraded":"2023-07-14T15:57:26.694374+0000","last_fullsized":"2023-07-14T15:57:26.694374+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:56:33.930892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694844+0000","last_change":"2023-07-14T15:56:01.965649+0000","last_active":"2023-07-14T15:57:26.694844+0000","last_peered":"2023-07-14T15:57:26.694844+0000","last_clean":"2023-07-14T15:57:26.694844+0000","last_became_active":"2023-07-14T15:56:01.965344+0000","last_became_peered":"2023-07-14T15:56:01.965344+0000","last_unstale":"2023-07-14T15:57:26.694844+0000","last_undegraded":"2023-07-14T15:57:26.694844+0000","last_fullsized":"2023-07-14T15:57:26.694844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:30:36.061855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T15:57:24.924637+0000","last_change":"2023-07-14T15:57:24.924637+0000","last_active":"2023-07-14T15:57:24.924637+0000","last_peered":"2023-07-14T15:57:24.924637+0000","last_clean":"2023-07-14T15:57:24.924637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:57:24.924637+0000","last_undegraded":"2023-07-14T15:57:24.924637+0000","last_fullsized":"2023-07-14T15:57:24.924637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693419+0000","last_change":"2023-07-14T15:57:24.948449+0000","last_active":"2023-07-14T15:57:26.693419+0000","last_peered":"2023-07-14T15:57:26.693419+0000","last_clean":"2023-07-14T15:57:26.693419+0000","last_became_active":"2023-07-14T15:57:24.948145+0000","last_became_peered":"2023-07-14T15:57:24.948145+0000","last_unstale":"2023-07-14T15:57:26.693419+0000","last_undegraded":"2023-07-14T15:57:26.693419+0000","last_fullsized":"2023-07-14T15:57:26.693419+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:43:28.358856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694508+0000","last_change":"2023-07-14T15:56:01.966578+0000","last_active":"2023-07-14T15:57:26.694508+0000","last_peered":"2023-07-14T15:57:26.694508+0000","last_clean":"2023-07-14T15:57:26.694508+0000","last_became_active":"2023-07-14T15:56:01.966216+0000","last_became_peered":"2023-07-14T15:56:01.966216+0000","last_unstale":"2023-07-14T15:57:26.694508+0000","last_undegraded":"2023-07-14T15:57:26.694508+0000","last_fullsized":"2023-07-14T15:57:26.694508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:34:54.823729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":108,"acting":108,"num_store_stats":7},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476759,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":401408,"data_stored":162350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.35699999999999998}]},{"osd":1,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.48399999999999999}]},{"osd":2,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.57199999999999995}]},{"osd":4,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.59199999999999997}]},{"osd":5,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.73999999999999999}]},{"osd":6,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.61099999999999999}]},{"osd":7,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.629}]}]},{"osd":0,"up_from":16,"seq":68719476759,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":348160,"data_stored":135681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.33100000000000002}]},{"osd":2,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.44}]},{"osd":3,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.48799999999999999}]},{"osd":4,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.69899999999999995}]},{"osd":5,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.81699999999999995}]},{"osd":6,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.746},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.871}]},{"osd":7,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.72599999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542166,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":389120,"data_stored":155641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.65200000000000002}]},{"osd":1,"last update":"Fri Jul 14 15:56:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.76600000000000001}]},{"osd":2,"last update":"Fri Jul 14 15:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.87}]},{"osd":3,"last update":"Fri Jul 14 15:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":3.141,"5min":3.141,"15min":3.141},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.88800000000000001}]},{"osd":4,"last update":"Fri Jul 14 15:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.72399999999999998}]},{"osd":5,"last update":"Fri Jul 14 15:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.94499999999999995}]},{"osd":7,"last update":"Fri Jul 14 15:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.90800000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542165,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32008,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339832,"statfs":{"total":96636764160,"available":96603987968,"internally_reserved":0,"allocated":983040,"data_stored":745997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":4.5519999999999996,"5min":4.5519999999999996,"15min":4.5519999999999996},"last":0.39400000000000002},{"interface":"front","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":15.911,"5min":15.911,"15min":15.911},"last":0.46800000000000003}]},{"osd":2,"last update":"Fri Jul 14 15:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":4.5140000000000002,"5min":4.5140000000000002,"15min":4.5140000000000002},"last":0.44800000000000001}]},{"osd":3,"last update":"Fri Jul 14 15:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":4.452,"5min":4.452,"15min":4.452},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":4.2279999999999998,"5min":4.2279999999999998,"15min":4.2279999999999998},"last":0.42599999999999999}]},{"osd":4,"last update":"Fri Jul 14 15:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":4.6200000000000001,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":4.9109999999999996,"5min":4.9109999999999996,"15min":4.9109999999999996},"last":0.69399999999999995}]},{"osd":5,"last update":"Fri Jul 14 15:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":4.1269999999999998,"5min":4.1269999999999998,"15min":4.1269999999999998},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":4.585,"5min":4.585,"15min":4.585},"last":0.64000000000000001}]},{"osd":6,"last update":"Fri Jul 14 15:56:51 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":4.9880000000000004,"5min":4.9880000000000004,"15min":4.9880000000000004},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":4.1660000000000004,"5min":4.1660000000000004,"15min":4.1660000000000004},"last":0.68100000000000005}]},{"osd":7,"last update":"Fri Jul 14 15:56:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":4.9530000000000003,"5min":4.9530000000000003,"15min":4.9530000000000003},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":4.1959999999999997,"5min":4.1959999999999997,"15min":4.1959999999999997},"last":0.61799999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509463,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":413696,"data_stored":164406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:56:53 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.437}]},{"osd":1,"last update":"Fri Jul 14 15:56:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.315},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.46899999999999997}]},{"osd":3,"last update":"Fri Jul 14 15:56:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.498}]},{"osd":4,"last update":"Fri Jul 14 15:56:53 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.72699999999999998}]},{"osd":5,"last update":"Fri Jul 14 15:56:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.60999999999999999}]},{"osd":6,"last update":"Fri Jul 14 15:56:53 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.64600000000000002}]},{"osd":7,"last update":"Fri Jul 14 15:56:53 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.71099999999999997}]}]},{"osd":4,"up_from":15,"seq":64424509462,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":408,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":417792,"data_stored":163948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.88300000000000001}]},{"osd":1,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.748},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.82899999999999996}]},{"osd":2,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.80200000000000005}]},{"osd":3,"last update":"Fri Jul 14 15:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.94299999999999995}]},{"osd":5,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.84299999999999997}]},{"osd":6,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.63700000000000001}]},{"osd":7,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.61499999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509464,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27924,"kb_used_data":972,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343916,"statfs":{"total":96636764160,"available":96608169984,"internally_reserved":0,"allocated":995328,"data_stored":753210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":8.1500000000000004,"5min":8.1500000000000004,"15min":8.1500000000000004},"last":0.67500000000000004}]},{"osd":1,"last update":"Fri Jul 14 15:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.76800000000000002}]},{"osd":2,"last update":"Fri Jul 14 15:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.83899999999999997}]},{"osd":3,"last update":"Fri Jul 14 15:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.90600000000000003}]},{"osd":4,"last update":"Fri Jul 14 15:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.64400000000000002}]},{"osd":6,"last update":"Fri Jul 14 15:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.754},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.93799999999999994}]},{"osd":7,"last update":"Fri Jul 14 15:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.875},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.92300000000000004}]}]},{"osd":7,"up_from":15,"seq":64424509463,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":401408,"data_stored":162330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":4.5919999999999996,"5min":4.5919999999999996,"15min":4.5919999999999996},"last":0.624}]},{"osd":1,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1,"5min":1,"15min":1},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":4.665,"5min":4.665,"15min":4.665},"last":0.749}]},{"osd":2,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":5.4089999999999998,"5min":5.4089999999999998,"15min":5.4089999999999998},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":0.80400000000000005}]},{"osd":3,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":2.3380000000000001,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":2.3530000000000002,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":0.84199999999999997}]},{"osd":4,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.68899999999999995}]},{"osd":5,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.70399999999999996}]},{"osd":6,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.72599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T15:57:30.859 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T15:57:31.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.110+0000 7f0e249ff700 1 Processor -- start 2023-07-14T15:57:31.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.110+0000 7f0e249ff700 1 -- start start 2023-07-14T15:57:31.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.111+0000 7f0e249ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0e200cffc0 0x7f0e200b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:31.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.111+0000 7f0e249ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f0e20160c50 0x7f0e200cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:31.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.111+0000 7f0e249ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e200cf6f0 con 0x7f0e200b8b80 2023-07-14T15:57:31.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.111+0000 7f0e249ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e200d0de0 con 0x7f0e200cffc0 2023-07-14T15:57:31.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.111+0000 7f0e249ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e201610f0 con 0x7f0e20160c50 2023-07-14T15:57:31.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.111+0000 7f0e17fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0e200cffc0 0x7f0e200b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:31.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.111+0000 7f0e17fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0e200cffc0 0x7f0e200b5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38556/0 (socket says 172.21.15.37:38556) 2023-07-14T15:57:31.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.111+0000 7f0e17fff700 1 -- 172.21.15.37:0/977278031 learned_addr learned my addr 172.21.15.37:0/977278031 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:31.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.112+0000 7f0e1ed9d700 1 --2- 172.21.15.37:0/977278031 >> v2:172.21.15.98:3300/0 conn(0x7f0e20160c50 0x7f0e200cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:31.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.112+0000 7f0e17fff700 1 -- 172.21.15.37:0/977278031 >> v2:172.21.15.98:3300/0 conn(0x7f0e20160c50 msgr2=0x7f0e200cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:31.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.112+0000 7f0e17fff700 1 --2- 172.21.15.37:0/977278031 >> v2:172.21.15.98:3300/0 conn(0x7f0e20160c50 0x7f0e200cf1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:31.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.112+0000 7f0e17fff700 1 -- 172.21.15.37:0/977278031 >> v1:172.21.15.98:6789/0 conn(0x7f0e200b8b80 legacy=0x7f0e200cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:31.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.112+0000 7f0e17fff700 1 -- 172.21.15.37:0/977278031 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e200cd590 con 0x7f0e200cffc0 2023-07-14T15:57:31.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.112+0000 7f0e1ed9d700 1 --2- 172.21.15.37:0/977278031 >> v2:172.21.15.98:3300/0 conn(0x7f0e20160c50 0x7f0e200cf1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:57:31.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.112+0000 7f0e17fff700 1 --2- 172.21.15.37:0/977278031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e200cffc0 0x7f0e200b5cf0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f0e200ceeb0 tx=0x7f0e08009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4ec70cd4a148aad server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:31.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.112+0000 7f0e1dd9b700 1 -- 172.21.15.37:0/977278031 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e08004230 con 0x7f0e200cffc0 2023-07-14T15:57:31.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.112+0000 7f0e1dd9b700 1 -- 172.21.15.37:0/977278031 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e08004390 con 0x7f0e200cffc0 2023-07-14T15:57:31.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.112+0000 7f0e1dd9b700 1 -- 172.21.15.37:0/977278031 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e080036a0 con 0x7f0e200cffc0 2023-07-14T15:57:31.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.113+0000 7f0e249ff700 1 -- 172.21.15.37:0/977278031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e200cffc0 msgr2=0x7f0e200b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:31.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.113+0000 7f0e249ff700 1 --2- 172.21.15.37:0/977278031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e200cffc0 0x7f0e200b5cf0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f0e200ceeb0 tx=0x7f0e08009bd0 comp rx=0 tx=0).stop 2023-07-14T15:57:31.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.113+0000 7f0e249ff700 1 -- 172.21.15.37:0/977278031 shutdown_connections 2023-07-14T15:57:31.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.113+0000 7f0e249ff700 1 --2- 172.21.15.37:0/977278031 >> v2:172.21.15.98:3300/0 conn(0x7f0e20160c50 0x7f0e200cf1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:31.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.113+0000 7f0e249ff700 1 --2- 172.21.15.37:0/977278031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e200cffc0 0x7f0e200b5cf0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:31.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.113+0000 7f0e249ff700 1 -- 172.21.15.37:0/977278031 >> 172.21.15.37:0/977278031 conn(0x7f0e2006b150 msgr2=0x7f0e2006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:31.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.113+0000 7f0e249ff700 1 -- 172.21.15.37:0/977278031 shutdown_connections 2023-07-14T15:57:31.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.113+0000 7f0e249ff700 1 -- 172.21.15.37:0/977278031 wait complete. 2023-07-14T15:57:31.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.115+0000 7f0e249ff700 1 Processor -- start 2023-07-14T15:57:31.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.115+0000 7f0e249ff700 1 -- start start 2023-07-14T15:57:31.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.116+0000 7f0e249ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e200b8b80 0x7f0e200b3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:31.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.116+0000 7f0e249ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0e200cffc0 0x7f0e201f1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:31.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.116+0000 7f0e249ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e20160c50 0x7f0e20159040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:31.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.116+0000 7f0e249ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e200b4030 con 0x7f0e20160c50 2023-07-14T15:57:31.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.116+0000 7f0e249ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e200b4310 con 0x7f0e200b8b80 2023-07-14T15:57:31.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.116+0000 7f0e249ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e200b45f0 con 0x7f0e200cffc0 2023-07-14T15:57:31.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.116+0000 7f0e1ed9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e20160c50 0x7f0e20159040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:31.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.116+0000 7f0e1ed9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e20160c50 0x7f0e20159040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38570/0 (socket says 172.21.15.37:38570) 2023-07-14T15:57:31.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.116+0000 7f0e1ed9d700 1 -- 172.21.15.37:0/3074771163 learned_addr learned my addr 172.21.15.37:0/3074771163 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:31.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.116+0000 7f0e1e59c700 1 --2- 172.21.15.37:0/3074771163 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e200b8b80 0x7f0e200b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:31.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.116+0000 7f0e17fff700 1 --2- 172.21.15.37:0/3074771163 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0e200cffc0 0x7f0e201f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:31.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.117+0000 7f0e1ed9d700 1 -- 172.21.15.37:0/3074771163 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0e200cffc0 msgr2=0x7f0e201f1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:31.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.117+0000 7f0e1ed9d700 1 --2- 172.21.15.37:0/3074771163 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0e200cffc0 0x7f0e201f1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:31.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.117+0000 7f0e1ed9d700 1 -- 172.21.15.37:0/3074771163 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e200b8b80 msgr2=0x7f0e200b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:31.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.117+0000 7f0e1ed9d700 1 --2- 172.21.15.37:0/3074771163 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e200b8b80 0x7f0e200b3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:31.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.117+0000 7f0e1ed9d700 1 -- 172.21.15.37:0/3074771163 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e08009550 con 0x7f0e20160c50 2023-07-14T15:57:31.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.117+0000 7f0e1e59c700 1 --2- 172.21.15.37:0/3074771163 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e200b8b80 0x7f0e200b3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:57:31.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.117+0000 7f0e1ed9d700 1 --2- 172.21.15.37:0/3074771163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e20160c50 0x7f0e20159040 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0e1800cef0 tx=0x7f0e1800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:31.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.117+0000 7f0e16ffd700 1 -- 172.21.15.37:0/3074771163 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1800ae50 con 0x7f0e20160c50 2023-07-14T15:57:31.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.117+0000 7f0e16ffd700 1 -- 172.21.15.37:0/3074771163 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e18015440 con 0x7f0e20160c50 2023-07-14T15:57:31.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.117+0000 7f0e249ff700 1 -- 172.21.15.37:0/3074771163 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e200b48d0 con 0x7f0e20160c50 2023-07-14T15:57:31.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.117+0000 7f0e16ffd700 1 -- 172.21.15.37:0/3074771163 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e180157f0 con 0x7f0e20160c50 2023-07-14T15:57:31.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.117+0000 7f0e249ff700 1 -- 172.21.15.37:0/3074771163 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e200b3cd0 con 0x7f0e20160c50 2023-07-14T15:57:31.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.118+0000 7f0e249ff700 1 -- 172.21.15.37:0/3074771163 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e20067840 con 0x7f0e20160c50 2023-07-14T15:57:31.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.119+0000 7f0e16ffd700 1 -- 172.21.15.37:0/3074771163 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0e1800d430 con 0x7f0e20160c50 2023-07-14T15:57:31.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.120+0000 7f0e16ffd700 1 --2- 172.21.15.37:0/3074771163 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0e0006ace0 0x7f0e0006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:31.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.120+0000 7f0e16ffd700 1 -- 172.21.15.37:0/3074771163 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0e18089b80 con 0x7f0e20160c50 2023-07-14T15:57:31.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.121+0000 7f0e1e59c700 1 --2- 172.21.15.37:0/3074771163 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0e0006ace0 0x7f0e0006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:31.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.121+0000 7f0e1e59c700 1 --2- 172.21.15.37:0/3074771163 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0e0006ace0 0x7f0e0006d190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0e10009930 tx=0x7f0e10008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:31.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.124+0000 7f0e16ffd700 1 -- 172.21.15.37:0/3074771163 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0e18054b90 con 0x7f0e20160c50 2023-07-14T15:57:31.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.325+0000 7f0e249ff700 1 -- 172.21.15.37:0/3074771163 --> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0e200cdb50 con 0x7f0e0006ace0 2023-07-14T15:57:31.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.335+0000 7f0e16ffd700 1 -- 172.21.15.37:0/3074771163 <== mgr.4100 v2:172.21.15.98:6832/3163748069 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310879 (secure 0 0 0) 0x7f0e10009e00 con 0x7f0e0006ace0 2023-07-14T15:57:31.323 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:57:31.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.339+0000 7f0e249ff700 1 -- 172.21.15.37:0/3074771163 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0e0006ace0 msgr2=0x7f0e0006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:31.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.339+0000 7f0e249ff700 1 --2- 172.21.15.37:0/3074771163 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0e0006ace0 0x7f0e0006d190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0e10009930 tx=0x7f0e10008040 comp rx=0 tx=0).stop 2023-07-14T15:57:31.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.339+0000 7f0e249ff700 1 -- 172.21.15.37:0/3074771163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e20160c50 msgr2=0x7f0e20159040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:31.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.339+0000 7f0e249ff700 1 --2- 172.21.15.37:0/3074771163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e20160c50 0x7f0e20159040 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0e1800cef0 tx=0x7f0e1800a340 comp rx=0 tx=0).stop 2023-07-14T15:57:31.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.339+0000 7f0e249ff700 1 -- 172.21.15.37:0/3074771163 shutdown_connections 2023-07-14T15:57:31.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.339+0000 7f0e249ff700 1 --2- 172.21.15.37:0/3074771163 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e200b8b80 0x7f0e200b3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:31.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.339+0000 7f0e249ff700 1 --2- 172.21.15.37:0/3074771163 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0e0006ace0 0x7f0e0006d190 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:31.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.339+0000 7f0e249ff700 1 --2- 172.21.15.37:0/3074771163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e20160c50 0x7f0e20159040 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:31.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.339+0000 7f0e249ff700 1 --2- 172.21.15.37:0/3074771163 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0e200cffc0 0x7f0e201f1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:31.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.339+0000 7f0e249ff700 1 -- 172.21.15.37:0/3074771163 >> 172.21.15.37:0/3074771163 conn(0x7f0e2006b150 msgr2=0x7f0e2015ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:31.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.339+0000 7f0e249ff700 1 -- 172.21.15.37:0/3074771163 shutdown_connections 2023-07-14T15:57:31.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.339+0000 7f0e249ff700 1 -- 172.21.15.37:0/3074771163 wait complete. 2023-07-14T15:57:31.327 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-14T15:57:31.343 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2023-07-14T15:57:30.873431+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":132,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224016,"kb_used_data":4304,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754750704,"statfs":{"total":773094113280,"available":772864720896,"internally_reserved":0,"allocated":4407296,"data_stored":2470234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001243"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694788+0000","last_change":"2023-07-14T15:57:25.708719+0000","last_active":"2023-07-14T15:57:26.694788+0000","last_peered":"2023-07-14T15:57:26.694788+0000","last_clean":"2023-07-14T15:57:26.694788+0000","last_became_active":"2023-07-14T15:57:25.708107+0000","last_became_peered":"2023-07-14T15:57:25.708107+0000","last_unstale":"2023-07-14T15:57:26.694788+0000","last_undegraded":"2023-07-14T15:57:26.694788+0000","last_fullsized":"2023-07-14T15:57:26.694788+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:52:37.992568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.717421+0000","last_change":"2023-07-14T15:57:25.710340+0000","last_active":"2023-07-14T15:57:25.717421+0000","last_peered":"2023-07-14T15:57:25.717421+0000","last_clean":"2023-07-14T15:57:25.717421+0000","last_became_active":"2023-07-14T15:57:25.710113+0000","last_became_peered":"2023-07-14T15:57:25.710113+0000","last_unstale":"2023-07-14T15:57:25.717421+0000","last_undegraded":"2023-07-14T15:57:25.717421+0000","last_fullsized":"2023-07-14T15:57:25.717421+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:53:01.027835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694176+0000","last_change":"2023-07-14T15:57:25.707011+0000","last_active":"2023-07-14T15:57:26.694176+0000","last_peered":"2023-07-14T15:57:26.694176+0000","last_clean":"2023-07-14T15:57:26.694176+0000","last_became_active":"2023-07-14T15:57:25.706720+0000","last_became_peered":"2023-07-14T15:57:25.706720+0000","last_unstale":"2023-07-14T15:57:26.694176+0000","last_undegraded":"2023-07-14T15:57:26.694176+0000","last_fullsized":"2023-07-14T15:57:26.694176+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:11:43.491601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694227+0000","last_change":"2023-07-14T15:57:25.710983+0000","last_active":"2023-07-14T15:57:26.694227+0000","last_peered":"2023-07-14T15:57:26.694227+0000","last_clean":"2023-07-14T15:57:26.694227+0000","last_became_active":"2023-07-14T15:57:25.710549+0000","last_became_peered":"2023-07-14T15:57:25.710549+0000","last_unstale":"2023-07-14T15:57:26.694227+0000","last_undegraded":"2023-07-14T15:57:26.694227+0000","last_fullsized":"2023-07-14T15:57:26.694227+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:40:25.153466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.076832+0000","last_change":"2023-07-14T15:57:25.703749+0000","last_active":"2023-07-14T15:57:27.076832+0000","last_peered":"2023-07-14T15:57:27.076832+0000","last_clean":"2023-07-14T15:57:27.076832+0000","last_became_active":"2023-07-14T15:57:25.703455+0000","last_became_peered":"2023-07-14T15:57:25.703455+0000","last_unstale":"2023-07-14T15:57:27.076832+0000","last_undegraded":"2023-07-14T15:57:27.076832+0000","last_fullsized":"2023-07-14T15:57:27.076832+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:08:58.707250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.717512+0000","last_change":"2023-07-14T15:57:25.712112+0000","last_active":"2023-07-14T15:57:25.717512+0000","last_peered":"2023-07-14T15:57:25.717512+0000","last_clean":"2023-07-14T15:57:25.717512+0000","last_became_active":"2023-07-14T15:57:25.711731+0000","last_became_peered":"2023-07-14T15:57:25.711731+0000","last_unstale":"2023-07-14T15:57:25.717512+0000","last_undegraded":"2023-07-14T15:57:25.717512+0000","last_fullsized":"2023-07-14T15:57:25.717512+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:00:40.319113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.715576+0000","last_change":"2023-07-14T15:57:25.708346+0000","last_active":"2023-07-14T15:57:25.715576+0000","last_peered":"2023-07-14T15:57:25.715576+0000","last_clean":"2023-07-14T15:57:25.715576+0000","last_became_active":"2023-07-14T15:57:25.708048+0000","last_became_peered":"2023-07-14T15:57:25.708048+0000","last_unstale":"2023-07-14T15:57:25.715576+0000","last_undegraded":"2023-07-14T15:57:25.715576+0000","last_fullsized":"2023-07-14T15:57:25.715576+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:05:25.335710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694045+0000","last_change":"2023-07-14T15:57:25.706331+0000","last_active":"2023-07-14T15:57:26.694045+0000","last_peered":"2023-07-14T15:57:26.694045+0000","last_clean":"2023-07-14T15:57:26.694045+0000","last_became_active":"2023-07-14T15:57:25.705691+0000","last_became_peered":"2023-07-14T15:57:25.705691+0000","last_unstale":"2023-07-14T15:57:26.694045+0000","last_undegraded":"2023-07-14T15:57:26.694045+0000","last_fullsized":"2023-07-14T15:57:26.694045+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:24:52.499316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.077364+0000","last_change":"2023-07-14T15:57:25.713167+0000","last_active":"2023-07-14T15:57:27.077364+0000","last_peered":"2023-07-14T15:57:27.077364+0000","last_clean":"2023-07-14T15:57:27.077364+0000","last_became_active":"2023-07-14T15:57:25.712829+0000","last_became_peered":"2023-07-14T15:57:25.712829+0000","last_unstale":"2023-07-14T15:57:27.077364+0000","last_undegraded":"2023-07-14T15:57:27.077364+0000","last_fullsized":"2023-07-14T15:57:27.077364+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:53:49.977402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.714964+0000","last_change":"2023-07-14T15:57:25.707232+0000","last_active":"2023-07-14T15:57:25.714964+0000","last_peered":"2023-07-14T15:57:25.714964+0000","last_clean":"2023-07-14T15:57:25.714964+0000","last_became_active":"2023-07-14T15:57:25.706976+0000","last_became_peered":"2023-07-14T15:57:25.706976+0000","last_unstale":"2023-07-14T15:57:25.714964+0000","last_undegraded":"2023-07-14T15:57:25.714964+0000","last_fullsized":"2023-07-14T15:57:25.714964+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:48:00.956575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.080162+0000","last_change":"2023-07-14T15:57:25.704130+0000","last_active":"2023-07-14T15:57:27.080162+0000","last_peered":"2023-07-14T15:57:27.080162+0000","last_clean":"2023-07-14T15:57:27.080162+0000","last_became_active":"2023-07-14T15:57:25.703350+0000","last_became_peered":"2023-07-14T15:57:25.703350+0000","last_unstale":"2023-07-14T15:57:27.080162+0000","last_undegraded":"2023-07-14T15:57:27.080162+0000","last_fullsized":"2023-07-14T15:57:27.080162+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:51:25.799916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.077125+0000","last_change":"2023-07-14T15:57:25.709331+0000","last_active":"2023-07-14T15:57:27.077125+0000","last_peered":"2023-07-14T15:57:27.077125+0000","last_clean":"2023-07-14T15:57:27.077125+0000","last_became_active":"2023-07-14T15:57:25.709039+0000","last_became_peered":"2023-07-14T15:57:25.709039+0000","last_unstale":"2023-07-14T15:57:27.077125+0000","last_undegraded":"2023-07-14T15:57:27.077125+0000","last_fullsized":"2023-07-14T15:57:27.077125+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:05:25.335710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.717498+0000","last_change":"2023-07-14T15:57:25.715095+0000","last_active":"2023-07-14T15:57:25.717498+0000","last_peered":"2023-07-14T15:57:25.717498+0000","last_clean":"2023-07-14T15:57:25.717498+0000","last_became_active":"2023-07-14T15:57:25.714840+0000","last_became_peered":"2023-07-14T15:57:25.714840+0000","last_unstale":"2023-07-14T15:57:25.717498+0000","last_undegraded":"2023-07-14T15:57:25.717498+0000","last_fullsized":"2023-07-14T15:57:25.717498+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:38:24.688175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170148+0000","last_change":"2023-07-14T15:57:25.710052+0000","last_active":"2023-07-14T15:57:27.170148+0000","last_peered":"2023-07-14T15:57:27.170148+0000","last_clean":"2023-07-14T15:57:27.170148+0000","last_became_active":"2023-07-14T15:57:25.709808+0000","last_became_peered":"2023-07-14T15:57:25.709808+0000","last_unstale":"2023-07-14T15:57:27.170148+0000","last_undegraded":"2023-07-14T15:57:27.170148+0000","last_fullsized":"2023-07-14T15:57:27.170148+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:19:01.933649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693904+0000","last_change":"2023-07-14T15:57:25.709747+0000","last_active":"2023-07-14T15:57:26.693904+0000","last_peered":"2023-07-14T15:57:26.693904+0000","last_clean":"2023-07-14T15:57:26.693904+0000","last_became_active":"2023-07-14T15:57:25.709442+0000","last_became_peered":"2023-07-14T15:57:25.709442+0000","last_unstale":"2023-07-14T15:57:26.693904+0000","last_undegraded":"2023-07-14T15:57:26.693904+0000","last_fullsized":"2023-07-14T15:57:26.693904+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:30:18.330946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.715604+0000","last_change":"2023-07-14T15:57:25.712207+0000","last_active":"2023-07-14T15:57:25.715604+0000","last_peered":"2023-07-14T15:57:25.715604+0000","last_clean":"2023-07-14T15:57:25.715604+0000","last_became_active":"2023-07-14T15:57:25.711936+0000","last_became_peered":"2023-07-14T15:57:25.711936+0000","last_unstale":"2023-07-14T15:57:25.715604+0000","last_undegraded":"2023-07-14T15:57:25.715604+0000","last_fullsized":"2023-07-14T15:57:25.715604+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:08:58.707250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694397+0000","last_change":"2023-07-14T15:57:25.711637+0000","last_active":"2023-07-14T15:57:26.694397+0000","last_peered":"2023-07-14T15:57:26.694397+0000","last_clean":"2023-07-14T15:57:26.694397+0000","last_became_active":"2023-07-14T15:57:25.710975+0000","last_became_peered":"2023-07-14T15:57:25.710975+0000","last_unstale":"2023-07-14T15:57:26.694397+0000","last_undegraded":"2023-07-14T15:57:26.694397+0000","last_fullsized":"2023-07-14T15:57:26.694397+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:24:11.251154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694300+0000","last_change":"2023-07-14T15:57:25.711476+0000","last_active":"2023-07-14T15:57:26.694300+0000","last_peered":"2023-07-14T15:57:26.694300+0000","last_clean":"2023-07-14T15:57:26.694300+0000","last_became_active":"2023-07-14T15:57:25.711204+0000","last_became_peered":"2023-07-14T15:57:25.711204+0000","last_unstale":"2023-07-14T15:57:26.694300+0000","last_undegraded":"2023-07-14T15:57:26.694300+0000","last_fullsized":"2023-07-14T15:57:26.694300+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:27:16.753361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694835+0000","last_change":"2023-07-14T15:57:25.715333+0000","last_active":"2023-07-14T15:57:26.694835+0000","last_peered":"2023-07-14T15:57:26.694835+0000","last_clean":"2023-07-14T15:57:26.694835+0000","last_became_active":"2023-07-14T15:57:25.715044+0000","last_became_peered":"2023-07-14T15:57:25.715044+0000","last_unstale":"2023-07-14T15:57:26.694835+0000","last_undegraded":"2023-07-14T15:57:26.694835+0000","last_fullsized":"2023-07-14T15:57:26.694835+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:13:09.841632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.079778+0000","last_change":"2023-07-14T15:57:25.710745+0000","last_active":"2023-07-14T15:57:27.079778+0000","last_peered":"2023-07-14T15:57:27.079778+0000","last_clean":"2023-07-14T15:57:27.079778+0000","last_became_active":"2023-07-14T15:57:25.710470+0000","last_became_peered":"2023-07-14T15:57:25.710470+0000","last_unstale":"2023-07-14T15:57:27.079778+0000","last_undegraded":"2023-07-14T15:57:27.079778+0000","last_fullsized":"2023-07-14T15:57:27.079778+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:50:07.191662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.079795+0000","last_change":"2023-07-14T15:57:25.707437+0000","last_active":"2023-07-14T15:57:27.079795+0000","last_peered":"2023-07-14T15:57:27.079795+0000","last_clean":"2023-07-14T15:57:27.079795+0000","last_became_active":"2023-07-14T15:57:25.707120+0000","last_became_peered":"2023-07-14T15:57:25.707120+0000","last_unstale":"2023-07-14T15:57:27.079795+0000","last_undegraded":"2023-07-14T15:57:27.079795+0000","last_fullsized":"2023-07-14T15:57:27.079795+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:43:47.530104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.079781+0000","last_change":"2023-07-14T15:57:25.711301+0000","last_active":"2023-07-14T15:57:27.079781+0000","last_peered":"2023-07-14T15:57:27.079781+0000","last_clean":"2023-07-14T15:57:27.079781+0000","last_became_active":"2023-07-14T15:57:25.710426+0000","last_became_peered":"2023-07-14T15:57:25.710426+0000","last_unstale":"2023-07-14T15:57:27.079781+0000","last_undegraded":"2023-07-14T15:57:27.079781+0000","last_fullsized":"2023-07-14T15:57:27.079781+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:25:29.672522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693910+0000","last_change":"2023-07-14T15:57:25.716297+0000","last_active":"2023-07-14T15:57:26.693910+0000","last_peered":"2023-07-14T15:57:26.693910+0000","last_clean":"2023-07-14T15:57:26.693910+0000","last_became_active":"2023-07-14T15:57:25.716028+0000","last_became_peered":"2023-07-14T15:57:25.716028+0000","last_unstale":"2023-07-14T15:57:26.693910+0000","last_undegraded":"2023-07-14T15:57:26.693910+0000","last_fullsized":"2023-07-14T15:57:26.693910+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:50:57.963143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693902+0000","last_change":"2023-07-14T15:57:25.707324+0000","last_active":"2023-07-14T15:57:26.693902+0000","last_peered":"2023-07-14T15:57:26.693902+0000","last_clean":"2023-07-14T15:57:26.693902+0000","last_became_active":"2023-07-14T15:57:25.706434+0000","last_became_peered":"2023-07-14T15:57:25.706434+0000","last_unstale":"2023-07-14T15:57:26.693902+0000","last_undegraded":"2023-07-14T15:57:26.693902+0000","last_fullsized":"2023-07-14T15:57:26.693902+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:15:31.939973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170401+0000","last_change":"2023-07-14T15:57:25.711970+0000","last_active":"2023-07-14T15:57:27.170401+0000","last_peered":"2023-07-14T15:57:27.170401+0000","last_clean":"2023-07-14T15:57:27.170401+0000","last_became_active":"2023-07-14T15:57:25.711620+0000","last_became_peered":"2023-07-14T15:57:25.711620+0000","last_unstale":"2023-07-14T15:57:27.170401+0000","last_undegraded":"2023-07-14T15:57:27.170401+0000","last_fullsized":"2023-07-14T15:57:27.170401+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:25:29.672522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694804+0000","last_change":"2023-07-14T15:57:25.704116+0000","last_active":"2023-07-14T15:57:26.694804+0000","last_peered":"2023-07-14T15:57:26.694804+0000","last_clean":"2023-07-14T15:57:26.694804+0000","last_became_active":"2023-07-14T15:57:25.703738+0000","last_became_peered":"2023-07-14T15:57:25.703738+0000","last_unstale":"2023-07-14T15:57:26.694804+0000","last_undegraded":"2023-07-14T15:57:26.694804+0000","last_fullsized":"2023-07-14T15:57:26.694804+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:59:26.269692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.080025+0000","last_change":"2023-07-14T15:57:25.716868+0000","last_active":"2023-07-14T15:57:27.080025+0000","last_peered":"2023-07-14T15:57:27.080025+0000","last_clean":"2023-07-14T15:57:27.080025+0000","last_became_active":"2023-07-14T15:57:25.714448+0000","last_became_peered":"2023-07-14T15:57:25.714448+0000","last_unstale":"2023-07-14T15:57:27.080025+0000","last_undegraded":"2023-07-14T15:57:27.080025+0000","last_fullsized":"2023-07-14T15:57:27.080025+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:11:14.971099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.715018+0000","last_change":"2023-07-14T15:57:25.707017+0000","last_active":"2023-07-14T15:57:25.715018+0000","last_peered":"2023-07-14T15:57:25.715018+0000","last_clean":"2023-07-14T15:57:25.715018+0000","last_became_active":"2023-07-14T15:57:25.706670+0000","last_became_peered":"2023-07-14T15:57:25.706670+0000","last_unstale":"2023-07-14T15:57:25.715018+0000","last_undegraded":"2023-07-14T15:57:25.715018+0000","last_fullsized":"2023-07-14T15:57:25.715018+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:37:34.881300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694039+0000","last_change":"2023-07-14T15:57:25.716158+0000","last_active":"2023-07-14T15:57:26.694039+0000","last_peered":"2023-07-14T15:57:26.694039+0000","last_clean":"2023-07-14T15:57:26.694039+0000","last_became_active":"2023-07-14T15:57:25.715850+0000","last_became_peered":"2023-07-14T15:57:25.715850+0000","last_unstale":"2023-07-14T15:57:26.694039+0000","last_undegraded":"2023-07-14T15:57:26.694039+0000","last_fullsized":"2023-07-14T15:57:26.694039+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:30:09.595831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694008+0000","last_change":"2023-07-14T15:57:25.708658+0000","last_active":"2023-07-14T15:57:26.694008+0000","last_peered":"2023-07-14T15:57:26.694008+0000","last_clean":"2023-07-14T15:57:26.694008+0000","last_became_active":"2023-07-14T15:57:25.708289+0000","last_became_peered":"2023-07-14T15:57:25.708289+0000","last_unstale":"2023-07-14T15:57:26.694008+0000","last_undegraded":"2023-07-14T15:57:26.694008+0000","last_fullsized":"2023-07-14T15:57:26.694008+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:20:54.175890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.717615+0000","last_change":"2023-07-14T15:57:25.713419+0000","last_active":"2023-07-14T15:57:25.717615+0000","last_peered":"2023-07-14T15:57:25.717615+0000","last_clean":"2023-07-14T15:57:25.717615+0000","last_became_active":"2023-07-14T15:57:25.713093+0000","last_became_peered":"2023-07-14T15:57:25.713093+0000","last_unstale":"2023-07-14T15:57:25.717615+0000","last_undegraded":"2023-07-14T15:57:25.717615+0000","last_fullsized":"2023-07-14T15:57:25.717615+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:00:49.136871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693994+0000","last_change":"2023-07-14T15:57:25.706580+0000","last_active":"2023-07-14T15:57:26.693994+0000","last_peered":"2023-07-14T15:57:26.693994+0000","last_clean":"2023-07-14T15:57:26.693994+0000","last_became_active":"2023-07-14T15:57:25.706059+0000","last_became_peered":"2023-07-14T15:57:25.706059+0000","last_unstale":"2023-07-14T15:57:26.693994+0000","last_undegraded":"2023-07-14T15:57:26.693994+0000","last_fullsized":"2023-07-14T15:57:26.693994+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:16:24.805508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694193+0000","last_change":"2023-07-14T15:57:25.706488+0000","last_active":"2023-07-14T15:57:26.694193+0000","last_peered":"2023-07-14T15:57:26.694193+0000","last_clean":"2023-07-14T15:57:26.694193+0000","last_became_active":"2023-07-14T15:57:25.706198+0000","last_became_peered":"2023-07-14T15:57:25.706198+0000","last_unstale":"2023-07-14T15:57:26.694193+0000","last_undegraded":"2023-07-14T15:57:26.694193+0000","last_fullsized":"2023-07-14T15:57:26.694193+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:38:44.179763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"35'4","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170540+0000","last_change":"2023-07-14T15:57:24.951038+0000","last_active":"2023-07-14T15:57:27.170540+0000","last_peered":"2023-07-14T15:57:27.170540+0000","last_clean":"2023-07-14T15:57:27.170540+0000","last_became_active":"2023-07-14T15:57:24.950729+0000","last_became_peered":"2023-07-14T15:57:24.950729+0000","last_unstale":"2023-07-14T15:57:27.170540+0000","last_undegraded":"2023-07-14T15:57:27.170540+0000","last_fullsized":"2023-07-14T15:57:27.170540+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:50:06.189560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.717685+0000","last_change":"2023-07-14T15:57:25.713457+0000","last_active":"2023-07-14T15:57:25.717685+0000","last_peered":"2023-07-14T15:57:25.717685+0000","last_clean":"2023-07-14T15:57:25.717685+0000","last_became_active":"2023-07-14T15:57:25.713153+0000","last_became_peered":"2023-07-14T15:57:25.713153+0000","last_unstale":"2023-07-14T15:57:25.717685+0000","last_undegraded":"2023-07-14T15:57:25.717685+0000","last_fullsized":"2023-07-14T15:57:25.717685+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:06:47.964048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"35'1","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.944686+0000","last_change":"2023-07-14T15:57:24.950846+0000","last_active":"2023-07-14T15:57:25.944686+0000","last_peered":"2023-07-14T15:57:25.944686+0000","last_clean":"2023-07-14T15:57:25.944686+0000","last_became_active":"2023-07-14T15:57:24.948195+0000","last_became_peered":"2023-07-14T15:57:24.948195+0000","last_unstale":"2023-07-14T15:57:25.944686+0000","last_undegraded":"2023-07-14T15:57:25.944686+0000","last_fullsized":"2023-07-14T15:57:25.944686+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:11:06.906742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694467+0000","last_change":"2023-07-14T15:57:25.706821+0000","last_active":"2023-07-14T15:57:26.694467+0000","last_peered":"2023-07-14T15:57:26.694467+0000","last_clean":"2023-07-14T15:57:26.694467+0000","last_became_active":"2023-07-14T15:57:25.706544+0000","last_became_peered":"2023-07-14T15:57:25.706544+0000","last_unstale":"2023-07-14T15:57:26.694467+0000","last_undegraded":"2023-07-14T15:57:26.694467+0000","last_fullsized":"2023-07-14T15:57:26.694467+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:57:14.558950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694334+0000","last_change":"2023-07-14T15:57:24.946400+0000","last_active":"2023-07-14T15:57:26.694334+0000","last_peered":"2023-07-14T15:57:26.694334+0000","last_clean":"2023-07-14T15:57:26.694334+0000","last_became_active":"2023-07-14T15:57:24.944268+0000","last_became_peered":"2023-07-14T15:57:24.944268+0000","last_unstale":"2023-07-14T15:57:26.694334+0000","last_undegraded":"2023-07-14T15:57:26.694334+0000","last_fullsized":"2023-07-14T15:57:26.694334+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:19:27.823719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.717611+0000","last_change":"2023-07-14T15:57:25.713045+0000","last_active":"2023-07-14T15:57:25.717611+0000","last_peered":"2023-07-14T15:57:25.717611+0000","last_clean":"2023-07-14T15:57:25.717611+0000","last_became_active":"2023-07-14T15:57:25.712719+0000","last_became_peered":"2023-07-14T15:57:25.712719+0000","last_unstale":"2023-07-14T15:57:25.717611+0000","last_undegraded":"2023-07-14T15:57:25.717611+0000","last_fullsized":"2023-07-14T15:57:25.717611+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:29:07.098880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170349+0000","last_change":"2023-07-14T15:57:24.949781+0000","last_active":"2023-07-14T15:57:27.170349+0000","last_peered":"2023-07-14T15:57:27.170349+0000","last_clean":"2023-07-14T15:57:27.170349+0000","last_became_active":"2023-07-14T15:57:24.949496+0000","last_became_peered":"2023-07-14T15:57:24.949496+0000","last_unstale":"2023-07-14T15:57:27.170349+0000","last_undegraded":"2023-07-14T15:57:27.170349+0000","last_fullsized":"2023-07-14T15:57:27.170349+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:38:12.937516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693738+0000","last_change":"2023-07-14T15:57:25.712413+0000","last_active":"2023-07-14T15:57:26.693738+0000","last_peered":"2023-07-14T15:57:26.693738+0000","last_clean":"2023-07-14T15:57:26.693738+0000","last_became_active":"2023-07-14T15:57:25.712153+0000","last_became_peered":"2023-07-14T15:57:25.712153+0000","last_unstale":"2023-07-14T15:57:26.693738+0000","last_undegraded":"2023-07-14T15:57:26.693738+0000","last_fullsized":"2023-07-14T15:57:26.693738+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:48:28.785668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"35'1","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170210+0000","last_change":"2023-07-14T15:57:24.946938+0000","last_active":"2023-07-14T15:57:27.170210+0000","last_peered":"2023-07-14T15:57:27.170210+0000","last_clean":"2023-07-14T15:57:27.170210+0000","last_became_active":"2023-07-14T15:57:24.946611+0000","last_became_peered":"2023-07-14T15:57:24.946611+0000","last_unstale":"2023-07-14T15:57:27.170210+0000","last_undegraded":"2023-07-14T15:57:27.170210+0000","last_fullsized":"2023-07-14T15:57:27.170210+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:03:29.027256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.079689+0000","last_change":"2023-07-14T15:57:25.711684+0000","last_active":"2023-07-14T15:57:27.079689+0000","last_peered":"2023-07-14T15:57:27.079689+0000","last_clean":"2023-07-14T15:57:27.079689+0000","last_became_active":"2023-07-14T15:57:25.710777+0000","last_became_peered":"2023-07-14T15:57:25.710777+0000","last_unstale":"2023-07-14T15:57:27.079689+0000","last_undegraded":"2023-07-14T15:57:27.079689+0000","last_fullsized":"2023-07-14T15:57:27.079689+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:38:13.939618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"35'1","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.941681+0000","last_change":"2023-07-14T15:57:24.952640+0000","last_active":"2023-07-14T15:57:25.941681+0000","last_peered":"2023-07-14T15:57:25.941681+0000","last_clean":"2023-07-14T15:57:25.941681+0000","last_became_active":"2023-07-14T15:57:24.952305+0000","last_became_peered":"2023-07-14T15:57:24.952305+0000","last_unstale":"2023-07-14T15:57:25.941681+0000","last_undegraded":"2023-07-14T15:57:25.941681+0000","last_fullsized":"2023-07-14T15:57:25.941681+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:54:38.765166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694294+0000","last_change":"2023-07-14T15:57:25.714100+0000","last_active":"2023-07-14T15:57:26.694294+0000","last_peered":"2023-07-14T15:57:26.694294+0000","last_clean":"2023-07-14T15:57:26.694294+0000","last_became_active":"2023-07-14T15:57:25.713850+0000","last_became_peered":"2023-07-14T15:57:25.713850+0000","last_unstale":"2023-07-14T15:57:26.694294+0000","last_undegraded":"2023-07-14T15:57:26.694294+0000","last_fullsized":"2023-07-14T15:57:26.694294+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:17:22.305947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693561+0000","last_change":"2023-07-14T15:57:24.944873+0000","last_active":"2023-07-14T15:57:26.693561+0000","last_peered":"2023-07-14T15:57:26.693561+0000","last_clean":"2023-07-14T15:57:26.693561+0000","last_became_active":"2023-07-14T15:57:24.944406+0000","last_became_peered":"2023-07-14T15:57:24.944406+0000","last_unstale":"2023-07-14T15:57:26.693561+0000","last_undegraded":"2023-07-14T15:57:26.693561+0000","last_fullsized":"2023-07-14T15:57:26.693561+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:27:08.642795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.717649+0000","last_change":"2023-07-14T15:57:25.713086+0000","last_active":"2023-07-14T15:57:25.717649+0000","last_peered":"2023-07-14T15:57:25.717649+0000","last_clean":"2023-07-14T15:57:25.717649+0000","last_became_active":"2023-07-14T15:57:25.712650+0000","last_became_peered":"2023-07-14T15:57:25.712650+0000","last_unstale":"2023-07-14T15:57:25.717649+0000","last_undegraded":"2023-07-14T15:57:25.717649+0000","last_fullsized":"2023-07-14T15:57:25.717649+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:21:41.043364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.694205+0000","last_change":"2023-07-14T15:57:24.946452+0000","last_active":"2023-07-14T15:57:25.694205+0000","last_peered":"2023-07-14T15:57:25.694205+0000","last_clean":"2023-07-14T15:57:25.694205+0000","last_became_active":"2023-07-14T15:57:24.946176+0000","last_became_peered":"2023-07-14T15:57:24.946176+0000","last_unstale":"2023-07-14T15:57:25.694205+0000","last_undegraded":"2023-07-14T15:57:25.694205+0000","last_fullsized":"2023-07-14T15:57:25.694205+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:53:48.975299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694391+0000","last_change":"2023-07-14T15:57:25.710818+0000","last_active":"2023-07-14T15:57:26.694391+0000","last_peered":"2023-07-14T15:57:26.694391+0000","last_clean":"2023-07-14T15:57:26.694391+0000","last_became_active":"2023-07-14T15:57:25.710212+0000","last_became_peered":"2023-07-14T15:57:25.710212+0000","last_unstale":"2023-07-14T15:57:26.694391+0000","last_undegraded":"2023-07-14T15:57:26.694391+0000","last_fullsized":"2023-07-14T15:57:26.694391+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:39:17.831626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694697+0000","last_change":"2023-07-14T15:57:24.949982+0000","last_active":"2023-07-14T15:57:26.694697+0000","last_peered":"2023-07-14T15:57:26.694697+0000","last_clean":"2023-07-14T15:57:26.694697+0000","last_became_active":"2023-07-14T15:57:24.949690+0000","last_became_peered":"2023-07-14T15:57:24.949690+0000","last_unstale":"2023-07-14T15:57:26.694697+0000","last_undegraded":"2023-07-14T15:57:26.694697+0000","last_fullsized":"2023-07-14T15:57:26.694697+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:06:06.625225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170316+0000","last_change":"2023-07-14T15:57:25.703650+0000","last_active":"2023-07-14T15:57:27.170316+0000","last_peered":"2023-07-14T15:57:27.170316+0000","last_clean":"2023-07-14T15:57:27.170316+0000","last_became_active":"2023-07-14T15:57:25.703366+0000","last_became_peered":"2023-07-14T15:57:25.703366+0000","last_unstale":"2023-07-14T15:57:27.170316+0000","last_undegraded":"2023-07-14T15:57:27.170316+0000","last_fullsized":"2023-07-14T15:57:27.170316+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:38:49.336628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694197+0000","last_change":"2023-07-14T15:57:24.949161+0000","last_active":"2023-07-14T15:57:26.694197+0000","last_peered":"2023-07-14T15:57:26.694197+0000","last_clean":"2023-07-14T15:57:26.694197+0000","last_became_active":"2023-07-14T15:57:24.948793+0000","last_became_peered":"2023-07-14T15:57:24.948793+0000","last_unstale":"2023-07-14T15:57:26.694197+0000","last_undegraded":"2023-07-14T15:57:26.694197+0000","last_fullsized":"2023-07-14T15:57:26.694197+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:40:33.570630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694750+0000","last_change":"2023-07-14T15:57:25.708172+0000","last_active":"2023-07-14T15:57:26.694750+0000","last_peered":"2023-07-14T15:57:26.694750+0000","last_clean":"2023-07-14T15:57:26.694750+0000","last_became_active":"2023-07-14T15:57:25.707852+0000","last_became_peered":"2023-07-14T15:57:25.707852+0000","last_unstale":"2023-07-14T15:57:26.694750+0000","last_undegraded":"2023-07-14T15:57:26.694750+0000","last_fullsized":"2023-07-14T15:57:26.694750+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:35:14.571116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"35'3","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694081+0000","last_change":"2023-07-14T15:57:24.943596+0000","last_active":"2023-07-14T15:57:26.694081+0000","last_peered":"2023-07-14T15:57:26.694081+0000","last_clean":"2023-07-14T15:57:26.694081+0000","last_became_active":"2023-07-14T15:57:24.943283+0000","last_became_peered":"2023-07-14T15:57:24.943283+0000","last_unstale":"2023-07-14T15:57:26.694081+0000","last_undegraded":"2023-07-14T15:57:26.694081+0000","last_fullsized":"2023-07-14T15:57:26.694081+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:59:41.480965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.701436+0000","last_change":"2023-07-14T15:57:25.700392+0000","last_active":"2023-07-14T15:57:25.701436+0000","last_peered":"2023-07-14T15:57:25.701436+0000","last_clean":"2023-07-14T15:57:25.701436+0000","last_became_active":"2023-07-14T15:57:25.700004+0000","last_became_peered":"2023-07-14T15:57:25.700004+0000","last_unstale":"2023-07-14T15:57:25.701436+0000","last_undegraded":"2023-07-14T15:57:25.701436+0000","last_fullsized":"2023-07-14T15:57:25.701436+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:19:12.695328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"35'6","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694419+0000","last_change":"2023-07-14T15:57:24.947031+0000","last_active":"2023-07-14T15:57:26.694419+0000","last_peered":"2023-07-14T15:57:26.694419+0000","last_clean":"2023-07-14T15:57:26.694419+0000","last_became_active":"2023-07-14T15:57:24.946757+0000","last_became_peered":"2023-07-14T15:57:24.946757+0000","last_unstale":"2023-07-14T15:57:26.694419+0000","last_undegraded":"2023-07-14T15:57:26.694419+0000","last_fullsized":"2023-07-14T15:57:26.694419+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:53:11.648125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693550+0000","last_change":"2023-07-14T15:57:25.707515+0000","last_active":"2023-07-14T15:57:26.693550+0000","last_peered":"2023-07-14T15:57:26.693550+0000","last_clean":"2023-07-14T15:57:26.693550+0000","last_became_active":"2023-07-14T15:57:25.706851+0000","last_became_peered":"2023-07-14T15:57:25.706851+0000","last_unstale":"2023-07-14T15:57:26.693550+0000","last_undegraded":"2023-07-14T15:57:26.693550+0000","last_fullsized":"2023-07-14T15:57:26.693550+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:32:43.868693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693711+0000","last_change":"2023-07-14T15:57:24.950415+0000","last_active":"2023-07-14T15:57:26.693711+0000","last_peered":"2023-07-14T15:57:26.693711+0000","last_clean":"2023-07-14T15:57:26.693711+0000","last_became_active":"2023-07-14T15:57:24.950096+0000","last_became_peered":"2023-07-14T15:57:24.950096+0000","last_unstale":"2023-07-14T15:57:26.693711+0000","last_undegraded":"2023-07-14T15:57:26.693711+0000","last_fullsized":"2023-07-14T15:57:26.693711+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:40:32.381876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.717469+0000","last_change":"2023-07-14T15:57:25.709485+0000","last_active":"2023-07-14T15:57:25.717469+0000","last_peered":"2023-07-14T15:57:25.717469+0000","last_clean":"2023-07-14T15:57:25.717469+0000","last_became_active":"2023-07-14T15:57:25.709177+0000","last_became_peered":"2023-07-14T15:57:25.709177+0000","last_unstale":"2023-07-14T15:57:25.717469+0000","last_undegraded":"2023-07-14T15:57:25.717469+0000","last_fullsized":"2023-07-14T15:57:25.717469+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:26:49.722181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.703812+0000","last_change":"2023-07-14T15:57:24.950482+0000","last_active":"2023-07-14T15:57:25.703812+0000","last_peered":"2023-07-14T15:57:25.703812+0000","last_clean":"2023-07-14T15:57:25.703812+0000","last_became_active":"2023-07-14T15:57:24.950222+0000","last_became_peered":"2023-07-14T15:57:24.950222+0000","last_unstale":"2023-07-14T15:57:25.703812+0000","last_undegraded":"2023-07-14T15:57:25.703812+0000","last_fullsized":"2023-07-14T15:57:25.703812+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:02:33.348436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.079793+0000","last_change":"2023-07-14T15:57:25.711446+0000","last_active":"2023-07-14T15:57:27.079793+0000","last_peered":"2023-07-14T15:57:27.079793+0000","last_clean":"2023-07-14T15:57:27.079793+0000","last_became_active":"2023-07-14T15:57:25.710394+0000","last_became_peered":"2023-07-14T15:57:25.710394+0000","last_unstale":"2023-07-14T15:57:27.079793+0000","last_undegraded":"2023-07-14T15:57:27.079793+0000","last_fullsized":"2023-07-14T15:57:27.079793+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:13:07.610735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694231+0000","last_change":"2023-07-14T15:57:24.948415+0000","last_active":"2023-07-14T15:57:26.694231+0000","last_peered":"2023-07-14T15:57:26.694231+0000","last_clean":"2023-07-14T15:57:26.694231+0000","last_became_active":"2023-07-14T15:57:24.947719+0000","last_became_peered":"2023-07-14T15:57:24.947719+0000","last_unstale":"2023-07-14T15:57:26.694231+0000","last_undegraded":"2023-07-14T15:57:26.694231+0000","last_fullsized":"2023-07-14T15:57:26.694231+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:08:13.930103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.076982+0000","last_change":"2023-07-14T15:57:25.710816+0000","last_active":"2023-07-14T15:57:27.076982+0000","last_peered":"2023-07-14T15:57:27.076982+0000","last_clean":"2023-07-14T15:57:27.076982+0000","last_became_active":"2023-07-14T15:57:25.710525+0000","last_became_peered":"2023-07-14T15:57:25.710525+0000","last_unstale":"2023-07-14T15:57:27.076982+0000","last_undegraded":"2023-07-14T15:57:27.076982+0000","last_fullsized":"2023-07-14T15:57:27.076982+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:54:39.767268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"35'8","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170313+0000","last_change":"2023-07-14T15:57:24.949662+0000","last_active":"2023-07-14T15:57:27.170313+0000","last_peered":"2023-07-14T15:57:27.170313+0000","last_clean":"2023-07-14T15:57:27.170313+0000","last_became_active":"2023-07-14T15:57:24.949145+0000","last_became_peered":"2023-07-14T15:57:24.949145+0000","last_unstale":"2023-07-14T15:57:27.170313+0000","last_undegraded":"2023-07-14T15:57:27.170313+0000","last_fullsized":"2023-07-14T15:57:27.170313+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:41:33.784826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.714329+0000","last_change":"2023-07-14T15:57:25.708735+0000","last_active":"2023-07-14T15:57:25.714329+0000","last_peered":"2023-07-14T15:57:25.714329+0000","last_clean":"2023-07-14T15:57:25.714329+0000","last_became_active":"2023-07-14T15:57:25.708251+0000","last_became_peered":"2023-07-14T15:57:25.708251+0000","last_unstale":"2023-07-14T15:57:25.714329+0000","last_undegraded":"2023-07-14T15:57:25.714329+0000","last_fullsized":"2023-07-14T15:57:25.714329+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:48:43.914128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"35'1","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.944067+0000","last_change":"2023-07-14T15:57:24.950806+0000","last_active":"2023-07-14T15:57:25.944067+0000","last_peered":"2023-07-14T15:57:25.944067+0000","last_clean":"2023-07-14T15:57:25.944067+0000","last_became_active":"2023-07-14T15:57:24.950499+0000","last_became_peered":"2023-07-14T15:57:24.950499+0000","last_unstale":"2023-07-14T15:57:25.944067+0000","last_undegraded":"2023-07-14T15:57:25.944067+0000","last_fullsized":"2023-07-14T15:57:25.944067+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:44:44.559996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.715713+0000","last_change":"2023-07-14T15:57:25.707810+0000","last_active":"2023-07-14T15:57:25.715713+0000","last_peered":"2023-07-14T15:57:25.715713+0000","last_clean":"2023-07-14T15:57:25.715713+0000","last_became_active":"2023-07-14T15:57:25.707540+0000","last_became_peered":"2023-07-14T15:57:25.707540+0000","last_unstale":"2023-07-14T15:57:25.715713+0000","last_undegraded":"2023-07-14T15:57:25.715713+0000","last_fullsized":"2023-07-14T15:57:25.715713+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:47:29.092265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694350+0000","last_change":"2023-07-14T15:57:24.943847+0000","last_active":"2023-07-14T15:57:26.694350+0000","last_peered":"2023-07-14T15:57:26.694350+0000","last_clean":"2023-07-14T15:57:26.694350+0000","last_became_active":"2023-07-14T15:57:24.943377+0000","last_became_peered":"2023-07-14T15:57:24.943377+0000","last_unstale":"2023-07-14T15:57:26.694350+0000","last_undegraded":"2023-07-14T15:57:26.694350+0000","last_fullsized":"2023-07-14T15:57:26.694350+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:15:32.247155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.717587+0000","last_change":"2023-07-14T15:57:25.713671+0000","last_active":"2023-07-14T15:57:25.717587+0000","last_peered":"2023-07-14T15:57:25.717587+0000","last_clean":"2023-07-14T15:57:25.717587+0000","last_became_active":"2023-07-14T15:57:25.713277+0000","last_became_peered":"2023-07-14T15:57:25.713277+0000","last_unstale":"2023-07-14T15:57:25.717587+0000","last_undegraded":"2023-07-14T15:57:25.717587+0000","last_fullsized":"2023-07-14T15:57:25.717587+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:50:51.047340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"35'1","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.077142+0000","last_change":"2023-07-14T15:57:24.947575+0000","last_active":"2023-07-14T15:57:27.077142+0000","last_peered":"2023-07-14T15:57:27.077142+0000","last_clean":"2023-07-14T15:57:27.077142+0000","last_became_active":"2023-07-14T15:57:24.947236+0000","last_became_peered":"2023-07-14T15:57:24.947236+0000","last_unstale":"2023-07-14T15:57:27.077142+0000","last_undegraded":"2023-07-14T15:57:27.077142+0000","last_fullsized":"2023-07-14T15:57:27.077142+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:37:33.879198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694961+0000","last_change":"2023-07-14T15:57:25.715669+0000","last_active":"2023-07-14T15:57:26.694961+0000","last_peered":"2023-07-14T15:57:26.694961+0000","last_clean":"2023-07-14T15:57:26.694961+0000","last_became_active":"2023-07-14T15:57:25.715414+0000","last_became_peered":"2023-07-14T15:57:25.715414+0000","last_unstale":"2023-07-14T15:57:26.694961+0000","last_undegraded":"2023-07-14T15:57:26.694961+0000","last_fullsized":"2023-07-14T15:57:26.694961+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:11:15.367018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694919+0000","last_change":"2023-07-14T15:57:24.946879+0000","last_active":"2023-07-14T15:57:26.694919+0000","last_peered":"2023-07-14T15:57:26.694919+0000","last_clean":"2023-07-14T15:57:26.694919+0000","last_became_active":"2023-07-14T15:57:24.946470+0000","last_became_peered":"2023-07-14T15:57:24.946470+0000","last_unstale":"2023-07-14T15:57:26.694919+0000","last_undegraded":"2023-07-14T15:57:26.694919+0000","last_fullsized":"2023-07-14T15:57:26.694919+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:24:27.076859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693801+0000","last_change":"2023-07-14T15:57:25.709753+0000","last_active":"2023-07-14T15:57:26.693801+0000","last_peered":"2023-07-14T15:57:26.693801+0000","last_clean":"2023-07-14T15:57:26.693801+0000","last_became_active":"2023-07-14T15:57:25.709467+0000","last_became_peered":"2023-07-14T15:57:25.709467+0000","last_unstale":"2023-07-14T15:57:26.693801+0000","last_undegraded":"2023-07-14T15:57:26.693801+0000","last_fullsized":"2023-07-14T15:57:26.693801+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:54:59.872919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694767+0000","last_change":"2023-07-14T15:57:24.942184+0000","last_active":"2023-07-14T15:57:26.694767+0000","last_peered":"2023-07-14T15:57:26.694767+0000","last_clean":"2023-07-14T15:57:26.694767+0000","last_became_active":"2023-07-14T15:57:24.941875+0000","last_became_peered":"2023-07-14T15:57:24.941875+0000","last_unstale":"2023-07-14T15:57:26.694767+0000","last_undegraded":"2023-07-14T15:57:26.694767+0000","last_fullsized":"2023-07-14T15:57:26.694767+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:52:45.470519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693423+0000","last_change":"2023-07-14T15:57:25.704418+0000","last_active":"2023-07-14T15:57:26.693423+0000","last_peered":"2023-07-14T15:57:26.693423+0000","last_clean":"2023-07-14T15:57:26.693423+0000","last_became_active":"2023-07-14T15:57:25.704119+0000","last_became_peered":"2023-07-14T15:57:25.704119+0000","last_unstale":"2023-07-14T15:57:26.693423+0000","last_undegraded":"2023-07-14T15:57:26.693423+0000","last_fullsized":"2023-07-14T15:57:26.693423+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:45:31.081120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.704009+0000","last_change":"2023-07-14T15:57:24.949131+0000","last_active":"2023-07-14T15:57:25.704009+0000","last_peered":"2023-07-14T15:57:25.704009+0000","last_clean":"2023-07-14T15:57:25.704009+0000","last_became_active":"2023-07-14T15:57:24.948700+0000","last_became_peered":"2023-07-14T15:57:24.948700+0000","last_unstale":"2023-07-14T15:57:25.704009+0000","last_undegraded":"2023-07-14T15:57:25.704009+0000","last_fullsized":"2023-07-14T15:57:25.704009+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:05:50.727388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.079927+0000","last_change":"2023-07-14T15:57:25.702410+0000","last_active":"2023-07-14T15:57:27.079927+0000","last_peered":"2023-07-14T15:57:27.079927+0000","last_clean":"2023-07-14T15:57:27.079927+0000","last_became_active":"2023-07-14T15:57:25.701678+0000","last_became_peered":"2023-07-14T15:57:25.701678+0000","last_unstale":"2023-07-14T15:57:27.079927+0000","last_undegraded":"2023-07-14T15:57:27.079927+0000","last_fullsized":"2023-07-14T15:57:27.079927+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:16:17.080122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.695691+0000","last_change":"2023-07-14T15:57:24.950805+0000","last_active":"2023-07-14T15:57:25.695691+0000","last_peered":"2023-07-14T15:57:25.695691+0000","last_clean":"2023-07-14T15:57:25.695691+0000","last_became_active":"2023-07-14T15:57:24.950510+0000","last_became_peered":"2023-07-14T15:57:24.950510+0000","last_unstale":"2023-07-14T15:57:25.695691+0000","last_undegraded":"2023-07-14T15:57:25.695691+0000","last_fullsized":"2023-07-14T15:57:25.695691+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:10:30.682698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693849+0000","last_change":"2023-07-14T15:57:25.704591+0000","last_active":"2023-07-14T15:57:26.693849+0000","last_peered":"2023-07-14T15:57:26.693849+0000","last_clean":"2023-07-14T15:57:26.693849+0000","last_became_active":"2023-07-14T15:57:25.704350+0000","last_became_peered":"2023-07-14T15:57:25.704350+0000","last_unstale":"2023-07-14T15:57:26.693849+0000","last_undegraded":"2023-07-14T15:57:26.693849+0000","last_fullsized":"2023-07-14T15:57:26.693849+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:22:31.192902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.703273+0000","last_change":"2023-07-14T15:57:24.949538+0000","last_active":"2023-07-14T15:57:25.703273+0000","last_peered":"2023-07-14T15:57:25.703273+0000","last_clean":"2023-07-14T15:57:25.703273+0000","last_became_active":"2023-07-14T15:57:24.949233+0000","last_became_peered":"2023-07-14T15:57:24.949233+0000","last_unstale":"2023-07-14T15:57:25.703273+0000","last_undegraded":"2023-07-14T15:57:25.703273+0000","last_fullsized":"2023-07-14T15:57:25.703273+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:24:23.085848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.076745+0000","last_change":"2023-07-14T15:57:25.707893+0000","last_active":"2023-07-14T15:57:27.076745+0000","last_peered":"2023-07-14T15:57:27.076745+0000","last_clean":"2023-07-14T15:57:27.076745+0000","last_became_active":"2023-07-14T15:57:25.707515+0000","last_became_peered":"2023-07-14T15:57:25.707515+0000","last_unstale":"2023-07-14T15:57:27.076745+0000","last_undegraded":"2023-07-14T15:57:27.076745+0000","last_fullsized":"2023-07-14T15:57:27.076745+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:13:20.474319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693948+0000","last_change":"2023-07-14T15:57:24.944835+0000","last_active":"2023-07-14T15:57:26.693948+0000","last_peered":"2023-07-14T15:57:26.693948+0000","last_clean":"2023-07-14T15:57:26.693948+0000","last_became_active":"2023-07-14T15:57:24.944421+0000","last_became_peered":"2023-07-14T15:57:24.944421+0000","last_unstale":"2023-07-14T15:57:26.693948+0000","last_undegraded":"2023-07-14T15:57:26.693948+0000","last_fullsized":"2023-07-14T15:57:26.693948+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:36:20.633161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694805+0000","last_change":"2023-07-14T15:56:02.621850+0000","last_active":"2023-07-14T15:57:26.694805+0000","last_peered":"2023-07-14T15:57:26.694805+0000","last_clean":"2023-07-14T15:57:26.694805+0000","last_became_active":"2023-07-14T15:56:02.621471+0000","last_became_peered":"2023-07-14T15:56:02.621471+0000","last_unstale":"2023-07-14T15:57:26.694805+0000","last_undegraded":"2023-07-14T15:57:26.694805+0000","last_fullsized":"2023-07-14T15:57:26.694805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:31:52.328091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694678+0000","last_change":"2023-07-14T15:57:25.717543+0000","last_active":"2023-07-14T15:57:26.694678+0000","last_peered":"2023-07-14T15:57:26.694678+0000","last_clean":"2023-07-14T15:57:26.694678+0000","last_became_active":"2023-07-14T15:57:25.717185+0000","last_became_peered":"2023-07-14T15:57:25.717185+0000","last_unstale":"2023-07-14T15:57:26.694678+0000","last_undegraded":"2023-07-14T15:57:26.694678+0000","last_fullsized":"2023-07-14T15:57:26.694678+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:54:28.947637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.077156+0000","last_change":"2023-07-14T15:57:24.943282+0000","last_active":"2023-07-14T15:57:27.077156+0000","last_peered":"2023-07-14T15:57:27.077156+0000","last_clean":"2023-07-14T15:57:27.077156+0000","last_became_active":"2023-07-14T15:57:24.942964+0000","last_became_peered":"2023-07-14T15:57:24.942964+0000","last_unstale":"2023-07-14T15:57:27.077156+0000","last_undegraded":"2023-07-14T15:57:27.077156+0000","last_fullsized":"2023-07-14T15:57:27.077156+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:50:50.045238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694297+0000","last_change":"2023-07-14T15:56:02.621963+0000","last_active":"2023-07-14T15:57:26.694297+0000","last_peered":"2023-07-14T15:57:26.694297+0000","last_clean":"2023-07-14T15:57:26.694297+0000","last_became_active":"2023-07-14T15:56:02.621678+0000","last_became_peered":"2023-07-14T15:56:02.621678+0000","last_unstale":"2023-07-14T15:57:26.694297+0000","last_undegraded":"2023-07-14T15:57:26.694297+0000","last_fullsized":"2023-07-14T15:57:26.694297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:13:35.392704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.079851+0000","last_change":"2023-07-14T15:57:25.702765+0000","last_active":"2023-07-14T15:57:27.079851+0000","last_peered":"2023-07-14T15:57:27.079851+0000","last_clean":"2023-07-14T15:57:27.079851+0000","last_became_active":"2023-07-14T15:57:25.702508+0000","last_became_peered":"2023-07-14T15:57:25.702508+0000","last_unstale":"2023-07-14T15:57:27.079851+0000","last_undegraded":"2023-07-14T15:57:27.079851+0000","last_fullsized":"2023-07-14T15:57:27.079851+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:18:05.260347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"36'1","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.078951+0000","last_change":"2023-07-14T15:57:24.945667+0000","last_active":"2023-07-14T15:57:27.078951+0000","last_peered":"2023-07-14T15:57:27.078951+0000","last_clean":"2023-07-14T15:57:27.078951+0000","last_became_active":"2023-07-14T15:57:24.945404+0000","last_became_peered":"2023-07-14T15:57:24.945404+0000","last_unstale":"2023-07-14T15:57:27.078951+0000","last_undegraded":"2023-07-14T15:57:27.078951+0000","last_fullsized":"2023-07-14T15:57:27.078951+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:38:23.686073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.076753+0000","last_change":"2023-07-14T15:56:01.925110+0000","last_active":"2023-07-14T15:57:27.076753+0000","last_peered":"2023-07-14T15:57:27.076753+0000","last_clean":"2023-07-14T15:57:27.076753+0000","last_became_active":"2023-07-14T15:56:01.924723+0000","last_became_peered":"2023-07-14T15:56:01.924723+0000","last_unstale":"2023-07-14T15:57:27.076753+0000","last_undegraded":"2023-07-14T15:57:27.076753+0000","last_fullsized":"2023-07-14T15:57:27.076753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:03:05.866904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694461+0000","last_change":"2023-07-14T15:57:25.711424+0000","last_active":"2023-07-14T15:57:26.694461+0000","last_peered":"2023-07-14T15:57:26.694461+0000","last_clean":"2023-07-14T15:57:26.694461+0000","last_became_active":"2023-07-14T15:57:25.710670+0000","last_became_peered":"2023-07-14T15:57:25.710670+0000","last_unstale":"2023-07-14T15:57:26.694461+0000","last_undegraded":"2023-07-14T15:57:26.694461+0000","last_fullsized":"2023-07-14T15:57:26.694461+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:25:01.452256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.079891+0000","last_change":"2023-07-14T15:57:24.943746+0000","last_active":"2023-07-14T15:57:27.079891+0000","last_peered":"2023-07-14T15:57:27.079891+0000","last_clean":"2023-07-14T15:57:27.079891+0000","last_became_active":"2023-07-14T15:57:24.943464+0000","last_became_peered":"2023-07-14T15:57:24.943464+0000","last_unstale":"2023-07-14T15:57:27.079891+0000","last_undegraded":"2023-07-14T15:57:27.079891+0000","last_fullsized":"2023-07-14T15:57:27.079891+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:56:11.761557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693926+0000","last_change":"2023-07-14T15:56:01.923465+0000","last_active":"2023-07-14T15:57:26.693926+0000","last_peered":"2023-07-14T15:57:26.693926+0000","last_clean":"2023-07-14T15:57:26.693926+0000","last_became_active":"2023-07-14T15:56:01.923160+0000","last_became_peered":"2023-07-14T15:56:01.923160+0000","last_unstale":"2023-07-14T15:57:26.693926+0000","last_undegraded":"2023-07-14T15:57:26.693926+0000","last_fullsized":"2023-07-14T15:57:26.693926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:59:26.813576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":189,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.694308+0000","last_change":"2023-07-14T15:55:54.040065+0000","last_active":"2023-07-14T15:57:25.694308+0000","last_peered":"2023-07-14T15:57:25.694308+0000","last_clean":"2023-07-14T15:57:25.694308+0000","last_became_active":"2023-07-14T15:55:54.038885+0000","last_became_peered":"2023-07-14T15:55:54.038885+0000","last_unstale":"2023-07-14T15:57:25.694308+0000","last_undegraded":"2023-07-14T15:57:25.694308+0000","last_fullsized":"2023-07-14T15:57:25.694308+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:55:53.025696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:55:53.025696+0000","last_clean_scrub_stamp":"2023-07-14T15:55:53.025696+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:23:24.719178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.076975+0000","last_change":"2023-07-14T15:57:25.703197+0000","last_active":"2023-07-14T15:57:27.076975+0000","last_peered":"2023-07-14T15:57:27.076975+0000","last_clean":"2023-07-14T15:57:27.076975+0000","last_became_active":"2023-07-14T15:57:25.702875+0000","last_became_peered":"2023-07-14T15:57:25.702875+0000","last_unstale":"2023-07-14T15:57:27.076975+0000","last_undegraded":"2023-07-14T15:57:27.076975+0000","last_fullsized":"2023-07-14T15:57:27.076975+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:00:49.136871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694484+0000","last_change":"2023-07-14T15:57:24.945870+0000","last_active":"2023-07-14T15:57:26.694484+0000","last_peered":"2023-07-14T15:57:26.694484+0000","last_clean":"2023-07-14T15:57:26.694484+0000","last_became_active":"2023-07-14T15:57:24.945590+0000","last_became_peered":"2023-07-14T15:57:24.945590+0000","last_unstale":"2023-07-14T15:57:26.694484+0000","last_undegraded":"2023-07-14T15:57:26.694484+0000","last_fullsized":"2023-07-14T15:57:26.694484+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:26:43.460807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693733+0000","last_change":"2023-07-14T15:56:01.920714+0000","last_active":"2023-07-14T15:57:26.693733+0000","last_peered":"2023-07-14T15:57:26.693733+0000","last_clean":"2023-07-14T15:57:26.693733+0000","last_became_active":"2023-07-14T15:56:01.920325+0000","last_became_peered":"2023-07-14T15:56:01.920325+0000","last_unstale":"2023-07-14T15:57:26.693733+0000","last_undegraded":"2023-07-14T15:57:26.693733+0000","last_fullsized":"2023-07-14T15:57:26.693733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:34:47.858129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.719013+0000","last_change":"2023-07-14T15:57:25.716751+0000","last_active":"2023-07-14T15:57:25.719013+0000","last_peered":"2023-07-14T15:57:25.719013+0000","last_clean":"2023-07-14T15:57:25.719013+0000","last_became_active":"2023-07-14T15:57:25.716471+0000","last_became_peered":"2023-07-14T15:57:25.716471+0000","last_unstale":"2023-07-14T15:57:25.719013+0000","last_undegraded":"2023-07-14T15:57:25.719013+0000","last_fullsized":"2023-07-14T15:57:25.719013+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:47:07.841527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.079980+0000","last_change":"2023-07-14T15:57:24.943010+0000","last_active":"2023-07-14T15:57:27.079980+0000","last_peered":"2023-07-14T15:57:27.079980+0000","last_clean":"2023-07-14T15:57:27.079980+0000","last_became_active":"2023-07-14T15:57:24.942673+0000","last_became_peered":"2023-07-14T15:57:24.942673+0000","last_unstale":"2023-07-14T15:57:27.079980+0000","last_undegraded":"2023-07-14T15:57:27.079980+0000","last_fullsized":"2023-07-14T15:57:27.079980+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:26:16.015035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694065+0000","last_change":"2023-07-14T15:56:01.923631+0000","last_active":"2023-07-14T15:57:26.694065+0000","last_peered":"2023-07-14T15:57:26.694065+0000","last_clean":"2023-07-14T15:57:26.694065+0000","last_became_active":"2023-07-14T15:56:01.922783+0000","last_became_peered":"2023-07-14T15:56:01.922783+0000","last_unstale":"2023-07-14T15:57:26.694065+0000","last_undegraded":"2023-07-14T15:57:26.694065+0000","last_fullsized":"2023-07-14T15:57:26.694065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:31:16.123367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694160+0000","last_change":"2023-07-14T15:57:25.715467+0000","last_active":"2023-07-14T15:57:26.694160+0000","last_peered":"2023-07-14T15:57:26.694160+0000","last_clean":"2023-07-14T15:57:26.694160+0000","last_became_active":"2023-07-14T15:57:25.715169+0000","last_became_peered":"2023-07-14T15:57:25.715169+0000","last_unstale":"2023-07-14T15:57:26.694160+0000","last_undegraded":"2023-07-14T15:57:26.694160+0000","last_fullsized":"2023-07-14T15:57:26.694160+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:18:30.445378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694374+0000","last_change":"2023-07-14T15:57:24.948604+0000","last_active":"2023-07-14T15:57:26.694374+0000","last_peered":"2023-07-14T15:57:26.694374+0000","last_clean":"2023-07-14T15:57:26.694374+0000","last_became_active":"2023-07-14T15:57:24.948128+0000","last_became_peered":"2023-07-14T15:57:24.948128+0000","last_unstale":"2023-07-14T15:57:26.694374+0000","last_undegraded":"2023-07-14T15:57:26.694374+0000","last_fullsized":"2023-07-14T15:57:26.694374+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:56:33.930892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694844+0000","last_change":"2023-07-14T15:56:01.965649+0000","last_active":"2023-07-14T15:57:26.694844+0000","last_peered":"2023-07-14T15:57:26.694844+0000","last_clean":"2023-07-14T15:57:26.694844+0000","last_became_active":"2023-07-14T15:56:01.965344+0000","last_became_peered":"2023-07-14T15:56:01.965344+0000","last_unstale":"2023-07-14T15:57:26.694844+0000","last_undegraded":"2023-07-14T15:57:26.694844+0000","last_fullsized":"2023-07-14T15:57:26.694844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:30:36.061855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.079965+0000","last_change":"2023-07-14T15:57:25.714552+0000","last_active":"2023-07-14T15:57:27.079965+0000","last_peered":"2023-07-14T15:57:27.079965+0000","last_clean":"2023-07-14T15:57:27.079965+0000","last_became_active":"2023-07-14T15:57:25.713523+0000","last_became_peered":"2023-07-14T15:57:25.713523+0000","last_unstale":"2023-07-14T15:57:27.079965+0000","last_undegraded":"2023-07-14T15:57:27.079965+0000","last_fullsized":"2023-07-14T15:57:27.079965+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:58:44.095117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693419+0000","last_change":"2023-07-14T15:57:24.948449+0000","last_active":"2023-07-14T15:57:26.693419+0000","last_peered":"2023-07-14T15:57:26.693419+0000","last_clean":"2023-07-14T15:57:26.693419+0000","last_became_active":"2023-07-14T15:57:24.948145+0000","last_became_peered":"2023-07-14T15:57:24.948145+0000","last_unstale":"2023-07-14T15:57:26.693419+0000","last_undegraded":"2023-07-14T15:57:26.693419+0000","last_fullsized":"2023-07-14T15:57:26.693419+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:43:28.358856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694508+0000","last_change":"2023-07-14T15:56:01.966578+0000","last_active":"2023-07-14T15:57:26.694508+0000","last_peered":"2023-07-14T15:57:26.694508+0000","last_clean":"2023-07-14T15:57:26.694508+0000","last_became_active":"2023-07-14T15:56:01.966216+0000","last_became_peered":"2023-07-14T15:56:01.966216+0000","last_unstale":"2023-07-14T15:57:26.694508+0000","last_undegraded":"2023-07-14T15:57:26.694508+0000","last_fullsized":"2023-07-14T15:57:26.694508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:34:54.823729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476759,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":401408,"data_stored":162350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.35699999999999998}]},{"osd":1,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.48399999999999999}]},{"osd":2,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.57199999999999995}]},{"osd":4,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.59199999999999997}]},{"osd":5,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.73999999999999999}]},{"osd":6,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.61099999999999999}]},{"osd":7,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.629}]}]},{"osd":0,"up_from":16,"seq":68719476760,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":396,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":405504,"data_stored":162352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.501},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.57699999999999996}]},{"osd":2,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.626}]},{"osd":3,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.74199999999999999}]},{"osd":4,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.78400000000000003}]},{"osd":5,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.66900000000000004}]},{"osd":6,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.90800000000000003}]},{"osd":7,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.88900000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542166,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":389120,"data_stored":155641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.65200000000000002}]},{"osd":1,"last update":"Fri Jul 14 15:56:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.76600000000000001}]},{"osd":2,"last update":"Fri Jul 14 15:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.87}]},{"osd":3,"last update":"Fri Jul 14 15:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":3.141,"5min":3.141,"15min":3.141},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.88800000000000001}]},{"osd":4,"last update":"Fri Jul 14 15:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.72399999999999998}]},{"osd":5,"last update":"Fri Jul 14 15:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.94499999999999995}]},{"osd":7,"last update":"Fri Jul 14 15:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.90800000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542165,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32008,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339832,"statfs":{"total":96636764160,"available":96603987968,"internally_reserved":0,"allocated":983040,"data_stored":745997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":4.5519999999999996,"5min":4.5519999999999996,"15min":4.5519999999999996},"last":0.39400000000000002},{"interface":"front","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":15.911,"5min":15.911,"15min":15.911},"last":0.46800000000000003}]},{"osd":2,"last update":"Fri Jul 14 15:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":4.5140000000000002,"5min":4.5140000000000002,"15min":4.5140000000000002},"last":0.44800000000000001}]},{"osd":3,"last update":"Fri Jul 14 15:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":4.452,"5min":4.452,"15min":4.452},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":4.2279999999999998,"5min":4.2279999999999998,"15min":4.2279999999999998},"last":0.42599999999999999}]},{"osd":4,"last update":"Fri Jul 14 15:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":4.6200000000000001,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":4.9109999999999996,"5min":4.9109999999999996,"15min":4.9109999999999996},"last":0.69399999999999995}]},{"osd":5,"last update":"Fri Jul 14 15:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":4.1269999999999998,"5min":4.1269999999999998,"15min":4.1269999999999998},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":4.585,"5min":4.585,"15min":4.585},"last":0.64000000000000001}]},{"osd":6,"last update":"Fri Jul 14 15:56:51 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":4.9880000000000004,"5min":4.9880000000000004,"15min":4.9880000000000004},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":4.1660000000000004,"5min":4.1660000000000004,"15min":4.1660000000000004},"last":0.68100000000000005}]},{"osd":7,"last update":"Fri Jul 14 15:56:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":4.9530000000000003,"5min":4.9530000000000003,"15min":4.9530000000000003},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":4.1959999999999997,"5min":4.1959999999999997,"15min":4.1959999999999997},"last":0.61799999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509463,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":413696,"data_stored":164406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:56:53 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.437}]},{"osd":1,"last update":"Fri Jul 14 15:56:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.315},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.46899999999999997}]},{"osd":3,"last update":"Fri Jul 14 15:56:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.498}]},{"osd":4,"last update":"Fri Jul 14 15:56:53 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.72699999999999998}]},{"osd":5,"last update":"Fri Jul 14 15:56:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.60999999999999999}]},{"osd":6,"last update":"Fri Jul 14 15:56:53 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.64600000000000002}]},{"osd":7,"last update":"Fri Jul 14 15:56:53 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.71099999999999997}]}]},{"osd":4,"up_from":15,"seq":64424509462,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":408,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":417792,"data_stored":163948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.88300000000000001}]},{"osd":1,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.748},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.82899999999999996}]},{"osd":2,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.80200000000000005}]},{"osd":3,"last update":"Fri Jul 14 15:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.94299999999999995}]},{"osd":5,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.84299999999999997}]},{"osd":6,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.63700000000000001}]},{"osd":7,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.61499999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509464,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27924,"kb_used_data":972,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343916,"statfs":{"total":96636764160,"available":96608169984,"internally_reserved":0,"allocated":995328,"data_stored":753210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":8.1500000000000004,"5min":8.1500000000000004,"15min":8.1500000000000004},"last":0.67500000000000004}]},{"osd":1,"last update":"Fri Jul 14 15:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.76800000000000002}]},{"osd":2,"last update":"Fri Jul 14 15:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.83899999999999997}]},{"osd":3,"last update":"Fri Jul 14 15:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.90600000000000003}]},{"osd":4,"last update":"Fri Jul 14 15:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.64400000000000002}]},{"osd":6,"last update":"Fri Jul 14 15:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.754},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.93799999999999994}]},{"osd":7,"last update":"Fri Jul 14 15:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.875},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.92300000000000004}]}]},{"osd":7,"up_from":15,"seq":64424509463,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":401408,"data_stored":162330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":4.5919999999999996,"5min":4.5919999999999996,"15min":4.5919999999999996},"last":0.624}]},{"osd":1,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1,"5min":1,"15min":1},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":4.665,"5min":4.665,"15min":4.665},"last":0.749}]},{"osd":2,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":5.4089999999999998,"5min":5.4089999999999998,"15min":5.4089999999999998},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":0.80400000000000005}]},{"osd":3,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":2.3380000000000001,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":2.3530000000000002,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":0.84199999999999997}]},{"osd":4,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.68899999999999995}]},{"osd":5,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.70399999999999996}]},{"osd":6,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.72599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T15:57:31.355 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-14T15:57:31.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.597+0000 7f964a9ff700 1 Processor -- start 2023-07-14T15:57:31.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.598+0000 7f964a9ff700 1 -- start start 2023-07-14T15:57:31.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.599+0000 7f964a9ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f96440b85f0 0x7f964415d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:31.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.599+0000 7f964a9ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96440cf6b0 con 0x7f96440b54b0 2023-07-14T15:57:31.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.599+0000 7f964a9ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96440cdc40 con 0x7f96440b4910 2023-07-14T15:57:31.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.599+0000 7f964a9ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f964415dba0 con 0x7f96440b85f0 2023-07-14T15:57:31.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.599+0000 7f9643fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f96440b85f0 0x7f964415d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:31.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.599+0000 7f9643fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f96440b85f0 0x7f964415d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38580/0 (socket says 172.21.15.37:38580) 2023-07-14T15:57:31.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.599+0000 7f96437fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f96440b54b0 0x7f96440cfb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56846/0 (socket says 172.21.15.37:56846) 2023-07-14T15:57:31.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.599+0000 7f9643fff700 1 -- 172.21.15.37:0/3395531784 learned_addr learned my addr 172.21.15.37:0/3395531784 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:31.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.600+0000 7f9643fff700 1 -- 172.21.15.37:0/3395531784 >> v1:172.21.15.98:6789/0 conn(0x7f96440b4910 legacy=0x7f96440b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:31.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.600+0000 7f9643fff700 1 -- 172.21.15.37:0/3395531784 >> v1:172.21.15.37:6789/0 conn(0x7f96440b54b0 legacy=0x7f96440cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:31.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.600+0000 7f9643fff700 1 -- 172.21.15.37:0/3395531784 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96440d0250 con 0x7f96440b85f0 2023-07-14T15:57:31.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.600+0000 7f9642ffd700 1 -- 172.21.15.37:0/3395531784 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3120174600 0 0) 0x7f96440cf6b0 con 0x7f96440b54b0 2023-07-14T15:57:31.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.600+0000 7f9643fff700 1 --2- 172.21.15.37:0/3395531784 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96440b85f0 0x7f964415d660 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f96340098f0 tx=0x7f9634009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6048a8160305835e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:31.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.600+0000 7f9642ffd700 1 -- 172.21.15.37:0/3395531784 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963400b8a0 con 0x7f96440b85f0 2023-07-14T15:57:31.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.600+0000 7f9642ffd700 1 -- 172.21.15.37:0/3395531784 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f963400ba00 con 0x7f96440b85f0 2023-07-14T15:57:31.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.600+0000 7f9642ffd700 1 -- 172.21.15.37:0/3395531784 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963400bd90 con 0x7f96440b85f0 2023-07-14T15:57:31.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.601+0000 7f964a9ff700 1 -- 172.21.15.37:0/3395531784 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96440b85f0 msgr2=0x7f964415d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:31.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.601+0000 7f964a9ff700 1 --2- 172.21.15.37:0/3395531784 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96440b85f0 0x7f964415d660 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f96340098f0 tx=0x7f9634009c00 comp rx=0 tx=0).stop 2023-07-14T15:57:31.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.601+0000 7f964a9ff700 1 -- 172.21.15.37:0/3395531784 shutdown_connections 2023-07-14T15:57:31.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.601+0000 7f964a9ff700 1 --2- 172.21.15.37:0/3395531784 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96440b85f0 0x7f964415d660 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:31.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.601+0000 7f964a9ff700 1 -- 172.21.15.37:0/3395531784 >> 172.21.15.37:0/3395531784 conn(0x7f964406a580 msgr2=0x7f964406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:31.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.601+0000 7f964a9ff700 1 -- 172.21.15.37:0/3395531784 shutdown_connections 2023-07-14T15:57:31.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.601+0000 7f964a9ff700 1 -- 172.21.15.37:0/3395531784 wait complete. 2023-07-14T15:57:31.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.603+0000 7f964a9ff700 1 Processor -- start 2023-07-14T15:57:31.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.603+0000 7f964a9ff700 1 -- start start 2023-07-14T15:57:31.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.604+0000 7f964a9ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f96440b4910 0x7f96441542b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:31.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.604+0000 7f964a9ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96440b54b0 0x7f96440b30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:31.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.604+0000 7f964a9ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96440b85f0 0x7f96441e7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:31.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.604+0000 7f964a9ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96441547f0 con 0x7f96440b85f0 2023-07-14T15:57:31.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.604+0000 7f964a9ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964415fea0 con 0x7f96440b54b0 2023-07-14T15:57:31.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.604+0000 7f964a9ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9644160180 con 0x7f96440b4910 2023-07-14T15:57:31.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.604+0000 7f9648f9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96440b85f0 0x7f96441e7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:31.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.604+0000 7f9648f9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96440b85f0 0x7f96441e7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38594/0 (socket says 172.21.15.37:38594) 2023-07-14T15:57:31.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.604+0000 7f9648f9c700 1 -- 172.21.15.37:0/1300370301 learned_addr learned my addr 172.21.15.37:0/1300370301 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:31.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.604+0000 7f9643fff700 1 --2- 172.21.15.37:0/1300370301 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f96440b4910 0x7f96441542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:31.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.604+0000 7f96437fe700 1 --2- 172.21.15.37:0/1300370301 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96440b54b0 0x7f96440b30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:31.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.605+0000 7f9648f9c700 1 -- 172.21.15.37:0/1300370301 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f96440b4910 msgr2=0x7f96441542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:31.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.605+0000 7f9648f9c700 1 --2- 172.21.15.37:0/1300370301 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f96440b4910 0x7f96441542b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:31.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.605+0000 7f9648f9c700 1 -- 172.21.15.37:0/1300370301 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96440b54b0 msgr2=0x7f96440b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:31.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.605+0000 7f9648f9c700 1 --2- 172.21.15.37:0/1300370301 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96440b54b0 0x7f96440b30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:31.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.605+0000 7f9648f9c700 1 -- 172.21.15.37:0/1300370301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9634009550 con 0x7f96440b85f0 2023-07-14T15:57:31.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.605+0000 7f9648f9c700 1 --2- 172.21.15.37:0/1300370301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96440b85f0 0x7f96441e7140 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f963c00cc50 tx=0x7f963c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:31.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.605+0000 7f9640ff9700 1 -- 172.21.15.37:0/1300370301 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963c003c00 con 0x7f96440b85f0 2023-07-14T15:57:31.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.605+0000 7f9640ff9700 1 -- 172.21.15.37:0/1300370301 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f963c003d60 con 0x7f96440b85f0 2023-07-14T15:57:31.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.605+0000 7f964a9ff700 1 -- 172.21.15.37:0/1300370301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9644160460 con 0x7f96440b85f0 2023-07-14T15:57:31.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.605+0000 7f9640ff9700 1 -- 172.21.15.37:0/1300370301 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963c00aaf0 con 0x7f96440b85f0 2023-07-14T15:57:31.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.605+0000 7f964a9ff700 1 -- 172.21.15.37:0/1300370301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9644160a20 con 0x7f96440b85f0 2023-07-14T15:57:31.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.606+0000 7f964a9ff700 1 -- 172.21.15.37:0/1300370301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9644067840 con 0x7f96440b85f0 2023-07-14T15:57:31.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.607+0000 7f9640ff9700 1 -- 172.21.15.37:0/1300370301 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f963c00ac50 con 0x7f96440b85f0 2023-07-14T15:57:31.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.608+0000 7f9640ff9700 1 --2- 172.21.15.37:0/1300370301 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f963006ace0 0x7f963006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:31.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.608+0000 7f9640ff9700 1 -- 172.21.15.37:0/1300370301 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f963c0894d0 con 0x7f96440b85f0 2023-07-14T15:57:31.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.609+0000 7f9643fff700 1 --2- 172.21.15.37:0/1300370301 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f963006ace0 0x7f963006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:31.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.610+0000 7f9643fff700 1 --2- 172.21.15.37:0/1300370301 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f963006ace0 0x7f963006d190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9634014040 tx=0x7f963401c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:31.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.612+0000 7f9640ff9700 1 -- 172.21.15.37:0/1300370301 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f963c054580 con 0x7f96440b85f0 2023-07-14T15:57:31.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.903+0000 7f964a9ff700 1 -- 172.21.15.37:0/1300370301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f96441610a0 con 0x7f96440b85f0 2023-07-14T15:57:31.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.904+0000 7f9640ff9700 1 -- 172.21.15.37:0/1300370301 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1175 (secure 0 0 0) 0x7f963c057ba0 con 0x7f96440b85f0 2023-07-14T15:57:31.889 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:57:31.890 INFO:teuthology.orchestra.run.smithi037.stdout:{"fsid":"9da30401-a779-4e46-aba6-00c2494c6c67","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":112,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":36,"num_osds":8,"num_up_osds":8,"osd_up_since":1689350153,"num_in_osds":8,"osd_in_since":1689350143,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":24,"data_bytes":592730,"bytes_used":229392384,"bytes_avail":772864720896,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":16,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":5121}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-07-14T15:57:04.868112+0000","services":{"mds":{"daemons":{"summary":"","d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-07-14T15:57:31.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.906+0000 7f964a9ff700 1 -- 172.21.15.37:0/1300370301 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f963006ace0 msgr2=0x7f963006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:31.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.906+0000 7f964a9ff700 1 --2- 172.21.15.37:0/1300370301 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f963006ace0 0x7f963006d190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9634014040 tx=0x7f963401c040 comp rx=0 tx=0).stop 2023-07-14T15:57:31.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.906+0000 7f964a9ff700 1 -- 172.21.15.37:0/1300370301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96440b85f0 msgr2=0x7f96441e7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:31.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.906+0000 7f964a9ff700 1 --2- 172.21.15.37:0/1300370301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96440b85f0 0x7f96441e7140 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f963c00cc50 tx=0x7f963c00cf60 comp rx=0 tx=0).stop 2023-07-14T15:57:31.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.906+0000 7f964a9ff700 1 -- 172.21.15.37:0/1300370301 shutdown_connections 2023-07-14T15:57:31.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.906+0000 7f964a9ff700 1 --2- 172.21.15.37:0/1300370301 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f963006ace0 0x7f963006d190 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:31.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.906+0000 7f964a9ff700 1 --2- 172.21.15.37:0/1300370301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96440b85f0 0x7f96441e7140 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:31.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.906+0000 7f964a9ff700 1 --2- 172.21.15.37:0/1300370301 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f96440b4910 0x7f96441542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:31.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.906+0000 7f964a9ff700 1 --2- 172.21.15.37:0/1300370301 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96440b54b0 0x7f96440b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:31.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.906+0000 7f964a9ff700 1 -- 172.21.15.37:0/1300370301 >> 172.21.15.37:0/1300370301 conn(0x7f964406a580 msgr2=0x7f964415cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:31.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.906+0000 7f964a9ff700 1 -- 172.21.15.37:0/1300370301 shutdown_connections 2023-07-14T15:57:31.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:31.906+0000 7f964a9ff700 1 -- 172.21.15.37:0/1300370301 wait complete. 2023-07-14T15:57:31.910 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-14T15:57:31.911 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T15:57:32.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.126+0000 7fd4313ff700 1 Processor -- start 2023-07-14T15:57:32.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.126+0000 7fd4313ff700 1 -- start start 2023-07-14T15:57:32.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.128+0000 7fd4313ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd42c0cffc0 0x7fd42c0b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:32.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.128+0000 7fd4313ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd42c0d0de0 con 0x7fd42c160c50 2023-07-14T15:57:32.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.128+0000 7fd4313ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd42c1610f0 con 0x7fd42c0b8b80 2023-07-14T15:57:32.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.128+0000 7fd4313ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd42c0cd590 con 0x7fd42c0cffc0 2023-07-14T15:57:32.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.128+0000 7fd42b7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd42c160c50 0x7fd42c0d1270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56856/0 (socket says 172.21.15.37:56856) 2023-07-14T15:57:32.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.128+0000 7fd42b7fe700 1 -- 172.21.15.37:0/3046453286 learned_addr learned my addr 172.21.15.37:0/3046453286 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:32.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.128+0000 7fd423fff700 1 --2- 172.21.15.37:0/3046453286 >> v2:172.21.15.98:3300/0 conn(0x7fd42c0cffc0 0x7fd42c0b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:32.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.128+0000 7fd42a7fc700 1 -- 172.21.15.37:0/3046453286 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 845655589 0 0) 0x7fd42c0d0de0 con 0x7fd42c160c50 2023-07-14T15:57:32.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.129+0000 7fd42a7fc700 1 -- 172.21.15.37:0/3046453286 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4180035b0 con 0x7fd42c160c50 2023-07-14T15:57:32.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.129+0000 7fd423fff700 1 -- 172.21.15.37:0/3046453286 >> v1:172.21.15.98:6789/0 conn(0x7fd42c0b8b80 legacy=0x7fd42c0cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:32.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.129+0000 7fd42a7fc700 1 -- 172.21.15.37:0/3046453286 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1662346896 0 0) 0x7fd4180035b0 con 0x7fd42c160c50 2023-07-14T15:57:32.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.129+0000 7fd423fff700 1 -- 172.21.15.37:0/3046453286 >> v1:172.21.15.37:6789/0 conn(0x7fd42c160c50 legacy=0x7fd42c0d1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:32.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.129+0000 7fd423fff700 1 -- 172.21.15.37:0/3046453286 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd42c0cd870 con 0x7fd42c0cffc0 2023-07-14T15:57:32.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.129+0000 7fd423fff700 1 --2- 172.21.15.37:0/3046453286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd42c0cffc0 0x7fd42c0b5cf0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd4140097c0 tx=0x7fd414009ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1f5dbe5409ac493 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:32.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.129+0000 7fd42a7fc700 1 -- 172.21.15.37:0/3046453286 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4240019f0 con 0x7fd42c0cffc0 2023-07-14T15:57:32.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.129+0000 7fd42a7fc700 1 -- 172.21.15.37:0/3046453286 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd414004030 con 0x7fd42c0cffc0 2023-07-14T15:57:32.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.129+0000 7fd42a7fc700 1 -- 172.21.15.37:0/3046453286 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4140043a0 con 0x7fd42c0cffc0 2023-07-14T15:57:32.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.130+0000 7fd4313ff700 1 -- 172.21.15.37:0/3046453286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd42c0cffc0 msgr2=0x7fd42c0b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:32.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.130+0000 7fd4313ff700 1 --2- 172.21.15.37:0/3046453286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd42c0cffc0 0x7fd42c0b5cf0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd4140097c0 tx=0x7fd414009ad0 comp rx=0 tx=0).stop 2023-07-14T15:57:32.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.130+0000 7fd4313ff700 1 -- 172.21.15.37:0/3046453286 shutdown_connections 2023-07-14T15:57:32.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.130+0000 7fd4313ff700 1 --2- 172.21.15.37:0/3046453286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd42c0cffc0 0x7fd42c0b5cf0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:32.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.130+0000 7fd4313ff700 1 -- 172.21.15.37:0/3046453286 >> 172.21.15.37:0/3046453286 conn(0x7fd42c06b150 msgr2=0x7fd42c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:32.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.130+0000 7fd4313ff700 1 -- 172.21.15.37:0/3046453286 shutdown_connections 2023-07-14T15:57:32.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.130+0000 7fd4313ff700 1 -- 172.21.15.37:0/3046453286 wait complete. 2023-07-14T15:57:32.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.132+0000 7fd4313ff700 1 Processor -- start 2023-07-14T15:57:32.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.132+0000 7fd4313ff700 1 -- start start 2023-07-14T15:57:32.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.133+0000 7fd4313ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd42c0b8b80 0x7fd42c0b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:32.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.133+0000 7fd4313ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd42c0cffc0 0x7fd42c151290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:32.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.133+0000 7fd4313ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd42c160c50 0x7fd42c0c9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:32.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.133+0000 7fd4313ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42c0b2610 con 0x7fd42c0cffc0 2023-07-14T15:57:32.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.133+0000 7fd4313ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42c0b28f0 con 0x7fd42c160c50 2023-07-14T15:57:32.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.133+0000 7fd4313ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd42c0b2bd0 con 0x7fd42c0b8b80 2023-07-14T15:57:32.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.133+0000 7fd423fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd42c0cffc0 0x7fd42c151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:32.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.133+0000 7fd423fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd42c0cffc0 0x7fd42c151290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38598/0 (socket says 172.21.15.37:38598) 2023-07-14T15:57:32.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.133+0000 7fd423fff700 1 -- 172.21.15.37:0/2548023225 learned_addr learned my addr 172.21.15.37:0/2548023225 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:32.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.133+0000 7fd42affd700 1 --2- 172.21.15.37:0/2548023225 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd42c0b8b80 0x7fd42c0b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:32.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.133+0000 7fd42b7fe700 1 --2- 172.21.15.37:0/2548023225 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd42c160c50 0x7fd42c0c9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:32.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.133+0000 7fd423fff700 1 -- 172.21.15.37:0/2548023225 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd42c0b8b80 msgr2=0x7fd42c0b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:32.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.133+0000 7fd423fff700 1 --2- 172.21.15.37:0/2548023225 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd42c0b8b80 0x7fd42c0b36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:32.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.133+0000 7fd423fff700 1 -- 172.21.15.37:0/2548023225 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd42c160c50 msgr2=0x7fd42c0c9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:32.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.133+0000 7fd423fff700 1 --2- 172.21.15.37:0/2548023225 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd42c160c50 0x7fd42c0c9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:32.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.134+0000 7fd423fff700 1 -- 172.21.15.37:0/2548023225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4140094a0 con 0x7fd42c0cffc0 2023-07-14T15:57:32.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.134+0000 7fd42affd700 1 --2- 172.21.15.37:0/2548023225 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd42c0b8b80 0x7fd42c0b36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:57:32.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.134+0000 7fd42b7fe700 1 --2- 172.21.15.37:0/2548023225 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd42c160c50 0x7fd42c0c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:57:32.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.134+0000 7fd423fff700 1 --2- 172.21.15.37:0/2548023225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd42c0cffc0 0x7fd42c151290 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd414014040 tx=0x7fd414004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:32.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.134+0000 7fd4237fe700 1 -- 172.21.15.37:0/2548023225 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41400f920 con 0x7fd42c0cffc0 2023-07-14T15:57:32.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.134+0000 7fd4237fe700 1 -- 172.21.15.37:0/2548023225 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd41400faa0 con 0x7fd42c0cffc0 2023-07-14T15:57:32.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.134+0000 7fd4237fe700 1 -- 172.21.15.37:0/2548023225 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41400fe50 con 0x7fd42c0cffc0 2023-07-14T15:57:32.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.134+0000 7fd4313ff700 1 -- 172.21.15.37:0/2548023225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd42c0b2eb0 con 0x7fd42c0cffc0 2023-07-14T15:57:32.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.134+0000 7fd4313ff700 1 -- 172.21.15.37:0/2548023225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd42c0b3bf0 con 0x7fd42c0cffc0 2023-07-14T15:57:32.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.135+0000 7fd4313ff700 1 -- 172.21.15.37:0/2548023225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd42c0b33d0 con 0x7fd42c0cffc0 2023-07-14T15:57:32.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.136+0000 7fd4237fe700 1 -- 172.21.15.37:0/2548023225 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd414018070 con 0x7fd42c0cffc0 2023-07-14T15:57:32.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.137+0000 7fd4237fe700 1 --2- 172.21.15.37:0/2548023225 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd40c06ace0 0x7fd40c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:32.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.137+0000 7fd4237fe700 1 -- 172.21.15.37:0/2548023225 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd41408ab40 con 0x7fd42c0cffc0 2023-07-14T15:57:32.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.138+0000 7fd42affd700 1 --2- 172.21.15.37:0/2548023225 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd40c06ace0 0x7fd40c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:32.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.138+0000 7fd42affd700 1 --2- 172.21.15.37:0/2548023225 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd40c06ace0 0x7fd40c06d190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd41c0018e0 tx=0x7fd41c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:32.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.142+0000 7fd4237fe700 1 -- 172.21.15.37:0/2548023225 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd42c0b33d0 con 0x7fd42c0cffc0 2023-07-14T15:57:32.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.346+0000 7fd4313ff700 1 -- 172.21.15.37:0/2548023225 --> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd42c0d0a70 con 0x7fd40c06ace0 2023-07-14T15:57:32.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.356+0000 7fd4237fe700 1 -- 172.21.15.37:0/2548023225 <== mgr.4100 v2:172.21.15.98:6832/3163748069 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310879 (secure 0 0 0) 0x7fd41c0014d0 con 0x7fd40c06ace0 2023-07-14T15:57:32.345 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:57:32.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.360+0000 7fd4313ff700 1 -- 172.21.15.37:0/2548023225 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd40c06ace0 msgr2=0x7fd40c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:32.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.360+0000 7fd4313ff700 1 --2- 172.21.15.37:0/2548023225 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd40c06ace0 0x7fd40c06d190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd41c0018e0 tx=0x7fd41c009040 comp rx=0 tx=0).stop 2023-07-14T15:57:32.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.360+0000 7fd4313ff700 1 -- 172.21.15.37:0/2548023225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd42c0cffc0 msgr2=0x7fd42c151290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:32.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.360+0000 7fd4313ff700 1 --2- 172.21.15.37:0/2548023225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd42c0cffc0 0x7fd42c151290 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd414014040 tx=0x7fd414004750 comp rx=0 tx=0).stop 2023-07-14T15:57:32.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.360+0000 7fd4313ff700 1 -- 172.21.15.37:0/2548023225 shutdown_connections 2023-07-14T15:57:32.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.360+0000 7fd4313ff700 1 --2- 172.21.15.37:0/2548023225 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd42c160c50 0x7fd42c0c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:32.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.360+0000 7fd4313ff700 1 --2- 172.21.15.37:0/2548023225 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd40c06ace0 0x7fd40c06d190 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:32.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.360+0000 7fd4313ff700 1 --2- 172.21.15.37:0/2548023225 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd42c0b8b80 0x7fd42c0b36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:32.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.360+0000 7fd4313ff700 1 --2- 172.21.15.37:0/2548023225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd42c0cffc0 0x7fd42c151290 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:32.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.360+0000 7fd4313ff700 1 -- 172.21.15.37:0/2548023225 >> 172.21.15.37:0/2548023225 conn(0x7fd42c06b150 msgr2=0x7fd42c0cdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:32.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.360+0000 7fd4313ff700 1 -- 172.21.15.37:0/2548023225 shutdown_connections 2023-07-14T15:57:32.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:32.360+0000 7fd4313ff700 1 -- 172.21.15.37:0/2548023225 wait complete. 2023-07-14T15:57:32.348 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-14T15:57:32.363 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2023-07-14T15:57:30.873431+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":132,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224016,"kb_used_data":4304,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754750704,"statfs":{"total":773094113280,"available":772864720896,"internally_reserved":0,"allocated":4407296,"data_stored":2470234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001243"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694788+0000","last_change":"2023-07-14T15:57:25.708719+0000","last_active":"2023-07-14T15:57:26.694788+0000","last_peered":"2023-07-14T15:57:26.694788+0000","last_clean":"2023-07-14T15:57:26.694788+0000","last_became_active":"2023-07-14T15:57:25.708107+0000","last_became_peered":"2023-07-14T15:57:25.708107+0000","last_unstale":"2023-07-14T15:57:26.694788+0000","last_undegraded":"2023-07-14T15:57:26.694788+0000","last_fullsized":"2023-07-14T15:57:26.694788+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:52:37.992568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.717421+0000","last_change":"2023-07-14T15:57:25.710340+0000","last_active":"2023-07-14T15:57:25.717421+0000","last_peered":"2023-07-14T15:57:25.717421+0000","last_clean":"2023-07-14T15:57:25.717421+0000","last_became_active":"2023-07-14T15:57:25.710113+0000","last_became_peered":"2023-07-14T15:57:25.710113+0000","last_unstale":"2023-07-14T15:57:25.717421+0000","last_undegraded":"2023-07-14T15:57:25.717421+0000","last_fullsized":"2023-07-14T15:57:25.717421+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:53:01.027835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694176+0000","last_change":"2023-07-14T15:57:25.707011+0000","last_active":"2023-07-14T15:57:26.694176+0000","last_peered":"2023-07-14T15:57:26.694176+0000","last_clean":"2023-07-14T15:57:26.694176+0000","last_became_active":"2023-07-14T15:57:25.706720+0000","last_became_peered":"2023-07-14T15:57:25.706720+0000","last_unstale":"2023-07-14T15:57:26.694176+0000","last_undegraded":"2023-07-14T15:57:26.694176+0000","last_fullsized":"2023-07-14T15:57:26.694176+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:11:43.491601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694227+0000","last_change":"2023-07-14T15:57:25.710983+0000","last_active":"2023-07-14T15:57:26.694227+0000","last_peered":"2023-07-14T15:57:26.694227+0000","last_clean":"2023-07-14T15:57:26.694227+0000","last_became_active":"2023-07-14T15:57:25.710549+0000","last_became_peered":"2023-07-14T15:57:25.710549+0000","last_unstale":"2023-07-14T15:57:26.694227+0000","last_undegraded":"2023-07-14T15:57:26.694227+0000","last_fullsized":"2023-07-14T15:57:26.694227+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:40:25.153466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.076832+0000","last_change":"2023-07-14T15:57:25.703749+0000","last_active":"2023-07-14T15:57:27.076832+0000","last_peered":"2023-07-14T15:57:27.076832+0000","last_clean":"2023-07-14T15:57:27.076832+0000","last_became_active":"2023-07-14T15:57:25.703455+0000","last_became_peered":"2023-07-14T15:57:25.703455+0000","last_unstale":"2023-07-14T15:57:27.076832+0000","last_undegraded":"2023-07-14T15:57:27.076832+0000","last_fullsized":"2023-07-14T15:57:27.076832+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:08:58.707250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.717512+0000","last_change":"2023-07-14T15:57:25.712112+0000","last_active":"2023-07-14T15:57:25.717512+0000","last_peered":"2023-07-14T15:57:25.717512+0000","last_clean":"2023-07-14T15:57:25.717512+0000","last_became_active":"2023-07-14T15:57:25.711731+0000","last_became_peered":"2023-07-14T15:57:25.711731+0000","last_unstale":"2023-07-14T15:57:25.717512+0000","last_undegraded":"2023-07-14T15:57:25.717512+0000","last_fullsized":"2023-07-14T15:57:25.717512+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:00:40.319113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.715576+0000","last_change":"2023-07-14T15:57:25.708346+0000","last_active":"2023-07-14T15:57:25.715576+0000","last_peered":"2023-07-14T15:57:25.715576+0000","last_clean":"2023-07-14T15:57:25.715576+0000","last_became_active":"2023-07-14T15:57:25.708048+0000","last_became_peered":"2023-07-14T15:57:25.708048+0000","last_unstale":"2023-07-14T15:57:25.715576+0000","last_undegraded":"2023-07-14T15:57:25.715576+0000","last_fullsized":"2023-07-14T15:57:25.715576+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:05:25.335710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694045+0000","last_change":"2023-07-14T15:57:25.706331+0000","last_active":"2023-07-14T15:57:26.694045+0000","last_peered":"2023-07-14T15:57:26.694045+0000","last_clean":"2023-07-14T15:57:26.694045+0000","last_became_active":"2023-07-14T15:57:25.705691+0000","last_became_peered":"2023-07-14T15:57:25.705691+0000","last_unstale":"2023-07-14T15:57:26.694045+0000","last_undegraded":"2023-07-14T15:57:26.694045+0000","last_fullsized":"2023-07-14T15:57:26.694045+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:24:52.499316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.077364+0000","last_change":"2023-07-14T15:57:25.713167+0000","last_active":"2023-07-14T15:57:27.077364+0000","last_peered":"2023-07-14T15:57:27.077364+0000","last_clean":"2023-07-14T15:57:27.077364+0000","last_became_active":"2023-07-14T15:57:25.712829+0000","last_became_peered":"2023-07-14T15:57:25.712829+0000","last_unstale":"2023-07-14T15:57:27.077364+0000","last_undegraded":"2023-07-14T15:57:27.077364+0000","last_fullsized":"2023-07-14T15:57:27.077364+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:53:49.977402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.714964+0000","last_change":"2023-07-14T15:57:25.707232+0000","last_active":"2023-07-14T15:57:25.714964+0000","last_peered":"2023-07-14T15:57:25.714964+0000","last_clean":"2023-07-14T15:57:25.714964+0000","last_became_active":"2023-07-14T15:57:25.706976+0000","last_became_peered":"2023-07-14T15:57:25.706976+0000","last_unstale":"2023-07-14T15:57:25.714964+0000","last_undegraded":"2023-07-14T15:57:25.714964+0000","last_fullsized":"2023-07-14T15:57:25.714964+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:48:00.956575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.080162+0000","last_change":"2023-07-14T15:57:25.704130+0000","last_active":"2023-07-14T15:57:27.080162+0000","last_peered":"2023-07-14T15:57:27.080162+0000","last_clean":"2023-07-14T15:57:27.080162+0000","last_became_active":"2023-07-14T15:57:25.703350+0000","last_became_peered":"2023-07-14T15:57:25.703350+0000","last_unstale":"2023-07-14T15:57:27.080162+0000","last_undegraded":"2023-07-14T15:57:27.080162+0000","last_fullsized":"2023-07-14T15:57:27.080162+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:51:25.799916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.077125+0000","last_change":"2023-07-14T15:57:25.709331+0000","last_active":"2023-07-14T15:57:27.077125+0000","last_peered":"2023-07-14T15:57:27.077125+0000","last_clean":"2023-07-14T15:57:27.077125+0000","last_became_active":"2023-07-14T15:57:25.709039+0000","last_became_peered":"2023-07-14T15:57:25.709039+0000","last_unstale":"2023-07-14T15:57:27.077125+0000","last_undegraded":"2023-07-14T15:57:27.077125+0000","last_fullsized":"2023-07-14T15:57:27.077125+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:05:25.335710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.717498+0000","last_change":"2023-07-14T15:57:25.715095+0000","last_active":"2023-07-14T15:57:25.717498+0000","last_peered":"2023-07-14T15:57:25.717498+0000","last_clean":"2023-07-14T15:57:25.717498+0000","last_became_active":"2023-07-14T15:57:25.714840+0000","last_became_peered":"2023-07-14T15:57:25.714840+0000","last_unstale":"2023-07-14T15:57:25.717498+0000","last_undegraded":"2023-07-14T15:57:25.717498+0000","last_fullsized":"2023-07-14T15:57:25.717498+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:38:24.688175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170148+0000","last_change":"2023-07-14T15:57:25.710052+0000","last_active":"2023-07-14T15:57:27.170148+0000","last_peered":"2023-07-14T15:57:27.170148+0000","last_clean":"2023-07-14T15:57:27.170148+0000","last_became_active":"2023-07-14T15:57:25.709808+0000","last_became_peered":"2023-07-14T15:57:25.709808+0000","last_unstale":"2023-07-14T15:57:27.170148+0000","last_undegraded":"2023-07-14T15:57:27.170148+0000","last_fullsized":"2023-07-14T15:57:27.170148+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:19:01.933649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693904+0000","last_change":"2023-07-14T15:57:25.709747+0000","last_active":"2023-07-14T15:57:26.693904+0000","last_peered":"2023-07-14T15:57:26.693904+0000","last_clean":"2023-07-14T15:57:26.693904+0000","last_became_active":"2023-07-14T15:57:25.709442+0000","last_became_peered":"2023-07-14T15:57:25.709442+0000","last_unstale":"2023-07-14T15:57:26.693904+0000","last_undegraded":"2023-07-14T15:57:26.693904+0000","last_fullsized":"2023-07-14T15:57:26.693904+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:30:18.330946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.715604+0000","last_change":"2023-07-14T15:57:25.712207+0000","last_active":"2023-07-14T15:57:25.715604+0000","last_peered":"2023-07-14T15:57:25.715604+0000","last_clean":"2023-07-14T15:57:25.715604+0000","last_became_active":"2023-07-14T15:57:25.711936+0000","last_became_peered":"2023-07-14T15:57:25.711936+0000","last_unstale":"2023-07-14T15:57:25.715604+0000","last_undegraded":"2023-07-14T15:57:25.715604+0000","last_fullsized":"2023-07-14T15:57:25.715604+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:08:58.707250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694397+0000","last_change":"2023-07-14T15:57:25.711637+0000","last_active":"2023-07-14T15:57:26.694397+0000","last_peered":"2023-07-14T15:57:26.694397+0000","last_clean":"2023-07-14T15:57:26.694397+0000","last_became_active":"2023-07-14T15:57:25.710975+0000","last_became_peered":"2023-07-14T15:57:25.710975+0000","last_unstale":"2023-07-14T15:57:26.694397+0000","last_undegraded":"2023-07-14T15:57:26.694397+0000","last_fullsized":"2023-07-14T15:57:26.694397+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:24:11.251154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694300+0000","last_change":"2023-07-14T15:57:25.711476+0000","last_active":"2023-07-14T15:57:26.694300+0000","last_peered":"2023-07-14T15:57:26.694300+0000","last_clean":"2023-07-14T15:57:26.694300+0000","last_became_active":"2023-07-14T15:57:25.711204+0000","last_became_peered":"2023-07-14T15:57:25.711204+0000","last_unstale":"2023-07-14T15:57:26.694300+0000","last_undegraded":"2023-07-14T15:57:26.694300+0000","last_fullsized":"2023-07-14T15:57:26.694300+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:27:16.753361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694835+0000","last_change":"2023-07-14T15:57:25.715333+0000","last_active":"2023-07-14T15:57:26.694835+0000","last_peered":"2023-07-14T15:57:26.694835+0000","last_clean":"2023-07-14T15:57:26.694835+0000","last_became_active":"2023-07-14T15:57:25.715044+0000","last_became_peered":"2023-07-14T15:57:25.715044+0000","last_unstale":"2023-07-14T15:57:26.694835+0000","last_undegraded":"2023-07-14T15:57:26.694835+0000","last_fullsized":"2023-07-14T15:57:26.694835+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:13:09.841632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.079778+0000","last_change":"2023-07-14T15:57:25.710745+0000","last_active":"2023-07-14T15:57:27.079778+0000","last_peered":"2023-07-14T15:57:27.079778+0000","last_clean":"2023-07-14T15:57:27.079778+0000","last_became_active":"2023-07-14T15:57:25.710470+0000","last_became_peered":"2023-07-14T15:57:25.710470+0000","last_unstale":"2023-07-14T15:57:27.079778+0000","last_undegraded":"2023-07-14T15:57:27.079778+0000","last_fullsized":"2023-07-14T15:57:27.079778+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:50:07.191662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.079795+0000","last_change":"2023-07-14T15:57:25.707437+0000","last_active":"2023-07-14T15:57:27.079795+0000","last_peered":"2023-07-14T15:57:27.079795+0000","last_clean":"2023-07-14T15:57:27.079795+0000","last_became_active":"2023-07-14T15:57:25.707120+0000","last_became_peered":"2023-07-14T15:57:25.707120+0000","last_unstale":"2023-07-14T15:57:27.079795+0000","last_undegraded":"2023-07-14T15:57:27.079795+0000","last_fullsized":"2023-07-14T15:57:27.079795+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:43:47.530104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.079781+0000","last_change":"2023-07-14T15:57:25.711301+0000","last_active":"2023-07-14T15:57:27.079781+0000","last_peered":"2023-07-14T15:57:27.079781+0000","last_clean":"2023-07-14T15:57:27.079781+0000","last_became_active":"2023-07-14T15:57:25.710426+0000","last_became_peered":"2023-07-14T15:57:25.710426+0000","last_unstale":"2023-07-14T15:57:27.079781+0000","last_undegraded":"2023-07-14T15:57:27.079781+0000","last_fullsized":"2023-07-14T15:57:27.079781+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:25:29.672522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693910+0000","last_change":"2023-07-14T15:57:25.716297+0000","last_active":"2023-07-14T15:57:26.693910+0000","last_peered":"2023-07-14T15:57:26.693910+0000","last_clean":"2023-07-14T15:57:26.693910+0000","last_became_active":"2023-07-14T15:57:25.716028+0000","last_became_peered":"2023-07-14T15:57:25.716028+0000","last_unstale":"2023-07-14T15:57:26.693910+0000","last_undegraded":"2023-07-14T15:57:26.693910+0000","last_fullsized":"2023-07-14T15:57:26.693910+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:50:57.963143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693902+0000","last_change":"2023-07-14T15:57:25.707324+0000","last_active":"2023-07-14T15:57:26.693902+0000","last_peered":"2023-07-14T15:57:26.693902+0000","last_clean":"2023-07-14T15:57:26.693902+0000","last_became_active":"2023-07-14T15:57:25.706434+0000","last_became_peered":"2023-07-14T15:57:25.706434+0000","last_unstale":"2023-07-14T15:57:26.693902+0000","last_undegraded":"2023-07-14T15:57:26.693902+0000","last_fullsized":"2023-07-14T15:57:26.693902+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:15:31.939973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170401+0000","last_change":"2023-07-14T15:57:25.711970+0000","last_active":"2023-07-14T15:57:27.170401+0000","last_peered":"2023-07-14T15:57:27.170401+0000","last_clean":"2023-07-14T15:57:27.170401+0000","last_became_active":"2023-07-14T15:57:25.711620+0000","last_became_peered":"2023-07-14T15:57:25.711620+0000","last_unstale":"2023-07-14T15:57:27.170401+0000","last_undegraded":"2023-07-14T15:57:27.170401+0000","last_fullsized":"2023-07-14T15:57:27.170401+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:25:29.672522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694804+0000","last_change":"2023-07-14T15:57:25.704116+0000","last_active":"2023-07-14T15:57:26.694804+0000","last_peered":"2023-07-14T15:57:26.694804+0000","last_clean":"2023-07-14T15:57:26.694804+0000","last_became_active":"2023-07-14T15:57:25.703738+0000","last_became_peered":"2023-07-14T15:57:25.703738+0000","last_unstale":"2023-07-14T15:57:26.694804+0000","last_undegraded":"2023-07-14T15:57:26.694804+0000","last_fullsized":"2023-07-14T15:57:26.694804+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:59:26.269692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.080025+0000","last_change":"2023-07-14T15:57:25.716868+0000","last_active":"2023-07-14T15:57:27.080025+0000","last_peered":"2023-07-14T15:57:27.080025+0000","last_clean":"2023-07-14T15:57:27.080025+0000","last_became_active":"2023-07-14T15:57:25.714448+0000","last_became_peered":"2023-07-14T15:57:25.714448+0000","last_unstale":"2023-07-14T15:57:27.080025+0000","last_undegraded":"2023-07-14T15:57:27.080025+0000","last_fullsized":"2023-07-14T15:57:27.080025+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:11:14.971099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.715018+0000","last_change":"2023-07-14T15:57:25.707017+0000","last_active":"2023-07-14T15:57:25.715018+0000","last_peered":"2023-07-14T15:57:25.715018+0000","last_clean":"2023-07-14T15:57:25.715018+0000","last_became_active":"2023-07-14T15:57:25.706670+0000","last_became_peered":"2023-07-14T15:57:25.706670+0000","last_unstale":"2023-07-14T15:57:25.715018+0000","last_undegraded":"2023-07-14T15:57:25.715018+0000","last_fullsized":"2023-07-14T15:57:25.715018+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:37:34.881300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694039+0000","last_change":"2023-07-14T15:57:25.716158+0000","last_active":"2023-07-14T15:57:26.694039+0000","last_peered":"2023-07-14T15:57:26.694039+0000","last_clean":"2023-07-14T15:57:26.694039+0000","last_became_active":"2023-07-14T15:57:25.715850+0000","last_became_peered":"2023-07-14T15:57:25.715850+0000","last_unstale":"2023-07-14T15:57:26.694039+0000","last_undegraded":"2023-07-14T15:57:26.694039+0000","last_fullsized":"2023-07-14T15:57:26.694039+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:30:09.595831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694008+0000","last_change":"2023-07-14T15:57:25.708658+0000","last_active":"2023-07-14T15:57:26.694008+0000","last_peered":"2023-07-14T15:57:26.694008+0000","last_clean":"2023-07-14T15:57:26.694008+0000","last_became_active":"2023-07-14T15:57:25.708289+0000","last_became_peered":"2023-07-14T15:57:25.708289+0000","last_unstale":"2023-07-14T15:57:26.694008+0000","last_undegraded":"2023-07-14T15:57:26.694008+0000","last_fullsized":"2023-07-14T15:57:26.694008+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:20:54.175890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.717615+0000","last_change":"2023-07-14T15:57:25.713419+0000","last_active":"2023-07-14T15:57:25.717615+0000","last_peered":"2023-07-14T15:57:25.717615+0000","last_clean":"2023-07-14T15:57:25.717615+0000","last_became_active":"2023-07-14T15:57:25.713093+0000","last_became_peered":"2023-07-14T15:57:25.713093+0000","last_unstale":"2023-07-14T15:57:25.717615+0000","last_undegraded":"2023-07-14T15:57:25.717615+0000","last_fullsized":"2023-07-14T15:57:25.717615+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:00:49.136871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693994+0000","last_change":"2023-07-14T15:57:25.706580+0000","last_active":"2023-07-14T15:57:26.693994+0000","last_peered":"2023-07-14T15:57:26.693994+0000","last_clean":"2023-07-14T15:57:26.693994+0000","last_became_active":"2023-07-14T15:57:25.706059+0000","last_became_peered":"2023-07-14T15:57:25.706059+0000","last_unstale":"2023-07-14T15:57:26.693994+0000","last_undegraded":"2023-07-14T15:57:26.693994+0000","last_fullsized":"2023-07-14T15:57:26.693994+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:16:24.805508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694193+0000","last_change":"2023-07-14T15:57:25.706488+0000","last_active":"2023-07-14T15:57:26.694193+0000","last_peered":"2023-07-14T15:57:26.694193+0000","last_clean":"2023-07-14T15:57:26.694193+0000","last_became_active":"2023-07-14T15:57:25.706198+0000","last_became_peered":"2023-07-14T15:57:25.706198+0000","last_unstale":"2023-07-14T15:57:26.694193+0000","last_undegraded":"2023-07-14T15:57:26.694193+0000","last_fullsized":"2023-07-14T15:57:26.694193+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:38:44.179763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"35'4","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170540+0000","last_change":"2023-07-14T15:57:24.951038+0000","last_active":"2023-07-14T15:57:27.170540+0000","last_peered":"2023-07-14T15:57:27.170540+0000","last_clean":"2023-07-14T15:57:27.170540+0000","last_became_active":"2023-07-14T15:57:24.950729+0000","last_became_peered":"2023-07-14T15:57:24.950729+0000","last_unstale":"2023-07-14T15:57:27.170540+0000","last_undegraded":"2023-07-14T15:57:27.170540+0000","last_fullsized":"2023-07-14T15:57:27.170540+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:50:06.189560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.717685+0000","last_change":"2023-07-14T15:57:25.713457+0000","last_active":"2023-07-14T15:57:25.717685+0000","last_peered":"2023-07-14T15:57:25.717685+0000","last_clean":"2023-07-14T15:57:25.717685+0000","last_became_active":"2023-07-14T15:57:25.713153+0000","last_became_peered":"2023-07-14T15:57:25.713153+0000","last_unstale":"2023-07-14T15:57:25.717685+0000","last_undegraded":"2023-07-14T15:57:25.717685+0000","last_fullsized":"2023-07-14T15:57:25.717685+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:06:47.964048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"35'1","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.944686+0000","last_change":"2023-07-14T15:57:24.950846+0000","last_active":"2023-07-14T15:57:25.944686+0000","last_peered":"2023-07-14T15:57:25.944686+0000","last_clean":"2023-07-14T15:57:25.944686+0000","last_became_active":"2023-07-14T15:57:24.948195+0000","last_became_peered":"2023-07-14T15:57:24.948195+0000","last_unstale":"2023-07-14T15:57:25.944686+0000","last_undegraded":"2023-07-14T15:57:25.944686+0000","last_fullsized":"2023-07-14T15:57:25.944686+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:11:06.906742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694467+0000","last_change":"2023-07-14T15:57:25.706821+0000","last_active":"2023-07-14T15:57:26.694467+0000","last_peered":"2023-07-14T15:57:26.694467+0000","last_clean":"2023-07-14T15:57:26.694467+0000","last_became_active":"2023-07-14T15:57:25.706544+0000","last_became_peered":"2023-07-14T15:57:25.706544+0000","last_unstale":"2023-07-14T15:57:26.694467+0000","last_undegraded":"2023-07-14T15:57:26.694467+0000","last_fullsized":"2023-07-14T15:57:26.694467+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:57:14.558950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694334+0000","last_change":"2023-07-14T15:57:24.946400+0000","last_active":"2023-07-14T15:57:26.694334+0000","last_peered":"2023-07-14T15:57:26.694334+0000","last_clean":"2023-07-14T15:57:26.694334+0000","last_became_active":"2023-07-14T15:57:24.944268+0000","last_became_peered":"2023-07-14T15:57:24.944268+0000","last_unstale":"2023-07-14T15:57:26.694334+0000","last_undegraded":"2023-07-14T15:57:26.694334+0000","last_fullsized":"2023-07-14T15:57:26.694334+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:19:27.823719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.717611+0000","last_change":"2023-07-14T15:57:25.713045+0000","last_active":"2023-07-14T15:57:25.717611+0000","last_peered":"2023-07-14T15:57:25.717611+0000","last_clean":"2023-07-14T15:57:25.717611+0000","last_became_active":"2023-07-14T15:57:25.712719+0000","last_became_peered":"2023-07-14T15:57:25.712719+0000","last_unstale":"2023-07-14T15:57:25.717611+0000","last_undegraded":"2023-07-14T15:57:25.717611+0000","last_fullsized":"2023-07-14T15:57:25.717611+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:29:07.098880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170349+0000","last_change":"2023-07-14T15:57:24.949781+0000","last_active":"2023-07-14T15:57:27.170349+0000","last_peered":"2023-07-14T15:57:27.170349+0000","last_clean":"2023-07-14T15:57:27.170349+0000","last_became_active":"2023-07-14T15:57:24.949496+0000","last_became_peered":"2023-07-14T15:57:24.949496+0000","last_unstale":"2023-07-14T15:57:27.170349+0000","last_undegraded":"2023-07-14T15:57:27.170349+0000","last_fullsized":"2023-07-14T15:57:27.170349+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:38:12.937516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693738+0000","last_change":"2023-07-14T15:57:25.712413+0000","last_active":"2023-07-14T15:57:26.693738+0000","last_peered":"2023-07-14T15:57:26.693738+0000","last_clean":"2023-07-14T15:57:26.693738+0000","last_became_active":"2023-07-14T15:57:25.712153+0000","last_became_peered":"2023-07-14T15:57:25.712153+0000","last_unstale":"2023-07-14T15:57:26.693738+0000","last_undegraded":"2023-07-14T15:57:26.693738+0000","last_fullsized":"2023-07-14T15:57:26.693738+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:48:28.785668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"35'1","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170210+0000","last_change":"2023-07-14T15:57:24.946938+0000","last_active":"2023-07-14T15:57:27.170210+0000","last_peered":"2023-07-14T15:57:27.170210+0000","last_clean":"2023-07-14T15:57:27.170210+0000","last_became_active":"2023-07-14T15:57:24.946611+0000","last_became_peered":"2023-07-14T15:57:24.946611+0000","last_unstale":"2023-07-14T15:57:27.170210+0000","last_undegraded":"2023-07-14T15:57:27.170210+0000","last_fullsized":"2023-07-14T15:57:27.170210+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:03:29.027256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.079689+0000","last_change":"2023-07-14T15:57:25.711684+0000","last_active":"2023-07-14T15:57:27.079689+0000","last_peered":"2023-07-14T15:57:27.079689+0000","last_clean":"2023-07-14T15:57:27.079689+0000","last_became_active":"2023-07-14T15:57:25.710777+0000","last_became_peered":"2023-07-14T15:57:25.710777+0000","last_unstale":"2023-07-14T15:57:27.079689+0000","last_undegraded":"2023-07-14T15:57:27.079689+0000","last_fullsized":"2023-07-14T15:57:27.079689+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:38:13.939618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"35'1","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.941681+0000","last_change":"2023-07-14T15:57:24.952640+0000","last_active":"2023-07-14T15:57:25.941681+0000","last_peered":"2023-07-14T15:57:25.941681+0000","last_clean":"2023-07-14T15:57:25.941681+0000","last_became_active":"2023-07-14T15:57:24.952305+0000","last_became_peered":"2023-07-14T15:57:24.952305+0000","last_unstale":"2023-07-14T15:57:25.941681+0000","last_undegraded":"2023-07-14T15:57:25.941681+0000","last_fullsized":"2023-07-14T15:57:25.941681+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:54:38.765166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694294+0000","last_change":"2023-07-14T15:57:25.714100+0000","last_active":"2023-07-14T15:57:26.694294+0000","last_peered":"2023-07-14T15:57:26.694294+0000","last_clean":"2023-07-14T15:57:26.694294+0000","last_became_active":"2023-07-14T15:57:25.713850+0000","last_became_peered":"2023-07-14T15:57:25.713850+0000","last_unstale":"2023-07-14T15:57:26.694294+0000","last_undegraded":"2023-07-14T15:57:26.694294+0000","last_fullsized":"2023-07-14T15:57:26.694294+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:17:22.305947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693561+0000","last_change":"2023-07-14T15:57:24.944873+0000","last_active":"2023-07-14T15:57:26.693561+0000","last_peered":"2023-07-14T15:57:26.693561+0000","last_clean":"2023-07-14T15:57:26.693561+0000","last_became_active":"2023-07-14T15:57:24.944406+0000","last_became_peered":"2023-07-14T15:57:24.944406+0000","last_unstale":"2023-07-14T15:57:26.693561+0000","last_undegraded":"2023-07-14T15:57:26.693561+0000","last_fullsized":"2023-07-14T15:57:26.693561+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:27:08.642795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.717649+0000","last_change":"2023-07-14T15:57:25.713086+0000","last_active":"2023-07-14T15:57:25.717649+0000","last_peered":"2023-07-14T15:57:25.717649+0000","last_clean":"2023-07-14T15:57:25.717649+0000","last_became_active":"2023-07-14T15:57:25.712650+0000","last_became_peered":"2023-07-14T15:57:25.712650+0000","last_unstale":"2023-07-14T15:57:25.717649+0000","last_undegraded":"2023-07-14T15:57:25.717649+0000","last_fullsized":"2023-07-14T15:57:25.717649+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:21:41.043364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.694205+0000","last_change":"2023-07-14T15:57:24.946452+0000","last_active":"2023-07-14T15:57:25.694205+0000","last_peered":"2023-07-14T15:57:25.694205+0000","last_clean":"2023-07-14T15:57:25.694205+0000","last_became_active":"2023-07-14T15:57:24.946176+0000","last_became_peered":"2023-07-14T15:57:24.946176+0000","last_unstale":"2023-07-14T15:57:25.694205+0000","last_undegraded":"2023-07-14T15:57:25.694205+0000","last_fullsized":"2023-07-14T15:57:25.694205+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:53:48.975299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694391+0000","last_change":"2023-07-14T15:57:25.710818+0000","last_active":"2023-07-14T15:57:26.694391+0000","last_peered":"2023-07-14T15:57:26.694391+0000","last_clean":"2023-07-14T15:57:26.694391+0000","last_became_active":"2023-07-14T15:57:25.710212+0000","last_became_peered":"2023-07-14T15:57:25.710212+0000","last_unstale":"2023-07-14T15:57:26.694391+0000","last_undegraded":"2023-07-14T15:57:26.694391+0000","last_fullsized":"2023-07-14T15:57:26.694391+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:39:17.831626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694697+0000","last_change":"2023-07-14T15:57:24.949982+0000","last_active":"2023-07-14T15:57:26.694697+0000","last_peered":"2023-07-14T15:57:26.694697+0000","last_clean":"2023-07-14T15:57:26.694697+0000","last_became_active":"2023-07-14T15:57:24.949690+0000","last_became_peered":"2023-07-14T15:57:24.949690+0000","last_unstale":"2023-07-14T15:57:26.694697+0000","last_undegraded":"2023-07-14T15:57:26.694697+0000","last_fullsized":"2023-07-14T15:57:26.694697+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:06:06.625225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170316+0000","last_change":"2023-07-14T15:57:25.703650+0000","last_active":"2023-07-14T15:57:27.170316+0000","last_peered":"2023-07-14T15:57:27.170316+0000","last_clean":"2023-07-14T15:57:27.170316+0000","last_became_active":"2023-07-14T15:57:25.703366+0000","last_became_peered":"2023-07-14T15:57:25.703366+0000","last_unstale":"2023-07-14T15:57:27.170316+0000","last_undegraded":"2023-07-14T15:57:27.170316+0000","last_fullsized":"2023-07-14T15:57:27.170316+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:38:49.336628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694197+0000","last_change":"2023-07-14T15:57:24.949161+0000","last_active":"2023-07-14T15:57:26.694197+0000","last_peered":"2023-07-14T15:57:26.694197+0000","last_clean":"2023-07-14T15:57:26.694197+0000","last_became_active":"2023-07-14T15:57:24.948793+0000","last_became_peered":"2023-07-14T15:57:24.948793+0000","last_unstale":"2023-07-14T15:57:26.694197+0000","last_undegraded":"2023-07-14T15:57:26.694197+0000","last_fullsized":"2023-07-14T15:57:26.694197+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:40:33.570630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694750+0000","last_change":"2023-07-14T15:57:25.708172+0000","last_active":"2023-07-14T15:57:26.694750+0000","last_peered":"2023-07-14T15:57:26.694750+0000","last_clean":"2023-07-14T15:57:26.694750+0000","last_became_active":"2023-07-14T15:57:25.707852+0000","last_became_peered":"2023-07-14T15:57:25.707852+0000","last_unstale":"2023-07-14T15:57:26.694750+0000","last_undegraded":"2023-07-14T15:57:26.694750+0000","last_fullsized":"2023-07-14T15:57:26.694750+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:35:14.571116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"35'3","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694081+0000","last_change":"2023-07-14T15:57:24.943596+0000","last_active":"2023-07-14T15:57:26.694081+0000","last_peered":"2023-07-14T15:57:26.694081+0000","last_clean":"2023-07-14T15:57:26.694081+0000","last_became_active":"2023-07-14T15:57:24.943283+0000","last_became_peered":"2023-07-14T15:57:24.943283+0000","last_unstale":"2023-07-14T15:57:26.694081+0000","last_undegraded":"2023-07-14T15:57:26.694081+0000","last_fullsized":"2023-07-14T15:57:26.694081+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:59:41.480965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.701436+0000","last_change":"2023-07-14T15:57:25.700392+0000","last_active":"2023-07-14T15:57:25.701436+0000","last_peered":"2023-07-14T15:57:25.701436+0000","last_clean":"2023-07-14T15:57:25.701436+0000","last_became_active":"2023-07-14T15:57:25.700004+0000","last_became_peered":"2023-07-14T15:57:25.700004+0000","last_unstale":"2023-07-14T15:57:25.701436+0000","last_undegraded":"2023-07-14T15:57:25.701436+0000","last_fullsized":"2023-07-14T15:57:25.701436+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:19:12.695328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"35'6","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694419+0000","last_change":"2023-07-14T15:57:24.947031+0000","last_active":"2023-07-14T15:57:26.694419+0000","last_peered":"2023-07-14T15:57:26.694419+0000","last_clean":"2023-07-14T15:57:26.694419+0000","last_became_active":"2023-07-14T15:57:24.946757+0000","last_became_peered":"2023-07-14T15:57:24.946757+0000","last_unstale":"2023-07-14T15:57:26.694419+0000","last_undegraded":"2023-07-14T15:57:26.694419+0000","last_fullsized":"2023-07-14T15:57:26.694419+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:53:11.648125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693550+0000","last_change":"2023-07-14T15:57:25.707515+0000","last_active":"2023-07-14T15:57:26.693550+0000","last_peered":"2023-07-14T15:57:26.693550+0000","last_clean":"2023-07-14T15:57:26.693550+0000","last_became_active":"2023-07-14T15:57:25.706851+0000","last_became_peered":"2023-07-14T15:57:25.706851+0000","last_unstale":"2023-07-14T15:57:26.693550+0000","last_undegraded":"2023-07-14T15:57:26.693550+0000","last_fullsized":"2023-07-14T15:57:26.693550+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:32:43.868693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693711+0000","last_change":"2023-07-14T15:57:24.950415+0000","last_active":"2023-07-14T15:57:26.693711+0000","last_peered":"2023-07-14T15:57:26.693711+0000","last_clean":"2023-07-14T15:57:26.693711+0000","last_became_active":"2023-07-14T15:57:24.950096+0000","last_became_peered":"2023-07-14T15:57:24.950096+0000","last_unstale":"2023-07-14T15:57:26.693711+0000","last_undegraded":"2023-07-14T15:57:26.693711+0000","last_fullsized":"2023-07-14T15:57:26.693711+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:40:32.381876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.717469+0000","last_change":"2023-07-14T15:57:25.709485+0000","last_active":"2023-07-14T15:57:25.717469+0000","last_peered":"2023-07-14T15:57:25.717469+0000","last_clean":"2023-07-14T15:57:25.717469+0000","last_became_active":"2023-07-14T15:57:25.709177+0000","last_became_peered":"2023-07-14T15:57:25.709177+0000","last_unstale":"2023-07-14T15:57:25.717469+0000","last_undegraded":"2023-07-14T15:57:25.717469+0000","last_fullsized":"2023-07-14T15:57:25.717469+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:26:49.722181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.703812+0000","last_change":"2023-07-14T15:57:24.950482+0000","last_active":"2023-07-14T15:57:25.703812+0000","last_peered":"2023-07-14T15:57:25.703812+0000","last_clean":"2023-07-14T15:57:25.703812+0000","last_became_active":"2023-07-14T15:57:24.950222+0000","last_became_peered":"2023-07-14T15:57:24.950222+0000","last_unstale":"2023-07-14T15:57:25.703812+0000","last_undegraded":"2023-07-14T15:57:25.703812+0000","last_fullsized":"2023-07-14T15:57:25.703812+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:02:33.348436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.079793+0000","last_change":"2023-07-14T15:57:25.711446+0000","last_active":"2023-07-14T15:57:27.079793+0000","last_peered":"2023-07-14T15:57:27.079793+0000","last_clean":"2023-07-14T15:57:27.079793+0000","last_became_active":"2023-07-14T15:57:25.710394+0000","last_became_peered":"2023-07-14T15:57:25.710394+0000","last_unstale":"2023-07-14T15:57:27.079793+0000","last_undegraded":"2023-07-14T15:57:27.079793+0000","last_fullsized":"2023-07-14T15:57:27.079793+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:13:07.610735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694231+0000","last_change":"2023-07-14T15:57:24.948415+0000","last_active":"2023-07-14T15:57:26.694231+0000","last_peered":"2023-07-14T15:57:26.694231+0000","last_clean":"2023-07-14T15:57:26.694231+0000","last_became_active":"2023-07-14T15:57:24.947719+0000","last_became_peered":"2023-07-14T15:57:24.947719+0000","last_unstale":"2023-07-14T15:57:26.694231+0000","last_undegraded":"2023-07-14T15:57:26.694231+0000","last_fullsized":"2023-07-14T15:57:26.694231+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:08:13.930103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.076982+0000","last_change":"2023-07-14T15:57:25.710816+0000","last_active":"2023-07-14T15:57:27.076982+0000","last_peered":"2023-07-14T15:57:27.076982+0000","last_clean":"2023-07-14T15:57:27.076982+0000","last_became_active":"2023-07-14T15:57:25.710525+0000","last_became_peered":"2023-07-14T15:57:25.710525+0000","last_unstale":"2023-07-14T15:57:27.076982+0000","last_undegraded":"2023-07-14T15:57:27.076982+0000","last_fullsized":"2023-07-14T15:57:27.076982+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:54:39.767268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"35'8","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170313+0000","last_change":"2023-07-14T15:57:24.949662+0000","last_active":"2023-07-14T15:57:27.170313+0000","last_peered":"2023-07-14T15:57:27.170313+0000","last_clean":"2023-07-14T15:57:27.170313+0000","last_became_active":"2023-07-14T15:57:24.949145+0000","last_became_peered":"2023-07-14T15:57:24.949145+0000","last_unstale":"2023-07-14T15:57:27.170313+0000","last_undegraded":"2023-07-14T15:57:27.170313+0000","last_fullsized":"2023-07-14T15:57:27.170313+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:41:33.784826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.714329+0000","last_change":"2023-07-14T15:57:25.708735+0000","last_active":"2023-07-14T15:57:25.714329+0000","last_peered":"2023-07-14T15:57:25.714329+0000","last_clean":"2023-07-14T15:57:25.714329+0000","last_became_active":"2023-07-14T15:57:25.708251+0000","last_became_peered":"2023-07-14T15:57:25.708251+0000","last_unstale":"2023-07-14T15:57:25.714329+0000","last_undegraded":"2023-07-14T15:57:25.714329+0000","last_fullsized":"2023-07-14T15:57:25.714329+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:48:43.914128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"35'1","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.944067+0000","last_change":"2023-07-14T15:57:24.950806+0000","last_active":"2023-07-14T15:57:25.944067+0000","last_peered":"2023-07-14T15:57:25.944067+0000","last_clean":"2023-07-14T15:57:25.944067+0000","last_became_active":"2023-07-14T15:57:24.950499+0000","last_became_peered":"2023-07-14T15:57:24.950499+0000","last_unstale":"2023-07-14T15:57:25.944067+0000","last_undegraded":"2023-07-14T15:57:25.944067+0000","last_fullsized":"2023-07-14T15:57:25.944067+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:44:44.559996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.715713+0000","last_change":"2023-07-14T15:57:25.707810+0000","last_active":"2023-07-14T15:57:25.715713+0000","last_peered":"2023-07-14T15:57:25.715713+0000","last_clean":"2023-07-14T15:57:25.715713+0000","last_became_active":"2023-07-14T15:57:25.707540+0000","last_became_peered":"2023-07-14T15:57:25.707540+0000","last_unstale":"2023-07-14T15:57:25.715713+0000","last_undegraded":"2023-07-14T15:57:25.715713+0000","last_fullsized":"2023-07-14T15:57:25.715713+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:47:29.092265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694350+0000","last_change":"2023-07-14T15:57:24.943847+0000","last_active":"2023-07-14T15:57:26.694350+0000","last_peered":"2023-07-14T15:57:26.694350+0000","last_clean":"2023-07-14T15:57:26.694350+0000","last_became_active":"2023-07-14T15:57:24.943377+0000","last_became_peered":"2023-07-14T15:57:24.943377+0000","last_unstale":"2023-07-14T15:57:26.694350+0000","last_undegraded":"2023-07-14T15:57:26.694350+0000","last_fullsized":"2023-07-14T15:57:26.694350+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:15:32.247155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.717587+0000","last_change":"2023-07-14T15:57:25.713671+0000","last_active":"2023-07-14T15:57:25.717587+0000","last_peered":"2023-07-14T15:57:25.717587+0000","last_clean":"2023-07-14T15:57:25.717587+0000","last_became_active":"2023-07-14T15:57:25.713277+0000","last_became_peered":"2023-07-14T15:57:25.713277+0000","last_unstale":"2023-07-14T15:57:25.717587+0000","last_undegraded":"2023-07-14T15:57:25.717587+0000","last_fullsized":"2023-07-14T15:57:25.717587+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:50:51.047340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"35'1","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.077142+0000","last_change":"2023-07-14T15:57:24.947575+0000","last_active":"2023-07-14T15:57:27.077142+0000","last_peered":"2023-07-14T15:57:27.077142+0000","last_clean":"2023-07-14T15:57:27.077142+0000","last_became_active":"2023-07-14T15:57:24.947236+0000","last_became_peered":"2023-07-14T15:57:24.947236+0000","last_unstale":"2023-07-14T15:57:27.077142+0000","last_undegraded":"2023-07-14T15:57:27.077142+0000","last_fullsized":"2023-07-14T15:57:27.077142+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:37:33.879198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694961+0000","last_change":"2023-07-14T15:57:25.715669+0000","last_active":"2023-07-14T15:57:26.694961+0000","last_peered":"2023-07-14T15:57:26.694961+0000","last_clean":"2023-07-14T15:57:26.694961+0000","last_became_active":"2023-07-14T15:57:25.715414+0000","last_became_peered":"2023-07-14T15:57:25.715414+0000","last_unstale":"2023-07-14T15:57:26.694961+0000","last_undegraded":"2023-07-14T15:57:26.694961+0000","last_fullsized":"2023-07-14T15:57:26.694961+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:11:15.367018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694919+0000","last_change":"2023-07-14T15:57:24.946879+0000","last_active":"2023-07-14T15:57:26.694919+0000","last_peered":"2023-07-14T15:57:26.694919+0000","last_clean":"2023-07-14T15:57:26.694919+0000","last_became_active":"2023-07-14T15:57:24.946470+0000","last_became_peered":"2023-07-14T15:57:24.946470+0000","last_unstale":"2023-07-14T15:57:26.694919+0000","last_undegraded":"2023-07-14T15:57:26.694919+0000","last_fullsized":"2023-07-14T15:57:26.694919+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:24:27.076859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693801+0000","last_change":"2023-07-14T15:57:25.709753+0000","last_active":"2023-07-14T15:57:26.693801+0000","last_peered":"2023-07-14T15:57:26.693801+0000","last_clean":"2023-07-14T15:57:26.693801+0000","last_became_active":"2023-07-14T15:57:25.709467+0000","last_became_peered":"2023-07-14T15:57:25.709467+0000","last_unstale":"2023-07-14T15:57:26.693801+0000","last_undegraded":"2023-07-14T15:57:26.693801+0000","last_fullsized":"2023-07-14T15:57:26.693801+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:54:59.872919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694767+0000","last_change":"2023-07-14T15:57:24.942184+0000","last_active":"2023-07-14T15:57:26.694767+0000","last_peered":"2023-07-14T15:57:26.694767+0000","last_clean":"2023-07-14T15:57:26.694767+0000","last_became_active":"2023-07-14T15:57:24.941875+0000","last_became_peered":"2023-07-14T15:57:24.941875+0000","last_unstale":"2023-07-14T15:57:26.694767+0000","last_undegraded":"2023-07-14T15:57:26.694767+0000","last_fullsized":"2023-07-14T15:57:26.694767+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:52:45.470519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693423+0000","last_change":"2023-07-14T15:57:25.704418+0000","last_active":"2023-07-14T15:57:26.693423+0000","last_peered":"2023-07-14T15:57:26.693423+0000","last_clean":"2023-07-14T15:57:26.693423+0000","last_became_active":"2023-07-14T15:57:25.704119+0000","last_became_peered":"2023-07-14T15:57:25.704119+0000","last_unstale":"2023-07-14T15:57:26.693423+0000","last_undegraded":"2023-07-14T15:57:26.693423+0000","last_fullsized":"2023-07-14T15:57:26.693423+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:45:31.081120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.704009+0000","last_change":"2023-07-14T15:57:24.949131+0000","last_active":"2023-07-14T15:57:25.704009+0000","last_peered":"2023-07-14T15:57:25.704009+0000","last_clean":"2023-07-14T15:57:25.704009+0000","last_became_active":"2023-07-14T15:57:24.948700+0000","last_became_peered":"2023-07-14T15:57:24.948700+0000","last_unstale":"2023-07-14T15:57:25.704009+0000","last_undegraded":"2023-07-14T15:57:25.704009+0000","last_fullsized":"2023-07-14T15:57:25.704009+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:05:50.727388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.079927+0000","last_change":"2023-07-14T15:57:25.702410+0000","last_active":"2023-07-14T15:57:27.079927+0000","last_peered":"2023-07-14T15:57:27.079927+0000","last_clean":"2023-07-14T15:57:27.079927+0000","last_became_active":"2023-07-14T15:57:25.701678+0000","last_became_peered":"2023-07-14T15:57:25.701678+0000","last_unstale":"2023-07-14T15:57:27.079927+0000","last_undegraded":"2023-07-14T15:57:27.079927+0000","last_fullsized":"2023-07-14T15:57:27.079927+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:16:17.080122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.695691+0000","last_change":"2023-07-14T15:57:24.950805+0000","last_active":"2023-07-14T15:57:25.695691+0000","last_peered":"2023-07-14T15:57:25.695691+0000","last_clean":"2023-07-14T15:57:25.695691+0000","last_became_active":"2023-07-14T15:57:24.950510+0000","last_became_peered":"2023-07-14T15:57:24.950510+0000","last_unstale":"2023-07-14T15:57:25.695691+0000","last_undegraded":"2023-07-14T15:57:25.695691+0000","last_fullsized":"2023-07-14T15:57:25.695691+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:10:30.682698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693849+0000","last_change":"2023-07-14T15:57:25.704591+0000","last_active":"2023-07-14T15:57:26.693849+0000","last_peered":"2023-07-14T15:57:26.693849+0000","last_clean":"2023-07-14T15:57:26.693849+0000","last_became_active":"2023-07-14T15:57:25.704350+0000","last_became_peered":"2023-07-14T15:57:25.704350+0000","last_unstale":"2023-07-14T15:57:26.693849+0000","last_undegraded":"2023-07-14T15:57:26.693849+0000","last_fullsized":"2023-07-14T15:57:26.693849+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:22:31.192902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.703273+0000","last_change":"2023-07-14T15:57:24.949538+0000","last_active":"2023-07-14T15:57:25.703273+0000","last_peered":"2023-07-14T15:57:25.703273+0000","last_clean":"2023-07-14T15:57:25.703273+0000","last_became_active":"2023-07-14T15:57:24.949233+0000","last_became_peered":"2023-07-14T15:57:24.949233+0000","last_unstale":"2023-07-14T15:57:25.703273+0000","last_undegraded":"2023-07-14T15:57:25.703273+0000","last_fullsized":"2023-07-14T15:57:25.703273+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:24:23.085848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.076745+0000","last_change":"2023-07-14T15:57:25.707893+0000","last_active":"2023-07-14T15:57:27.076745+0000","last_peered":"2023-07-14T15:57:27.076745+0000","last_clean":"2023-07-14T15:57:27.076745+0000","last_became_active":"2023-07-14T15:57:25.707515+0000","last_became_peered":"2023-07-14T15:57:25.707515+0000","last_unstale":"2023-07-14T15:57:27.076745+0000","last_undegraded":"2023-07-14T15:57:27.076745+0000","last_fullsized":"2023-07-14T15:57:27.076745+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:13:20.474319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693948+0000","last_change":"2023-07-14T15:57:24.944835+0000","last_active":"2023-07-14T15:57:26.693948+0000","last_peered":"2023-07-14T15:57:26.693948+0000","last_clean":"2023-07-14T15:57:26.693948+0000","last_became_active":"2023-07-14T15:57:24.944421+0000","last_became_peered":"2023-07-14T15:57:24.944421+0000","last_unstale":"2023-07-14T15:57:26.693948+0000","last_undegraded":"2023-07-14T15:57:26.693948+0000","last_fullsized":"2023-07-14T15:57:26.693948+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:36:20.633161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694805+0000","last_change":"2023-07-14T15:56:02.621850+0000","last_active":"2023-07-14T15:57:26.694805+0000","last_peered":"2023-07-14T15:57:26.694805+0000","last_clean":"2023-07-14T15:57:26.694805+0000","last_became_active":"2023-07-14T15:56:02.621471+0000","last_became_peered":"2023-07-14T15:56:02.621471+0000","last_unstale":"2023-07-14T15:57:26.694805+0000","last_undegraded":"2023-07-14T15:57:26.694805+0000","last_fullsized":"2023-07-14T15:57:26.694805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:31:52.328091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694678+0000","last_change":"2023-07-14T15:57:25.717543+0000","last_active":"2023-07-14T15:57:26.694678+0000","last_peered":"2023-07-14T15:57:26.694678+0000","last_clean":"2023-07-14T15:57:26.694678+0000","last_became_active":"2023-07-14T15:57:25.717185+0000","last_became_peered":"2023-07-14T15:57:25.717185+0000","last_unstale":"2023-07-14T15:57:26.694678+0000","last_undegraded":"2023-07-14T15:57:26.694678+0000","last_fullsized":"2023-07-14T15:57:26.694678+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:54:28.947637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.077156+0000","last_change":"2023-07-14T15:57:24.943282+0000","last_active":"2023-07-14T15:57:27.077156+0000","last_peered":"2023-07-14T15:57:27.077156+0000","last_clean":"2023-07-14T15:57:27.077156+0000","last_became_active":"2023-07-14T15:57:24.942964+0000","last_became_peered":"2023-07-14T15:57:24.942964+0000","last_unstale":"2023-07-14T15:57:27.077156+0000","last_undegraded":"2023-07-14T15:57:27.077156+0000","last_fullsized":"2023-07-14T15:57:27.077156+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:50:50.045238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694297+0000","last_change":"2023-07-14T15:56:02.621963+0000","last_active":"2023-07-14T15:57:26.694297+0000","last_peered":"2023-07-14T15:57:26.694297+0000","last_clean":"2023-07-14T15:57:26.694297+0000","last_became_active":"2023-07-14T15:56:02.621678+0000","last_became_peered":"2023-07-14T15:56:02.621678+0000","last_unstale":"2023-07-14T15:57:26.694297+0000","last_undegraded":"2023-07-14T15:57:26.694297+0000","last_fullsized":"2023-07-14T15:57:26.694297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:13:35.392704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.079851+0000","last_change":"2023-07-14T15:57:25.702765+0000","last_active":"2023-07-14T15:57:27.079851+0000","last_peered":"2023-07-14T15:57:27.079851+0000","last_clean":"2023-07-14T15:57:27.079851+0000","last_became_active":"2023-07-14T15:57:25.702508+0000","last_became_peered":"2023-07-14T15:57:25.702508+0000","last_unstale":"2023-07-14T15:57:27.079851+0000","last_undegraded":"2023-07-14T15:57:27.079851+0000","last_fullsized":"2023-07-14T15:57:27.079851+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:18:05.260347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"36'1","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.078951+0000","last_change":"2023-07-14T15:57:24.945667+0000","last_active":"2023-07-14T15:57:27.078951+0000","last_peered":"2023-07-14T15:57:27.078951+0000","last_clean":"2023-07-14T15:57:27.078951+0000","last_became_active":"2023-07-14T15:57:24.945404+0000","last_became_peered":"2023-07-14T15:57:24.945404+0000","last_unstale":"2023-07-14T15:57:27.078951+0000","last_undegraded":"2023-07-14T15:57:27.078951+0000","last_fullsized":"2023-07-14T15:57:27.078951+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:38:23.686073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.076753+0000","last_change":"2023-07-14T15:56:01.925110+0000","last_active":"2023-07-14T15:57:27.076753+0000","last_peered":"2023-07-14T15:57:27.076753+0000","last_clean":"2023-07-14T15:57:27.076753+0000","last_became_active":"2023-07-14T15:56:01.924723+0000","last_became_peered":"2023-07-14T15:56:01.924723+0000","last_unstale":"2023-07-14T15:57:27.076753+0000","last_undegraded":"2023-07-14T15:57:27.076753+0000","last_fullsized":"2023-07-14T15:57:27.076753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:03:05.866904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694461+0000","last_change":"2023-07-14T15:57:25.711424+0000","last_active":"2023-07-14T15:57:26.694461+0000","last_peered":"2023-07-14T15:57:26.694461+0000","last_clean":"2023-07-14T15:57:26.694461+0000","last_became_active":"2023-07-14T15:57:25.710670+0000","last_became_peered":"2023-07-14T15:57:25.710670+0000","last_unstale":"2023-07-14T15:57:26.694461+0000","last_undegraded":"2023-07-14T15:57:26.694461+0000","last_fullsized":"2023-07-14T15:57:26.694461+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:25:01.452256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.079891+0000","last_change":"2023-07-14T15:57:24.943746+0000","last_active":"2023-07-14T15:57:27.079891+0000","last_peered":"2023-07-14T15:57:27.079891+0000","last_clean":"2023-07-14T15:57:27.079891+0000","last_became_active":"2023-07-14T15:57:24.943464+0000","last_became_peered":"2023-07-14T15:57:24.943464+0000","last_unstale":"2023-07-14T15:57:27.079891+0000","last_undegraded":"2023-07-14T15:57:27.079891+0000","last_fullsized":"2023-07-14T15:57:27.079891+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:56:11.761557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693926+0000","last_change":"2023-07-14T15:56:01.923465+0000","last_active":"2023-07-14T15:57:26.693926+0000","last_peered":"2023-07-14T15:57:26.693926+0000","last_clean":"2023-07-14T15:57:26.693926+0000","last_became_active":"2023-07-14T15:56:01.923160+0000","last_became_peered":"2023-07-14T15:56:01.923160+0000","last_unstale":"2023-07-14T15:57:26.693926+0000","last_undegraded":"2023-07-14T15:57:26.693926+0000","last_fullsized":"2023-07-14T15:57:26.693926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:59:26.813576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":189,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.694308+0000","last_change":"2023-07-14T15:55:54.040065+0000","last_active":"2023-07-14T15:57:25.694308+0000","last_peered":"2023-07-14T15:57:25.694308+0000","last_clean":"2023-07-14T15:57:25.694308+0000","last_became_active":"2023-07-14T15:55:54.038885+0000","last_became_peered":"2023-07-14T15:55:54.038885+0000","last_unstale":"2023-07-14T15:57:25.694308+0000","last_undegraded":"2023-07-14T15:57:25.694308+0000","last_fullsized":"2023-07-14T15:57:25.694308+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:55:53.025696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:55:53.025696+0000","last_clean_scrub_stamp":"2023-07-14T15:55:53.025696+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:23:24.719178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.076975+0000","last_change":"2023-07-14T15:57:25.703197+0000","last_active":"2023-07-14T15:57:27.076975+0000","last_peered":"2023-07-14T15:57:27.076975+0000","last_clean":"2023-07-14T15:57:27.076975+0000","last_became_active":"2023-07-14T15:57:25.702875+0000","last_became_peered":"2023-07-14T15:57:25.702875+0000","last_unstale":"2023-07-14T15:57:27.076975+0000","last_undegraded":"2023-07-14T15:57:27.076975+0000","last_fullsized":"2023-07-14T15:57:27.076975+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:00:49.136871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694484+0000","last_change":"2023-07-14T15:57:24.945870+0000","last_active":"2023-07-14T15:57:26.694484+0000","last_peered":"2023-07-14T15:57:26.694484+0000","last_clean":"2023-07-14T15:57:26.694484+0000","last_became_active":"2023-07-14T15:57:24.945590+0000","last_became_peered":"2023-07-14T15:57:24.945590+0000","last_unstale":"2023-07-14T15:57:26.694484+0000","last_undegraded":"2023-07-14T15:57:26.694484+0000","last_fullsized":"2023-07-14T15:57:26.694484+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:26:43.460807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693733+0000","last_change":"2023-07-14T15:56:01.920714+0000","last_active":"2023-07-14T15:57:26.693733+0000","last_peered":"2023-07-14T15:57:26.693733+0000","last_clean":"2023-07-14T15:57:26.693733+0000","last_became_active":"2023-07-14T15:56:01.920325+0000","last_became_peered":"2023-07-14T15:56:01.920325+0000","last_unstale":"2023-07-14T15:57:26.693733+0000","last_undegraded":"2023-07-14T15:57:26.693733+0000","last_fullsized":"2023-07-14T15:57:26.693733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:34:47.858129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T15:57:25.719013+0000","last_change":"2023-07-14T15:57:25.716751+0000","last_active":"2023-07-14T15:57:25.719013+0000","last_peered":"2023-07-14T15:57:25.719013+0000","last_clean":"2023-07-14T15:57:25.719013+0000","last_became_active":"2023-07-14T15:57:25.716471+0000","last_became_peered":"2023-07-14T15:57:25.716471+0000","last_unstale":"2023-07-14T15:57:25.719013+0000","last_undegraded":"2023-07-14T15:57:25.719013+0000","last_fullsized":"2023-07-14T15:57:25.719013+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:47:07.841527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.079980+0000","last_change":"2023-07-14T15:57:24.943010+0000","last_active":"2023-07-14T15:57:27.079980+0000","last_peered":"2023-07-14T15:57:27.079980+0000","last_clean":"2023-07-14T15:57:27.079980+0000","last_became_active":"2023-07-14T15:57:24.942673+0000","last_became_peered":"2023-07-14T15:57:24.942673+0000","last_unstale":"2023-07-14T15:57:27.079980+0000","last_undegraded":"2023-07-14T15:57:27.079980+0000","last_fullsized":"2023-07-14T15:57:27.079980+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:26:16.015035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694065+0000","last_change":"2023-07-14T15:56:01.923631+0000","last_active":"2023-07-14T15:57:26.694065+0000","last_peered":"2023-07-14T15:57:26.694065+0000","last_clean":"2023-07-14T15:57:26.694065+0000","last_became_active":"2023-07-14T15:56:01.922783+0000","last_became_peered":"2023-07-14T15:56:01.922783+0000","last_unstale":"2023-07-14T15:57:26.694065+0000","last_undegraded":"2023-07-14T15:57:26.694065+0000","last_fullsized":"2023-07-14T15:57:26.694065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:31:16.123367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694160+0000","last_change":"2023-07-14T15:57:25.715467+0000","last_active":"2023-07-14T15:57:26.694160+0000","last_peered":"2023-07-14T15:57:26.694160+0000","last_clean":"2023-07-14T15:57:26.694160+0000","last_became_active":"2023-07-14T15:57:25.715169+0000","last_became_peered":"2023-07-14T15:57:25.715169+0000","last_unstale":"2023-07-14T15:57:26.694160+0000","last_undegraded":"2023-07-14T15:57:26.694160+0000","last_fullsized":"2023-07-14T15:57:26.694160+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:18:30.445378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694374+0000","last_change":"2023-07-14T15:57:24.948604+0000","last_active":"2023-07-14T15:57:26.694374+0000","last_peered":"2023-07-14T15:57:26.694374+0000","last_clean":"2023-07-14T15:57:26.694374+0000","last_became_active":"2023-07-14T15:57:24.948128+0000","last_became_peered":"2023-07-14T15:57:24.948128+0000","last_unstale":"2023-07-14T15:57:26.694374+0000","last_undegraded":"2023-07-14T15:57:26.694374+0000","last_fullsized":"2023-07-14T15:57:26.694374+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:56:33.930892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694844+0000","last_change":"2023-07-14T15:56:01.965649+0000","last_active":"2023-07-14T15:57:26.694844+0000","last_peered":"2023-07-14T15:57:26.694844+0000","last_clean":"2023-07-14T15:57:26.694844+0000","last_became_active":"2023-07-14T15:56:01.965344+0000","last_became_peered":"2023-07-14T15:56:01.965344+0000","last_unstale":"2023-07-14T15:57:26.694844+0000","last_undegraded":"2023-07-14T15:57:26.694844+0000","last_fullsized":"2023-07-14T15:57:26.694844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:30:36.061855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.079965+0000","last_change":"2023-07-14T15:57:25.714552+0000","last_active":"2023-07-14T15:57:27.079965+0000","last_peered":"2023-07-14T15:57:27.079965+0000","last_clean":"2023-07-14T15:57:27.079965+0000","last_became_active":"2023-07-14T15:57:25.713523+0000","last_became_peered":"2023-07-14T15:57:25.713523+0000","last_unstale":"2023-07-14T15:57:27.079965+0000","last_undegraded":"2023-07-14T15:57:27.079965+0000","last_fullsized":"2023-07-14T15:57:27.079965+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:58:44.095117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693419+0000","last_change":"2023-07-14T15:57:24.948449+0000","last_active":"2023-07-14T15:57:26.693419+0000","last_peered":"2023-07-14T15:57:26.693419+0000","last_clean":"2023-07-14T15:57:26.693419+0000","last_became_active":"2023-07-14T15:57:24.948145+0000","last_became_peered":"2023-07-14T15:57:24.948145+0000","last_unstale":"2023-07-14T15:57:26.693419+0000","last_undegraded":"2023-07-14T15:57:26.693419+0000","last_fullsized":"2023-07-14T15:57:26.693419+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:43:28.358856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694508+0000","last_change":"2023-07-14T15:56:01.966578+0000","last_active":"2023-07-14T15:57:26.694508+0000","last_peered":"2023-07-14T15:57:26.694508+0000","last_clean":"2023-07-14T15:57:26.694508+0000","last_became_active":"2023-07-14T15:56:01.966216+0000","last_became_peered":"2023-07-14T15:56:01.966216+0000","last_unstale":"2023-07-14T15:57:26.694508+0000","last_undegraded":"2023-07-14T15:57:26.694508+0000","last_fullsized":"2023-07-14T15:57:26.694508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:34:54.823729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476759,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":401408,"data_stored":162350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.35699999999999998}]},{"osd":1,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.48399999999999999}]},{"osd":2,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.57199999999999995}]},{"osd":4,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.59199999999999997}]},{"osd":5,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.73999999999999999}]},{"osd":6,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.61099999999999999}]},{"osd":7,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.629}]}]},{"osd":0,"up_from":16,"seq":68719476760,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":396,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":405504,"data_stored":162352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.501},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.57699999999999996}]},{"osd":2,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.626}]},{"osd":3,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.74199999999999999}]},{"osd":4,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.78400000000000003}]},{"osd":5,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.66900000000000004}]},{"osd":6,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.90800000000000003}]},{"osd":7,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.88900000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542166,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":389120,"data_stored":155641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.65200000000000002}]},{"osd":1,"last update":"Fri Jul 14 15:56:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.76600000000000001}]},{"osd":2,"last update":"Fri Jul 14 15:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.87}]},{"osd":3,"last update":"Fri Jul 14 15:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":3.141,"5min":3.141,"15min":3.141},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.88800000000000001}]},{"osd":4,"last update":"Fri Jul 14 15:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.72399999999999998}]},{"osd":5,"last update":"Fri Jul 14 15:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.94499999999999995}]},{"osd":7,"last update":"Fri Jul 14 15:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.90800000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542165,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32008,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339832,"statfs":{"total":96636764160,"available":96603987968,"internally_reserved":0,"allocated":983040,"data_stored":745997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":4.5519999999999996,"5min":4.5519999999999996,"15min":4.5519999999999996},"last":0.39400000000000002},{"interface":"front","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":15.911,"5min":15.911,"15min":15.911},"last":0.46800000000000003}]},{"osd":2,"last update":"Fri Jul 14 15:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":4.5140000000000002,"5min":4.5140000000000002,"15min":4.5140000000000002},"last":0.44800000000000001}]},{"osd":3,"last update":"Fri Jul 14 15:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":4.452,"5min":4.452,"15min":4.452},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":4.2279999999999998,"5min":4.2279999999999998,"15min":4.2279999999999998},"last":0.42599999999999999}]},{"osd":4,"last update":"Fri Jul 14 15:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":4.6200000000000001,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":4.9109999999999996,"5min":4.9109999999999996,"15min":4.9109999999999996},"last":0.69399999999999995}]},{"osd":5,"last update":"Fri Jul 14 15:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":4.1269999999999998,"5min":4.1269999999999998,"15min":4.1269999999999998},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":4.585,"5min":4.585,"15min":4.585},"last":0.64000000000000001}]},{"osd":6,"last update":"Fri Jul 14 15:56:51 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":4.9880000000000004,"5min":4.9880000000000004,"15min":4.9880000000000004},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":4.1660000000000004,"5min":4.1660000000000004,"15min":4.1660000000000004},"last":0.68100000000000005}]},{"osd":7,"last update":"Fri Jul 14 15:56:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":4.9530000000000003,"5min":4.9530000000000003,"15min":4.9530000000000003},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":4.1959999999999997,"5min":4.1959999999999997,"15min":4.1959999999999997},"last":0.61799999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509463,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":413696,"data_stored":164406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:56:53 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.437}]},{"osd":1,"last update":"Fri Jul 14 15:56:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.315},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.46899999999999997}]},{"osd":3,"last update":"Fri Jul 14 15:56:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.498}]},{"osd":4,"last update":"Fri Jul 14 15:56:53 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.72699999999999998}]},{"osd":5,"last update":"Fri Jul 14 15:56:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.60999999999999999}]},{"osd":6,"last update":"Fri Jul 14 15:56:53 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.64600000000000002}]},{"osd":7,"last update":"Fri Jul 14 15:56:53 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.71099999999999997}]}]},{"osd":4,"up_from":15,"seq":64424509462,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":408,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":417792,"data_stored":163948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.88300000000000001}]},{"osd":1,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.748},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.82899999999999996}]},{"osd":2,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.80200000000000005}]},{"osd":3,"last update":"Fri Jul 14 15:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.94299999999999995}]},{"osd":5,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.84299999999999997}]},{"osd":6,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.63700000000000001}]},{"osd":7,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.61499999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509464,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27924,"kb_used_data":972,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343916,"statfs":{"total":96636764160,"available":96608169984,"internally_reserved":0,"allocated":995328,"data_stored":753210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":8.1500000000000004,"5min":8.1500000000000004,"15min":8.1500000000000004},"last":0.67500000000000004}]},{"osd":1,"last update":"Fri Jul 14 15:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.76800000000000002}]},{"osd":2,"last update":"Fri Jul 14 15:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.83899999999999997}]},{"osd":3,"last update":"Fri Jul 14 15:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.90600000000000003}]},{"osd":4,"last update":"Fri Jul 14 15:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.64400000000000002}]},{"osd":6,"last update":"Fri Jul 14 15:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.754},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.93799999999999994}]},{"osd":7,"last update":"Fri Jul 14 15:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.875},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.92300000000000004}]}]},{"osd":7,"up_from":15,"seq":64424509463,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":401408,"data_stored":162330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":4.5919999999999996,"5min":4.5919999999999996,"15min":4.5919999999999996},"last":0.624}]},{"osd":1,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1,"5min":1,"15min":1},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":4.665,"5min":4.665,"15min":4.665},"last":0.749}]},{"osd":2,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":5.4089999999999998,"5min":5.4089999999999998,"15min":5.4089999999999998},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":0.80400000000000005}]},{"osd":3,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":2.3380000000000001,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":2.3530000000000002,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":0.84199999999999997}]},{"osd":4,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.68899999999999995}]},{"osd":5,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.70399999999999996}]},{"osd":6,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.72599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T15:57:35.372 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T15:57:35.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.592+0000 7f705bdff700 1 Processor -- start 2023-07-14T15:57:35.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.593+0000 7f705bdff700 1 -- start start 2023-07-14T15:57:35.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.594+0000 7f705bdff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f70540b85f0 0x7f705415d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:35.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.594+0000 7f705bdff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f70540b54b0 0x7f70540cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:35.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.594+0000 7f705bdff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70540cf6b0 con 0x7f70540b4910 2023-07-14T15:57:35.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.594+0000 7f705bdff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70540cdc40 con 0x7f70540b85f0 2023-07-14T15:57:35.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.594+0000 7f705bdff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f705415dba0 con 0x7f70540b54b0 2023-07-14T15:57:35.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.594+0000 7f7059b9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f70540b85f0 0x7f705415d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:35.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.594+0000 7f705a39c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f70540b4910 0x7f705415dda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56858/0 (socket says 172.21.15.37:56858) 2023-07-14T15:57:35.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.594+0000 7f705a39c700 1 -- 172.21.15.37:0/4164267851 learned_addr learned my addr 172.21.15.37:0/4164267851 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:35.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.594+0000 7f705939a700 1 --2- 172.21.15.37:0/4164267851 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f70540b54b0 0x7f70540cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:35.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.595+0000 7f7059b9b700 1 -- 172.21.15.37:0/4164267851 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f70540b54b0 msgr2=0x7f70540cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:35.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.595+0000 7f7059b9b700 1 --2- 172.21.15.37:0/4164267851 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f70540b54b0 0x7f70540cfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:35.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.595+0000 7f7059b9b700 1 -- 172.21.15.37:0/4164267851 >> v1:172.21.15.37:6789/0 conn(0x7f70540b4910 legacy=0x7f705415dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:35.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.595+0000 7f7059b9b700 1 -- 172.21.15.37:0/4164267851 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70540cf0a0 con 0x7f70540b85f0 2023-07-14T15:57:35.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.595+0000 7f7058b99700 1 -- 172.21.15.37:0/4164267851 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 872189613 0 0) 0x7f70540cf6b0 con 0x7f70540b4910 2023-07-14T15:57:35.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.595+0000 7f7059b9b700 1 --2- 172.21.15.37:0/4164267851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70540b85f0 0x7f705415d660 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7050009840 tx=0x7f7050009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1296060624b06e7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:35.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.595+0000 7f7058b99700 1 -- 172.21.15.37:0/4164267851 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7050011830 con 0x7f70540b85f0 2023-07-14T15:57:35.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.595+0000 7f7058b99700 1 -- 172.21.15.37:0/4164267851 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7050011990 con 0x7f70540b85f0 2023-07-14T15:57:35.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.595+0000 7f7058b99700 1 -- 172.21.15.37:0/4164267851 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7050011d20 con 0x7f70540b85f0 2023-07-14T15:57:35.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.596+0000 7f705bdff700 1 -- 172.21.15.37:0/4164267851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70540b85f0 msgr2=0x7f705415d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:35.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.596+0000 7f705bdff700 1 --2- 172.21.15.37:0/4164267851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70540b85f0 0x7f705415d660 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7050009840 tx=0x7f7050009b50 comp rx=0 tx=0).stop 2023-07-14T15:57:35.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.596+0000 7f705bdff700 1 -- 172.21.15.37:0/4164267851 shutdown_connections 2023-07-14T15:57:35.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.596+0000 7f705bdff700 1 --2- 172.21.15.37:0/4164267851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70540b85f0 0x7f705415d660 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:35.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.596+0000 7f705bdff700 1 --2- 172.21.15.37:0/4164267851 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f70540b54b0 0x7f70540cfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:35.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.596+0000 7f705bdff700 1 -- 172.21.15.37:0/4164267851 >> 172.21.15.37:0/4164267851 conn(0x7f705406a580 msgr2=0x7f705406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:35.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.596+0000 7f705bdff700 1 -- 172.21.15.37:0/4164267851 shutdown_connections 2023-07-14T15:57:35.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.596+0000 7f705bdff700 1 -- 172.21.15.37:0/4164267851 wait complete. 2023-07-14T15:57:35.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.598+0000 7f705bdff700 1 Processor -- start 2023-07-14T15:57:35.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.598+0000 7f705bdff700 1 -- start start 2023-07-14T15:57:35.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.599+0000 7f705bdff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70540b4910 0x7f70540a9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:35.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.599+0000 7f705bdff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70540b54b0 0x7f70541605e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:35.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.599+0000 7f705bdff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f70540b85f0 0x7f70541f5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:35.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.599+0000 7f705bdff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70540c8070 con 0x7f70540b54b0 2023-07-14T15:57:35.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.599+0000 7f705bdff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70540aa950 con 0x7f70540b4910 2023-07-14T15:57:35.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.599+0000 7f705bdff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7054160b20 con 0x7f70540b85f0 2023-07-14T15:57:35.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.599+0000 7f705939a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70540b54b0 0x7f70541605e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:35.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.599+0000 7f705939a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70540b54b0 0x7f70541605e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38614/0 (socket says 172.21.15.37:38614) 2023-07-14T15:57:35.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.599+0000 7f705939a700 1 -- 172.21.15.37:0/4138617153 learned_addr learned my addr 172.21.15.37:0/4138617153 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:35.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.599+0000 7f7059b9b700 1 --2- 172.21.15.37:0/4138617153 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70540b4910 0x7f70540a9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:35.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.599+0000 7f705a39c700 1 --2- 172.21.15.37:0/4138617153 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f70540b85f0 0x7f70541f5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:35.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.600+0000 7f705939a700 1 -- 172.21.15.37:0/4138617153 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f70540b85f0 msgr2=0x7f70541f5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:35.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.600+0000 7f705939a700 1 --2- 172.21.15.37:0/4138617153 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f70540b85f0 0x7f70541f5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:35.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.600+0000 7f705939a700 1 -- 172.21.15.37:0/4138617153 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70540b4910 msgr2=0x7f70540a9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:35.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.600+0000 7f705939a700 1 --2- 172.21.15.37:0/4138617153 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70540b4910 0x7f70540a9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:35.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.600+0000 7f705939a700 1 -- 172.21.15.37:0/4138617153 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70500094a0 con 0x7f70540b54b0 2023-07-14T15:57:35.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.600+0000 7f705939a700 1 --2- 172.21.15.37:0/4138617153 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70540b54b0 0x7f70541605e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f704400e810 tx=0x7f704400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:35.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.600+0000 7f704a7fc700 1 -- 172.21.15.37:0/4138617153 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7044013610 con 0x7f70540b54b0 2023-07-14T15:57:35.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.600+0000 7f704a7fc700 1 -- 172.21.15.37:0/4138617153 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7044013770 con 0x7f70540b54b0 2023-07-14T15:57:35.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.600+0000 7f704a7fc700 1 -- 172.21.15.37:0/4138617153 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7044013b20 con 0x7f70540b54b0 2023-07-14T15:57:35.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.600+0000 7f705bdff700 1 -- 172.21.15.37:0/4138617153 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70540c79d0 con 0x7f70540b54b0 2023-07-14T15:57:35.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.600+0000 7f705bdff700 1 -- 172.21.15.37:0/4138617153 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70540c7c90 con 0x7f70540b54b0 2023-07-14T15:57:35.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.601+0000 7f705bdff700 1 -- 172.21.15.37:0/4138617153 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7054067840 con 0x7f70540b54b0 2023-07-14T15:57:35.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.602+0000 7f704a7fc700 1 -- 172.21.15.37:0/4138617153 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7044013c80 con 0x7f70540b54b0 2023-07-14T15:57:35.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.603+0000 7f704a7fc700 1 --2- 172.21.15.37:0/4138617153 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f703806ace0 0x7f703806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:35.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.603+0000 7f704a7fc700 1 -- 172.21.15.37:0/4138617153 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7044089170 con 0x7f70540b54b0 2023-07-14T15:57:35.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.604+0000 7f7059b9b700 1 --2- 172.21.15.37:0/4138617153 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f703806ace0 0x7f703806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:35.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.604+0000 7f7059b9b700 1 --2- 172.21.15.37:0/4138617153 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f703806ace0 0x7f703806d190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7050000c00 tx=0x7f705001c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:35.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.607+0000 7f704a7fc700 1 -- 172.21.15.37:0/4138617153 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7044057c20 con 0x7f70540b54b0 2023-07-14T15:57:35.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.810+0000 7f705bdff700 1 -- 172.21.15.37:0/4138617153 --> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f70540c7850 con 0x7f703806ace0 2023-07-14T15:57:35.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.820+0000 7f704a7fc700 1 -- 172.21.15.37:0/4138617153 <== mgr.4100 v2:172.21.15.98:6832/3163748069 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310790 (secure 0 0 0) 0x7f7050011b80 con 0x7f703806ace0 2023-07-14T15:57:35.809 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:57:35.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.824+0000 7f705bdff700 1 -- 172.21.15.37:0/4138617153 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f703806ace0 msgr2=0x7f703806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:35.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.824+0000 7f705bdff700 1 --2- 172.21.15.37:0/4138617153 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f703806ace0 0x7f703806d190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7050000c00 tx=0x7f705001c040 comp rx=0 tx=0).stop 2023-07-14T15:57:35.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.824+0000 7f705bdff700 1 -- 172.21.15.37:0/4138617153 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70540b54b0 msgr2=0x7f70541605e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:35.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.824+0000 7f705bdff700 1 --2- 172.21.15.37:0/4138617153 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70540b54b0 0x7f70541605e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f704400e810 tx=0x7f704400eb20 comp rx=0 tx=0).stop 2023-07-14T15:57:35.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.824+0000 7f705bdff700 1 -- 172.21.15.37:0/4138617153 shutdown_connections 2023-07-14T15:57:35.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.824+0000 7f705bdff700 1 --2- 172.21.15.37:0/4138617153 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70540b4910 0x7f70540a9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:35.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.824+0000 7f705bdff700 1 --2- 172.21.15.37:0/4138617153 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f703806ace0 0x7f703806d190 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:35.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.824+0000 7f705bdff700 1 --2- 172.21.15.37:0/4138617153 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f70540b85f0 0x7f70541f5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:35.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.824+0000 7f705bdff700 1 --2- 172.21.15.37:0/4138617153 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70540b54b0 0x7f70541605e0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:35.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.824+0000 7f705bdff700 1 -- 172.21.15.37:0/4138617153 >> 172.21.15.37:0/4138617153 conn(0x7f705406a580 msgr2=0x7f70540b6f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:35.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.824+0000 7f705bdff700 1 -- 172.21.15.37:0/4138617153 shutdown_connections 2023-07-14T15:57:35.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:35.824+0000 7f705bdff700 1 -- 172.21.15.37:0/4138617153 wait complete. 2023-07-14T15:57:35.813 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-14T15:57:35.827 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2023-07-14T15:57:34.874492+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224040,"kb_used_data":4328,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754750680,"statfs":{"total":773094113280,"available":772864696320,"internally_reserved":0,"allocated":4431872,"data_stored":2483540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.183882"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694788+0000","last_change":"2023-07-14T15:57:25.708719+0000","last_active":"2023-07-14T15:57:26.694788+0000","last_peered":"2023-07-14T15:57:26.694788+0000","last_clean":"2023-07-14T15:57:26.694788+0000","last_became_active":"2023-07-14T15:57:25.708107+0000","last_became_peered":"2023-07-14T15:57:25.708107+0000","last_unstale":"2023-07-14T15:57:26.694788+0000","last_undegraded":"2023-07-14T15:57:26.694788+0000","last_fullsized":"2023-07-14T15:57:26.694788+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:52:37.992568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170517+0000","last_change":"2023-07-14T15:57:25.710340+0000","last_active":"2023-07-14T15:57:27.170517+0000","last_peered":"2023-07-14T15:57:27.170517+0000","last_clean":"2023-07-14T15:57:27.170517+0000","last_became_active":"2023-07-14T15:57:25.710113+0000","last_became_peered":"2023-07-14T15:57:25.710113+0000","last_unstale":"2023-07-14T15:57:27.170517+0000","last_undegraded":"2023-07-14T15:57:27.170517+0000","last_fullsized":"2023-07-14T15:57:27.170517+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:05:25.335710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694176+0000","last_change":"2023-07-14T15:57:25.707011+0000","last_active":"2023-07-14T15:57:26.694176+0000","last_peered":"2023-07-14T15:57:26.694176+0000","last_clean":"2023-07-14T15:57:26.694176+0000","last_became_active":"2023-07-14T15:57:25.706720+0000","last_became_peered":"2023-07-14T15:57:25.706720+0000","last_unstale":"2023-07-14T15:57:26.694176+0000","last_undegraded":"2023-07-14T15:57:26.694176+0000","last_fullsized":"2023-07-14T15:57:26.694176+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:11:43.491601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694227+0000","last_change":"2023-07-14T15:57:25.710983+0000","last_active":"2023-07-14T15:57:26.694227+0000","last_peered":"2023-07-14T15:57:26.694227+0000","last_clean":"2023-07-14T15:57:26.694227+0000","last_became_active":"2023-07-14T15:57:25.710549+0000","last_became_peered":"2023-07-14T15:57:25.710549+0000","last_unstale":"2023-07-14T15:57:26.694227+0000","last_undegraded":"2023-07-14T15:57:26.694227+0000","last_fullsized":"2023-07-14T15:57:26.694227+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:40:25.153466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.076832+0000","last_change":"2023-07-14T15:57:25.703749+0000","last_active":"2023-07-14T15:57:27.076832+0000","last_peered":"2023-07-14T15:57:27.076832+0000","last_clean":"2023-07-14T15:57:27.076832+0000","last_became_active":"2023-07-14T15:57:25.703455+0000","last_became_peered":"2023-07-14T15:57:25.703455+0000","last_unstale":"2023-07-14T15:57:27.076832+0000","last_undegraded":"2023-07-14T15:57:27.076832+0000","last_fullsized":"2023-07-14T15:57:27.076832+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:08:58.707250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.169981+0000","last_change":"2023-07-14T15:57:25.712112+0000","last_active":"2023-07-14T15:57:27.169981+0000","last_peered":"2023-07-14T15:57:27.169981+0000","last_clean":"2023-07-14T15:57:27.169981+0000","last_became_active":"2023-07-14T15:57:25.711731+0000","last_became_peered":"2023-07-14T15:57:25.711731+0000","last_unstale":"2023-07-14T15:57:27.169981+0000","last_undegraded":"2023-07-14T15:57:27.169981+0000","last_fullsized":"2023-07-14T15:57:27.169981+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:30:01.196875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.169593+0000","last_change":"2023-07-14T15:57:25.708346+0000","last_active":"2023-07-14T15:57:27.169593+0000","last_peered":"2023-07-14T15:57:27.169593+0000","last_clean":"2023-07-14T15:57:27.169593+0000","last_became_active":"2023-07-14T15:57:25.708048+0000","last_became_peered":"2023-07-14T15:57:25.708048+0000","last_unstale":"2023-07-14T15:57:27.169593+0000","last_undegraded":"2023-07-14T15:57:27.169593+0000","last_fullsized":"2023-07-14T15:57:27.169593+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:49:19.521735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694045+0000","last_change":"2023-07-14T15:57:25.706331+0000","last_active":"2023-07-14T15:57:26.694045+0000","last_peered":"2023-07-14T15:57:26.694045+0000","last_clean":"2023-07-14T15:57:26.694045+0000","last_became_active":"2023-07-14T15:57:25.705691+0000","last_became_peered":"2023-07-14T15:57:25.705691+0000","last_unstale":"2023-07-14T15:57:26.694045+0000","last_undegraded":"2023-07-14T15:57:26.694045+0000","last_fullsized":"2023-07-14T15:57:26.694045+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:24:52.499316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.077364+0000","last_change":"2023-07-14T15:57:25.713167+0000","last_active":"2023-07-14T15:57:27.077364+0000","last_peered":"2023-07-14T15:57:27.077364+0000","last_clean":"2023-07-14T15:57:27.077364+0000","last_became_active":"2023-07-14T15:57:25.712829+0000","last_became_peered":"2023-07-14T15:57:25.712829+0000","last_unstale":"2023-07-14T15:57:27.077364+0000","last_undegraded":"2023-07-14T15:57:27.077364+0000","last_fullsized":"2023-07-14T15:57:27.077364+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:53:49.977402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.169843+0000","last_change":"2023-07-14T15:57:25.707232+0000","last_active":"2023-07-14T15:57:27.169843+0000","last_peered":"2023-07-14T15:57:27.169843+0000","last_clean":"2023-07-14T15:57:27.169843+0000","last_became_active":"2023-07-14T15:57:25.706976+0000","last_became_peered":"2023-07-14T15:57:25.706976+0000","last_unstale":"2023-07-14T15:57:27.169843+0000","last_undegraded":"2023-07-14T15:57:27.169843+0000","last_fullsized":"2023-07-14T15:57:27.169843+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:33:16.346186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.080162+0000","last_change":"2023-07-14T15:57:25.704130+0000","last_active":"2023-07-14T15:57:27.080162+0000","last_peered":"2023-07-14T15:57:27.080162+0000","last_clean":"2023-07-14T15:57:27.080162+0000","last_became_active":"2023-07-14T15:57:25.703350+0000","last_became_peered":"2023-07-14T15:57:25.703350+0000","last_unstale":"2023-07-14T15:57:27.080162+0000","last_undegraded":"2023-07-14T15:57:27.080162+0000","last_fullsized":"2023-07-14T15:57:27.080162+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:51:25.799916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.077125+0000","last_change":"2023-07-14T15:57:25.709331+0000","last_active":"2023-07-14T15:57:27.077125+0000","last_peered":"2023-07-14T15:57:27.077125+0000","last_clean":"2023-07-14T15:57:27.077125+0000","last_became_active":"2023-07-14T15:57:25.709039+0000","last_became_peered":"2023-07-14T15:57:25.709039+0000","last_unstale":"2023-07-14T15:57:27.077125+0000","last_undegraded":"2023-07-14T15:57:27.077125+0000","last_fullsized":"2023-07-14T15:57:27.077125+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:05:25.335710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.169793+0000","last_change":"2023-07-14T15:57:25.715095+0000","last_active":"2023-07-14T15:57:27.169793+0000","last_peered":"2023-07-14T15:57:27.169793+0000","last_clean":"2023-07-14T15:57:27.169793+0000","last_became_active":"2023-07-14T15:57:25.714840+0000","last_became_peered":"2023-07-14T15:57:25.714840+0000","last_unstale":"2023-07-14T15:57:27.169793+0000","last_undegraded":"2023-07-14T15:57:27.169793+0000","last_fullsized":"2023-07-14T15:57:27.169793+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:52:46.472621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170148+0000","last_change":"2023-07-14T15:57:25.710052+0000","last_active":"2023-07-14T15:57:27.170148+0000","last_peered":"2023-07-14T15:57:27.170148+0000","last_clean":"2023-07-14T15:57:27.170148+0000","last_became_active":"2023-07-14T15:57:25.709808+0000","last_became_peered":"2023-07-14T15:57:25.709808+0000","last_unstale":"2023-07-14T15:57:27.170148+0000","last_undegraded":"2023-07-14T15:57:27.170148+0000","last_fullsized":"2023-07-14T15:57:27.170148+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:19:01.933649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693904+0000","last_change":"2023-07-14T15:57:25.709747+0000","last_active":"2023-07-14T15:57:26.693904+0000","last_peered":"2023-07-14T15:57:26.693904+0000","last_clean":"2023-07-14T15:57:26.693904+0000","last_became_active":"2023-07-14T15:57:25.709442+0000","last_became_peered":"2023-07-14T15:57:25.709442+0000","last_unstale":"2023-07-14T15:57:26.693904+0000","last_undegraded":"2023-07-14T15:57:26.693904+0000","last_fullsized":"2023-07-14T15:57:26.693904+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:30:18.330946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.169541+0000","last_change":"2023-07-14T15:57:25.712207+0000","last_active":"2023-07-14T15:57:27.169541+0000","last_peered":"2023-07-14T15:57:27.169541+0000","last_clean":"2023-07-14T15:57:27.169541+0000","last_became_active":"2023-07-14T15:57:25.711936+0000","last_became_peered":"2023-07-14T15:57:25.711936+0000","last_unstale":"2023-07-14T15:57:27.169541+0000","last_undegraded":"2023-07-14T15:57:27.169541+0000","last_fullsized":"2023-07-14T15:57:27.169541+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:07:21.314190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694397+0000","last_change":"2023-07-14T15:57:25.711637+0000","last_active":"2023-07-14T15:57:26.694397+0000","last_peered":"2023-07-14T15:57:26.694397+0000","last_clean":"2023-07-14T15:57:26.694397+0000","last_became_active":"2023-07-14T15:57:25.710975+0000","last_became_peered":"2023-07-14T15:57:25.710975+0000","last_unstale":"2023-07-14T15:57:26.694397+0000","last_undegraded":"2023-07-14T15:57:26.694397+0000","last_fullsized":"2023-07-14T15:57:26.694397+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:24:11.251154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694300+0000","last_change":"2023-07-14T15:57:25.711476+0000","last_active":"2023-07-14T15:57:26.694300+0000","last_peered":"2023-07-14T15:57:26.694300+0000","last_clean":"2023-07-14T15:57:26.694300+0000","last_became_active":"2023-07-14T15:57:25.711204+0000","last_became_peered":"2023-07-14T15:57:25.711204+0000","last_unstale":"2023-07-14T15:57:26.694300+0000","last_undegraded":"2023-07-14T15:57:26.694300+0000","last_fullsized":"2023-07-14T15:57:26.694300+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:27:16.753361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694835+0000","last_change":"2023-07-14T15:57:25.715333+0000","last_active":"2023-07-14T15:57:26.694835+0000","last_peered":"2023-07-14T15:57:26.694835+0000","last_clean":"2023-07-14T15:57:26.694835+0000","last_became_active":"2023-07-14T15:57:25.715044+0000","last_became_peered":"2023-07-14T15:57:25.715044+0000","last_unstale":"2023-07-14T15:57:26.694835+0000","last_undegraded":"2023-07-14T15:57:26.694835+0000","last_fullsized":"2023-07-14T15:57:26.694835+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:13:09.841632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.079778+0000","last_change":"2023-07-14T15:57:25.710745+0000","last_active":"2023-07-14T15:57:27.079778+0000","last_peered":"2023-07-14T15:57:27.079778+0000","last_clean":"2023-07-14T15:57:27.079778+0000","last_became_active":"2023-07-14T15:57:25.710470+0000","last_became_peered":"2023-07-14T15:57:25.710470+0000","last_unstale":"2023-07-14T15:57:27.079778+0000","last_undegraded":"2023-07-14T15:57:27.079778+0000","last_fullsized":"2023-07-14T15:57:27.079778+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:50:07.191662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.079795+0000","last_change":"2023-07-14T15:57:25.707437+0000","last_active":"2023-07-14T15:57:27.079795+0000","last_peered":"2023-07-14T15:57:27.079795+0000","last_clean":"2023-07-14T15:57:27.079795+0000","last_became_active":"2023-07-14T15:57:25.707120+0000","last_became_peered":"2023-07-14T15:57:25.707120+0000","last_unstale":"2023-07-14T15:57:27.079795+0000","last_undegraded":"2023-07-14T15:57:27.079795+0000","last_fullsized":"2023-07-14T15:57:27.079795+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:43:47.530104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.079781+0000","last_change":"2023-07-14T15:57:25.711301+0000","last_active":"2023-07-14T15:57:27.079781+0000","last_peered":"2023-07-14T15:57:27.079781+0000","last_clean":"2023-07-14T15:57:27.079781+0000","last_became_active":"2023-07-14T15:57:25.710426+0000","last_became_peered":"2023-07-14T15:57:25.710426+0000","last_unstale":"2023-07-14T15:57:27.079781+0000","last_undegraded":"2023-07-14T15:57:27.079781+0000","last_fullsized":"2023-07-14T15:57:27.079781+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:25:29.672522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693910+0000","last_change":"2023-07-14T15:57:25.716297+0000","last_active":"2023-07-14T15:57:26.693910+0000","last_peered":"2023-07-14T15:57:26.693910+0000","last_clean":"2023-07-14T15:57:26.693910+0000","last_became_active":"2023-07-14T15:57:25.716028+0000","last_became_peered":"2023-07-14T15:57:25.716028+0000","last_unstale":"2023-07-14T15:57:26.693910+0000","last_undegraded":"2023-07-14T15:57:26.693910+0000","last_fullsized":"2023-07-14T15:57:26.693910+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:50:57.963143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693902+0000","last_change":"2023-07-14T15:57:25.707324+0000","last_active":"2023-07-14T15:57:26.693902+0000","last_peered":"2023-07-14T15:57:26.693902+0000","last_clean":"2023-07-14T15:57:26.693902+0000","last_became_active":"2023-07-14T15:57:25.706434+0000","last_became_peered":"2023-07-14T15:57:25.706434+0000","last_unstale":"2023-07-14T15:57:26.693902+0000","last_undegraded":"2023-07-14T15:57:26.693902+0000","last_fullsized":"2023-07-14T15:57:26.693902+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:15:31.939973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170401+0000","last_change":"2023-07-14T15:57:25.711970+0000","last_active":"2023-07-14T15:57:27.170401+0000","last_peered":"2023-07-14T15:57:27.170401+0000","last_clean":"2023-07-14T15:57:27.170401+0000","last_became_active":"2023-07-14T15:57:25.711620+0000","last_became_peered":"2023-07-14T15:57:25.711620+0000","last_unstale":"2023-07-14T15:57:27.170401+0000","last_undegraded":"2023-07-14T15:57:27.170401+0000","last_fullsized":"2023-07-14T15:57:27.170401+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:25:29.672522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694804+0000","last_change":"2023-07-14T15:57:25.704116+0000","last_active":"2023-07-14T15:57:26.694804+0000","last_peered":"2023-07-14T15:57:26.694804+0000","last_clean":"2023-07-14T15:57:26.694804+0000","last_became_active":"2023-07-14T15:57:25.703738+0000","last_became_peered":"2023-07-14T15:57:25.703738+0000","last_unstale":"2023-07-14T15:57:26.694804+0000","last_undegraded":"2023-07-14T15:57:26.694804+0000","last_fullsized":"2023-07-14T15:57:26.694804+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:59:26.269692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.080025+0000","last_change":"2023-07-14T15:57:25.716868+0000","last_active":"2023-07-14T15:57:27.080025+0000","last_peered":"2023-07-14T15:57:27.080025+0000","last_clean":"2023-07-14T15:57:27.080025+0000","last_became_active":"2023-07-14T15:57:25.714448+0000","last_became_peered":"2023-07-14T15:57:25.714448+0000","last_unstale":"2023-07-14T15:57:27.080025+0000","last_undegraded":"2023-07-14T15:57:27.080025+0000","last_fullsized":"2023-07-14T15:57:27.080025+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:11:14.971099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170006+0000","last_change":"2023-07-14T15:57:25.707017+0000","last_active":"2023-07-14T15:57:27.170006+0000","last_peered":"2023-07-14T15:57:27.170006+0000","last_clean":"2023-07-14T15:57:27.170006+0000","last_became_active":"2023-07-14T15:57:25.706670+0000","last_became_peered":"2023-07-14T15:57:25.706670+0000","last_unstale":"2023-07-14T15:57:27.170006+0000","last_undegraded":"2023-07-14T15:57:27.170006+0000","last_fullsized":"2023-07-14T15:57:27.170006+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:05:52.618425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694039+0000","last_change":"2023-07-14T15:57:25.716158+0000","last_active":"2023-07-14T15:57:26.694039+0000","last_peered":"2023-07-14T15:57:26.694039+0000","last_clean":"2023-07-14T15:57:26.694039+0000","last_became_active":"2023-07-14T15:57:25.715850+0000","last_became_peered":"2023-07-14T15:57:25.715850+0000","last_unstale":"2023-07-14T15:57:26.694039+0000","last_undegraded":"2023-07-14T15:57:26.694039+0000","last_fullsized":"2023-07-14T15:57:26.694039+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:30:09.595831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694008+0000","last_change":"2023-07-14T15:57:25.708658+0000","last_active":"2023-07-14T15:57:26.694008+0000","last_peered":"2023-07-14T15:57:26.694008+0000","last_clean":"2023-07-14T15:57:26.694008+0000","last_became_active":"2023-07-14T15:57:25.708289+0000","last_became_peered":"2023-07-14T15:57:25.708289+0000","last_unstale":"2023-07-14T15:57:26.694008+0000","last_undegraded":"2023-07-14T15:57:26.694008+0000","last_fullsized":"2023-07-14T15:57:26.694008+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:20:54.175890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.169736+0000","last_change":"2023-07-14T15:57:25.713419+0000","last_active":"2023-07-14T15:57:27.169736+0000","last_peered":"2023-07-14T15:57:27.169736+0000","last_clean":"2023-07-14T15:57:27.169736+0000","last_became_active":"2023-07-14T15:57:25.713093+0000","last_became_peered":"2023-07-14T15:57:25.713093+0000","last_unstale":"2023-07-14T15:57:27.169736+0000","last_undegraded":"2023-07-14T15:57:27.169736+0000","last_fullsized":"2023-07-14T15:57:27.169736+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:13:09.841632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693994+0000","last_change":"2023-07-14T15:57:25.706580+0000","last_active":"2023-07-14T15:57:26.693994+0000","last_peered":"2023-07-14T15:57:26.693994+0000","last_clean":"2023-07-14T15:57:26.693994+0000","last_became_active":"2023-07-14T15:57:25.706059+0000","last_became_peered":"2023-07-14T15:57:25.706059+0000","last_unstale":"2023-07-14T15:57:26.693994+0000","last_undegraded":"2023-07-14T15:57:26.693994+0000","last_fullsized":"2023-07-14T15:57:26.693994+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:16:24.805508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694193+0000","last_change":"2023-07-14T15:57:25.706488+0000","last_active":"2023-07-14T15:57:26.694193+0000","last_peered":"2023-07-14T15:57:26.694193+0000","last_clean":"2023-07-14T15:57:26.694193+0000","last_became_active":"2023-07-14T15:57:25.706198+0000","last_became_peered":"2023-07-14T15:57:25.706198+0000","last_unstale":"2023-07-14T15:57:26.694193+0000","last_undegraded":"2023-07-14T15:57:26.694193+0000","last_fullsized":"2023-07-14T15:57:26.694193+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:38:44.179763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"35'4","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170540+0000","last_change":"2023-07-14T15:57:24.951038+0000","last_active":"2023-07-14T15:57:27.170540+0000","last_peered":"2023-07-14T15:57:27.170540+0000","last_clean":"2023-07-14T15:57:27.170540+0000","last_became_active":"2023-07-14T15:57:24.950729+0000","last_became_peered":"2023-07-14T15:57:24.950729+0000","last_unstale":"2023-07-14T15:57:27.170540+0000","last_undegraded":"2023-07-14T15:57:27.170540+0000","last_fullsized":"2023-07-14T15:57:27.170540+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:50:06.189560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170392+0000","last_change":"2023-07-14T15:57:25.713457+0000","last_active":"2023-07-14T15:57:27.170392+0000","last_peered":"2023-07-14T15:57:27.170392+0000","last_clean":"2023-07-14T15:57:27.170392+0000","last_became_active":"2023-07-14T15:57:25.713153+0000","last_became_peered":"2023-07-14T15:57:25.713153+0000","last_unstale":"2023-07-14T15:57:27.170392+0000","last_undegraded":"2023-07-14T15:57:27.170392+0000","last_fullsized":"2023-07-14T15:57:27.170392+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:00:49.136871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"35'1","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170589+0000","last_change":"2023-07-14T15:57:24.950846+0000","last_active":"2023-07-14T15:57:27.170589+0000","last_peered":"2023-07-14T15:57:27.170589+0000","last_clean":"2023-07-14T15:57:27.170589+0000","last_became_active":"2023-07-14T15:57:24.948195+0000","last_became_peered":"2023-07-14T15:57:24.948195+0000","last_unstale":"2023-07-14T15:57:27.170589+0000","last_undegraded":"2023-07-14T15:57:27.170589+0000","last_fullsized":"2023-07-14T15:57:27.170589+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:37:33.879198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694467+0000","last_change":"2023-07-14T15:57:25.706821+0000","last_active":"2023-07-14T15:57:26.694467+0000","last_peered":"2023-07-14T15:57:26.694467+0000","last_clean":"2023-07-14T15:57:26.694467+0000","last_became_active":"2023-07-14T15:57:25.706544+0000","last_became_peered":"2023-07-14T15:57:25.706544+0000","last_unstale":"2023-07-14T15:57:26.694467+0000","last_undegraded":"2023-07-14T15:57:26.694467+0000","last_fullsized":"2023-07-14T15:57:26.694467+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:57:14.558950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694334+0000","last_change":"2023-07-14T15:57:24.946400+0000","last_active":"2023-07-14T15:57:26.694334+0000","last_peered":"2023-07-14T15:57:26.694334+0000","last_clean":"2023-07-14T15:57:26.694334+0000","last_became_active":"2023-07-14T15:57:24.944268+0000","last_became_peered":"2023-07-14T15:57:24.944268+0000","last_unstale":"2023-07-14T15:57:26.694334+0000","last_undegraded":"2023-07-14T15:57:26.694334+0000","last_fullsized":"2023-07-14T15:57:26.694334+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:19:27.823719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170644+0000","last_change":"2023-07-14T15:57:25.713045+0000","last_active":"2023-07-14T15:57:27.170644+0000","last_peered":"2023-07-14T15:57:27.170644+0000","last_clean":"2023-07-14T15:57:27.170644+0000","last_became_active":"2023-07-14T15:57:25.712719+0000","last_became_peered":"2023-07-14T15:57:25.712719+0000","last_unstale":"2023-07-14T15:57:27.170644+0000","last_undegraded":"2023-07-14T15:57:27.170644+0000","last_fullsized":"2023-07-14T15:57:27.170644+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:50:51.047340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170349+0000","last_change":"2023-07-14T15:57:24.949781+0000","last_active":"2023-07-14T15:57:27.170349+0000","last_peered":"2023-07-14T15:57:27.170349+0000","last_clean":"2023-07-14T15:57:27.170349+0000","last_became_active":"2023-07-14T15:57:24.949496+0000","last_became_peered":"2023-07-14T15:57:24.949496+0000","last_unstale":"2023-07-14T15:57:27.170349+0000","last_undegraded":"2023-07-14T15:57:27.170349+0000","last_fullsized":"2023-07-14T15:57:27.170349+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:38:12.937516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693738+0000","last_change":"2023-07-14T15:57:25.712413+0000","last_active":"2023-07-14T15:57:26.693738+0000","last_peered":"2023-07-14T15:57:26.693738+0000","last_clean":"2023-07-14T15:57:26.693738+0000","last_became_active":"2023-07-14T15:57:25.712153+0000","last_became_peered":"2023-07-14T15:57:25.712153+0000","last_unstale":"2023-07-14T15:57:26.693738+0000","last_undegraded":"2023-07-14T15:57:26.693738+0000","last_fullsized":"2023-07-14T15:57:26.693738+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:48:28.785668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"35'1","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170210+0000","last_change":"2023-07-14T15:57:24.946938+0000","last_active":"2023-07-14T15:57:27.170210+0000","last_peered":"2023-07-14T15:57:27.170210+0000","last_clean":"2023-07-14T15:57:27.170210+0000","last_became_active":"2023-07-14T15:57:24.946611+0000","last_became_peered":"2023-07-14T15:57:24.946611+0000","last_unstale":"2023-07-14T15:57:27.170210+0000","last_undegraded":"2023-07-14T15:57:27.170210+0000","last_fullsized":"2023-07-14T15:57:27.170210+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:03:29.027256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.079689+0000","last_change":"2023-07-14T15:57:25.711684+0000","last_active":"2023-07-14T15:57:27.079689+0000","last_peered":"2023-07-14T15:57:27.079689+0000","last_clean":"2023-07-14T15:57:27.079689+0000","last_became_active":"2023-07-14T15:57:25.710777+0000","last_became_peered":"2023-07-14T15:57:25.710777+0000","last_unstale":"2023-07-14T15:57:27.079689+0000","last_undegraded":"2023-07-14T15:57:27.079689+0000","last_fullsized":"2023-07-14T15:57:27.079689+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:38:13.939618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"35'1","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.169840+0000","last_change":"2023-07-14T15:57:24.952640+0000","last_active":"2023-07-14T15:57:27.169840+0000","last_peered":"2023-07-14T15:57:27.169840+0000","last_clean":"2023-07-14T15:57:27.169840+0000","last_became_active":"2023-07-14T15:57:24.952305+0000","last_became_peered":"2023-07-14T15:57:24.952305+0000","last_unstale":"2023-07-14T15:57:27.169840+0000","last_undegraded":"2023-07-14T15:57:27.169840+0000","last_fullsized":"2023-07-14T15:57:27.169840+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:24:27.076859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694294+0000","last_change":"2023-07-14T15:57:25.714100+0000","last_active":"2023-07-14T15:57:26.694294+0000","last_peered":"2023-07-14T15:57:26.694294+0000","last_clean":"2023-07-14T15:57:26.694294+0000","last_became_active":"2023-07-14T15:57:25.713850+0000","last_became_peered":"2023-07-14T15:57:25.713850+0000","last_unstale":"2023-07-14T15:57:26.694294+0000","last_undegraded":"2023-07-14T15:57:26.694294+0000","last_fullsized":"2023-07-14T15:57:26.694294+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:17:22.305947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693561+0000","last_change":"2023-07-14T15:57:24.944873+0000","last_active":"2023-07-14T15:57:26.693561+0000","last_peered":"2023-07-14T15:57:26.693561+0000","last_clean":"2023-07-14T15:57:26.693561+0000","last_became_active":"2023-07-14T15:57:24.944406+0000","last_became_peered":"2023-07-14T15:57:24.944406+0000","last_unstale":"2023-07-14T15:57:26.693561+0000","last_undegraded":"2023-07-14T15:57:26.693561+0000","last_fullsized":"2023-07-14T15:57:26.693561+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:27:08.642795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170183+0000","last_change":"2023-07-14T15:57:25.713086+0000","last_active":"2023-07-14T15:57:27.170183+0000","last_peered":"2023-07-14T15:57:27.170183+0000","last_clean":"2023-07-14T15:57:27.170183+0000","last_became_active":"2023-07-14T15:57:25.712650+0000","last_became_peered":"2023-07-14T15:57:25.712650+0000","last_unstale":"2023-07-14T15:57:27.170183+0000","last_undegraded":"2023-07-14T15:57:27.170183+0000","last_fullsized":"2023-07-14T15:57:27.170183+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:04:29.884999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.169587+0000","last_change":"2023-07-14T15:57:24.946452+0000","last_active":"2023-07-14T15:57:27.169587+0000","last_peered":"2023-07-14T15:57:27.169587+0000","last_clean":"2023-07-14T15:57:27.169587+0000","last_became_active":"2023-07-14T15:57:24.946176+0000","last_became_peered":"2023-07-14T15:57:24.946176+0000","last_unstale":"2023-07-14T15:57:27.169587+0000","last_undegraded":"2023-07-14T15:57:27.169587+0000","last_fullsized":"2023-07-14T15:57:27.169587+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:04:42.034676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694391+0000","last_change":"2023-07-14T15:57:25.710818+0000","last_active":"2023-07-14T15:57:26.694391+0000","last_peered":"2023-07-14T15:57:26.694391+0000","last_clean":"2023-07-14T15:57:26.694391+0000","last_became_active":"2023-07-14T15:57:25.710212+0000","last_became_peered":"2023-07-14T15:57:25.710212+0000","last_unstale":"2023-07-14T15:57:26.694391+0000","last_undegraded":"2023-07-14T15:57:26.694391+0000","last_fullsized":"2023-07-14T15:57:26.694391+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:39:17.831626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694697+0000","last_change":"2023-07-14T15:57:24.949982+0000","last_active":"2023-07-14T15:57:26.694697+0000","last_peered":"2023-07-14T15:57:26.694697+0000","last_clean":"2023-07-14T15:57:26.694697+0000","last_became_active":"2023-07-14T15:57:24.949690+0000","last_became_peered":"2023-07-14T15:57:24.949690+0000","last_unstale":"2023-07-14T15:57:26.694697+0000","last_undegraded":"2023-07-14T15:57:26.694697+0000","last_fullsized":"2023-07-14T15:57:26.694697+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:06:06.625225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170316+0000","last_change":"2023-07-14T15:57:25.703650+0000","last_active":"2023-07-14T15:57:27.170316+0000","last_peered":"2023-07-14T15:57:27.170316+0000","last_clean":"2023-07-14T15:57:27.170316+0000","last_became_active":"2023-07-14T15:57:25.703366+0000","last_became_peered":"2023-07-14T15:57:25.703366+0000","last_unstale":"2023-07-14T15:57:27.170316+0000","last_undegraded":"2023-07-14T15:57:27.170316+0000","last_fullsized":"2023-07-14T15:57:27.170316+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:38:49.336628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694197+0000","last_change":"2023-07-14T15:57:24.949161+0000","last_active":"2023-07-14T15:57:26.694197+0000","last_peered":"2023-07-14T15:57:26.694197+0000","last_clean":"2023-07-14T15:57:26.694197+0000","last_became_active":"2023-07-14T15:57:24.948793+0000","last_became_peered":"2023-07-14T15:57:24.948793+0000","last_unstale":"2023-07-14T15:57:26.694197+0000","last_undegraded":"2023-07-14T15:57:26.694197+0000","last_fullsized":"2023-07-14T15:57:26.694197+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:40:33.570630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694750+0000","last_change":"2023-07-14T15:57:25.708172+0000","last_active":"2023-07-14T15:57:26.694750+0000","last_peered":"2023-07-14T15:57:26.694750+0000","last_clean":"2023-07-14T15:57:26.694750+0000","last_became_active":"2023-07-14T15:57:25.707852+0000","last_became_peered":"2023-07-14T15:57:25.707852+0000","last_unstale":"2023-07-14T15:57:26.694750+0000","last_undegraded":"2023-07-14T15:57:26.694750+0000","last_fullsized":"2023-07-14T15:57:26.694750+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:35:14.571116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"35'3","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694081+0000","last_change":"2023-07-14T15:57:24.943596+0000","last_active":"2023-07-14T15:57:26.694081+0000","last_peered":"2023-07-14T15:57:26.694081+0000","last_clean":"2023-07-14T15:57:26.694081+0000","last_became_active":"2023-07-14T15:57:24.943283+0000","last_became_peered":"2023-07-14T15:57:24.943283+0000","last_unstale":"2023-07-14T15:57:26.694081+0000","last_undegraded":"2023-07-14T15:57:26.694081+0000","last_fullsized":"2023-07-14T15:57:26.694081+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:59:41.480965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170496+0000","last_change":"2023-07-14T15:57:25.700392+0000","last_active":"2023-07-14T15:57:27.170496+0000","last_peered":"2023-07-14T15:57:27.170496+0000","last_clean":"2023-07-14T15:57:27.170496+0000","last_became_active":"2023-07-14T15:57:25.700004+0000","last_became_peered":"2023-07-14T15:57:25.700004+0000","last_unstale":"2023-07-14T15:57:27.170496+0000","last_undegraded":"2023-07-14T15:57:27.170496+0000","last_fullsized":"2023-07-14T15:57:27.170496+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:53:36.476244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"35'6","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694419+0000","last_change":"2023-07-14T15:57:24.947031+0000","last_active":"2023-07-14T15:57:26.694419+0000","last_peered":"2023-07-14T15:57:26.694419+0000","last_clean":"2023-07-14T15:57:26.694419+0000","last_became_active":"2023-07-14T15:57:24.946757+0000","last_became_peered":"2023-07-14T15:57:24.946757+0000","last_unstale":"2023-07-14T15:57:26.694419+0000","last_undegraded":"2023-07-14T15:57:26.694419+0000","last_fullsized":"2023-07-14T15:57:26.694419+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:53:11.648125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693550+0000","last_change":"2023-07-14T15:57:25.707515+0000","last_active":"2023-07-14T15:57:26.693550+0000","last_peered":"2023-07-14T15:57:26.693550+0000","last_clean":"2023-07-14T15:57:26.693550+0000","last_became_active":"2023-07-14T15:57:25.706851+0000","last_became_peered":"2023-07-14T15:57:25.706851+0000","last_unstale":"2023-07-14T15:57:26.693550+0000","last_undegraded":"2023-07-14T15:57:26.693550+0000","last_fullsized":"2023-07-14T15:57:26.693550+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:32:43.868693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693711+0000","last_change":"2023-07-14T15:57:24.950415+0000","last_active":"2023-07-14T15:57:26.693711+0000","last_peered":"2023-07-14T15:57:26.693711+0000","last_clean":"2023-07-14T15:57:26.693711+0000","last_became_active":"2023-07-14T15:57:24.950096+0000","last_became_peered":"2023-07-14T15:57:24.950096+0000","last_unstale":"2023-07-14T15:57:26.693711+0000","last_undegraded":"2023-07-14T15:57:26.693711+0000","last_fullsized":"2023-07-14T15:57:26.693711+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:40:32.381876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170053+0000","last_change":"2023-07-14T15:57:25.709485+0000","last_active":"2023-07-14T15:57:27.170053+0000","last_peered":"2023-07-14T15:57:27.170053+0000","last_clean":"2023-07-14T15:57:27.170053+0000","last_became_active":"2023-07-14T15:57:25.709177+0000","last_became_peered":"2023-07-14T15:57:25.709177+0000","last_unstale":"2023-07-14T15:57:27.170053+0000","last_undegraded":"2023-07-14T15:57:27.170053+0000","last_fullsized":"2023-07-14T15:57:27.170053+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:15:53.819033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170084+0000","last_change":"2023-07-14T15:57:24.950482+0000","last_active":"2023-07-14T15:57:27.170084+0000","last_peered":"2023-07-14T15:57:27.170084+0000","last_clean":"2023-07-14T15:57:27.170084+0000","last_became_active":"2023-07-14T15:57:24.950222+0000","last_became_peered":"2023-07-14T15:57:24.950222+0000","last_unstale":"2023-07-14T15:57:27.170084+0000","last_undegraded":"2023-07-14T15:57:27.170084+0000","last_fullsized":"2023-07-14T15:57:27.170084+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:26:32.319838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.079793+0000","last_change":"2023-07-14T15:57:25.711446+0000","last_active":"2023-07-14T15:57:27.079793+0000","last_peered":"2023-07-14T15:57:27.079793+0000","last_clean":"2023-07-14T15:57:27.079793+0000","last_became_active":"2023-07-14T15:57:25.710394+0000","last_became_peered":"2023-07-14T15:57:25.710394+0000","last_unstale":"2023-07-14T15:57:27.079793+0000","last_undegraded":"2023-07-14T15:57:27.079793+0000","last_fullsized":"2023-07-14T15:57:27.079793+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:13:07.610735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694231+0000","last_change":"2023-07-14T15:57:24.948415+0000","last_active":"2023-07-14T15:57:26.694231+0000","last_peered":"2023-07-14T15:57:26.694231+0000","last_clean":"2023-07-14T15:57:26.694231+0000","last_became_active":"2023-07-14T15:57:24.947719+0000","last_became_peered":"2023-07-14T15:57:24.947719+0000","last_unstale":"2023-07-14T15:57:26.694231+0000","last_undegraded":"2023-07-14T15:57:26.694231+0000","last_fullsized":"2023-07-14T15:57:26.694231+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:08:13.930103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.076982+0000","last_change":"2023-07-14T15:57:25.710816+0000","last_active":"2023-07-14T15:57:27.076982+0000","last_peered":"2023-07-14T15:57:27.076982+0000","last_clean":"2023-07-14T15:57:27.076982+0000","last_became_active":"2023-07-14T15:57:25.710525+0000","last_became_peered":"2023-07-14T15:57:25.710525+0000","last_unstale":"2023-07-14T15:57:27.076982+0000","last_undegraded":"2023-07-14T15:57:27.076982+0000","last_fullsized":"2023-07-14T15:57:27.076982+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:54:39.767268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"35'8","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170313+0000","last_change":"2023-07-14T15:57:24.949662+0000","last_active":"2023-07-14T15:57:27.170313+0000","last_peered":"2023-07-14T15:57:27.170313+0000","last_clean":"2023-07-14T15:57:27.170313+0000","last_became_active":"2023-07-14T15:57:24.949145+0000","last_became_peered":"2023-07-14T15:57:24.949145+0000","last_unstale":"2023-07-14T15:57:27.170313+0000","last_undegraded":"2023-07-14T15:57:27.170313+0000","last_fullsized":"2023-07-14T15:57:27.170313+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:41:33.784826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170420+0000","last_change":"2023-07-14T15:57:25.708735+0000","last_active":"2023-07-14T15:57:27.170420+0000","last_peered":"2023-07-14T15:57:27.170420+0000","last_clean":"2023-07-14T15:57:27.170420+0000","last_became_active":"2023-07-14T15:57:25.708251+0000","last_became_peered":"2023-07-14T15:57:25.708251+0000","last_unstale":"2023-07-14T15:57:27.170420+0000","last_undegraded":"2023-07-14T15:57:27.170420+0000","last_fullsized":"2023-07-14T15:57:27.170420+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:54:39.767268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"35'1","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170498+0000","last_change":"2023-07-14T15:57:24.950806+0000","last_active":"2023-07-14T15:57:27.170498+0000","last_peered":"2023-07-14T15:57:27.170498+0000","last_clean":"2023-07-14T15:57:27.170498+0000","last_became_active":"2023-07-14T15:57:24.950499+0000","last_became_peered":"2023-07-14T15:57:24.950499+0000","last_unstale":"2023-07-14T15:57:27.170498+0000","last_undegraded":"2023-07-14T15:57:27.170498+0000","last_fullsized":"2023-07-14T15:57:27.170498+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:27:09.914578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170004+0000","last_change":"2023-07-14T15:57:25.707810+0000","last_active":"2023-07-14T15:57:27.170004+0000","last_peered":"2023-07-14T15:57:27.170004+0000","last_clean":"2023-07-14T15:57:27.170004+0000","last_became_active":"2023-07-14T15:57:25.707540+0000","last_became_peered":"2023-07-14T15:57:25.707540+0000","last_unstale":"2023-07-14T15:57:27.170004+0000","last_undegraded":"2023-07-14T15:57:27.170004+0000","last_fullsized":"2023-07-14T15:57:27.170004+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:11:15.367018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694350+0000","last_change":"2023-07-14T15:57:24.943847+0000","last_active":"2023-07-14T15:57:26.694350+0000","last_peered":"2023-07-14T15:57:26.694350+0000","last_clean":"2023-07-14T15:57:26.694350+0000","last_became_active":"2023-07-14T15:57:24.943377+0000","last_became_peered":"2023-07-14T15:57:24.943377+0000","last_unstale":"2023-07-14T15:57:26.694350+0000","last_undegraded":"2023-07-14T15:57:26.694350+0000","last_fullsized":"2023-07-14T15:57:26.694350+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:15:32.247155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170632+0000","last_change":"2023-07-14T15:57:25.713671+0000","last_active":"2023-07-14T15:57:27.170632+0000","last_peered":"2023-07-14T15:57:27.170632+0000","last_clean":"2023-07-14T15:57:27.170632+0000","last_became_active":"2023-07-14T15:57:25.713277+0000","last_became_peered":"2023-07-14T15:57:25.713277+0000","last_unstale":"2023-07-14T15:57:27.170632+0000","last_undegraded":"2023-07-14T15:57:27.170632+0000","last_fullsized":"2023-07-14T15:57:27.170632+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:12:57.578787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"35'1","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.077142+0000","last_change":"2023-07-14T15:57:24.947575+0000","last_active":"2023-07-14T15:57:27.077142+0000","last_peered":"2023-07-14T15:57:27.077142+0000","last_clean":"2023-07-14T15:57:27.077142+0000","last_became_active":"2023-07-14T15:57:24.947236+0000","last_became_peered":"2023-07-14T15:57:24.947236+0000","last_unstale":"2023-07-14T15:57:27.077142+0000","last_undegraded":"2023-07-14T15:57:27.077142+0000","last_fullsized":"2023-07-14T15:57:27.077142+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:37:33.879198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694961+0000","last_change":"2023-07-14T15:57:25.715669+0000","last_active":"2023-07-14T15:57:26.694961+0000","last_peered":"2023-07-14T15:57:26.694961+0000","last_clean":"2023-07-14T15:57:26.694961+0000","last_became_active":"2023-07-14T15:57:25.715414+0000","last_became_peered":"2023-07-14T15:57:25.715414+0000","last_unstale":"2023-07-14T15:57:26.694961+0000","last_undegraded":"2023-07-14T15:57:26.694961+0000","last_fullsized":"2023-07-14T15:57:26.694961+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:11:15.367018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694919+0000","last_change":"2023-07-14T15:57:24.946879+0000","last_active":"2023-07-14T15:57:26.694919+0000","last_peered":"2023-07-14T15:57:26.694919+0000","last_clean":"2023-07-14T15:57:26.694919+0000","last_became_active":"2023-07-14T15:57:24.946470+0000","last_became_peered":"2023-07-14T15:57:24.946470+0000","last_unstale":"2023-07-14T15:57:26.694919+0000","last_undegraded":"2023-07-14T15:57:26.694919+0000","last_fullsized":"2023-07-14T15:57:26.694919+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:24:27.076859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693801+0000","last_change":"2023-07-14T15:57:25.709753+0000","last_active":"2023-07-14T15:57:26.693801+0000","last_peered":"2023-07-14T15:57:26.693801+0000","last_clean":"2023-07-14T15:57:26.693801+0000","last_became_active":"2023-07-14T15:57:25.709467+0000","last_became_peered":"2023-07-14T15:57:25.709467+0000","last_unstale":"2023-07-14T15:57:26.693801+0000","last_undegraded":"2023-07-14T15:57:26.693801+0000","last_fullsized":"2023-07-14T15:57:26.693801+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:54:59.872919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694767+0000","last_change":"2023-07-14T15:57:24.942184+0000","last_active":"2023-07-14T15:57:26.694767+0000","last_peered":"2023-07-14T15:57:26.694767+0000","last_clean":"2023-07-14T15:57:26.694767+0000","last_became_active":"2023-07-14T15:57:24.941875+0000","last_became_peered":"2023-07-14T15:57:24.941875+0000","last_unstale":"2023-07-14T15:57:26.694767+0000","last_undegraded":"2023-07-14T15:57:26.694767+0000","last_fullsized":"2023-07-14T15:57:26.694767+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:52:45.470519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693423+0000","last_change":"2023-07-14T15:57:25.704418+0000","last_active":"2023-07-14T15:57:26.693423+0000","last_peered":"2023-07-14T15:57:26.693423+0000","last_clean":"2023-07-14T15:57:26.693423+0000","last_became_active":"2023-07-14T15:57:25.704119+0000","last_became_peered":"2023-07-14T15:57:25.704119+0000","last_unstale":"2023-07-14T15:57:26.693423+0000","last_undegraded":"2023-07-14T15:57:26.693423+0000","last_fullsized":"2023-07-14T15:57:26.693423+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:45:31.081120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170232+0000","last_change":"2023-07-14T15:57:24.949131+0000","last_active":"2023-07-14T15:57:27.170232+0000","last_peered":"2023-07-14T15:57:27.170232+0000","last_clean":"2023-07-14T15:57:27.170232+0000","last_became_active":"2023-07-14T15:57:24.948700+0000","last_became_peered":"2023-07-14T15:57:24.948700+0000","last_unstale":"2023-07-14T15:57:27.170232+0000","last_undegraded":"2023-07-14T15:57:27.170232+0000","last_fullsized":"2023-07-14T15:57:27.170232+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:08:57.705148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.079927+0000","last_change":"2023-07-14T15:57:25.702410+0000","last_active":"2023-07-14T15:57:27.079927+0000","last_peered":"2023-07-14T15:57:27.079927+0000","last_clean":"2023-07-14T15:57:27.079927+0000","last_became_active":"2023-07-14T15:57:25.701678+0000","last_became_peered":"2023-07-14T15:57:25.701678+0000","last_unstale":"2023-07-14T15:57:27.079927+0000","last_undegraded":"2023-07-14T15:57:27.079927+0000","last_fullsized":"2023-07-14T15:57:27.079927+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:16:17.080122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.169603+0000","last_change":"2023-07-14T15:57:24.950805+0000","last_active":"2023-07-14T15:57:27.169603+0000","last_peered":"2023-07-14T15:57:27.169603+0000","last_clean":"2023-07-14T15:57:27.169603+0000","last_became_active":"2023-07-14T15:57:24.950510+0000","last_became_peered":"2023-07-14T15:57:24.950510+0000","last_unstale":"2023-07-14T15:57:27.169603+0000","last_undegraded":"2023-07-14T15:57:27.169603+0000","last_fullsized":"2023-07-14T15:57:27.169603+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:39:02.486312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693849+0000","last_change":"2023-07-14T15:57:25.704591+0000","last_active":"2023-07-14T15:57:26.693849+0000","last_peered":"2023-07-14T15:57:26.693849+0000","last_clean":"2023-07-14T15:57:26.693849+0000","last_became_active":"2023-07-14T15:57:25.704350+0000","last_became_peered":"2023-07-14T15:57:25.704350+0000","last_unstale":"2023-07-14T15:57:26.693849+0000","last_undegraded":"2023-07-14T15:57:26.693849+0000","last_fullsized":"2023-07-14T15:57:26.693849+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:22:31.192902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.169906+0000","last_change":"2023-07-14T15:57:24.949538+0000","last_active":"2023-07-14T15:57:27.169906+0000","last_peered":"2023-07-14T15:57:27.169906+0000","last_clean":"2023-07-14T15:57:27.169906+0000","last_became_active":"2023-07-14T15:57:24.949233+0000","last_became_peered":"2023-07-14T15:57:24.949233+0000","last_unstale":"2023-07-14T15:57:27.169906+0000","last_undegraded":"2023-07-14T15:57:27.169906+0000","last_fullsized":"2023-07-14T15:57:27.169906+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:08:42.159884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.076745+0000","last_change":"2023-07-14T15:57:25.707893+0000","last_active":"2023-07-14T15:57:27.076745+0000","last_peered":"2023-07-14T15:57:27.076745+0000","last_clean":"2023-07-14T15:57:27.076745+0000","last_became_active":"2023-07-14T15:57:25.707515+0000","last_became_peered":"2023-07-14T15:57:25.707515+0000","last_unstale":"2023-07-14T15:57:27.076745+0000","last_undegraded":"2023-07-14T15:57:27.076745+0000","last_fullsized":"2023-07-14T15:57:27.076745+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:13:20.474319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693948+0000","last_change":"2023-07-14T15:57:24.944835+0000","last_active":"2023-07-14T15:57:26.693948+0000","last_peered":"2023-07-14T15:57:26.693948+0000","last_clean":"2023-07-14T15:57:26.693948+0000","last_became_active":"2023-07-14T15:57:24.944421+0000","last_became_peered":"2023-07-14T15:57:24.944421+0000","last_unstale":"2023-07-14T15:57:26.693948+0000","last_undegraded":"2023-07-14T15:57:26.693948+0000","last_fullsized":"2023-07-14T15:57:26.693948+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:36:20.633161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694805+0000","last_change":"2023-07-14T15:56:02.621850+0000","last_active":"2023-07-14T15:57:26.694805+0000","last_peered":"2023-07-14T15:57:26.694805+0000","last_clean":"2023-07-14T15:57:26.694805+0000","last_became_active":"2023-07-14T15:56:02.621471+0000","last_became_peered":"2023-07-14T15:56:02.621471+0000","last_unstale":"2023-07-14T15:57:26.694805+0000","last_undegraded":"2023-07-14T15:57:26.694805+0000","last_fullsized":"2023-07-14T15:57:26.694805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:31:52.328091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694678+0000","last_change":"2023-07-14T15:57:25.717543+0000","last_active":"2023-07-14T15:57:26.694678+0000","last_peered":"2023-07-14T15:57:26.694678+0000","last_clean":"2023-07-14T15:57:26.694678+0000","last_became_active":"2023-07-14T15:57:25.717185+0000","last_became_peered":"2023-07-14T15:57:25.717185+0000","last_unstale":"2023-07-14T15:57:26.694678+0000","last_undegraded":"2023-07-14T15:57:26.694678+0000","last_fullsized":"2023-07-14T15:57:26.694678+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:54:28.947637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.077156+0000","last_change":"2023-07-14T15:57:24.943282+0000","last_active":"2023-07-14T15:57:27.077156+0000","last_peered":"2023-07-14T15:57:27.077156+0000","last_clean":"2023-07-14T15:57:27.077156+0000","last_became_active":"2023-07-14T15:57:24.942964+0000","last_became_peered":"2023-07-14T15:57:24.942964+0000","last_unstale":"2023-07-14T15:57:27.077156+0000","last_undegraded":"2023-07-14T15:57:27.077156+0000","last_fullsized":"2023-07-14T15:57:27.077156+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:50:50.045238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694297+0000","last_change":"2023-07-14T15:56:02.621963+0000","last_active":"2023-07-14T15:57:26.694297+0000","last_peered":"2023-07-14T15:57:26.694297+0000","last_clean":"2023-07-14T15:57:26.694297+0000","last_became_active":"2023-07-14T15:56:02.621678+0000","last_became_peered":"2023-07-14T15:56:02.621678+0000","last_unstale":"2023-07-14T15:57:26.694297+0000","last_undegraded":"2023-07-14T15:57:26.694297+0000","last_fullsized":"2023-07-14T15:57:26.694297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:13:35.392704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.079851+0000","last_change":"2023-07-14T15:57:25.702765+0000","last_active":"2023-07-14T15:57:27.079851+0000","last_peered":"2023-07-14T15:57:27.079851+0000","last_clean":"2023-07-14T15:57:27.079851+0000","last_became_active":"2023-07-14T15:57:25.702508+0000","last_became_peered":"2023-07-14T15:57:25.702508+0000","last_unstale":"2023-07-14T15:57:27.079851+0000","last_undegraded":"2023-07-14T15:57:27.079851+0000","last_fullsized":"2023-07-14T15:57:27.079851+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:18:05.260347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"36'1","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.078951+0000","last_change":"2023-07-14T15:57:24.945667+0000","last_active":"2023-07-14T15:57:27.078951+0000","last_peered":"2023-07-14T15:57:27.078951+0000","last_clean":"2023-07-14T15:57:27.078951+0000","last_became_active":"2023-07-14T15:57:24.945404+0000","last_became_peered":"2023-07-14T15:57:24.945404+0000","last_unstale":"2023-07-14T15:57:27.078951+0000","last_undegraded":"2023-07-14T15:57:27.078951+0000","last_fullsized":"2023-07-14T15:57:27.078951+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:38:23.686073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.076753+0000","last_change":"2023-07-14T15:56:01.925110+0000","last_active":"2023-07-14T15:57:27.076753+0000","last_peered":"2023-07-14T15:57:27.076753+0000","last_clean":"2023-07-14T15:57:27.076753+0000","last_became_active":"2023-07-14T15:56:01.924723+0000","last_became_peered":"2023-07-14T15:56:01.924723+0000","last_unstale":"2023-07-14T15:57:27.076753+0000","last_undegraded":"2023-07-14T15:57:27.076753+0000","last_fullsized":"2023-07-14T15:57:27.076753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:03:05.866904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694461+0000","last_change":"2023-07-14T15:57:25.711424+0000","last_active":"2023-07-14T15:57:26.694461+0000","last_peered":"2023-07-14T15:57:26.694461+0000","last_clean":"2023-07-14T15:57:26.694461+0000","last_became_active":"2023-07-14T15:57:25.710670+0000","last_became_peered":"2023-07-14T15:57:25.710670+0000","last_unstale":"2023-07-14T15:57:26.694461+0000","last_undegraded":"2023-07-14T15:57:26.694461+0000","last_fullsized":"2023-07-14T15:57:26.694461+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:25:01.452256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.079891+0000","last_change":"2023-07-14T15:57:24.943746+0000","last_active":"2023-07-14T15:57:27.079891+0000","last_peered":"2023-07-14T15:57:27.079891+0000","last_clean":"2023-07-14T15:57:27.079891+0000","last_became_active":"2023-07-14T15:57:24.943464+0000","last_became_peered":"2023-07-14T15:57:24.943464+0000","last_unstale":"2023-07-14T15:57:27.079891+0000","last_undegraded":"2023-07-14T15:57:27.079891+0000","last_fullsized":"2023-07-14T15:57:27.079891+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:56:11.761557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693926+0000","last_change":"2023-07-14T15:56:01.923465+0000","last_active":"2023-07-14T15:57:26.693926+0000","last_peered":"2023-07-14T15:57:26.693926+0000","last_clean":"2023-07-14T15:57:26.693926+0000","last_became_active":"2023-07-14T15:56:01.923160+0000","last_became_peered":"2023-07-14T15:56:01.923160+0000","last_unstale":"2023-07-14T15:57:26.693926+0000","last_undegraded":"2023-07-14T15:57:26.693926+0000","last_fullsized":"2023-07-14T15:57:26.693926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:59:26.813576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":191,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.169688+0000","last_change":"2023-07-14T15:55:54.040065+0000","last_active":"2023-07-14T15:57:27.169688+0000","last_peered":"2023-07-14T15:57:27.169688+0000","last_clean":"2023-07-14T15:57:27.169688+0000","last_became_active":"2023-07-14T15:55:54.038885+0000","last_became_peered":"2023-07-14T15:55:54.038885+0000","last_unstale":"2023-07-14T15:57:27.169688+0000","last_undegraded":"2023-07-14T15:57:27.169688+0000","last_fullsized":"2023-07-14T15:57:27.169688+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:55:53.025696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:55:53.025696+0000","last_clean_scrub_stamp":"2023-07-14T15:55:53.025696+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:52:57.048697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.076975+0000","last_change":"2023-07-14T15:57:25.703197+0000","last_active":"2023-07-14T15:57:27.076975+0000","last_peered":"2023-07-14T15:57:27.076975+0000","last_clean":"2023-07-14T15:57:27.076975+0000","last_became_active":"2023-07-14T15:57:25.702875+0000","last_became_peered":"2023-07-14T15:57:25.702875+0000","last_unstale":"2023-07-14T15:57:27.076975+0000","last_undegraded":"2023-07-14T15:57:27.076975+0000","last_fullsized":"2023-07-14T15:57:27.076975+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:00:49.136871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694484+0000","last_change":"2023-07-14T15:57:24.945870+0000","last_active":"2023-07-14T15:57:26.694484+0000","last_peered":"2023-07-14T15:57:26.694484+0000","last_clean":"2023-07-14T15:57:26.694484+0000","last_became_active":"2023-07-14T15:57:24.945590+0000","last_became_peered":"2023-07-14T15:57:24.945590+0000","last_unstale":"2023-07-14T15:57:26.694484+0000","last_undegraded":"2023-07-14T15:57:26.694484+0000","last_fullsized":"2023-07-14T15:57:26.694484+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:26:43.460807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693733+0000","last_change":"2023-07-14T15:56:01.920714+0000","last_active":"2023-07-14T15:57:26.693733+0000","last_peered":"2023-07-14T15:57:26.693733+0000","last_clean":"2023-07-14T15:57:26.693733+0000","last_became_active":"2023-07-14T15:56:01.920325+0000","last_became_peered":"2023-07-14T15:56:01.920325+0000","last_unstale":"2023-07-14T15:57:26.693733+0000","last_undegraded":"2023-07-14T15:57:26.693733+0000","last_fullsized":"2023-07-14T15:57:26.693733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:34:47.858129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.170074+0000","last_change":"2023-07-14T15:57:25.716751+0000","last_active":"2023-07-14T15:57:27.170074+0000","last_peered":"2023-07-14T15:57:27.170074+0000","last_clean":"2023-07-14T15:57:27.170074+0000","last_became_active":"2023-07-14T15:57:25.716471+0000","last_became_peered":"2023-07-14T15:57:25.716471+0000","last_unstale":"2023-07-14T15:57:27.170074+0000","last_undegraded":"2023-07-14T15:57:27.170074+0000","last_fullsized":"2023-07-14T15:57:27.170074+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:13:20.474319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.079980+0000","last_change":"2023-07-14T15:57:24.943010+0000","last_active":"2023-07-14T15:57:27.079980+0000","last_peered":"2023-07-14T15:57:27.079980+0000","last_clean":"2023-07-14T15:57:27.079980+0000","last_became_active":"2023-07-14T15:57:24.942673+0000","last_became_peered":"2023-07-14T15:57:24.942673+0000","last_unstale":"2023-07-14T15:57:27.079980+0000","last_undegraded":"2023-07-14T15:57:27.079980+0000","last_fullsized":"2023-07-14T15:57:27.079980+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:26:16.015035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694065+0000","last_change":"2023-07-14T15:56:01.923631+0000","last_active":"2023-07-14T15:57:26.694065+0000","last_peered":"2023-07-14T15:57:26.694065+0000","last_clean":"2023-07-14T15:57:26.694065+0000","last_became_active":"2023-07-14T15:56:01.922783+0000","last_became_peered":"2023-07-14T15:56:01.922783+0000","last_unstale":"2023-07-14T15:57:26.694065+0000","last_undegraded":"2023-07-14T15:57:26.694065+0000","last_fullsized":"2023-07-14T15:57:26.694065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:31:16.123367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694160+0000","last_change":"2023-07-14T15:57:25.715467+0000","last_active":"2023-07-14T15:57:26.694160+0000","last_peered":"2023-07-14T15:57:26.694160+0000","last_clean":"2023-07-14T15:57:26.694160+0000","last_became_active":"2023-07-14T15:57:25.715169+0000","last_became_peered":"2023-07-14T15:57:25.715169+0000","last_unstale":"2023-07-14T15:57:26.694160+0000","last_undegraded":"2023-07-14T15:57:26.694160+0000","last_fullsized":"2023-07-14T15:57:26.694160+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:18:30.445378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694374+0000","last_change":"2023-07-14T15:57:24.948604+0000","last_active":"2023-07-14T15:57:26.694374+0000","last_peered":"2023-07-14T15:57:26.694374+0000","last_clean":"2023-07-14T15:57:26.694374+0000","last_became_active":"2023-07-14T15:57:24.948128+0000","last_became_peered":"2023-07-14T15:57:24.948128+0000","last_unstale":"2023-07-14T15:57:26.694374+0000","last_undegraded":"2023-07-14T15:57:26.694374+0000","last_fullsized":"2023-07-14T15:57:26.694374+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:56:33.930892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694844+0000","last_change":"2023-07-14T15:56:01.965649+0000","last_active":"2023-07-14T15:57:26.694844+0000","last_peered":"2023-07-14T15:57:26.694844+0000","last_clean":"2023-07-14T15:57:26.694844+0000","last_became_active":"2023-07-14T15:56:01.965344+0000","last_became_peered":"2023-07-14T15:56:01.965344+0000","last_unstale":"2023-07-14T15:57:26.694844+0000","last_undegraded":"2023-07-14T15:57:26.694844+0000","last_fullsized":"2023-07-14T15:57:26.694844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:30:36.061855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:27.079965+0000","last_change":"2023-07-14T15:57:25.714552+0000","last_active":"2023-07-14T15:57:27.079965+0000","last_peered":"2023-07-14T15:57:27.079965+0000","last_clean":"2023-07-14T15:57:27.079965+0000","last_became_active":"2023-07-14T15:57:25.713523+0000","last_became_peered":"2023-07-14T15:57:25.713523+0000","last_unstale":"2023-07-14T15:57:27.079965+0000","last_undegraded":"2023-07-14T15:57:27.079965+0000","last_fullsized":"2023-07-14T15:57:27.079965+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:24.924637+0000","last_clean_scrub_stamp":"2023-07-14T15:57:24.924637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:58:44.095117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.693419+0000","last_change":"2023-07-14T15:57:24.948449+0000","last_active":"2023-07-14T15:57:26.693419+0000","last_peered":"2023-07-14T15:57:26.693419+0000","last_clean":"2023-07-14T15:57:26.693419+0000","last_became_active":"2023-07-14T15:57:24.948145+0000","last_became_peered":"2023-07-14T15:57:24.948145+0000","last_unstale":"2023-07-14T15:57:26.693419+0000","last_undegraded":"2023-07-14T15:57:26.693419+0000","last_fullsized":"2023-07-14T15:57:26.693419+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:57:23.922534+0000","last_clean_scrub_stamp":"2023-07-14T15:57:23.922534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:43:28.358856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-14T15:57:26.694508+0000","last_change":"2023-07-14T15:56:01.966578+0000","last_active":"2023-07-14T15:57:26.694508+0000","last_peered":"2023-07-14T15:57:26.694508+0000","last_clean":"2023-07-14T15:57:26.694508+0000","last_became_active":"2023-07-14T15:56:01.966216+0000","last_became_peered":"2023-07-14T15:56:01.966216+0000","last_unstale":"2023-07-14T15:57:26.694508+0000","last_undegraded":"2023-07-14T15:57:26.694508+0000","last_fullsized":"2023-07-14T15:57:26.694508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:34:54.823729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476760,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":401408,"data_stored":162350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.35099999999999998}]},{"osd":1,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.67500000000000004}]},{"osd":2,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.498},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.58399999999999996}]},{"osd":4,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.63200000000000001}]},{"osd":5,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.72399999999999998}]},{"osd":6,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.749},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.57299999999999995}]},{"osd":7,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.55500000000000005}]}]},{"osd":0,"up_from":16,"seq":68719476761,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":396,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":405504,"data_stored":162352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.443}]},{"osd":2,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.49199999999999999}]},{"osd":3,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.46700000000000003}]},{"osd":4,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.69799999999999995}]},{"osd":5,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.623},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.60799999999999998}]},{"osd":6,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.76300000000000001}]},{"osd":7,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.55800000000000005}]}]},{"osd":6,"up_from":14,"seq":60129542167,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":401408,"data_stored":162294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.52900000000000003}]},{"osd":1,"last update":"Fri Jul 14 15:56:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.82799999999999996}]},{"osd":2,"last update":"Fri Jul 14 15:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.47299999999999998}]},{"osd":3,"last update":"Fri Jul 14 15:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":3.141,"5min":3.141,"15min":3.141},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.76700000000000002}]},{"osd":4,"last update":"Fri Jul 14 15:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.74199999999999999}]},{"osd":5,"last update":"Fri Jul 14 15:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.69599999999999995}]},{"osd":7,"last update":"Fri Jul 14 15:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.81299999999999994}]}]},{"osd":1,"up_from":14,"seq":60129542166,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":972,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":995328,"data_stored":752650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":4.5519999999999996,"5min":4.5519999999999996,"15min":4.5519999999999996},"last":0.39900000000000002},{"interface":"front","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":15.911,"5min":15.911,"15min":15.911},"last":0.53400000000000003}]},{"osd":2,"last update":"Fri Jul 14 15:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":4.5140000000000002,"5min":4.5140000000000002,"15min":4.5140000000000002},"last":0.45900000000000002}]},{"osd":3,"last update":"Fri Jul 14 15:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":4.452,"5min":4.452,"15min":4.452},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":4.2279999999999998,"5min":4.2279999999999998,"15min":4.2279999999999998},"last":0.44400000000000001}]},{"osd":4,"last update":"Fri Jul 14 15:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":4.6200000000000001,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":4.9109999999999996,"5min":4.9109999999999996,"15min":4.9109999999999996},"last":0.95699999999999996}]},{"osd":5,"last update":"Fri Jul 14 15:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":4.1269999999999998,"5min":4.1269999999999998,"15min":4.1269999999999998},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":4.585,"5min":4.585,"15min":4.585},"last":0.93700000000000006}]},{"osd":6,"last update":"Fri Jul 14 15:56:51 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":4.9880000000000004,"5min":4.9880000000000004,"15min":4.9880000000000004},"last":1},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":4.1660000000000004,"5min":4.1660000000000004,"15min":4.1660000000000004},"last":0.84199999999999997}]},{"osd":7,"last update":"Fri Jul 14 15:56:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":4.9530000000000003,"5min":4.9530000000000003,"15min":4.9530000000000003},"last":1.0429999999999999},{"interface":"front","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":4.1959999999999997,"5min":4.1959999999999997,"15min":4.1959999999999997},"last":0.80100000000000005}]}]},{"osd":2,"up_from":15,"seq":64424509464,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":413696,"data_stored":164406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:56:53 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.48599999999999999}]},{"osd":1,"last update":"Fri Jul 14 15:56:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.439},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.55300000000000005}]},{"osd":3,"last update":"Fri Jul 14 15:56:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.505}]},{"osd":4,"last update":"Fri Jul 14 15:56:53 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.745}]},{"osd":5,"last update":"Fri Jul 14 15:56:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.70999999999999996}]},{"osd":6,"last update":"Fri Jul 14 15:56:53 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.68999999999999995}]},{"osd":7,"last update":"Fri Jul 14 15:56:53 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.73299999999999998}]}]},{"osd":4,"up_from":15,"seq":64424509463,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":408,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":417792,"data_stored":163948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.39700000000000002}]},{"osd":1,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.68700000000000006}]},{"osd":2,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.501}]},{"osd":3,"last update":"Fri Jul 14 15:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.626}]},{"osd":5,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.751}]},{"osd":6,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.64700000000000002}]},{"osd":7,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.61499999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509465,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27924,"kb_used_data":972,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343916,"statfs":{"total":96636764160,"available":96608169984,"internally_reserved":0,"allocated":995328,"data_stored":753210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.68500000000000005},{"interface":"front","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":8.1500000000000004,"5min":8.1500000000000004,"15min":8.1500000000000004},"last":0.73699999999999999}]},{"osd":1,"last update":"Fri Jul 14 15:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.65500000000000003}]},{"osd":2,"last update":"Fri Jul 14 15:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.71099999999999997}]},{"osd":3,"last update":"Fri Jul 14 15:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.627},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.75}]},{"osd":4,"last update":"Fri Jul 14 15:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.55700000000000005}]},{"osd":6,"last update":"Fri Jul 14 15:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.64100000000000001}]},{"osd":7,"last update":"Fri Jul 14 15:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.67000000000000004}]}]},{"osd":7,"up_from":15,"seq":64424509464,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":401408,"data_stored":162330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":4.5919999999999996,"5min":4.5919999999999996,"15min":4.5919999999999996},"last":0.64000000000000001}]},{"osd":1,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1,"5min":1,"15min":1},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":4.665,"5min":4.665,"15min":4.665},"last":0.60099999999999998}]},{"osd":2,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":5.4089999999999998,"5min":5.4089999999999998,"15min":5.4089999999999998},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":0.73999999999999999}]},{"osd":3,"last update":"Fri Jul 14 15:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":2.3380000000000001,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":2.3530000000000002,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":0.72699999999999998}]},{"osd":4,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.56399999999999995}]},{"osd":5,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.47899999999999998}]},{"osd":6,"last update":"Fri Jul 14 15:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.505},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.61699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T15:57:35.834 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-14T15:57:35.835 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-14T15:57:36.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.089+0000 7fe03d7ff700 1 Processor -- start 2023-07-14T15:57:36.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.090+0000 7fe03d7ff700 1 -- start start 2023-07-14T15:57:36.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.091+0000 7fe03d7ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe03806b160 0x7fe03806b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:36.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.091+0000 7fe03d7ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe03809a3e0 con 0x7fe0380cdcb0 2023-07-14T15:57:36.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.091+0000 7fe03d7ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0380cea90 con 0x7fe0380d0100 2023-07-14T15:57:36.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.091+0000 7fe03d7ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0380cf810 con 0x7fe03806b160 2023-07-14T15:57:36.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.091+0000 7fe0377fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe0380cdcb0 0x7fe0380cb470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56874/0 (socket says 172.21.15.37:56874) 2023-07-14T15:57:36.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.091+0000 7fe0377fe700 1 -- 172.21.15.37:0/753527665 learned_addr learned my addr 172.21.15.37:0/753527665 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:36.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.091+0000 7fe036ffd700 1 --2- 172.21.15.37:0/753527665 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe03806b160 0x7fe03806b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:36.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.091+0000 7fe0367fc700 1 -- 172.21.15.37:0/753527665 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2760237745 0 0) 0x7fe03809a3e0 con 0x7fe0380cdcb0 2023-07-14T15:57:36.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.092+0000 7fe0367fc700 1 -- 172.21.15.37:0/753527665 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0240035b0 con 0x7fe0380cdcb0 2023-07-14T15:57:36.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.092+0000 7fe0367fc700 1 -- 172.21.15.37:0/753527665 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1520008238 0 0) 0x7fe0380cea90 con 0x7fe0380d0100 2023-07-14T15:57:36.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.092+0000 7fe0367fc700 1 -- 172.21.15.37:0/753527665 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe03809a3e0 con 0x7fe0380d0100 2023-07-14T15:57:36.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.092+0000 7fe0367fc700 1 -- 172.21.15.37:0/753527665 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3507165651 0 0) 0x7fe0240035b0 con 0x7fe0380cdcb0 2023-07-14T15:57:36.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.092+0000 7fe036ffd700 1 -- 172.21.15.37:0/753527665 >> v1:172.21.15.98:6789/0 conn(0x7fe0380d0100 legacy=0x7fe0380cd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:36.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.092+0000 7fe036ffd700 1 -- 172.21.15.37:0/753527665 >> v1:172.21.15.37:6789/0 conn(0x7fe0380cdcb0 legacy=0x7fe0380cb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:36.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.092+0000 7fe036ffd700 1 -- 172.21.15.37:0/753527665 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0380cfa20 con 0x7fe03806b160 2023-07-14T15:57:36.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.092+0000 7fe036ffd700 1 --2- 172.21.15.37:0/753527665 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe03806b160 0x7fe03806b530 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe028009870 tx=0x7fe028009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfe686f4efb533da server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:36.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.092+0000 7fe0367fc700 1 -- 172.21.15.37:0/753527665 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0300019f0 con 0x7fe03806b160 2023-07-14T15:57:36.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.093+0000 7fe0367fc700 1 -- 172.21.15.37:0/753527665 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe028004030 con 0x7fe03806b160 2023-07-14T15:57:36.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.093+0000 7fe0367fc700 1 -- 172.21.15.37:0/753527665 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0280043c0 con 0x7fe03806b160 2023-07-14T15:57:36.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.093+0000 7fe03d7ff700 1 -- 172.21.15.37:0/753527665 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe03806b160 msgr2=0x7fe03806b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:36.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.093+0000 7fe03d7ff700 1 --2- 172.21.15.37:0/753527665 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe03806b160 0x7fe03806b530 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe028009870 tx=0x7fe028009b80 comp rx=0 tx=0).stop 2023-07-14T15:57:36.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.093+0000 7fe03d7ff700 1 -- 172.21.15.37:0/753527665 shutdown_connections 2023-07-14T15:57:36.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.093+0000 7fe03d7ff700 1 --2- 172.21.15.37:0/753527665 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe03806b160 0x7fe03806b530 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:36.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.093+0000 7fe03d7ff700 1 -- 172.21.15.37:0/753527665 >> 172.21.15.37:0/753527665 conn(0x7fe038099fe0 msgr2=0x7fe0380d0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:36.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.093+0000 7fe03d7ff700 1 -- 172.21.15.37:0/753527665 shutdown_connections 2023-07-14T15:57:36.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.093+0000 7fe03d7ff700 1 -- 172.21.15.37:0/753527665 wait complete. 2023-07-14T15:57:36.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.095+0000 7fe03d7ff700 1 Processor -- start 2023-07-14T15:57:36.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.095+0000 7fe03d7ff700 1 -- start start 2023-07-14T15:57:36.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.096+0000 7fe03d7ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe03806b160 0x7fe0381e6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:36.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.096+0000 7fe03d7ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe0380cdcb0 0x7fe0380c4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:36.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.096+0000 7fe03d7ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0380d0100 0x7fe038152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:36.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.096+0000 7fe03d7ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0380c5cb0 con 0x7fe0380d0100 2023-07-14T15:57:36.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.096+0000 7fe03d7ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0380c4d90 con 0x7fe03806b160 2023-07-14T15:57:36.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.096+0000 7fe03d7ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0380c5030 con 0x7fe0380cdcb0 2023-07-14T15:57:36.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.096+0000 7fe0377fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0380d0100 0x7fe038152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:36.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.096+0000 7fe0377fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0380d0100 0x7fe038152fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38624/0 (socket says 172.21.15.37:38624) 2023-07-14T15:57:36.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.096+0000 7fe0377fe700 1 -- 172.21.15.37:0/1205949789 learned_addr learned my addr 172.21.15.37:0/1205949789 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:36.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.096+0000 7fe036ffd700 1 --2- 172.21.15.37:0/1205949789 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe03806b160 0x7fe0381e6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:36.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.097+0000 7fe02ffff700 1 --2- 172.21.15.37:0/1205949789 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe0380cdcb0 0x7fe0380c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:36.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.097+0000 7fe0377fe700 1 -- 172.21.15.37:0/1205949789 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe0380cdcb0 msgr2=0x7fe0380c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:36.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.097+0000 7fe0377fe700 1 --2- 172.21.15.37:0/1205949789 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe0380cdcb0 0x7fe0380c4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:36.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.097+0000 7fe0377fe700 1 -- 172.21.15.37:0/1205949789 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe03806b160 msgr2=0x7fe0381e6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:36.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.097+0000 7fe0377fe700 1 --2- 172.21.15.37:0/1205949789 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe03806b160 0x7fe0381e6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:36.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.097+0000 7fe0377fe700 1 -- 172.21.15.37:0/1205949789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0280094a0 con 0x7fe0380d0100 2023-07-14T15:57:36.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.097+0000 7fe02ffff700 1 --2- 172.21.15.37:0/1205949789 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe0380cdcb0 0x7fe0380c4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:57:36.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.097+0000 7fe0377fe700 1 --2- 172.21.15.37:0/1205949789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0380d0100 0x7fe038152fb0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe030001870 tx=0x7fe03000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:36.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.097+0000 7fe02f7fe700 1 -- 172.21.15.37:0/1205949789 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03000ad80 con 0x7fe0380d0100 2023-07-14T15:57:36.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.097+0000 7fe02f7fe700 1 -- 172.21.15.37:0/1205949789 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0300070d0 con 0x7fe0380d0100 2023-07-14T15:57:36.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.097+0000 7fe03d7ff700 1 -- 172.21.15.37:0/1205949789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0380c5310 con 0x7fe0380d0100 2023-07-14T15:57:36.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.097+0000 7fe02f7fe700 1 -- 172.21.15.37:0/1205949789 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe030007480 con 0x7fe0380d0100 2023-07-14T15:57:36.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.097+0000 7fe03d7ff700 1 -- 172.21.15.37:0/1205949789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0380c58d0 con 0x7fe0380d0100 2023-07-14T15:57:36.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.098+0000 7fe03d7ff700 1 -- 172.21.15.37:0/1205949789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0380b2610 con 0x7fe0380d0100 2023-07-14T15:57:36.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.099+0000 7fe02f7fe700 1 -- 172.21.15.37:0/1205949789 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe0300075e0 con 0x7fe0380d0100 2023-07-14T15:57:36.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.100+0000 7fe02f7fe700 1 --2- 172.21.15.37:0/1205949789 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe01806ace0 0x7fe01806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:36.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.100+0000 7fe02f7fe700 1 -- 172.21.15.37:0/1205949789 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe030089520 con 0x7fe0380d0100 2023-07-14T15:57:36.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.101+0000 7fe036ffd700 1 --2- 172.21.15.37:0/1205949789 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe01806ace0 0x7fe01806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:36.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.101+0000 7fe036ffd700 1 --2- 172.21.15.37:0/1205949789 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe01806ace0 0x7fe01806d190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe0280090b0 tx=0x7fe028008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:36.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.105+0000 7fe02f7fe700 1 -- 172.21.15.37:0/1205949789 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe030054530 con 0x7fe0380d0100 2023-07-14T15:57:36.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.396+0000 7fe03d7ff700 1 -- 172.21.15.37:0/1205949789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fe038067840 con 0x7fe0380d0100 2023-07-14T15:57:36.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.400+0000 7fe02f7fe700 1 -- 172.21.15.37:0/1205949789 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7fe030057b50 con 0x7fe0380d0100 2023-07-14T15:57:36.385 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2023-07-14T15:57:36.386 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDWb7Fk8l4jKRAAD40aK9YW0bgBjt3LF5EM2Q== 2023-07-14T15:57:36.386 INFO:teuthology.orchestra.run.smithi037.stdout: caps mds = "allow" 2023-07-14T15:57:36.386 INFO:teuthology.orchestra.run.smithi037.stdout: caps mon = "allow r" 2023-07-14T15:57:36.386 INFO:teuthology.orchestra.run.smithi037.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-14T15:57:36.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.402+0000 7fe03d7ff700 1 -- 172.21.15.37:0/1205949789 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe01806ace0 msgr2=0x7fe01806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:36.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.402+0000 7fe03d7ff700 1 --2- 172.21.15.37:0/1205949789 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe01806ace0 0x7fe01806d190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe0280090b0 tx=0x7fe028008030 comp rx=0 tx=0).stop 2023-07-14T15:57:36.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.402+0000 7fe03d7ff700 1 -- 172.21.15.37:0/1205949789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0380d0100 msgr2=0x7fe038152fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:36.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.402+0000 7fe03d7ff700 1 --2- 172.21.15.37:0/1205949789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0380d0100 0x7fe038152fb0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe030001870 tx=0x7fe03000a340 comp rx=0 tx=0).stop 2023-07-14T15:57:36.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.402+0000 7fe03d7ff700 1 -- 172.21.15.37:0/1205949789 shutdown_connections 2023-07-14T15:57:36.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.402+0000 7fe03d7ff700 1 --2- 172.21.15.37:0/1205949789 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe03806b160 0x7fe0381e6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:36.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.402+0000 7fe03d7ff700 1 --2- 172.21.15.37:0/1205949789 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe01806ace0 0x7fe01806d190 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:36.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.402+0000 7fe03d7ff700 1 --2- 172.21.15.37:0/1205949789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0380d0100 0x7fe038152fb0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:36.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.402+0000 7fe03d7ff700 1 --2- 172.21.15.37:0/1205949789 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe0380cdcb0 0x7fe0380c4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:36.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.402+0000 7fe03d7ff700 1 -- 172.21.15.37:0/1205949789 >> 172.21.15.37:0/1205949789 conn(0x7fe038099fe0 msgr2=0x7fe0380b61d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:36.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.403+0000 7fe03d7ff700 1 -- 172.21.15.37:0/1205949789 shutdown_connections 2023-07-14T15:57:36.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.403+0000 7fe03d7ff700 1 -- 172.21.15.37:0/1205949789 wait complete. 2023-07-14T15:57:36.390 INFO:teuthology.orchestra.run.smithi037.stderr:updated caps for client.0 2023-07-14T15:57:36.406 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T15:57:36.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.622+0000 7f819edff700 1 Processor -- start 2023-07-14T15:57:36.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.622+0000 7f819edff700 1 -- start start 2023-07-14T15:57:36.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.623+0000 7f819edff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f81981593c0 0x7f81980ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:36.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.623+0000 7f819edff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f8198159790 0x7f81980af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:36.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.623+0000 7f819edff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81980c9540 con 0x7f81980c9b30 2023-07-14T15:57:36.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.623+0000 7f819edff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81980c9ff0 con 0x7f81981593c0 2023-07-14T15:57:36.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.623+0000 7f819edff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81980ce3d0 con 0x7f8198159790 2023-07-14T15:57:36.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.623+0000 7f819cb9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f81981593c0 0x7f81980ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:36.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.624+0000 7f819cb9b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f81981593c0 0x7f81980ccce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38626/0 (socket says 172.21.15.37:38626) 2023-07-14T15:57:36.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.624+0000 7f819cb9b700 1 -- 172.21.15.37:0/2537880941 learned_addr learned my addr 172.21.15.37:0/2537880941 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:36.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.624+0000 7f819d39c700 1 --2- 172.21.15.37:0/2537880941 >> v2:172.21.15.98:3300/0 conn(0x7f8198159790 0x7f81980af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:36.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.624+0000 7f819cb9b700 1 -- 172.21.15.37:0/2537880941 >> v2:172.21.15.98:3300/0 conn(0x7f8198159790 msgr2=0x7f81980af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:36.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.624+0000 7f819cb9b700 1 --2- 172.21.15.37:0/2537880941 >> v2:172.21.15.98:3300/0 conn(0x7f8198159790 0x7f81980af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:36.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.624+0000 7f819cb9b700 1 -- 172.21.15.37:0/2537880941 >> v1:172.21.15.98:6789/0 conn(0x7f81980c9b30 legacy=0x7f819815db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:36.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.624+0000 7f819cb9b700 1 -- 172.21.15.37:0/2537880941 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81980ce6b0 con 0x7f81981593c0 2023-07-14T15:57:36.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.624+0000 7f819cb9b700 1 --2- 172.21.15.37:0/2537880941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81981593c0 0x7f81980ccce0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8198071310 tx=0x7f818c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a7bea7450cd290f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:36.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.625+0000 7f81977fe700 1 -- 172.21.15.37:0/2537880941 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818c011830 con 0x7f81981593c0 2023-07-14T15:57:36.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.625+0000 7f81977fe700 1 -- 172.21.15.37:0/2537880941 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f818c011990 con 0x7f81981593c0 2023-07-14T15:57:36.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.625+0000 7f81977fe700 1 -- 172.21.15.37:0/2537880941 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818c011d20 con 0x7f81981593c0 2023-07-14T15:57:36.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.625+0000 7f819edff700 1 -- 172.21.15.37:0/2537880941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81981593c0 msgr2=0x7f81980ccce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:36.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.625+0000 7f819edff700 1 --2- 172.21.15.37:0/2537880941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81981593c0 0x7f81980ccce0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8198071310 tx=0x7f818c009bd0 comp rx=0 tx=0).stop 2023-07-14T15:57:36.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.625+0000 7f819edff700 1 -- 172.21.15.37:0/2537880941 shutdown_connections 2023-07-14T15:57:36.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.625+0000 7f819edff700 1 --2- 172.21.15.37:0/2537880941 >> v2:172.21.15.98:3300/0 conn(0x7f8198159790 0x7f81980af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:36.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.625+0000 7f819edff700 1 --2- 172.21.15.37:0/2537880941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81981593c0 0x7f81980ccce0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:36.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.625+0000 7f819edff700 1 -- 172.21.15.37:0/2537880941 >> 172.21.15.37:0/2537880941 conn(0x7f81980b08c0 msgr2=0x7f81980b0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:36.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.625+0000 7f819edff700 1 -- 172.21.15.37:0/2537880941 shutdown_connections 2023-07-14T15:57:36.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.625+0000 7f819edff700 1 -- 172.21.15.37:0/2537880941 wait complete. 2023-07-14T15:57:36.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.627+0000 7f819edff700 1 Processor -- start 2023-07-14T15:57:36.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.627+0000 7f819edff700 1 -- start start 2023-07-14T15:57:36.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.628+0000 7f819edff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81980c9b30 0x7f81981553c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:36.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.628+0000 7f819edff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81981593c0 0x7f819814f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:36.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.628+0000 7f819edff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f8198159790 0x7f81981582e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:36.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.628+0000 7f819edff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819814fc40 con 0x7f81981593c0 2023-07-14T15:57:36.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.628+0000 7f819edff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8198156b00 con 0x7f81980c9b30 2023-07-14T15:57:36.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.628+0000 7f819edff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8198158820 con 0x7f8198159790 2023-07-14T15:57:36.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.628+0000 7f8197fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81981593c0 0x7f819814f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:36.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.628+0000 7f8197fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81981593c0 0x7f819814f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38628/0 (socket says 172.21.15.37:38628) 2023-07-14T15:57:36.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.628+0000 7f8197fff700 1 -- 172.21.15.37:0/1825625567 learned_addr learned my addr 172.21.15.37:0/1825625567 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:36.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.629+0000 7f819cb9b700 1 --2- 172.21.15.37:0/1825625567 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81980c9b30 0x7f81981553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:36.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.629+0000 7f819d39c700 1 --2- 172.21.15.37:0/1825625567 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f8198159790 0x7f81981582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:36.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.629+0000 7f8197fff700 1 -- 172.21.15.37:0/1825625567 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f8198159790 msgr2=0x7f81981582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:36.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.629+0000 7f8197fff700 1 --2- 172.21.15.37:0/1825625567 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f8198159790 0x7f81981582e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:36.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.629+0000 7f8197fff700 1 -- 172.21.15.37:0/1825625567 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81980c9b30 msgr2=0x7f81981553c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:36.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.629+0000 7f8197fff700 1 --2- 172.21.15.37:0/1825625567 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81980c9b30 0x7f81981553c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:36.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.629+0000 7f8197fff700 1 -- 172.21.15.37:0/1825625567 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f818c009550 con 0x7f81981593c0 2023-07-14T15:57:36.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.629+0000 7f8197fff700 1 --2- 172.21.15.37:0/1825625567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81981593c0 0x7f819814f700 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f818400c4b0 tx=0x7f818400c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:36.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.629+0000 7f81957fa700 1 -- 172.21.15.37:0/1825625567 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81840052d0 con 0x7f81981593c0 2023-07-14T15:57:36.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.629+0000 7f81957fa700 1 -- 172.21.15.37:0/1825625567 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8184005430 con 0x7f81981593c0 2023-07-14T15:57:36.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.629+0000 7f819edff700 1 -- 172.21.15.37:0/1825625567 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8198155a60 con 0x7f81981593c0 2023-07-14T15:57:36.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.629+0000 7f81957fa700 1 -- 172.21.15.37:0/1825625567 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81840038c0 con 0x7f81981593c0 2023-07-14T15:57:36.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.630+0000 7f819edff700 1 -- 172.21.15.37:0/1825625567 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8198156020 con 0x7f81981593c0 2023-07-14T15:57:36.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.630+0000 7f819edff700 1 -- 172.21.15.37:0/1825625567 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8198067840 con 0x7f81981593c0 2023-07-14T15:57:36.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.632+0000 7f81957fa700 1 -- 172.21.15.37:0/1825625567 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8184003a20 con 0x7f81981593c0 2023-07-14T15:57:36.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.633+0000 7f81957fa700 1 --2- 172.21.15.37:0/1825625567 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f817c06ace0 0x7f817c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:36.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.633+0000 7f81957fa700 1 -- 172.21.15.37:0/1825625567 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8184088810 con 0x7f81981593c0 2023-07-14T15:57:36.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.633+0000 7f819cb9b700 1 --2- 172.21.15.37:0/1825625567 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f817c06ace0 0x7f817c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:36.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.634+0000 7f819cb9b700 1 --2- 172.21.15.37:0/1825625567 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f817c06ace0 0x7f817c06d190 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f818c009c10 tx=0x7f818c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:36.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.637+0000 7f81957fa700 1 -- 172.21.15.37:0/1825625567 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f81840538b0 con 0x7f81981593c0 2023-07-14T15:57:36.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.893+0000 7f819edff700 1 -- 172.21.15.37:0/1825625567 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f81980b16e0 con 0x7f81981593c0 2023-07-14T15:57:36.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.893+0000 7f81957fa700 1 -- 172.21.15.37:0/1825625567 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4709 (secure 0 0 0) 0x7f8184056ed0 con 0x7f81981593c0 2023-07-14T15:57:36.879 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:57:36.880 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/1292294727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":1292294727},{"type":"v1","addr":"172.21.15.98:6837","nonce":1292294727}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4811,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1091097806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1091097806},{"type":"v1","addr":"172.21.15.37:6835","nonce":1091097806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5059,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/2838228048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2838228048},{"type":"v1","addr":"172.21.15.98:6836","nonce":2838228048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T15:57:25.446758+0000","modified":"2023-07-14T15:57:28.951927+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5121},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5121":{"gid":5121,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6834/2406398098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2406398098},{"type":"v1","addr":"172.21.15.37:6834","nonce":2406398098}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-14T15:57:36.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.896+0000 7f819edff700 1 -- 172.21.15.37:0/1825625567 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f817c06ace0 msgr2=0x7f817c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:36.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.896+0000 7f819edff700 1 --2- 172.21.15.37:0/1825625567 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f817c06ace0 0x7f817c06d190 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f818c009c10 tx=0x7f818c008030 comp rx=0 tx=0).stop 2023-07-14T15:57:36.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.896+0000 7f819edff700 1 -- 172.21.15.37:0/1825625567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81981593c0 msgr2=0x7f819814f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:36.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.896+0000 7f819edff700 1 --2- 172.21.15.37:0/1825625567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81981593c0 0x7f819814f700 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f818400c4b0 tx=0x7f818400c7c0 comp rx=0 tx=0).stop 2023-07-14T15:57:36.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.896+0000 7f819edff700 1 -- 172.21.15.37:0/1825625567 shutdown_connections 2023-07-14T15:57:36.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.896+0000 7f819edff700 1 --2- 172.21.15.37:0/1825625567 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81980c9b30 0x7f81981553c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:36.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.896+0000 7f819edff700 1 --2- 172.21.15.37:0/1825625567 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f817c06ace0 0x7f817c06d190 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:36.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.896+0000 7f819edff700 1 --2- 172.21.15.37:0/1825625567 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f8198159790 0x7f81981582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:36.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.896+0000 7f819edff700 1 --2- 172.21.15.37:0/1825625567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81981593c0 0x7f819814f700 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:36.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.896+0000 7f819edff700 1 -- 172.21.15.37:0/1825625567 >> 172.21.15.37:0/1825625567 conn(0x7f81980b08c0 msgr2=0x7f81980b1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:36.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.896+0000 7f819edff700 1 -- 172.21.15.37:0/1825625567 shutdown_connections 2023-07-14T15:57:36.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:36.896+0000 7f819edff700 1 -- 172.21.15.37:0/1825625567 wait complete. 2023-07-14T15:57:36.886 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 16 2023-07-14T15:57:37.302 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-14T15:57:25.446758+0000', 'modified': '2023-07-14T15:57:28.951927+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5121}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5121': {'gid': 5121, 'name': 'c', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.37:6834/2406398098', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6832', 'nonce': 2406398098}, {'type': 'v1', 'addr': '172.21.15.37:6834', 'nonce': 2406398098}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-14T15:57:37.302 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-14T15:57:37.302 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-14T15:57:37.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.521+0000 7fb0aa9ff700 1 Processor -- start 2023-07-14T15:57:37.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.522+0000 7fb0aa9ff700 1 -- start start 2023-07-14T15:57:37.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.523+0000 7fb0aa9ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb0a40c9830 0x7fb0a40cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:37.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.523+0000 7fb0aa9ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb0a40cda10 0x7fb0a40cba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:37.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.523+0000 7fb0aa9ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0a41598c0 con 0x7fb0a40adfe0 2023-07-14T15:57:37.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.523+0000 7fb0aa9ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0a415dec0 con 0x7fb0a40c9830 2023-07-14T15:57:37.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.523+0000 7fb0aa9ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a40ccc50 con 0x7fb0a40cda10 2023-07-14T15:57:37.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.523+0000 7fb0a37fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb0a40c9830 0x7fb0a40cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:37.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.523+0000 7fb0a37fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb0a40c9830 0x7fb0a40cb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38638/0 (socket says 172.21.15.37:38638) 2023-07-14T15:57:37.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.523+0000 7fb0a37fe700 1 -- 172.21.15.37:0/1024480639 learned_addr learned my addr 172.21.15.37:0/1024480639 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:37.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.523+0000 7fb0a37fe700 1 -- 172.21.15.37:0/1024480639 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb0a40cda10 msgr2=0x7fb0a40cba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:37.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.523+0000 7fb0a37fe700 1 --2- 172.21.15.37:0/1024480639 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb0a40cda10 0x7fb0a40cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:37.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.523+0000 7fb0a37fe700 1 -- 172.21.15.37:0/1024480639 >> v1:172.21.15.98:6789/0 conn(0x7fb0a40adfe0 legacy=0x7fb0a40c9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:37.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.523+0000 7fb0a37fe700 1 -- 172.21.15.37:0/1024480639 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a40ccf30 con 0x7fb0a40c9830 2023-07-14T15:57:37.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.524+0000 7fb0a37fe700 1 --2- 172.21.15.37:0/1024480639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0a40c9830 0x7fb0a40cb4e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb0980098f0 tx=0x7fb098009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a106e8949505eaca server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:37.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.524+0000 7fb0a2ffd700 1 -- 172.21.15.37:0/1024480639 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb098004230 con 0x7fb0a40c9830 2023-07-14T15:57:37.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.524+0000 7fb0a2ffd700 1 -- 172.21.15.37:0/1024480639 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb098004390 con 0x7fb0a40c9830 2023-07-14T15:57:37.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.524+0000 7fb0a2ffd700 1 -- 172.21.15.37:0/1024480639 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0980036a0 con 0x7fb0a40c9830 2023-07-14T15:57:37.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.524+0000 7fb0aa9ff700 1 -- 172.21.15.37:0/1024480639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0a40c9830 msgr2=0x7fb0a40cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:37.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.524+0000 7fb0aa9ff700 1 --2- 172.21.15.37:0/1024480639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0a40c9830 0x7fb0a40cb4e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb0980098f0 tx=0x7fb098009c00 comp rx=0 tx=0).stop 2023-07-14T15:57:37.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.525+0000 7fb0aa9ff700 1 -- 172.21.15.37:0/1024480639 shutdown_connections 2023-07-14T15:57:37.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.525+0000 7fb0aa9ff700 1 --2- 172.21.15.37:0/1024480639 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb0a40cda10 0x7fb0a40cba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:37.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.525+0000 7fb0aa9ff700 1 --2- 172.21.15.37:0/1024480639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0a40c9830 0x7fb0a40cb4e0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:37.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.525+0000 7fb0aa9ff700 1 -- 172.21.15.37:0/1024480639 >> 172.21.15.37:0/1024480639 conn(0x7fb0a40b0620 msgr2=0x7fb0a40b0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:37.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.525+0000 7fb0aa9ff700 1 -- 172.21.15.37:0/1024480639 shutdown_connections 2023-07-14T15:57:37.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.525+0000 7fb0aa9ff700 1 -- 172.21.15.37:0/1024480639 wait complete. 2023-07-14T15:57:37.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.526+0000 7fb0aa9ff700 1 Processor -- start 2023-07-14T15:57:37.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.527+0000 7fb0aa9ff700 1 -- start start 2023-07-14T15:57:37.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.527+0000 7fb0aa9ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb0a40adfe0 0x7fb0a41512b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:37.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.527+0000 7fb0aa9ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0a40c9830 0x7fb0a4155290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:37.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.527+0000 7fb0aa9ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb0a40cda10 0x7fb0a41557d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:37.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.527+0000 7fb0aa9ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a40719e0 con 0x7fb0a40c9830 2023-07-14T15:57:37.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.527+0000 7fb0aa9ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a40b19c0 con 0x7fb0a40adfe0 2023-07-14T15:57:37.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.527+0000 7fb0aa9ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a40b1ca0 con 0x7fb0a40cda10 2023-07-14T15:57:37.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.528+0000 7fb0a37fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0a40c9830 0x7fb0a4155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:37.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.528+0000 7fb0a37fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0a40c9830 0x7fb0a4155290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38646/0 (socket says 172.21.15.37:38646) 2023-07-14T15:57:37.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.528+0000 7fb0a37fe700 1 -- 172.21.15.37:0/3775523866 learned_addr learned my addr 172.21.15.37:0/3775523866 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:37.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.528+0000 7fb0a3fff700 1 --2- 172.21.15.37:0/3775523866 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb0a40adfe0 0x7fb0a41512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:37.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.528+0000 7fb0a8f9c700 1 --2- 172.21.15.37:0/3775523866 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb0a40cda10 0x7fb0a41557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:37.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.528+0000 7fb0a37fe700 1 -- 172.21.15.37:0/3775523866 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb0a40cda10 msgr2=0x7fb0a41557d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:37.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.528+0000 7fb0a37fe700 1 --2- 172.21.15.37:0/3775523866 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb0a40cda10 0x7fb0a41557d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:37.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.528+0000 7fb0a37fe700 1 -- 172.21.15.37:0/3775523866 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb0a40adfe0 msgr2=0x7fb0a41512b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:37.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.528+0000 7fb0a37fe700 1 --2- 172.21.15.37:0/3775523866 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb0a40adfe0 0x7fb0a41512b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:37.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.528+0000 7fb0a37fe700 1 -- 172.21.15.37:0/3775523866 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb098009550 con 0x7fb0a40c9830 2023-07-14T15:57:37.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.528+0000 7fb0a3fff700 1 --2- 172.21.15.37:0/3775523866 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb0a40adfe0 0x7fb0a41512b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:57:37.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.528+0000 7fb0a37fe700 1 --2- 172.21.15.37:0/3775523866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0a40c9830 0x7fb0a4155290 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4072070 tx=0x7fb098004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:37.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.529+0000 7fb0a0ff9700 1 -- 172.21.15.37:0/3775523866 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb098003e70 con 0x7fb0a40c9830 2023-07-14T15:57:37.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.529+0000 7fb0a0ff9700 1 -- 172.21.15.37:0/3775523866 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09801f070 con 0x7fb0a40c9830 2023-07-14T15:57:37.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.529+0000 7fb0aa9ff700 1 -- 172.21.15.37:0/3775523866 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0a40b1f80 con 0x7fb0a40c9830 2023-07-14T15:57:37.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.529+0000 7fb0a0ff9700 1 -- 172.21.15.37:0/3775523866 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09800b8a0 con 0x7fb0a40c9830 2023-07-14T15:57:37.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.529+0000 7fb0aa9ff700 1 -- 172.21.15.37:0/3775523866 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0a41517f0 con 0x7fb0a40c9830 2023-07-14T15:57:37.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.531+0000 7fb0a0ff9700 1 -- 172.21.15.37:0/3775523866 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb098021030 con 0x7fb0a40c9830 2023-07-14T15:57:37.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.532+0000 7fb0a0ff9700 1 --2- 172.21.15.37:0/3775523866 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb09006ace0 0x7fb09006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:37.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.533+0000 7fb0a0ff9700 1 -- 172.21.15.37:0/3775523866 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb09808ab10 con 0x7fb0a40c9830 2023-07-14T15:57:37.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.533+0000 7fb0a3fff700 1 --2- 172.21.15.37:0/3775523866 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb09006ace0 0x7fb09006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:37.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.533+0000 7fb0a3fff700 1 --2- 172.21.15.37:0/3775523866 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb09006ace0 0x7fb09006d190 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb094009910 tx=0x7fb094008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:37.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.534+0000 7fb0be3bdb80 1 Processor -- start 2023-07-14T15:57:37.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.535+0000 7fb0be3bdb80 1 -- start start 2023-07-14T15:57:37.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.535+0000 7fb0be3bdb80 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x5563329f2f00 0x5563329f36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:37.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.535+0000 7fb0be3bdb80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563329f32d0 0x5563329f7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:37.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.535+0000 7fb0be3bdb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563329f7ea0 0x556332a120d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:37.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.535+0000 7fb0be3bdb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563328d1c60 con 0x5563329f7ea0 2023-07-14T15:57:37.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.535+0000 7fb0be3bdb80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563329249f0 con 0x5563329f32d0 2023-07-14T15:57:37.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.535+0000 7fb0be3bdb80 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x55633291de80 con 0x5563329f2f00 2023-07-14T15:57:37.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.536+0000 7fb0a8f9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563329f7ea0 0x556332a120d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:37.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.536+0000 7fb0a8f9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563329f7ea0 0x556332a120d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38652/0 (socket says 172.21.15.37:38652) 2023-07-14T15:57:37.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.536+0000 7fb0a8f9c700 1 -- 172.21.15.37:0/4123039159 learned_addr learned my addr 172.21.15.37:0/4123039159 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:37.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.536+0000 7fb0a37fe700 1 --2- 172.21.15.37:0/4123039159 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563329f32d0 0x5563329f7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:37.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.536+0000 7fb0a3fff700 1 --2- 172.21.15.37:0/4123039159 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x5563329f2f00 0x5563329f36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:37.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.536+0000 7fb0a8f9c700 1 -- 172.21.15.37:0/4123039159 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x5563329f2f00 msgr2=0x5563329f36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:37.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.536+0000 7fb0a8f9c700 1 --2- 172.21.15.37:0/4123039159 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x5563329f2f00 0x5563329f36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:37.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.536+0000 7fb0a8f9c700 1 -- 172.21.15.37:0/4123039159 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563329f32d0 msgr2=0x5563329f7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:37.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.536+0000 7fb0a8f9c700 1 --2- 172.21.15.37:0/4123039159 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563329f32d0 0x5563329f7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:37.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.536+0000 7fb0a8f9c700 1 -- 172.21.15.37:0/4123039159 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55633274bd90 con 0x5563329f7ea0 2023-07-14T15:57:37.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.536+0000 7fb0a8f9c700 1 --2- 172.21.15.37:0/4123039159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563329f7ea0 0x556332a120d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb09c009f20 tx=0x7fb09c009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f448427816ea6b65 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:37.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.537+0000 7fb089ffb700 1 -- 172.21.15.37:0/4123039159 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09c011070 con 0x5563329f7ea0 2023-07-14T15:57:37.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.537+0000 7fb089ffb700 1 -- 172.21.15.37:0/4123039159 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09c00c9d0 con 0x5563329f7ea0 2023-07-14T15:57:37.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.537+0000 7fb089ffb700 1 -- 172.21.15.37:0/4123039159 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09c00cd40 con 0x5563329f7ea0 2023-07-14T15:57:37.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.537+0000 7fb0be3bdb80 1 -- 172.21.15.37:0/4123039159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563329f7ea0 msgr2=0x556332a120d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:37.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.537+0000 7fb0be3bdb80 1 --2- 172.21.15.37:0/4123039159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563329f7ea0 0x556332a120d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb09c009f20 tx=0x7fb09c009f50 comp rx=0 tx=0).stop 2023-07-14T15:57:37.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.537+0000 7fb0be3bdb80 1 -- 172.21.15.37:0/4123039159 shutdown_connections 2023-07-14T15:57:37.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.537+0000 7fb0be3bdb80 1 --2- 172.21.15.37:0/4123039159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563329f7ea0 0x556332a120d0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:37.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.537+0000 7fb0be3bdb80 1 --2- 172.21.15.37:0/4123039159 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x5563329f2f00 0x5563329f36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:37.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.537+0000 7fb0be3bdb80 1 --2- 172.21.15.37:0/4123039159 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563329f32d0 0x5563329f7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:37.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.537+0000 7fb0be3bdb80 1 -- 172.21.15.37:0/4123039159 >> 172.21.15.37:0/4123039159 conn(0x5563329c1b90 msgr2=0x5563329c7130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:37.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.537+0000 7fb0be3bdb80 1 -- 172.21.15.37:0/4123039159 shutdown_connections 2023-07-14T15:57:37.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.537+0000 7fb0be3bdb80 1 -- 172.21.15.37:0/4123039159 wait complete. 2023-07-14T15:57:37.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.538+0000 7fb0be3bdb80 1 -- start start 2023-07-14T15:57:37.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.538+0000 7fb0be3bdb80 1 Processor -- start 2023-07-14T15:57:37.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.539+0000 7fb0be3bdb80 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x5563329f2f00 0x5563329e1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:37.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.539+0000 7fb0be3bdb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563329f32d0 0x556332a14310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:37.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.540+0000 7fb0be3bdb80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563329f7ea0 0x5563329f68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:37.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.540+0000 7fb0be3bdb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563328bda70 con 0x5563329f32d0 2023-07-14T15:57:37.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.540+0000 7fb0be3bdb80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563328bd770 con 0x5563329f7ea0 2023-07-14T15:57:37.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.540+0000 7fb0be3bdb80 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x5563327a18d0 con 0x5563329f2f00 2023-07-14T15:57:37.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.540+0000 7fb0be3bdb80 10 client.0 _ll_register_callbacks cb 0x5563328bb710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T15:57:37.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.540+0000 7fb0a37fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563329f32d0 0x556332a14310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:37.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.540+0000 7fb0a37fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563329f32d0 0x556332a14310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38654/0 (socket says 172.21.15.37:38654) 2023-07-14T15:57:37.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.540+0000 7fb0a37fe700 1 -- 172.21.15.37:0/1771360475 learned_addr learned my addr 172.21.15.37:0/1771360475 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:37.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.540+0000 7fb0a8f9c700 1 --2- 172.21.15.37:0/1771360475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563329f7ea0 0x5563329f68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:37.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.540+0000 7fb0a3fff700 1 --2- 172.21.15.37:0/1771360475 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x5563329f2f00 0x5563329e1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:37.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.540+0000 7fb0a37fe700 1 -- 172.21.15.37:0/1771360475 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x5563329f2f00 msgr2=0x5563329e1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:37.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.540+0000 7fb0a37fe700 1 --2- 172.21.15.37:0/1771360475 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x5563329f2f00 0x5563329e1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:37.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.540+0000 7fb0a37fe700 1 -- 172.21.15.37:0/1771360475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563329f7ea0 msgr2=0x5563329f68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:37.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.540+0000 7fb0a37fe700 1 --2- 172.21.15.37:0/1771360475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563329f7ea0 0x5563329f68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:37.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.540+0000 7fb0a37fe700 1 -- 172.21.15.37:0/1771360475 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb09c009bd0 con 0x5563329f32d0 2023-07-14T15:57:37.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.540+0000 7fb0a8f9c700 1 --2- 172.21.15.37:0/1771360475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563329f7ea0 0x5563329f68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:57:37.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.540+0000 7fb0a3fff700 1 --2- 172.21.15.37:0/1771360475 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x5563329f2f00 0x5563329e1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:57:37.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.540+0000 7fb0a37fe700 1 --2- 172.21.15.37:0/1771360475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563329f32d0 0x556332a14310 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb098009c40 tx=0x7fb09805d970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25cd8e259d28f16a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:37.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.540+0000 7fb082ffd700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-07-14T15:57:37.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.541+0000 7fb082ffd700 1 -- 172.21.15.37:0/1771360475 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb098006ea0 con 0x5563329f32d0 2023-07-14T15:57:37.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.541+0000 7fb082ffd700 1 -- 172.21.15.37:0/1771360475 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb098057d60 con 0x5563329f32d0 2023-07-14T15:57:37.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.541+0000 7fb0be3bdb80 1 -- 172.21.15.37:0/1771360475 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5563329bf1a0 con 0x5563329f32d0 2023-07-14T15:57:37.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.541+0000 7fb082ffd700 1 -- 172.21.15.37:0/1771360475 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb098061ea0 con 0x5563329f32d0 2023-07-14T15:57:37.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.541+0000 7fb0be3bdb80 10 client.5313 fetch_fsmap learned FSMap version 16 2023-07-14T15:57:37.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.541+0000 7fb0be3bdb80 1 -- 172.21.15.37:0/1771360475 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x556332734c10 con 0x5563329f32d0 2023-07-14T15:57:37.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.541+0000 7fb082ffd700 1 -- 172.21.15.37:0/1771360475 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5563329bf1a0 con 0x5563329f32d0 2023-07-14T15:57:37.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.541+0000 7fb082ffd700 1 -- 172.21.15.37:0/1771360475 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 16) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fb0980617c0 con 0x5563329f32d0 2023-07-14T15:57:37.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.541+0000 7fb0be3bdb80 10 client.5313 fetch_fsmap finished waiting for FSMap version 16 2023-07-14T15:57:37.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.541+0000 7fb0be3bdb80 10 client.5313 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-14T15:57:37.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.541+0000 7fb0be3bdb80 20 client.5313 populate_metadata read hostname 'smithi037' 2023-07-14T15:57:37.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.541+0000 7fb0be3bdb80 1 --2- 172.21.15.37:0/1771360475 >> [v2:172.21.15.37:6832/2406398098,v1:172.21.15.37:6834/2406398098] conn(0x556332a135e0 0x556332a139b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:37.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.541+0000 7fb0be3bdb80 4 client.5313 mds_command: new command op to 5121 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T15:57:37.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.541+0000 7fb0be3bdb80 1 -- 172.21.15.37:0/1771360475 --> [v2:172.21.15.37:6832/2406398098,v1:172.21.15.37:6834/2406398098] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556332916e60 con 0x556332a135e0 2023-07-14T15:57:37.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.541+0000 7fb0a3fff700 1 --2- 172.21.15.37:0/1771360475 >> [v2:172.21.15.37:6832/2406398098,v1:172.21.15.37:6834/2406398098] conn(0x556332a135e0 0x556332a139b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:37.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.542+0000 7fb0a3fff700 1 --2- 172.21.15.37:0/1771360475 >> [v2:172.21.15.37:6832/2406398098,v1:172.21.15.37:6834/2406398098] conn(0x556332a135e0 0x556332a139b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2867c60cc85851db server_cookie=146f22b5c6e38139 in_seq=0 out_seq=0 2023-07-14T15:57:37.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.542+0000 7fb082ffd700 10 client.5313 ms_handle_connect on v2:172.21.15.37:6832/2406398098 2023-07-14T15:57:37.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.543+0000 7fb082ffd700 1 -- 172.21.15.37:0/1771360475 <== mds.0 v2:172.21.15.37:6832/2406398098 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x556332916e60 con 0x556332a135e0 2023-07-14T15:57:37.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.543+0000 7fb082ffd700 10 client.5313 handle_command_reply: tid=0 2023-07-14T15:57:37.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.543+0000 7fb0be3bdb80 1 client.5313 shutdown 2023-07-14T15:57:37.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.543+0000 7fb0be3bdb80 1 -- 172.21.15.37:0/1771360475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563329f32d0 msgr2=0x556332a14310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:37.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.543+0000 7fb0be3bdb80 1 --2- 172.21.15.37:0/1771360475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563329f32d0 0x556332a14310 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb098009c40 tx=0x7fb09805d970 comp rx=0 tx=0).stop 2023-07-14T15:57:37.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.543+0000 7fb0be3bdb80 1 -- 172.21.15.37:0/1771360475 shutdown_connections 2023-07-14T15:57:37.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.543+0000 7fb0be3bdb80 1 --2- 172.21.15.37:0/1771360475 >> [v2:172.21.15.37:6832/2406398098,v1:172.21.15.37:6834/2406398098] conn(0x556332a135e0 0x556332a139b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:37.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.543+0000 7fb0be3bdb80 1 --2- 172.21.15.37:0/1771360475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563329f7ea0 0x5563329f68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:37.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.543+0000 7fb0be3bdb80 1 --2- 172.21.15.37:0/1771360475 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x5563329f2f00 0x5563329e1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:37.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.543+0000 7fb0be3bdb80 1 --2- 172.21.15.37:0/1771360475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563329f32d0 0x556332a14310 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:37.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.543+0000 7fb082ffd700 0 client.5313 ms_handle_reset on v2:172.21.15.37:6832/2406398098 2023-07-14T15:57:37.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.543+0000 7fb0be3bdb80 1 -- 172.21.15.37:0/1771360475 >> 172.21.15.37:0/1771360475 conn(0x5563329c1b90 msgr2=0x5563329c7610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:37.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.543+0000 7fb0be3bdb80 1 -- 172.21.15.37:0/1771360475 shutdown_connections 2023-07-14T15:57:37.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.543+0000 7fb0be3bdb80 1 -- 172.21.15.37:0/1771360475 wait complete. 2023-07-14T15:57:37.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.543+0000 7fb0be3bdb80 20 client.5313 trim_cache size 0 max 16384 2023-07-14T15:57:37.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.562+0000 7fb0be3bdb80 1 Processor -- start 2023-07-14T15:57:37.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.563+0000 7fb0be3bdb80 1 -- start start 2023-07-14T15:57:37.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.564+0000 7fb0be3bdb80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563329f2f00 0x556332a13ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:37.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.564+0000 7fb0be3bdb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563329f32d0 0x5563329f4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:37.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.564+0000 7fb0be3bdb80 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x5563329f7ea0 0x5563329f5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:37.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.564+0000 7fb0be3bdb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563329cd000 con 0x5563329f32d0 2023-07-14T15:57:37.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.564+0000 7fb0be3bdb80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563329f6af0 con 0x5563329f2f00 2023-07-14T15:57:37.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.564+0000 7fb0be3bdb80 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x5563329e0f50 con 0x5563329f7ea0 2023-07-14T15:57:37.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.564+0000 7fb0a37fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563329f32d0 0x5563329f4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:37.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.564+0000 7fb0a37fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563329f32d0 0x5563329f4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38656/0 (socket says 172.21.15.37:38656) 2023-07-14T15:57:37.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.564+0000 7fb0a37fe700 1 -- 172.21.15.37:0/2510636317 learned_addr learned my addr 172.21.15.37:0/2510636317 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:37.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.564+0000 7fb0a3fff700 1 --2- 172.21.15.37:0/2510636317 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563329f2f00 0x556332a13ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:37.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.564+0000 7fb0a37fe700 1 -- 172.21.15.37:0/2510636317 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x5563329f7ea0 msgr2=0x5563329f5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:37.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.564+0000 7fb0a37fe700 1 --2- 172.21.15.37:0/2510636317 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x5563329f7ea0 0x5563329f5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:37.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.564+0000 7fb0a37fe700 1 -- 172.21.15.37:0/2510636317 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563329f2f00 msgr2=0x556332a13ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:37.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.564+0000 7fb0a37fe700 1 --2- 172.21.15.37:0/2510636317 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563329f2f00 0x556332a13ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:37.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.564+0000 7fb0a37fe700 1 -- 172.21.15.37:0/2510636317 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556332772200 con 0x5563329f32d0 2023-07-14T15:57:37.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.564+0000 7fb0a3fff700 1 --2- 172.21.15.37:0/2510636317 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563329f2f00 0x556332a13ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:57:37.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.565+0000 7fb0a37fe700 1 --2- 172.21.15.37:0/2510636317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563329f32d0 0x5563329f4d00 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb098055e00 tx=0x7fb09805c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6d1d465185ad318 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:37.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.565+0000 7fb08a7fc700 1 -- 172.21.15.37:0/2510636317 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb098061ea0 con 0x5563329f32d0 2023-07-14T15:57:37.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.565+0000 7fb08a7fc700 1 -- 172.21.15.37:0/2510636317 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0980596d0 con 0x5563329f32d0 2023-07-14T15:57:37.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.565+0000 7fb08a7fc700 1 -- 172.21.15.37:0/2510636317 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb098006ea0 con 0x5563329f32d0 2023-07-14T15:57:37.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.565+0000 7fb0be3bdb80 1 -- 172.21.15.37:0/2510636317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563329f32d0 msgr2=0x5563329f4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:37.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.565+0000 7fb0be3bdb80 1 --2- 172.21.15.37:0/2510636317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563329f32d0 0x5563329f4d00 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb098055e00 tx=0x7fb09805c000 comp rx=0 tx=0).stop 2023-07-14T15:57:37.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.565+0000 7fb0be3bdb80 1 -- 172.21.15.37:0/2510636317 shutdown_connections 2023-07-14T15:57:37.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.565+0000 7fb0be3bdb80 1 --2- 172.21.15.37:0/2510636317 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563329f2f00 0x556332a13ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:37.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.565+0000 7fb0be3bdb80 1 --2- 172.21.15.37:0/2510636317 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x5563329f7ea0 0x5563329f5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:37.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.565+0000 7fb0be3bdb80 1 --2- 172.21.15.37:0/2510636317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563329f32d0 0x5563329f4d00 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:37.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.565+0000 7fb0be3bdb80 1 -- 172.21.15.37:0/2510636317 >> 172.21.15.37:0/2510636317 conn(0x5563329c1b90 msgr2=0x5563329c3100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:37.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.566+0000 7fb0be3bdb80 1 -- 172.21.15.37:0/2510636317 shutdown_connections 2023-07-14T15:57:37.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.566+0000 7fb0be3bdb80 1 -- 172.21.15.37:0/2510636317 wait complete. 2023-07-14T15:57:37.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.566+0000 7fb0be3bdb80 1 -- start start 2023-07-14T15:57:37.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.566+0000 7fb0be3bdb80 1 Processor -- start 2023-07-14T15:57:37.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.567+0000 7fb0be3bdb80 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x5563329f2f00 0x556332a7ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:37.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.567+0000 7fb0be3bdb80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563329f32d0 0x5563329c62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:37.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.567+0000 7fb0be3bdb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563329f7ea0 0x5563329c6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:37.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.567+0000 7fb0be3bdb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563329fa8b0 con 0x5563329f7ea0 2023-07-14T15:57:37.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.567+0000 7fb0be3bdb80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563329f4d80 con 0x5563329f32d0 2023-07-14T15:57:37.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.567+0000 7fb0be3bdb80 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x556332a0e200 con 0x5563329f2f00 2023-07-14T15:57:37.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.567+0000 7fb0be3bdb80 10 client.0 _ll_register_callbacks cb 0x7fb098059260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T15:57:37.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.568+0000 7fb0a8f9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563329f7ea0 0x5563329c6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:37.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.568+0000 7fb0a8f9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563329f7ea0 0x5563329c6800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38670/0 (socket says 172.21.15.37:38670) 2023-07-14T15:57:37.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.568+0000 7fb0a8f9c700 1 -- 172.21.15.37:0/2783164194 learned_addr learned my addr 172.21.15.37:0/2783164194 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:37.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.568+0000 7fb0a37fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563329f32d0 0x5563329c62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:37.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.568+0000 7fb0a3fff700 1 --2- 172.21.15.37:0/2783164194 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x5563329f2f00 0x556332a7ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:37.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.568+0000 7fb0a8f9c700 1 -- 172.21.15.37:0/2783164194 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x5563329f2f00 msgr2=0x556332a7ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:37.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.568+0000 7fb0a8f9c700 1 --2- 172.21.15.37:0/2783164194 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x5563329f2f00 0x556332a7ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:37.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.568+0000 7fb0a8f9c700 1 -- 172.21.15.37:0/2783164194 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563329f32d0 msgr2=0x5563329c62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:37.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.568+0000 7fb0a8f9c700 1 --2- 172.21.15.37:0/2783164194 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563329f32d0 0x5563329c62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:37.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.568+0000 7fb0a8f9c700 1 -- 172.21.15.37:0/2783164194 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb09c009bd0 con 0x5563329f7ea0 2023-07-14T15:57:37.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.568+0000 7fb0a37fe700 1 --2- 172.21.15.37:0/2783164194 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563329f32d0 0x5563329c62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:57:37.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.568+0000 7fb0a8f9c700 1 --2- 172.21.15.37:0/2783164194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563329f7ea0 0x5563329c6800 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb09c018040 tx=0x7fb09c004be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f80b482f79398d5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:37.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.568+0000 7fb082ffd700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-07-14T15:57:37.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.569+0000 7fb082ffd700 1 -- 172.21.15.37:0/2783164194 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09c015610 con 0x5563329f7ea0 2023-07-14T15:57:37.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.569+0000 7fb082ffd700 1 -- 172.21.15.37:0/2783164194 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb09c006e40 con 0x5563329f7ea0 2023-07-14T15:57:37.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.569+0000 7fb0be3bdb80 1 -- 172.21.15.37:0/2783164194 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb09c00c9d0 con 0x5563329f7ea0 2023-07-14T15:57:37.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.569+0000 7fb082ffd700 1 -- 172.21.15.37:0/2783164194 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb09c007000 con 0x5563329f7ea0 2023-07-14T15:57:37.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.569+0000 7fb0be3bdb80 10 client.5319 fetch_fsmap learned FSMap version 16 2023-07-14T15:57:37.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.569+0000 7fb0be3bdb80 1 -- 172.21.15.37:0/2783164194 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55633274a260 con 0x5563329f7ea0 2023-07-14T15:57:37.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.569+0000 7fb082ffd700 1 -- 172.21.15.37:0/2783164194 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09c00c9d0 con 0x5563329f7ea0 2023-07-14T15:57:37.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.569+0000 7fb082ffd700 1 -- 172.21.15.37:0/2783164194 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 16) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fb09c015770 con 0x5563329f7ea0 2023-07-14T15:57:37.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.569+0000 7fb0be3bdb80 10 client.5319 fetch_fsmap finished waiting for FSMap version 16 2023-07-14T15:57:37.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.569+0000 7fb0be3bdb80 10 client.5319 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-14T15:57:37.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.569+0000 7fb0be3bdb80 20 client.5319 populate_metadata read hostname 'smithi037' 2023-07-14T15:57:37.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.569+0000 7fb0be3bdb80 1 --2- 172.21.15.37:0/2783164194 >> [v2:172.21.15.37:6832/2406398098,v1:172.21.15.37:6834/2406398098] conn(0x556332a123e0 0x556332a127b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:37.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.569+0000 7fb0be3bdb80 4 client.5319 mds_command: new command op to 5121 tid=0[{"prefix": "status"}] 2023-07-14T15:57:37.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.569+0000 7fb0be3bdb80 1 -- 172.21.15.37:0/2783164194 --> [v2:172.21.15.37:6832/2406398098,v1:172.21.15.37:6834/2406398098] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5563328d9000 con 0x556332a123e0 2023-07-14T15:57:37.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.570+0000 7fb0a3fff700 1 --2- 172.21.15.37:0/2783164194 >> [v2:172.21.15.37:6832/2406398098,v1:172.21.15.37:6834/2406398098] conn(0x556332a123e0 0x556332a127b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:37.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.570+0000 7fb0a3fff700 1 --2- 172.21.15.37:0/2783164194 >> [v2:172.21.15.37:6832/2406398098,v1:172.21.15.37:6834/2406398098] conn(0x556332a123e0 0x556332a127b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b6e80c359d696fc server_cookie=8d6d3732c4d328b5 in_seq=0 out_seq=0 2023-07-14T15:57:37.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.570+0000 7fb082ffd700 10 client.5319 ms_handle_connect on v2:172.21.15.37:6832/2406398098 2023-07-14T15:57:37.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.570+0000 7fb082ffd700 1 -- 172.21.15.37:0/2783164194 <== mds.0 v2:172.21.15.37:6832/2406398098 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x5563328d9000 con 0x556332a123e0 2023-07-14T15:57:37.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.570+0000 7fb082ffd700 10 client.5319 handle_command_reply: tid=0 2023-07-14T15:57:37.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.570+0000 7fb0be3bdb80 1 client.5319 shutdown 2023-07-14T15:57:37.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.571+0000 7fb0be3bdb80 1 -- 172.21.15.37:0/2783164194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563329f7ea0 msgr2=0x5563329c6800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:37.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.571+0000 7fb0be3bdb80 1 --2- 172.21.15.37:0/2783164194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563329f7ea0 0x5563329c6800 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb09c018040 tx=0x7fb09c004be0 comp rx=0 tx=0).stop 2023-07-14T15:57:37.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.571+0000 7fb0be3bdb80 1 -- 172.21.15.37:0/2783164194 shutdown_connections 2023-07-14T15:57:37.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.571+0000 7fb0be3bdb80 1 --2- 172.21.15.37:0/2783164194 >> [v2:172.21.15.37:6832/2406398098,v1:172.21.15.37:6834/2406398098] conn(0x556332a123e0 0x556332a127b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:37.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.571+0000 7fb0be3bdb80 1 --2- 172.21.15.37:0/2783164194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563329f7ea0 0x5563329c6800 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:37.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.571+0000 7fb0be3bdb80 1 --2- 172.21.15.37:0/2783164194 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x5563329f2f00 0x556332a7ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:37.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.571+0000 7fb0be3bdb80 1 --2- 172.21.15.37:0/2783164194 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563329f32d0 0x5563329c62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:37.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.571+0000 7fb082ffd700 0 client.5319 ms_handle_reset on v2:172.21.15.37:6832/2406398098 2023-07-14T15:57:37.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.571+0000 7fb0be3bdb80 1 -- 172.21.15.37:0/2783164194 >> 172.21.15.37:0/2783164194 conn(0x5563329c1b90 msgr2=0x556332a13ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:37.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.571+0000 7fb0be3bdb80 1 -- 172.21.15.37:0/2783164194 shutdown_connections 2023-07-14T15:57:37.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.571+0000 7fb0be3bdb80 1 -- 172.21.15.37:0/2783164194 wait complete. 2023-07-14T15:57:37.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.571+0000 7fb0be3bdb80 20 client.5319 trim_cache size 0 max 16384 2023-07-14T15:57:37.574 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-14T15:57:37.574 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "9da30401-a779-4e46-aba6-00c2494c6c67", 2023-07-14T15:57:37.574 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2023-07-14T15:57:37.574 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 5121, 2023-07-14T15:57:37.575 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2023-07-14T15:57:37.575 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2023-07-14T15:57:37.575 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2023-07-14T15:57:37.575 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 11.641939893, 2023-07-14T15:57:37.575 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 16, 2023-07-14T15:57:37.576 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 36, 2023-07-14T15:57:37.576 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 36, 2023-07-14T15:57:37.576 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 20.501540401 2023-07-14T15:57:37.576 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-14T15:57:37.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.571+0000 7fb0aa9ff700 1 -- 172.21.15.37:0/3775523866 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb09006ace0 msgr2=0x7fb09006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:37.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.571+0000 7fb0aa9ff700 1 --2- 172.21.15.37:0/3775523866 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb09006ace0 0x7fb09006d190 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb094009910 tx=0x7fb094008040 comp rx=0 tx=0).stop 2023-07-14T15:57:37.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.571+0000 7fb0aa9ff700 1 -- 172.21.15.37:0/3775523866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0a40c9830 msgr2=0x7fb0a4155290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:37.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.571+0000 7fb0aa9ff700 1 --2- 172.21.15.37:0/3775523866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0a40c9830 0x7fb0a4155290 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4072070 tx=0x7fb098004750 comp rx=0 tx=0).stop 2023-07-14T15:57:37.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.572+0000 7fb0aa9ff700 1 -- 172.21.15.37:0/3775523866 shutdown_connections 2023-07-14T15:57:37.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.572+0000 7fb0aa9ff700 1 --2- 172.21.15.37:0/3775523866 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb0a40adfe0 0x7fb0a41512b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:37.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.572+0000 7fb0aa9ff700 1 --2- 172.21.15.37:0/3775523866 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb09006ace0 0x7fb09006d190 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:37.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.572+0000 7fb0aa9ff700 1 --2- 172.21.15.37:0/3775523866 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb0a40cda10 0x7fb0a41557d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:37.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.572+0000 7fb0aa9ff700 1 --2- 172.21.15.37:0/3775523866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0a40c9830 0x7fb0a4155290 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:37.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.572+0000 7fb0aa9ff700 1 -- 172.21.15.37:0/3775523866 >> 172.21.15.37:0/3775523866 conn(0x7fb0a40b0620 msgr2=0x7fb0a406c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:37.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.572+0000 7fb0aa9ff700 1 -- 172.21.15.37:0/3775523866 shutdown_connections 2023-07-14T15:57:37.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.572+0000 7fb0aa9ff700 1 -- 172.21.15.37:0/3775523866 wait complete. 2023-07-14T15:57:37.579 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-14T15:57:37.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.797+0000 7f24a0fff700 1 Processor -- start 2023-07-14T15:57:37.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.798+0000 7f24a0fff700 1 -- start start 2023-07-14T15:57:37.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.799+0000 7f24a0fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f249c0b8650 0x7f249c0d0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:37.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.799+0000 7f24a0fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f249c0b24e0 0x7f249c0cf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:37.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.799+0000 7f24a0fff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f249c0cd540 con 0x7f249c0cfbd0 2023-07-14T15:57:37.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.799+0000 7f24a0fff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f249c0d1000 con 0x7f249c0b8650 2023-07-14T15:57:37.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.799+0000 7f24a0fff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f249c160f70 con 0x7f249c0b24e0 2023-07-14T15:57:37.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.799+0000 7f249a59c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f249c0b8650 0x7f249c0d0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:37.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.799+0000 7f249ad9d700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f249c0cfbd0 0x7f249c0b4970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56884/0 (socket says 172.21.15.37:56884) 2023-07-14T15:57:37.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.799+0000 7f249a59c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f249c0b8650 0x7f249c0d0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38672/0 (socket says 172.21.15.37:38672) 2023-07-14T15:57:37.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.799+0000 7f249ad9d700 1 -- 172.21.15.37:0/3156122840 learned_addr learned my addr 172.21.15.37:0/3156122840 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:37.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.799+0000 7f2499d9b700 1 --2- 172.21.15.37:0/3156122840 >> v2:172.21.15.98:3300/0 conn(0x7f249c0b24e0 0x7f249c0cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:37.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.800+0000 7f249959a700 1 -- 172.21.15.37:0/3156122840 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3905157077 0 0) 0x7f249c0cd540 con 0x7f249c0cfbd0 2023-07-14T15:57:37.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.800+0000 7f249a59c700 1 -- 172.21.15.37:0/3156122840 >> v2:172.21.15.98:3300/0 conn(0x7f249c0b24e0 msgr2=0x7f249c0cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:37.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.800+0000 7f249a59c700 1 --2- 172.21.15.37:0/3156122840 >> v2:172.21.15.98:3300/0 conn(0x7f249c0b24e0 0x7f249c0cf690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:37.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.800+0000 7f249a59c700 1 -- 172.21.15.37:0/3156122840 >> v1:172.21.15.37:6789/0 conn(0x7f249c0cfbd0 legacy=0x7f249c0b4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:37.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.800+0000 7f249a59c700 1 -- 172.21.15.37:0/3156122840 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f249c0cd790 con 0x7f249c0b8650 2023-07-14T15:57:37.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.800+0000 7f249a59c700 1 --2- 172.21.15.37:0/3156122840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f249c0b8650 0x7f249c0d0ac0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f249c0d0470 tx=0x7f248c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b96ac6473c696af server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:37.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.800+0000 7f249959a700 1 -- 172.21.15.37:0/3156122840 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248c011830 con 0x7f249c0b8650 2023-07-14T15:57:37.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.800+0000 7f249959a700 1 -- 172.21.15.37:0/3156122840 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f248c011990 con 0x7f249c0b8650 2023-07-14T15:57:37.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.800+0000 7f249959a700 1 -- 172.21.15.37:0/3156122840 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248c011d20 con 0x7f249c0b8650 2023-07-14T15:57:37.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.801+0000 7f24a0fff700 1 -- 172.21.15.37:0/3156122840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f249c0b8650 msgr2=0x7f249c0d0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:37.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.801+0000 7f24a0fff700 1 --2- 172.21.15.37:0/3156122840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f249c0b8650 0x7f249c0d0ac0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f249c0d0470 tx=0x7f248c009b20 comp rx=0 tx=0).stop 2023-07-14T15:57:37.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.801+0000 7f24a0fff700 1 -- 172.21.15.37:0/3156122840 shutdown_connections 2023-07-14T15:57:37.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.801+0000 7f24a0fff700 1 --2- 172.21.15.37:0/3156122840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f249c0b8650 0x7f249c0d0ac0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:37.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.801+0000 7f24a0fff700 1 --2- 172.21.15.37:0/3156122840 >> v2:172.21.15.98:3300/0 conn(0x7f249c0b24e0 0x7f249c0cf690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:37.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.801+0000 7f24a0fff700 1 -- 172.21.15.37:0/3156122840 >> 172.21.15.37:0/3156122840 conn(0x7f249c06c0f0 msgr2=0x7f249c06c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:37.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.801+0000 7f24a0fff700 1 -- 172.21.15.37:0/3156122840 shutdown_connections 2023-07-14T15:57:37.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.801+0000 7f24a0fff700 1 -- 172.21.15.37:0/3156122840 wait complete. 2023-07-14T15:57:37.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.803+0000 7f24a0fff700 1 Processor -- start 2023-07-14T15:57:37.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.803+0000 7f24a0fff700 1 -- start start 2023-07-14T15:57:37.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.804+0000 7f24a0fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f249c0b24e0 0x7f249c0c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:37.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.804+0000 7f24a0fff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f249c0b8650 0x7f249c14e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:37.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.804+0000 7f24a0fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f249c0cfbd0 0x7f249c0cc480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:37.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.804+0000 7f24a0fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249c0ca7f0 con 0x7f249c0cfbd0 2023-07-14T15:57:37.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.804+0000 7f24a0fff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249c0caad0 con 0x7f249c0b24e0 2023-07-14T15:57:37.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.804+0000 7f24a0fff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f249c0cadb0 con 0x7f249c0b8650 2023-07-14T15:57:37.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.804+0000 7f249ad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f249c0cfbd0 0x7f249c0cc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:37.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.804+0000 7f249ad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f249c0cfbd0 0x7f249c0cc480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38684/0 (socket says 172.21.15.37:38684) 2023-07-14T15:57:37.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.804+0000 7f249ad9d700 1 -- 172.21.15.37:0/2444882949 learned_addr learned my addr 172.21.15.37:0/2444882949 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:37.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.804+0000 7f249ad9d700 1 -- 172.21.15.37:0/2444882949 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f249c0b8650 msgr2=0x7f249c14e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:37.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.804+0000 7f249ad9d700 1 --2- 172.21.15.37:0/2444882949 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f249c0b8650 0x7f249c14e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:37.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.804+0000 7f249ad9d700 1 -- 172.21.15.37:0/2444882949 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f249c0b24e0 msgr2=0x7f249c0c9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:37.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.804+0000 7f249ad9d700 1 --2- 172.21.15.37:0/2444882949 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f249c0b24e0 0x7f249c0c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:37.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.804+0000 7f249ad9d700 1 -- 172.21.15.37:0/2444882949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f248c0094a0 con 0x7f249c0cfbd0 2023-07-14T15:57:37.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.805+0000 7f249ad9d700 1 --2- 172.21.15.37:0/2444882949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f249c0cfbd0 0x7f249c0cc480 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f249400cba0 tx=0x7f249400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:37.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.805+0000 7f248affd700 1 -- 172.21.15.37:0/2444882949 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249400ab80 con 0x7f249c0cfbd0 2023-07-14T15:57:37.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.805+0000 7f248affd700 1 -- 172.21.15.37:0/2444882949 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249400ace0 con 0x7f249c0cfbd0 2023-07-14T15:57:37.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.805+0000 7f248affd700 1 -- 172.21.15.37:0/2444882949 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24940072d0 con 0x7f249c0cfbd0 2023-07-14T15:57:37.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.805+0000 7f24a0fff700 1 -- 172.21.15.37:0/2444882949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f249c0cb090 con 0x7f249c0cfbd0 2023-07-14T15:57:37.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.805+0000 7f24a0fff700 1 -- 172.21.15.37:0/2444882949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f249c0ca500 con 0x7f249c0cfbd0 2023-07-14T15:57:37.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.806+0000 7f24a0fff700 1 -- 172.21.15.37:0/2444882949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249c0cb5b0 con 0x7f249c0cfbd0 2023-07-14T15:57:37.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.807+0000 7f248affd700 1 -- 172.21.15.37:0/2444882949 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2494007430 con 0x7f249c0cfbd0 2023-07-14T15:57:37.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.808+0000 7f248affd700 1 --2- 172.21.15.37:0/2444882949 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f247c06ace0 0x7f247c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:37.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.808+0000 7f248affd700 1 -- 172.21.15.37:0/2444882949 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2494089100 con 0x7f249c0cfbd0 2023-07-14T15:57:37.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.809+0000 7f249a59c700 1 --2- 172.21.15.37:0/2444882949 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f247c06ace0 0x7f247c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:37.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.809+0000 7f249a59c700 1 --2- 172.21.15.37:0/2444882949 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f247c06ace0 0x7f247c06d190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f248c0090b0 tx=0x7f248c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:37.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:37.813+0000 7f248affd700 1 -- 172.21.15.37:0/2444882949 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f249c0cb5b0 con 0x7f249c0cfbd0 2023-07-14T15:57:38.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:38.072+0000 7f24a0fff700 1 -- 172.21.15.37:0/2444882949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f249c0cb5b0 con 0x7f249c0cfbd0 2023-07-14T15:57:38.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:38.073+0000 7f248affd700 1 -- 172.21.15.37:0/2444882949 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f249c0cb5b0 con 0x7f249c0cfbd0 2023-07-14T15:57:38.058 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-14T15:57:38.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:38.075+0000 7f24a0fff700 1 -- 172.21.15.37:0/2444882949 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f247c06ace0 msgr2=0x7f247c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:38.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:38.075+0000 7f24a0fff700 1 --2- 172.21.15.37:0/2444882949 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f247c06ace0 0x7f247c06d190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f248c0090b0 tx=0x7f248c010000 comp rx=0 tx=0).stop 2023-07-14T15:57:38.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:38.075+0000 7f24a0fff700 1 -- 172.21.15.37:0/2444882949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f249c0cfbd0 msgr2=0x7f249c0cc480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:38.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:38.075+0000 7f24a0fff700 1 --2- 172.21.15.37:0/2444882949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f249c0cfbd0 0x7f249c0cc480 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f249400cba0 tx=0x7f249400cf60 comp rx=0 tx=0).stop 2023-07-14T15:57:38.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:38.075+0000 7f24a0fff700 1 -- 172.21.15.37:0/2444882949 shutdown_connections 2023-07-14T15:57:38.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:38.075+0000 7f24a0fff700 1 --2- 172.21.15.37:0/2444882949 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f249c0b24e0 0x7f249c0c9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:38.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:38.075+0000 7f24a0fff700 1 --2- 172.21.15.37:0/2444882949 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f247c06ace0 0x7f247c06d190 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:38.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:38.075+0000 7f24a0fff700 1 --2- 172.21.15.37:0/2444882949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f249c0cfbd0 0x7f249c0cc480 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:38.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:38.075+0000 7f24a0fff700 1 --2- 172.21.15.37:0/2444882949 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f249c0b8650 0x7f249c14e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:38.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:38.075+0000 7f24a0fff700 1 -- 172.21.15.37:0/2444882949 >> 172.21.15.37:0/2444882949 conn(0x7f249c06c0f0 msgr2=0x7f249c0d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:38.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:38.075+0000 7f24a0fff700 1 -- 172.21.15.37:0/2444882949 shutdown_connections 2023-07-14T15:57:38.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:38.075+0000 7f24a0fff700 1 -- 172.21.15.37:0/2444882949 wait complete. 2023-07-14T15:57:38.079 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-14T15:57:38.079 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-14T15:57:38.079 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2023-07-14T15:57:38.080 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-14T15:57:38.080 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-14T15:57:38.080 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-14T15:57:38.080 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-14T15:57:38.081 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-14T15:57:38.081 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-14T15:57:38.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:57:38.082 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2023-07-14T15:57:38.126 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T15:57:38.127 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T15:57:38.127 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T15:57:38.127 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:57:38.127 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-07-14T15:57:38.127 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:57:38.128 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T15:57:38.128 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2023-07-14T15:57:38.128 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2023-07-14T15:57:38.128 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T15:57:38.128 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2023-07-14T15:57:38.128 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2023-07-14T15:57:38.128 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-14T15:57:38.129 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2023-07-14T15:57:38.129 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2023-07-14T15:57:38.129 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-07-14T15:57:38.129 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 41980sec preferred_lft 41980sec 2023-07-14T15:57:38.130 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2023-07-14T15:57:38.130 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:57:38.131 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T15:57:38.131 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2023-07-14T15:57:38.131 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2023-07-14T15:57:38.131 INFO:teuthology.orchestra.run.smithi037.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-14T15:57:38.131 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 96:4b:9b:4c:a1:a6 brd ff:ff:ff:ff:ff:ff 2023-07-14T15:57:38.131 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-14T15:57:38.131 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:57:38.132 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::bcee:35ff:fe0f:4eb1/64 scope link 2023-07-14T15:57:38.132 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:57:38.132 INFO:teuthology.orchestra.run.smithi037.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T15:57:38.132 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 96:4b:9b:4c:a1:a6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-14T15:57:38.132 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::944b:9bff:fe4c:a1a6/64 scope link 2023-07-14T15:57:38.132 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:57:38.132 INFO:teuthology.orchestra.run.smithi037.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T15:57:38.132 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether f6:22:24:13:98:79 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-14T15:57:38.133 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::f422:24ff:fe13:9879/64 scope link 2023-07-14T15:57:38.133 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:57:38.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:57:38.133 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-14T15:57:38.233 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-07-14T15:57:38.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:57:38.236 DEBUG:teuthology.orchestra.run.smithi037:> route 2023-07-14T15:57:38.282 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2023-07-14T15:57:38.283 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-14T15:57:38.283 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-07-14T15:57:38.283 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-07-14T15:57:38.283 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-14T15:57:38.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:57:38.285 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-07-14T15:57:38.285 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-07-14T15:57:38.285 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-14T15:57:38.285 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-14T15:57:38.286 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-14T15:57:38.286 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-07-14T15:57:38.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:57:38.497 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-07-14T15:57:38.540 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-14T15:57:38.541 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-14T15:57:38.542 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-14T15:57:38.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:57:38.542 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2023-07-14T15:57:38.652 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T15:57:38.653 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-14T15:57:38.698 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-14T15:57:38.698 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T15:57:38.698 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-14T15:57:38.781 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-07-14T15:57:38.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:57:38.782 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T15:57:38.929 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T15:57:38.929 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-14T15:57:38.959 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T15:57:38.959 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-14T15:57:38.960 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.98:3300,172.21.15.98:3301" 2023-07-14T15:57:38.960 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with new device syntax: 0@9da30401-a779-4e46-aba6-00c2494c6c67.cephfs=/ 2023-07-14T15:57:38.960 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.37:3300/172.21.15.98:3300/172.21.15.98:3301" will pass to kernel 2023-07-14T15:57:38.964 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-14T15:57:38.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:57:38.965 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-14T15:57:39.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:57:39.035 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T15:57:39.141 INFO:teuthology.orchestra.run.smithi037.stdout:client5331 2023-07-14T15:57:39.141 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-14T15:57:39.142 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T15:57:39.186 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-14T15:57:39.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.442+0000 7f92715ff700 1 Processor -- start 2023-07-14T15:57:39.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.442+0000 7f92715ff700 1 -- start start 2023-07-14T15:57:39.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.443+0000 7f92715ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f926c1603d0 0x7f926c0cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:39.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.443+0000 7f92715ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f926c0cfc90 0x7f926c0d00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:39.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.443+0000 7f92715ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f926c0d0630 con 0x7f926c0b01a0 2023-07-14T15:57:39.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.443+0000 7f92715ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f926c0b0570 con 0x7f926c1603d0 2023-07-14T15:57:39.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.443+0000 7f92715ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f926c15cca0 con 0x7f926c0cfc90 2023-07-14T15:57:39.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.444+0000 7f926b7fe700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f926c0cfc90 0x7f926c0d00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:39.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.444+0000 7f9263fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f926c1603d0 0x7f926c0cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:39.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.444+0000 7f926b7fe700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f926c0cfc90 0x7f926c0d00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3301/0 says I am v2:172.21.15.37:43504/0 (socket says 172.21.15.37:43504) 2023-07-14T15:57:39.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.444+0000 7f926b7fe700 1 -- 172.21.15.37:0/343688016 learned_addr learned my addr 172.21.15.37:0/343688016 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:39.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.444+0000 7f926b7fe700 1 -- 172.21.15.37:0/343688016 >> v2:172.21.15.98:3300/0 conn(0x7f926c1603d0 msgr2=0x7f926c0cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:39.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.444+0000 7f926b7fe700 1 --2- 172.21.15.37:0/343688016 >> v2:172.21.15.98:3300/0 conn(0x7f926c1603d0 0x7f926c0cf530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:39.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.444+0000 7f926b7fe700 1 -- 172.21.15.37:0/343688016 >> v1:172.21.15.98:6789/0 conn(0x7f926c0b01a0 legacy=0x7f926c0cb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:39.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.444+0000 7f926b7fe700 1 -- 172.21.15.37:0/343688016 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f926c0b29d0 con 0x7f926c0cfc90 2023-07-14T15:57:39.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.444+0000 7f9263fff700 1 --2- 172.21.15.37:0/343688016 >> v2:172.21.15.98:3300/0 conn(0x7f926c1603d0 0x7f926c0cf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:57:39.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.444+0000 7f926b7fe700 1 --2- 172.21.15.37:0/343688016 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f926c0cfc90 0x7f926c0d00f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9264009e50 tx=0x7f926400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f263d637279010c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:39.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.445+0000 7f926a7fc700 1 -- 172.21.15.37:0/343688016 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926400e070 con 0x7f926c0cfc90 2023-07-14T15:57:39.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.445+0000 7f926a7fc700 1 -- 172.21.15.37:0/343688016 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f926400b910 con 0x7f926c0cfc90 2023-07-14T15:57:39.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.445+0000 7f926a7fc700 1 -- 172.21.15.37:0/343688016 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926400bcc0 con 0x7f926c0cfc90 2023-07-14T15:57:39.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.445+0000 7f92715ff700 1 -- 172.21.15.37:0/343688016 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f926c0cfc90 msgr2=0x7f926c0d00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:39.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.445+0000 7f92715ff700 1 --2- 172.21.15.37:0/343688016 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f926c0cfc90 0x7f926c0d00f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9264009e50 tx=0x7f926400b330 comp rx=0 tx=0).stop 2023-07-14T15:57:39.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.445+0000 7f92715ff700 1 -- 172.21.15.37:0/343688016 shutdown_connections 2023-07-14T15:57:39.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.445+0000 7f92715ff700 1 --2- 172.21.15.37:0/343688016 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f926c0cfc90 0x7f926c0d00f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:39.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.445+0000 7f92715ff700 1 --2- 172.21.15.37:0/343688016 >> v2:172.21.15.98:3300/0 conn(0x7f926c1603d0 0x7f926c0cf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:39.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.445+0000 7f92715ff700 1 -- 172.21.15.37:0/343688016 >> 172.21.15.37:0/343688016 conn(0x7f926c065bd0 msgr2=0x7f926c065fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:39.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.445+0000 7f92715ff700 1 -- 172.21.15.37:0/343688016 shutdown_connections 2023-07-14T15:57:39.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.445+0000 7f92715ff700 1 -- 172.21.15.37:0/343688016 wait complete. 2023-07-14T15:57:39.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.447+0000 7f92715ff700 1 Processor -- start 2023-07-14T15:57:39.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.447+0000 7f92715ff700 1 -- start start 2023-07-14T15:57:39.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.448+0000 7f92715ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f926c0b01a0 0x7f926c1428a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:39.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.448+0000 7f92715ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f926c0cfc90 0x7f926c0ad900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:39.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.448+0000 7f92715ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f926c1603d0 0x7f926c0ade40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:39.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.448+0000 7f92715ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926c1463f0 con 0x7f926c0b01a0 2023-07-14T15:57:39.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.448+0000 7f92715ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926c0ae470 con 0x7f926c0cfc90 2023-07-14T15:57:39.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.448+0000 7f92715ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f926c0ae750 con 0x7f926c1603d0 2023-07-14T15:57:39.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.448+0000 7f926affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f926c0b01a0 0x7f926c1428a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:39.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.449+0000 7f926affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f926c0b01a0 0x7f926c1428a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38692/0 (socket says 172.21.15.37:38692) 2023-07-14T15:57:39.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.449+0000 7f926affd700 1 -- 172.21.15.37:0/662813126 learned_addr learned my addr 172.21.15.37:0/662813126 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:39.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.449+0000 7f9263fff700 1 --2- 172.21.15.37:0/662813126 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f926c0cfc90 0x7f926c0ad900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:39.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.449+0000 7f926b7fe700 1 --2- 172.21.15.37:0/662813126 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f926c1603d0 0x7f926c0ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:39.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.449+0000 7f926affd700 1 -- 172.21.15.37:0/662813126 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f926c1603d0 msgr2=0x7f926c0ade40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:39.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.449+0000 7f926affd700 1 --2- 172.21.15.37:0/662813126 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f926c1603d0 0x7f926c0ade40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:39.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.449+0000 7f926affd700 1 -- 172.21.15.37:0/662813126 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f926c0cfc90 msgr2=0x7f926c0ad900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:39.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.449+0000 7f926affd700 1 --2- 172.21.15.37:0/662813126 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f926c0cfc90 0x7f926c0ad900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:39.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.449+0000 7f926affd700 1 -- 172.21.15.37:0/662813126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92540094a0 con 0x7f926c0b01a0 2023-07-14T15:57:39.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.449+0000 7f926affd700 1 --2- 172.21.15.37:0/662813126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f926c0b01a0 0x7f926c1428a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f925c00c4e0 tx=0x7f925c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:39.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.450+0000 7f92637fe700 1 -- 172.21.15.37:0/662813126 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c0052d0 con 0x7f926c0b01a0 2023-07-14T15:57:39.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.450+0000 7f92637fe700 1 -- 172.21.15.37:0/662813126 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925c005430 con 0x7f926c0b01a0 2023-07-14T15:57:39.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.450+0000 7f92715ff700 1 -- 172.21.15.37:0/662813126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9264009b30 con 0x7f926c0b01a0 2023-07-14T15:57:39.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.450+0000 7f92637fe700 1 -- 172.21.15.37:0/662813126 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c0038c0 con 0x7f926c0b01a0 2023-07-14T15:57:39.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.450+0000 7f92715ff700 1 -- 172.21.15.37:0/662813126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f926c0aeae0 con 0x7f926c0b01a0 2023-07-14T15:57:39.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.451+0000 7f92715ff700 1 -- 172.21.15.37:0/662813126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f926c06d8c0 con 0x7f926c0b01a0 2023-07-14T15:57:39.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.452+0000 7f92637fe700 1 -- 172.21.15.37:0/662813126 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f925c003a20 con 0x7f926c0b01a0 2023-07-14T15:57:39.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.453+0000 7f92637fe700 1 --2- 172.21.15.37:0/662813126 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f924c06ace0 0x7f924c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:39.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.453+0000 7f92637fe700 1 -- 172.21.15.37:0/662813126 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f925c0888c0 con 0x7f926c0b01a0 2023-07-14T15:57:39.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.453+0000 7f9263fff700 1 --2- 172.21.15.37:0/662813126 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f924c06ace0 0x7f924c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:39.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.454+0000 7f9263fff700 1 --2- 172.21.15.37:0/662813126 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f924c06ace0 0x7f924c06d190 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f926c0b58e0 tx=0x7f9254009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:39.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.457+0000 7f92637fe700 1 -- 172.21.15.37:0/662813126 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f925c0538d0 con 0x7f926c0b01a0 2023-07-14T15:57:39.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.718+0000 7f92715ff700 1 -- 172.21.15.37:0/662813126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f926c067840 con 0x7f926c0b01a0 2023-07-14T15:57:39.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.718+0000 7f92637fe700 1 -- 172.21.15.37:0/662813126 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f925c017060 con 0x7f926c0b01a0 2023-07-14T15:57:39.704 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-14T15:57:39.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.721+0000 7f92715ff700 1 -- 172.21.15.37:0/662813126 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f924c06ace0 msgr2=0x7f924c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:39.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.721+0000 7f92715ff700 1 --2- 172.21.15.37:0/662813126 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f924c06ace0 0x7f924c06d190 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f926c0b58e0 tx=0x7f9254009210 comp rx=0 tx=0).stop 2023-07-14T15:57:39.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.721+0000 7f92715ff700 1 -- 172.21.15.37:0/662813126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f926c0b01a0 msgr2=0x7f926c1428a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:39.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.721+0000 7f92715ff700 1 --2- 172.21.15.37:0/662813126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f926c0b01a0 0x7f926c1428a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f925c00c4e0 tx=0x7f925c00c7f0 comp rx=0 tx=0).stop 2023-07-14T15:57:39.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.721+0000 7f92715ff700 1 -- 172.21.15.37:0/662813126 shutdown_connections 2023-07-14T15:57:39.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.721+0000 7f92715ff700 1 --2- 172.21.15.37:0/662813126 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f924c06ace0 0x7f924c06d190 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:39.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.721+0000 7f92715ff700 1 --2- 172.21.15.37:0/662813126 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f926c1603d0 0x7f926c0ade40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:39.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.721+0000 7f92715ff700 1 --2- 172.21.15.37:0/662813126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f926c0b01a0 0x7f926c1428a0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:39.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.721+0000 7f92715ff700 1 --2- 172.21.15.37:0/662813126 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f926c0cfc90 0x7f926c0ad900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:39.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.721+0000 7f92715ff700 1 -- 172.21.15.37:0/662813126 >> 172.21.15.37:0/662813126 conn(0x7f926c065bd0 msgr2=0x7f926c0b1870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:39.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.721+0000 7f92715ff700 1 -- 172.21.15.37:0/662813126 shutdown_connections 2023-07-14T15:57:39.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:39.721+0000 7f92715ff700 1 -- 172.21.15.37:0/662813126 wait complete. 2023-07-14T15:57:39.725 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-14T15:57:39.726 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-14T15:57:39.726 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi098.front.sepia.ceph.com 2023-07-14T15:57:39.726 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-14T15:57:39.727 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-14T15:57:39.727 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-14T15:57:39.728 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-14T15:57:39.728 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-14T15:57:39.729 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-14T15:57:39.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:57:39.730 DEBUG:teuthology.orchestra.run.smithi098:> ip addr 2023-07-14T15:57:39.779 INFO:teuthology.orchestra.run.smithi098.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T15:57:39.779 INFO:teuthology.orchestra.run.smithi098.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T15:57:39.779 INFO:teuthology.orchestra.run.smithi098.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T15:57:39.780 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:57:39.780 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 ::1/128 scope host 2023-07-14T15:57:39.780 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:57:39.780 INFO:teuthology.orchestra.run.smithi098.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T15:57:39.780 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b8 brd ff:ff:ff:ff:ff:ff 2023-07-14T15:57:39.781 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f0 2023-07-14T15:57:39.781 INFO:teuthology.orchestra.run.smithi098.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T15:57:39.781 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b9 brd ff:ff:ff:ff:ff:ff 2023-07-14T15:57:39.781 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f1 2023-07-14T15:57:39.781 INFO:teuthology.orchestra.run.smithi098.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T15:57:39.781 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6a brd ff:ff:ff:ff:ff:ff 2023-07-14T15:57:39.781 INFO:teuthology.orchestra.run.smithi098.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-14T15:57:39.782 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6b brd ff:ff:ff:ff:ff:ff 2023-07-14T15:57:39.782 INFO:teuthology.orchestra.run.smithi098.stdout: inet 172.21.15.98/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-14T15:57:39.782 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft 41994sec preferred_lft 41994sec 2023-07-14T15:57:39.782 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::9888:7b88:1642:cf3d/64 scope link noprefixroute 2023-07-14T15:57:39.782 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:57:39.783 INFO:teuthology.orchestra.run.smithi098.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-14T15:57:39.783 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 4a:c5:e7:d2:66:a2 brd ff:ff:ff:ff:ff:ff 2023-07-14T15:57:39.783 INFO:teuthology.orchestra.run.smithi098.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-14T15:57:39.783 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:57:39.783 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::80a1:17ff:febf:8ddc/64 scope link 2023-07-14T15:57:39.783 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:57:39.783 INFO:teuthology.orchestra.run.smithi098.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T15:57:39.784 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether f6:48:a1:0d:45:34 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-14T15:57:39.784 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::f448:a1ff:fe0d:4534/64 scope link 2023-07-14T15:57:39.784 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:57:39.784 INFO:teuthology.orchestra.run.smithi098.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T15:57:39.784 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 4a:c5:e7:d2:66:a2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-14T15:57:39.784 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::48c5:e7ff:fed2:66a2/64 scope link 2023-07-14T15:57:39.785 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:57:39.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:57:39.786 DEBUG:teuthology.orchestra.run.smithi098:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-14T15:57:39.854 INFO:teuthology.orchestra.run.smithi098.stdout:1 2023-07-14T15:57:39.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:57:39.857 DEBUG:teuthology.orchestra.run.smithi098:> route 2023-07-14T15:57:39.903 INFO:teuthology.orchestra.run.smithi098.stdout:Kernel IP routing table 2023-07-14T15:57:39.904 INFO:teuthology.orchestra.run.smithi098.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-14T15:57:39.904 INFO:teuthology.orchestra.run.smithi098.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-14T15:57:39.904 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-14T15:57:39.904 INFO:teuthology.orchestra.run.smithi098.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-14T15:57:39.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:57:39.906 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec bash -c ' 2023-07-14T15:57:39.906 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2023-07-14T15:57:39.906 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-14T15:57:39.906 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-14T15:57:39.907 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-14T15:57:39.907 DEBUG:teuthology.orchestra.run.smithi098:> ') 2023-07-14T15:57:40.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:57:40.077 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2023-07-14T15:57:40.119 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-07-14T15:57:40.120 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-14T15:57:40.120 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-14T15:57:40.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:57:40.121 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set brx.0 up 2023-07-14T15:57:40.228 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T15:57:40.228 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-14T15:57:40.271 INFO:teuthology.orchestra.run.smithi098.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-14T15:57:40.272 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T15:57:40.272 DEBUG:teuthology.orchestra.run.smithi098:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-14T15:57:40.353 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-07-14T15:57:40.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:57:40.354 DEBUG:teuthology.orchestra.run.smithi098:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T15:57:40.496 INFO:teuthology.orchestra.run.smithi098.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T15:57:40.496 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-14T15:57:40.529 INFO:teuthology.orchestra.run.smithi098.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T15:57:40.529 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-14T15:57:40.529 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.98:3300,172.21.15.98:3301" 2023-07-14T15:57:40.530 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: trying mount with new device syntax: 1@9da30401-a779-4e46-aba6-00c2494c6c67.cephfs=/ 2023-07-14T15:57:40.530 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.37:3300/172.21.15.98:3300/172.21.15.98:3301" will pass to kernel 2023-07-14T15:57:40.534 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-14T15:57:40.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:57:40.534 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-14T15:57:40.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:57:40.603 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T15:57:40.687 INFO:teuthology.orchestra.run.smithi098.stdout:client5337 2023-07-14T15:57:40.688 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-14T15:57:40.688 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T15:57:40.731 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-07-14T15:57:40.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.965+0000 7fed3a5ff700 1 Processor -- start 2023-07-14T15:57:40.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.965+0000 7fed3a5ff700 1 -- start start 2023-07-14T15:57:40.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.966+0000 7fed3a5ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fed34159380 0x7fed340c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:40.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.966+0000 7fed3a5ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed340c9900 con 0x7fed3406cff0 2023-07-14T15:57:40.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.966+0000 7fed3a5ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed340c9be0 con 0x7fed3415db00 2023-07-14T15:57:40.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.966+0000 7fed3a5ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed340cca90 con 0x7fed34159380 2023-07-14T15:57:40.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.966+0000 7fed38b9c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fed3406cff0 0x7fed340cd570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48010/0 (socket says 172.21.15.37:48010) 2023-07-14T15:57:40.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.966+0000 7fed38b9c700 1 -- 172.21.15.37:0/1794021688 learned_addr learned my addr 172.21.15.37:0/1794021688 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:40.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.967+0000 7fed33fff700 1 --2- 172.21.15.37:0/1794021688 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fed34159380 0x7fed340c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:40.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.967+0000 7fed32ffd700 1 -- 172.21.15.37:0/1794021688 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1360632355 0 0) 0x7fed340c9900 con 0x7fed3406cff0 2023-07-14T15:57:40.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.967+0000 7fed32ffd700 1 -- 172.21.15.37:0/1794021688 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed1c0057c0 con 0x7fed3406cff0 2023-07-14T15:57:40.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.967+0000 7fed32ffd700 1 -- 172.21.15.37:0/1794021688 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 159049370 0 0) 0x7fed340c9be0 con 0x7fed3415db00 2023-07-14T15:57:40.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.967+0000 7fed32ffd700 1 -- 172.21.15.37:0/1794021688 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed340c9900 con 0x7fed3415db00 2023-07-14T15:57:40.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.967+0000 7fed33fff700 1 -- 172.21.15.37:0/1794021688 >> v1:172.21.15.98:6789/0 conn(0x7fed3415db00 legacy=0x7fed3406c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:40.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.967+0000 7fed33fff700 1 -- 172.21.15.37:0/1794021688 >> v1:172.21.15.37:6789/0 conn(0x7fed3406cff0 legacy=0x7fed340cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:40.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.967+0000 7fed33fff700 1 -- 172.21.15.37:0/1794021688 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed340ccd70 con 0x7fed34159380 2023-07-14T15:57:40.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.967+0000 7fed33fff700 1 --2- 172.21.15.37:0/1794021688 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fed34159380 0x7fed340c9040 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fed24009870 tx=0x7fed24009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e79bad379ca73840 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:40.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.968+0000 7fed32ffd700 1 -- 172.21.15.37:0/1794021688 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed24011830 con 0x7fed34159380 2023-07-14T15:57:40.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.968+0000 7fed32ffd700 1 -- 172.21.15.37:0/1794021688 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed24011990 con 0x7fed34159380 2023-07-14T15:57:40.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.968+0000 7fed32ffd700 1 -- 172.21.15.37:0/1794021688 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed24011d20 con 0x7fed34159380 2023-07-14T15:57:40.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.968+0000 7fed3a5ff700 1 -- 172.21.15.37:0/1794021688 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fed34159380 msgr2=0x7fed340c9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:40.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.968+0000 7fed3a5ff700 1 --2- 172.21.15.37:0/1794021688 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fed34159380 0x7fed340c9040 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fed24009870 tx=0x7fed24009b80 comp rx=0 tx=0).stop 2023-07-14T15:57:40.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.968+0000 7fed3a5ff700 1 -- 172.21.15.37:0/1794021688 shutdown_connections 2023-07-14T15:57:40.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.968+0000 7fed3a5ff700 1 --2- 172.21.15.37:0/1794021688 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fed34159380 0x7fed340c9040 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:40.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.968+0000 7fed3a5ff700 1 -- 172.21.15.37:0/1794021688 >> 172.21.15.37:0/1794021688 conn(0x7fed340cb470 msgr2=0x7fed340cb870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:40.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.968+0000 7fed3a5ff700 1 -- 172.21.15.37:0/1794021688 shutdown_connections 2023-07-14T15:57:40.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.968+0000 7fed3a5ff700 1 -- 172.21.15.37:0/1794021688 wait complete. 2023-07-14T15:57:40.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.970+0000 7fed3a5ff700 1 Processor -- start 2023-07-14T15:57:40.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.970+0000 7fed3a5ff700 1 -- start start 2023-07-14T15:57:40.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.971+0000 7fed3a5ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed3406cff0 0x7fed34151a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:40.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.971+0000 7fed3a5ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fed34159380 0x7fed341598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:40.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.971+0000 7fed3a5ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed3415db00 0x7fed34159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:40.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.971+0000 7fed3a5ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed34151f90 con 0x7fed3406cff0 2023-07-14T15:57:40.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.971+0000 7fed3a5ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed34152440 con 0x7fed3415db00 2023-07-14T15:57:40.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.971+0000 7fed3a5ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed340b3580 con 0x7fed34159380 2023-07-14T15:57:40.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.971+0000 7fed33fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed3406cff0 0x7fed34151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:40.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.971+0000 7fed33fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed3406cff0 0x7fed34151a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48190/0 (socket says 172.21.15.37:48190) 2023-07-14T15:57:40.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.971+0000 7fed33fff700 1 -- 172.21.15.37:0/3396820954 learned_addr learned my addr 172.21.15.37:0/3396820954 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:40.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.971+0000 7fed38b9c700 1 --2- 172.21.15.37:0/3396820954 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed3415db00 0x7fed34159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:40.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.971+0000 7fed337fe700 1 --2- 172.21.15.37:0/3396820954 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fed34159380 0x7fed341598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:40.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.972+0000 7fed33fff700 1 -- 172.21.15.37:0/3396820954 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fed34159380 msgr2=0x7fed341598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:40.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.972+0000 7fed33fff700 1 --2- 172.21.15.37:0/3396820954 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fed34159380 0x7fed341598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:40.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.972+0000 7fed33fff700 1 -- 172.21.15.37:0/3396820954 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed3415db00 msgr2=0x7fed34159e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:40.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.972+0000 7fed33fff700 1 --2- 172.21.15.37:0/3396820954 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed3415db00 0x7fed34159e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:40.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.972+0000 7fed33fff700 1 -- 172.21.15.37:0/3396820954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed240094a0 con 0x7fed3406cff0 2023-07-14T15:57:40.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.972+0000 7fed33fff700 1 --2- 172.21.15.37:0/3396820954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed3406cff0 0x7fed34151a50 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fed3406eea0 tx=0x7fed24004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:40.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.972+0000 7fed30ff9700 1 -- 172.21.15.37:0/3396820954 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2401a8f0 con 0x7fed3406cff0 2023-07-14T15:57:40.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.972+0000 7fed30ff9700 1 -- 172.21.15.37:0/3396820954 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed2401aa50 con 0x7fed3406cff0 2023-07-14T15:57:40.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.972+0000 7fed30ff9700 1 -- 172.21.15.37:0/3396820954 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2401adc0 con 0x7fed3406cff0 2023-07-14T15:57:40.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.972+0000 7fed3a5ff700 1 -- 172.21.15.37:0/3396820954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed340b3860 con 0x7fed3406cff0 2023-07-14T15:57:40.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.972+0000 7fed3a5ff700 1 -- 172.21.15.37:0/3396820954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed340b3e20 con 0x7fed3406cff0 2023-07-14T15:57:40.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.973+0000 7fed3a5ff700 1 -- 172.21.15.37:0/3396820954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed34067840 con 0x7fed3406cff0 2023-07-14T15:57:40.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.974+0000 7fed30ff9700 1 -- 172.21.15.37:0/3396820954 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fed240243f0 con 0x7fed3406cff0 2023-07-14T15:57:40.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.975+0000 7fed30ff9700 1 --2- 172.21.15.37:0/3396820954 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fed2006ad10 0x7fed2006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:40.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.975+0000 7fed30ff9700 1 -- 172.21.15.37:0/3396820954 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fed2408a7e0 con 0x7fed3406cff0 2023-07-14T15:57:40.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.976+0000 7fed337fe700 1 --2- 172.21.15.37:0/3396820954 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fed2006ad10 0x7fed2006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:40.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.976+0000 7fed337fe700 1 --2- 172.21.15.37:0/3396820954 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fed2006ad10 0x7fed2006d1c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fed340cf9d0 tx=0x7fed28009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:40.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:40.980+0000 7fed30ff9700 1 -- 172.21.15.37:0/3396820954 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fed240559a0 con 0x7fed3406cff0 2023-07-14T15:57:41.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.236+0000 7fed3a5ff700 1 -- 172.21.15.37:0/3396820954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fed340b12d0 con 0x7fed3406cff0 2023-07-14T15:57:41.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.726+0000 7fed30ff9700 1 -- 172.21.15.37:0/3396820954 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v17) v1 ==== 136+0+0 (secure 0 0 0) 0x7fed24058fc0 con 0x7fed3406cff0 2023-07-14T15:57:41.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.729+0000 7fed3a5ff700 1 -- 172.21.15.37:0/3396820954 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fed2006ad10 msgr2=0x7fed2006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:41.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.729+0000 7fed3a5ff700 1 --2- 172.21.15.37:0/3396820954 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fed2006ad10 0x7fed2006d1c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fed340cf9d0 tx=0x7fed28009040 comp rx=0 tx=0).stop 2023-07-14T15:57:41.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.729+0000 7fed3a5ff700 1 -- 172.21.15.37:0/3396820954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed3406cff0 msgr2=0x7fed34151a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:41.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.729+0000 7fed3a5ff700 1 --2- 172.21.15.37:0/3396820954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed3406cff0 0x7fed34151a50 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fed3406eea0 tx=0x7fed24004750 comp rx=0 tx=0).stop 2023-07-14T15:57:41.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.729+0000 7fed3a5ff700 1 -- 172.21.15.37:0/3396820954 shutdown_connections 2023-07-14T15:57:41.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.729+0000 7fed3a5ff700 1 --2- 172.21.15.37:0/3396820954 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed3415db00 0x7fed34159e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:41.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.729+0000 7fed3a5ff700 1 --2- 172.21.15.37:0/3396820954 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fed2006ad10 0x7fed2006d1c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:41.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.729+0000 7fed3a5ff700 1 --2- 172.21.15.37:0/3396820954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed3406cff0 0x7fed34151a50 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:41.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.729+0000 7fed3a5ff700 1 --2- 172.21.15.37:0/3396820954 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fed34159380 0x7fed341598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:41.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.729+0000 7fed3a5ff700 1 -- 172.21.15.37:0/3396820954 >> 172.21.15.37:0/3396820954 conn(0x7fed340cb470 msgr2=0x7fed340ac8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:41.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.729+0000 7fed3a5ff700 1 -- 172.21.15.37:0/3396820954 shutdown_connections 2023-07-14T15:57:41.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.730+0000 7fed3a5ff700 1 -- 172.21.15.37:0/3396820954 wait complete. 2023-07-14T15:57:41.735 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-14T15:57:41.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.956+0000 7fb9bcdff700 1 Processor -- start 2023-07-14T15:57:41.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.956+0000 7fb9bcdff700 1 -- start start 2023-07-14T15:57:41.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.957+0000 7fb9bcdff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb9b806b690 0x7fb9b80cfe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:41.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.957+0000 7fb9bcdff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb9b80d03a0 0x7fb9b80cb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:41.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.957+0000 7fb9bcdff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9b80d07e0 con 0x7fb9b80cf870 2023-07-14T15:57:41.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.957+0000 7fb9bcdff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9b80d1ae0 con 0x7fb9b806b690 2023-07-14T15:57:41.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.957+0000 7fb9bcdff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b815cb50 con 0x7fb9b80d03a0 2023-07-14T15:57:41.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.957+0000 7fb9affff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb9b806b690 0x7fb9b80cfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:41.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.957+0000 7fb9b659c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb9b80cf870 0x7fb9b806af80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48026/0 (socket says 172.21.15.37:48026) 2023-07-14T15:57:41.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.957+0000 7fb9b659c700 1 -- 172.21.15.37:0/4002324645 learned_addr learned my addr 172.21.15.37:0/4002324645 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:41.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.957+0000 7fb9b6d9d700 1 --2- 172.21.15.37:0/4002324645 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb9b80d03a0 0x7fb9b80cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:41.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.958+0000 7fb9b5d9b700 1 -- 172.21.15.37:0/4002324645 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3133165609 0 0) 0x7fb9b80d07e0 con 0x7fb9b80cf870 2023-07-14T15:57:41.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.958+0000 7fb9b5d9b700 1 -- 172.21.15.37:0/4002324645 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9a40035b0 con 0x7fb9b80cf870 2023-07-14T15:57:41.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.958+0000 7fb9affff700 1 -- 172.21.15.37:0/4002324645 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb9b80d03a0 msgr2=0x7fb9b80cb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:41.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.958+0000 7fb9affff700 1 --2- 172.21.15.37:0/4002324645 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb9b80d03a0 0x7fb9b80cb310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:41.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.958+0000 7fb9affff700 1 -- 172.21.15.37:0/4002324645 >> v1:172.21.15.37:6789/0 conn(0x7fb9b80cf870 legacy=0x7fb9b806af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:41.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.958+0000 7fb9affff700 1 -- 172.21.15.37:0/4002324645 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b80cebb0 con 0x7fb9b806b690 2023-07-14T15:57:41.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.958+0000 7fb9affff700 1 --2- 172.21.15.37:0/4002324645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9b806b690 0x7fb9b80cfe60 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0009840 tx=0x7fb9a0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8bc2373ac896637 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:41.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.958+0000 7fb9b5d9b700 1 -- 172.21.15.37:0/4002324645 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a0011830 con 0x7fb9b806b690 2023-07-14T15:57:41.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.958+0000 7fb9b5d9b700 1 -- 172.21.15.37:0/4002324645 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a0011990 con 0x7fb9b806b690 2023-07-14T15:57:41.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.958+0000 7fb9b5d9b700 1 -- 172.21.15.37:0/4002324645 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a0011d20 con 0x7fb9b806b690 2023-07-14T15:57:41.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.959+0000 7fb9bcdff700 1 -- 172.21.15.37:0/4002324645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9b806b690 msgr2=0x7fb9b80cfe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:41.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.959+0000 7fb9bcdff700 1 --2- 172.21.15.37:0/4002324645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9b806b690 0x7fb9b80cfe60 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0009840 tx=0x7fb9a0009b50 comp rx=0 tx=0).stop 2023-07-14T15:57:41.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.959+0000 7fb9bcdff700 1 -- 172.21.15.37:0/4002324645 shutdown_connections 2023-07-14T15:57:41.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.959+0000 7fb9bcdff700 1 --2- 172.21.15.37:0/4002324645 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb9b80d03a0 0x7fb9b80cb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:41.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.959+0000 7fb9bcdff700 1 --2- 172.21.15.37:0/4002324645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9b806b690 0x7fb9b80cfe60 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:41.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.959+0000 7fb9bcdff700 1 -- 172.21.15.37:0/4002324645 >> 172.21.15.37:0/4002324645 conn(0x7fb9b80664f0 msgr2=0x7fb9b809a030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:41.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.959+0000 7fb9bcdff700 1 -- 172.21.15.37:0/4002324645 shutdown_connections 2023-07-14T15:57:41.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.959+0000 7fb9bcdff700 1 -- 172.21.15.37:0/4002324645 wait complete. 2023-07-14T15:57:41.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.961+0000 7fb9bcdff700 1 Processor -- start 2023-07-14T15:57:41.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.961+0000 7fb9bcdff700 1 -- start start 2023-07-14T15:57:41.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.962+0000 7fb9bcdff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9b806b690 0x7fb9b81e6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:41.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.962+0000 7fb9bcdff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9b80d03a0 0x7fb9b80cd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:41.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.962+0000 7fb9bcdff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb9b80cd620 0x7fb9b80b5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:41.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.962+0000 7fb9bcdff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b80cdaa0 con 0x7fb9b80d03a0 2023-07-14T15:57:41.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.962+0000 7fb9bcdff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b814e760 con 0x7fb9b806b690 2023-07-14T15:57:41.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.962+0000 7fb9bcdff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b81e6b80 con 0x7fb9b80cd620 2023-07-14T15:57:41.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.962+0000 7fb9affff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9b80d03a0 0x7fb9b80cd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:41.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.962+0000 7fb9affff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9b80d03a0 0x7fb9b80cd0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48212/0 (socket says 172.21.15.37:48212) 2023-07-14T15:57:41.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.962+0000 7fb9affff700 1 -- 172.21.15.37:0/817579351 learned_addr learned my addr 172.21.15.37:0/817579351 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:41.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.962+0000 7fb9affff700 1 -- 172.21.15.37:0/817579351 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb9b80cd620 msgr2=0x7fb9b80b5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:41.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.962+0000 7fb9affff700 1 --2- 172.21.15.37:0/817579351 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb9b80cd620 0x7fb9b80b5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:41.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.963+0000 7fb9affff700 1 -- 172.21.15.37:0/817579351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9b806b690 msgr2=0x7fb9b81e6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:41.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.963+0000 7fb9affff700 1 --2- 172.21.15.37:0/817579351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9b806b690 0x7fb9b81e6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:41.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.963+0000 7fb9affff700 1 -- 172.21.15.37:0/817579351 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a00094a0 con 0x7fb9b80d03a0 2023-07-14T15:57:41.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.963+0000 7fb9affff700 1 --2- 172.21.15.37:0/817579351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9b80d03a0 0x7fb9b80cd0e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb9a00090b0 tx=0x7fb9a0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:41.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.963+0000 7fb9aeffd700 1 -- 172.21.15.37:0/817579351 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a00036a0 con 0x7fb9b80d03a0 2023-07-14T15:57:41.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.963+0000 7fb9aeffd700 1 -- 172.21.15.37:0/817579351 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a001f070 con 0x7fb9b80d03a0 2023-07-14T15:57:41.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.963+0000 7fb9aeffd700 1 -- 172.21.15.37:0/817579351 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a0003a40 con 0x7fb9b80d03a0 2023-07-14T15:57:41.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.963+0000 7fb9bcdff700 1 -- 172.21.15.37:0/817579351 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9b80b6b70 con 0x7fb9b80d03a0 2023-07-14T15:57:41.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.963+0000 7fb9bcdff700 1 -- 172.21.15.37:0/817579351 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9b814be10 con 0x7fb9b80d03a0 2023-07-14T15:57:41.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.964+0000 7fb9bcdff700 1 -- 172.21.15.37:0/817579351 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9b804e210 con 0x7fb9b80d03a0 2023-07-14T15:57:41.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.965+0000 7fb9aeffd700 1 -- 172.21.15.37:0/817579351 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb9a0003ba0 con 0x7fb9b80d03a0 2023-07-14T15:57:41.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.966+0000 7fb9aeffd700 1 --2- 172.21.15.37:0/817579351 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb99806ace0 0x7fb99806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:41.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.966+0000 7fb9aeffd700 1 -- 172.21.15.37:0/817579351 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb9a0021070 con 0x7fb9b80d03a0 2023-07-14T15:57:41.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.967+0000 7fb9b659c700 1 --2- 172.21.15.37:0/817579351 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb99806ace0 0x7fb99806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:41.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.967+0000 7fb9b659c700 1 --2- 172.21.15.37:0/817579351 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb99806ace0 0x7fb99806d190 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb9a80016b0 tx=0x7fb9a80079c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:41.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:41.971+0000 7fb9aeffd700 1 -- 172.21.15.37:0/817579351 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb9a0055d40 con 0x7fb9b80d03a0 2023-07-14T15:57:42.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.207+0000 7fb9bcdff700 1 -- 172.21.15.37:0/817579351 --> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fb9b80d0d20 con 0x7fb99806ace0 2023-07-14T15:57:42.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.209+0000 7fb9aeffd700 1 -- 172.21.15.37:0/817579351 <== mgr.4100 v2:172.21.15.98:6832/3163748069 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fb9a8005940 con 0x7fb99806ace0 2023-07-14T15:57:42.194 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-07-14T15:57:42.194 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:57:42.194 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephfs" 2023-07-14T15:57:42.194 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:57:42.195 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-07-14T15:57:42.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.211+0000 7fb9bcdff700 1 -- 172.21.15.37:0/817579351 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb99806ace0 msgr2=0x7fb99806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:42.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.211+0000 7fb9bcdff700 1 --2- 172.21.15.37:0/817579351 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb99806ace0 0x7fb99806d190 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb9a80016b0 tx=0x7fb9a80079c0 comp rx=0 tx=0).stop 2023-07-14T15:57:42.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.211+0000 7fb9bcdff700 1 -- 172.21.15.37:0/817579351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9b80d03a0 msgr2=0x7fb9b80cd0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:42.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.211+0000 7fb9bcdff700 1 --2- 172.21.15.37:0/817579351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9b80d03a0 0x7fb9b80cd0e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb9a00090b0 tx=0x7fb9a0004750 comp rx=0 tx=0).stop 2023-07-14T15:57:42.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.211+0000 7fb9bcdff700 1 -- 172.21.15.37:0/817579351 shutdown_connections 2023-07-14T15:57:42.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.211+0000 7fb9bcdff700 1 --2- 172.21.15.37:0/817579351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9b806b690 0x7fb9b81e6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:42.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.211+0000 7fb9bcdff700 1 --2- 172.21.15.37:0/817579351 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb99806ace0 0x7fb99806d190 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:42.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.211+0000 7fb9bcdff700 1 --2- 172.21.15.37:0/817579351 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb9b80cd620 0x7fb9b80b5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:42.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.211+0000 7fb9bcdff700 1 --2- 172.21.15.37:0/817579351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9b80d03a0 0x7fb9b80cd0e0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:42.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.211+0000 7fb9bcdff700 1 -- 172.21.15.37:0/817579351 >> 172.21.15.37:0/817579351 conn(0x7fb9b80664f0 msgr2=0x7fb9b80af0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:42.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.211+0000 7fb9bcdff700 1 -- 172.21.15.37:0/817579351 shutdown_connections 2023-07-14T15:57:42.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.211+0000 7fb9bcdff700 1 -- 172.21.15.37:0/817579351 wait complete. 2023-07-14T15:57:42.215 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-14T15:57:42.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.434+0000 7ff4349ff700 1 Processor -- start 2023-07-14T15:57:42.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.434+0000 7ff4349ff700 1 -- start start 2023-07-14T15:57:42.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.436+0000 7ff4349ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff4300d1140 0x7ff43015ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:42.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.436+0000 7ff4349ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff4301603b0 0x7ff4300b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:42.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.436+0000 7ff4349ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff43015dc50 con 0x7ff43015fee0 2023-07-14T15:57:42.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.436+0000 7ff4349ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4300b2940 con 0x7ff4301603b0 2023-07-14T15:57:42.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.436+0000 7ff4349ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4300b2c20 con 0x7ff4300d1140 2023-07-14T15:57:42.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.436+0000 7ff42e59c700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7ff43015fee0 0x7ff4300d0a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.37:53428/0 (socket says 172.21.15.37:53428) 2023-07-14T15:57:42.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.436+0000 7ff42dd9b700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff4300d1140 0x7ff43015ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:42.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.436+0000 7ff42e59c700 1 -- 172.21.15.37:0/3552670865 learned_addr learned my addr 172.21.15.37:0/3552670865 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:42.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.436+0000 7ff42ed9d700 1 --2- 172.21.15.37:0/3552670865 >> v2:172.21.15.98:3300/0 conn(0x7ff4301603b0 0x7ff4300b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:42.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.437+0000 7ff42dd9b700 1 -- 172.21.15.37:0/3552670865 >> v2:172.21.15.98:3300/0 conn(0x7ff4301603b0 msgr2=0x7ff4300b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:42.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.437+0000 7ff42dd9b700 1 --2- 172.21.15.37:0/3552670865 >> v2:172.21.15.98:3300/0 conn(0x7ff4301603b0 0x7ff4300b39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:42.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.437+0000 7ff42dd9b700 1 -- 172.21.15.37:0/3552670865 >> v1:172.21.15.98:6789/0 conn(0x7ff43015fee0 legacy=0x7ff4300d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:42.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.437+0000 7ff42dd9b700 1 -- 172.21.15.37:0/3552670865 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4300b2f00 con 0x7ff4300d1140 2023-07-14T15:57:42.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.437+0000 7ff42d59a700 1 -- 172.21.15.37:0/3552670865 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1407981544 0 0) 0x7ff43015dc50 con 0x7ff43015fee0 2023-07-14T15:57:42.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.437+0000 7ff42dd9b700 1 --2- 172.21.15.37:0/3552670865 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff4300d1140 0x7ff43015ded0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff424009840 tx=0x7ff424009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33c4a20e95c4fc17 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:42.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.437+0000 7ff42d59a700 1 -- 172.21.15.37:0/3552670865 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff424011830 con 0x7ff4300d1140 2023-07-14T15:57:42.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.437+0000 7ff42d59a700 1 -- 172.21.15.37:0/3552670865 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff424011990 con 0x7ff4300d1140 2023-07-14T15:57:42.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.437+0000 7ff42d59a700 1 -- 172.21.15.37:0/3552670865 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff424011d20 con 0x7ff4300d1140 2023-07-14T15:57:42.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.438+0000 7ff4349ff700 1 -- 172.21.15.37:0/3552670865 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff4300d1140 msgr2=0x7ff43015ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:42.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.438+0000 7ff4349ff700 1 --2- 172.21.15.37:0/3552670865 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff4300d1140 0x7ff43015ded0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff424009840 tx=0x7ff424009b50 comp rx=0 tx=0).stop 2023-07-14T15:57:42.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.438+0000 7ff4349ff700 1 -- 172.21.15.37:0/3552670865 shutdown_connections 2023-07-14T15:57:42.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.438+0000 7ff4349ff700 1 --2- 172.21.15.37:0/3552670865 >> v2:172.21.15.98:3300/0 conn(0x7ff4301603b0 0x7ff4300b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:42.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.438+0000 7ff4349ff700 1 --2- 172.21.15.37:0/3552670865 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff4300d1140 0x7ff43015ded0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:42.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.438+0000 7ff4349ff700 1 -- 172.21.15.37:0/3552670865 >> 172.21.15.37:0/3552670865 conn(0x7ff43009c1b0 msgr2=0x7ff4300d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:42.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.438+0000 7ff4349ff700 1 -- 172.21.15.37:0/3552670865 shutdown_connections 2023-07-14T15:57:42.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.438+0000 7ff4349ff700 1 -- 172.21.15.37:0/3552670865 wait complete. 2023-07-14T15:57:42.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.441+0000 7ff4349ff700 1 Processor -- start 2023-07-14T15:57:42.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.441+0000 7ff4349ff700 1 -- start start 2023-07-14T15:57:42.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.442+0000 7ff4349ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4300d1140 0x7ff4300b6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:42.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.442+0000 7ff4349ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff43015fee0 0x7ff4300b0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:42.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.442+0000 7ff4349ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff4301603b0 0x7ff4300b0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:42.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.442+0000 7ff4349ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff430155c60 con 0x7ff4300d1140 2023-07-14T15:57:42.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.442+0000 7ff4349ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4300c8ce0 con 0x7ff43015fee0 2023-07-14T15:57:42.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.442+0000 7ff4349ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4300c8fc0 con 0x7ff4301603b0 2023-07-14T15:57:42.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.442+0000 7ff42e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4300d1140 0x7ff4300b6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:42.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.442+0000 7ff42e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4300d1140 0x7ff4300b6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48228/0 (socket says 172.21.15.37:48228) 2023-07-14T15:57:42.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.442+0000 7ff42e59c700 1 -- 172.21.15.37:0/718153823 learned_addr learned my addr 172.21.15.37:0/718153823 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:42.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.443+0000 7ff42dd9b700 1 --2- 172.21.15.37:0/718153823 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff43015fee0 0x7ff4300b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:42.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.443+0000 7ff42ed9d700 1 --2- 172.21.15.37:0/718153823 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff4301603b0 0x7ff4300b0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:42.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.443+0000 7ff42e59c700 1 -- 172.21.15.37:0/718153823 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff4301603b0 msgr2=0x7ff4300b0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:42.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.443+0000 7ff42e59c700 1 --2- 172.21.15.37:0/718153823 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff4301603b0 0x7ff4300b0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:42.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.443+0000 7ff42e59c700 1 -- 172.21.15.37:0/718153823 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff43015fee0 msgr2=0x7ff4300b0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:42.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.443+0000 7ff42e59c700 1 --2- 172.21.15.37:0/718153823 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff43015fee0 0x7ff4300b0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:42.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.443+0000 7ff42e59c700 1 -- 172.21.15.37:0/718153823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4240094a0 con 0x7ff4300d1140 2023-07-14T15:57:42.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.443+0000 7ff42e59c700 1 --2- 172.21.15.37:0/718153823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4300d1140 0x7ff4300b6fc0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff42000c520 tx=0x7ff42000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:42.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.443+0000 7ff41effd700 1 -- 172.21.15.37:0/718153823 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff420004c80 con 0x7ff4300d1140 2023-07-14T15:57:42.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.443+0000 7ff41effd700 1 -- 172.21.15.37:0/718153823 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff420004e00 con 0x7ff4300d1140 2023-07-14T15:57:42.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.443+0000 7ff4349ff700 1 -- 172.21.15.37:0/718153823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4300c92a0 con 0x7ff4300d1140 2023-07-14T15:57:42.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.443+0000 7ff41effd700 1 -- 172.21.15.37:0/718153823 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff420007310 con 0x7ff4300d1140 2023-07-14T15:57:42.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.444+0000 7ff4349ff700 1 -- 172.21.15.37:0/718153823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4300c9580 con 0x7ff4300d1140 2023-07-14T15:57:42.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.445+0000 7ff4349ff700 1 -- 172.21.15.37:0/718153823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4301f23b0 con 0x7ff4300d1140 2023-07-14T15:57:42.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.446+0000 7ff41effd700 1 -- 172.21.15.37:0/718153823 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff420007470 con 0x7ff4300d1140 2023-07-14T15:57:42.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.447+0000 7ff41effd700 1 --2- 172.21.15.37:0/718153823 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff41006ace0 0x7ff41006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:42.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.447+0000 7ff41effd700 1 -- 172.21.15.37:0/718153823 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff420089110 con 0x7ff4300d1140 2023-07-14T15:57:42.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.448+0000 7ff42dd9b700 1 --2- 172.21.15.37:0/718153823 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff41006ace0 0x7ff41006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:42.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.448+0000 7ff42dd9b700 1 --2- 172.21.15.37:0/718153823 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff41006ace0 0x7ff41006d190 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff4300d1530 tx=0x7ff42401c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:42.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.452+0000 7ff41effd700 1 -- 172.21.15.37:0/718153823 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff4301f23b0 con 0x7ff4300d1140 2023-07-14T15:57:42.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.660+0000 7ff4349ff700 1 -- 172.21.15.37:0/718153823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff4301f23b0 con 0x7ff4300d1140 2023-07-14T15:57:42.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.660+0000 7ff41effd700 1 -- 172.21.15.37:0/718153823 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff4301f23b0 con 0x7ff4300d1140 2023-07-14T15:57:42.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.662+0000 7ff4349ff700 1 -- 172.21.15.37:0/718153823 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff41006ace0 msgr2=0x7ff41006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:42.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.662+0000 7ff4349ff700 1 --2- 172.21.15.37:0/718153823 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff41006ace0 0x7ff41006d190 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff4300d1530 tx=0x7ff42401c040 comp rx=0 tx=0).stop 2023-07-14T15:57:42.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.662+0000 7ff4349ff700 1 -- 172.21.15.37:0/718153823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4300d1140 msgr2=0x7ff4300b6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:42.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.662+0000 7ff4349ff700 1 --2- 172.21.15.37:0/718153823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4300d1140 0x7ff4300b6fc0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff42000c520 tx=0x7ff42000c830 comp rx=0 tx=0).stop 2023-07-14T15:57:42.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.662+0000 7ff4349ff700 1 -- 172.21.15.37:0/718153823 shutdown_connections 2023-07-14T15:57:42.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.662+0000 7ff4349ff700 1 --2- 172.21.15.37:0/718153823 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff41006ace0 0x7ff41006d190 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:42.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.662+0000 7ff4349ff700 1 --2- 172.21.15.37:0/718153823 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff4301603b0 0x7ff4300b0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:42.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.662+0000 7ff4349ff700 1 --2- 172.21.15.37:0/718153823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4300d1140 0x7ff4300b6fc0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:42.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.662+0000 7ff4349ff700 1 --2- 172.21.15.37:0/718153823 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff43015fee0 0x7ff4300b0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:42.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.662+0000 7ff4349ff700 1 -- 172.21.15.37:0/718153823 >> 172.21.15.37:0/718153823 conn(0x7ff43009c1b0 msgr2=0x7ff4300b3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:42.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.662+0000 7ff4349ff700 1 -- 172.21.15.37:0/718153823 shutdown_connections 2023-07-14T15:57:42.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.662+0000 7ff4349ff700 1 -- 172.21.15.37:0/718153823 wait complete. 2023-07-14T15:57:42.666 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs group_0000000000042574 2023-07-14T15:57:42.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.886+0000 7ff7461ff700 1 Processor -- start 2023-07-14T15:57:42.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.886+0000 7ff7461ff700 1 -- start start 2023-07-14T15:57:42.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.887+0000 7ff7461ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ff7400b1e80 0x7ff7400d2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:42.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.887+0000 7ff7461ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff7400b0ac0 0x7ff7400b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:42.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.887+0000 7ff7461ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7400b1840 con 0x7ff7400cfd50 2023-07-14T15:57:42.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.887+0000 7ff7461ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff74015ccf0 con 0x7ff7400b0ac0 2023-07-14T15:57:42.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.887+0000 7ff7461ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7400b2550 con 0x7ff7400b1e80 2023-07-14T15:57:42.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.888+0000 7ff73f7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff7400cfd50 0x7ff7400b2d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48040/0 (socket says 172.21.15.37:48040) 2023-07-14T15:57:42.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.888+0000 7ff73f7fe700 1 -- 172.21.15.37:0/2794029776 learned_addr learned my addr 172.21.15.37:0/2794029776 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:42.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.888+0000 7ff73ffff700 1 --2- 172.21.15.37:0/2794029776 >> v2:172.21.15.37:3300/0 conn(0x7ff7400b0ac0 0x7ff7400b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:42.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.888+0000 7ff73effd700 1 --2- 172.21.15.37:0/2794029776 >> v2:172.21.15.98:3300/0 conn(0x7ff7400b1e80 0x7ff7400d2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:42.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.888+0000 7ff73e7fc700 1 -- 172.21.15.37:0/2794029776 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 197486129 0 0) 0x7ff7400b1840 con 0x7ff7400cfd50 2023-07-14T15:57:42.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.888+0000 7ff73e7fc700 1 -- 172.21.15.37:0/2794029776 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7280035b0 con 0x7ff7400cfd50 2023-07-14T15:57:42.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.888+0000 7ff73ffff700 1 -- 172.21.15.37:0/2794029776 >> v2:172.21.15.98:3300/0 conn(0x7ff7400b1e80 msgr2=0x7ff7400d2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:42.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.888+0000 7ff73ffff700 1 --2- 172.21.15.37:0/2794029776 >> v2:172.21.15.98:3300/0 conn(0x7ff7400b1e80 0x7ff7400d2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:42.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.888+0000 7ff73ffff700 1 -- 172.21.15.37:0/2794029776 >> v1:172.21.15.37:6789/0 conn(0x7ff7400cfd50 legacy=0x7ff7400b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:42.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.888+0000 7ff73ffff700 1 -- 172.21.15.37:0/2794029776 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7400b2830 con 0x7ff7400b0ac0 2023-07-14T15:57:42.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.889+0000 7ff73ffff700 1 --2- 172.21.15.37:0/2794029776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7400b0ac0 0x7ff7400b0f60 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff7400b2320 tx=0x7ff73800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3cf12ff70980894 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:42.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.889+0000 7ff73e7fc700 1 -- 172.21.15.37:0/2794029776 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73800e070 con 0x7ff7400b0ac0 2023-07-14T15:57:42.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.889+0000 7ff73e7fc700 1 -- 172.21.15.37:0/2794029776 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73800bb20 con 0x7ff7400b0ac0 2023-07-14T15:57:42.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.889+0000 7ff73e7fc700 1 -- 172.21.15.37:0/2794029776 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff738012430 con 0x7ff7400b0ac0 2023-07-14T15:57:42.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.889+0000 7ff7461ff700 1 -- 172.21.15.37:0/2794029776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7400b0ac0 msgr2=0x7ff7400b0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:42.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.889+0000 7ff7461ff700 1 --2- 172.21.15.37:0/2794029776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7400b0ac0 0x7ff7400b0f60 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff7400b2320 tx=0x7ff73800b330 comp rx=0 tx=0).stop 2023-07-14T15:57:42.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.889+0000 7ff7461ff700 1 -- 172.21.15.37:0/2794029776 shutdown_connections 2023-07-14T15:57:42.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.889+0000 7ff7461ff700 1 --2- 172.21.15.37:0/2794029776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7400b0ac0 0x7ff7400b0f60 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:42.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.889+0000 7ff7461ff700 1 --2- 172.21.15.37:0/2794029776 >> v2:172.21.15.98:3300/0 conn(0x7ff7400b1e80 0x7ff7400d2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:42.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.889+0000 7ff7461ff700 1 -- 172.21.15.37:0/2794029776 >> 172.21.15.37:0/2794029776 conn(0x7ff74009c1c0 msgr2=0x7ff7400d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:42.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.889+0000 7ff7461ff700 1 -- 172.21.15.37:0/2794029776 shutdown_connections 2023-07-14T15:57:42.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.889+0000 7ff7461ff700 1 -- 172.21.15.37:0/2794029776 wait complete. 2023-07-14T15:57:42.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.891+0000 7ff7461ff700 1 Processor -- start 2023-07-14T15:57:42.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.891+0000 7ff7461ff700 1 -- start start 2023-07-14T15:57:42.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.892+0000 7ff7461ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7400b0ac0 0x7ff7400c9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:42.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.892+0000 7ff7461ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7400b1e80 0x7ff7401f5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:42.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.892+0000 7ff7461ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff7400cfd50 0x7ff740150c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:42.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.892+0000 7ff7461ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7400c7510 con 0x7ff7400b0ac0 2023-07-14T15:57:42.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.892+0000 7ff7461ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7400c7d20 con 0x7ff7400b1e80 2023-07-14T15:57:42.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.892+0000 7ff7461ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7400c9780 con 0x7ff7400cfd50 2023-07-14T15:57:42.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.893+0000 7ff73f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7400b0ac0 0x7ff7400c9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:42.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.893+0000 7ff73f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7400b0ac0 0x7ff7400c9240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48242/0 (socket says 172.21.15.37:48242) 2023-07-14T15:57:42.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.893+0000 7ff73f7fe700 1 -- 172.21.15.37:0/1156467201 learned_addr learned my addr 172.21.15.37:0/1156467201 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:42.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.893+0000 7ff73effd700 1 --2- 172.21.15.37:0/1156467201 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7400b1e80 0x7ff7401f5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:42.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.893+0000 7ff73ffff700 1 --2- 172.21.15.37:0/1156467201 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff7400cfd50 0x7ff740150c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:42.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.893+0000 7ff73f7fe700 1 -- 172.21.15.37:0/1156467201 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff7400cfd50 msgr2=0x7ff740150c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:42.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.893+0000 7ff73f7fe700 1 --2- 172.21.15.37:0/1156467201 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff7400cfd50 0x7ff740150c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:42.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.893+0000 7ff73f7fe700 1 -- 172.21.15.37:0/1156467201 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7400b1e80 msgr2=0x7ff7401f5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:42.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.893+0000 7ff73f7fe700 1 --2- 172.21.15.37:0/1156467201 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7400b1e80 0x7ff7401f5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:42.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.893+0000 7ff73f7fe700 1 -- 172.21.15.37:0/1156467201 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff738009a70 con 0x7ff7400b0ac0 2023-07-14T15:57:42.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.893+0000 7ff73f7fe700 1 --2- 172.21.15.37:0/1156467201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7400b0ac0 0x7ff7400c9240 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff73000c4d0 tx=0x7ff73000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:42.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.893+0000 7ff727fff700 1 -- 172.21.15.37:0/1156467201 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff730005d70 con 0x7ff7400b0ac0 2023-07-14T15:57:42.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.893+0000 7ff727fff700 1 -- 172.21.15.37:0/1156467201 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7300070d0 con 0x7ff7400b0ac0 2023-07-14T15:57:42.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.893+0000 7ff7461ff700 1 -- 172.21.15.37:0/1156467201 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7401590b0 con 0x7ff7400b0ac0 2023-07-14T15:57:42.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.894+0000 7ff727fff700 1 -- 172.21.15.37:0/1156467201 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff730007460 con 0x7ff7400b0ac0 2023-07-14T15:57:42.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.894+0000 7ff7461ff700 1 -- 172.21.15.37:0/1156467201 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7400c7a40 con 0x7ff7400b0ac0 2023-07-14T15:57:42.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.895+0000 7ff7461ff700 1 -- 172.21.15.37:0/1156467201 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7401e1bd0 con 0x7ff7400b0ac0 2023-07-14T15:57:42.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.896+0000 7ff727fff700 1 -- 172.21.15.37:0/1156467201 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff7300075c0 con 0x7ff7400b0ac0 2023-07-14T15:57:42.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.897+0000 7ff727fff700 1 --2- 172.21.15.37:0/1156467201 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff72c06ace0 0x7ff72c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:42.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.897+0000 7ff727fff700 1 -- 172.21.15.37:0/1156467201 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff7300889a0 con 0x7ff7400b0ac0 2023-07-14T15:57:42.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.898+0000 7ff73effd700 1 --2- 172.21.15.37:0/1156467201 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff72c06ace0 0x7ff72c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:42.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.898+0000 7ff73effd700 1 --2- 172.21.15.37:0/1156467201 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff72c06ace0 0x7ff72c06d190 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff74015ad90 tx=0x7ff734008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:42.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:42.902+0000 7ff727fff700 1 -- 172.21.15.37:0/1156467201 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff7401e1bd0 con 0x7ff7400b0ac0 2023-07-14T15:57:43.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.141+0000 7ff7461ff700 1 -- 172.21.15.37:0/1156467201 --> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "group_0000000000042574", "target": ["mon-mgr", ""]}) v1 -- 0x7ff7400d0120 con 0x7ff72c06ace0 2023-07-14T15:57:43.133 INFO:tasks.ceph.mgr.x.smithi098.stderr:2023-07-14T15:57:43.149+0000 7fa3c0dbe700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T15:57:43.134 INFO:tasks.ceph.mgr.x.smithi098.stderr:2023-07-14T15:57:43.149+0000 7fa3c0dbe700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T15:57:43.134 INFO:tasks.ceph.mgr.x.smithi098.stderr:2023-07-14T15:57:43.149+0000 7fa3c0dbe700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T15:57:43.134 INFO:tasks.ceph.mgr.x.smithi098.stderr:2023-07-14T15:57:43.149+0000 7fa3c0dbe700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T15:57:43.134 INFO:tasks.ceph.mgr.x.smithi098.stderr:2023-07-14T15:57:43.149+0000 7fa3c0dbe700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T15:57:43.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.166+0000 7ff727fff700 1 -- 172.21.15.37:0/1156467201 <== mgr.4100 v2:172.21.15.98:6832/3163748069 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7ff734011780 con 0x7ff72c06ace0 2023-07-14T15:57:43.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.168+0000 7ff7461ff700 1 -- 172.21.15.37:0/1156467201 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff72c06ace0 msgr2=0x7ff72c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:43.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.168+0000 7ff7461ff700 1 --2- 172.21.15.37:0/1156467201 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff72c06ace0 0x7ff72c06d190 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff74015ad90 tx=0x7ff734008040 comp rx=0 tx=0).stop 2023-07-14T15:57:43.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.168+0000 7ff7461ff700 1 -- 172.21.15.37:0/1156467201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7400b0ac0 msgr2=0x7ff7400c9240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:43.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.168+0000 7ff7461ff700 1 --2- 172.21.15.37:0/1156467201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7400b0ac0 0x7ff7400c9240 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff73000c4d0 tx=0x7ff73000c890 comp rx=0 tx=0).stop 2023-07-14T15:57:43.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.168+0000 7ff7461ff700 1 -- 172.21.15.37:0/1156467201 shutdown_connections 2023-07-14T15:57:43.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.168+0000 7ff7461ff700 1 --2- 172.21.15.37:0/1156467201 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff72c06ace0 0x7ff72c06d190 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:43.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.168+0000 7ff7461ff700 1 --2- 172.21.15.37:0/1156467201 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff7400cfd50 0x7ff740150c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:43.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.168+0000 7ff7461ff700 1 --2- 172.21.15.37:0/1156467201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7400b0ac0 0x7ff7400c9240 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:43.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.168+0000 7ff7461ff700 1 --2- 172.21.15.37:0/1156467201 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7400b1e80 0x7ff7401f5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:43.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.168+0000 7ff7461ff700 1 -- 172.21.15.37:0/1156467201 >> 172.21.15.37:0/1156467201 conn(0x7ff74009c1c0 msgr2=0x7ff7400b5100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:43.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.169+0000 7ff7461ff700 1 -- 172.21.15.37:0/1156467201 shutdown_connections 2023-07-14T15:57:43.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.169+0000 7ff7461ff700 1 -- 172.21.15.37:0/1156467201 wait complete. 2023-07-14T15:57:43.172 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup snapshot create cephfs group_0000000000042574 snapshot_0000000000437276 2023-07-14T15:57:43.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.394+0000 7fbb185ff700 1 Processor -- start 2023-07-14T15:57:43.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.394+0000 7fbb185ff700 1 -- start start 2023-07-14T15:57:43.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.395+0000 7fbb185ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbb100b1f30 0x7fbb10069e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:43.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.395+0000 7fbb185ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbb1015d5c0 0x7fbb100ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:43.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.395+0000 7fbb185ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb1006e4f0 con 0x7fbb1006a3b0 2023-07-14T15:57:43.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.395+0000 7fbb185ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb1006a850 con 0x7fbb100b1f30 2023-07-14T15:57:43.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.395+0000 7fbb185ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1015dbe0 con 0x7fbb1015d5c0 2023-07-14T15:57:43.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.395+0000 7fbb1639b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbb100b1f30 0x7fbb10069e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:43.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.395+0000 7fbb15b9a700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fbb1006a3b0 0x7fbb1015ceb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48044/0 (socket says 172.21.15.37:48044) 2023-07-14T15:57:43.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.395+0000 7fbb15b9a700 1 -- 172.21.15.37:0/2963754870 learned_addr learned my addr 172.21.15.37:0/2963754870 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:43.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.396+0000 7fbb16b9c700 1 --2- 172.21.15.37:0/2963754870 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbb1015d5c0 0x7fbb100ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:43.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.396+0000 7fbb15399700 1 -- 172.21.15.37:0/2963754870 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4289428192 0 0) 0x7fbb00001110 con 0x7fbb1006a3b0 2023-07-14T15:57:43.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.396+0000 7fbb1639b700 1 -- 172.21.15.37:0/2963754870 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbb1015d5c0 msgr2=0x7fbb100ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:43.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.396+0000 7fbb1639b700 1 --2- 172.21.15.37:0/2963754870 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbb1015d5c0 0x7fbb100ce6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:43.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.396+0000 7fbb1639b700 1 -- 172.21.15.37:0/2963754870 >> v1:172.21.15.37:6789/0 conn(0x7fbb1006a3b0 legacy=0x7fbb1015ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:43.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.396+0000 7fbb1639b700 1 -- 172.21.15.37:0/2963754870 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb101603a0 con 0x7fbb100b1f30 2023-07-14T15:57:43.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.396+0000 7fbb1639b700 1 --2- 172.21.15.37:0/2963754870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb100b1f30 0x7fbb10069e70 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c009840 tx=0x7fbb0c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a448831c9816176 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:43.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.396+0000 7fbb15399700 1 -- 172.21.15.37:0/2963754870 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c011830 con 0x7fbb100b1f30 2023-07-14T15:57:43.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.396+0000 7fbb15399700 1 -- 172.21.15.37:0/2963754870 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb0c011990 con 0x7fbb100b1f30 2023-07-14T15:57:43.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.396+0000 7fbb15399700 1 -- 172.21.15.37:0/2963754870 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c011d20 con 0x7fbb100b1f30 2023-07-14T15:57:43.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.397+0000 7fbb185ff700 1 -- 172.21.15.37:0/2963754870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb100b1f30 msgr2=0x7fbb10069e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:43.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.397+0000 7fbb185ff700 1 --2- 172.21.15.37:0/2963754870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb100b1f30 0x7fbb10069e70 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c009840 tx=0x7fbb0c009b50 comp rx=0 tx=0).stop 2023-07-14T15:57:43.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.397+0000 7fbb185ff700 1 -- 172.21.15.37:0/2963754870 shutdown_connections 2023-07-14T15:57:43.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.397+0000 7fbb185ff700 1 --2- 172.21.15.37:0/2963754870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb100b1f30 0x7fbb10069e70 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:43.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.397+0000 7fbb185ff700 1 --2- 172.21.15.37:0/2963754870 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbb1015d5c0 0x7fbb100ce6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:43.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.397+0000 7fbb185ff700 1 -- 172.21.15.37:0/2963754870 >> 172.21.15.37:0/2963754870 conn(0x7fbb100cc580 msgr2=0x7fbb100cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:43.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.397+0000 7fbb185ff700 1 -- 172.21.15.37:0/2963754870 shutdown_connections 2023-07-14T15:57:43.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.397+0000 7fbb185ff700 1 -- 172.21.15.37:0/2963754870 wait complete. 2023-07-14T15:57:43.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.399+0000 7fbb185ff700 1 Processor -- start 2023-07-14T15:57:43.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.399+0000 7fbb185ff700 1 -- start start 2023-07-14T15:57:43.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.400+0000 7fbb185ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb1006a3b0 0x7fbb101f5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:43.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.400+0000 7fbb185ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbb100b1f30 0x7fbb1015be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:43.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.400+0000 7fbb185ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb1015d5c0 0x7fbb1015c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:43.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.400+0000 7fbb185ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb101f65d0 con 0x7fbb1006a3b0 2023-07-14T15:57:43.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.400+0000 7fbb185ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb100b3830 con 0x7fbb1015d5c0 2023-07-14T15:57:43.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.400+0000 7fbb185ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb101f6010 con 0x7fbb100b1f30 2023-07-14T15:57:43.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.400+0000 7fbb1639b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb1006a3b0 0x7fbb101f5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:43.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.400+0000 7fbb1639b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb1006a3b0 0x7fbb101f5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48256/0 (socket says 172.21.15.37:48256) 2023-07-14T15:57:43.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.400+0000 7fbb1639b700 1 -- 172.21.15.37:0/1975291723 learned_addr learned my addr 172.21.15.37:0/1975291723 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:43.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.400+0000 7fbb1639b700 1 -- 172.21.15.37:0/1975291723 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbb100b1f30 msgr2=0x7fbb1015be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:43.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.400+0000 7fbb15b9a700 1 --2- 172.21.15.37:0/1975291723 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbb100b1f30 0x7fbb1015be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:43.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.400+0000 7fbb16b9c700 1 --2- 172.21.15.37:0/1975291723 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb1015d5c0 0x7fbb1015c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:43.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.400+0000 7fbb1639b700 1 --2- 172.21.15.37:0/1975291723 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbb100b1f30 0x7fbb1015be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:43.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.400+0000 7fbb1639b700 1 -- 172.21.15.37:0/1975291723 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb1015d5c0 msgr2=0x7fbb1015c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:43.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.400+0000 7fbb1639b700 1 --2- 172.21.15.37:0/1975291723 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb1015d5c0 0x7fbb1015c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:43.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.400+0000 7fbb1639b700 1 -- 172.21.15.37:0/1975291723 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb0c0094a0 con 0x7fbb1006a3b0 2023-07-14T15:57:43.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.400+0000 7fbb15b9a700 1 --2- 172.21.15.37:0/1975291723 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbb100b1f30 0x7fbb1015be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:57:43.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.400+0000 7fbb16b9c700 1 --2- 172.21.15.37:0/1975291723 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb1015d5c0 0x7fbb1015c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:57:43.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.401+0000 7fbb1639b700 1 --2- 172.21.15.37:0/1975291723 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb1006a3b0 0x7fbb101f5630 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c0090b0 tx=0x7fbb0c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:43.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.401+0000 7fbb06ffd700 1 -- 172.21.15.37:0/1975291723 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c0038a0 con 0x7fbb1006a3b0 2023-07-14T15:57:43.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.401+0000 7fbb06ffd700 1 -- 172.21.15.37:0/1975291723 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb0c01f070 con 0x7fbb1006a3b0 2023-07-14T15:57:43.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.401+0000 7fbb185ff700 1 -- 172.21.15.37:0/1975291723 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb101f62f0 con 0x7fbb1006a3b0 2023-07-14T15:57:43.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.401+0000 7fbb06ffd700 1 -- 172.21.15.37:0/1975291723 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c003c20 con 0x7fbb1006a3b0 2023-07-14T15:57:43.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.401+0000 7fbb185ff700 1 -- 172.21.15.37:0/1975291723 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb100b5680 con 0x7fbb1006a3b0 2023-07-14T15:57:43.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.402+0000 7fbb185ff700 1 -- 172.21.15.37:0/1975291723 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb100b5870 con 0x7fbb1006a3b0 2023-07-14T15:57:43.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.403+0000 7fbb06ffd700 1 -- 172.21.15.37:0/1975291723 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbb0c026480 con 0x7fbb1006a3b0 2023-07-14T15:57:43.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.405+0000 7fbb06ffd700 1 --2- 172.21.15.37:0/1975291723 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbaf406ace0 0x7fbaf406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:43.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.405+0000 7fbb06ffd700 1 -- 172.21.15.37:0/1975291723 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbb0c021070 con 0x7fbb1006a3b0 2023-07-14T15:57:43.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.405+0000 7fbb15b9a700 1 --2- 172.21.15.37:0/1975291723 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbaf406ace0 0x7fbaf406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:43.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.406+0000 7fbb15b9a700 1 --2- 172.21.15.37:0/1975291723 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbaf406ace0 0x7fbaf406d190 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbb00007fd0 tx=0x7fbb00009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:43.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.409+0000 7fbb06ffd700 1 -- 172.21.15.37:0/1975291723 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fbb100b5870 con 0x7fbb1006a3b0 2023-07-14T15:57:43.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.645+0000 7fbb185ff700 1 -- 172.21.15.37:0/1975291723 --> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup snapshot create", "vol_name": "cephfs", "group_name": "group_0000000000042574", "snap_name": "snapshot_0000000000437276", "target": ["mon-mgr", ""]}) v1 -- 0x7fbb10160960 con 0x7fbaf406ace0 2023-07-14T15:57:43.633 INFO:tasks.ceph.mgr.x.smithi098.stderr:2023-07-14T15:57:43.648+0000 7fa3c0dbe700 -1 mgr.server reply reply (38) Function not implemented subvolume group snapshots are not supported 2023-07-14T15:57:43.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.649+0000 7fbb06ffd700 1 -- 172.21.15.37:0/1975291723 <== mgr.4100 v2:172.21.15.98:6832/3163748069 1 ==== mgr_command_reply(tid 0: -38 subvolume group snapshots are not supported) v1 ==== 51+0+0 (secure 0 0 0) 0x7fbb000014c0 con 0x7fbaf406ace0 2023-07-14T15:57:43.635 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENOSYS: subvolume group snapshots are not supported 2023-07-14T15:57:43.643 DEBUG:teuthology.orchestra.run:got remote process result: 38 2023-07-14T15:57:43.643 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup rm cephfs group_0000000000042574 2023-07-14T15:57:43.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.863+0000 7fb0715ff700 1 Processor -- start 2023-07-14T15:57:43.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.863+0000 7fb0715ff700 1 -- start start 2023-07-14T15:57:43.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.864+0000 7fb0715ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb06c15fee0 0x7fb06c15ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:43.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.864+0000 7fb0715ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb06c1603b0 0x7fb06c0d0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:43.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.864+0000 7fb0715ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb06c0d13d0 con 0x7fb06c0d0f70 2023-07-14T15:57:43.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.864+0000 7fb0715ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb06c15dc50 con 0x7fb06c15fee0 2023-07-14T15:57:43.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.864+0000 7fb0715ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb06c0b2940 con 0x7fb06c1603b0 2023-07-14T15:57:43.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.864+0000 7fb06b7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb06c0d0f70 0x7fb06c0b39e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48050/0 (socket says 172.21.15.37:48050) 2023-07-14T15:57:43.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.864+0000 7fb06affd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb06c15fee0 0x7fb06c15ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:43.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.864+0000 7fb06b7fe700 1 -- 172.21.15.37:0/1530467281 learned_addr learned my addr 172.21.15.37:0/1530467281 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:43.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.865+0000 7fb06a7fc700 1 --2- 172.21.15.37:0/1530467281 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb06c1603b0 0x7fb06c0d0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:43.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.865+0000 7fb069ffb700 1 -- 172.21.15.37:0/1530467281 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4162400629 0 0) 0x7fb06c0d13d0 con 0x7fb06c0d0f70 2023-07-14T15:57:43.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.865+0000 7fb069ffb700 1 -- 172.21.15.37:0/1530467281 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0540035b0 con 0x7fb06c0d0f70 2023-07-14T15:57:43.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.865+0000 7fb06affd700 1 -- 172.21.15.37:0/1530467281 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb06c1603b0 msgr2=0x7fb06c0d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:43.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.865+0000 7fb06affd700 1 --2- 172.21.15.37:0/1530467281 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb06c1603b0 0x7fb06c0d0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:43.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.865+0000 7fb06affd700 1 -- 172.21.15.37:0/1530467281 >> v1:172.21.15.37:6789/0 conn(0x7fb06c0d0f70 legacy=0x7fb06c0b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:43.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.865+0000 7fb06affd700 1 -- 172.21.15.37:0/1530467281 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb06c0b2c20 con 0x7fb06c15fee0 2023-07-14T15:57:43.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.865+0000 7fb06affd700 1 --2- 172.21.15.37:0/1530467281 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb06c15fee0 0x7fb06c15ded0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb05c009840 tx=0x7fb05c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9ba8a2484a05def server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:43.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.865+0000 7fb069ffb700 1 -- 172.21.15.37:0/1530467281 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05c011830 con 0x7fb06c15fee0 2023-07-14T15:57:43.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.866+0000 7fb069ffb700 1 -- 172.21.15.37:0/1530467281 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb05c011990 con 0x7fb06c15fee0 2023-07-14T15:57:43.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.866+0000 7fb069ffb700 1 -- 172.21.15.37:0/1530467281 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05c011d20 con 0x7fb06c15fee0 2023-07-14T15:57:43.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.866+0000 7fb0715ff700 1 -- 172.21.15.37:0/1530467281 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb06c15fee0 msgr2=0x7fb06c15ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:43.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.866+0000 7fb0715ff700 1 --2- 172.21.15.37:0/1530467281 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb06c15fee0 0x7fb06c15ded0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb05c009840 tx=0x7fb05c009b50 comp rx=0 tx=0).stop 2023-07-14T15:57:43.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.866+0000 7fb0715ff700 1 -- 172.21.15.37:0/1530467281 shutdown_connections 2023-07-14T15:57:43.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.866+0000 7fb0715ff700 1 --2- 172.21.15.37:0/1530467281 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb06c15fee0 0x7fb06c15ded0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:43.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.866+0000 7fb0715ff700 1 --2- 172.21.15.37:0/1530467281 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb06c1603b0 0x7fb06c0d0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:43.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.866+0000 7fb0715ff700 1 -- 172.21.15.37:0/1530467281 >> 172.21.15.37:0/1530467281 conn(0x7fb06c09c1b0 msgr2=0x7fb06c0d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:43.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.866+0000 7fb0715ff700 1 -- 172.21.15.37:0/1530467281 shutdown_connections 2023-07-14T15:57:43.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.866+0000 7fb0715ff700 1 -- 172.21.15.37:0/1530467281 wait complete. 2023-07-14T15:57:43.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.868+0000 7fb0715ff700 1 Processor -- start 2023-07-14T15:57:43.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.868+0000 7fb0715ff700 1 -- start start 2023-07-14T15:57:43.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.869+0000 7fb0715ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb06c0d0f70 0x7fb06c0b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:43.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.869+0000 7fb0715ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb06c15fee0 0x7fb06c0c9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:43.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.869+0000 7fb0715ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb06c1603b0 0x7fb06c0b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:43.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.869+0000 7fb0715ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb06c0b1b20 con 0x7fb06c0d0f70 2023-07-14T15:57:43.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.869+0000 7fb0715ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb06c0b1560 con 0x7fb06c15fee0 2023-07-14T15:57:43.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.869+0000 7fb0715ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb06c0b1840 con 0x7fb06c1603b0 2023-07-14T15:57:43.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.869+0000 7fb06affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb06c0d0f70 0x7fb06c0b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:43.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.869+0000 7fb06affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb06c0d0f70 0x7fb06c0b0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48264/0 (socket says 172.21.15.37:48264) 2023-07-14T15:57:43.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.869+0000 7fb06affd700 1 -- 172.21.15.37:0/3559030915 learned_addr learned my addr 172.21.15.37:0/3559030915 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:43.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.869+0000 7fb06b7fe700 1 --2- 172.21.15.37:0/3559030915 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb06c1603b0 0x7fb06c0b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:43.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.869+0000 7fb06a7fc700 1 --2- 172.21.15.37:0/3559030915 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb06c15fee0 0x7fb06c0c9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:43.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.870+0000 7fb06affd700 1 -- 172.21.15.37:0/3559030915 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb06c1603b0 msgr2=0x7fb06c0b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:43.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.870+0000 7fb06affd700 1 --2- 172.21.15.37:0/3559030915 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb06c1603b0 0x7fb06c0b65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:43.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.870+0000 7fb06affd700 1 -- 172.21.15.37:0/3559030915 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb06c15fee0 msgr2=0x7fb06c0c9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:43.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.870+0000 7fb06affd700 1 --2- 172.21.15.37:0/3559030915 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb06c15fee0 0x7fb06c0c9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:43.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.870+0000 7fb06affd700 1 -- 172.21.15.37:0/3559030915 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb05c0094a0 con 0x7fb06c0d0f70 2023-07-14T15:57:43.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.870+0000 7fb06affd700 1 --2- 172.21.15.37:0/3559030915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb06c0d0f70 0x7fb06c0b0d30 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb05c009fd0 tx=0x7fb05c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:43.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.870+0000 7fb0537fe700 1 -- 172.21.15.37:0/3559030915 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05c004400 con 0x7fb06c0d0f70 2023-07-14T15:57:43.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.870+0000 7fb0537fe700 1 -- 172.21.15.37:0/3559030915 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb05c01f070 con 0x7fb06c0d0f70 2023-07-14T15:57:43.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.870+0000 7fb0537fe700 1 -- 172.21.15.37:0/3559030915 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05c0038e0 con 0x7fb06c0d0f70 2023-07-14T15:57:43.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.870+0000 7fb0715ff700 1 -- 172.21.15.37:0/3559030915 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb06c0b5dc0 con 0x7fb06c0d0f70 2023-07-14T15:57:43.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.870+0000 7fb0715ff700 1 -- 172.21.15.37:0/3559030915 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb06c0b1270 con 0x7fb06c0d0f70 2023-07-14T15:57:43.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.872+0000 7fb0715ff700 1 -- 172.21.15.37:0/3559030915 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb06c0b62e0 con 0x7fb06c0d0f70 2023-07-14T15:57:43.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.872+0000 7fb0537fe700 1 -- 172.21.15.37:0/3559030915 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb05c021030 con 0x7fb06c0d0f70 2023-07-14T15:57:43.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.873+0000 7fb0537fe700 1 --2- 172.21.15.37:0/3559030915 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb05806ace0 0x7fb05806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:43.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.874+0000 7fb0537fe700 1 -- 172.21.15.37:0/3559030915 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb05c08a640 con 0x7fb06c0d0f70 2023-07-14T15:57:43.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.874+0000 7fb06a7fc700 1 --2- 172.21.15.37:0/3559030915 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb05806ace0 0x7fb05806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:43.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.874+0000 7fb06a7fc700 1 --2- 172.21.15.37:0/3559030915 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb05806ace0 0x7fb05806d190 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb06c15ebc0 tx=0x7fb060008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:43.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:43.878+0000 7fb0537fe700 1 -- 172.21.15.37:0/3559030915 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb05c0556e0 con 0x7fb06c0d0f70 2023-07-14T15:57:44.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.119+0000 7fb0715ff700 1 -- 172.21.15.37:0/3559030915 --> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup rm", "vol_name": "cephfs", "group_name": "group_0000000000042574", "target": ["mon-mgr", ""]}) v1 -- 0x7fb06c0b31e0 con 0x7fb05806ace0 2023-07-14T15:57:44.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.123+0000 7fb0537fe700 1 -- 172.21.15.37:0/3559030915 <== mgr.4100 v2:172.21.15.98:6832/3163748069 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fb060009e40 con 0x7fb05806ace0 2023-07-14T15:57:44.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.125+0000 7fb0715ff700 1 -- 172.21.15.37:0/3559030915 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb05806ace0 msgr2=0x7fb05806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:44.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.125+0000 7fb0715ff700 1 --2- 172.21.15.37:0/3559030915 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb05806ace0 0x7fb05806d190 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb06c15ebc0 tx=0x7fb060008040 comp rx=0 tx=0).stop 2023-07-14T15:57:44.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.125+0000 7fb0715ff700 1 -- 172.21.15.37:0/3559030915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb06c0d0f70 msgr2=0x7fb06c0b0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:44.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.125+0000 7fb0715ff700 1 --2- 172.21.15.37:0/3559030915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb06c0d0f70 0x7fb06c0b0d30 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb05c009fd0 tx=0x7fb05c004750 comp rx=0 tx=0).stop 2023-07-14T15:57:44.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.125+0000 7fb0715ff700 1 -- 172.21.15.37:0/3559030915 shutdown_connections 2023-07-14T15:57:44.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.125+0000 7fb0715ff700 1 --2- 172.21.15.37:0/3559030915 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb05806ace0 0x7fb05806d190 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:44.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.125+0000 7fb0715ff700 1 --2- 172.21.15.37:0/3559030915 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb06c1603b0 0x7fb06c0b65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:44.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.125+0000 7fb0715ff700 1 --2- 172.21.15.37:0/3559030915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb06c0d0f70 0x7fb06c0b0d30 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:44.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.125+0000 7fb0715ff700 1 --2- 172.21.15.37:0/3559030915 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb06c15fee0 0x7fb06c0c9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:44.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.126+0000 7fb0715ff700 1 -- 172.21.15.37:0/3559030915 >> 172.21.15.37:0/3559030915 conn(0x7fb06c09c1b0 msgr2=0x7fb06c06bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:44.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.126+0000 7fb0715ff700 1 -- 172.21.15.37:0/3559030915 shutdown_connections 2023-07-14T15:57:44.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.126+0000 7fb0715ff700 1 -- 172.21.15.37:0/3559030915 wait complete. 2023-07-14T15:57:44.129 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-14T15:57:44.131 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T15:57:44.235 DEBUG:teuthology.orchestra.run.smithi098:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T15:57:44.344 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-14T15:57:44.344 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-14T15:57:44.344 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T15:57:44.387 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-14T15:57:44.388 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T15:57:44.471 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T15:57:44.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.727+0000 7f8431bff700 1 Processor -- start 2023-07-14T15:57:44.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.728+0000 7f8431bff700 1 -- start start 2023-07-14T15:57:44.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.729+0000 7f8431bff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f842c0ce400 0x7f842c0afae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:44.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.729+0000 7f8431bff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f842c15a810 0x7f842c0b0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:44.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.729+0000 7f8431bff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f842c0cb5e0 con 0x7f842c15a440 2023-07-14T15:57:44.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.729+0000 7f8431bff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f842c0cb880 con 0x7f842c0ce400 2023-07-14T15:57:44.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.729+0000 7f8431bff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f842c0cbb60 con 0x7f842c15a810 2023-07-14T15:57:44.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.729+0000 7f842affd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f842c0ce400 0x7f842c0afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:44.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.729+0000 7f842b7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f842c15a440 0x7f842c0cdcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48058/0 (socket says 172.21.15.37:48058) 2023-07-14T15:57:44.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.729+0000 7f842b7fe700 1 -- 172.21.15.37:0/664420078 learned_addr learned my addr 172.21.15.37:0/664420078 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:44.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.729+0000 7f842bfff700 1 --2- 172.21.15.37:0/664420078 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f842c15a810 0x7f842c0b0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:44.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.730+0000 7f842a7fc700 1 -- 172.21.15.37:0/664420078 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3681560911 0 0) 0x7f842c0cb5e0 con 0x7f842c15a440 2023-07-14T15:57:44.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.730+0000 7f842affd700 1 -- 172.21.15.37:0/664420078 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f842c15a810 msgr2=0x7f842c0b0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:44.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.730+0000 7f842affd700 1 --2- 172.21.15.37:0/664420078 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f842c15a810 0x7f842c0b0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:44.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.730+0000 7f842affd700 1 -- 172.21.15.37:0/664420078 >> v1:172.21.15.37:6789/0 conn(0x7f842c15a440 legacy=0x7f842c0cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:44.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.730+0000 7f842affd700 1 -- 172.21.15.37:0/664420078 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f842c0cbe40 con 0x7f842c0ce400 2023-07-14T15:57:44.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.730+0000 7f842affd700 1 --2- 172.21.15.37:0/664420078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f842c0ce400 0x7f842c0afae0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8420009840 tx=0x7f8420009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b91e0d48e37efd2d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:44.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.730+0000 7f842a7fc700 1 -- 172.21.15.37:0/664420078 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8420011830 con 0x7f842c0ce400 2023-07-14T15:57:44.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.730+0000 7f842a7fc700 1 -- 172.21.15.37:0/664420078 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8420011990 con 0x7f842c0ce400 2023-07-14T15:57:44.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.730+0000 7f842a7fc700 1 -- 172.21.15.37:0/664420078 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8420011d20 con 0x7f842c0ce400 2023-07-14T15:57:44.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.731+0000 7f8431bff700 1 -- 172.21.15.37:0/664420078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f842c0ce400 msgr2=0x7f842c0afae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:44.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.731+0000 7f8431bff700 1 --2- 172.21.15.37:0/664420078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f842c0ce400 0x7f842c0afae0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8420009840 tx=0x7f8420009b50 comp rx=0 tx=0).stop 2023-07-14T15:57:44.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.731+0000 7f8431bff700 1 -- 172.21.15.37:0/664420078 shutdown_connections 2023-07-14T15:57:44.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.731+0000 7f8431bff700 1 --2- 172.21.15.37:0/664420078 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f842c15a810 0x7f842c0b0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:44.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.731+0000 7f8431bff700 1 --2- 172.21.15.37:0/664420078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f842c0ce400 0x7f842c0afae0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:44.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.731+0000 7f8431bff700 1 -- 172.21.15.37:0/664420078 >> 172.21.15.37:0/664420078 conn(0x7f842c0b08c0 msgr2=0x7f842c0b0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:44.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.731+0000 7f8431bff700 1 -- 172.21.15.37:0/664420078 shutdown_connections 2023-07-14T15:57:44.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.731+0000 7f8431bff700 1 -- 172.21.15.37:0/664420078 wait complete. 2023-07-14T15:57:44.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.733+0000 7f8431bff700 1 Processor -- start 2023-07-14T15:57:44.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.733+0000 7f8431bff700 1 -- start start 2023-07-14T15:57:44.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.734+0000 7f8431bff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f842c0ce400 0x7f842c06c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:44.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.734+0000 7f8431bff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f842c15a440 0x7f842c158ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:44.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.734+0000 7f8431bff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f842c15a810 0x7f842c159020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:44.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.734+0000 7f8431bff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842c148f40 con 0x7f842c15a810 2023-07-14T15:57:44.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.734+0000 7f8431bff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842c14ac40 con 0x7f842c0ce400 2023-07-14T15:57:44.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.734+0000 7f8431bff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f842c14aee0 con 0x7f842c15a440 2023-07-14T15:57:44.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.734+0000 7f842bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f842c15a810 0x7f842c159020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:44.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.734+0000 7f842bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f842c15a810 0x7f842c159020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48286/0 (socket says 172.21.15.37:48286) 2023-07-14T15:57:44.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.734+0000 7f842b7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f842c0ce400 0x7f842c06c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:44.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.734+0000 7f842bfff700 1 -- 172.21.15.37:0/761140774 learned_addr learned my addr 172.21.15.37:0/761140774 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:44.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.734+0000 7f842affd700 1 --2- 172.21.15.37:0/761140774 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f842c15a440 0x7f842c158ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:44.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.735+0000 7f842bfff700 1 -- 172.21.15.37:0/761140774 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f842c15a440 msgr2=0x7f842c158ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:44.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.735+0000 7f842bfff700 1 --2- 172.21.15.37:0/761140774 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f842c15a440 0x7f842c158ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:44.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.735+0000 7f842bfff700 1 -- 172.21.15.37:0/761140774 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f842c0ce400 msgr2=0x7f842c06c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:44.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.735+0000 7f842bfff700 1 --2- 172.21.15.37:0/761140774 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f842c0ce400 0x7f842c06c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:44.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.735+0000 7f842bfff700 1 -- 172.21.15.37:0/761140774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84200094a0 con 0x7f842c15a810 2023-07-14T15:57:44.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.735+0000 7f842bfff700 1 --2- 172.21.15.37:0/761140774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f842c15a810 0x7f842c159020 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f842400efc0 tx=0x7f842400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:44.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.736+0000 7f8413fff700 1 -- 172.21.15.37:0/761140774 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8424009ea0 con 0x7f842c15a810 2023-07-14T15:57:44.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.736+0000 7f8413fff700 1 -- 172.21.15.37:0/761140774 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842400f040 con 0x7f842c15a810 2023-07-14T15:57:44.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.736+0000 7f8431bff700 1 -- 172.21.15.37:0/761140774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f842c14b1c0 con 0x7f842c15a810 2023-07-14T15:57:44.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.736+0000 7f8413fff700 1 -- 172.21.15.37:0/761140774 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842400ced0 con 0x7f842c15a810 2023-07-14T15:57:44.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.736+0000 7f8431bff700 1 -- 172.21.15.37:0/761140774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f842c1582e0 con 0x7f842c15a810 2023-07-14T15:57:44.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.737+0000 7f8431bff700 1 -- 172.21.15.37:0/761140774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f842c067840 con 0x7f842c15a810 2023-07-14T15:57:44.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.738+0000 7f8413fff700 1 -- 172.21.15.37:0/761140774 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8424014480 con 0x7f842c15a810 2023-07-14T15:57:44.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.739+0000 7f8413fff700 1 --2- 172.21.15.37:0/761140774 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f841806ace0 0x7f841806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:44.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.739+0000 7f8413fff700 1 -- 172.21.15.37:0/761140774 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8424089c90 con 0x7f842c15a810 2023-07-14T15:57:44.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.739+0000 7f842b7fe700 1 --2- 172.21.15.37:0/761140774 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f841806ace0 0x7f841806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:44.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.740+0000 7f842b7fe700 1 --2- 172.21.15.37:0/761140774 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f841806ace0 0x7f841806d190 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f841c007fd0 tx=0x7f841c007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:44.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.744+0000 7f8413fff700 1 -- 172.21.15.37:0/761140774 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8424054d30 con 0x7f842c15a810 2023-07-14T15:57:44.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.954+0000 7f8431bff700 1 -- 172.21.15.37:0/761140774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f842c06c950 con 0x7f842c15a810 2023-07-14T15:57:44.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.955+0000 7f8413fff700 1 -- 172.21.15.37:0/761140774 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+18341 (secure 0 0 0) 0x7f8424058350 con 0x7f842c15a810 2023-07-14T15:57:44.941 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:57:44.941 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":36,"fsid":"9da30401-a779-4e46-aba6-00c2494c6c67","created":"2023-07-14T15:55:39.898867+0000","modified":"2023-07-14T15:57:26.688069+0000","last_up_change":"2023-07-14T15:55:53.025696+0000","last_in_change":"2023-07-14T15:55:43.388192+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T15:55:52.907261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T15:55:59.992839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-14T15:57:23.872384+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-14T15:57:24.423055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d049535-7b87-4276-8fe5-0f74ba422d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6801","nonce":2783032392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6803","nonce":2783032392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6807","nonce":2783032392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6805","nonce":2783032392}]},"public_addr":"172.21.15.37:6801/2783032392","cluster_addr":"172.21.15.37:6803/2783032392","heartbeat_back_addr":"172.21.15.37:6807/2783032392","heartbeat_front_addr":"172.21.15.37:6805/2783032392","state":["exists","up"]},{"osd":1,"uuid":"79ec948d-ead2-4c2d-923a-dd6eeaac9dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6823","nonce":1190059746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6826","nonce":1190059746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6831","nonce":1190059746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6829","nonce":1190059746}]},"public_addr":"172.21.15.37:6823/1190059746","cluster_addr":"172.21.15.37:6826/1190059746","heartbeat_back_addr":"172.21.15.37:6831/1190059746","heartbeat_front_addr":"172.21.15.37:6829/1190059746","state":["exists","up"]},{"osd":2,"uuid":"a1db6690-c160-4366-9c82-2cca17e4bba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6809","nonce":2266223499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6813","nonce":2266223499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6820","nonce":2266223499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6816","nonce":2266223499}]},"public_addr":"172.21.15.37:6809/2266223499","cluster_addr":"172.21.15.37:6813/2266223499","heartbeat_back_addr":"172.21.15.37:6820/2266223499","heartbeat_front_addr":"172.21.15.37:6816/2266223499","state":["exists","up"]},{"osd":3,"uuid":"767b8220-e79a-4a86-a162-6b3b73198379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6812","nonce":4166694594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6817","nonce":4166694594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6828","nonce":4166694594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6822","nonce":4166694594}]},"public_addr":"172.21.15.37:6812/4166694594","cluster_addr":"172.21.15.37:6817/4166694594","heartbeat_back_addr":"172.21.15.37:6828/4166694594","heartbeat_front_addr":"172.21.15.37:6822/4166694594","state":["exists","up"]},{"osd":4,"uuid":"717bd773-ae7e-4236-ac79-900cf99a37c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6801","nonce":3529020407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6803","nonce":3529020407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6807","nonce":3529020407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6805","nonce":3529020407}]},"public_addr":"172.21.15.98:6801/3529020407","cluster_addr":"172.21.15.98:6803/3529020407","heartbeat_back_addr":"172.21.15.98:6807/3529020407","heartbeat_front_addr":"172.21.15.98:6805/3529020407","state":["exists","up"]},{"osd":5,"uuid":"a941d358-0f03-4136-a9b2-3a1c2e9358cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6817","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6819","nonce":2311501838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6821","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6823","nonce":2311501838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6829","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6831","nonce":2311501838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6825","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6827","nonce":2311501838}]},"public_addr":"172.21.15.98:6819/2311501838","cluster_addr":"172.21.15.98:6823/2311501838","heartbeat_back_addr":"172.21.15.98:6831/2311501838","heartbeat_front_addr":"172.21.15.98:6827/2311501838","state":["exists","up"]},{"osd":6,"uuid":"27153772-6d4b-479d-9953-0582e7b96743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6809","nonce":1144224691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6811","nonce":1144224691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6815","nonce":1144224691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6813","nonce":1144224691}]},"public_addr":"172.21.15.98:6809/1144224691","cluster_addr":"172.21.15.98:6811/1144224691","heartbeat_back_addr":"172.21.15.98:6815/1144224691","heartbeat_front_addr":"172.21.15.98:6813/1144224691","state":["exists","up"]},{"osd":7,"uuid":"d21ffc8e-40bb-47eb-af2c-e3e730d3fb76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6818","nonce":1144470927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6822","nonce":1144470927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6830","nonce":1144470927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6826","nonce":1144470927}]},"public_addr":"172.21.15.98:6818/1144470927","cluster_addr":"172.21.15.98:6822/1144470927","heartbeat_back_addr":"172.21.15.98:6830/1144470927","heartbeat_front_addr":"172.21.15.98:6826/1144470927","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.921114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.739210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.024016+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.002527+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.698127+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.813416+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.709351+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.815457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T15:57:44.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.957+0000 7f8431bff700 1 -- 172.21.15.37:0/761140774 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f841806ace0 msgr2=0x7f841806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:44.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.957+0000 7f8431bff700 1 --2- 172.21.15.37:0/761140774 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f841806ace0 0x7f841806d190 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f841c007fd0 tx=0x7f841c007de0 comp rx=0 tx=0).stop 2023-07-14T15:57:44.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.957+0000 7f8431bff700 1 -- 172.21.15.37:0/761140774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f842c15a810 msgr2=0x7f842c159020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:44.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.957+0000 7f8431bff700 1 --2- 172.21.15.37:0/761140774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f842c15a810 0x7f842c159020 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f842400efc0 tx=0x7f842400c3a0 comp rx=0 tx=0).stop 2023-07-14T15:57:44.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.957+0000 7f8431bff700 1 -- 172.21.15.37:0/761140774 shutdown_connections 2023-07-14T15:57:44.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.957+0000 7f8431bff700 1 --2- 172.21.15.37:0/761140774 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f842c0ce400 0x7f842c06c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:44.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.957+0000 7f8431bff700 1 --2- 172.21.15.37:0/761140774 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f841806ace0 0x7f841806d190 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:44.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.957+0000 7f8431bff700 1 --2- 172.21.15.37:0/761140774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f842c15a810 0x7f842c159020 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:44.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.957+0000 7f8431bff700 1 --2- 172.21.15.37:0/761140774 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f842c15a440 0x7f842c158ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:44.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.957+0000 7f8431bff700 1 -- 172.21.15.37:0/761140774 >> 172.21.15.37:0/761140774 conn(0x7f842c0b08c0 msgr2=0x7f842c0b0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:44.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.957+0000 7f8431bff700 1 -- 172.21.15.37:0/761140774 shutdown_connections 2023-07-14T15:57:44.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:44.957+0000 7f8431bff700 1 -- 172.21.15.37:0/761140774 wait complete. 2023-07-14T15:57:44.961 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T15:55:52.907261+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T15:55:59.992839+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T15:57:23.872384+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T15:57:24.423055+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T15:57:44.961 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T15:57:45.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.180+0000 7f17ec3ff700 1 Processor -- start 2023-07-14T15:57:45.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.180+0000 7f17ec3ff700 1 -- start start 2023-07-14T15:57:45.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.181+0000 7f17ec3ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f17e415fee0 0x7f17e415ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:45.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.182+0000 7f17ec3ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17e415dc50 con 0x7f17e41603b0 2023-07-14T15:57:45.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.182+0000 7f17ec3ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17e40b2940 con 0x7f17e40d1140 2023-07-14T15:57:45.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.182+0000 7f17ec3ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17e40b2c20 con 0x7f17e415fee0 2023-07-14T15:57:45.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.182+0000 7f17ea19b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f17e415fee0 0x7f17e415ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:45.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.182+0000 7f17e999a700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f17e41603b0 0x7f17e40d0a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48070/0 (socket says 172.21.15.37:48070) 2023-07-14T15:57:45.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.182+0000 7f17e999a700 1 -- 172.21.15.37:0/3555794563 learned_addr learned my addr 172.21.15.37:0/3555794563 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:45.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.182+0000 7f17ea19b700 1 -- 172.21.15.37:0/3555794563 >> v1:172.21.15.98:6789/0 conn(0x7f17e40d1140 legacy=0x7f17e40b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:45.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.182+0000 7f17ea19b700 1 -- 172.21.15.37:0/3555794563 >> v1:172.21.15.37:6789/0 conn(0x7f17e41603b0 legacy=0x7f17e40d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:45.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.182+0000 7f17ea19b700 1 -- 172.21.15.37:0/3555794563 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e40b2f00 con 0x7f17e415fee0 2023-07-14T15:57:45.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.183+0000 7f17ea19b700 1 --2- 172.21.15.37:0/3555794563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17e415fee0 0x7f17e415ded0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f17e0009840 tx=0x7f17e0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63c8332d4a10809a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:45.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.183+0000 7f17e9199700 1 -- 172.21.15.37:0/3555794563 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e0011830 con 0x7f17e415fee0 2023-07-14T15:57:45.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.183+0000 7f17e9199700 1 -- 172.21.15.37:0/3555794563 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e0011990 con 0x7f17e415fee0 2023-07-14T15:57:45.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.183+0000 7f17e9199700 1 -- 172.21.15.37:0/3555794563 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e0011d20 con 0x7f17e415fee0 2023-07-14T15:57:45.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.183+0000 7f17ec3ff700 1 -- 172.21.15.37:0/3555794563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17e415fee0 msgr2=0x7f17e415ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:45.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.183+0000 7f17ec3ff700 1 --2- 172.21.15.37:0/3555794563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17e415fee0 0x7f17e415ded0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f17e0009840 tx=0x7f17e0009b50 comp rx=0 tx=0).stop 2023-07-14T15:57:45.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.183+0000 7f17ec3ff700 1 -- 172.21.15.37:0/3555794563 shutdown_connections 2023-07-14T15:57:45.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.183+0000 7f17ec3ff700 1 --2- 172.21.15.37:0/3555794563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17e415fee0 0x7f17e415ded0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:45.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.183+0000 7f17ec3ff700 1 -- 172.21.15.37:0/3555794563 >> 172.21.15.37:0/3555794563 conn(0x7f17e409c1b0 msgr2=0x7f17e40d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:45.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.184+0000 7f17ec3ff700 1 -- 172.21.15.37:0/3555794563 shutdown_connections 2023-07-14T15:57:45.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.184+0000 7f17ec3ff700 1 -- 172.21.15.37:0/3555794563 wait complete. 2023-07-14T15:57:45.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.185+0000 7f17ec3ff700 1 Processor -- start 2023-07-14T15:57:45.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.185+0000 7f17ec3ff700 1 -- start start 2023-07-14T15:57:45.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.186+0000 7f17ec3ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f17e40d1140 0x7f17e40b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:45.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.186+0000 7f17ec3ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17e415fee0 0x7f17e4145ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:45.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.186+0000 7f17ec3ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17e41603b0 0x7f17e41f17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:45.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.186+0000 7f17ec3ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e40b8b40 con 0x7f17e41603b0 2023-07-14T15:57:45.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.186+0000 7f17ec3ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e40b61d0 con 0x7f17e415fee0 2023-07-14T15:57:45.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.186+0000 7f17ec3ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17e40b0990 con 0x7f17e40d1140 2023-07-14T15:57:45.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.187+0000 7f17ea99c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17e41603b0 0x7f17e41f17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:45.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.187+0000 7f17ea99c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17e41603b0 0x7f17e41f17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48294/0 (socket says 172.21.15.37:48294) 2023-07-14T15:57:45.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.187+0000 7f17ea99c700 1 -- 172.21.15.37:0/361091672 learned_addr learned my addr 172.21.15.37:0/361091672 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:45.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.187+0000 7f17ea19b700 1 --2- 172.21.15.37:0/361091672 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f17e40d1140 0x7f17e40b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:45.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.187+0000 7f17e999a700 1 --2- 172.21.15.37:0/361091672 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17e415fee0 0x7f17e4145ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:45.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.187+0000 7f17ea99c700 1 -- 172.21.15.37:0/361091672 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f17e40d1140 msgr2=0x7f17e40b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:45.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.187+0000 7f17ea99c700 1 --2- 172.21.15.37:0/361091672 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f17e40d1140 0x7f17e40b5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:45.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.187+0000 7f17ea99c700 1 -- 172.21.15.37:0/361091672 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17e415fee0 msgr2=0x7f17e4145ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:45.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.187+0000 7f17ea99c700 1 --2- 172.21.15.37:0/361091672 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17e415fee0 0x7f17e4145ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:45.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.187+0000 7f17ea99c700 1 -- 172.21.15.37:0/361091672 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e00094a0 con 0x7f17e41603b0 2023-07-14T15:57:45.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.187+0000 7f17ea19b700 1 --2- 172.21.15.37:0/361091672 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f17e40d1140 0x7f17e40b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:57:45.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.187+0000 7f17ea99c700 1 --2- 172.21.15.37:0/361091672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17e41603b0 0x7f17e41f17d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f17dc00cb50 tx=0x7f17dc00cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:45.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.188+0000 7f17daffd700 1 -- 172.21.15.37:0/361091672 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc003c00 con 0x7f17e41603b0 2023-07-14T15:57:45.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.188+0000 7f17daffd700 1 -- 172.21.15.37:0/361091672 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17dc003d60 con 0x7f17e41603b0 2023-07-14T15:57:45.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.188+0000 7f17daffd700 1 -- 172.21.15.37:0/361091672 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc00ab70 con 0x7f17e41603b0 2023-07-14T15:57:45.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.188+0000 7f17ec3ff700 1 -- 172.21.15.37:0/361091672 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17e40b0c70 con 0x7f17e41603b0 2023-07-14T15:57:45.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.188+0000 7f17ec3ff700 1 -- 172.21.15.37:0/361091672 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17e40b1230 con 0x7f17e41603b0 2023-07-14T15:57:45.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.189+0000 7f17ec3ff700 1 -- 172.21.15.37:0/361091672 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17e4067840 con 0x7f17e41603b0 2023-07-14T15:57:45.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.190+0000 7f17daffd700 1 -- 172.21.15.37:0/361091672 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f17dc00acd0 con 0x7f17e41603b0 2023-07-14T15:57:45.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.191+0000 7f17daffd700 1 --2- 172.21.15.37:0/361091672 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f17c806ace0 0x7f17c806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:45.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.191+0000 7f17daffd700 1 -- 172.21.15.37:0/361091672 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f17dc0895c0 con 0x7f17e41603b0 2023-07-14T15:57:45.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.191+0000 7f17ea19b700 1 --2- 172.21.15.37:0/361091672 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f17c806ace0 0x7f17c806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:45.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.192+0000 7f17ea19b700 1 --2- 172.21.15.37:0/361091672 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f17c806ace0 0x7f17c806d190 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f17e00090b0 tx=0x7f17e0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:45.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.195+0000 7f17daffd700 1 -- 172.21.15.37:0/361091672 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f17dc0545d0 con 0x7f17e41603b0 2023-07-14T15:57:45.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.402+0000 7f17ec3ff700 1 -- 172.21.15.37:0/361091672 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f17e406c0b0 con 0x7f17e41603b0 2023-07-14T15:57:45.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.403+0000 7f17daffd700 1 -- 172.21.15.37:0/361091672 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f17dc057bf0 con 0x7f17e41603b0 2023-07-14T15:57:45.388 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-14T15:57:45.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.405+0000 7f17ec3ff700 1 -- 172.21.15.37:0/361091672 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f17c806ace0 msgr2=0x7f17c806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:45.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.405+0000 7f17ec3ff700 1 --2- 172.21.15.37:0/361091672 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f17c806ace0 0x7f17c806d190 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f17e00090b0 tx=0x7f17e0008030 comp rx=0 tx=0).stop 2023-07-14T15:57:45.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.405+0000 7f17ec3ff700 1 -- 172.21.15.37:0/361091672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17e41603b0 msgr2=0x7f17e41f17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:45.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.405+0000 7f17ec3ff700 1 --2- 172.21.15.37:0/361091672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17e41603b0 0x7f17e41f17d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f17dc00cb50 tx=0x7f17dc00cf10 comp rx=0 tx=0).stop 2023-07-14T15:57:45.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.405+0000 7f17ec3ff700 1 -- 172.21.15.37:0/361091672 shutdown_connections 2023-07-14T15:57:45.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.405+0000 7f17ec3ff700 1 --2- 172.21.15.37:0/361091672 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f17c806ace0 0x7f17c806d190 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:45.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.405+0000 7f17ec3ff700 1 --2- 172.21.15.37:0/361091672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17e41603b0 0x7f17e41f17d0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:45.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.405+0000 7f17ec3ff700 1 --2- 172.21.15.37:0/361091672 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f17e40d1140 0x7f17e40b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:45.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.405+0000 7f17ec3ff700 1 --2- 172.21.15.37:0/361091672 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17e415fee0 0x7f17e4145ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:45.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.405+0000 7f17ec3ff700 1 -- 172.21.15.37:0/361091672 >> 172.21.15.37:0/361091672 conn(0x7f17e409c1b0 msgr2=0x7f17e41e6f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:45.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.405+0000 7f17ec3ff700 1 -- 172.21.15.37:0/361091672 shutdown_connections 2023-07-14T15:57:45.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.405+0000 7f17ec3ff700 1 -- 172.21.15.37:0/361091672 wait complete. 2023-07-14T15:57:45.408 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T15:57:45.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.627+0000 7feddd5ff700 1 Processor -- start 2023-07-14T15:57:45.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.628+0000 7feddd5ff700 1 -- start start 2023-07-14T15:57:45.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.629+0000 7feddd5ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fedd80cb430 0x7fedd80cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:45.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.629+0000 7feddd5ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fedd806d290 0x7fedd80c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:45.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.629+0000 7feddd5ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedd80707f0 con 0x7fedd8071820 2023-07-14T15:57:45.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.629+0000 7feddd5ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedd80cbd40 con 0x7fedd806d290 2023-07-14T15:57:45.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.629+0000 7feddd5ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedd8070a60 con 0x7fedd80cb430 2023-07-14T15:57:45.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.629+0000 7fedd77fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fedd806d290 0x7fedd80c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:45.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.629+0000 7fedd67fc700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fedd8071820 0x7fedd806cb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48082/0 (socket says 172.21.15.37:48082) 2023-07-14T15:57:45.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.629+0000 7fedd67fc700 1 -- 172.21.15.37:0/1861904796 learned_addr learned my addr 172.21.15.37:0/1861904796 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:45.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.629+0000 7fedd6ffd700 1 --2- 172.21.15.37:0/1861904796 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fedd80cb430 0x7fedd80cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:45.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.630+0000 7fedd77fe700 1 -- 172.21.15.37:0/1861904796 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fedd80cb430 msgr2=0x7fedd80cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:45.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.630+0000 7fedd77fe700 1 --2- 172.21.15.37:0/1861904796 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fedd80cb430 0x7fedd80cb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:45.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.630+0000 7fedd77fe700 1 -- 172.21.15.37:0/1861904796 >> v1:172.21.15.37:6789/0 conn(0x7fedd8071820 legacy=0x7fedd806cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:45.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.630+0000 7fedd77fe700 1 -- 172.21.15.37:0/1861904796 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd8070d40 con 0x7fedd806d290 2023-07-14T15:57:45.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.630+0000 7fedd5ffb700 1 -- 172.21.15.37:0/1861904796 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2747170726 0 0) 0x7fedd80707f0 con 0x7fedd8071820 2023-07-14T15:57:45.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.630+0000 7fedd77fe700 1 --2- 172.21.15.37:0/1861904796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedd806d290 0x7fedd80c90d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fedd0009d90 tx=0x7fedd000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbce181f3fede570 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:45.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.630+0000 7fedd5ffb700 1 -- 172.21.15.37:0/1861904796 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd000e070 con 0x7fedd806d290 2023-07-14T15:57:45.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.630+0000 7fedd5ffb700 1 -- 172.21.15.37:0/1861904796 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd000bb20 con 0x7fedd806d290 2023-07-14T15:57:45.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.630+0000 7fedd5ffb700 1 -- 172.21.15.37:0/1861904796 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd0012430 con 0x7fedd806d290 2023-07-14T15:57:45.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.631+0000 7feddd5ff700 1 -- 172.21.15.37:0/1861904796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedd806d290 msgr2=0x7fedd80c90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:45.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.631+0000 7feddd5ff700 1 --2- 172.21.15.37:0/1861904796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedd806d290 0x7fedd80c90d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fedd0009d90 tx=0x7fedd000b330 comp rx=0 tx=0).stop 2023-07-14T15:57:45.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.631+0000 7feddd5ff700 1 -- 172.21.15.37:0/1861904796 shutdown_connections 2023-07-14T15:57:45.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.631+0000 7feddd5ff700 1 --2- 172.21.15.37:0/1861904796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedd806d290 0x7fedd80c90d0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:45.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.631+0000 7feddd5ff700 1 --2- 172.21.15.37:0/1861904796 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fedd80cb430 0x7fedd80cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:45.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.631+0000 7feddd5ff700 1 -- 172.21.15.37:0/1861904796 >> 172.21.15.37:0/1861904796 conn(0x7fedd806aac0 msgr2=0x7fedd80b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:45.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.631+0000 7feddd5ff700 1 -- 172.21.15.37:0/1861904796 shutdown_connections 2023-07-14T15:57:45.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.631+0000 7feddd5ff700 1 -- 172.21.15.37:0/1861904796 wait complete. 2023-07-14T15:57:45.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.632+0000 7feddd5ff700 1 Processor -- start 2023-07-14T15:57:45.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.633+0000 7feddd5ff700 1 -- start start 2023-07-14T15:57:45.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.634+0000 7feddd5ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedd806d290 0x7fedd815be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:45.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.634+0000 7feddd5ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fedd8071820 0x7fedd815c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:45.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.634+0000 7feddd5ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fedd80cb430 0x7fedd81f3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:45.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.634+0000 7feddd5ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd80b35b0 con 0x7fedd806d290 2023-07-14T15:57:45.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.634+0000 7feddd5ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd8154fe0 con 0x7fedd80cb430 2023-07-14T15:57:45.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.634+0000 7feddd5ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedd80b29c0 con 0x7fedd8071820 2023-07-14T15:57:45.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.634+0000 7fedd6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedd806d290 0x7fedd815be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:45.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.634+0000 7fedd6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedd806d290 0x7fedd815be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48318/0 (socket says 172.21.15.37:48318) 2023-07-14T15:57:45.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.634+0000 7fedd6ffd700 1 -- 172.21.15.37:0/2075326199 learned_addr learned my addr 172.21.15.37:0/2075326199 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:45.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.634+0000 7fedd67fc700 1 --2- 172.21.15.37:0/2075326199 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fedd8071820 0x7fedd815c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:45.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.634+0000 7fedd77fe700 1 --2- 172.21.15.37:0/2075326199 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fedd80cb430 0x7fedd81f3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:45.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.634+0000 7fedd6ffd700 1 -- 172.21.15.37:0/2075326199 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fedd8071820 msgr2=0x7fedd815c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:45.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.634+0000 7fedd6ffd700 1 --2- 172.21.15.37:0/2075326199 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fedd8071820 0x7fedd815c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:45.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.634+0000 7fedd6ffd700 1 -- 172.21.15.37:0/2075326199 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fedd80cb430 msgr2=0x7fedd81f3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:45.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.634+0000 7fedd6ffd700 1 --2- 172.21.15.37:0/2075326199 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fedd80cb430 0x7fedd81f3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:45.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.634+0000 7fedd6ffd700 1 -- 172.21.15.37:0/2075326199 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd0009a70 con 0x7fedd806d290 2023-07-14T15:57:45.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.634+0000 7fedd67fc700 1 --2- 172.21.15.37:0/2075326199 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fedd8071820 0x7fedd815c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:57:45.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.635+0000 7fedd6ffd700 1 --2- 172.21.15.37:0/2075326199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedd806d290 0x7fedd815be20 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fedc800e8a0 tx=0x7fedc800ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:45.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.635+0000 7fedbf7fe700 1 -- 172.21.15.37:0/2075326199 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc8009590 con 0x7fedd806d290 2023-07-14T15:57:45.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.635+0000 7fedbf7fe700 1 -- 172.21.15.37:0/2075326199 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc800eea0 con 0x7fedd806d290 2023-07-14T15:57:45.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.635+0000 7feddd5ff700 1 -- 172.21.15.37:0/2075326199 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedd80b2c10 con 0x7fedd806d290 2023-07-14T15:57:45.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.635+0000 7fedbf7fe700 1 -- 172.21.15.37:0/2075326199 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc800ca50 con 0x7fedd806d290 2023-07-14T15:57:45.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.635+0000 7feddd5ff700 1 -- 172.21.15.37:0/2075326199 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedd80b31d0 con 0x7fedd806d290 2023-07-14T15:57:45.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.636+0000 7feddd5ff700 1 -- 172.21.15.37:0/2075326199 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedd80b3820 con 0x7fedd806d290 2023-07-14T15:57:45.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.637+0000 7fedbf7fe700 1 -- 172.21.15.37:0/2075326199 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fedc800cbb0 con 0x7fedd806d290 2023-07-14T15:57:45.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.638+0000 7fedbf7fe700 1 --2- 172.21.15.37:0/2075326199 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fedc406ace0 0x7fedc406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:45.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.638+0000 7fedbf7fe700 1 -- 172.21.15.37:0/2075326199 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fedc80893c0 con 0x7fedd806d290 2023-07-14T15:57:45.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.638+0000 7fedd67fc700 1 --2- 172.21.15.37:0/2075326199 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fedc406ace0 0x7fedc406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:45.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.639+0000 7fedd67fc700 1 --2- 172.21.15.37:0/2075326199 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fedc406ace0 0x7fedc406d190 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fedd81556a0 tx=0x7fedcc007ca0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:45.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.642+0000 7fedbf7fe700 1 -- 172.21.15.37:0/2075326199 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fedc8057f90 con 0x7fedd806d290 2023-07-14T15:57:45.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.744+0000 7fedbf7fe700 1 -- 172.21.15.37:0/2075326199 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7fedc80548d0 con 0x7fedd806d290 2023-07-14T15:57:45.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.852+0000 7feddd5ff700 1 -- 172.21.15.37:0/2075326199 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fedd80ca640 con 0x7fedd806d290 2023-07-14T15:57:45.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.853+0000 7fedbf7fe700 1 -- 172.21.15.37:0/2075326199 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v36) v1 ==== 92+0+10 (secure 0 0 0) 0x7fedc80739f0 con 0x7fedd806d290 2023-07-14T15:57:45.838 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-14T15:57:45.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.855+0000 7feddd5ff700 1 -- 172.21.15.37:0/2075326199 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fedc406ace0 msgr2=0x7fedc406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:45.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.855+0000 7feddd5ff700 1 --2- 172.21.15.37:0/2075326199 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fedc406ace0 0x7fedc406d190 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fedd81556a0 tx=0x7fedcc007ca0 comp rx=0 tx=0).stop 2023-07-14T15:57:45.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.855+0000 7feddd5ff700 1 -- 172.21.15.37:0/2075326199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedd806d290 msgr2=0x7fedd815be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:45.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.855+0000 7feddd5ff700 1 --2- 172.21.15.37:0/2075326199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedd806d290 0x7fedd815be20 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fedc800e8a0 tx=0x7fedc800ec60 comp rx=0 tx=0).stop 2023-07-14T15:57:45.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.855+0000 7feddd5ff700 1 -- 172.21.15.37:0/2075326199 shutdown_connections 2023-07-14T15:57:45.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.855+0000 7feddd5ff700 1 --2- 172.21.15.37:0/2075326199 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fedd80cb430 0x7fedd81f3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:45.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.855+0000 7feddd5ff700 1 --2- 172.21.15.37:0/2075326199 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fedc406ace0 0x7fedc406d190 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:45.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.855+0000 7feddd5ff700 1 --2- 172.21.15.37:0/2075326199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedd806d290 0x7fedd815be20 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:45.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.855+0000 7feddd5ff700 1 --2- 172.21.15.37:0/2075326199 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fedd8071820 0x7fedd815c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:45.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.855+0000 7feddd5ff700 1 -- 172.21.15.37:0/2075326199 >> 172.21.15.37:0/2075326199 conn(0x7fedd806aac0 msgr2=0x7fedd80ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:45.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.855+0000 7feddd5ff700 1 -- 172.21.15.37:0/2075326199 shutdown_connections 2023-07-14T15:57:45.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:45.855+0000 7feddd5ff700 1 -- 172.21.15.37:0/2075326199 wait complete. 2023-07-14T15:57:45.859 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T15:57:46.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.080+0000 7fbf11fff700 1 Processor -- start 2023-07-14T15:57:46.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.080+0000 7fbf11fff700 1 -- start start 2023-07-14T15:57:46.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.081+0000 7fbf11fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbf0c071730 0x7fbf0c06f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:46.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.081+0000 7fbf11fff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf0c159870 con 0x7fbf0c0ae000 2023-07-14T15:57:46.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.081+0000 7fbf11fff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf0c0ca790 con 0x7fbf0c06c0d0 2023-07-14T15:57:46.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.081+0000 7fbf11fff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf0c0ae4a0 con 0x7fbf0c071730 2023-07-14T15:57:46.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.081+0000 7fbf0b7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbf0c071730 0x7fbf0c06f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:46.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.081+0000 7fbf0affd700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fbf0c0ae000 0x7fbf0c06b9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48098/0 (socket says 172.21.15.37:48098) 2023-07-14T15:57:46.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.081+0000 7fbf0affd700 1 -- 172.21.15.37:0/2214422759 learned_addr learned my addr 172.21.15.37:0/2214422759 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:46.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.082+0000 7fbf0b7fe700 1 -- 172.21.15.37:0/2214422759 >> v1:172.21.15.98:6789/0 conn(0x7fbf0c06c0d0 legacy=0x7fbf0c0cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:46.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.082+0000 7fbf0b7fe700 1 -- 172.21.15.37:0/2214422759 >> v1:172.21.15.37:6789/0 conn(0x7fbf0c0ae000 legacy=0x7fbf0c06b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:46.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.082+0000 7fbf0b7fe700 1 -- 172.21.15.37:0/2214422759 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf0c0cc780 con 0x7fbf0c071730 2023-07-14T15:57:46.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.082+0000 7fbf0b7fe700 1 --2- 172.21.15.37:0/2214422759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf0c071730 0x7fbf0c06f740 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fbefc009840 tx=0x7fbefc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76b56a31a5ca0a77 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:46.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.082+0000 7fbf0a7fc700 1 -- 172.21.15.37:0/2214422759 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbefc00f8a0 con 0x7fbf0c071730 2023-07-14T15:57:46.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.082+0000 7fbf0a7fc700 1 -- 172.21.15.37:0/2214422759 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbefc00fa00 con 0x7fbf0c071730 2023-07-14T15:57:46.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.082+0000 7fbf0a7fc700 1 -- 172.21.15.37:0/2214422759 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbefc00fd90 con 0x7fbf0c071730 2023-07-14T15:57:46.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.083+0000 7fbf11fff700 1 -- 172.21.15.37:0/2214422759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf0c071730 msgr2=0x7fbf0c06f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:46.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.083+0000 7fbf11fff700 1 --2- 172.21.15.37:0/2214422759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf0c071730 0x7fbf0c06f740 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fbefc009840 tx=0x7fbefc009b50 comp rx=0 tx=0).stop 2023-07-14T15:57:46.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.083+0000 7fbf11fff700 1 -- 172.21.15.37:0/2214422759 shutdown_connections 2023-07-14T15:57:46.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.083+0000 7fbf11fff700 1 --2- 172.21.15.37:0/2214422759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf0c071730 0x7fbf0c06f740 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:46.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.083+0000 7fbf11fff700 1 -- 172.21.15.37:0/2214422759 >> 172.21.15.37:0/2214422759 conn(0x7fbf0c06aac0 msgr2=0x7fbf0c0b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:46.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.083+0000 7fbf11fff700 1 -- 172.21.15.37:0/2214422759 shutdown_connections 2023-07-14T15:57:46.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.083+0000 7fbf11fff700 1 -- 172.21.15.37:0/2214422759 wait complete. 2023-07-14T15:57:46.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.085+0000 7fbf11fff700 1 Processor -- start 2023-07-14T15:57:46.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.085+0000 7fbf11fff700 1 -- start start 2023-07-14T15:57:46.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.086+0000 7fbf11fff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbf0c06c0d0 0x7fbf0c0b2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:46.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.086+0000 7fbf11fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf0c071730 0x7fbf0c0c6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:46.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.086+0000 7fbf11fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf0c0ae000 0x7fbf0c1f1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:46.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.086+0000 7fbf11fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c0b3300 con 0x7fbf0c0ae000 2023-07-14T15:57:46.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.086+0000 7fbf11fff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c0c6a90 con 0x7fbf0c071730 2023-07-14T15:57:46.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.086+0000 7fbf11fff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c0c5cf0 con 0x7fbf0c06c0d0 2023-07-14T15:57:46.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.086+0000 7fbf0bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf0c0ae000 0x7fbf0c1f1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:46.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.086+0000 7fbf0bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf0c0ae000 0x7fbf0c1f1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48334/0 (socket says 172.21.15.37:48334) 2023-07-14T15:57:46.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.086+0000 7fbf0bfff700 1 -- 172.21.15.37:0/1576588426 learned_addr learned my addr 172.21.15.37:0/1576588426 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:46.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.086+0000 7fbf0affd700 1 --2- 172.21.15.37:0/1576588426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf0c071730 0x7fbf0c0c6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:46.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.086+0000 7fbf0b7fe700 1 --2- 172.21.15.37:0/1576588426 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbf0c06c0d0 0x7fbf0c0b2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:46.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.087+0000 7fbf0bfff700 1 -- 172.21.15.37:0/1576588426 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbf0c06c0d0 msgr2=0x7fbf0c0b2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:46.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.087+0000 7fbf0bfff700 1 --2- 172.21.15.37:0/1576588426 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbf0c06c0d0 0x7fbf0c0b2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:46.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.087+0000 7fbf0bfff700 1 -- 172.21.15.37:0/1576588426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf0c071730 msgr2=0x7fbf0c0c6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:46.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.087+0000 7fbf0bfff700 1 --2- 172.21.15.37:0/1576588426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf0c071730 0x7fbf0c0c6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:46.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.087+0000 7fbf0bfff700 1 -- 172.21.15.37:0/1576588426 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbefc0094a0 con 0x7fbf0c0ae000 2023-07-14T15:57:46.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.087+0000 7fbf0affd700 1 --2- 172.21.15.37:0/1576588426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf0c071730 0x7fbf0c0c6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:57:46.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.087+0000 7fbf0bfff700 1 --2- 172.21.15.37:0/1576588426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf0c0ae000 0x7fbf0c1f1290 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fbf0400cb80 tx=0x7fbf0400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:46.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.087+0000 7fbef3fff700 1 -- 172.21.15.37:0/1576588426 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf04003c00 con 0x7fbf0c0ae000 2023-07-14T15:57:46.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.087+0000 7fbef3fff700 1 -- 172.21.15.37:0/1576588426 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf04003d60 con 0x7fbf0c0ae000 2023-07-14T15:57:46.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.087+0000 7fbef3fff700 1 -- 172.21.15.37:0/1576588426 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0400ab50 con 0x7fbf0c0ae000 2023-07-14T15:57:46.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.087+0000 7fbf11fff700 1 -- 172.21.15.37:0/1576588426 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf0c0c5fd0 con 0x7fbf0c0ae000 2023-07-14T15:57:46.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.087+0000 7fbf11fff700 1 -- 172.21.15.37:0/1576588426 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf0c0c6590 con 0x7fbf0c0ae000 2023-07-14T15:57:46.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.088+0000 7fbf11fff700 1 -- 172.21.15.37:0/1576588426 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf0c0c6750 con 0x7fbf0c0ae000 2023-07-14T15:57:46.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.089+0000 7fbef3fff700 1 -- 172.21.15.37:0/1576588426 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7fbf0400acb0 con 0x7fbf0c0ae000 2023-07-14T15:57:46.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.090+0000 7fbef3fff700 1 --2- 172.21.15.37:0/1576588426 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbef806ad70 0x7fbef806d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:46.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.090+0000 7fbef3fff700 1 -- 172.21.15.37:0/1576588426 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbf04089600 con 0x7fbf0c0ae000 2023-07-14T15:57:46.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.091+0000 7fbf0b7fe700 1 --2- 172.21.15.37:0/1576588426 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbef806ad70 0x7fbef806d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:46.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.091+0000 7fbf0b7fe700 1 --2- 172.21.15.37:0/1576588426 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbef806ad70 0x7fbef806d220 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbefc0090b0 tx=0x7fbefc01b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:46.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.095+0000 7fbef3fff700 1 -- 172.21.15.37:0/1576588426 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fbf040545c0 con 0x7fbf0c0ae000 2023-07-14T15:57:46.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.304+0000 7fbf11fff700 1 -- 172.21.15.37:0/1576588426 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbf0c0cb300 con 0x7fbf0c0ae000 2023-07-14T15:57:46.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.305+0000 7fbef3fff700 1 -- 172.21.15.37:0/1576588426 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbf04057be0 con 0x7fbf0c0ae000 2023-07-14T15:57:46.290 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-14T15:57:46.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.307+0000 7fbf11fff700 1 -- 172.21.15.37:0/1576588426 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbef806ad70 msgr2=0x7fbef806d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:46.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.307+0000 7fbf11fff700 1 --2- 172.21.15.37:0/1576588426 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbef806ad70 0x7fbef806d220 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbefc0090b0 tx=0x7fbefc01b040 comp rx=0 tx=0).stop 2023-07-14T15:57:46.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.307+0000 7fbf11fff700 1 -- 172.21.15.37:0/1576588426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf0c0ae000 msgr2=0x7fbf0c1f1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:46.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.307+0000 7fbf11fff700 1 --2- 172.21.15.37:0/1576588426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf0c0ae000 0x7fbf0c1f1290 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fbf0400cb80 tx=0x7fbf0400cf40 comp rx=0 tx=0).stop 2023-07-14T15:57:46.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.308+0000 7fbf11fff700 1 -- 172.21.15.37:0/1576588426 shutdown_connections 2023-07-14T15:57:46.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.308+0000 7fbf11fff700 1 --2- 172.21.15.37:0/1576588426 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbef806ad70 0x7fbef806d220 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:46.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.308+0000 7fbf11fff700 1 --2- 172.21.15.37:0/1576588426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf0c0ae000 0x7fbf0c1f1290 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:46.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.308+0000 7fbf11fff700 1 --2- 172.21.15.37:0/1576588426 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbf0c06c0d0 0x7fbf0c0b2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:46.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.308+0000 7fbf11fff700 1 --2- 172.21.15.37:0/1576588426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf0c071730 0x7fbf0c0c6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:46.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.308+0000 7fbf11fff700 1 -- 172.21.15.37:0/1576588426 >> 172.21.15.37:0/1576588426 conn(0x7fbf0c06aac0 msgr2=0x7fbf0c0cea10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:46.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.308+0000 7fbf11fff700 1 -- 172.21.15.37:0/1576588426 shutdown_connections 2023-07-14T15:57:46.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.308+0000 7fbf11fff700 1 -- 172.21.15.37:0/1576588426 wait complete. 2023-07-14T15:57:46.311 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T15:57:46.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.529+0000 7f0eca7ff700 1 Processor -- start 2023-07-14T15:57:46.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.530+0000 7f0eca7ff700 1 -- start start 2023-07-14T15:57:46.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.531+0000 7f0eca7ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0ec406dd60 0x7f0ec406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:46.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.531+0000 7f0eca7ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ec415dae0 con 0x7f0ec406b220 2023-07-14T15:57:46.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.531+0000 7f0eca7ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ec415d520 con 0x7f0ec40ce150 2023-07-14T15:57:46.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.531+0000 7f0eca7ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ec415d330 con 0x7f0ec406dd60 2023-07-14T15:57:46.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.531+0000 7f0ec37fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0ec406b220 0x7f0ec415cc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48100/0 (socket says 172.21.15.37:48100) 2023-07-14T15:57:46.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.531+0000 7f0ec37fe700 1 -- 172.21.15.37:0/125814225 learned_addr learned my addr 172.21.15.37:0/125814225 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:46.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.531+0000 7f0ec3fff700 1 --2- 172.21.15.37:0/125814225 >> v2:172.21.15.37:3300/0 conn(0x7f0ec406dd60 0x7f0ec406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:46.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.532+0000 7f0ec2ffd700 1 -- 172.21.15.37:0/125814225 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3071105787 0 0) 0x7f0ec415dae0 con 0x7f0ec406b220 2023-07-14T15:57:46.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.532+0000 7f0ec2ffd700 1 -- 172.21.15.37:0/125814225 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0eac0035b0 con 0x7f0ec406b220 2023-07-14T15:57:46.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.532+0000 7f0ec3fff700 1 -- 172.21.15.37:0/125814225 >> v1:172.21.15.98:6789/0 conn(0x7f0ec40ce150 legacy=0x7f0ec40ce550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:46.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.532+0000 7f0ec3fff700 1 -- 172.21.15.37:0/125814225 >> v1:172.21.15.37:6789/0 conn(0x7f0ec406b220 legacy=0x7f0ec415cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:46.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.532+0000 7f0ec3fff700 1 -- 172.21.15.37:0/125814225 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec415d800 con 0x7f0ec406dd60 2023-07-14T15:57:46.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.532+0000 7f0ec3fff700 1 --2- 172.21.15.37:0/125814225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ec406dd60 0x7f0ec406a7a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4009840 tx=0x7f0eb4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c3e1895908952fd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:46.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.532+0000 7f0ec2ffd700 1 -- 172.21.15.37:0/125814225 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb4011830 con 0x7f0ec406dd60 2023-07-14T15:57:46.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.532+0000 7f0ec2ffd700 1 -- 172.21.15.37:0/125814225 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb4011990 con 0x7f0ec406dd60 2023-07-14T15:57:46.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.532+0000 7f0ec2ffd700 1 -- 172.21.15.37:0/125814225 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb4011d20 con 0x7f0ec406dd60 2023-07-14T15:57:46.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.533+0000 7f0eca7ff700 1 -- 172.21.15.37:0/125814225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ec406dd60 msgr2=0x7f0ec406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:46.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.533+0000 7f0eca7ff700 1 --2- 172.21.15.37:0/125814225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ec406dd60 0x7f0ec406a7a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4009840 tx=0x7f0eb4009b50 comp rx=0 tx=0).stop 2023-07-14T15:57:46.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.533+0000 7f0eca7ff700 1 -- 172.21.15.37:0/125814225 shutdown_connections 2023-07-14T15:57:46.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.533+0000 7f0eca7ff700 1 --2- 172.21.15.37:0/125814225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ec406dd60 0x7f0ec406a7a0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:46.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.533+0000 7f0eca7ff700 1 -- 172.21.15.37:0/125814225 >> 172.21.15.37:0/125814225 conn(0x7f0ec40cbd50 msgr2=0x7f0ec40cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:46.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.533+0000 7f0eca7ff700 1 -- 172.21.15.37:0/125814225 shutdown_connections 2023-07-14T15:57:46.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.533+0000 7f0eca7ff700 1 -- 172.21.15.37:0/125814225 wait complete. 2023-07-14T15:57:46.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.535+0000 7f0eca7ff700 1 Processor -- start 2023-07-14T15:57:46.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.535+0000 7f0eca7ff700 1 -- start start 2023-07-14T15:57:46.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.536+0000 7f0eca7ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ec406b220 0x7f0ec413bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:46.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.536+0000 7f0eca7ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ec406dd60 0x7f0ec40b2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:46.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.536+0000 7f0eca7ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0ec40ce150 0x7f0ec40c56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:46.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.536+0000 7f0eca7ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec40b3de0 con 0x7f0ec406dd60 2023-07-14T15:57:46.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.536+0000 7f0eca7ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec40b4920 con 0x7f0ec406b220 2023-07-14T15:57:46.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.536+0000 7f0eca7ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec40b2640 con 0x7f0ec40ce150 2023-07-14T15:57:46.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.536+0000 7f0ec37fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ec406dd60 0x7f0ec40b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:46.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.536+0000 7f0ec37fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ec406dd60 0x7f0ec40b2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48350/0 (socket says 172.21.15.37:48350) 2023-07-14T15:57:46.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.536+0000 7f0ec37fe700 1 -- 172.21.15.37:0/3091021173 learned_addr learned my addr 172.21.15.37:0/3091021173 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:46.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.537+0000 7f0ec3fff700 1 --2- 172.21.15.37:0/3091021173 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ec406b220 0x7f0ec413bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:46.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.537+0000 7f0ec8d9c700 1 --2- 172.21.15.37:0/3091021173 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0ec40ce150 0x7f0ec40c56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:46.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.537+0000 7f0ec37fe700 1 -- 172.21.15.37:0/3091021173 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0ec40ce150 msgr2=0x7f0ec40c56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:46.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.537+0000 7f0ec37fe700 1 --2- 172.21.15.37:0/3091021173 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0ec40ce150 0x7f0ec40c56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:46.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.537+0000 7f0ec37fe700 1 -- 172.21.15.37:0/3091021173 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ec406b220 msgr2=0x7f0ec413bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:46.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.537+0000 7f0ec37fe700 1 --2- 172.21.15.37:0/3091021173 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ec406b220 0x7f0ec413bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:46.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.537+0000 7f0ec37fe700 1 -- 172.21.15.37:0/3091021173 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb40094a0 con 0x7f0ec406dd60 2023-07-14T15:57:46.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.537+0000 7f0ec8d9c700 1 --2- 172.21.15.37:0/3091021173 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0ec40ce150 0x7f0ec40c56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:57:46.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.537+0000 7f0ec3fff700 1 --2- 172.21.15.37:0/3091021173 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ec406b220 0x7f0ec413bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:57:46.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.537+0000 7f0ec37fe700 1 --2- 172.21.15.37:0/3091021173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ec406dd60 0x7f0ec40b2100 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8005910 tx=0x7f0eb800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:46.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.537+0000 7f0ec0ff9700 1 -- 172.21.15.37:0/3091021173 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb8005d70 con 0x7f0ec406dd60 2023-07-14T15:57:46.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.537+0000 7f0ec0ff9700 1 -- 172.21.15.37:0/3091021173 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb80070d0 con 0x7f0ec406dd60 2023-07-14T15:57:46.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.537+0000 7f0eca7ff700 1 -- 172.21.15.37:0/3091021173 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ec40b3ff0 con 0x7f0ec406dd60 2023-07-14T15:57:46.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.537+0000 7f0ec0ff9700 1 -- 172.21.15.37:0/3091021173 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb8007440 con 0x7f0ec406dd60 2023-07-14T15:57:46.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.537+0000 7f0eca7ff700 1 -- 172.21.15.37:0/3091021173 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ec40b45b0 con 0x7f0ec406dd60 2023-07-14T15:57:46.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.538+0000 7f0eca7ff700 1 -- 172.21.15.37:0/3091021173 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ec40b4770 con 0x7f0ec406dd60 2023-07-14T15:57:46.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.539+0000 7f0ec0ff9700 1 -- 172.21.15.37:0/3091021173 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f0eb80075a0 con 0x7f0ec406dd60 2023-07-14T15:57:46.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.540+0000 7f0ec0ff9700 1 --2- 172.21.15.37:0/3091021173 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0eb006ad70 0x7f0eb006d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:46.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.540+0000 7f0ec0ff9700 1 -- 172.21.15.37:0/3091021173 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0eb80889a0 con 0x7f0ec406dd60 2023-07-14T15:57:46.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.541+0000 7f0ec3fff700 1 --2- 172.21.15.37:0/3091021173 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0eb006ad70 0x7f0eb006d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:46.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.541+0000 7f0ec3fff700 1 --2- 172.21.15.37:0/3091021173 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0eb006ad70 0x7f0eb006d220 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4000c00 tx=0x7f0eb4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:46.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.544+0000 7f0ec0ff9700 1 -- 172.21.15.37:0/3091021173 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0eb8053980 con 0x7f0ec406dd60 2023-07-14T15:57:46.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.753+0000 7f0eca7ff700 1 -- 172.21.15.37:0/3091021173 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0ec40c27c0 con 0x7f0ec406dd60 2023-07-14T15:57:46.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.754+0000 7f0ec0ff9700 1 -- 172.21.15.37:0/3091021173 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0eb80170a0 con 0x7f0ec406dd60 2023-07-14T15:57:46.739 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-14T15:57:46.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.756+0000 7f0eca7ff700 1 -- 172.21.15.37:0/3091021173 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0eb006ad70 msgr2=0x7f0eb006d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:46.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.756+0000 7f0eca7ff700 1 --2- 172.21.15.37:0/3091021173 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0eb006ad70 0x7f0eb006d220 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4000c00 tx=0x7f0eb4008030 comp rx=0 tx=0).stop 2023-07-14T15:57:46.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.756+0000 7f0eca7ff700 1 -- 172.21.15.37:0/3091021173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ec406dd60 msgr2=0x7f0ec40b2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:46.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.756+0000 7f0eca7ff700 1 --2- 172.21.15.37:0/3091021173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ec406dd60 0x7f0ec40b2100 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8005910 tx=0x7f0eb800c860 comp rx=0 tx=0).stop 2023-07-14T15:57:46.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.756+0000 7f0eca7ff700 1 -- 172.21.15.37:0/3091021173 shutdown_connections 2023-07-14T15:57:46.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.756+0000 7f0eca7ff700 1 --2- 172.21.15.37:0/3091021173 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ec406b220 0x7f0ec413bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:46.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.756+0000 7f0eca7ff700 1 --2- 172.21.15.37:0/3091021173 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0eb006ad70 0x7f0eb006d220 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:46.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.756+0000 7f0eca7ff700 1 --2- 172.21.15.37:0/3091021173 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0ec40ce150 0x7f0ec40c56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:46.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.756+0000 7f0eca7ff700 1 --2- 172.21.15.37:0/3091021173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ec406dd60 0x7f0ec40b2100 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:46.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.756+0000 7f0eca7ff700 1 -- 172.21.15.37:0/3091021173 >> 172.21.15.37:0/3091021173 conn(0x7f0ec40cbd50 msgr2=0x7f0ec4156760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:46.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.756+0000 7f0eca7ff700 1 -- 172.21.15.37:0/3091021173 shutdown_connections 2023-07-14T15:57:46.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.756+0000 7f0eca7ff700 1 -- 172.21.15.37:0/3091021173 wait complete. 2023-07-14T15:57:46.759 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-14T15:57:46.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.977+0000 7f41b43ff700 1 Processor -- start 2023-07-14T15:57:46.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.977+0000 7f41b43ff700 1 -- start start 2023-07-14T15:57:46.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.978+0000 7f41b43ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f41ac15ec90 0x7f41ac0cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:46.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.978+0000 7f41b43ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f41ac06d8b0 0x7f41ac0cba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:46.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.978+0000 7f41b43ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f41ac15dfe0 0x7f41ac06b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:46.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.978+0000 7f41b43ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41ac0718a0 con 0x7f41ac15dfe0 2023-07-14T15:57:46.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.978+0000 7f41b43ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41ac15a8d0 con 0x7f41ac06d8b0 2023-07-14T15:57:46.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.978+0000 7f41b43ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41ac070c90 con 0x7f41ac15ec90 2023-07-14T15:57:46.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.979+0000 7f41b299c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f41ac15dfe0 0x7f41ac06b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:46.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.979+0000 7f41b299c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f41ac15dfe0 0x7f41ac06b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48354/0 (socket says 172.21.15.37:48354) 2023-07-14T15:57:46.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.979+0000 7f41b299c700 1 -- 172.21.15.37:0/1139281745 learned_addr learned my addr 172.21.15.37:0/1139281745 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:46.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.979+0000 7f41b219b700 1 --2- 172.21.15.37:0/1139281745 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f41ac15ec90 0x7f41ac0cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:46.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.979+0000 7f41b199a700 1 --2- 172.21.15.37:0/1139281745 >> v2:172.21.15.98:3300/0 conn(0x7f41ac06d8b0 0x7f41ac0cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:46.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.979+0000 7f41b299c700 1 -- 172.21.15.37:0/1139281745 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f41ac15ec90 msgr2=0x7f41ac0cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:46.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.979+0000 7f41b299c700 1 --2- 172.21.15.37:0/1139281745 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f41ac15ec90 0x7f41ac0cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:46.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.979+0000 7f41b299c700 1 -- 172.21.15.37:0/1139281745 >> v2:172.21.15.98:3300/0 conn(0x7f41ac06d8b0 msgr2=0x7f41ac0cba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:46.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.979+0000 7f41b299c700 1 --2- 172.21.15.37:0/1139281745 >> v2:172.21.15.98:3300/0 conn(0x7f41ac06d8b0 0x7f41ac0cba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:46.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.979+0000 7f41b299c700 1 -- 172.21.15.37:0/1139281745 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41ac070f70 con 0x7f41ac15dfe0 2023-07-14T15:57:46.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.979+0000 7f41b199a700 1 --2- 172.21.15.37:0/1139281745 >> v2:172.21.15.98:3300/0 conn(0x7f41ac06d8b0 0x7f41ac0cba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:57:46.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.979+0000 7f41b299c700 1 --2- 172.21.15.37:0/1139281745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41ac15dfe0 0x7f41ac06b120 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f41ac072270 tx=0x7f41a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4988134c63370ba3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:46.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.980+0000 7f41b1199700 1 -- 172.21.15.37:0/1139281745 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a400e070 con 0x7f41ac15dfe0 2023-07-14T15:57:46.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.980+0000 7f41b1199700 1 -- 172.21.15.37:0/1139281745 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a400b9c0 con 0x7f41ac15dfe0 2023-07-14T15:57:46.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.980+0000 7f41b1199700 1 -- 172.21.15.37:0/1139281745 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a400bd70 con 0x7f41ac15dfe0 2023-07-14T15:57:46.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.980+0000 7f41b43ff700 1 -- 172.21.15.37:0/1139281745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41ac15dfe0 msgr2=0x7f41ac06b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:46.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.980+0000 7f41b43ff700 1 --2- 172.21.15.37:0/1139281745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41ac15dfe0 0x7f41ac06b120 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f41ac072270 tx=0x7f41a400b330 comp rx=0 tx=0).stop 2023-07-14T15:57:46.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.980+0000 7f41b43ff700 1 -- 172.21.15.37:0/1139281745 shutdown_connections 2023-07-14T15:57:46.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.980+0000 7f41b43ff700 1 --2- 172.21.15.37:0/1139281745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41ac15dfe0 0x7f41ac06b120 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:46.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.980+0000 7f41b43ff700 1 --2- 172.21.15.37:0/1139281745 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f41ac15ec90 0x7f41ac0cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:46.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.980+0000 7f41b43ff700 1 --2- 172.21.15.37:0/1139281745 >> v2:172.21.15.98:3300/0 conn(0x7f41ac06d8b0 0x7f41ac0cba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:46.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.980+0000 7f41b43ff700 1 -- 172.21.15.37:0/1139281745 >> 172.21.15.37:0/1139281745 conn(0x7f41ac0b0620 msgr2=0x7f41ac0b0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:46.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.980+0000 7f41b43ff700 1 -- 172.21.15.37:0/1139281745 shutdown_connections 2023-07-14T15:57:46.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.981+0000 7f41b43ff700 1 -- 172.21.15.37:0/1139281745 wait complete. 2023-07-14T15:57:46.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.982+0000 7f41b43ff700 1 Processor -- start 2023-07-14T15:57:46.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.982+0000 7f41b43ff700 1 -- start start 2023-07-14T15:57:46.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.983+0000 7f41b43ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41ac15dfe0 0x7f41ac0c71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:46.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.983+0000 7f41b43ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41ac15ec90 0x7f41ac0b1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:46.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.983+0000 7f41b43ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f41ac0c81a0 0x7f41ac15cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:46.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.983+0000 7f41b43ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41ac15aa10 con 0x7f41ac15dfe0 2023-07-14T15:57:46.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.983+0000 7f41b43ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41ac0c8610 con 0x7f41ac15ec90 2023-07-14T15:57:46.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.983+0000 7f41b43ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41ac15ac60 con 0x7f41ac0c81a0 2023-07-14T15:57:46.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.984+0000 7f41b219b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41ac15dfe0 0x7f41ac0c71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:46.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.984+0000 7f41b219b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41ac15dfe0 0x7f41ac0c71d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48366/0 (socket says 172.21.15.37:48366) 2023-07-14T15:57:46.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.984+0000 7f41b219b700 1 -- 172.21.15.37:0/3725516315 learned_addr learned my addr 172.21.15.37:0/3725516315 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:46.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.984+0000 7f41b199a700 1 --2- 172.21.15.37:0/3725516315 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41ac15ec90 0x7f41ac0b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:46.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.984+0000 7f41b299c700 1 --2- 172.21.15.37:0/3725516315 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f41ac0c81a0 0x7f41ac15cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:46.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.984+0000 7f41b219b700 1 -- 172.21.15.37:0/3725516315 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f41ac0c81a0 msgr2=0x7f41ac15cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:46.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.984+0000 7f41b219b700 1 --2- 172.21.15.37:0/3725516315 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f41ac0c81a0 0x7f41ac15cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:46.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.984+0000 7f41b219b700 1 -- 172.21.15.37:0/3725516315 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41ac15ec90 msgr2=0x7f41ac0b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:46.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.984+0000 7f41b219b700 1 --2- 172.21.15.37:0/3725516315 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41ac15ec90 0x7f41ac0b1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:46.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.984+0000 7f41b219b700 1 -- 172.21.15.37:0/3725516315 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a4009b30 con 0x7f41ac15dfe0 2023-07-14T15:57:46.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.984+0000 7f41b219b700 1 --2- 172.21.15.37:0/3725516315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41ac15dfe0 0x7f41ac0c71d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f41a800d800 tx=0x7f41a800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:46.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.984+0000 7f41a2ffd700 1 -- 172.21.15.37:0/3725516315 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a80125f0 con 0x7f41ac15dfe0 2023-07-14T15:57:46.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.985+0000 7f41a2ffd700 1 -- 172.21.15.37:0/3725516315 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a8012750 con 0x7f41ac15dfe0 2023-07-14T15:57:46.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.985+0000 7f41a2ffd700 1 -- 172.21.15.37:0/3725516315 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a8012b00 con 0x7f41ac15dfe0 2023-07-14T15:57:46.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.985+0000 7f41b43ff700 1 -- 172.21.15.37:0/3725516315 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41ac15af40 con 0x7f41ac15dfe0 2023-07-14T15:57:46.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.985+0000 7f41b43ff700 1 -- 172.21.15.37:0/3725516315 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41ac0b1e60 con 0x7f41ac15dfe0 2023-07-14T15:57:46.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.986+0000 7f41b43ff700 1 -- 172.21.15.37:0/3725516315 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41ac04e210 con 0x7f41ac15dfe0 2023-07-14T15:57:46.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.987+0000 7f41a2ffd700 1 -- 172.21.15.37:0/3725516315 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f41a8012c60 con 0x7f41ac15dfe0 2023-07-14T15:57:46.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.988+0000 7f41a2ffd700 1 --2- 172.21.15.37:0/3725516315 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f419006ad70 0x7f419006d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:46.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.988+0000 7f41a2ffd700 1 -- 172.21.15.37:0/3725516315 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f41a8089420 con 0x7f41ac15dfe0 2023-07-14T15:57:46.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.988+0000 7f41b199a700 1 --2- 172.21.15.37:0/3725516315 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f419006ad70 0x7f419006d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:46.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.989+0000 7f41b199a700 1 --2- 172.21.15.37:0/3725516315 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f419006ad70 0x7f419006d220 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f41ac0b47e0 tx=0x7f419c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:46.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:46.992+0000 7f41a2ffd700 1 -- 172.21.15.37:0/3725516315 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f41a8054570 con 0x7f41ac15dfe0 2023-07-14T15:57:47.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.216+0000 7f41b43ff700 1 -- 172.21.15.37:0/3725516315 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f41ac0b4a50 con 0x7f41ac15dfe0 2023-07-14T15:57:47.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.217+0000 7f41a2ffd700 1 -- 172.21.15.37:0/3725516315 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v36) v1 ==== 80+0+0 (secure 0 0 0) 0x7f41a8057b90 con 0x7f41ac15dfe0 2023-07-14T15:57:47.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.219+0000 7f41b43ff700 1 -- 172.21.15.37:0/3725516315 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f419006ad70 msgr2=0x7f419006d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:47.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.219+0000 7f41b43ff700 1 --2- 172.21.15.37:0/3725516315 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f419006ad70 0x7f419006d220 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f41ac0b47e0 tx=0x7f419c008040 comp rx=0 tx=0).stop 2023-07-14T15:57:47.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.219+0000 7f41b43ff700 1 -- 172.21.15.37:0/3725516315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41ac15dfe0 msgr2=0x7f41ac0c71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:47.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.219+0000 7f41b43ff700 1 --2- 172.21.15.37:0/3725516315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41ac15dfe0 0x7f41ac0c71d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f41a800d800 tx=0x7f41a800db10 comp rx=0 tx=0).stop 2023-07-14T15:57:47.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.219+0000 7f41b43ff700 1 -- 172.21.15.37:0/3725516315 shutdown_connections 2023-07-14T15:57:47.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.219+0000 7f41b43ff700 1 --2- 172.21.15.37:0/3725516315 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f419006ad70 0x7f419006d220 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:47.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.219+0000 7f41b43ff700 1 --2- 172.21.15.37:0/3725516315 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f41ac0c81a0 0x7f41ac15cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:47.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.219+0000 7f41b43ff700 1 --2- 172.21.15.37:0/3725516315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41ac15dfe0 0x7f41ac0c71d0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:47.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.219+0000 7f41b43ff700 1 --2- 172.21.15.37:0/3725516315 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41ac15ec90 0x7f41ac0b1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:47.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.219+0000 7f41b43ff700 1 -- 172.21.15.37:0/3725516315 >> 172.21.15.37:0/3725516315 conn(0x7f41ac0b0620 msgr2=0x7f41ac158590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:47.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.219+0000 7f41b43ff700 1 -- 172.21.15.37:0/3725516315 shutdown_connections 2023-07-14T15:57:47.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.219+0000 7f41b43ff700 1 -- 172.21.15.37:0/3725516315 wait complete. 2023-07-14T15:57:47.207 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2023-07-14T15:57:47.222 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-14T15:57:47.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:57:47.223 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-14T15:57:47.318 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-07-14T15:57:47.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:57:47.318 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-14T15:57:47.362 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-14T15:57:47.363 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T15:57:47.412 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-14T15:57:47.413 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T15:57:47.499 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T15:57:47.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.715+0000 7f2975bff700 1 Processor -- start 2023-07-14T15:57:47.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.715+0000 7f2975bff700 1 -- start start 2023-07-14T15:57:47.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.716+0000 7f2975bff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f29700b85f0 0x7f297015d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:47.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.716+0000 7f2975bff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29700cf6b0 con 0x7f29700b4910 2023-07-14T15:57:47.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.717+0000 7f2975bff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29700cdc40 con 0x7f29700b54b0 2023-07-14T15:57:47.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.717+0000 7f2975bff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f297015dba0 con 0x7f29700b85f0 2023-07-14T15:57:47.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.717+0000 7f296ffff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f29700b4910 0x7f29700b4d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48110/0 (socket says 172.21.15.37:48110) 2023-07-14T15:57:47.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.717+0000 7f296ffff700 1 -- 172.21.15.37:0/1370203061 learned_addr learned my addr 172.21.15.37:0/1370203061 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:47.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.717+0000 7f296f7fe700 1 --2- 172.21.15.37:0/1370203061 >> v2:172.21.15.98:3300/0 conn(0x7f29700b85f0 0x7f297015d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:47.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.717+0000 7f296effd700 1 -- 172.21.15.37:0/1370203061 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3857499811 0 0) 0x7f29700cf6b0 con 0x7f29700b4910 2023-07-14T15:57:47.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.717+0000 7f296effd700 1 -- 172.21.15.37:0/1370203061 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f295c0035b0 con 0x7f29700b4910 2023-07-14T15:57:47.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.717+0000 7f296effd700 1 -- 172.21.15.37:0/1370203061 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3659951357 0 0) 0x7f29700cdc40 con 0x7f29700b54b0 2023-07-14T15:57:47.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.717+0000 7f296effd700 1 -- 172.21.15.37:0/1370203061 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29700cf6b0 con 0x7f29700b54b0 2023-07-14T15:57:47.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.717+0000 7f296f7fe700 1 -- 172.21.15.37:0/1370203061 >> v1:172.21.15.98:6789/0 conn(0x7f29700b54b0 legacy=0x7f29700cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:47.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.717+0000 7f296f7fe700 1 -- 172.21.15.37:0/1370203061 >> v1:172.21.15.37:6789/0 conn(0x7f29700b4910 legacy=0x7f29700b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:47.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.717+0000 7f296f7fe700 1 -- 172.21.15.37:0/1370203061 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29700d0250 con 0x7f29700b85f0 2023-07-14T15:57:47.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.718+0000 7f296f7fe700 1 --2- 172.21.15.37:0/1370203061 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f29700b85f0 0x7f297015d660 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2960009840 tx=0x7f2960009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f2734fa917329c2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:47.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.718+0000 7f296effd700 1 -- 172.21.15.37:0/1370203061 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2960011830 con 0x7f29700b85f0 2023-07-14T15:57:47.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.718+0000 7f296effd700 1 -- 172.21.15.37:0/1370203061 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2960011990 con 0x7f29700b85f0 2023-07-14T15:57:47.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.718+0000 7f296effd700 1 -- 172.21.15.37:0/1370203061 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2960011d20 con 0x7f29700b85f0 2023-07-14T15:57:47.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.719+0000 7f2975bff700 1 -- 172.21.15.37:0/1370203061 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f29700b85f0 msgr2=0x7f297015d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:47.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.719+0000 7f2975bff700 1 --2- 172.21.15.37:0/1370203061 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f29700b85f0 0x7f297015d660 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2960009840 tx=0x7f2960009b50 comp rx=0 tx=0).stop 2023-07-14T15:57:47.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.719+0000 7f2975bff700 1 -- 172.21.15.37:0/1370203061 shutdown_connections 2023-07-14T15:57:47.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.719+0000 7f2975bff700 1 --2- 172.21.15.37:0/1370203061 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f29700b85f0 0x7f297015d660 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:47.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.719+0000 7f2975bff700 1 -- 172.21.15.37:0/1370203061 >> 172.21.15.37:0/1370203061 conn(0x7f297006a580 msgr2=0x7f297006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:47.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.719+0000 7f2975bff700 1 -- 172.21.15.37:0/1370203061 shutdown_connections 2023-07-14T15:57:47.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.719+0000 7f2975bff700 1 -- 172.21.15.37:0/1370203061 wait complete. 2023-07-14T15:57:47.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.721+0000 7f2975bff700 1 Processor -- start 2023-07-14T15:57:47.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.721+0000 7f2975bff700 1 -- start start 2023-07-14T15:57:47.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.722+0000 7f2975bff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29700b4910 0x7f29700ca970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:47.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.722+0000 7f2975bff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f29700b54b0 0x7f2970160880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:47.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.722+0000 7f2975bff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f29700b85f0 0x7f29700cbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:47.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.722+0000 7f2975bff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29701574c0 con 0x7f29700b4910 2023-07-14T15:57:47.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.722+0000 7f2975bff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2970156ef0 con 0x7f29700b85f0 2023-07-14T15:57:47.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.722+0000 7f2975bff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29701562e0 con 0x7f29700b54b0 2023-07-14T15:57:47.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.722+0000 7f296f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29700b4910 0x7f29700ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:47.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.722+0000 7f296f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29700b4910 0x7f29700ca970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48372/0 (socket says 172.21.15.37:48372) 2023-07-14T15:57:47.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.722+0000 7f296f7fe700 1 -- 172.21.15.37:0/1720244487 learned_addr learned my addr 172.21.15.37:0/1720244487 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:47.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.722+0000 7f296f7fe700 1 -- 172.21.15.37:0/1720244487 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f29700b54b0 msgr2=0x7f2970160880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:47.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.722+0000 7f296f7fe700 1 --2- 172.21.15.37:0/1720244487 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f29700b54b0 0x7f2970160880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:47.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.722+0000 7f296f7fe700 1 -- 172.21.15.37:0/1720244487 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f29700b85f0 msgr2=0x7f29700cbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:47.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.722+0000 7f296f7fe700 1 --2- 172.21.15.37:0/1720244487 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f29700b85f0 0x7f29700cbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:47.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.722+0000 7f296f7fe700 1 -- 172.21.15.37:0/1720244487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29600094a0 con 0x7f29700b4910 2023-07-14T15:57:47.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.723+0000 7f296f7fe700 1 --2- 172.21.15.37:0/1720244487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29700b4910 0x7f29700ca970 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2960014040 tx=0x7f2960004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:47.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.723+0000 7f296cff9700 1 -- 172.21.15.37:0/1720244487 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296001a860 con 0x7f29700b4910 2023-07-14T15:57:47.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.723+0000 7f296cff9700 1 -- 172.21.15.37:0/1720244487 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f296001a9c0 con 0x7f29700b4910 2023-07-14T15:57:47.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.723+0000 7f296cff9700 1 -- 172.21.15.37:0/1720244487 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296001ad30 con 0x7f29700b4910 2023-07-14T15:57:47.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.723+0000 7f2975bff700 1 -- 172.21.15.37:0/1720244487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29701565c0 con 0x7f29700b4910 2023-07-14T15:57:47.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.723+0000 7f2975bff700 1 -- 172.21.15.37:0/1720244487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2970156b80 con 0x7f29700b4910 2023-07-14T15:57:47.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.724+0000 7f2975bff700 1 -- 172.21.15.37:0/1720244487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2970156d40 con 0x7f29700b4910 2023-07-14T15:57:47.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.725+0000 7f296cff9700 1 -- 172.21.15.37:0/1720244487 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f2960022070 con 0x7f29700b4910 2023-07-14T15:57:47.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.726+0000 7f296cff9700 1 --2- 172.21.15.37:0/1720244487 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f295006ad70 0x7f295006d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:47.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.726+0000 7f296cff9700 1 -- 172.21.15.37:0/1720244487 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f296008a1f0 con 0x7f29700b4910 2023-07-14T15:57:47.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.726+0000 7f2967fff700 1 --2- 172.21.15.37:0/1720244487 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f295006ad70 0x7f295006d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:47.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.727+0000 7f2967fff700 1 --2- 172.21.15.37:0/1720244487 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f295006ad70 0x7f295006d220 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2958007fd0 tx=0x7f29580079a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:47.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.730+0000 7f296cff9700 1 -- 172.21.15.37:0/1720244487 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f29600552f0 con 0x7f29700b4910 2023-07-14T15:57:47.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.940+0000 7f2975bff700 1 -- 172.21.15.37:0/1720244487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2970067840 con 0x7f29700b4910 2023-07-14T15:57:47.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.941+0000 7f296cff9700 1 -- 172.21.15.37:0/1720244487 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18376 (secure 0 0 0) 0x7f2960015090 con 0x7f29700b4910 2023-07-14T15:57:47.927 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:57:47.928 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":37,"fsid":"9da30401-a779-4e46-aba6-00c2494c6c67","created":"2023-07-14T15:55:39.898867+0000","modified":"2023-07-14T15:57:47.744214+0000","last_up_change":"2023-07-14T15:55:53.025696+0000","last_in_change":"2023-07-14T15:55:43.388192+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T15:55:52.907261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T15:55:59.992839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-14T15:57:23.872384+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-14T15:57:24.423055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d049535-7b87-4276-8fe5-0f74ba422d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6801","nonce":2783032392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6803","nonce":2783032392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6807","nonce":2783032392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6805","nonce":2783032392}]},"public_addr":"172.21.15.37:6801/2783032392","cluster_addr":"172.21.15.37:6803/2783032392","heartbeat_back_addr":"172.21.15.37:6807/2783032392","heartbeat_front_addr":"172.21.15.37:6805/2783032392","state":["exists","up"]},{"osd":1,"uuid":"79ec948d-ead2-4c2d-923a-dd6eeaac9dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6823","nonce":1190059746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6826","nonce":1190059746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6831","nonce":1190059746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6829","nonce":1190059746}]},"public_addr":"172.21.15.37:6823/1190059746","cluster_addr":"172.21.15.37:6826/1190059746","heartbeat_back_addr":"172.21.15.37:6831/1190059746","heartbeat_front_addr":"172.21.15.37:6829/1190059746","state":["exists","up"]},{"osd":2,"uuid":"a1db6690-c160-4366-9c82-2cca17e4bba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6809","nonce":2266223499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6813","nonce":2266223499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6820","nonce":2266223499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6816","nonce":2266223499}]},"public_addr":"172.21.15.37:6809/2266223499","cluster_addr":"172.21.15.37:6813/2266223499","heartbeat_back_addr":"172.21.15.37:6820/2266223499","heartbeat_front_addr":"172.21.15.37:6816/2266223499","state":["exists","up"]},{"osd":3,"uuid":"767b8220-e79a-4a86-a162-6b3b73198379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6812","nonce":4166694594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6817","nonce":4166694594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6828","nonce":4166694594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6822","nonce":4166694594}]},"public_addr":"172.21.15.37:6812/4166694594","cluster_addr":"172.21.15.37:6817/4166694594","heartbeat_back_addr":"172.21.15.37:6828/4166694594","heartbeat_front_addr":"172.21.15.37:6822/4166694594","state":["exists","up"]},{"osd":4,"uuid":"717bd773-ae7e-4236-ac79-900cf99a37c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6801","nonce":3529020407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6803","nonce":3529020407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6807","nonce":3529020407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6805","nonce":3529020407}]},"public_addr":"172.21.15.98:6801/3529020407","cluster_addr":"172.21.15.98:6803/3529020407","heartbeat_back_addr":"172.21.15.98:6807/3529020407","heartbeat_front_addr":"172.21.15.98:6805/3529020407","state":["exists","up"]},{"osd":5,"uuid":"a941d358-0f03-4136-a9b2-3a1c2e9358cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6817","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6819","nonce":2311501838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6821","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6823","nonce":2311501838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6829","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6831","nonce":2311501838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6825","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6827","nonce":2311501838}]},"public_addr":"172.21.15.98:6819/2311501838","cluster_addr":"172.21.15.98:6823/2311501838","heartbeat_back_addr":"172.21.15.98:6831/2311501838","heartbeat_front_addr":"172.21.15.98:6827/2311501838","state":["exists","up"]},{"osd":6,"uuid":"27153772-6d4b-479d-9953-0582e7b96743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6809","nonce":1144224691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6811","nonce":1144224691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6815","nonce":1144224691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6813","nonce":1144224691}]},"public_addr":"172.21.15.98:6809/1144224691","cluster_addr":"172.21.15.98:6811/1144224691","heartbeat_back_addr":"172.21.15.98:6815/1144224691","heartbeat_front_addr":"172.21.15.98:6813/1144224691","state":["exists","up"]},{"osd":7,"uuid":"d21ffc8e-40bb-47eb-af2c-e3e730d3fb76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6818","nonce":1144470927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6822","nonce":1144470927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6830","nonce":1144470927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6826","nonce":1144470927}]},"public_addr":"172.21.15.98:6818/1144470927","cluster_addr":"172.21.15.98:6822/1144470927","heartbeat_back_addr":"172.21.15.98:6830/1144470927","heartbeat_front_addr":"172.21.15.98:6826/1144470927","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.921114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.739210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.024016+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.002527+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.698127+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.813416+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.709351+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.815457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.f","mappings":[{"from":4,"to":2}]},{"pgid":"6.3f","mappings":[{"from":4,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T15:57:47.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.943+0000 7f2975bff700 1 -- 172.21.15.37:0/1720244487 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f295006ad70 msgr2=0x7f295006d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:47.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.943+0000 7f2975bff700 1 --2- 172.21.15.37:0/1720244487 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f295006ad70 0x7f295006d220 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2958007fd0 tx=0x7f29580079a0 comp rx=0 tx=0).stop 2023-07-14T15:57:47.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.943+0000 7f2975bff700 1 -- 172.21.15.37:0/1720244487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29700b4910 msgr2=0x7f29700ca970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:47.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.943+0000 7f2975bff700 1 --2- 172.21.15.37:0/1720244487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29700b4910 0x7f29700ca970 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2960014040 tx=0x7f2960004750 comp rx=0 tx=0).stop 2023-07-14T15:57:47.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.944+0000 7f2975bff700 1 -- 172.21.15.37:0/1720244487 shutdown_connections 2023-07-14T15:57:47.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.944+0000 7f2975bff700 1 --2- 172.21.15.37:0/1720244487 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f29700b85f0 0x7f29700cbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:47.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.944+0000 7f2975bff700 1 --2- 172.21.15.37:0/1720244487 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f295006ad70 0x7f295006d220 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:47.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.944+0000 7f2975bff700 1 --2- 172.21.15.37:0/1720244487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29700b4910 0x7f29700ca970 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:47.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.944+0000 7f2975bff700 1 --2- 172.21.15.37:0/1720244487 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f29700b54b0 0x7f2970160880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:47.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.944+0000 7f2975bff700 1 -- 172.21.15.37:0/1720244487 >> 172.21.15.37:0/1720244487 conn(0x7f297006a580 msgr2=0x7f297015c140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:47.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.944+0000 7f2975bff700 1 -- 172.21.15.37:0/1720244487 shutdown_connections 2023-07-14T15:57:47.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:47.944+0000 7f2975bff700 1 -- 172.21.15.37:0/1720244487 wait complete. 2023-07-14T15:57:47.947 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T15:55:52.907261+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T15:55:59.992839+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T15:57:23.872384+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T15:57:24.423055+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T15:57:47.948 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T15:57:48.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.168+0000 7ffbb4dff700 1 Processor -- start 2023-07-14T15:57:48.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.169+0000 7ffbb4dff700 1 -- start start 2023-07-14T15:57:48.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.170+0000 7ffbb4dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ffbb015fee0 0x7ffbb015ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:48.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.170+0000 7ffbb4dff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ffbb00d1140 0x7ffbb00b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:48.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.170+0000 7ffbb4dff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbb015dc50 con 0x7ffbb01603b0 2023-07-14T15:57:48.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.170+0000 7ffbb4dff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbb00b2940 con 0x7ffbb00d1140 2023-07-14T15:57:48.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.170+0000 7ffbb4dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb00b2c20 con 0x7ffbb015fee0 2023-07-14T15:57:48.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.170+0000 7ffba7fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ffbb01603b0 0x7ffbb00d0a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48118/0 (socket says 172.21.15.37:48118) 2023-07-14T15:57:48.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.170+0000 7ffba7fff700 1 -- 172.21.15.37:0/2939880332 learned_addr learned my addr 172.21.15.37:0/2939880332 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:48.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.170+0000 7ffbaed9d700 1 --2- 172.21.15.37:0/2939880332 >> v2:172.21.15.37:3300/0 conn(0x7ffbb00d1140 0x7ffbb00b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:48.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.170+0000 7ffbae59c700 1 --2- 172.21.15.37:0/2939880332 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ffbb015fee0 0x7ffbb015ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:48.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.170+0000 7ffbadd9b700 1 -- 172.21.15.37:0/2939880332 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3826313427 0 0) 0x7ffbb015dc50 con 0x7ffbb01603b0 2023-07-14T15:57:48.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.170+0000 7ffbadd9b700 1 -- 172.21.15.37:0/2939880332 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb9c0035b0 con 0x7ffbb01603b0 2023-07-14T15:57:48.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.171+0000 7ffbaed9d700 1 -- 172.21.15.37:0/2939880332 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ffbb015fee0 msgr2=0x7ffbb015ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:48.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.171+0000 7ffbaed9d700 1 --2- 172.21.15.37:0/2939880332 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ffbb015fee0 0x7ffbb015ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:48.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.171+0000 7ffbaed9d700 1 -- 172.21.15.37:0/2939880332 >> v1:172.21.15.37:6789/0 conn(0x7ffbb01603b0 legacy=0x7ffbb00d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:48.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.171+0000 7ffbaed9d700 1 -- 172.21.15.37:0/2939880332 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb00b2f00 con 0x7ffbb00d1140 2023-07-14T15:57:48.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.171+0000 7ffbaed9d700 1 --2- 172.21.15.37:0/2939880332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbb00d1140 0x7ffbb00b39e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ffba8009d90 tx=0x7ffba800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a31586fd286437d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:48.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.171+0000 7ffbadd9b700 1 -- 172.21.15.37:0/2939880332 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba800e070 con 0x7ffbb00d1140 2023-07-14T15:57:48.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.171+0000 7ffbadd9b700 1 -- 172.21.15.37:0/2939880332 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba800bb20 con 0x7ffbb00d1140 2023-07-14T15:57:48.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.171+0000 7ffbadd9b700 1 -- 172.21.15.37:0/2939880332 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba8012430 con 0x7ffbb00d1140 2023-07-14T15:57:48.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.172+0000 7ffbb4dff700 1 -- 172.21.15.37:0/2939880332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbb00d1140 msgr2=0x7ffbb00b39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:48.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.172+0000 7ffbb4dff700 1 --2- 172.21.15.37:0/2939880332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbb00d1140 0x7ffbb00b39e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ffba8009d90 tx=0x7ffba800b330 comp rx=0 tx=0).stop 2023-07-14T15:57:48.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.172+0000 7ffbb4dff700 1 -- 172.21.15.37:0/2939880332 shutdown_connections 2023-07-14T15:57:48.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.172+0000 7ffbb4dff700 1 --2- 172.21.15.37:0/2939880332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbb00d1140 0x7ffbb00b39e0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:48.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.172+0000 7ffbb4dff700 1 --2- 172.21.15.37:0/2939880332 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ffbb015fee0 0x7ffbb015ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:48.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.172+0000 7ffbb4dff700 1 -- 172.21.15.37:0/2939880332 >> 172.21.15.37:0/2939880332 conn(0x7ffbb009c1b0 msgr2=0x7ffbb00d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:48.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.172+0000 7ffbb4dff700 1 -- 172.21.15.37:0/2939880332 shutdown_connections 2023-07-14T15:57:48.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.172+0000 7ffbb4dff700 1 -- 172.21.15.37:0/2939880332 wait complete. 2023-07-14T15:57:48.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.173+0000 7ffbb4dff700 1 Processor -- start 2023-07-14T15:57:48.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.174+0000 7ffbb4dff700 1 -- start start 2023-07-14T15:57:48.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.175+0000 7ffbb4dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ffbb00d1140 0x7ffbb01543a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:48.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.175+0000 7ffbb4dff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbb015fee0 0x7ffbb00b85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:48.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.175+0000 7ffbb4dff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbb01603b0 0x7ffbb0158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:48.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.175+0000 7ffbb4dff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb01f2060 con 0x7ffbb01603b0 2023-07-14T15:57:48.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.175+0000 7ffbb4dff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb01548e0 con 0x7ffbb015fee0 2023-07-14T15:57:48.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.175+0000 7ffbb4dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb00b8b20 con 0x7ffbb00d1140 2023-07-14T15:57:48.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.175+0000 7ffbaed9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbb01603b0 0x7ffbb0158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:48.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.175+0000 7ffbaed9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbb01603b0 0x7ffbb0158390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48398/0 (socket says 172.21.15.37:48398) 2023-07-14T15:57:48.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.175+0000 7ffbaed9d700 1 -- 172.21.15.37:0/2584945737 learned_addr learned my addr 172.21.15.37:0/2584945737 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:48.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.175+0000 7ffbae59c700 1 --2- 172.21.15.37:0/2584945737 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ffbb00d1140 0x7ffbb01543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:48.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.175+0000 7ffba7fff700 1 --2- 172.21.15.37:0/2584945737 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbb015fee0 0x7ffbb00b85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:48.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.175+0000 7ffbaed9d700 1 -- 172.21.15.37:0/2584945737 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ffbb00d1140 msgr2=0x7ffbb01543a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:48.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.175+0000 7ffbaed9d700 1 --2- 172.21.15.37:0/2584945737 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ffbb00d1140 0x7ffbb01543a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:48.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.175+0000 7ffbaed9d700 1 -- 172.21.15.37:0/2584945737 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbb015fee0 msgr2=0x7ffbb00b85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:48.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.175+0000 7ffbaed9d700 1 --2- 172.21.15.37:0/2584945737 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbb015fee0 0x7ffbb00b85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:48.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.175+0000 7ffbaed9d700 1 -- 172.21.15.37:0/2584945737 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba8009a70 con 0x7ffbb01603b0 2023-07-14T15:57:48.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.175+0000 7ffba7fff700 1 --2- 172.21.15.37:0/2584945737 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbb015fee0 0x7ffbb00b85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:57:48.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.176+0000 7ffbaed9d700 1 --2- 172.21.15.37:0/2584945737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbb01603b0 0x7ffbb0158390 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ffba8014040 tx=0x7ffba8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:48.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.176+0000 7ffba6ffd700 1 -- 172.21.15.37:0/2584945737 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba8012a90 con 0x7ffbb01603b0 2023-07-14T15:57:48.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.176+0000 7ffba6ffd700 1 -- 172.21.15.37:0/2584945737 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba8020070 con 0x7ffbb01603b0 2023-07-14T15:57:48.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.176+0000 7ffbb4dff700 1 -- 172.21.15.37:0/2584945737 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbb00c8fd0 con 0x7ffbb01603b0 2023-07-14T15:57:48.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.176+0000 7ffba6ffd700 1 -- 172.21.15.37:0/2584945737 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba8012e50 con 0x7ffbb01603b0 2023-07-14T15:57:48.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.176+0000 7ffbb4dff700 1 -- 172.21.15.37:0/2584945737 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbb00c9590 con 0x7ffbb01603b0 2023-07-14T15:57:48.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.177+0000 7ffbb4dff700 1 -- 172.21.15.37:0/2584945737 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbb0067840 con 0x7ffbb01603b0 2023-07-14T15:57:48.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.178+0000 7ffba6ffd700 1 -- 172.21.15.37:0/2584945737 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7ffba8004040 con 0x7ffbb01603b0 2023-07-14T15:57:48.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.179+0000 7ffba6ffd700 1 --2- 172.21.15.37:0/2584945737 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ffb9006ad70 0x7ffb9006d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:48.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.179+0000 7ffba6ffd700 1 -- 172.21.15.37:0/2584945737 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6120+0+0 (secure 0 0 0) 0x7ffba8022070 con 0x7ffbb01603b0 2023-07-14T15:57:48.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.180+0000 7ffbae59c700 1 --2- 172.21.15.37:0/2584945737 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ffb9006ad70 0x7ffb9006d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:48.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.180+0000 7ffbae59c700 1 --2- 172.21.15.37:0/2584945737 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ffb9006ad70 0x7ffb9006d220 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ffba0009be0 tx=0x7ffba0009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:48.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.183+0000 7ffba6ffd700 1 -- 172.21.15.37:0/2584945737 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ffba8059c10 con 0x7ffbb01603b0 2023-07-14T15:57:48.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.393+0000 7ffbb4dff700 1 -- 172.21.15.37:0/2584945737 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffbb015ae40 con 0x7ffbb01603b0 2023-07-14T15:57:48.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.393+0000 7ffba6ffd700 1 -- 172.21.15.37:0/2584945737 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffba802c0a0 con 0x7ffbb01603b0 2023-07-14T15:57:48.379 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-14T15:57:48.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.395+0000 7ffbb4dff700 1 -- 172.21.15.37:0/2584945737 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ffb9006ad70 msgr2=0x7ffb9006d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:48.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.395+0000 7ffbb4dff700 1 --2- 172.21.15.37:0/2584945737 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ffb9006ad70 0x7ffb9006d220 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ffba0009be0 tx=0x7ffba0009210 comp rx=0 tx=0).stop 2023-07-14T15:57:48.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.395+0000 7ffbb4dff700 1 -- 172.21.15.37:0/2584945737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbb01603b0 msgr2=0x7ffbb0158390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:48.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.395+0000 7ffbb4dff700 1 --2- 172.21.15.37:0/2584945737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbb01603b0 0x7ffbb0158390 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ffba8014040 tx=0x7ffba8004ad0 comp rx=0 tx=0).stop 2023-07-14T15:57:48.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.395+0000 7ffbb4dff700 1 -- 172.21.15.37:0/2584945737 shutdown_connections 2023-07-14T15:57:48.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.395+0000 7ffbb4dff700 1 --2- 172.21.15.37:0/2584945737 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ffb9006ad70 0x7ffb9006d220 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:48.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.395+0000 7ffbb4dff700 1 --2- 172.21.15.37:0/2584945737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbb01603b0 0x7ffbb0158390 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:48.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.395+0000 7ffbb4dff700 1 --2- 172.21.15.37:0/2584945737 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ffbb00d1140 0x7ffbb01543a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:48.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.395+0000 7ffbb4dff700 1 --2- 172.21.15.37:0/2584945737 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbb015fee0 0x7ffbb00b85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:48.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.395+0000 7ffbb4dff700 1 -- 172.21.15.37:0/2584945737 >> 172.21.15.37:0/2584945737 conn(0x7ffbb009c1b0 msgr2=0x7ffbb00d0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:48.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.395+0000 7ffbb4dff700 1 -- 172.21.15.37:0/2584945737 shutdown_connections 2023-07-14T15:57:48.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.395+0000 7ffbb4dff700 1 -- 172.21.15.37:0/2584945737 wait complete. 2023-07-14T15:57:48.399 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T15:57:48.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.619+0000 7f07713ff700 1 Processor -- start 2023-07-14T15:57:48.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.619+0000 7f07713ff700 1 -- start start 2023-07-14T15:57:48.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.620+0000 7f07713ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f076c06d290 0x7f076c165070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:48.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.620+0000 7f07713ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f076c0707f0 con 0x7f076c071820 2023-07-14T15:57:48.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.620+0000 7f07713ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f076c070a60 con 0x7f076c0cb430 2023-07-14T15:57:48.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.620+0000 7f07713ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f076c070d40 con 0x7f076c06d290 2023-07-14T15:57:48.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.621+0000 7f0763fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f076c071820 0x7f076c06cb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48132/0 (socket says 172.21.15.37:48132) 2023-07-14T15:57:48.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.621+0000 7f0763fff700 1 -- 172.21.15.37:0/3111640784 learned_addr learned my addr 172.21.15.37:0/3111640784 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:48.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.621+0000 7f076b7fe700 1 --2- 172.21.15.37:0/3111640784 >> v2:172.21.15.98:3300/0 conn(0x7f076c06d290 0x7f076c165070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:48.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.621+0000 7f076a7fc700 1 -- 172.21.15.37:0/3111640784 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1840767646 0 0) 0x7f076c0707f0 con 0x7f076c071820 2023-07-14T15:57:48.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.621+0000 7f076a7fc700 1 -- 172.21.15.37:0/3111640784 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07580035b0 con 0x7f076c071820 2023-07-14T15:57:48.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.621+0000 7f076b7fe700 1 -- 172.21.15.37:0/3111640784 >> v1:172.21.15.98:6789/0 conn(0x7f076c0cb430 legacy=0x7f076c0cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:48.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.621+0000 7f076b7fe700 1 -- 172.21.15.37:0/3111640784 >> v1:172.21.15.37:6789/0 conn(0x7f076c071820 legacy=0x7f076c06cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:48.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.621+0000 7f076b7fe700 1 -- 172.21.15.37:0/3111640784 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f076c071020 con 0x7f076c06d290 2023-07-14T15:57:48.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.622+0000 7f076b7fe700 1 --2- 172.21.15.37:0/3111640784 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f076c06d290 0x7f076c165070 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0764009d90 tx=0x7f076400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=356cc7529b718f72 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:48.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.622+0000 7f076a7fc700 1 -- 172.21.15.37:0/3111640784 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076400e070 con 0x7f076c06d290 2023-07-14T15:57:48.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.622+0000 7f076a7fc700 1 -- 172.21.15.37:0/3111640784 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076400bb20 con 0x7f076c06d290 2023-07-14T15:57:48.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.622+0000 7f076a7fc700 1 -- 172.21.15.37:0/3111640784 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0764012430 con 0x7f076c06d290 2023-07-14T15:57:48.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.622+0000 7f07713ff700 1 -- 172.21.15.37:0/3111640784 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f076c06d290 msgr2=0x7f076c165070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:48.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.622+0000 7f07713ff700 1 --2- 172.21.15.37:0/3111640784 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f076c06d290 0x7f076c165070 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0764009d90 tx=0x7f076400b330 comp rx=0 tx=0).stop 2023-07-14T15:57:48.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.623+0000 7f07713ff700 1 -- 172.21.15.37:0/3111640784 shutdown_connections 2023-07-14T15:57:48.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.623+0000 7f07713ff700 1 --2- 172.21.15.37:0/3111640784 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f076c06d290 0x7f076c165070 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:48.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.623+0000 7f07713ff700 1 -- 172.21.15.37:0/3111640784 >> 172.21.15.37:0/3111640784 conn(0x7f076c06aac0 msgr2=0x7f076c0b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:48.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.623+0000 7f07713ff700 1 -- 172.21.15.37:0/3111640784 shutdown_connections 2023-07-14T15:57:48.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.623+0000 7f07713ff700 1 -- 172.21.15.37:0/3111640784 wait complete. 2023-07-14T15:57:48.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.625+0000 7f07713ff700 1 Processor -- start 2023-07-14T15:57:48.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.625+0000 7f07713ff700 1 -- start start 2023-07-14T15:57:48.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.626+0000 7f07713ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f076c06d290 0x7f076c0c4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:48.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.626+0000 7f07713ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f076c071820 0x7f076c1f07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:48.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.627+0000 7f07713ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f076c0cb430 0x7f076c0c5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:48.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.627+0000 7f07713ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076c0c8900 con 0x7f076c0cb430 2023-07-14T15:57:48.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.627+0000 7f07713ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076c0c7a90 con 0x7f076c071820 2023-07-14T15:57:48.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.627+0000 7f07713ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f076c0c54b0 con 0x7f076c06d290 2023-07-14T15:57:48.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.627+0000 7f076b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f076c0cb430 0x7f076c0c5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:48.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.627+0000 7f076b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f076c0cb430 0x7f076c0c5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48400/0 (socket says 172.21.15.37:48400) 2023-07-14T15:57:48.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.627+0000 7f076b7fe700 1 -- 172.21.15.37:0/4043088569 learned_addr learned my addr 172.21.15.37:0/4043088569 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:48.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.627+0000 7f076affd700 1 --2- 172.21.15.37:0/4043088569 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f076c06d290 0x7f076c0c4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:48.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.627+0000 7f0763fff700 1 --2- 172.21.15.37:0/4043088569 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f076c071820 0x7f076c1f07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:48.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.627+0000 7f076b7fe700 1 -- 172.21.15.37:0/4043088569 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f076c06d290 msgr2=0x7f076c0c4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:48.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.627+0000 7f076b7fe700 1 --2- 172.21.15.37:0/4043088569 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f076c06d290 0x7f076c0c4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:48.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.627+0000 7f076b7fe700 1 -- 172.21.15.37:0/4043088569 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f076c071820 msgr2=0x7f076c1f07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:48.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.627+0000 7f076b7fe700 1 --2- 172.21.15.37:0/4043088569 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f076c071820 0x7f076c1f07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:48.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.627+0000 7f076b7fe700 1 -- 172.21.15.37:0/4043088569 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0764009a70 con 0x7f076c0cb430 2023-07-14T15:57:48.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.627+0000 7f0763fff700 1 --2- 172.21.15.37:0/4043088569 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f076c071820 0x7f076c1f07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:57:48.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.628+0000 7f076b7fe700 1 --2- 172.21.15.37:0/4043088569 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f076c0cb430 0x7f076c0c5b50 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f076c071e30 tx=0x7f0764004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:48.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.628+0000 7f07637fe700 1 -- 172.21.15.37:0/4043088569 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0764012430 con 0x7f076c0cb430 2023-07-14T15:57:48.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.628+0000 7f07637fe700 1 -- 172.21.15.37:0/4043088569 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0764020070 con 0x7f076c0cb430 2023-07-14T15:57:48.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.628+0000 7f07637fe700 1 -- 172.21.15.37:0/4043088569 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0764004280 con 0x7f076c0cb430 2023-07-14T15:57:48.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.628+0000 7f07713ff700 1 -- 172.21.15.37:0/4043088569 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f076c0c7c80 con 0x7f076c0cb430 2023-07-14T15:57:48.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.628+0000 7f07713ff700 1 -- 172.21.15.37:0/4043088569 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f076c0c8240 con 0x7f076c0cb430 2023-07-14T15:57:48.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.629+0000 7f07713ff700 1 -- 172.21.15.37:0/4043088569 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f076c0ca640 con 0x7f076c0cb430 2023-07-14T15:57:48.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.630+0000 7f07637fe700 1 -- 172.21.15.37:0/4043088569 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f07640043e0 con 0x7f076c0cb430 2023-07-14T15:57:48.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.631+0000 7f07637fe700 1 --2- 172.21.15.37:0/4043088569 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f074c06ad70 0x7f074c06d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:48.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.631+0000 7f07637fe700 1 -- 172.21.15.37:0/4043088569 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f0764022070 con 0x7f076c0cb430 2023-07-14T15:57:48.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.631+0000 7f076affd700 1 --2- 172.21.15.37:0/4043088569 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f074c06ad70 0x7f074c06d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:48.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.632+0000 7f076affd700 1 --2- 172.21.15.37:0/4043088569 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f074c06ad70 0x7f074c06d220 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f075c007fd0 tx=0x7f075c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:48.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.635+0000 7f07637fe700 1 -- 172.21.15.37:0/4043088569 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f07640bd330 con 0x7f076c0cb430 2023-07-14T15:57:48.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.849+0000 7f07713ff700 1 -- 172.21.15.37:0/4043088569 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f076c0c8a40 con 0x7f076c0cb430 2023-07-14T15:57:48.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.850+0000 7f07637fe700 1 -- 172.21.15.37:0/4043088569 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v38) v1 ==== 92+0+10 (secure 0 0 0) 0x7f076402c020 con 0x7f076c0cb430 2023-07-14T15:57:48.836 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-14T15:57:48.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.852+0000 7f07713ff700 1 -- 172.21.15.37:0/4043088569 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f074c06ad70 msgr2=0x7f074c06d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:48.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.852+0000 7f07713ff700 1 --2- 172.21.15.37:0/4043088569 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f074c06ad70 0x7f074c06d220 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f075c007fd0 tx=0x7f075c009040 comp rx=0 tx=0).stop 2023-07-14T15:57:48.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.852+0000 7f07713ff700 1 -- 172.21.15.37:0/4043088569 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f076c0cb430 msgr2=0x7f076c0c5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:48.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.852+0000 7f07713ff700 1 --2- 172.21.15.37:0/4043088569 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f076c0cb430 0x7f076c0c5b50 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f076c071e30 tx=0x7f0764004ad0 comp rx=0 tx=0).stop 2023-07-14T15:57:48.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.852+0000 7f07713ff700 1 -- 172.21.15.37:0/4043088569 shutdown_connections 2023-07-14T15:57:48.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.852+0000 7f07713ff700 1 --2- 172.21.15.37:0/4043088569 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f074c06ad70 0x7f074c06d220 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:48.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.852+0000 7f07713ff700 1 --2- 172.21.15.37:0/4043088569 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f076c0cb430 0x7f076c0c5b50 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:48.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.852+0000 7f07713ff700 1 --2- 172.21.15.37:0/4043088569 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f076c06d290 0x7f076c0c4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:48.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.852+0000 7f07713ff700 1 --2- 172.21.15.37:0/4043088569 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f076c071820 0x7f076c1f07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:48.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.852+0000 7f07713ff700 1 -- 172.21.15.37:0/4043088569 >> 172.21.15.37:0/4043088569 conn(0x7f076c06aac0 msgr2=0x7f076c157790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:48.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.852+0000 7f07713ff700 1 -- 172.21.15.37:0/4043088569 shutdown_connections 2023-07-14T15:57:48.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:48.852+0000 7f07713ff700 1 -- 172.21.15.37:0/4043088569 wait complete. 2023-07-14T15:57:48.856 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T15:57:49.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.081+0000 7fd529bff700 1 Processor -- start 2023-07-14T15:57:49.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.081+0000 7fd529bff700 1 -- start start 2023-07-14T15:57:49.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.083+0000 7fd529bff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd5240cfd50 0x7fd5240d2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:49.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.083+0000 7fd529bff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd5240b1e80 0x7fd5240b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:49.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.083+0000 7fd529bff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5240b1840 con 0x7fd5240b3290 2023-07-14T15:57:49.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.083+0000 7fd529bff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd52415ccf0 con 0x7fd5240cfd50 2023-07-14T15:57:49.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.083+0000 7fd529bff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5240b2550 con 0x7fd5240b1e80 2023-07-14T15:57:49.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.083+0000 7fd523fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd5240b3290 0x7fd5240b36f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48140/0 (socket says 172.21.15.37:48140) 2023-07-14T15:57:49.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.083+0000 7fd523fff700 1 -- 172.21.15.37:0/711146934 learned_addr learned my addr 172.21.15.37:0/711146934 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:49.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.083+0000 7fd51bfff700 1 --2- 172.21.15.37:0/711146934 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd5240b1e80 0x7fd5240b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:49.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.083+0000 7fd5237fe700 1 --2- 172.21.15.37:0/711146934 >> v2:172.21.15.98:3300/0 conn(0x7fd5240cfd50 0x7fd5240d2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:49.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.083+0000 7fd522ffd700 1 -- 172.21.15.37:0/711146934 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3345569659 0 0) 0x7fd5240b1840 con 0x7fd5240b3290 2023-07-14T15:57:49.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.083+0000 7fd522ffd700 1 -- 172.21.15.37:0/711146934 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5100035b0 con 0x7fd5240b3290 2023-07-14T15:57:49.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.084+0000 7fd522ffd700 1 -- 172.21.15.37:0/711146934 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4261311521 0 0) 0x7fd5100035b0 con 0x7fd5240b3290 2023-07-14T15:57:49.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.084+0000 7fd522ffd700 1 -- 172.21.15.37:0/711146934 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd5240b1e80 msgr2=0x7fd5240b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:49.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.084+0000 7fd522ffd700 1 --2- 172.21.15.37:0/711146934 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd5240b1e80 0x7fd5240b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:49.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.084+0000 7fd522ffd700 1 -- 172.21.15.37:0/711146934 >> v2:172.21.15.98:3300/0 conn(0x7fd5240cfd50 msgr2=0x7fd5240d2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:49.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.084+0000 7fd522ffd700 1 --2- 172.21.15.37:0/711146934 >> v2:172.21.15.98:3300/0 conn(0x7fd5240cfd50 0x7fd5240d2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:49.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.084+0000 7fd522ffd700 1 -- 172.21.15.37:0/711146934 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5240b2830 con 0x7fd5240b3290 2023-07-14T15:57:49.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.084+0000 7fd522ffd700 1 -- 172.21.15.37:0/711146934 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48633207 0 0) 0x7fd51c0019f0 con 0x7fd5240b3290 2023-07-14T15:57:49.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.084+0000 7fd522ffd700 1 -- 172.21.15.37:0/711146934 >> v1:172.21.15.37:6789/0 conn(0x7fd5240b3290 legacy=0x7fd5240b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:49.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.084+0000 7fd522ffd700 1 --2- 172.21.15.37:0/711146934 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd510003a00 0x7fd510003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:49.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.084+0000 7fd522ffd700 1 --2- 172.21.15.37:0/711146934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd510004430 0x7fd5100048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:49.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.084+0000 7fd522ffd700 1 --2- 172.21.15.37:0/711146934 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd5240b1e80 0x7fd510005060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:49.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.084+0000 7fd522ffd700 1 -- 172.21.15.37:0/711146934 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52415ccf0 con 0x7fd510004430 2023-07-14T15:57:49.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.084+0000 7fd522ffd700 1 -- 172.21.15.37:0/711146934 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5240b2550 con 0x7fd510003a00 2023-07-14T15:57:49.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.084+0000 7fd522ffd700 1 -- 172.21.15.37:0/711146934 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd51000ba10 con 0x7fd5240b1e80 2023-07-14T15:57:49.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.084+0000 7fd51bfff700 1 --2- 172.21.15.37:0/711146934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd510004430 0x7fd5100048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:49.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.084+0000 7fd5237fe700 1 --2- 172.21.15.37:0/711146934 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd510003a00 0x7fd510003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:49.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.084+0000 7fd523fff700 1 --2- 172.21.15.37:0/711146934 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd5240b1e80 0x7fd510005060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:49.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.085+0000 7fd51bfff700 1 -- 172.21.15.37:0/711146934 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd5240b1e80 msgr2=0x7fd510005060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:49.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.085+0000 7fd51bfff700 1 --2- 172.21.15.37:0/711146934 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd5240b1e80 0x7fd510005060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:49.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.085+0000 7fd51bfff700 1 -- 172.21.15.37:0/711146934 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd510003a00 msgr2=0x7fd510003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:49.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.085+0000 7fd51bfff700 1 --2- 172.21.15.37:0/711146934 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd510003a00 0x7fd510003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:49.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.085+0000 7fd51bfff700 1 -- 172.21.15.37:0/711146934 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5100035b0 con 0x7fd510004430 2023-07-14T15:57:49.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.085+0000 7fd51bfff700 1 --2- 172.21.15.37:0/711146934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd510004430 0x7fd5100048f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd50c009b90 tx=0x7fd510005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2f4bd74d7b51c1c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:49.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.085+0000 7fd522ffd700 1 -- 172.21.15.37:0/711146934 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c00e6c0 con 0x7fd510004430 2023-07-14T15:57:49.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.085+0000 7fd522ffd700 1 -- 172.21.15.37:0/711146934 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50c00e820 con 0x7fd510004430 2023-07-14T15:57:49.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.085+0000 7fd522ffd700 1 -- 172.21.15.37:0/711146934 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c00eb90 con 0x7fd510004430 2023-07-14T15:57:49.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.086+0000 7fd529bff700 1 -- 172.21.15.37:0/711146934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd510004430 msgr2=0x7fd5100048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:49.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.086+0000 7fd529bff700 1 --2- 172.21.15.37:0/711146934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd510004430 0x7fd5100048f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd50c009b90 tx=0x7fd510005880 comp rx=0 tx=0).stop 2023-07-14T15:57:49.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.086+0000 7fd523fff700 1 -- 172.21.15.37:0/711146934 reap_dead start 2023-07-14T15:57:49.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.086+0000 7fd529bff700 1 -- 172.21.15.37:0/711146934 shutdown_connections 2023-07-14T15:57:49.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.086+0000 7fd529bff700 1 -- 172.21.15.37:0/711146934 >> 172.21.15.37:0/711146934 conn(0x7fd52409c1c0 msgr2=0x7fd5240d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:49.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.086+0000 7fd529bff700 1 -- 172.21.15.37:0/711146934 shutdown_connections 2023-07-14T15:57:49.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.086+0000 7fd529bff700 1 -- 172.21.15.37:0/711146934 wait complete. 2023-07-14T15:57:49.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.088+0000 7fd529bff700 1 Processor -- start 2023-07-14T15:57:49.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.088+0000 7fd529bff700 1 -- start start 2023-07-14T15:57:49.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.089+0000 7fd529bff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd510004430 0x7fd5240c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:49.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.089+0000 7fd529bff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5240c6e90 0x7fd5241e5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:49.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.089+0000 7fd529bff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd5240c7300 0x7fd5241e6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:49.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.089+0000 7fd529bff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5240c8360 con 0x7fd5240c6e90 2023-07-14T15:57:49.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.089+0000 7fd529bff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd524155a80 con 0x7fd510004430 2023-07-14T15:57:49.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.089+0000 7fd529bff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5240c9830 con 0x7fd5240c7300 2023-07-14T15:57:49.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.089+0000 7fd51bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5240c6e90 0x7fd5241e5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:49.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.089+0000 7fd51bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5240c6e90 0x7fd5241e5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48406/0 (socket says 172.21.15.37:48406) 2023-07-14T15:57:49.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.089+0000 7fd51bfff700 1 -- 172.21.15.37:0/939469790 learned_addr learned my addr 172.21.15.37:0/939469790 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:49.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.089+0000 7fd51bfff700 1 -- 172.21.15.37:0/939469790 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd5240c7300 msgr2=0x7fd5241e6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:49.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.089+0000 7fd51bfff700 1 --2- 172.21.15.37:0/939469790 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd5240c7300 0x7fd5241e6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:49.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.089+0000 7fd51bfff700 1 -- 172.21.15.37:0/939469790 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd510004430 msgr2=0x7fd5240c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:49.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.089+0000 7fd5237fe700 1 --2- 172.21.15.37:0/939469790 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd510004430 0x7fd5240c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:49.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.089+0000 7fd51bfff700 1 --2- 172.21.15.37:0/939469790 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd510004430 0x7fd5240c92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:49.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.089+0000 7fd51bfff700 1 -- 172.21.15.37:0/939469790 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5240d02a0 con 0x7fd5240c6e90 2023-07-14T15:57:49.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.089+0000 7fd5237fe700 1 --2- 172.21.15.37:0/939469790 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd510004430 0x7fd5240c92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:57:49.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.090+0000 7fd51bfff700 1 --2- 172.21.15.37:0/939469790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5240c6e90 0x7fd5241e5e40 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd510005770 tx=0x7fd50c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:49.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.090+0000 7fd520ff9700 1 -- 172.21.15.37:0/939469790 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c00e6c0 con 0x7fd5240c6e90 2023-07-14T15:57:49.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.090+0000 7fd520ff9700 1 -- 172.21.15.37:0/939469790 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50c0038b0 con 0x7fd5240c6e90 2023-07-14T15:57:49.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.090+0000 7fd529bff700 1 -- 172.21.15.37:0/939469790 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5240c77e0 con 0x7fd5240c6e90 2023-07-14T15:57:49.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.090+0000 7fd520ff9700 1 -- 172.21.15.37:0/939469790 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c003c60 con 0x7fd5240c6e90 2023-07-14T15:57:49.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.090+0000 7fd529bff700 1 -- 172.21.15.37:0/939469790 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5240c7da0 con 0x7fd5240c6e90 2023-07-14T15:57:49.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.091+0000 7fd529bff700 1 -- 172.21.15.37:0/939469790 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5241e4050 con 0x7fd5240c6e90 2023-07-14T15:57:49.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.092+0000 7fd520ff9700 1 -- 172.21.15.37:0/939469790 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7fd50c013470 con 0x7fd5240c6e90 2023-07-14T15:57:49.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.093+0000 7fd520ff9700 1 --2- 172.21.15.37:0/939469790 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd50406ad70 0x7fd50406d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:49.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.093+0000 7fd520ff9700 1 -- 172.21.15.37:0/939469790 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fd50c08ad90 con 0x7fd5240c6e90 2023-07-14T15:57:49.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.094+0000 7fd5237fe700 1 --2- 172.21.15.37:0/939469790 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd50406ad70 0x7fd50406d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:49.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.094+0000 7fd5237fe700 1 --2- 172.21.15.37:0/939469790 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd50406ad70 0x7fd50406d220 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd514009b50 tx=0x7fd514008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:49.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.097+0000 7fd520ff9700 1 -- 172.21.15.37:0/939469790 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd50c055da0 con 0x7fd5240c6e90 2023-07-14T15:57:49.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.303+0000 7fd529bff700 1 -- 172.21.15.37:0/939469790 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd524067840 con 0x7fd5240c6e90 2023-07-14T15:57:49.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.303+0000 7fd520ff9700 1 -- 172.21.15.37:0/939469790 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v38) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd50c017020 con 0x7fd5240c6e90 2023-07-14T15:57:49.289 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-14T15:57:49.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.306+0000 7fd529bff700 1 -- 172.21.15.37:0/939469790 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd50406ad70 msgr2=0x7fd50406d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:49.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.306+0000 7fd529bff700 1 --2- 172.21.15.37:0/939469790 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd50406ad70 0x7fd50406d220 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd514009b50 tx=0x7fd514008040 comp rx=0 tx=0).stop 2023-07-14T15:57:49.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.306+0000 7fd529bff700 1 -- 172.21.15.37:0/939469790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5240c6e90 msgr2=0x7fd5241e5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:49.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.306+0000 7fd529bff700 1 --2- 172.21.15.37:0/939469790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5240c6e90 0x7fd5241e5e40 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd510005770 tx=0x7fd50c0047c0 comp rx=0 tx=0).stop 2023-07-14T15:57:49.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.306+0000 7fd529bff700 1 -- 172.21.15.37:0/939469790 shutdown_connections 2023-07-14T15:57:49.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.306+0000 7fd529bff700 1 --2- 172.21.15.37:0/939469790 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd510004430 0x7fd5240c92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:49.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.306+0000 7fd529bff700 1 --2- 172.21.15.37:0/939469790 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd50406ad70 0x7fd50406d220 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:49.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.306+0000 7fd529bff700 1 --2- 172.21.15.37:0/939469790 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd5240c7300 0x7fd5241e6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:49.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.306+0000 7fd529bff700 1 --2- 172.21.15.37:0/939469790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5240c6e90 0x7fd5241e5e40 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:49.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.306+0000 7fd529bff700 1 -- 172.21.15.37:0/939469790 >> 172.21.15.37:0/939469790 conn(0x7fd52409c1c0 msgr2=0x7fd5240b3fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:49.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.306+0000 7fd529bff700 1 -- 172.21.15.37:0/939469790 shutdown_connections 2023-07-14T15:57:49.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.306+0000 7fd529bff700 1 -- 172.21.15.37:0/939469790 wait complete. 2023-07-14T15:57:49.309 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T15:57:49.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.528+0000 7fb0385ff700 1 Processor -- start 2023-07-14T15:57:49.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.528+0000 7fb0385ff700 1 -- start start 2023-07-14T15:57:49.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.529+0000 7fb0385ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb03015c990 0x7fb0300ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:49.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.529+0000 7fb0385ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb03015cd60 0x7fb0300cf040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:49.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.529+0000 7fb0385ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb03006b310 con 0x7fb0300cbd30 2023-07-14T15:57:49.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.529+0000 7fb0385ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0300cc8c0 con 0x7fb03015c990 2023-07-14T15:57:49.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.529+0000 7fb0385ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0300ccab0 con 0x7fb03015cd60 2023-07-14T15:57:49.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.530+0000 7fb03639b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb03015c990 0x7fb0300ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:49.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.530+0000 7fb03639b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb03015c990 0x7fb0300ceb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48416/0 (socket says 172.21.15.37:48416) 2023-07-14T15:57:49.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.530+0000 7fb03639b700 1 -- 172.21.15.37:0/3204210732 learned_addr learned my addr 172.21.15.37:0/3204210732 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:49.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.530+0000 7fb035b9a700 1 --2- 172.21.15.37:0/3204210732 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb03015cd60 0x7fb0300cf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:49.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.530+0000 7fb03639b700 1 -- 172.21.15.37:0/3204210732 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb03015cd60 msgr2=0x7fb0300cf040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:49.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.530+0000 7fb03639b700 1 --2- 172.21.15.37:0/3204210732 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb03015cd60 0x7fb0300cf040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:49.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.530+0000 7fb03639b700 1 -- 172.21.15.37:0/3204210732 >> v1:172.21.15.98:6789/0 conn(0x7fb0300cbd30 legacy=0x7fb0300cc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:49.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.530+0000 7fb03639b700 1 -- 172.21.15.37:0/3204210732 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0300ccd90 con 0x7fb03015c990 2023-07-14T15:57:49.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.530+0000 7fb03639b700 1 --2- 172.21.15.37:0/3204210732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb03015c990 0x7fb0300ceb00 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb02c0098f0 tx=0x7fb02c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e61f5c0c912ebf4c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:49.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.531+0000 7fb035399700 1 -- 172.21.15.37:0/3204210732 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02c00b8a0 con 0x7fb03015c990 2023-07-14T15:57:49.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.531+0000 7fb035399700 1 -- 172.21.15.37:0/3204210732 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb02c00ba00 con 0x7fb03015c990 2023-07-14T15:57:49.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.531+0000 7fb035399700 1 -- 172.21.15.37:0/3204210732 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02c00bd90 con 0x7fb03015c990 2023-07-14T15:57:49.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.531+0000 7fb0385ff700 1 -- 172.21.15.37:0/3204210732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb03015c990 msgr2=0x7fb0300ceb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:49.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.531+0000 7fb0385ff700 1 --2- 172.21.15.37:0/3204210732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb03015c990 0x7fb0300ceb00 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb02c0098f0 tx=0x7fb02c009c00 comp rx=0 tx=0).stop 2023-07-14T15:57:49.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.531+0000 7fb0385ff700 1 -- 172.21.15.37:0/3204210732 shutdown_connections 2023-07-14T15:57:49.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.531+0000 7fb0385ff700 1 --2- 172.21.15.37:0/3204210732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb03015c990 0x7fb0300ceb00 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:49.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.531+0000 7fb0385ff700 1 --2- 172.21.15.37:0/3204210732 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb03015cd60 0x7fb0300cf040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:49.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.531+0000 7fb0385ff700 1 -- 172.21.15.37:0/3204210732 >> 172.21.15.37:0/3204210732 conn(0x7fb030099ff0 msgr2=0x7fb0300d0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:49.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.531+0000 7fb0385ff700 1 -- 172.21.15.37:0/3204210732 shutdown_connections 2023-07-14T15:57:49.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.531+0000 7fb0385ff700 1 -- 172.21.15.37:0/3204210732 wait complete. 2023-07-14T15:57:49.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.533+0000 7fb0385ff700 1 Processor -- start 2023-07-14T15:57:49.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.533+0000 7fb0385ff700 1 -- start start 2023-07-14T15:57:49.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.534+0000 7fb0385ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb0300cbd30 0x7fb0300b4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:49.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.534+0000 7fb0385ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb03015c990 0x7fb03015f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:49.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.534+0000 7fb0385ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb03015cd60 0x7fb03014f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:49.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.534+0000 7fb0385ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03015fb00 con 0x7fb03015c990 2023-07-14T15:57:49.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.534+0000 7fb0385ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03015e520 con 0x7fb0300cbd30 2023-07-14T15:57:49.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.534+0000 7fb0385ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb03015e800 con 0x7fb03015cd60 2023-07-14T15:57:49.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.534+0000 7fb035b9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb03015c990 0x7fb03015f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:49.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.535+0000 7fb035b9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb03015c990 0x7fb03015f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48422/0 (socket says 172.21.15.37:48422) 2023-07-14T15:57:49.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.535+0000 7fb035b9a700 1 -- 172.21.15.37:0/3669040356 learned_addr learned my addr 172.21.15.37:0/3669040356 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:49.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.535+0000 7fb03639b700 1 --2- 172.21.15.37:0/3669040356 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb0300cbd30 0x7fb0300b4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:49.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.535+0000 7fb036b9c700 1 --2- 172.21.15.37:0/3669040356 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb03015cd60 0x7fb03014f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:49.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.535+0000 7fb035b9a700 1 -- 172.21.15.37:0/3669040356 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb03015cd60 msgr2=0x7fb03014f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:49.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.535+0000 7fb035b9a700 1 --2- 172.21.15.37:0/3669040356 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb03015cd60 0x7fb03014f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:49.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.535+0000 7fb035b9a700 1 -- 172.21.15.37:0/3669040356 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb0300cbd30 msgr2=0x7fb0300b4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:49.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.535+0000 7fb035b9a700 1 --2- 172.21.15.37:0/3669040356 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb0300cbd30 0x7fb0300b4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:49.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.535+0000 7fb035b9a700 1 -- 172.21.15.37:0/3669040356 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02c009550 con 0x7fb03015c990 2023-07-14T15:57:49.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.535+0000 7fb035b9a700 1 --2- 172.21.15.37:0/3669040356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb03015c990 0x7fb03015f5c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb02000d800 tx=0x7fb02000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:49.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.535+0000 7fb026ffd700 1 -- 172.21.15.37:0/3669040356 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0200125f0 con 0x7fb03015c990 2023-07-14T15:57:49.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.535+0000 7fb026ffd700 1 -- 172.21.15.37:0/3669040356 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb020012750 con 0x7fb03015c990 2023-07-14T15:57:49.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.535+0000 7fb026ffd700 1 -- 172.21.15.37:0/3669040356 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb020012b00 con 0x7fb03015c990 2023-07-14T15:57:49.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.535+0000 7fb0385ff700 1 -- 172.21.15.37:0/3669040356 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb03015eae0 con 0x7fb03015c990 2023-07-14T15:57:49.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.536+0000 7fb0385ff700 1 -- 172.21.15.37:0/3669040356 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb03015f0a0 con 0x7fb03015c990 2023-07-14T15:57:49.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.537+0000 7fb0385ff700 1 -- 172.21.15.37:0/3669040356 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb03006b780 con 0x7fb03015c990 2023-07-14T15:57:49.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.538+0000 7fb026ffd700 1 -- 172.21.15.37:0/3669040356 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7fb020012c60 con 0x7fb03015c990 2023-07-14T15:57:49.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.539+0000 7fb026ffd700 1 --2- 172.21.15.37:0/3669040356 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb01406ada0 0x7fb01406d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:49.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.539+0000 7fb026ffd700 1 -- 172.21.15.37:0/3669040356 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fb0200898f0 con 0x7fb03015c990 2023-07-14T15:57:49.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.539+0000 7fb03639b700 1 --2- 172.21.15.37:0/3669040356 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb01406ada0 0x7fb01406d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:49.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.540+0000 7fb03639b700 1 --2- 172.21.15.37:0/3669040356 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb01406ada0 0x7fb01406d250 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb02c009c40 tx=0x7fb02c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:49.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.543+0000 7fb026ffd700 1 -- 172.21.15.37:0/3669040356 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb03006b780 con 0x7fb03015c990 2023-07-14T15:57:49.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.754+0000 7fb0385ff700 1 -- 172.21.15.37:0/3669040356 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb03006b780 con 0x7fb03015c990 2023-07-14T15:57:49.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.754+0000 7fb026ffd700 1 -- 172.21.15.37:0/3669040356 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v38) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb03006b780 con 0x7fb03015c990 2023-07-14T15:57:49.740 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-14T15:57:49.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.757+0000 7fb0385ff700 1 -- 172.21.15.37:0/3669040356 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb01406ada0 msgr2=0x7fb01406d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:49.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.757+0000 7fb0385ff700 1 --2- 172.21.15.37:0/3669040356 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb01406ada0 0x7fb01406d250 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb02c009c40 tx=0x7fb02c008030 comp rx=0 tx=0).stop 2023-07-14T15:57:49.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.757+0000 7fb0385ff700 1 -- 172.21.15.37:0/3669040356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb03015c990 msgr2=0x7fb03015f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:49.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.757+0000 7fb0385ff700 1 --2- 172.21.15.37:0/3669040356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb03015c990 0x7fb03015f5c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb02000d800 tx=0x7fb02000dbc0 comp rx=0 tx=0).stop 2023-07-14T15:57:49.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.757+0000 7fb0385ff700 1 -- 172.21.15.37:0/3669040356 shutdown_connections 2023-07-14T15:57:49.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.757+0000 7fb0385ff700 1 --2- 172.21.15.37:0/3669040356 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb0300cbd30 0x7fb0300b4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:49.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.757+0000 7fb0385ff700 1 --2- 172.21.15.37:0/3669040356 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb01406ada0 0x7fb01406d250 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:49.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.757+0000 7fb0385ff700 1 --2- 172.21.15.37:0/3669040356 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb03015cd60 0x7fb03014f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:49.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.757+0000 7fb0385ff700 1 --2- 172.21.15.37:0/3669040356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb03015c990 0x7fb03015f5c0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:49.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.757+0000 7fb0385ff700 1 -- 172.21.15.37:0/3669040356 >> 172.21.15.37:0/3669040356 conn(0x7fb030099ff0 msgr2=0x7fb03006c980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:49.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.757+0000 7fb0385ff700 1 -- 172.21.15.37:0/3669040356 shutdown_connections 2023-07-14T15:57:49.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.757+0000 7fb0385ff700 1 -- 172.21.15.37:0/3669040356 wait complete. 2023-07-14T15:57:49.761 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-14T15:57:49.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.980+0000 7ffbd27ff700 1 Processor -- start 2023-07-14T15:57:49.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.980+0000 7ffbd27ff700 1 -- start start 2023-07-14T15:57:49.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.981+0000 7ffbd27ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7ffbcc0b4890 0x7ffbcc0cd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:49.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.982+0000 7ffbd27ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ffbcc0b4c60 0x7ffbcc0b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:49.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.982+0000 7ffbd27ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ffbcc15caf0 0x7ffbcc15cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:49.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.982+0000 7ffbd27ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbcc0cfb70 con 0x7ffbcc0b4c60 2023-07-14T15:57:49.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.982+0000 7ffbd27ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbcc0cfdc0 con 0x7ffbcc0b4890 2023-07-14T15:57:49.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.982+0000 7ffbd27ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc0d00a0 con 0x7ffbcc15caf0 2023-07-14T15:57:49.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.982+0000 7ffbc3fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ffbcc0b4c60 0x7ffbcc0b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:49.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.982+0000 7ffbc3fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ffbcc0b4c60 0x7ffbcc0b50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44752/0 (socket says 172.21.15.37:44752) 2023-07-14T15:57:49.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.982+0000 7ffbc3fff700 1 -- 172.21.15.37:0/3096520243 learned_addr learned my addr 172.21.15.37:0/3096520243 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:49.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.982+0000 7ffbd0d9c700 1 --2- 172.21.15.37:0/3096520243 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ffbcc15caf0 0x7ffbcc15cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:49.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.982+0000 7ffbcbfff700 1 --2- 172.21.15.37:0/3096520243 >> v2:172.21.15.98:3300/0 conn(0x7ffbcc0b4890 0x7ffbcc0cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:49.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.982+0000 7ffbc3fff700 1 -- 172.21.15.37:0/3096520243 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ffbcc15caf0 msgr2=0x7ffbcc15cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:49.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.982+0000 7ffbc3fff700 1 --2- 172.21.15.37:0/3096520243 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ffbcc15caf0 0x7ffbcc15cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:49.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.982+0000 7ffbc3fff700 1 -- 172.21.15.37:0/3096520243 >> v2:172.21.15.98:3300/0 conn(0x7ffbcc0b4890 msgr2=0x7ffbcc0cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:49.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.982+0000 7ffbc3fff700 1 --2- 172.21.15.37:0/3096520243 >> v2:172.21.15.98:3300/0 conn(0x7ffbcc0b4890 0x7ffbcc0cd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:49.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.982+0000 7ffbc3fff700 1 -- 172.21.15.37:0/3096520243 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbcc0d0380 con 0x7ffbcc0b4c60 2023-07-14T15:57:49.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.982+0000 7ffbd0d9c700 1 --2- 172.21.15.37:0/3096520243 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ffbcc15caf0 0x7ffbcc15cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:57:49.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.983+0000 7ffbc3fff700 1 --2- 172.21.15.37:0/3096520243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbcc0b4c60 0x7ffbcc0b50d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc08be30 tx=0x7ffbb4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21b1278e6473bee7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:49.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.983+0000 7ffbcb7fe700 1 -- 172.21.15.37:0/3096520243 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb400b870 con 0x7ffbcc0b4c60 2023-07-14T15:57:49.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.983+0000 7ffbcb7fe700 1 -- 172.21.15.37:0/3096520243 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb400b9d0 con 0x7ffbcc0b4c60 2023-07-14T15:57:49.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.983+0000 7ffbcb7fe700 1 -- 172.21.15.37:0/3096520243 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb400bd60 con 0x7ffbcc0b4c60 2023-07-14T15:57:49.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.983+0000 7ffbd27ff700 1 -- 172.21.15.37:0/3096520243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbcc0b4c60 msgr2=0x7ffbcc0b50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:49.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.983+0000 7ffbd27ff700 1 --2- 172.21.15.37:0/3096520243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbcc0b4c60 0x7ffbcc0b50d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc08be30 tx=0x7ffbb4009bd0 comp rx=0 tx=0).stop 2023-07-14T15:57:49.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.983+0000 7ffbd27ff700 1 -- 172.21.15.37:0/3096520243 shutdown_connections 2023-07-14T15:57:49.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.983+0000 7ffbd27ff700 1 --2- 172.21.15.37:0/3096520243 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ffbcc15caf0 0x7ffbcc15cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:49.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.983+0000 7ffbd27ff700 1 --2- 172.21.15.37:0/3096520243 >> v2:172.21.15.98:3300/0 conn(0x7ffbcc0b4890 0x7ffbcc0cd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:49.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.983+0000 7ffbd27ff700 1 --2- 172.21.15.37:0/3096520243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbcc0b4c60 0x7ffbcc0b50d0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:49.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.983+0000 7ffbd27ff700 1 -- 172.21.15.37:0/3096520243 >> 172.21.15.37:0/3096520243 conn(0x7ffbcc06a540 msgr2=0x7ffbcc06a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:49.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.984+0000 7ffbd27ff700 1 -- 172.21.15.37:0/3096520243 shutdown_connections 2023-07-14T15:57:49.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.984+0000 7ffbd27ff700 1 -- 172.21.15.37:0/3096520243 wait complete. 2023-07-14T15:57:49.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.985+0000 7ffbd27ff700 1 Processor -- start 2023-07-14T15:57:49.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.985+0000 7ffbd27ff700 1 -- start start 2023-07-14T15:57:49.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.986+0000 7ffbd27ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbcc0b4890 0x7ffbcc15b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:49.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.986+0000 7ffbd27ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ffbcc0b4c60 0x7ffbcc0cc620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:49.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.986+0000 7ffbd27ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbcc15caf0 0x7ffbcc0c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:49.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.986+0000 7ffbd27ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc15b800 con 0x7ffbcc0b4890 2023-07-14T15:57:49.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.986+0000 7ffbd27ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc0cac90 con 0x7ffbcc15caf0 2023-07-14T15:57:49.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.986+0000 7ffbd27ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc0caf70 con 0x7ffbcc0b4c60 2023-07-14T15:57:49.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.986+0000 7ffbcbfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbcc0b4890 0x7ffbcc15b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:49.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.987+0000 7ffbcbfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbcc0b4890 0x7ffbcc15b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44754/0 (socket says 172.21.15.37:44754) 2023-07-14T15:57:49.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.987+0000 7ffbcbfff700 1 -- 172.21.15.37:0/3877866761 learned_addr learned my addr 172.21.15.37:0/3877866761 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:49.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.987+0000 7ffbc3fff700 1 --2- 172.21.15.37:0/3877866761 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ffbcc0b4c60 0x7ffbcc0cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:49.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.987+0000 7ffbd0d9c700 1 --2- 172.21.15.37:0/3877866761 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbcc15caf0 0x7ffbcc0c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:49.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.987+0000 7ffbcbfff700 1 -- 172.21.15.37:0/3877866761 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ffbcc0b4c60 msgr2=0x7ffbcc0cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:49.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.987+0000 7ffbcbfff700 1 --2- 172.21.15.37:0/3877866761 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ffbcc0b4c60 0x7ffbcc0cc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:49.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.987+0000 7ffbcbfff700 1 -- 172.21.15.37:0/3877866761 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbcc15caf0 msgr2=0x7ffbcc0c8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:49.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.987+0000 7ffbcbfff700 1 --2- 172.21.15.37:0/3877866761 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbcc15caf0 0x7ffbcc0c8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:49.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.987+0000 7ffbcbfff700 1 -- 172.21.15.37:0/3877866761 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb4009550 con 0x7ffbcc0b4890 2023-07-14T15:57:49.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.987+0000 7ffbcbfff700 1 --2- 172.21.15.37:0/3877866761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbcc0b4890 0x7ffbcc15b2c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc00d800 tx=0x7ffbbc00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:49.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.987+0000 7ffbc97fa700 1 -- 172.21.15.37:0/3877866761 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc0125f0 con 0x7ffbcc0b4890 2023-07-14T15:57:49.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.987+0000 7ffbc97fa700 1 -- 172.21.15.37:0/3877866761 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbbc012750 con 0x7ffbcc0b4890 2023-07-14T15:57:49.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.987+0000 7ffbd27ff700 1 -- 172.21.15.37:0/3877866761 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbcc0cb250 con 0x7ffbcc0b4890 2023-07-14T15:57:49.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.988+0000 7ffbc97fa700 1 -- 172.21.15.37:0/3877866761 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc012ae0 con 0x7ffbcc0b4890 2023-07-14T15:57:49.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.988+0000 7ffbd27ff700 1 -- 172.21.15.37:0/3877866761 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbcc0cb810 con 0x7ffbcc0b4890 2023-07-14T15:57:49.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.989+0000 7ffbd27ff700 1 -- 172.21.15.37:0/3877866761 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbcc04e210 con 0x7ffbcc0b4890 2023-07-14T15:57:49.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.990+0000 7ffbc97fa700 1 -- 172.21.15.37:0/3877866761 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7ffbbc012c40 con 0x7ffbcc0b4890 2023-07-14T15:57:49.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.990+0000 7ffbc97fa700 1 --2- 172.21.15.37:0/3877866761 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ffbac06ad70 0x7ffbac06d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:49.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.990+0000 7ffbc97fa700 1 -- 172.21.15.37:0/3877866761 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6120+0+0 (secure 0 0 0) 0x7ffbbc0895a0 con 0x7ffbcc0b4890 2023-07-14T15:57:49.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.991+0000 7ffbc3fff700 1 --2- 172.21.15.37:0/3877866761 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ffbac06ad70 0x7ffbac06d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:49.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.991+0000 7ffbc3fff700 1 --2- 172.21.15.37:0/3877866761 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ffbac06ad70 0x7ffbac06d220 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4014040 tx=0x7ffbb4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:49.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:49.995+0000 7ffbc97fa700 1 -- 172.21.15.37:0/3877866761 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ffbbc0545d0 con 0x7ffbcc0b4890 2023-07-14T15:57:50.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.220+0000 7ffbd27ff700 1 -- 172.21.15.37:0/3877866761 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ffbcc15c690 con 0x7ffbcc0b4890 2023-07-14T15:57:50.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.220+0000 7ffbc97fa700 1 -- 172.21.15.37:0/3877866761 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v38) v1 ==== 80+0+0 (secure 0 0 0) 0x7ffbbc057bf0 con 0x7ffbcc0b4890 2023-07-14T15:57:50.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.223+0000 7ffbd27ff700 1 -- 172.21.15.37:0/3877866761 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ffbac06ad70 msgr2=0x7ffbac06d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:50.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.223+0000 7ffbd27ff700 1 --2- 172.21.15.37:0/3877866761 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ffbac06ad70 0x7ffbac06d220 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4014040 tx=0x7ffbb4008030 comp rx=0 tx=0).stop 2023-07-14T15:57:50.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.223+0000 7ffbd27ff700 1 -- 172.21.15.37:0/3877866761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbcc0b4890 msgr2=0x7ffbcc15b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:50.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.223+0000 7ffbd27ff700 1 --2- 172.21.15.37:0/3877866761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbcc0b4890 0x7ffbcc15b2c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc00d800 tx=0x7ffbbc00db10 comp rx=0 tx=0).stop 2023-07-14T15:57:50.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.223+0000 7ffbd27ff700 1 -- 172.21.15.37:0/3877866761 shutdown_connections 2023-07-14T15:57:50.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.223+0000 7ffbd27ff700 1 --2- 172.21.15.37:0/3877866761 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffbcc15caf0 0x7ffbcc0c8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:50.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.223+0000 7ffbd27ff700 1 --2- 172.21.15.37:0/3877866761 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ffbac06ad70 0x7ffbac06d220 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:50.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.223+0000 7ffbd27ff700 1 --2- 172.21.15.37:0/3877866761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbcc0b4890 0x7ffbcc15b2c0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:50.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.223+0000 7ffbd27ff700 1 --2- 172.21.15.37:0/3877866761 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ffbcc0b4c60 0x7ffbcc0cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:50.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.223+0000 7ffbd27ff700 1 -- 172.21.15.37:0/3877866761 >> 172.21.15.37:0/3877866761 conn(0x7ffbcc06a540 msgr2=0x7ffbcc0b5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:50.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.223+0000 7ffbd27ff700 1 -- 172.21.15.37:0/3877866761 shutdown_connections 2023-07-14T15:57:50.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.223+0000 7ffbd27ff700 1 -- 172.21.15.37:0/3877866761 wait complete. 2023-07-14T15:57:50.210 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2023-07-14T15:57:50.225 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-14T15:57:50.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:57:50.226 DEBUG:teuthology.orchestra.run.smithi098:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-07-14T15:57:50.323 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi098.front.sepia.ceph.com 2023-07-14T15:57:50.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:57:50.323 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-14T15:57:50.369 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-14T15:57:50.369 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T15:57:50.413 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348708k,nr_inodes=4087177,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=34,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275628k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-07-14T15:57:50.414 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-14T15:57:50.414 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T15:57:50.457 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345608k,nr_inodes=4086402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275008k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-07-14T15:57:50.458 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T15:57:50.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.673+0000 7fd068fff700 1 Processor -- start 2023-07-14T15:57:50.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.673+0000 7fd068fff700 1 -- start start 2023-07-14T15:57:50.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.674+0000 7fd068fff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd0641601f0 0x7fd064160660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:50.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.674+0000 7fd068fff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0640c3d40 con 0x7fd0640ccf10 2023-07-14T15:57:50.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.674+0000 7fd068fff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0640c4300 con 0x7fd0640cb510 2023-07-14T15:57:50.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.674+0000 7fd068fff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd064160ba0 con 0x7fd0641601f0 2023-07-14T15:57:50.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.675+0000 7fd06259c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd0640ccf10 0x7fd0640ac8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34400/0 (socket says 172.21.15.37:34400) 2023-07-14T15:57:50.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.675+0000 7fd06259c700 1 -- 172.21.15.37:0/3006463540 learned_addr learned my addr 172.21.15.37:0/3006463540 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:50.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.675+0000 7fd061d9b700 1 --2- 172.21.15.37:0/3006463540 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd0641601f0 0x7fd064160660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:50.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.675+0000 7fd06159a700 1 -- 172.21.15.37:0/3006463540 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 964254826 0 0) 0x7fd0640c3d40 con 0x7fd0640ccf10 2023-07-14T15:57:50.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.675+0000 7fd06159a700 1 -- 172.21.15.37:0/3006463540 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd04c0035b0 con 0x7fd0640ccf10 2023-07-14T15:57:50.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.675+0000 7fd06159a700 1 -- 172.21.15.37:0/3006463540 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3951513368 0 0) 0x7fd0640c4300 con 0x7fd0640cb510 2023-07-14T15:57:50.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.675+0000 7fd06159a700 1 -- 172.21.15.37:0/3006463540 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0640c3d40 con 0x7fd0640cb510 2023-07-14T15:57:50.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.675+0000 7fd061d9b700 1 -- 172.21.15.37:0/3006463540 >> v1:172.21.15.98:6789/0 conn(0x7fd0640cb510 legacy=0x7fd0640cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:50.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.675+0000 7fd061d9b700 1 -- 172.21.15.37:0/3006463540 >> v1:172.21.15.37:6789/0 conn(0x7fd0640ccf10 legacy=0x7fd0640ac8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:50.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.675+0000 7fd061d9b700 1 -- 172.21.15.37:0/3006463540 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0640cec80 con 0x7fd0641601f0 2023-07-14T15:57:50.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.675+0000 7fd061d9b700 1 --2- 172.21.15.37:0/3006463540 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd0641601f0 0x7fd064160660 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd058009870 tx=0x7fd058009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95631cbe665e2f58 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:50.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.676+0000 7fd06159a700 1 -- 172.21.15.37:0/3006463540 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd058011830 con 0x7fd0641601f0 2023-07-14T15:57:50.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.676+0000 7fd06159a700 1 -- 172.21.15.37:0/3006463540 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd058011990 con 0x7fd0641601f0 2023-07-14T15:57:50.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.676+0000 7fd06159a700 1 -- 172.21.15.37:0/3006463540 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd058011d20 con 0x7fd0641601f0 2023-07-14T15:57:50.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.676+0000 7fd068fff700 1 -- 172.21.15.37:0/3006463540 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd0641601f0 msgr2=0x7fd064160660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:50.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.676+0000 7fd068fff700 1 --2- 172.21.15.37:0/3006463540 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd0641601f0 0x7fd064160660 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd058009870 tx=0x7fd058009b80 comp rx=0 tx=0).stop 2023-07-14T15:57:50.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.676+0000 7fd068fff700 1 -- 172.21.15.37:0/3006463540 shutdown_connections 2023-07-14T15:57:50.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.676+0000 7fd068fff700 1 --2- 172.21.15.37:0/3006463540 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd0641601f0 0x7fd064160660 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:50.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.676+0000 7fd068fff700 1 -- 172.21.15.37:0/3006463540 >> 172.21.15.37:0/3006463540 conn(0x7fd0640b0ad0 msgr2=0x7fd0640b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:50.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.677+0000 7fd068fff700 1 -- 172.21.15.37:0/3006463540 shutdown_connections 2023-07-14T15:57:50.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.677+0000 7fd068fff700 1 -- 172.21.15.37:0/3006463540 wait complete. 2023-07-14T15:57:50.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.678+0000 7fd068fff700 1 Processor -- start 2023-07-14T15:57:50.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.678+0000 7fd068fff700 1 -- start start 2023-07-14T15:57:50.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.679+0000 7fd068fff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd0640cb510 0x7fd0641f4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:50.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.679+0000 7fd068fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0640ccf10 0x7fd064134db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:50.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.679+0000 7fd068fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0641601f0 0x7fd064070b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:50.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.679+0000 7fd068fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0641f54c0 con 0x7fd0640ccf10 2023-07-14T15:57:50.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.679+0000 7fd068fff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0640b0850 con 0x7fd0641601f0 2023-07-14T15:57:50.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.679+0000 7fd068fff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd064145cd0 con 0x7fd0640cb510 2023-07-14T15:57:50.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.680+0000 7fd061d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0640ccf10 0x7fd064134db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:50.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.680+0000 7fd061d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0640ccf10 0x7fd064134db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44762/0 (socket says 172.21.15.37:44762) 2023-07-14T15:57:50.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.680+0000 7fd061d9b700 1 -- 172.21.15.37:0/543886636 learned_addr learned my addr 172.21.15.37:0/543886636 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:50.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.680+0000 7fd06259c700 1 --2- 172.21.15.37:0/543886636 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd0640cb510 0x7fd0641f4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:50.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.680+0000 7fd062d9d700 1 --2- 172.21.15.37:0/543886636 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0641601f0 0x7fd064070b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:50.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.680+0000 7fd061d9b700 1 -- 172.21.15.37:0/543886636 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd0640cb510 msgr2=0x7fd0641f4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:50.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.680+0000 7fd061d9b700 1 --2- 172.21.15.37:0/543886636 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd0640cb510 0x7fd0641f4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:50.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.680+0000 7fd061d9b700 1 -- 172.21.15.37:0/543886636 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0641601f0 msgr2=0x7fd064070b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:50.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.680+0000 7fd061d9b700 1 --2- 172.21.15.37:0/543886636 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0641601f0 0x7fd064070b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:50.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.680+0000 7fd061d9b700 1 -- 172.21.15.37:0/543886636 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0580094a0 con 0x7fd0640ccf10 2023-07-14T15:57:50.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.680+0000 7fd06259c700 1 --2- 172.21.15.37:0/543886636 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd0640cb510 0x7fd0641f4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:57:50.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.680+0000 7fd061d9b700 1 --2- 172.21.15.37:0/543886636 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0640ccf10 0x7fd064134db0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd0580090b0 tx=0x7fd058004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:50.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.680+0000 7fd052ffd700 1 -- 172.21.15.37:0/543886636 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05801a860 con 0x7fd0640ccf10 2023-07-14T15:57:50.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.680+0000 7fd052ffd700 1 -- 172.21.15.37:0/543886636 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05801a9c0 con 0x7fd0640ccf10 2023-07-14T15:57:50.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.681+0000 7fd052ffd700 1 -- 172.21.15.37:0/543886636 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05801ad30 con 0x7fd0640ccf10 2023-07-14T15:57:50.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.681+0000 7fd068fff700 1 -- 172.21.15.37:0/543886636 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0640afc40 con 0x7fd0640ccf10 2023-07-14T15:57:50.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.681+0000 7fd068fff700 1 -- 172.21.15.37:0/543886636 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0640b0200 con 0x7fd0640ccf10 2023-07-14T15:57:50.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.682+0000 7fd068fff700 1 -- 172.21.15.37:0/543886636 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd064067840 con 0x7fd0640ccf10 2023-07-14T15:57:50.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.683+0000 7fd052ffd700 1 -- 172.21.15.37:0/543886636 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7fd058022070 con 0x7fd0640ccf10 2023-07-14T15:57:50.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.684+0000 7fd052ffd700 1 --2- 172.21.15.37:0/543886636 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd04406ad70 0x7fd04406d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:50.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.684+0000 7fd052ffd700 1 -- 172.21.15.37:0/543886636 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fd05808a190 con 0x7fd0640ccf10 2023-07-14T15:57:50.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.684+0000 7fd06259c700 1 --2- 172.21.15.37:0/543886636 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd04406ad70 0x7fd04406d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:50.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.685+0000 7fd06259c700 1 --2- 172.21.15.37:0/543886636 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd04406ad70 0x7fd04406d220 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd054000f60 tx=0x7fd054009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:50.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.688+0000 7fd052ffd700 1 -- 172.21.15.37:0/543886636 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd058055370 con 0x7fd0640ccf10 2023-07-14T15:57:50.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.940+0000 7fd068fff700 1 -- 172.21.15.37:0/543886636 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd064071f40 con 0x7fd0640ccf10 2023-07-14T15:57:50.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.941+0000 7fd052ffd700 1 -- 172.21.15.37:0/543886636 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4709 (secure 0 0 0) 0x7fd058058990 con 0x7fd0640ccf10 2023-07-14T15:57:50.926 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:57:50.926 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/1292294727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":1292294727},{"type":"v1","addr":"172.21.15.98:6837","nonce":1292294727}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4811,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1091097806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1091097806},{"type":"v1","addr":"172.21.15.37:6835","nonce":1091097806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5059,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/2838228048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2838228048},{"type":"v1","addr":"172.21.15.98:6836","nonce":2838228048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T15:57:25.446758+0000","modified":"2023-07-14T15:57:28.951927+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5121},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5121":{"gid":5121,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6834/2406398098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2406398098},{"type":"v1","addr":"172.21.15.37:6834","nonce":2406398098}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-14T15:57:50.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.943+0000 7fd068fff700 1 -- 172.21.15.37:0/543886636 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd04406ad70 msgr2=0x7fd04406d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:50.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.943+0000 7fd068fff700 1 --2- 172.21.15.37:0/543886636 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd04406ad70 0x7fd04406d220 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd054000f60 tx=0x7fd054009040 comp rx=0 tx=0).stop 2023-07-14T15:57:50.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.943+0000 7fd068fff700 1 -- 172.21.15.37:0/543886636 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0640ccf10 msgr2=0x7fd064134db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:50.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.943+0000 7fd068fff700 1 --2- 172.21.15.37:0/543886636 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0640ccf10 0x7fd064134db0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd0580090b0 tx=0x7fd058004750 comp rx=0 tx=0).stop 2023-07-14T15:57:50.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.943+0000 7fd068fff700 1 -- 172.21.15.37:0/543886636 shutdown_connections 2023-07-14T15:57:50.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.943+0000 7fd068fff700 1 --2- 172.21.15.37:0/543886636 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0641601f0 0x7fd064070b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:50.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.943+0000 7fd068fff700 1 --2- 172.21.15.37:0/543886636 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd04406ad70 0x7fd04406d220 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:50.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.943+0000 7fd068fff700 1 --2- 172.21.15.37:0/543886636 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd0640cb510 0x7fd0641f4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:50.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.943+0000 7fd068fff700 1 --2- 172.21.15.37:0/543886636 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0640ccf10 0x7fd064134db0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:50.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.943+0000 7fd068fff700 1 -- 172.21.15.37:0/543886636 >> 172.21.15.37:0/543886636 conn(0x7fd0640b0ad0 msgr2=0x7fd06415f310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:50.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.943+0000 7fd068fff700 1 -- 172.21.15.37:0/543886636 shutdown_connections 2023-07-14T15:57:50.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:50.943+0000 7fd068fff700 1 -- 172.21.15.37:0/543886636 wait complete. 2023-07-14T15:57:50.930 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 17 2023-07-14T15:57:50.947 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T15:57:51.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.164+0000 7fe332dff700 1 Processor -- start 2023-07-14T15:57:51.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.164+0000 7fe332dff700 1 -- start start 2023-07-14T15:57:51.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.165+0000 7fe332dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe32c0b8b80 0x7fe32c0b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:51.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.165+0000 7fe332dff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe32c160c50 0x7fe32c0cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:51.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.165+0000 7fe332dff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe32c0cf6f0 con 0x7fe32c0cf8b0 2023-07-14T15:57:51.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.165+0000 7fe332dff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe32c0d0de0 con 0x7fe32c160c50 2023-07-14T15:57:51.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.165+0000 7fe332dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c0cd590 con 0x7fe32c0b8b80 2023-07-14T15:57:51.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.165+0000 7fe33139c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe32c0cf8b0 0x7fe32c0d1270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34412/0 (socket says 172.21.15.37:34412) 2023-07-14T15:57:51.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.165+0000 7fe33139c700 1 -- 172.21.15.37:0/716533943 learned_addr learned my addr 172.21.15.37:0/716533943 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:51.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.166+0000 7fe32bfff700 1 --2- 172.21.15.37:0/716533943 >> v2:172.21.15.98:3300/0 conn(0x7fe32c160c50 0x7fe32c0cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:51.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.166+0000 7fe330b9b700 1 --2- 172.21.15.37:0/716533943 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe32c0b8b80 0x7fe32c0b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:51.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.166+0000 7fe32b7fe700 1 -- 172.21.15.37:0/716533943 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4069955262 0 0) 0x7fe32c0cf6f0 con 0x7fe32c0cf8b0 2023-07-14T15:57:51.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.166+0000 7fe32b7fe700 1 -- 172.21.15.37:0/716533943 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe31c0035b0 con 0x7fe32c0cf8b0 2023-07-14T15:57:51.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.166+0000 7fe32bfff700 1 -- 172.21.15.37:0/716533943 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe32c0b8b80 msgr2=0x7fe32c0b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:51.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.166+0000 7fe32b7fe700 1 -- 172.21.15.37:0/716533943 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1737549075 0 0) 0x7fe31c0035b0 con 0x7fe32c0cf8b0 2023-07-14T15:57:51.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.166+0000 7fe32bfff700 1 --2- 172.21.15.37:0/716533943 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe32c0b8b80 0x7fe32c0b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:51.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.166+0000 7fe32bfff700 1 -- 172.21.15.37:0/716533943 >> v1:172.21.15.37:6789/0 conn(0x7fe32c0cf8b0 legacy=0x7fe32c0d1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:51.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.166+0000 7fe32bfff700 1 -- 172.21.15.37:0/716533943 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe32c0cd870 con 0x7fe32c160c50 2023-07-14T15:57:51.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.166+0000 7fe330b9b700 1 --2- 172.21.15.37:0/716533943 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe32c0b8b80 0x7fe32c0b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:57:51.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.167+0000 7fe32bfff700 1 --2- 172.21.15.37:0/716533943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe32c160c50 0x7fe32c0cf1b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe318009840 tx=0x7fe318009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=807f21d633129935 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:51.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.167+0000 7fe32b7fe700 1 -- 172.21.15.37:0/716533943 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3240019f0 con 0x7fe32c160c50 2023-07-14T15:57:51.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.167+0000 7fe32b7fe700 1 -- 172.21.15.37:0/716533943 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe318004030 con 0x7fe32c160c50 2023-07-14T15:57:51.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.167+0000 7fe32b7fe700 1 -- 172.21.15.37:0/716533943 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3180043c0 con 0x7fe32c160c50 2023-07-14T15:57:51.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.168+0000 7fe332dff700 1 -- 172.21.15.37:0/716533943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe32c160c50 msgr2=0x7fe32c0cf1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:51.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.168+0000 7fe332dff700 1 --2- 172.21.15.37:0/716533943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe32c160c50 0x7fe32c0cf1b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe318009840 tx=0x7fe318009b50 comp rx=0 tx=0).stop 2023-07-14T15:57:51.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.168+0000 7fe332dff700 1 -- 172.21.15.37:0/716533943 shutdown_connections 2023-07-14T15:57:51.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.168+0000 7fe332dff700 1 --2- 172.21.15.37:0/716533943 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe32c0b8b80 0x7fe32c0b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:51.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.168+0000 7fe332dff700 1 --2- 172.21.15.37:0/716533943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe32c160c50 0x7fe32c0cf1b0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:51.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.168+0000 7fe332dff700 1 -- 172.21.15.37:0/716533943 >> 172.21.15.37:0/716533943 conn(0x7fe32c06b150 msgr2=0x7fe32c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:51.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.168+0000 7fe332dff700 1 -- 172.21.15.37:0/716533943 shutdown_connections 2023-07-14T15:57:51.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.168+0000 7fe332dff700 1 -- 172.21.15.37:0/716533943 wait complete. 2023-07-14T15:57:51.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.170+0000 7fe332dff700 1 Processor -- start 2023-07-14T15:57:51.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.170+0000 7fe332dff700 1 -- start start 2023-07-14T15:57:51.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.171+0000 7fe332dff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe32c0b8b80 0x7fe32c0b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:51.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.171+0000 7fe332dff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe32c0cf8b0 0x7fe32c1e6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:51.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.171+0000 7fe332dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe32c160c50 0x7fe32c15a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:51.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.171+0000 7fe332dff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c0cb140 con 0x7fe32c0cf8b0 2023-07-14T15:57:51.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.171+0000 7fe332dff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c0b55e0 con 0x7fe32c0b8b80 2023-07-14T15:57:51.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.171+0000 7fe332dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c0ca530 con 0x7fe32c160c50 2023-07-14T15:57:51.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.171+0000 7fe32bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe32c0cf8b0 0x7fe32c1e6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:51.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.171+0000 7fe32bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe32c0cf8b0 0x7fe32c1e6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44774/0 (socket says 172.21.15.37:44774) 2023-07-14T15:57:51.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.171+0000 7fe32bfff700 1 -- 172.21.15.37:0/4287421799 learned_addr learned my addr 172.21.15.37:0/4287421799 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:51.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.171+0000 7fe330b9b700 1 --2- 172.21.15.37:0/4287421799 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe32c0b8b80 0x7fe32c0b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:51.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.171+0000 7fe33139c700 1 --2- 172.21.15.37:0/4287421799 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe32c160c50 0x7fe32c15a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:51.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.171+0000 7fe32bfff700 1 -- 172.21.15.37:0/4287421799 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe32c160c50 msgr2=0x7fe32c15a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:51.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.171+0000 7fe32bfff700 1 --2- 172.21.15.37:0/4287421799 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe32c160c50 0x7fe32c15a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:51.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.172+0000 7fe32bfff700 1 -- 172.21.15.37:0/4287421799 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe32c0b8b80 msgr2=0x7fe32c0b50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:51.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.172+0000 7fe32bfff700 1 --2- 172.21.15.37:0/4287421799 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe32c0b8b80 0x7fe32c0b50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:51.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.172+0000 7fe32bfff700 1 -- 172.21.15.37:0/4287421799 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3200094a0 con 0x7fe32c0cf8b0 2023-07-14T15:57:51.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.172+0000 7fe32bfff700 1 --2- 172.21.15.37:0/4287421799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe32c0cf8b0 0x7fe32c1e6120 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe31800a010 tx=0x7fe318004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:51.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.172+0000 7fe3297fa700 1 -- 172.21.15.37:0/4287421799 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe318003ae0 con 0x7fe32c0cf8b0 2023-07-14T15:57:51.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.172+0000 7fe3297fa700 1 -- 172.21.15.37:0/4287421799 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe31801f070 con 0x7fe32c0cf8b0 2023-07-14T15:57:51.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.172+0000 7fe3297fa700 1 -- 172.21.15.37:0/4287421799 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe318003ea0 con 0x7fe32c0cf8b0 2023-07-14T15:57:51.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.172+0000 7fe332dff700 1 -- 172.21.15.37:0/4287421799 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3180094a0 con 0x7fe32c0cf8b0 2023-07-14T15:57:51.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.172+0000 7fe332dff700 1 -- 172.21.15.37:0/4287421799 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe32c0caaf0 con 0x7fe32c0cf8b0 2023-07-14T15:57:51.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.173+0000 7fe332dff700 1 -- 172.21.15.37:0/4287421799 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe32c0cb2b0 con 0x7fe32c0cf8b0 2023-07-14T15:57:51.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.174+0000 7fe3297fa700 1 -- 172.21.15.37:0/4287421799 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7fe318021030 con 0x7fe32c0cf8b0 2023-07-14T15:57:51.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.175+0000 7fe3297fa700 1 --2- 172.21.15.37:0/4287421799 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe31006ad70 0x7fe31006d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:51.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.176+0000 7fe3297fa700 1 -- 172.21.15.37:0/4287421799 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fe31808a6e0 con 0x7fe32c0cf8b0 2023-07-14T15:57:51.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.176+0000 7fe330b9b700 1 --2- 172.21.15.37:0/4287421799 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe31006ad70 0x7fe31006d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:51.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.177+0000 7fe330b9b700 1 --2- 172.21.15.37:0/4287421799 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe31006ad70 0x7fe31006d220 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe32c15f950 tx=0x7fe320009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:51.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.180+0000 7fe3297fa700 1 -- 172.21.15.37:0/4287421799 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe3180556f0 con 0x7fe32c0cf8b0 2023-07-14T15:57:51.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.386+0000 7fe332dff700 1 -- 172.21.15.37:0/4287421799 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe32c067840 con 0x7fe32c0cf8b0 2023-07-14T15:57:51.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.387+0000 7fe3297fa700 1 -- 172.21.15.37:0/4287421799 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18376 (secure 0 0 0) 0x7fe318058d10 con 0x7fe32c0cf8b0 2023-07-14T15:57:51.372 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:57:51.373 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":38,"fsid":"9da30401-a779-4e46-aba6-00c2494c6c67","created":"2023-07-14T15:55:39.898867+0000","modified":"2023-07-14T15:57:48.750407+0000","last_up_change":"2023-07-14T15:55:53.025696+0000","last_in_change":"2023-07-14T15:55:43.388192+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T15:55:52.907261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T15:55:59.992839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-14T15:57:23.872384+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-14T15:57:24.423055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d049535-7b87-4276-8fe5-0f74ba422d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6801","nonce":2783032392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6803","nonce":2783032392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6807","nonce":2783032392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6805","nonce":2783032392}]},"public_addr":"172.21.15.37:6801/2783032392","cluster_addr":"172.21.15.37:6803/2783032392","heartbeat_back_addr":"172.21.15.37:6807/2783032392","heartbeat_front_addr":"172.21.15.37:6805/2783032392","state":["exists","up"]},{"osd":1,"uuid":"79ec948d-ead2-4c2d-923a-dd6eeaac9dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6823","nonce":1190059746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6826","nonce":1190059746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6831","nonce":1190059746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6829","nonce":1190059746}]},"public_addr":"172.21.15.37:6823/1190059746","cluster_addr":"172.21.15.37:6826/1190059746","heartbeat_back_addr":"172.21.15.37:6831/1190059746","heartbeat_front_addr":"172.21.15.37:6829/1190059746","state":["exists","up"]},{"osd":2,"uuid":"a1db6690-c160-4366-9c82-2cca17e4bba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6809","nonce":2266223499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6813","nonce":2266223499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6820","nonce":2266223499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6816","nonce":2266223499}]},"public_addr":"172.21.15.37:6809/2266223499","cluster_addr":"172.21.15.37:6813/2266223499","heartbeat_back_addr":"172.21.15.37:6820/2266223499","heartbeat_front_addr":"172.21.15.37:6816/2266223499","state":["exists","up"]},{"osd":3,"uuid":"767b8220-e79a-4a86-a162-6b3b73198379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6812","nonce":4166694594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6817","nonce":4166694594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6828","nonce":4166694594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6822","nonce":4166694594}]},"public_addr":"172.21.15.37:6812/4166694594","cluster_addr":"172.21.15.37:6817/4166694594","heartbeat_back_addr":"172.21.15.37:6828/4166694594","heartbeat_front_addr":"172.21.15.37:6822/4166694594","state":["exists","up"]},{"osd":4,"uuid":"717bd773-ae7e-4236-ac79-900cf99a37c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6801","nonce":3529020407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6803","nonce":3529020407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6807","nonce":3529020407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6805","nonce":3529020407}]},"public_addr":"172.21.15.98:6801/3529020407","cluster_addr":"172.21.15.98:6803/3529020407","heartbeat_back_addr":"172.21.15.98:6807/3529020407","heartbeat_front_addr":"172.21.15.98:6805/3529020407","state":["exists","up"]},{"osd":5,"uuid":"a941d358-0f03-4136-a9b2-3a1c2e9358cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6817","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6819","nonce":2311501838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6821","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6823","nonce":2311501838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6829","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6831","nonce":2311501838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6825","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6827","nonce":2311501838}]},"public_addr":"172.21.15.98:6819/2311501838","cluster_addr":"172.21.15.98:6823/2311501838","heartbeat_back_addr":"172.21.15.98:6831/2311501838","heartbeat_front_addr":"172.21.15.98:6827/2311501838","state":["exists","up"]},{"osd":6,"uuid":"27153772-6d4b-479d-9953-0582e7b96743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6809","nonce":1144224691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6811","nonce":1144224691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6815","nonce":1144224691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6813","nonce":1144224691}]},"public_addr":"172.21.15.98:6809/1144224691","cluster_addr":"172.21.15.98:6811/1144224691","heartbeat_back_addr":"172.21.15.98:6815/1144224691","heartbeat_front_addr":"172.21.15.98:6813/1144224691","state":["exists","up"]},{"osd":7,"uuid":"d21ffc8e-40bb-47eb-af2c-e3e730d3fb76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6818","nonce":1144470927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6822","nonce":1144470927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6830","nonce":1144470927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6826","nonce":1144470927}]},"public_addr":"172.21.15.98:6818/1144470927","cluster_addr":"172.21.15.98:6822/1144470927","heartbeat_back_addr":"172.21.15.98:6830/1144470927","heartbeat_front_addr":"172.21.15.98:6826/1144470927","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.921114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.739210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.024016+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.002527+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.698127+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.813416+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.709351+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.815457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.f","mappings":[{"from":4,"to":2}]},{"pgid":"6.3f","mappings":[{"from":4,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T15:57:51.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.389+0000 7fe332dff700 1 -- 172.21.15.37:0/4287421799 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe31006ad70 msgr2=0x7fe31006d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:51.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.389+0000 7fe332dff700 1 --2- 172.21.15.37:0/4287421799 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe31006ad70 0x7fe31006d220 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe32c15f950 tx=0x7fe320009210 comp rx=0 tx=0).stop 2023-07-14T15:57:51.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.389+0000 7fe332dff700 1 -- 172.21.15.37:0/4287421799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe32c0cf8b0 msgr2=0x7fe32c1e6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:51.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.389+0000 7fe332dff700 1 --2- 172.21.15.37:0/4287421799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe32c0cf8b0 0x7fe32c1e6120 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe31800a010 tx=0x7fe318004750 comp rx=0 tx=0).stop 2023-07-14T15:57:51.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.390+0000 7fe332dff700 1 -- 172.21.15.37:0/4287421799 shutdown_connections 2023-07-14T15:57:51.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.390+0000 7fe332dff700 1 --2- 172.21.15.37:0/4287421799 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe32c0b8b80 0x7fe32c0b50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:51.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.390+0000 7fe332dff700 1 --2- 172.21.15.37:0/4287421799 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe31006ad70 0x7fe31006d220 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:51.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.390+0000 7fe332dff700 1 --2- 172.21.15.37:0/4287421799 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe32c160c50 0x7fe32c15a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:51.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.390+0000 7fe332dff700 1 --2- 172.21.15.37:0/4287421799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe32c0cf8b0 0x7fe32c1e6120 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:51.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.390+0000 7fe332dff700 1 -- 172.21.15.37:0/4287421799 >> 172.21.15.37:0/4287421799 conn(0x7fe32c06b150 msgr2=0x7fe32c0d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:51.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.390+0000 7fe332dff700 1 -- 172.21.15.37:0/4287421799 shutdown_connections 2023-07-14T15:57:51.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.390+0000 7fe332dff700 1 -- 172.21.15.37:0/4287421799 wait complete. 2023-07-14T15:57:51.393 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T15:55:52.907261+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T15:55:59.992839+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T15:57:23.872384+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T15:57:24.423055+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T15:57:51.394 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T15:57:51.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.615+0000 7fb6dc5ff700 1 Processor -- start 2023-07-14T15:57:51.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.615+0000 7fb6dc5ff700 1 -- start start 2023-07-14T15:57:51.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.616+0000 7fb6dc5ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb6d40d1140 0x7fb6d415ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:51.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.616+0000 7fb6dc5ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb6d41603b0 0x7fb6d40b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:51.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.616+0000 7fb6dc5ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6d415dc50 con 0x7fb6d415fee0 2023-07-14T15:57:51.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.616+0000 7fb6dc5ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6d40b2940 con 0x7fb6d41603b0 2023-07-14T15:57:51.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.616+0000 7fb6dc5ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d40b2c20 con 0x7fb6d40d1140 2023-07-14T15:57:51.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.616+0000 7fb6da39b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb6d415fee0 0x7fb6d40d0a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34420/0 (socket says 172.21.15.37:34420) 2023-07-14T15:57:51.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.616+0000 7fb6da39b700 1 -- 172.21.15.37:0/652462583 learned_addr learned my addr 172.21.15.37:0/652462583 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:51.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.616+0000 7fb6dab9c700 1 --2- 172.21.15.37:0/652462583 >> v2:172.21.15.98:3300/0 conn(0x7fb6d41603b0 0x7fb6d40b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:51.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.616+0000 7fb6d9b9a700 1 --2- 172.21.15.37:0/652462583 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb6d40d1140 0x7fb6d415ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:51.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.617+0000 7fb6d9399700 1 -- 172.21.15.37:0/652462583 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1135641115 0 0) 0x7fb6d415dc50 con 0x7fb6d415fee0 2023-07-14T15:57:51.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.617+0000 7fb6d9399700 1 -- 172.21.15.37:0/652462583 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6c00035b0 con 0x7fb6d415fee0 2023-07-14T15:57:51.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.617+0000 7fb6d9b9a700 1 -- 172.21.15.37:0/652462583 >> v2:172.21.15.98:3300/0 conn(0x7fb6d41603b0 msgr2=0x7fb6d40b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:51.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.617+0000 7fb6d9b9a700 1 --2- 172.21.15.37:0/652462583 >> v2:172.21.15.98:3300/0 conn(0x7fb6d41603b0 0x7fb6d40b39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:51.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.617+0000 7fb6d9b9a700 1 -- 172.21.15.37:0/652462583 >> v1:172.21.15.37:6789/0 conn(0x7fb6d415fee0 legacy=0x7fb6d40d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:51.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.617+0000 7fb6d9b9a700 1 -- 172.21.15.37:0/652462583 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d40b2f00 con 0x7fb6d40d1140 2023-07-14T15:57:51.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.617+0000 7fb6dab9c700 1 --2- 172.21.15.37:0/652462583 >> v2:172.21.15.98:3300/0 conn(0x7fb6d41603b0 0x7fb6d40b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:57:51.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.617+0000 7fb6d9b9a700 1 --2- 172.21.15.37:0/652462583 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb6d40d1140 0x7fb6d415ded0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4009840 tx=0x7fb6c4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=694634c15b4bf8aa server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:51.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.618+0000 7fb6d9399700 1 -- 172.21.15.37:0/652462583 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c4011830 con 0x7fb6d40d1140 2023-07-14T15:57:51.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.618+0000 7fb6d9399700 1 -- 172.21.15.37:0/652462583 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c4011990 con 0x7fb6d40d1140 2023-07-14T15:57:51.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.618+0000 7fb6d9399700 1 -- 172.21.15.37:0/652462583 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c4011d20 con 0x7fb6d40d1140 2023-07-14T15:57:51.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.618+0000 7fb6dc5ff700 1 -- 172.21.15.37:0/652462583 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb6d40d1140 msgr2=0x7fb6d415ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:51.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.618+0000 7fb6dc5ff700 1 --2- 172.21.15.37:0/652462583 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb6d40d1140 0x7fb6d415ded0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4009840 tx=0x7fb6c4009b50 comp rx=0 tx=0).stop 2023-07-14T15:57:51.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.618+0000 7fb6dc5ff700 1 -- 172.21.15.37:0/652462583 shutdown_connections 2023-07-14T15:57:51.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.618+0000 7fb6dc5ff700 1 --2- 172.21.15.37:0/652462583 >> v2:172.21.15.98:3300/0 conn(0x7fb6d41603b0 0x7fb6d40b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:51.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.618+0000 7fb6dc5ff700 1 --2- 172.21.15.37:0/652462583 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb6d40d1140 0x7fb6d415ded0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:51.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.618+0000 7fb6dc5ff700 1 -- 172.21.15.37:0/652462583 >> 172.21.15.37:0/652462583 conn(0x7fb6d409c1b0 msgr2=0x7fb6d40d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:51.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.618+0000 7fb6dc5ff700 1 -- 172.21.15.37:0/652462583 shutdown_connections 2023-07-14T15:57:51.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.618+0000 7fb6dc5ff700 1 -- 172.21.15.37:0/652462583 wait complete. 2023-07-14T15:57:51.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.621+0000 7fb6dc5ff700 1 Processor -- start 2023-07-14T15:57:51.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.621+0000 7fb6dc5ff700 1 -- start start 2023-07-14T15:57:51.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.622+0000 7fb6dc5ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6d40d1140 0x7fb6d40c66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:51.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.622+0000 7fb6dc5ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb6d415fee0 0x7fb6d40c6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:51.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.622+0000 7fb6dc5ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb6d41603b0 0x7fb6d40b0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:51.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.622+0000 7fb6dc5ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d40c7250 con 0x7fb6d40d1140 2023-07-14T15:57:51.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.622+0000 7fb6dc5ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d40c7530 con 0x7fb6d41603b0 2023-07-14T15:57:51.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.622+0000 7fb6dc5ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d40c7ec0 con 0x7fb6d415fee0 2023-07-14T15:57:51.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.622+0000 7fb6da39b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6d40d1140 0x7fb6d40c66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:51.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.622+0000 7fb6da39b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6d40d1140 0x7fb6d40c66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44788/0 (socket says 172.21.15.37:44788) 2023-07-14T15:57:51.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.622+0000 7fb6da39b700 1 -- 172.21.15.37:0/2708871216 learned_addr learned my addr 172.21.15.37:0/2708871216 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:51.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.623+0000 7fb6d9b9a700 1 --2- 172.21.15.37:0/2708871216 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb6d415fee0 0x7fb6d40c6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:51.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.623+0000 7fb6dab9c700 1 --2- 172.21.15.37:0/2708871216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb6d41603b0 0x7fb6d40b0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:51.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.623+0000 7fb6da39b700 1 -- 172.21.15.37:0/2708871216 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb6d415fee0 msgr2=0x7fb6d40c6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:51.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.623+0000 7fb6da39b700 1 --2- 172.21.15.37:0/2708871216 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb6d415fee0 0x7fb6d40c6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:51.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.623+0000 7fb6da39b700 1 -- 172.21.15.37:0/2708871216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb6d41603b0 msgr2=0x7fb6d40b0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:51.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.623+0000 7fb6da39b700 1 --2- 172.21.15.37:0/2708871216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb6d41603b0 0x7fb6d40b0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:51.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.623+0000 7fb6da39b700 1 -- 172.21.15.37:0/2708871216 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6cc009a70 con 0x7fb6d40d1140 2023-07-14T15:57:51.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.623+0000 7fb6da39b700 1 --2- 172.21.15.37:0/2708871216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6d40d1140 0x7fb6d40c66e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb6d000c700 tx=0x7fb6d000cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:51.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.623+0000 7fb6caffd700 1 -- 172.21.15.37:0/2708871216 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d0005d70 con 0x7fb6d40d1140 2023-07-14T15:57:51.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.623+0000 7fb6caffd700 1 -- 172.21.15.37:0/2708871216 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6d00070d0 con 0x7fb6d40d1140 2023-07-14T15:57:51.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.623+0000 7fb6dc5ff700 1 -- 172.21.15.37:0/2708871216 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6c40094a0 con 0x7fb6d40d1140 2023-07-14T15:57:51.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.623+0000 7fb6caffd700 1 -- 172.21.15.37:0/2708871216 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d0007460 con 0x7fb6d40d1140 2023-07-14T15:57:51.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.623+0000 7fb6dc5ff700 1 -- 172.21.15.37:0/2708871216 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6d40c8480 con 0x7fb6d40d1140 2023-07-14T15:57:51.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.625+0000 7fb6dc5ff700 1 -- 172.21.15.37:0/2708871216 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6d4067840 con 0x7fb6d40d1140 2023-07-14T15:57:51.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.625+0000 7fb6caffd700 1 -- 172.21.15.37:0/2708871216 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7fb6d00075c0 con 0x7fb6d40d1140 2023-07-14T15:57:51.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.626+0000 7fb6caffd700 1 --2- 172.21.15.37:0/2708871216 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb6b806ad70 0x7fb6b806d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:51.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.626+0000 7fb6caffd700 1 -- 172.21.15.37:0/2708871216 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fb6d0088c20 con 0x7fb6d40d1140 2023-07-14T15:57:51.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.627+0000 7fb6d9b9a700 1 --2- 172.21.15.37:0/2708871216 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb6b806ad70 0x7fb6b806d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:51.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.627+0000 7fb6d9b9a700 1 --2- 172.21.15.37:0/2708871216 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb6b806ad70 0x7fb6b806d220 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb6d40d1530 tx=0x7fb6c401c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:51.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.630+0000 7fb6caffd700 1 -- 172.21.15.37:0/2708871216 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb6d0053bb0 con 0x7fb6d40d1140 2023-07-14T15:57:51.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.841+0000 7fb6dc5ff700 1 -- 172.21.15.37:0/2708871216 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb6d40d1840 con 0x7fb6d40d1140 2023-07-14T15:57:51.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.841+0000 7fb6caffd700 1 -- 172.21.15.37:0/2708871216 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb6d00571d0 con 0x7fb6d40d1140 2023-07-14T15:57:51.827 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-14T15:57:51.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.843+0000 7fb6dc5ff700 1 -- 172.21.15.37:0/2708871216 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb6b806ad70 msgr2=0x7fb6b806d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:51.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.843+0000 7fb6dc5ff700 1 --2- 172.21.15.37:0/2708871216 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb6b806ad70 0x7fb6b806d220 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb6d40d1530 tx=0x7fb6c401c040 comp rx=0 tx=0).stop 2023-07-14T15:57:51.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.844+0000 7fb6dc5ff700 1 -- 172.21.15.37:0/2708871216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6d40d1140 msgr2=0x7fb6d40c66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:51.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.844+0000 7fb6dc5ff700 1 --2- 172.21.15.37:0/2708871216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6d40d1140 0x7fb6d40c66e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb6d000c700 tx=0x7fb6d000cac0 comp rx=0 tx=0).stop 2023-07-14T15:57:51.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.844+0000 7fb6dc5ff700 1 -- 172.21.15.37:0/2708871216 shutdown_connections 2023-07-14T15:57:51.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.844+0000 7fb6dc5ff700 1 --2- 172.21.15.37:0/2708871216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb6d41603b0 0x7fb6d40b0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:51.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.844+0000 7fb6dc5ff700 1 --2- 172.21.15.37:0/2708871216 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb6b806ad70 0x7fb6b806d220 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:51.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.844+0000 7fb6dc5ff700 1 --2- 172.21.15.37:0/2708871216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6d40d1140 0x7fb6d40c66e0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:51.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.844+0000 7fb6dc5ff700 1 --2- 172.21.15.37:0/2708871216 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb6d415fee0 0x7fb6d40c6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:51.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.844+0000 7fb6dc5ff700 1 -- 172.21.15.37:0/2708871216 >> 172.21.15.37:0/2708871216 conn(0x7fb6d409c1b0 msgr2=0x7fb6d406a690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:51.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.844+0000 7fb6dc5ff700 1 -- 172.21.15.37:0/2708871216 shutdown_connections 2023-07-14T15:57:51.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:51.844+0000 7fb6dc5ff700 1 -- 172.21.15.37:0/2708871216 wait complete. 2023-07-14T15:57:51.847 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T15:57:52.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.067+0000 7f2bfefff700 1 Processor -- start 2023-07-14T15:57:52.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.067+0000 7f2bfefff700 1 -- start start 2023-07-14T15:57:52.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.068+0000 7f2bfefff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2bf80cfd50 0x7f2bf80d2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:52.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.068+0000 7f2bfefff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f2bf80b1e80 0x7f2bf80b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:52.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.068+0000 7f2bfefff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2bf80b3290 0x7f2bf80b36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:52.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.068+0000 7f2bfefff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bf815ccf0 con 0x7f2bf80b3290 2023-07-14T15:57:52.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.068+0000 7f2bfefff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bf80b1840 con 0x7f2bf80b1e80 2023-07-14T15:57:52.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.068+0000 7f2bfefff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf80b2550 con 0x7f2bf80cfd50 2023-07-14T15:57:52.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.068+0000 7f2bfd59c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2bf80b3290 0x7f2bf80b36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:52.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.068+0000 7f2bfd59c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2bf80b3290 0x7f2bf80b36d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44798/0 (socket says 172.21.15.37:44798) 2023-07-14T15:57:52.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.068+0000 7f2bfd59c700 1 -- 172.21.15.37:0/3802770306 learned_addr learned my addr 172.21.15.37:0/3802770306 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:52.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.068+0000 7f2bfcd9b700 1 --2- 172.21.15.37:0/3802770306 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2bf80cfd50 0x7f2bf80d2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:52.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.069+0000 7f2bf7fff700 1 --2- 172.21.15.37:0/3802770306 >> v2:172.21.15.98:3300/0 conn(0x7f2bf80b1e80 0x7f2bf80b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:52.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.069+0000 7f2bfd59c700 1 -- 172.21.15.37:0/3802770306 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2bf80cfd50 msgr2=0x7f2bf80d2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:52.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.069+0000 7f2bfd59c700 1 --2- 172.21.15.37:0/3802770306 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2bf80cfd50 0x7f2bf80d2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:52.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.069+0000 7f2bfd59c700 1 -- 172.21.15.37:0/3802770306 >> v2:172.21.15.98:3300/0 conn(0x7f2bf80b1e80 msgr2=0x7f2bf80b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:52.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.069+0000 7f2bfd59c700 1 --2- 172.21.15.37:0/3802770306 >> v2:172.21.15.98:3300/0 conn(0x7f2bf80b1e80 0x7f2bf80b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:52.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.069+0000 7f2bfd59c700 1 -- 172.21.15.37:0/3802770306 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf80b2830 con 0x7f2bf80b3290 2023-07-14T15:57:52.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.069+0000 7f2bf7fff700 1 --2- 172.21.15.37:0/3802770306 >> v2:172.21.15.98:3300/0 conn(0x7f2bf80b1e80 0x7f2bf80b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:57:52.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.069+0000 7f2bfd59c700 1 --2- 172.21.15.37:0/3802770306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2bf80b3290 0x7f2bf80b36d0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0009e50 tx=0x7f2bf000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fc6987def7142ba server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:52.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.069+0000 7f2bf77fe700 1 -- 172.21.15.37:0/3802770306 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf000e070 con 0x7f2bf80b3290 2023-07-14T15:57:52.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.069+0000 7f2bf77fe700 1 -- 172.21.15.37:0/3802770306 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf000b980 con 0x7f2bf80b3290 2023-07-14T15:57:52.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.069+0000 7f2bf77fe700 1 -- 172.21.15.37:0/3802770306 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf000bd30 con 0x7f2bf80b3290 2023-07-14T15:57:52.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.070+0000 7f2bfefff700 1 -- 172.21.15.37:0/3802770306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2bf80b3290 msgr2=0x7f2bf80b36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:52.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.070+0000 7f2bfefff700 1 --2- 172.21.15.37:0/3802770306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2bf80b3290 0x7f2bf80b36d0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0009e50 tx=0x7f2bf000b330 comp rx=0 tx=0).stop 2023-07-14T15:57:52.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.070+0000 7f2bfefff700 1 -- 172.21.15.37:0/3802770306 shutdown_connections 2023-07-14T15:57:52.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.070+0000 7f2bfefff700 1 --2- 172.21.15.37:0/3802770306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2bf80b3290 0x7f2bf80b36d0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:52.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.070+0000 7f2bfefff700 1 --2- 172.21.15.37:0/3802770306 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2bf80cfd50 0x7f2bf80d2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:52.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.070+0000 7f2bfefff700 1 --2- 172.21.15.37:0/3802770306 >> v2:172.21.15.98:3300/0 conn(0x7f2bf80b1e80 0x7f2bf80b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:52.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.070+0000 7f2bfefff700 1 -- 172.21.15.37:0/3802770306 >> 172.21.15.37:0/3802770306 conn(0x7f2bf809c1c0 msgr2=0x7f2bf80d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:52.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.070+0000 7f2bfefff700 1 -- 172.21.15.37:0/3802770306 shutdown_connections 2023-07-14T15:57:52.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.070+0000 7f2bfefff700 1 -- 172.21.15.37:0/3802770306 wait complete. 2023-07-14T15:57:52.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.072+0000 7f2bfefff700 1 Processor -- start 2023-07-14T15:57:52.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.072+0000 7f2bfefff700 1 -- start start 2023-07-14T15:57:52.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.073+0000 7f2bfefff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2bf80b1e80 0x7f2bf8158380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:52.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.073+0000 7f2bfefff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2bf80b3290 0x7f2bf8159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:52.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.073+0000 7f2bfefff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2bf80cfd50 0x7f2bf81e5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:52.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.073+0000 7f2bfefff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf80c6a90 con 0x7f2bf80b1e80 2023-07-14T15:57:52.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.073+0000 7f2bfefff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf80c6d70 con 0x7f2bf80b3290 2023-07-14T15:57:52.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.073+0000 7f2bfefff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf80c7050 con 0x7f2bf80cfd50 2023-07-14T15:57:52.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.073+0000 7f2bfcd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2bf80b1e80 0x7f2bf8158380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:52.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.073+0000 7f2bfcd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2bf80b1e80 0x7f2bf8158380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44806/0 (socket says 172.21.15.37:44806) 2023-07-14T15:57:52.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.073+0000 7f2bfcd9b700 1 -- 172.21.15.37:0/4267429158 learned_addr learned my addr 172.21.15.37:0/4267429158 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:52.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.074+0000 7f2bf7fff700 1 --2- 172.21.15.37:0/4267429158 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2bf80b3290 0x7f2bf8159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:52.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.074+0000 7f2bfd59c700 1 --2- 172.21.15.37:0/4267429158 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2bf80cfd50 0x7f2bf81e5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:52.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.074+0000 7f2bfcd9b700 1 -- 172.21.15.37:0/4267429158 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2bf80cfd50 msgr2=0x7f2bf81e5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:52.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.074+0000 7f2bfcd9b700 1 --2- 172.21.15.37:0/4267429158 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2bf80cfd50 0x7f2bf81e5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:52.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.074+0000 7f2bfcd9b700 1 -- 172.21.15.37:0/4267429158 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2bf80b3290 msgr2=0x7f2bf8159cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:52.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.074+0000 7f2bfcd9b700 1 --2- 172.21.15.37:0/4267429158 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2bf80b3290 0x7f2bf8159cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:52.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.074+0000 7f2bfcd9b700 1 -- 172.21.15.37:0/4267429158 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf0009b30 con 0x7f2bf80b1e80 2023-07-14T15:57:52.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.074+0000 7f2bfcd9b700 1 --2- 172.21.15.37:0/4267429158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2bf80b1e80 0x7f2bf8158380 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2bec00d800 tx=0x7f2bec00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:52.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.074+0000 7f2bf57fa700 1 -- 172.21.15.37:0/4267429158 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec0125f0 con 0x7f2bf80b1e80 2023-07-14T15:57:52.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.074+0000 7f2bf57fa700 1 -- 172.21.15.37:0/4267429158 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bec012750 con 0x7f2bf80b1e80 2023-07-14T15:57:52.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.074+0000 7f2bfefff700 1 -- 172.21.15.37:0/4267429158 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bf80d02a0 con 0x7f2bf80b1e80 2023-07-14T15:57:52.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.074+0000 7f2bf57fa700 1 -- 172.21.15.37:0/4267429158 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec012b00 con 0x7f2bf80b1e80 2023-07-14T15:57:52.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.075+0000 7f2bfefff700 1 -- 172.21.15.37:0/4267429158 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bf80c7610 con 0x7f2bf80b1e80 2023-07-14T15:57:52.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.076+0000 7f2bfefff700 1 -- 172.21.15.37:0/4267429158 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bf8065fa0 con 0x7f2bf80b1e80 2023-07-14T15:57:52.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.077+0000 7f2bf57fa700 1 -- 172.21.15.37:0/4267429158 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f2bec012c60 con 0x7f2bf80b1e80 2023-07-14T15:57:52.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.078+0000 7f2bf57fa700 1 --2- 172.21.15.37:0/4267429158 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f2bdc06ada0 0x7f2bdc06d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:52.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.078+0000 7f2bf57fa700 1 -- 172.21.15.37:0/4267429158 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f2bec0898b0 con 0x7f2bf80b1e80 2023-07-14T15:57:52.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.079+0000 7f2bf7fff700 1 --2- 172.21.15.37:0/4267429158 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f2bdc06ada0 0x7f2bdc06d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:52.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.079+0000 7f2bf7fff700 1 --2- 172.21.15.37:0/4267429158 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f2bdc06ada0 0x7f2bdc06d250 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2bf81e68a0 tx=0x7f2be4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:52.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.082+0000 7f2bf57fa700 1 -- 172.21.15.37:0/4267429158 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2bec0548c0 con 0x7f2bf80b1e80 2023-07-14T15:57:52.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.288+0000 7f2bfefff700 1 -- 172.21.15.37:0/4267429158 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2bf806c570 con 0x7f2bf80b1e80 2023-07-14T15:57:52.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.288+0000 7f2bf57fa700 1 -- 172.21.15.37:0/4267429158 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v38) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2bec057ee0 con 0x7f2bf80b1e80 2023-07-14T15:57:52.274 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-14T15:57:52.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.291+0000 7f2bfefff700 1 -- 172.21.15.37:0/4267429158 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f2bdc06ada0 msgr2=0x7f2bdc06d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:52.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.291+0000 7f2bfefff700 1 --2- 172.21.15.37:0/4267429158 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f2bdc06ada0 0x7f2bdc06d250 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2bf81e68a0 tx=0x7f2be4008040 comp rx=0 tx=0).stop 2023-07-14T15:57:52.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.291+0000 7f2bfefff700 1 -- 172.21.15.37:0/4267429158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2bf80b1e80 msgr2=0x7f2bf8158380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:52.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.291+0000 7f2bfefff700 1 --2- 172.21.15.37:0/4267429158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2bf80b1e80 0x7f2bf8158380 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2bec00d800 tx=0x7f2bec00dbc0 comp rx=0 tx=0).stop 2023-07-14T15:57:52.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.291+0000 7f2bfefff700 1 -- 172.21.15.37:0/4267429158 shutdown_connections 2023-07-14T15:57:52.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.291+0000 7f2bfefff700 1 --2- 172.21.15.37:0/4267429158 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f2bdc06ada0 0x7f2bdc06d250 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:52.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.291+0000 7f2bfefff700 1 --2- 172.21.15.37:0/4267429158 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2bf80cfd50 0x7f2bf81e5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:52.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.291+0000 7f2bfefff700 1 --2- 172.21.15.37:0/4267429158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2bf80b1e80 0x7f2bf8158380 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:52.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.291+0000 7f2bfefff700 1 --2- 172.21.15.37:0/4267429158 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2bf80b3290 0x7f2bf8159cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:52.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.291+0000 7f2bfefff700 1 -- 172.21.15.37:0/4267429158 >> 172.21.15.37:0/4267429158 conn(0x7f2bf809c1c0 msgr2=0x7f2bf806aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:52.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.291+0000 7f2bfefff700 1 -- 172.21.15.37:0/4267429158 shutdown_connections 2023-07-14T15:57:52.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.291+0000 7f2bfefff700 1 -- 172.21.15.37:0/4267429158 wait complete. 2023-07-14T15:57:52.295 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T15:57:52.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.514+0000 7f0ddedff700 1 Processor -- start 2023-07-14T15:57:52.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.514+0000 7f0ddedff700 1 -- start start 2023-07-14T15:57:52.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.515+0000 7f0ddedff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f0dd80d1140 0x7f0dd815ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:52.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.515+0000 7f0ddedff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0dd81603b0 0x7f0dd80b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:52.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.515+0000 7f0ddedff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dd815dc50 con 0x7f0dd815fee0 2023-07-14T15:57:52.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.515+0000 7f0ddedff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dd80b2940 con 0x7f0dd81603b0 2023-07-14T15:57:52.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.515+0000 7f0ddedff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dd80b2c20 con 0x7f0dd80d1140 2023-07-14T15:57:52.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.516+0000 7f0ddcb9b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0dd815fee0 0x7f0dd80d0a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34422/0 (socket says 172.21.15.37:34422) 2023-07-14T15:57:52.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.516+0000 7f0ddcb9b700 1 -- 172.21.15.37:0/3591805407 learned_addr learned my addr 172.21.15.37:0/3591805407 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:52.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.516+0000 7f0ddd39c700 1 --2- 172.21.15.37:0/3591805407 >> v2:172.21.15.37:3300/0 conn(0x7f0dd81603b0 0x7f0dd80b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:52.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.516+0000 7f0dd7fff700 1 --2- 172.21.15.37:0/3591805407 >> v2:172.21.15.98:3300/0 conn(0x7f0dd80d1140 0x7f0dd815ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:52.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.516+0000 7f0dd77fe700 1 -- 172.21.15.37:0/3591805407 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 328712613 0 0) 0x7f0dd815dc50 con 0x7f0dd815fee0 2023-07-14T15:57:52.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.516+0000 7f0dd77fe700 1 -- 172.21.15.37:0/3591805407 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0dc80035b0 con 0x7f0dd815fee0 2023-07-14T15:57:52.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.516+0000 7f0ddd39c700 1 -- 172.21.15.37:0/3591805407 >> v2:172.21.15.98:3300/0 conn(0x7f0dd80d1140 msgr2=0x7f0dd815ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:52.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.516+0000 7f0ddd39c700 1 --2- 172.21.15.37:0/3591805407 >> v2:172.21.15.98:3300/0 conn(0x7f0dd80d1140 0x7f0dd815ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:52.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.516+0000 7f0ddd39c700 1 -- 172.21.15.37:0/3591805407 >> v1:172.21.15.37:6789/0 conn(0x7f0dd815fee0 legacy=0x7f0dd80d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:52.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.516+0000 7f0ddd39c700 1 -- 172.21.15.37:0/3591805407 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd80b2f00 con 0x7f0dd81603b0 2023-07-14T15:57:52.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.516+0000 7f0ddd39c700 1 --2- 172.21.15.37:0/3591805407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dd81603b0 0x7f0dd80b39e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f0dd809c850 tx=0x7f0dd000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adcf2e6a42a6681d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:52.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.517+0000 7f0dd77fe700 1 -- 172.21.15.37:0/3591805407 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd000e070 con 0x7f0dd81603b0 2023-07-14T15:57:52.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.517+0000 7f0dd77fe700 1 -- 172.21.15.37:0/3591805407 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd000bb20 con 0x7f0dd81603b0 2023-07-14T15:57:52.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.517+0000 7f0dd77fe700 1 -- 172.21.15.37:0/3591805407 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd0012430 con 0x7f0dd81603b0 2023-07-14T15:57:52.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.517+0000 7f0ddedff700 1 -- 172.21.15.37:0/3591805407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dd81603b0 msgr2=0x7f0dd80b39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:52.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.517+0000 7f0ddedff700 1 --2- 172.21.15.37:0/3591805407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dd81603b0 0x7f0dd80b39e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f0dd809c850 tx=0x7f0dd000b330 comp rx=0 tx=0).stop 2023-07-14T15:57:52.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.517+0000 7f0ddedff700 1 -- 172.21.15.37:0/3591805407 shutdown_connections 2023-07-14T15:57:52.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.517+0000 7f0ddedff700 1 --2- 172.21.15.37:0/3591805407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dd81603b0 0x7f0dd80b39e0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:52.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.517+0000 7f0ddedff700 1 --2- 172.21.15.37:0/3591805407 >> v2:172.21.15.98:3300/0 conn(0x7f0dd80d1140 0x7f0dd815ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:52.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.517+0000 7f0ddedff700 1 -- 172.21.15.37:0/3591805407 >> 172.21.15.37:0/3591805407 conn(0x7f0dd809c1b0 msgr2=0x7f0dd80d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:52.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.517+0000 7f0ddedff700 1 -- 172.21.15.37:0/3591805407 shutdown_connections 2023-07-14T15:57:52.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.517+0000 7f0ddedff700 1 -- 172.21.15.37:0/3591805407 wait complete. 2023-07-14T15:57:52.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.520+0000 7f0ddedff700 1 Processor -- start 2023-07-14T15:57:52.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.520+0000 7f0ddedff700 1 -- start start 2023-07-14T15:57:52.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.521+0000 7f0ddedff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0dd80d1140 0x7f0dd80b8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:52.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.521+0000 7f0ddedff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0dd815fee0 0x7f0dd80b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:52.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.521+0000 7f0ddedff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dd81603b0 0x7f0dd80b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:52.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.521+0000 7f0ddedff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd809e630 con 0x7f0dd81603b0 2023-07-14T15:57:52.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.521+0000 7f0ddedff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd809da20 con 0x7f0dd815fee0 2023-07-14T15:57:52.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.521+0000 7f0ddedff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd809dd00 con 0x7f0dd80d1140 2023-07-14T15:57:52.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.522+0000 7f0ddd39c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dd81603b0 0x7f0dd80b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:52.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.522+0000 7f0ddd39c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dd81603b0 0x7f0dd80b61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44824/0 (socket says 172.21.15.37:44824) 2023-07-14T15:57:52.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.522+0000 7f0ddd39c700 1 -- 172.21.15.37:0/3186903587 learned_addr learned my addr 172.21.15.37:0/3186903587 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:52.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.522+0000 7f0ddcb9b700 1 --2- 172.21.15.37:0/3186903587 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0dd80d1140 0x7f0dd80b8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:52.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.522+0000 7f0dd7fff700 1 --2- 172.21.15.37:0/3186903587 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0dd815fee0 0x7f0dd80b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:52.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.522+0000 7f0ddd39c700 1 -- 172.21.15.37:0/3186903587 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0dd80d1140 msgr2=0x7f0dd80b8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:52.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.522+0000 7f0ddd39c700 1 --2- 172.21.15.37:0/3186903587 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0dd80d1140 0x7f0dd80b8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:52.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.522+0000 7f0ddd39c700 1 -- 172.21.15.37:0/3186903587 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0dd815fee0 msgr2=0x7f0dd80b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:52.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.522+0000 7f0ddd39c700 1 --2- 172.21.15.37:0/3186903587 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0dd815fee0 0x7f0dd80b5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:52.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.522+0000 7f0ddd39c700 1 -- 172.21.15.37:0/3186903587 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd0009a70 con 0x7f0dd81603b0 2023-07-14T15:57:52.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.522+0000 7f0ddd39c700 1 --2- 172.21.15.37:0/3186903587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dd81603b0 0x7f0dd80b61d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f0dd0014040 tx=0x7f0dd0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:52.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.523+0000 7f0dd57fa700 1 -- 172.21.15.37:0/3186903587 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd0012430 con 0x7f0dd81603b0 2023-07-14T15:57:52.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.523+0000 7f0dd57fa700 1 -- 172.21.15.37:0/3186903587 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd0020070 con 0x7f0dd81603b0 2023-07-14T15:57:52.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.523+0000 7f0dd57fa700 1 -- 172.21.15.37:0/3186903587 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd0004280 con 0x7f0dd81603b0 2023-07-14T15:57:52.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.523+0000 7f0ddedff700 1 -- 172.21.15.37:0/3186903587 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dd809dfe0 con 0x7f0dd81603b0 2023-07-14T15:57:52.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.523+0000 7f0ddedff700 1 -- 172.21.15.37:0/3186903587 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dd80b8a80 con 0x7f0dd81603b0 2023-07-14T15:57:52.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.524+0000 7f0ddedff700 1 -- 172.21.15.37:0/3186903587 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dd8067840 con 0x7f0dd81603b0 2023-07-14T15:57:52.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.525+0000 7f0dd57fa700 1 -- 172.21.15.37:0/3186903587 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f0dd00043e0 con 0x7f0dd81603b0 2023-07-14T15:57:52.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.527+0000 7f0dd57fa700 1 --2- 172.21.15.37:0/3186903587 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0dbc06ad70 0x7f0dbc06d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:52.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.527+0000 7f0dd57fa700 1 -- 172.21.15.37:0/3186903587 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f0dd0022070 con 0x7f0dd81603b0 2023-07-14T15:57:52.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.527+0000 7f0ddcb9b700 1 --2- 172.21.15.37:0/3186903587 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0dbc06ad70 0x7f0dbc06d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:52.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.528+0000 7f0ddcb9b700 1 --2- 172.21.15.37:0/3186903587 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0dbc06ad70 0x7f0dbc06d220 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc0011e0 tx=0x7f0dcc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:52.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.531+0000 7f0dd57fa700 1 -- 172.21.15.37:0/3186903587 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0dd00562a0 con 0x7f0dd81603b0 2023-07-14T15:57:52.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.736+0000 7f0ddedff700 1 -- 172.21.15.37:0/3186903587 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0dd80d0af0 con 0x7f0dd81603b0 2023-07-14T15:57:52.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.736+0000 7f0dd57fa700 1 -- 172.21.15.37:0/3186903587 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v38) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0dd00598c0 con 0x7f0dd81603b0 2023-07-14T15:57:52.721 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-14T15:57:52.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.738+0000 7f0ddedff700 1 -- 172.21.15.37:0/3186903587 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0dbc06ad70 msgr2=0x7f0dbc06d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:52.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.738+0000 7f0ddedff700 1 --2- 172.21.15.37:0/3186903587 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0dbc06ad70 0x7f0dbc06d220 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc0011e0 tx=0x7f0dcc009040 comp rx=0 tx=0).stop 2023-07-14T15:57:52.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.738+0000 7f0ddedff700 1 -- 172.21.15.37:0/3186903587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dd81603b0 msgr2=0x7f0dd80b61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:52.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.738+0000 7f0ddedff700 1 --2- 172.21.15.37:0/3186903587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dd81603b0 0x7f0dd80b61d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f0dd0014040 tx=0x7f0dd0004ad0 comp rx=0 tx=0).stop 2023-07-14T15:57:52.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.738+0000 7f0ddedff700 1 -- 172.21.15.37:0/3186903587 shutdown_connections 2023-07-14T15:57:52.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.738+0000 7f0ddedff700 1 --2- 172.21.15.37:0/3186903587 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0dbc06ad70 0x7f0dbc06d220 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:52.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.738+0000 7f0ddedff700 1 --2- 172.21.15.37:0/3186903587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dd81603b0 0x7f0dd80b61d0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:52.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.738+0000 7f0ddedff700 1 --2- 172.21.15.37:0/3186903587 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0dd80d1140 0x7f0dd80b8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:52.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.738+0000 7f0ddedff700 1 --2- 172.21.15.37:0/3186903587 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0dd815fee0 0x7f0dd80b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:52.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.738+0000 7f0ddedff700 1 -- 172.21.15.37:0/3186903587 >> 172.21.15.37:0/3186903587 conn(0x7f0dd809c1b0 msgr2=0x7f0dd80d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:52.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.738+0000 7f0ddedff700 1 -- 172.21.15.37:0/3186903587 shutdown_connections 2023-07-14T15:57:52.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.738+0000 7f0ddedff700 1 -- 172.21.15.37:0/3186903587 wait complete. 2023-07-14T15:57:52.741 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T15:57:52.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.961+0000 7f53263ff700 1 Processor -- start 2023-07-14T15:57:52.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.961+0000 7f53263ff700 1 -- start start 2023-07-14T15:57:52.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.962+0000 7f53263ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5320071820 0x7f532006cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:52.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.962+0000 7f53263ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f532006d0c0 0x7f53200c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:52.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.962+0000 7f53263ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53200707f0 con 0x7f53200cb430 2023-07-14T15:57:52.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.962+0000 7f53263ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5320070a60 con 0x7f532006d0c0 2023-07-14T15:57:52.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.962+0000 7f53263ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5320070d40 con 0x7f5320071820 2023-07-14T15:57:52.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.963+0000 7f532499c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f532006d0c0 0x7f53200c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:52.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.963+0000 7f531f7fe700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5320071820 0x7f532006cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:52.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.963+0000 7f531ffff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f53200cb430 0x7f53200cb800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.37:57986/0 (socket says 172.21.15.37:57986) 2023-07-14T15:57:52.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.963+0000 7f531ffff700 1 -- 172.21.15.37:0/3933398176 learned_addr learned my addr 172.21.15.37:0/3933398176 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:52.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.963+0000 7f532499c700 1 -- 172.21.15.37:0/3933398176 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5320071820 msgr2=0x7f532006cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:52.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.963+0000 7f532499c700 1 --2- 172.21.15.37:0/3933398176 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5320071820 0x7f532006cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:52.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.963+0000 7f532499c700 1 -- 172.21.15.37:0/3933398176 >> v1:172.21.15.98:6789/0 conn(0x7f53200cb430 legacy=0x7f53200cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:52.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.963+0000 7f532499c700 1 -- 172.21.15.37:0/3933398176 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5320071020 con 0x7f532006d0c0 2023-07-14T15:57:52.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.964+0000 7f532499c700 1 --2- 172.21.15.37:0/3933398176 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f532006d0c0 0x7f53200c90d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5318009d90 tx=0x7f531800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c367d5fe9e9b286 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:52.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.964+0000 7f531effd700 1 -- 172.21.15.37:0/3933398176 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531800e070 con 0x7f532006d0c0 2023-07-14T15:57:52.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.964+0000 7f531effd700 1 -- 172.21.15.37:0/3933398176 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f531800bb20 con 0x7f532006d0c0 2023-07-14T15:57:52.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.964+0000 7f531effd700 1 -- 172.21.15.37:0/3933398176 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5318012430 con 0x7f532006d0c0 2023-07-14T15:57:52.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.964+0000 7f53263ff700 1 -- 172.21.15.37:0/3933398176 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f532006d0c0 msgr2=0x7f53200c90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:52.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.964+0000 7f53263ff700 1 --2- 172.21.15.37:0/3933398176 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f532006d0c0 0x7f53200c90d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5318009d90 tx=0x7f531800b330 comp rx=0 tx=0).stop 2023-07-14T15:57:52.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.964+0000 7f53263ff700 1 -- 172.21.15.37:0/3933398176 shutdown_connections 2023-07-14T15:57:52.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.964+0000 7f53263ff700 1 --2- 172.21.15.37:0/3933398176 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f532006d0c0 0x7f53200c90d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:52.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.964+0000 7f53263ff700 1 --2- 172.21.15.37:0/3933398176 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5320071820 0x7f532006cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:52.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.964+0000 7f53263ff700 1 -- 172.21.15.37:0/3933398176 >> 172.21.15.37:0/3933398176 conn(0x7f532006aac0 msgr2=0x7f53200b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:52.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.965+0000 7f53263ff700 1 -- 172.21.15.37:0/3933398176 shutdown_connections 2023-07-14T15:57:52.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.965+0000 7f53263ff700 1 -- 172.21.15.37:0/3933398176 wait complete. 2023-07-14T15:57:52.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.966+0000 7f53263ff700 1 Processor -- start 2023-07-14T15:57:52.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.966+0000 7f53263ff700 1 -- start start 2023-07-14T15:57:52.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.967+0000 7f53263ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f532006d0c0 0x7f532014ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:52.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.967+0000 7f53263ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5320071820 0x7f532014df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:52.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.967+0000 7f53263ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f53200cb430 0x7f53200ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:52.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.967+0000 7f53263ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53200cd960 con 0x7f5320071820 2023-07-14T15:57:52.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.967+0000 7f53263ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53200cc340 con 0x7f532006d0c0 2023-07-14T15:57:52.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.967+0000 7f53263ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53200cd680 con 0x7f53200cb430 2023-07-14T15:57:52.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.968+0000 7f531f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5320071820 0x7f532014df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:52.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.968+0000 7f531f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5320071820 0x7f532014df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44838/0 (socket says 172.21.15.37:44838) 2023-07-14T15:57:52.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.968+0000 7f531f7fe700 1 -- 172.21.15.37:0/1023015090 learned_addr learned my addr 172.21.15.37:0/1023015090 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:52.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.968+0000 7f531ffff700 1 --2- 172.21.15.37:0/1023015090 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f532006d0c0 0x7f532014ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:52.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.968+0000 7f532499c700 1 --2- 172.21.15.37:0/1023015090 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f53200cb430 0x7f53200ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:52.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.968+0000 7f531f7fe700 1 -- 172.21.15.37:0/1023015090 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f53200cb430 msgr2=0x7f53200ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:52.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.968+0000 7f531f7fe700 1 --2- 172.21.15.37:0/1023015090 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f53200cb430 0x7f53200ccaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:52.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.968+0000 7f531f7fe700 1 -- 172.21.15.37:0/1023015090 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f532006d0c0 msgr2=0x7f532014ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:52.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.968+0000 7f531f7fe700 1 --2- 172.21.15.37:0/1023015090 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f532006d0c0 0x7f532014ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:52.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.968+0000 7f531f7fe700 1 -- 172.21.15.37:0/1023015090 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5318009a70 con 0x7f5320071820 2023-07-14T15:57:52.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.968+0000 7f532499c700 1 --2- 172.21.15.37:0/1023015090 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f53200cb430 0x7f53200ccaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:57:52.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.968+0000 7f531f7fe700 1 --2- 172.21.15.37:0/1023015090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5320071820 0x7f532014df10 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f531400e980 tx=0x7f531400ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:52.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.968+0000 7f531cff9700 1 -- 172.21.15.37:0/1023015090 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5314009710 con 0x7f5320071820 2023-07-14T15:57:52.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.969+0000 7f531cff9700 1 -- 172.21.15.37:0/1023015090 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f531400eed0 con 0x7f5320071820 2023-07-14T15:57:52.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.969+0000 7f531cff9700 1 -- 172.21.15.37:0/1023015090 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531400ca90 con 0x7f5320071820 2023-07-14T15:57:52.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.969+0000 7f53263ff700 1 -- 172.21.15.37:0/1023015090 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5320155920 con 0x7f5320071820 2023-07-14T15:57:52.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.969+0000 7f53263ff700 1 -- 172.21.15.37:0/1023015090 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5320155ee0 con 0x7f5320071820 2023-07-14T15:57:52.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.970+0000 7f53263ff700 1 -- 172.21.15.37:0/1023015090 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53201560a0 con 0x7f5320071820 2023-07-14T15:57:52.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.971+0000 7f531cff9700 1 -- 172.21.15.37:0/1023015090 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f531400cbf0 con 0x7f5320071820 2023-07-14T15:57:52.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.971+0000 7f531cff9700 1 --2- 172.21.15.37:0/1023015090 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f530c06ad70 0x7f530c06d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:52.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.972+0000 7f531cff9700 1 -- 172.21.15.37:0/1023015090 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f5314089550 con 0x7f5320071820 2023-07-14T15:57:52.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.972+0000 7f531ffff700 1 --2- 172.21.15.37:0/1023015090 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f530c06ad70 0x7f530c06d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:52.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.973+0000 7f531ffff700 1 --2- 172.21.15.37:0/1023015090 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f530c06ad70 0x7f530c06d220 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5310000f60 tx=0x7f5310007f10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:52.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:52.976+0000 7f531cff9700 1 -- 172.21.15.37:0/1023015090 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5314054560 con 0x7f5320071820 2023-07-14T15:57:53.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.186+0000 7f53263ff700 1 -- 172.21.15.37:0/1023015090 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f53200ca640 con 0x7f5320071820 2023-07-14T15:57:53.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.186+0000 7f531cff9700 1 -- 172.21.15.37:0/1023015090 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v38) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5314057b80 con 0x7f5320071820 2023-07-14T15:57:53.172 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-14T15:57:53.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.188+0000 7f53263ff700 1 -- 172.21.15.37:0/1023015090 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f530c06ad70 msgr2=0x7f530c06d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:53.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.188+0000 7f53263ff700 1 --2- 172.21.15.37:0/1023015090 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f530c06ad70 0x7f530c06d220 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5310000f60 tx=0x7f5310007f10 comp rx=0 tx=0).stop 2023-07-14T15:57:53.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.188+0000 7f53263ff700 1 -- 172.21.15.37:0/1023015090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5320071820 msgr2=0x7f532014df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:53.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.188+0000 7f53263ff700 1 --2- 172.21.15.37:0/1023015090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5320071820 0x7f532014df10 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f531400e980 tx=0x7f531400ec90 comp rx=0 tx=0).stop 2023-07-14T15:57:53.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.189+0000 7f53263ff700 1 -- 172.21.15.37:0/1023015090 shutdown_connections 2023-07-14T15:57:53.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.189+0000 7f53263ff700 1 --2- 172.21.15.37:0/1023015090 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f532006d0c0 0x7f532014ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:53.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.189+0000 7f53263ff700 1 --2- 172.21.15.37:0/1023015090 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f530c06ad70 0x7f530c06d220 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:53.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.189+0000 7f53263ff700 1 --2- 172.21.15.37:0/1023015090 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f53200cb430 0x7f53200ccaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:53.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.189+0000 7f53263ff700 1 --2- 172.21.15.37:0/1023015090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5320071820 0x7f532014df10 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:53.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.189+0000 7f53263ff700 1 -- 172.21.15.37:0/1023015090 >> 172.21.15.37:0/1023015090 conn(0x7f532006aac0 msgr2=0x7f53200c9100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:53.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.189+0000 7f53263ff700 1 -- 172.21.15.37:0/1023015090 shutdown_connections 2023-07-14T15:57:53.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.189+0000 7f53263ff700 1 -- 172.21.15.37:0/1023015090 wait complete. 2023-07-14T15:57:53.192 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T15:57:53.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.410+0000 7f75f09ff700 1 Processor -- start 2023-07-14T15:57:53.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.410+0000 7f75f09ff700 1 -- start start 2023-07-14T15:57:53.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.411+0000 7f75f09ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f75ec0b54b0 0x7f75ec0cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:53.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.411+0000 7f75f09ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75ec0cf6b0 con 0x7f75ec0b85f0 2023-07-14T15:57:53.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.411+0000 7f75f09ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75ec0cdc40 con 0x7f75ec0b4910 2023-07-14T15:57:53.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.411+0000 7f75f09ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75ec0cf0a0 con 0x7f75ec0b54b0 2023-07-14T15:57:53.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.411+0000 7f75ea59c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f75ec0b85f0 0x7f75ec15d660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34424/0 (socket says 172.21.15.37:34424) 2023-07-14T15:57:53.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.411+0000 7f75ea59c700 1 -- 172.21.15.37:0/2923341015 learned_addr learned my addr 172.21.15.37:0/2923341015 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:53.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.412+0000 7f75e3fff700 1 --2- 172.21.15.37:0/2923341015 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f75ec0b54b0 0x7f75ec0cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:53.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.412+0000 7f75e9d9b700 1 -- 172.21.15.37:0/2923341015 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1308070485 0 0) 0x7f75ec0cf6b0 con 0x7f75ec0b85f0 2023-07-14T15:57:53.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.412+0000 7f75e9d9b700 1 -- 172.21.15.37:0/2923341015 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75d80035b0 con 0x7f75ec0b85f0 2023-07-14T15:57:53.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.412+0000 7f75e9d9b700 1 -- 172.21.15.37:0/2923341015 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1139095536 0 0) 0x7f75ec0cdc40 con 0x7f75ec0b4910 2023-07-14T15:57:53.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.412+0000 7f75e9d9b700 1 -- 172.21.15.37:0/2923341015 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75ec0cf6b0 con 0x7f75ec0b4910 2023-07-14T15:57:53.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.412+0000 7f75e3fff700 1 -- 172.21.15.37:0/2923341015 >> v1:172.21.15.98:6789/0 conn(0x7f75ec0b4910 legacy=0x7f75ec15dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:53.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.412+0000 7f75e3fff700 1 -- 172.21.15.37:0/2923341015 >> v1:172.21.15.37:6789/0 conn(0x7f75ec0b85f0 legacy=0x7f75ec15d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:53.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.412+0000 7f75e9d9b700 1 -- 172.21.15.37:0/2923341015 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3570865659 0 0) 0x7f75d80035b0 con 0x7f75ec0b85f0 2023-07-14T15:57:53.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.412+0000 7f75e3fff700 1 -- 172.21.15.37:0/2923341015 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75ec0b89c0 con 0x7f75ec0b54b0 2023-07-14T15:57:53.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.412+0000 7f75e3fff700 1 --2- 172.21.15.37:0/2923341015 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f75ec0b54b0 0x7f75ec0cfb40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f75d4009870 tx=0x7f75d4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d101725a27f8273 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:53.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.413+0000 7f75e9d9b700 1 -- 172.21.15.37:0/2923341015 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d4011830 con 0x7f75ec0b54b0 2023-07-14T15:57:53.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.413+0000 7f75e9d9b700 1 -- 172.21.15.37:0/2923341015 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d4011990 con 0x7f75ec0b54b0 2023-07-14T15:57:53.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.413+0000 7f75e9d9b700 1 -- 172.21.15.37:0/2923341015 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d4011d20 con 0x7f75ec0b54b0 2023-07-14T15:57:53.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.413+0000 7f75f09ff700 1 -- 172.21.15.37:0/2923341015 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f75ec0b54b0 msgr2=0x7f75ec0cfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:53.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.413+0000 7f75f09ff700 1 --2- 172.21.15.37:0/2923341015 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f75ec0b54b0 0x7f75ec0cfb40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f75d4009870 tx=0x7f75d4009b80 comp rx=0 tx=0).stop 2023-07-14T15:57:53.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.413+0000 7f75f09ff700 1 -- 172.21.15.37:0/2923341015 shutdown_connections 2023-07-14T15:57:53.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.413+0000 7f75f09ff700 1 --2- 172.21.15.37:0/2923341015 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f75ec0b54b0 0x7f75ec0cfb40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:53.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.413+0000 7f75f09ff700 1 -- 172.21.15.37:0/2923341015 >> 172.21.15.37:0/2923341015 conn(0x7f75ec06a580 msgr2=0x7f75ec06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:53.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.414+0000 7f75f09ff700 1 -- 172.21.15.37:0/2923341015 shutdown_connections 2023-07-14T15:57:53.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.414+0000 7f75f09ff700 1 -- 172.21.15.37:0/2923341015 wait complete. 2023-07-14T15:57:53.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.415+0000 7f75f09ff700 1 Processor -- start 2023-07-14T15:57:53.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.415+0000 7f75f09ff700 1 -- start start 2023-07-14T15:57:53.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.416+0000 7f75f09ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75ec0b4910 0x7f75ec14d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:53.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.416+0000 7f75f09ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f75ec0b54b0 0x7f75ec0c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:53.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.416+0000 7f75f09ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75ec0b85f0 0x7f75ec0c8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:53.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.416+0000 7f75f09ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ec1576b0 con 0x7f75ec0b85f0 2023-07-14T15:57:53.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.416+0000 7f75f09ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ec14d7f0 con 0x7f75ec0b4910 2023-07-14T15:57:53.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.416+0000 7f75f09ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75ec15c030 con 0x7f75ec0b54b0 2023-07-14T15:57:53.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.417+0000 7f75ead9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75ec0b85f0 0x7f75ec0c8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:53.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.417+0000 7f75ead9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75ec0b85f0 0x7f75ec0c8df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44842/0 (socket says 172.21.15.37:44842) 2023-07-14T15:57:53.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.417+0000 7f75ead9d700 1 -- 172.21.15.37:0/2653845718 learned_addr learned my addr 172.21.15.37:0/2653845718 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:53.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.417+0000 7f75ea59c700 1 --2- 172.21.15.37:0/2653845718 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75ec0b4910 0x7f75ec14d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:53.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.417+0000 7f75e3fff700 1 --2- 172.21.15.37:0/2653845718 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f75ec0b54b0 0x7f75ec0c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:53.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.417+0000 7f75ead9d700 1 -- 172.21.15.37:0/2653845718 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f75ec0b54b0 msgr2=0x7f75ec0c88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:53.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.417+0000 7f75ead9d700 1 --2- 172.21.15.37:0/2653845718 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f75ec0b54b0 0x7f75ec0c88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:53.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.417+0000 7f75ead9d700 1 -- 172.21.15.37:0/2653845718 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75ec0b4910 msgr2=0x7f75ec14d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:53.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.417+0000 7f75ead9d700 1 --2- 172.21.15.37:0/2653845718 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75ec0b4910 0x7f75ec14d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:53.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.417+0000 7f75ead9d700 1 -- 172.21.15.37:0/2653845718 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d40094a0 con 0x7f75ec0b85f0 2023-07-14T15:57:53.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.418+0000 7f75ead9d700 1 --2- 172.21.15.37:0/2653845718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75ec0b85f0 0x7f75ec0c8df0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f75e400cc20 tx=0x7f75e400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:53.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.418+0000 7f75e2ffd700 1 -- 172.21.15.37:0/2653845718 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e400ac20 con 0x7f75ec0b85f0 2023-07-14T15:57:53.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.418+0000 7f75e2ffd700 1 -- 172.21.15.37:0/2653845718 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e400ad80 con 0x7f75ec0b85f0 2023-07-14T15:57:53.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.418+0000 7f75e2ffd700 1 -- 172.21.15.37:0/2653845718 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e4003c20 con 0x7f75ec0b85f0 2023-07-14T15:57:53.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.418+0000 7f75f09ff700 1 -- 172.21.15.37:0/2653845718 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75ec15c310 con 0x7f75ec0b85f0 2023-07-14T15:57:53.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.418+0000 7f75f09ff700 1 -- 172.21.15.37:0/2653845718 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75ec15c8d0 con 0x7f75ec0b85f0 2023-07-14T15:57:53.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.419+0000 7f75f09ff700 1 -- 172.21.15.37:0/2653845718 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75ec073760 con 0x7f75ec0b85f0 2023-07-14T15:57:53.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.420+0000 7f75e2ffd700 1 -- 172.21.15.37:0/2653845718 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f75e40050d0 con 0x7f75ec0b85f0 2023-07-14T15:57:53.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.421+0000 7f75e2ffd700 1 --2- 172.21.15.37:0/2653845718 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f75cc06ad70 0x7f75cc06d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:53.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.421+0000 7f75e2ffd700 1 -- 172.21.15.37:0/2653845718 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f75e4089760 con 0x7f75ec0b85f0 2023-07-14T15:57:53.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.421+0000 7f75ea59c700 1 --2- 172.21.15.37:0/2653845718 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f75cc06ad70 0x7f75cc06d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:53.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.422+0000 7f75ea59c700 1 --2- 172.21.15.37:0/2653845718 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f75cc06ad70 0x7f75cc06d220 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f75dc000f60 tx=0x7f75dc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:53.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.425+0000 7f75e2ffd700 1 -- 172.21.15.37:0/2653845718 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f75e40546e0 con 0x7f75ec0b85f0 2023-07-14T15:57:53.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.679+0000 7f75f09ff700 1 -- 172.21.15.37:0/2653845718 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75ec067840 con 0x7f75ec0b85f0 2023-07-14T15:57:53.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.680+0000 7f75e2ffd700 1 -- 172.21.15.37:0/2653845718 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4709 (secure 0 0 0) 0x7f75e4057d00 con 0x7f75ec0b85f0 2023-07-14T15:57:53.665 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:57:53.665 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/1292294727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":1292294727},{"type":"v1","addr":"172.21.15.98:6837","nonce":1292294727}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4811,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1091097806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1091097806},{"type":"v1","addr":"172.21.15.37:6835","nonce":1091097806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5059,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/2838228048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2838228048},{"type":"v1","addr":"172.21.15.98:6836","nonce":2838228048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T15:57:25.446758+0000","modified":"2023-07-14T15:57:28.951927+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5121},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5121":{"gid":5121,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6834/2406398098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2406398098},{"type":"v1","addr":"172.21.15.37:6834","nonce":2406398098}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-14T15:57:53.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.682+0000 7f75f09ff700 1 -- 172.21.15.37:0/2653845718 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f75cc06ad70 msgr2=0x7f75cc06d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:53.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.682+0000 7f75f09ff700 1 --2- 172.21.15.37:0/2653845718 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f75cc06ad70 0x7f75cc06d220 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f75dc000f60 tx=0x7f75dc009040 comp rx=0 tx=0).stop 2023-07-14T15:57:53.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.682+0000 7f75f09ff700 1 -- 172.21.15.37:0/2653845718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75ec0b85f0 msgr2=0x7f75ec0c8df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:53.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.682+0000 7f75f09ff700 1 --2- 172.21.15.37:0/2653845718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75ec0b85f0 0x7f75ec0c8df0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f75e400cc20 tx=0x7f75e400a060 comp rx=0 tx=0).stop 2023-07-14T15:57:53.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.682+0000 7f75f09ff700 1 -- 172.21.15.37:0/2653845718 shutdown_connections 2023-07-14T15:57:53.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.682+0000 7f75f09ff700 1 --2- 172.21.15.37:0/2653845718 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75ec0b4910 0x7f75ec14d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:53.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.682+0000 7f75f09ff700 1 --2- 172.21.15.37:0/2653845718 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f75cc06ad70 0x7f75cc06d220 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:53.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.682+0000 7f75f09ff700 1 --2- 172.21.15.37:0/2653845718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75ec0b85f0 0x7f75ec0c8df0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:53.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.682+0000 7f75f09ff700 1 --2- 172.21.15.37:0/2653845718 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f75ec0b54b0 0x7f75ec0c88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:53.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.682+0000 7f75f09ff700 1 -- 172.21.15.37:0/2653845718 >> 172.21.15.37:0/2653845718 conn(0x7f75ec06a580 msgr2=0x7f75ec0b5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:53.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.682+0000 7f75f09ff700 1 -- 172.21.15.37:0/2653845718 shutdown_connections 2023-07-14T15:57:53.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.682+0000 7f75f09ff700 1 -- 172.21.15.37:0/2653845718 wait complete. 2023-07-14T15:57:53.669 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 17 2023-07-14T15:57:53.686 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T15:57:53.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.902+0000 7f80043ff700 1 Processor -- start 2023-07-14T15:57:53.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.902+0000 7f80043ff700 1 -- start start 2023-07-14T15:57:53.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.903+0000 7f80043ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7ffc0cfda0 0x7f7ffc167580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:53.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.903+0000 7f80043ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ffc0cd540 con 0x7f7ffc0b8650 2023-07-14T15:57:53.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.903+0000 7f80043ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ffc0d0220 con 0x7f7ffc0b24e0 2023-07-14T15:57:53.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.903+0000 7f80043ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ffc160f70 con 0x7f7ffc0cfda0 2023-07-14T15:57:53.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.903+0000 7f800219b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7ffc0b8650 0x7f7ffc0d0ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34430/0 (socket says 172.21.15.37:34430) 2023-07-14T15:57:53.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.903+0000 7f800219b700 1 -- 172.21.15.37:0/1113862490 learned_addr learned my addr 172.21.15.37:0/1113862490 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:53.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.903+0000 7f800299c700 1 --2- 172.21.15.37:0/1113862490 >> v2:172.21.15.37:3300/0 conn(0x7f7ffc0cfda0 0x7f7ffc167580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:53.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.904+0000 7f8001199700 1 -- 172.21.15.37:0/1113862490 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 988693837 0 0) 0x7f7ffc0cd540 con 0x7f7ffc0b8650 2023-07-14T15:57:53.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.904+0000 7f800299c700 1 -- 172.21.15.37:0/1113862490 >> v1:172.21.15.98:6789/0 conn(0x7f7ffc0b24e0 legacy=0x7f7ffc0cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:53.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.904+0000 7f800299c700 1 -- 172.21.15.37:0/1113862490 >> v1:172.21.15.37:6789/0 conn(0x7f7ffc0b8650 legacy=0x7f7ffc0d0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:53.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.904+0000 7f800299c700 1 -- 172.21.15.37:0/1113862490 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ffc0cd790 con 0x7f7ffc0cfda0 2023-07-14T15:57:53.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.904+0000 7f800299c700 1 --2- 172.21.15.37:0/1113862490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ffc0cfda0 0x7f7ffc167580 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f7ff4009d90 tx=0x7f7ff400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e16ab464c32b4be8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:53.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.904+0000 7f8001199700 1 -- 172.21.15.37:0/1113862490 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff400e070 con 0x7f7ffc0cfda0 2023-07-14T15:57:53.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.904+0000 7f8001199700 1 -- 172.21.15.37:0/1113862490 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff400bb90 con 0x7f7ffc0cfda0 2023-07-14T15:57:53.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.904+0000 7f8001199700 1 -- 172.21.15.37:0/1113862490 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff4003a20 con 0x7f7ffc0cfda0 2023-07-14T15:57:53.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.905+0000 7f80043ff700 1 -- 172.21.15.37:0/1113862490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ffc0cfda0 msgr2=0x7f7ffc167580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:53.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.905+0000 7f80043ff700 1 --2- 172.21.15.37:0/1113862490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ffc0cfda0 0x7f7ffc167580 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f7ff4009d90 tx=0x7f7ff400b330 comp rx=0 tx=0).stop 2023-07-14T15:57:53.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.905+0000 7f80043ff700 1 -- 172.21.15.37:0/1113862490 shutdown_connections 2023-07-14T15:57:53.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.905+0000 7f80043ff700 1 --2- 172.21.15.37:0/1113862490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ffc0cfda0 0x7f7ffc167580 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:53.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.905+0000 7f80043ff700 1 -- 172.21.15.37:0/1113862490 >> 172.21.15.37:0/1113862490 conn(0x7f7ffc06c0f0 msgr2=0x7f7ffc06c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:53.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.905+0000 7f80043ff700 1 -- 172.21.15.37:0/1113862490 shutdown_connections 2023-07-14T15:57:53.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.905+0000 7f80043ff700 1 -- 172.21.15.37:0/1113862490 wait complete. 2023-07-14T15:57:53.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.907+0000 7f80043ff700 1 Processor -- start 2023-07-14T15:57:53.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.907+0000 7f80043ff700 1 -- start start 2023-07-14T15:57:53.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.909+0000 7f80043ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ffc0b24e0 0x7f7ffc15a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:53.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.909+0000 7f80043ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ffc0b8650 0x7f7ffc0d1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:53.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.909+0000 7f80043ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7ffc0cfda0 0x7f7ffc0d2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:53.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.909+0000 7f80043ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ffc15a680 con 0x7f7ffc0b8650 2023-07-14T15:57:53.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.909+0000 7f80043ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ffc0cc100 con 0x7f7ffc0b24e0 2023-07-14T15:57:53.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.909+0000 7f80043ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ffc0cc3a0 con 0x7f7ffc0cfda0 2023-07-14T15:57:53.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.909+0000 7f800199a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ffc0b8650 0x7f7ffc0d1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:53.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.909+0000 7f800199a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ffc0b8650 0x7f7ffc0d1ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44866/0 (socket says 172.21.15.37:44866) 2023-07-14T15:57:53.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.909+0000 7f800199a700 1 -- 172.21.15.37:0/126567245 learned_addr learned my addr 172.21.15.37:0/126567245 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:53.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.909+0000 7f800299c700 1 --2- 172.21.15.37:0/126567245 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7ffc0cfda0 0x7f7ffc0d2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:53.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.909+0000 7f800219b700 1 --2- 172.21.15.37:0/126567245 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ffc0b24e0 0x7f7ffc15a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:53.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.909+0000 7f800199a700 1 -- 172.21.15.37:0/126567245 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7ffc0cfda0 msgr2=0x7f7ffc0d2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:53.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.909+0000 7f800199a700 1 --2- 172.21.15.37:0/126567245 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7ffc0cfda0 0x7f7ffc0d2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:53.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.909+0000 7f800199a700 1 -- 172.21.15.37:0/126567245 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ffc0b24e0 msgr2=0x7f7ffc15a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:53.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.909+0000 7f800199a700 1 --2- 172.21.15.37:0/126567245 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ffc0b24e0 0x7f7ffc15a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:53.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.909+0000 7f800199a700 1 -- 172.21.15.37:0/126567245 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff4009a70 con 0x7f7ffc0b8650 2023-07-14T15:57:53.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.909+0000 7f800199a700 1 --2- 172.21.15.37:0/126567245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ffc0b8650 0x7f7ffc0d1ce0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f7fec00b4a0 tx=0x7f7fec00b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:53.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.909+0000 7f7ff2ffd700 1 -- 172.21.15.37:0/126567245 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fec011830 con 0x7f7ffc0b8650 2023-07-14T15:57:53.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.909+0000 7f7ff2ffd700 1 -- 172.21.15.37:0/126567245 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fec011990 con 0x7f7ffc0b8650 2023-07-14T15:57:53.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.909+0000 7f7ff2ffd700 1 -- 172.21.15.37:0/126567245 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fec011d40 con 0x7f7ffc0b8650 2023-07-14T15:57:53.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.909+0000 7f80043ff700 1 -- 172.21.15.37:0/126567245 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ffc0cc680 con 0x7f7ffc0b8650 2023-07-14T15:57:53.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.909+0000 7f80043ff700 1 -- 172.21.15.37:0/126567245 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ffc0ccc40 con 0x7f7ffc0b8650 2023-07-14T15:57:53.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.910+0000 7f80043ff700 1 -- 172.21.15.37:0/126567245 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ffc067840 con 0x7f7ffc0b8650 2023-07-14T15:57:53.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.911+0000 7f7ff2ffd700 1 -- 172.21.15.37:0/126567245 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f7fec01a400 con 0x7f7ffc0b8650 2023-07-14T15:57:53.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.912+0000 7f7ff2ffd700 1 --2- 172.21.15.37:0/126567245 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f7fe006ad70 0x7f7fe006d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:53.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.912+0000 7f7ff2ffd700 1 -- 172.21.15.37:0/126567245 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f7fec0892a0 con 0x7f7ffc0b8650 2023-07-14T15:57:53.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.913+0000 7f800219b700 1 --2- 172.21.15.37:0/126567245 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f7fe006ad70 0x7f7fe006d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:53.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.913+0000 7f800219b700 1 --2- 172.21.15.37:0/126567245 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f7fe006ad70 0x7f7fe006d220 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8000f60 tx=0x7f7ff8007c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:53.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:53.917+0000 7f7ff2ffd700 1 -- 172.21.15.37:0/126567245 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7fec0542b0 con 0x7f7ffc0b8650 2023-07-14T15:57:54.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.125+0000 7f80043ff700 1 -- 172.21.15.37:0/126567245 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ffc0b1830 con 0x7f7ffc0b8650 2023-07-14T15:57:54.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.126+0000 7f7ff2ffd700 1 -- 172.21.15.37:0/126567245 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18376 (secure 0 0 0) 0x7f7fec0578d0 con 0x7f7ffc0b8650 2023-07-14T15:57:54.112 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:57:54.112 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":38,"fsid":"9da30401-a779-4e46-aba6-00c2494c6c67","created":"2023-07-14T15:55:39.898867+0000","modified":"2023-07-14T15:57:48.750407+0000","last_up_change":"2023-07-14T15:55:53.025696+0000","last_in_change":"2023-07-14T15:55:43.388192+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T15:55:52.907261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T15:55:59.992839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-14T15:57:23.872384+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-14T15:57:24.423055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d049535-7b87-4276-8fe5-0f74ba422d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6801","nonce":2783032392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6803","nonce":2783032392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6807","nonce":2783032392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6805","nonce":2783032392}]},"public_addr":"172.21.15.37:6801/2783032392","cluster_addr":"172.21.15.37:6803/2783032392","heartbeat_back_addr":"172.21.15.37:6807/2783032392","heartbeat_front_addr":"172.21.15.37:6805/2783032392","state":["exists","up"]},{"osd":1,"uuid":"79ec948d-ead2-4c2d-923a-dd6eeaac9dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6823","nonce":1190059746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6826","nonce":1190059746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6831","nonce":1190059746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6829","nonce":1190059746}]},"public_addr":"172.21.15.37:6823/1190059746","cluster_addr":"172.21.15.37:6826/1190059746","heartbeat_back_addr":"172.21.15.37:6831/1190059746","heartbeat_front_addr":"172.21.15.37:6829/1190059746","state":["exists","up"]},{"osd":2,"uuid":"a1db6690-c160-4366-9c82-2cca17e4bba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6809","nonce":2266223499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6813","nonce":2266223499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6820","nonce":2266223499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6816","nonce":2266223499}]},"public_addr":"172.21.15.37:6809/2266223499","cluster_addr":"172.21.15.37:6813/2266223499","heartbeat_back_addr":"172.21.15.37:6820/2266223499","heartbeat_front_addr":"172.21.15.37:6816/2266223499","state":["exists","up"]},{"osd":3,"uuid":"767b8220-e79a-4a86-a162-6b3b73198379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6812","nonce":4166694594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6817","nonce":4166694594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6828","nonce":4166694594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6822","nonce":4166694594}]},"public_addr":"172.21.15.37:6812/4166694594","cluster_addr":"172.21.15.37:6817/4166694594","heartbeat_back_addr":"172.21.15.37:6828/4166694594","heartbeat_front_addr":"172.21.15.37:6822/4166694594","state":["exists","up"]},{"osd":4,"uuid":"717bd773-ae7e-4236-ac79-900cf99a37c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6801","nonce":3529020407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6803","nonce":3529020407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6807","nonce":3529020407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6805","nonce":3529020407}]},"public_addr":"172.21.15.98:6801/3529020407","cluster_addr":"172.21.15.98:6803/3529020407","heartbeat_back_addr":"172.21.15.98:6807/3529020407","heartbeat_front_addr":"172.21.15.98:6805/3529020407","state":["exists","up"]},{"osd":5,"uuid":"a941d358-0f03-4136-a9b2-3a1c2e9358cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6817","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6819","nonce":2311501838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6821","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6823","nonce":2311501838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6829","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6831","nonce":2311501838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6825","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6827","nonce":2311501838}]},"public_addr":"172.21.15.98:6819/2311501838","cluster_addr":"172.21.15.98:6823/2311501838","heartbeat_back_addr":"172.21.15.98:6831/2311501838","heartbeat_front_addr":"172.21.15.98:6827/2311501838","state":["exists","up"]},{"osd":6,"uuid":"27153772-6d4b-479d-9953-0582e7b96743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6809","nonce":1144224691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6811","nonce":1144224691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6815","nonce":1144224691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6813","nonce":1144224691}]},"public_addr":"172.21.15.98:6809/1144224691","cluster_addr":"172.21.15.98:6811/1144224691","heartbeat_back_addr":"172.21.15.98:6815/1144224691","heartbeat_front_addr":"172.21.15.98:6813/1144224691","state":["exists","up"]},{"osd":7,"uuid":"d21ffc8e-40bb-47eb-af2c-e3e730d3fb76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6818","nonce":1144470927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6822","nonce":1144470927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6830","nonce":1144470927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6826","nonce":1144470927}]},"public_addr":"172.21.15.98:6818/1144470927","cluster_addr":"172.21.15.98:6822/1144470927","heartbeat_back_addr":"172.21.15.98:6830/1144470927","heartbeat_front_addr":"172.21.15.98:6826/1144470927","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.921114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.739210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.024016+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.002527+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.698127+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.813416+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.709351+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.815457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.f","mappings":[{"from":4,"to":2}]},{"pgid":"6.3f","mappings":[{"from":4,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T15:57:54.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.129+0000 7f80043ff700 1 -- 172.21.15.37:0/126567245 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f7fe006ad70 msgr2=0x7f7fe006d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:54.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.129+0000 7f80043ff700 1 --2- 172.21.15.37:0/126567245 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f7fe006ad70 0x7f7fe006d220 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8000f60 tx=0x7f7ff8007c00 comp rx=0 tx=0).stop 2023-07-14T15:57:54.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.129+0000 7f80043ff700 1 -- 172.21.15.37:0/126567245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ffc0b8650 msgr2=0x7f7ffc0d1ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:54.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.129+0000 7f80043ff700 1 --2- 172.21.15.37:0/126567245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ffc0b8650 0x7f7ffc0d1ce0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f7fec00b4a0 tx=0x7f7fec00b860 comp rx=0 tx=0).stop 2023-07-14T15:57:54.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.129+0000 7f80043ff700 1 -- 172.21.15.37:0/126567245 shutdown_connections 2023-07-14T15:57:54.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.129+0000 7f80043ff700 1 --2- 172.21.15.37:0/126567245 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ffc0b24e0 0x7f7ffc15a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:54.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.129+0000 7f80043ff700 1 --2- 172.21.15.37:0/126567245 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f7fe006ad70 0x7f7fe006d220 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:54.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.129+0000 7f80043ff700 1 --2- 172.21.15.37:0/126567245 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7ffc0cfda0 0x7f7ffc0d2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:54.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.129+0000 7f80043ff700 1 --2- 172.21.15.37:0/126567245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ffc0b8650 0x7f7ffc0d1ce0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:54.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.129+0000 7f80043ff700 1 -- 172.21.15.37:0/126567245 >> 172.21.15.37:0/126567245 conn(0x7f7ffc06c0f0 msgr2=0x7f7ffc0b7a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:54.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.129+0000 7f80043ff700 1 -- 172.21.15.37:0/126567245 shutdown_connections 2023-07-14T15:57:54.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.129+0000 7f80043ff700 1 -- 172.21.15.37:0/126567245 wait complete. 2023-07-14T15:57:54.132 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-14T15:57:54.133 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T15:57:54.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.349+0000 7fa6073ff700 1 Processor -- start 2023-07-14T15:57:54.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.349+0000 7fa6073ff700 1 -- start start 2023-07-14T15:57:54.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.349+0000 7fa6073ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa600070730 0x7fa600070b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:54.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.350+0000 7fa6073ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa6000b3200 0x7fa60015d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:54.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.350+0000 7fa6073ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6000cf250 con 0x7fa6001594c0 2023-07-14T15:57:54.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.350+0000 7fa6073ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa600071040 con 0x7fa600070730 2023-07-14T15:57:54.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.350+0000 7fa6073ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6000ce640 con 0x7fa6000b3200 2023-07-14T15:57:54.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.350+0000 7fa60519b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa600070730 0x7fa600070b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:54.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.350+0000 7fa60519b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa600070730 0x7fa600070b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44870/0 (socket says 172.21.15.37:44870) 2023-07-14T15:57:54.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.350+0000 7fa60519b700 1 -- 172.21.15.37:0/1769130272 learned_addr learned my addr 172.21.15.37:0/1769130272 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:54.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.350+0000 7fa60599c700 1 --2- 172.21.15.37:0/1769130272 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa6000b3200 0x7fa60015d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:54.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.350+0000 7fa60519b700 1 -- 172.21.15.37:0/1769130272 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa6000b3200 msgr2=0x7fa60015d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:54.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.350+0000 7fa60519b700 1 --2- 172.21.15.37:0/1769130272 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa6000b3200 0x7fa60015d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:54.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.350+0000 7fa60519b700 1 -- 172.21.15.37:0/1769130272 >> v1:172.21.15.98:6789/0 conn(0x7fa6001594c0 legacy=0x7fa60015cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:54.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.350+0000 7fa60519b700 1 -- 172.21.15.37:0/1769130272 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6000ce920 con 0x7fa600070730 2023-07-14T15:57:54.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.351+0000 7fa60519b700 1 --2- 172.21.15.37:0/1769130272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa600070730 0x7fa600070b00 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc0098f0 tx=0x7fa5fc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b292b1b6af5e5f6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:54.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.351+0000 7fa5f7fff700 1 -- 172.21.15.37:0/1769130272 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc00b8a0 con 0x7fa600070730 2023-07-14T15:57:54.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.351+0000 7fa5f7fff700 1 -- 172.21.15.37:0/1769130272 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5fc00ba00 con 0x7fa600070730 2023-07-14T15:57:54.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.351+0000 7fa5f7fff700 1 -- 172.21.15.37:0/1769130272 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc00bd90 con 0x7fa600070730 2023-07-14T15:57:54.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.351+0000 7fa6073ff700 1 -- 172.21.15.37:0/1769130272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa600070730 msgr2=0x7fa600070b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:54.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.351+0000 7fa6073ff700 1 --2- 172.21.15.37:0/1769130272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa600070730 0x7fa600070b00 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc0098f0 tx=0x7fa5fc009c00 comp rx=0 tx=0).stop 2023-07-14T15:57:54.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.352+0000 7fa6073ff700 1 -- 172.21.15.37:0/1769130272 shutdown_connections 2023-07-14T15:57:54.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.352+0000 7fa6073ff700 1 --2- 172.21.15.37:0/1769130272 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa6000b3200 0x7fa60015d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:54.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.352+0000 7fa6073ff700 1 --2- 172.21.15.37:0/1769130272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa600070730 0x7fa600070b00 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:54.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.352+0000 7fa6073ff700 1 -- 172.21.15.37:0/1769130272 >> 172.21.15.37:0/1769130272 conn(0x7fa600069e70 msgr2=0x7fa60006a240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:54.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.352+0000 7fa6073ff700 1 -- 172.21.15.37:0/1769130272 shutdown_connections 2023-07-14T15:57:54.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.352+0000 7fa6073ff700 1 -- 172.21.15.37:0/1769130272 wait complete. 2023-07-14T15:57:54.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.353+0000 7fa6073ff700 1 Processor -- start 2023-07-14T15:57:54.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.354+0000 7fa6073ff700 1 -- start start 2023-07-14T15:57:54.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.354+0000 7fa6073ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa600070730 0x7fa6001448c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:54.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.354+0000 7fa6073ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa6000b3200 0x7fa6001e5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:54.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.354+0000 7fa6073ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6001594c0 0x7fa6001e63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:54.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.354+0000 7fa6073ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa600145860 con 0x7fa600070730 2023-07-14T15:57:54.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.354+0000 7fa6073ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60015a9f0 con 0x7fa6001594c0 2023-07-14T15:57:54.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.354+0000 7fa6073ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa60015a710 con 0x7fa6000b3200 2023-07-14T15:57:54.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.355+0000 7fa60519b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa600070730 0x7fa6001448c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:54.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.355+0000 7fa60519b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa600070730 0x7fa6001448c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44874/0 (socket says 172.21.15.37:44874) 2023-07-14T15:57:54.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.355+0000 7fa60519b700 1 -- 172.21.15.37:0/2899869876 learned_addr learned my addr 172.21.15.37:0/2899869876 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:54.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.355+0000 7fa60519b700 1 -- 172.21.15.37:0/2899869876 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa6000b3200 msgr2=0x7fa6001e5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:54.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.355+0000 7fa60519b700 1 --2- 172.21.15.37:0/2899869876 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa6000b3200 0x7fa6001e5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:54.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.355+0000 7fa60519b700 1 -- 172.21.15.37:0/2899869876 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6001594c0 msgr2=0x7fa6001e63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:54.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.355+0000 7fa60519b700 1 --2- 172.21.15.37:0/2899869876 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6001594c0 0x7fa6001e63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:54.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.355+0000 7fa60519b700 1 -- 172.21.15.37:0/2899869876 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5fc009550 con 0x7fa600070730 2023-07-14T15:57:54.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.355+0000 7fa60519b700 1 --2- 172.21.15.37:0/2899869876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa600070730 0x7fa6001448c0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc000c00 tx=0x7fa5fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:54.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.356+0000 7fa5f5ffb700 1 -- 172.21.15.37:0/2899869876 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc004570 con 0x7fa600070730 2023-07-14T15:57:54.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.356+0000 7fa5f5ffb700 1 -- 172.21.15.37:0/2899869876 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5fc01f070 con 0x7fa600070730 2023-07-14T15:57:54.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.356+0000 7fa5f5ffb700 1 -- 172.21.15.37:0/2899869876 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc0038e0 con 0x7fa600070730 2023-07-14T15:57:54.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.356+0000 7fa6073ff700 1 -- 172.21.15.37:0/2899869876 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa600145210 con 0x7fa600070730 2023-07-14T15:57:54.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.356+0000 7fa6073ff700 1 -- 172.21.15.37:0/2899869876 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa600144e00 con 0x7fa600070730 2023-07-14T15:57:54.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.357+0000 7fa6073ff700 1 -- 172.21.15.37:0/2899869876 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa60015c360 con 0x7fa600070730 2023-07-14T15:57:54.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.358+0000 7fa5f5ffb700 1 -- 172.21.15.37:0/2899869876 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7fa5fc021030 con 0x7fa600070730 2023-07-14T15:57:54.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.359+0000 7fa5f5ffb700 1 --2- 172.21.15.37:0/2899869876 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa5e406ad70 0x7fa5e406d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:54.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.359+0000 7fa5f5ffb700 1 -- 172.21.15.37:0/2899869876 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa5fc08aa00 con 0x7fa600070730 2023-07-14T15:57:54.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.359+0000 7fa60499a700 1 --2- 172.21.15.37:0/2899869876 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa5e406ad70 0x7fa5e406d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:54.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.360+0000 7fa60499a700 1 --2- 172.21.15.37:0/2899869876 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa5e406ad70 0x7fa5e406d220 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0000f60 tx=0x7fa5f0007a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:54.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.363+0000 7fa5f5ffb700 1 -- 172.21.15.37:0/2899869876 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa5fc055a10 con 0x7fa600070730 2023-07-14T15:57:54.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.611+0000 7fa6073ff700 1 -- 172.21.15.37:0/2899869876 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa6000713c0 con 0x7fa600070730 2023-07-14T15:57:54.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.612+0000 7fa5f5ffb700 1 -- 172.21.15.37:0/2899869876 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4709 (secure 0 0 0) 0x7fa5fc059030 con 0x7fa600070730 2023-07-14T15:57:54.598 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:57:54.598 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/1292294727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":1292294727},{"type":"v1","addr":"172.21.15.98:6837","nonce":1292294727}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4811,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1091097806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1091097806},{"type":"v1","addr":"172.21.15.37:6835","nonce":1091097806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5059,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/2838228048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2838228048},{"type":"v1","addr":"172.21.15.98:6836","nonce":2838228048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T15:57:25.446758+0000","modified":"2023-07-14T15:57:28.951927+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5121},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5121":{"gid":5121,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6834/2406398098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2406398098},{"type":"v1","addr":"172.21.15.37:6834","nonce":2406398098}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-14T15:57:54.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.614+0000 7fa6073ff700 1 -- 172.21.15.37:0/2899869876 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa5e406ad70 msgr2=0x7fa5e406d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:54.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.614+0000 7fa6073ff700 1 --2- 172.21.15.37:0/2899869876 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa5e406ad70 0x7fa5e406d220 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0000f60 tx=0x7fa5f0007a40 comp rx=0 tx=0).stop 2023-07-14T15:57:54.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.614+0000 7fa6073ff700 1 -- 172.21.15.37:0/2899869876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa600070730 msgr2=0x7fa6001448c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:54.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.614+0000 7fa6073ff700 1 --2- 172.21.15.37:0/2899869876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa600070730 0x7fa6001448c0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc000c00 tx=0x7fa5fc004750 comp rx=0 tx=0).stop 2023-07-14T15:57:54.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.614+0000 7fa6073ff700 1 -- 172.21.15.37:0/2899869876 shutdown_connections 2023-07-14T15:57:54.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.614+0000 7fa6073ff700 1 --2- 172.21.15.37:0/2899869876 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6001594c0 0x7fa6001e63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:54.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.614+0000 7fa6073ff700 1 --2- 172.21.15.37:0/2899869876 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa5e406ad70 0x7fa5e406d220 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:54.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.614+0000 7fa6073ff700 1 --2- 172.21.15.37:0/2899869876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa600070730 0x7fa6001448c0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:54.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.614+0000 7fa6073ff700 1 --2- 172.21.15.37:0/2899869876 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa6000b3200 0x7fa6001e5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:54.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.614+0000 7fa6073ff700 1 -- 172.21.15.37:0/2899869876 >> 172.21.15.37:0/2899869876 conn(0x7fa600069e70 msgr2=0x7fa6000ada10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:54.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.614+0000 7fa6073ff700 1 -- 172.21.15.37:0/2899869876 shutdown_connections 2023-07-14T15:57:54.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.614+0000 7fa6073ff700 1 -- 172.21.15.37:0/2899869876 wait complete. 2023-07-14T15:57:54.604 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 17 2023-07-14T15:57:54.618 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T15:57:54.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.836+0000 7fcde43ff700 1 Processor -- start 2023-07-14T15:57:54.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.836+0000 7fcde43ff700 1 -- start start 2023-07-14T15:57:54.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.838+0000 7fcde43ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcddc0b4910 0x7fcddc0b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:54.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.838+0000 7fcde43ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcddc0cf6b0 con 0x7fcddc0b54b0 2023-07-14T15:57:54.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.838+0000 7fcde43ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcddc0b5270 con 0x7fcddc0b85f0 2023-07-14T15:57:54.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.838+0000 7fcde43ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcddc0cdc40 con 0x7fcddc0b4910 2023-07-14T15:57:54.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.838+0000 7fcde299c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcddc0b4910 0x7fcddc0b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:54.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.838+0000 7fcde299c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcddc0b4910 0x7fcddc0b4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44888/0 (socket says 172.21.15.37:44888) 2023-07-14T15:57:54.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.838+0000 7fcde299c700 1 -- 172.21.15.37:0/3942920915 learned_addr learned my addr 172.21.15.37:0/3942920915 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:54.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.838+0000 7fcde199a700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fcddc0b54b0 0x7fcddc0cfb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34440/0 (socket says 172.21.15.37:34440) 2023-07-14T15:57:54.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.838+0000 7fcde299c700 1 -- 172.21.15.37:0/3942920915 >> v1:172.21.15.98:6789/0 conn(0x7fcddc0b85f0 legacy=0x7fcddc15d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:54.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.838+0000 7fcde299c700 1 -- 172.21.15.37:0/3942920915 >> v1:172.21.15.37:6789/0 conn(0x7fcddc0b54b0 legacy=0x7fcddc0cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:54.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.838+0000 7fcde299c700 1 -- 172.21.15.37:0/3942920915 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcddc0d0250 con 0x7fcddc0b4910 2023-07-14T15:57:54.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.838+0000 7fcde1199700 1 -- 172.21.15.37:0/3942920915 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1156254817 0 0) 0x7fcddc0cf6b0 con 0x7fcddc0b54b0 2023-07-14T15:57:54.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.839+0000 7fcde299c700 1 --2- 172.21.15.37:0/3942920915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcddc0b4910 0x7fcddc0b4d30 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4009e50 tx=0x7fcdd400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0f9b44d8f751d56 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:54.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.839+0000 7fcde1199700 1 -- 172.21.15.37:0/3942920915 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd400e070 con 0x7fcddc0b4910 2023-07-14T15:57:54.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.839+0000 7fcde1199700 1 -- 172.21.15.37:0/3942920915 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd400b9c0 con 0x7fcddc0b4910 2023-07-14T15:57:54.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.839+0000 7fcde1199700 1 -- 172.21.15.37:0/3942920915 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd400bd70 con 0x7fcddc0b4910 2023-07-14T15:57:54.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.839+0000 7fcde43ff700 1 -- 172.21.15.37:0/3942920915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcddc0b4910 msgr2=0x7fcddc0b4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:54.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.839+0000 7fcde43ff700 1 --2- 172.21.15.37:0/3942920915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcddc0b4910 0x7fcddc0b4d30 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4009e50 tx=0x7fcdd400b330 comp rx=0 tx=0).stop 2023-07-14T15:57:54.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.840+0000 7fcde43ff700 1 -- 172.21.15.37:0/3942920915 shutdown_connections 2023-07-14T15:57:54.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.840+0000 7fcde43ff700 1 --2- 172.21.15.37:0/3942920915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcddc0b4910 0x7fcddc0b4d30 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:54.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.840+0000 7fcde43ff700 1 -- 172.21.15.37:0/3942920915 >> 172.21.15.37:0/3942920915 conn(0x7fcddc06a580 msgr2=0x7fcddc06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:54.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.840+0000 7fcde43ff700 1 -- 172.21.15.37:0/3942920915 shutdown_connections 2023-07-14T15:57:54.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.840+0000 7fcde43ff700 1 -- 172.21.15.37:0/3942920915 wait complete. 2023-07-14T15:57:54.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.842+0000 7fcde43ff700 1 Processor -- start 2023-07-14T15:57:54.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.842+0000 7fcde43ff700 1 -- start start 2023-07-14T15:57:54.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.844+0000 7fcde43ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcddc0b4910 0x7fcddc1f21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:54.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.844+0000 7fcde43ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcddc0b54b0 0x7fcddc0cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:54.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.844+0000 7fcde43ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcddc0b85f0 0x7fcddc0c92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:54.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.844+0000 7fcde43ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcddc1f2700 con 0x7fcddc0b54b0 2023-07-14T15:57:54.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.844+0000 7fcde43ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcddc1f3190 con 0x7fcddc0b85f0 2023-07-14T15:57:54.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.844+0000 7fcde43ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcddc1f28f0 con 0x7fcddc0b4910 2023-07-14T15:57:54.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.844+0000 7fcde199a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcddc0b54b0 0x7fcddc0cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:54.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.844+0000 7fcde199a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcddc0b54b0 0x7fcddc0cc0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44896/0 (socket says 172.21.15.37:44896) 2023-07-14T15:57:54.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.844+0000 7fcde199a700 1 -- 172.21.15.37:0/2316862060 learned_addr learned my addr 172.21.15.37:0/2316862060 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:54.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.844+0000 7fcde199a700 1 -- 172.21.15.37:0/2316862060 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcddc0b4910 msgr2=0x7fcddc1f21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:54.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.844+0000 7fcde199a700 1 --2- 172.21.15.37:0/2316862060 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcddc0b4910 0x7fcddc1f21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:54.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.844+0000 7fcde299c700 1 --2- 172.21.15.37:0/2316862060 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcddc0b85f0 0x7fcddc0c92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:54.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.844+0000 7fcde199a700 1 -- 172.21.15.37:0/2316862060 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcddc0b85f0 msgr2=0x7fcddc0c92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:54.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.844+0000 7fcde199a700 1 --2- 172.21.15.37:0/2316862060 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcddc0b85f0 0x7fcddc0c92b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:54.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.844+0000 7fcde199a700 1 -- 172.21.15.37:0/2316862060 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd4009b30 con 0x7fcddc0b54b0 2023-07-14T15:57:54.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.844+0000 7fcde199a700 1 --2- 172.21.15.37:0/2316862060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcddc0b54b0 0x7fcddc0cc0e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc00c520 tx=0x7fcdcc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:54.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.845+0000 7fcdd2ffd700 1 -- 172.21.15.37:0/2316862060 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc004c80 con 0x7fcddc0b54b0 2023-07-14T15:57:54.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.845+0000 7fcdd2ffd700 1 -- 172.21.15.37:0/2316862060 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdcc004e00 con 0x7fcddc0b54b0 2023-07-14T15:57:54.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.845+0000 7fcde43ff700 1 -- 172.21.15.37:0/2316862060 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcddc1f2bd0 con 0x7fcddc0b54b0 2023-07-14T15:57:54.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.845+0000 7fcdd2ffd700 1 -- 172.21.15.37:0/2316862060 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc007310 con 0x7fcddc0b54b0 2023-07-14T15:57:54.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.845+0000 7fcde43ff700 1 -- 172.21.15.37:0/2316862060 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcddc0ca000 con 0x7fcddc0b54b0 2023-07-14T15:57:54.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.846+0000 7fcde43ff700 1 -- 172.21.15.37:0/2316862060 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcddc0ca220 con 0x7fcddc0b54b0 2023-07-14T15:57:54.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.847+0000 7fcdd2ffd700 1 -- 172.21.15.37:0/2316862060 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7fcdcc007470 con 0x7fcddc0b54b0 2023-07-14T15:57:54.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.848+0000 7fcdd2ffd700 1 --2- 172.21.15.37:0/2316862060 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fcdc006ad70 0x7fcdc006d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:54.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.848+0000 7fcdd2ffd700 1 -- 172.21.15.37:0/2316862060 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fcdcc089300 con 0x7fcddc0b54b0 2023-07-14T15:57:54.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.848+0000 7fcde219b700 1 --2- 172.21.15.37:0/2316862060 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fcdc006ad70 0x7fcdc006d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:54.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.849+0000 7fcde219b700 1 --2- 172.21.15.37:0/2316862060 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fcdc006ad70 0x7fcdc006d220 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8000f60 tx=0x7fcdd8007a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:54.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:54.852+0000 7fcdd2ffd700 1 -- 172.21.15.37:0/2316862060 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fcdcc054280 con 0x7fcddc0b54b0 2023-07-14T15:57:55.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.106+0000 7fcde43ff700 1 -- 172.21.15.37:0/2316862060 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcddc0d2a50 con 0x7fcddc0b54b0 2023-07-14T15:57:55.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.107+0000 7fcdd2ffd700 1 -- 172.21.15.37:0/2316862060 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4709 (secure 0 0 0) 0x7fcdcc0578a0 con 0x7fcddc0b54b0 2023-07-14T15:57:55.091 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:57:55.091 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/1292294727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":1292294727},{"type":"v1","addr":"172.21.15.98:6837","nonce":1292294727}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4811,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1091097806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1091097806},{"type":"v1","addr":"172.21.15.37:6835","nonce":1091097806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5059,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/2838228048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2838228048},{"type":"v1","addr":"172.21.15.98:6836","nonce":2838228048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T15:57:25.446758+0000","modified":"2023-07-14T15:57:28.951927+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5121},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5121":{"gid":5121,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6834/2406398098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2406398098},{"type":"v1","addr":"172.21.15.37:6834","nonce":2406398098}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-14T15:57:55.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.109+0000 7fcde43ff700 1 -- 172.21.15.37:0/2316862060 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fcdc006ad70 msgr2=0x7fcdc006d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:55.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.109+0000 7fcde43ff700 1 --2- 172.21.15.37:0/2316862060 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fcdc006ad70 0x7fcdc006d220 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8000f60 tx=0x7fcdd8007a40 comp rx=0 tx=0).stop 2023-07-14T15:57:55.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.109+0000 7fcde43ff700 1 -- 172.21.15.37:0/2316862060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcddc0b54b0 msgr2=0x7fcddc0cc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:55.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.109+0000 7fcde43ff700 1 --2- 172.21.15.37:0/2316862060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcddc0b54b0 0x7fcddc0cc0e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc00c520 tx=0x7fcdcc00c8e0 comp rx=0 tx=0).stop 2023-07-14T15:57:55.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.109+0000 7fcde43ff700 1 -- 172.21.15.37:0/2316862060 shutdown_connections 2023-07-14T15:57:55.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.109+0000 7fcde43ff700 1 --2- 172.21.15.37:0/2316862060 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcddc0b85f0 0x7fcddc0c92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:55.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.109+0000 7fcde43ff700 1 --2- 172.21.15.37:0/2316862060 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fcdc006ad70 0x7fcdc006d220 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:55.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.109+0000 7fcde43ff700 1 --2- 172.21.15.37:0/2316862060 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcddc0b4910 0x7fcddc1f21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:55.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.109+0000 7fcde43ff700 1 --2- 172.21.15.37:0/2316862060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcddc0b54b0 0x7fcddc0cc0e0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:55.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.109+0000 7fcde43ff700 1 -- 172.21.15.37:0/2316862060 >> 172.21.15.37:0/2316862060 conn(0x7fcddc06a580 msgr2=0x7fcddc0cfa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:55.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.109+0000 7fcde43ff700 1 -- 172.21.15.37:0/2316862060 shutdown_connections 2023-07-14T15:57:55.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.109+0000 7fcde43ff700 1 -- 172.21.15.37:0/2316862060 wait complete. 2023-07-14T15:57:55.095 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 17 2023-07-14T15:57:55.112 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T15:57:55.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.330+0000 7f5210dff700 1 Processor -- start 2023-07-14T15:57:55.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.330+0000 7f5210dff700 1 -- start start 2023-07-14T15:57:55.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.332+0000 7f5210dff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f520c15c700 0x7f520c0ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:55.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.332+0000 7f5210dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f520c15cad0 0x7f520c0b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:55.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.332+0000 7f5210dff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f520c0cd2c0 0x7f520c0cd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:55.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.332+0000 7f5210dff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f520c0b40e0 con 0x7f520c15c700 2023-07-14T15:57:55.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.332+0000 7f5210dff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f520c0cdc30 con 0x7f520c0cd2c0 2023-07-14T15:57:55.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.332+0000 7f5210dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f520c0b2e50 con 0x7f520c15cad0 2023-07-14T15:57:55.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.332+0000 7f520a59c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f520c15c700 0x7f520c0ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:55.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.332+0000 7f520a59c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f520c15c700 0x7f520c0ae8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44908/0 (socket says 172.21.15.37:44908) 2023-07-14T15:57:55.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.332+0000 7f520a59c700 1 -- 172.21.15.37:0/3824394164 learned_addr learned my addr 172.21.15.37:0/3824394164 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:55.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.333+0000 7f5209d9b700 1 --2- 172.21.15.37:0/3824394164 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f520c15cad0 0x7f520c0b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:55.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.333+0000 7f520ad9d700 1 --2- 172.21.15.37:0/3824394164 >> v2:172.21.15.98:3300/0 conn(0x7f520c0cd2c0 0x7f520c0cd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:55.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.333+0000 7f520a59c700 1 -- 172.21.15.37:0/3824394164 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f520c15cad0 msgr2=0x7f520c0b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:55.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.333+0000 7f520a59c700 1 --2- 172.21.15.37:0/3824394164 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f520c15cad0 0x7f520c0b3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:55.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.333+0000 7f520a59c700 1 -- 172.21.15.37:0/3824394164 >> v2:172.21.15.98:3300/0 conn(0x7f520c0cd2c0 msgr2=0x7f520c0cd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:55.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.333+0000 7f520a59c700 1 --2- 172.21.15.37:0/3824394164 >> v2:172.21.15.98:3300/0 conn(0x7f520c0cd2c0 0x7f520c0cd6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:55.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.333+0000 7f520a59c700 1 -- 172.21.15.37:0/3824394164 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f520c0cfcb0 con 0x7f520c15c700 2023-07-14T15:57:55.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.333+0000 7f520ad9d700 1 --2- 172.21.15.37:0/3824394164 >> v2:172.21.15.98:3300/0 conn(0x7f520c0cd2c0 0x7f520c0cd6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:57:55.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.333+0000 7f520a59c700 1 --2- 172.21.15.37:0/3824394164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f520c15c700 0x7f520c0ae8c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f520c06fd90 tx=0x7f51fc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=190b47c602fd6c93 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:55.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.333+0000 7f520959a700 1 -- 172.21.15.37:0/3824394164 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc00b870 con 0x7f520c15c700 2023-07-14T15:57:55.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.333+0000 7f520959a700 1 -- 172.21.15.37:0/3824394164 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51fc00b9d0 con 0x7f520c15c700 2023-07-14T15:57:55.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.333+0000 7f520959a700 1 -- 172.21.15.37:0/3824394164 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc00bd60 con 0x7f520c15c700 2023-07-14T15:57:55.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.334+0000 7f5210dff700 1 -- 172.21.15.37:0/3824394164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f520c15c700 msgr2=0x7f520c0ae8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:55.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.334+0000 7f5210dff700 1 --2- 172.21.15.37:0/3824394164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f520c15c700 0x7f520c0ae8c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f520c06fd90 tx=0x7f51fc009bd0 comp rx=0 tx=0).stop 2023-07-14T15:57:55.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.334+0000 7f5210dff700 1 -- 172.21.15.37:0/3824394164 shutdown_connections 2023-07-14T15:57:55.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.334+0000 7f5210dff700 1 --2- 172.21.15.37:0/3824394164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f520c15c700 0x7f520c0ae8c0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:55.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.334+0000 7f5210dff700 1 --2- 172.21.15.37:0/3824394164 >> v2:172.21.15.98:3300/0 conn(0x7f520c0cd2c0 0x7f520c0cd6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:55.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.334+0000 7f5210dff700 1 --2- 172.21.15.37:0/3824394164 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f520c15cad0 0x7f520c0b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:55.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.334+0000 7f5210dff700 1 -- 172.21.15.37:0/3824394164 >> 172.21.15.37:0/3824394164 conn(0x7f520c0ccad0 msgr2=0x7f520c0cf3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:55.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.334+0000 7f5210dff700 1 -- 172.21.15.37:0/3824394164 shutdown_connections 2023-07-14T15:57:55.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.334+0000 7f5210dff700 1 -- 172.21.15.37:0/3824394164 wait complete. 2023-07-14T15:57:55.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.336+0000 7f5210dff700 1 Processor -- start 2023-07-14T15:57:55.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.337+0000 7f5210dff700 1 -- start start 2023-07-14T15:57:55.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.338+0000 7f5210dff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f520c0cd2c0 0x7f520c1f2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:55.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.338+0000 7f5210dff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f520c15c700 0x7f520c156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:55.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.338+0000 7f5210dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f520c1f5570 0x7f520c1f59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:55.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.338+0000 7f5210dff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520c15d8e0 con 0x7f520c0cd2c0 2023-07-14T15:57:55.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.338+0000 7f5210dff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520c1571a0 con 0x7f520c15c700 2023-07-14T15:57:55.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.338+0000 7f5210dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f520c1f6010 con 0x7f520c1f5570 2023-07-14T15:57:55.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.338+0000 7f520a59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f520c0cd2c0 0x7f520c1f2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:55.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.338+0000 7f520a59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f520c0cd2c0 0x7f520c1f2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44910/0 (socket says 172.21.15.37:44910) 2023-07-14T15:57:55.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.338+0000 7f520a59c700 1 -- 172.21.15.37:0/479337202 learned_addr learned my addr 172.21.15.37:0/479337202 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:55.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.338+0000 7f5209d9b700 1 --2- 172.21.15.37:0/479337202 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f520c15c700 0x7f520c156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:55.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.338+0000 7f520ad9d700 1 --2- 172.21.15.37:0/479337202 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f520c1f5570 0x7f520c1f59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:55.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.339+0000 7f520a59c700 1 -- 172.21.15.37:0/479337202 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f520c1f5570 msgr2=0x7f520c1f59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:55.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.339+0000 7f520a59c700 1 --2- 172.21.15.37:0/479337202 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f520c1f5570 0x7f520c1f59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:55.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.339+0000 7f520a59c700 1 -- 172.21.15.37:0/479337202 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f520c15c700 msgr2=0x7f520c156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:55.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.339+0000 7f520a59c700 1 --2- 172.21.15.37:0/479337202 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f520c15c700 0x7f520c156c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:55.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.339+0000 7f520a59c700 1 -- 172.21.15.37:0/479337202 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51fc009550 con 0x7f520c0cd2c0 2023-07-14T15:57:55.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.339+0000 7f5209d9b700 1 --2- 172.21.15.37:0/479337202 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f520c15c700 0x7f520c156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:57:55.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.339+0000 7f520a59c700 1 --2- 172.21.15.37:0/479337202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f520c0cd2c0 0x7f520c1f2a90 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f51fc000c00 tx=0x7f51fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:55.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.339+0000 7f51faffd700 1 -- 172.21.15.37:0/479337202 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc004520 con 0x7f520c0cd2c0 2023-07-14T15:57:55.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.339+0000 7f51faffd700 1 -- 172.21.15.37:0/479337202 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51fc01e070 con 0x7f520c0cd2c0 2023-07-14T15:57:55.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.339+0000 7f5210dff700 1 -- 172.21.15.37:0/479337202 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f520c1f62f0 con 0x7f520c0cd2c0 2023-07-14T15:57:55.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.339+0000 7f51faffd700 1 -- 172.21.15.37:0/479337202 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc0038c0 con 0x7f520c0cd2c0 2023-07-14T15:57:55.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.339+0000 7f5210dff700 1 -- 172.21.15.37:0/479337202 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f520c1f2570 con 0x7f520c0cd2c0 2023-07-14T15:57:55.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.340+0000 7f5210dff700 1 -- 172.21.15.37:0/479337202 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f520c067840 con 0x7f520c0cd2c0 2023-07-14T15:57:55.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.341+0000 7f51faffd700 1 -- 172.21.15.37:0/479337202 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f51fc003a20 con 0x7f520c0cd2c0 2023-07-14T15:57:55.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.342+0000 7f51faffd700 1 --2- 172.21.15.37:0/479337202 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f51ec06ada0 0x7f51ec06d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:55.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.343+0000 7f51faffd700 1 -- 172.21.15.37:0/479337202 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f51fc020070 con 0x7f520c0cd2c0 2023-07-14T15:57:55.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.343+0000 7f5209d9b700 1 --2- 172.21.15.37:0/479337202 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f51ec06ada0 0x7f51ec06d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:55.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.344+0000 7f5209d9b700 1 --2- 172.21.15.37:0/479337202 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f51ec06ada0 0x7f51ec06d250 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f520c06b790 tx=0x7f5200008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:55.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.346+0000 7f51faffd700 1 -- 172.21.15.37:0/479337202 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f51fc055760 con 0x7f520c0cd2c0 2023-07-14T15:57:55.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.555+0000 7f5210dff700 1 -- 172.21.15.37:0/479337202 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f520c06a010 con 0x7f520c0cd2c0 2023-07-14T15:57:55.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.556+0000 7f51faffd700 1 -- 172.21.15.37:0/479337202 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18376 (secure 0 0 0) 0x7f51fc058d80 con 0x7f520c0cd2c0 2023-07-14T15:57:55.540 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:57:55.541 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":38,"fsid":"9da30401-a779-4e46-aba6-00c2494c6c67","created":"2023-07-14T15:55:39.898867+0000","modified":"2023-07-14T15:57:48.750407+0000","last_up_change":"2023-07-14T15:55:53.025696+0000","last_in_change":"2023-07-14T15:55:43.388192+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T15:55:52.907261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T15:55:59.992839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-14T15:57:23.872384+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-14T15:57:24.423055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d049535-7b87-4276-8fe5-0f74ba422d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6801","nonce":2783032392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6803","nonce":2783032392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6807","nonce":2783032392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6805","nonce":2783032392}]},"public_addr":"172.21.15.37:6801/2783032392","cluster_addr":"172.21.15.37:6803/2783032392","heartbeat_back_addr":"172.21.15.37:6807/2783032392","heartbeat_front_addr":"172.21.15.37:6805/2783032392","state":["exists","up"]},{"osd":1,"uuid":"79ec948d-ead2-4c2d-923a-dd6eeaac9dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6823","nonce":1190059746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6826","nonce":1190059746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6831","nonce":1190059746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6829","nonce":1190059746}]},"public_addr":"172.21.15.37:6823/1190059746","cluster_addr":"172.21.15.37:6826/1190059746","heartbeat_back_addr":"172.21.15.37:6831/1190059746","heartbeat_front_addr":"172.21.15.37:6829/1190059746","state":["exists","up"]},{"osd":2,"uuid":"a1db6690-c160-4366-9c82-2cca17e4bba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6809","nonce":2266223499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6813","nonce":2266223499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6820","nonce":2266223499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6816","nonce":2266223499}]},"public_addr":"172.21.15.37:6809/2266223499","cluster_addr":"172.21.15.37:6813/2266223499","heartbeat_back_addr":"172.21.15.37:6820/2266223499","heartbeat_front_addr":"172.21.15.37:6816/2266223499","state":["exists","up"]},{"osd":3,"uuid":"767b8220-e79a-4a86-a162-6b3b73198379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6812","nonce":4166694594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6817","nonce":4166694594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6828","nonce":4166694594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6822","nonce":4166694594}]},"public_addr":"172.21.15.37:6812/4166694594","cluster_addr":"172.21.15.37:6817/4166694594","heartbeat_back_addr":"172.21.15.37:6828/4166694594","heartbeat_front_addr":"172.21.15.37:6822/4166694594","state":["exists","up"]},{"osd":4,"uuid":"717bd773-ae7e-4236-ac79-900cf99a37c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6801","nonce":3529020407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6803","nonce":3529020407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6807","nonce":3529020407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6805","nonce":3529020407}]},"public_addr":"172.21.15.98:6801/3529020407","cluster_addr":"172.21.15.98:6803/3529020407","heartbeat_back_addr":"172.21.15.98:6807/3529020407","heartbeat_front_addr":"172.21.15.98:6805/3529020407","state":["exists","up"]},{"osd":5,"uuid":"a941d358-0f03-4136-a9b2-3a1c2e9358cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6817","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6819","nonce":2311501838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6821","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6823","nonce":2311501838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6829","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6831","nonce":2311501838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6825","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6827","nonce":2311501838}]},"public_addr":"172.21.15.98:6819/2311501838","cluster_addr":"172.21.15.98:6823/2311501838","heartbeat_back_addr":"172.21.15.98:6831/2311501838","heartbeat_front_addr":"172.21.15.98:6827/2311501838","state":["exists","up"]},{"osd":6,"uuid":"27153772-6d4b-479d-9953-0582e7b96743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6809","nonce":1144224691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6811","nonce":1144224691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6815","nonce":1144224691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6813","nonce":1144224691}]},"public_addr":"172.21.15.98:6809/1144224691","cluster_addr":"172.21.15.98:6811/1144224691","heartbeat_back_addr":"172.21.15.98:6815/1144224691","heartbeat_front_addr":"172.21.15.98:6813/1144224691","state":["exists","up"]},{"osd":7,"uuid":"d21ffc8e-40bb-47eb-af2c-e3e730d3fb76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6818","nonce":1144470927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6822","nonce":1144470927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6830","nonce":1144470927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6826","nonce":1144470927}]},"public_addr":"172.21.15.98:6818/1144470927","cluster_addr":"172.21.15.98:6822/1144470927","heartbeat_back_addr":"172.21.15.98:6830/1144470927","heartbeat_front_addr":"172.21.15.98:6826/1144470927","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.921114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.739210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.024016+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.002527+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.698127+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.813416+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.709351+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.815457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.f","mappings":[{"from":4,"to":2}]},{"pgid":"6.3f","mappings":[{"from":4,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T15:57:55.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.558+0000 7f5210dff700 1 -- 172.21.15.37:0/479337202 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f51ec06ada0 msgr2=0x7f51ec06d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:55.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.558+0000 7f5210dff700 1 --2- 172.21.15.37:0/479337202 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f51ec06ada0 0x7f51ec06d250 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f520c06b790 tx=0x7f5200008040 comp rx=0 tx=0).stop 2023-07-14T15:57:55.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.558+0000 7f5210dff700 1 -- 172.21.15.37:0/479337202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f520c0cd2c0 msgr2=0x7f520c1f2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:55.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.558+0000 7f5210dff700 1 --2- 172.21.15.37:0/479337202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f520c0cd2c0 0x7f520c1f2a90 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f51fc000c00 tx=0x7f51fc004750 comp rx=0 tx=0).stop 2023-07-14T15:57:55.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.558+0000 7f5210dff700 1 -- 172.21.15.37:0/479337202 shutdown_connections 2023-07-14T15:57:55.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.558+0000 7f5210dff700 1 --2- 172.21.15.37:0/479337202 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f51ec06ada0 0x7f51ec06d250 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:55.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.558+0000 7f5210dff700 1 --2- 172.21.15.37:0/479337202 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f520c1f5570 0x7f520c1f59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:55.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.558+0000 7f5210dff700 1 --2- 172.21.15.37:0/479337202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f520c0cd2c0 0x7f520c1f2a90 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:55.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.558+0000 7f5210dff700 1 --2- 172.21.15.37:0/479337202 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f520c15c700 0x7f520c156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:55.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.558+0000 7f5210dff700 1 -- 172.21.15.37:0/479337202 >> 172.21.15.37:0/479337202 conn(0x7f520c0ccad0 msgr2=0x7f520c06c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:55.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.558+0000 7f5210dff700 1 -- 172.21.15.37:0/479337202 shutdown_connections 2023-07-14T15:57:55.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.558+0000 7f5210dff700 1 -- 172.21.15.37:0/479337202 wait complete. 2023-07-14T15:57:55.561 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-14T15:57:55.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.781+0000 7faf77fff700 1 Processor -- start 2023-07-14T15:57:55.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.781+0000 7faf77fff700 1 -- start start 2023-07-14T15:57:55.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.782+0000 7faf77fff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7faf700b8900 0x7faf700cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:55.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.782+0000 7faf77fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faf700b5e00 0x7faf700d0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:55.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.782+0000 7faf77fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7faf700d13f0 0x7faf700cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:55.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.782+0000 7faf77fff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf700d1870 con 0x7faf700b5e00 2023-07-14T15:57:55.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.782+0000 7faf77fff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf7015d030 con 0x7faf700d13f0 2023-07-14T15:57:55.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.782+0000 7faf77fff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf700b6270 con 0x7faf700b8900 2023-07-14T15:57:55.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.782+0000 7faf7559a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faf700b5e00 0x7faf700d0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:55.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.782+0000 7faf7559a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faf700b5e00 0x7faf700d0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44924/0 (socket says 172.21.15.37:44924) 2023-07-14T15:57:55.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.782+0000 7faf7559a700 1 -- 172.21.15.37:0/910530356 learned_addr learned my addr 172.21.15.37:0/910530356 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:55.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.783+0000 7faf7659c700 1 --2- 172.21.15.37:0/910530356 >> v2:172.21.15.98:3300/0 conn(0x7faf700d13f0 0x7faf700cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:55.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.783+0000 7faf75d9b700 1 --2- 172.21.15.37:0/910530356 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7faf700b8900 0x7faf700cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:55.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.783+0000 7faf7559a700 1 -- 172.21.15.37:0/910530356 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7faf700b8900 msgr2=0x7faf700cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:55.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.783+0000 7faf7559a700 1 --2- 172.21.15.37:0/910530356 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7faf700b8900 0x7faf700cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:55.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.783+0000 7faf7559a700 1 -- 172.21.15.37:0/910530356 >> v2:172.21.15.98:3300/0 conn(0x7faf700d13f0 msgr2=0x7faf700cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:55.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.783+0000 7faf7559a700 1 --2- 172.21.15.37:0/910530356 >> v2:172.21.15.98:3300/0 conn(0x7faf700d13f0 0x7faf700cebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:55.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.783+0000 7faf7559a700 1 -- 172.21.15.37:0/910530356 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf700cdb50 con 0x7faf700b5e00 2023-07-14T15:57:55.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.783+0000 7faf75d9b700 1 --2- 172.21.15.37:0/910530356 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7faf700b8900 0x7faf700cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:57:55.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.783+0000 7faf7559a700 1 --2- 172.21.15.37:0/910530356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf700b5e00 0x7faf700d0eb0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7faf7009c910 tx=0x7faf60009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59f5c213435b7703 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:55.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.783+0000 7faf74d99700 1 -- 172.21.15.37:0/910530356 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6000b870 con 0x7faf700b5e00 2023-07-14T15:57:55.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.783+0000 7faf74d99700 1 -- 172.21.15.37:0/910530356 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf6000b9d0 con 0x7faf700b5e00 2023-07-14T15:57:55.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.783+0000 7faf74d99700 1 -- 172.21.15.37:0/910530356 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6000bd60 con 0x7faf700b5e00 2023-07-14T15:57:55.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.784+0000 7faf77fff700 1 -- 172.21.15.37:0/910530356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf700b5e00 msgr2=0x7faf700d0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:55.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.784+0000 7faf77fff700 1 --2- 172.21.15.37:0/910530356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf700b5e00 0x7faf700d0eb0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7faf7009c910 tx=0x7faf60009bd0 comp rx=0 tx=0).stop 2023-07-14T15:57:55.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.784+0000 7faf77fff700 1 -- 172.21.15.37:0/910530356 shutdown_connections 2023-07-14T15:57:55.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.784+0000 7faf77fff700 1 --2- 172.21.15.37:0/910530356 >> v2:172.21.15.98:3300/0 conn(0x7faf700d13f0 0x7faf700cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:55.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.784+0000 7faf77fff700 1 --2- 172.21.15.37:0/910530356 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7faf700b8900 0x7faf700cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:55.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.784+0000 7faf77fff700 1 --2- 172.21.15.37:0/910530356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf700b5e00 0x7faf700d0eb0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:55.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.784+0000 7faf77fff700 1 -- 172.21.15.37:0/910530356 >> 172.21.15.37:0/910530356 conn(0x7faf7009c1e0 msgr2=0x7faf700d2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:55.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.784+0000 7faf77fff700 1 -- 172.21.15.37:0/910530356 shutdown_connections 2023-07-14T15:57:55.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.784+0000 7faf77fff700 1 -- 172.21.15.37:0/910530356 wait complete. 2023-07-14T15:57:55.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.786+0000 7faf77fff700 1 Processor -- start 2023-07-14T15:57:55.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.786+0000 7faf77fff700 1 -- start start 2023-07-14T15:57:55.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.788+0000 7faf77fff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7faf700b5e00 0x7faf7015a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:55.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.788+0000 7faf77fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf700b8900 0x7faf700ca060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:55.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.788+0000 7faf77fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf700d13f0 0x7faf700caad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:55.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.788+0000 7faf77fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf700b8400 con 0x7faf700b8900 2023-07-14T15:57:55.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.788+0000 7faf77fff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf700b77f0 con 0x7faf700d13f0 2023-07-14T15:57:55.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.788+0000 7faf77fff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf700b7ad0 con 0x7faf700b5e00 2023-07-14T15:57:55.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.788+0000 7faf7559a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf700b8900 0x7faf700ca060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:55.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.788+0000 7faf75d9b700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7faf700b5e00 0x7faf7015a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:55.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.788+0000 7faf7559a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf700b8900 0x7faf700ca060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44938/0 (socket says 172.21.15.37:44938) 2023-07-14T15:57:55.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.788+0000 7faf7559a700 1 -- 172.21.15.37:0/3226653596 learned_addr learned my addr 172.21.15.37:0/3226653596 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:55.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.788+0000 7faf7659c700 1 --2- 172.21.15.37:0/3226653596 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf700d13f0 0x7faf700caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:55.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.788+0000 7faf7559a700 1 -- 172.21.15.37:0/3226653596 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7faf700b5e00 msgr2=0x7faf7015a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:55.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.788+0000 7faf7559a700 1 --2- 172.21.15.37:0/3226653596 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7faf700b5e00 0x7faf7015a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:55.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.788+0000 7faf7559a700 1 -- 172.21.15.37:0/3226653596 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf700d13f0 msgr2=0x7faf700caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:55.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.788+0000 7faf7559a700 1 --2- 172.21.15.37:0/3226653596 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf700d13f0 0x7faf700caad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:55.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.788+0000 7faf7559a700 1 -- 172.21.15.37:0/3226653596 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf60009550 con 0x7faf700b8900 2023-07-14T15:57:55.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.789+0000 7faf7559a700 1 --2- 172.21.15.37:0/3226653596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf700b8900 0x7faf700ca060 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7faf60000c00 tx=0x7faf60004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:55.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.789+0000 7faf667fc700 1 -- 172.21.15.37:0/3226653596 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf60004310 con 0x7faf700b8900 2023-07-14T15:57:55.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.789+0000 7faf667fc700 1 -- 172.21.15.37:0/3226653596 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf6001e070 con 0x7faf700b8900 2023-07-14T15:57:55.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.789+0000 7faf77fff700 1 -- 172.21.15.37:0/3226653596 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf700b7db0 con 0x7faf700b8900 2023-07-14T15:57:55.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.789+0000 7faf667fc700 1 -- 172.21.15.37:0/3226653596 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf600036a0 con 0x7faf700b8900 2023-07-14T15:57:55.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.789+0000 7faf77fff700 1 -- 172.21.15.37:0/3226653596 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf7015aa70 con 0x7faf700b8900 2023-07-14T15:57:55.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.790+0000 7faf77fff700 1 -- 172.21.15.37:0/3226653596 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf700d2060 con 0x7faf700b8900 2023-07-14T15:57:55.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.791+0000 7faf667fc700 1 -- 172.21.15.37:0/3226653596 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7faf60020030 con 0x7faf700b8900 2023-07-14T15:57:55.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.792+0000 7faf667fc700 1 --2- 172.21.15.37:0/3226653596 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7faf5406ad70 0x7faf5406d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:55.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.793+0000 7faf667fc700 1 -- 172.21.15.37:0/3226653596 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6120+0+0 (secure 0 0 0) 0x7faf6008a430 con 0x7faf700b8900 2023-07-14T15:57:55.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.793+0000 7faf75d9b700 1 --2- 172.21.15.37:0/3226653596 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7faf5406ad70 0x7faf5406d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:55.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.793+0000 7faf75d9b700 1 --2- 172.21.15.37:0/3226653596 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7faf5406ad70 0x7faf5406d220 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7faf6c006b40 tx=0x7faf6c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:55.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:55.798+0000 7faf667fc700 1 -- 172.21.15.37:0/3226653596 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7faf60055440 con 0x7faf700b8900 2023-07-14T15:57:56.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.055+0000 7faf77fff700 1 -- 172.21.15.37:0/3226653596 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7faf7004e210 con 0x7faf700b8900 2023-07-14T15:57:56.039 INFO:tasks.ceph.mon.a.smithi037.stderr:2023-07-14T15:57:56.056+0000 7f853c3f4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-14T15:57:56.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.064+0000 7faf667fc700 1 -- 172.21.15.37:0/3226653596 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) v1 ==== 161+0+0 (secure 0 0 0) 0x7faf60058a60 con 0x7faf700b8900 2023-07-14T15:57:56.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.066+0000 7faf77fff700 1 -- 172.21.15.37:0/3226653596 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7faf5406ad70 msgr2=0x7faf5406d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:56.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.066+0000 7faf77fff700 1 --2- 172.21.15.37:0/3226653596 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7faf5406ad70 0x7faf5406d220 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7faf6c006b40 tx=0x7faf6c008040 comp rx=0 tx=0).stop 2023-07-14T15:57:56.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.066+0000 7faf77fff700 1 -- 172.21.15.37:0/3226653596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf700b8900 msgr2=0x7faf700ca060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:56.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.066+0000 7faf77fff700 1 --2- 172.21.15.37:0/3226653596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf700b8900 0x7faf700ca060 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7faf60000c00 tx=0x7faf60004750 comp rx=0 tx=0).stop 2023-07-14T15:57:56.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.067+0000 7faf77fff700 1 -- 172.21.15.37:0/3226653596 shutdown_connections 2023-07-14T15:57:56.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.067+0000 7faf77fff700 1 --2- 172.21.15.37:0/3226653596 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf700d13f0 0x7faf700caad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:56.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.067+0000 7faf77fff700 1 --2- 172.21.15.37:0/3226653596 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7faf5406ad70 0x7faf5406d220 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:56.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.067+0000 7faf77fff700 1 --2- 172.21.15.37:0/3226653596 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7faf700b5e00 0x7faf7015a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:56.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.067+0000 7faf77fff700 1 --2- 172.21.15.37:0/3226653596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf700b8900 0x7faf700ca060 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:56.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.067+0000 7faf77fff700 1 -- 172.21.15.37:0/3226653596 >> 172.21.15.37:0/3226653596 conn(0x7faf7009c1e0 msgr2=0x7faf700d3470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:56.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.067+0000 7faf77fff700 1 -- 172.21.15.37:0/3226653596 shutdown_connections 2023-07-14T15:57:56.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.067+0000 7faf77fff700 1 -- 172.21.15.37:0/3226653596 wait complete. 2023-07-14T15:57:56.053 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-14T15:57:56.056 INFO:tasks.ceph.mds.c.smithi037.stderr: -5714> 2023-07-14T15:57:28.824+0000 7f158d5f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-14T15:57:56.070 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-14T15:57:56.111 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-07-14T15:57:56.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.292+0000 7f1e993ff700 1 Processor -- start 2023-07-14T15:57:56.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.292+0000 7f1e993ff700 1 -- start start 2023-07-14T15:57:56.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.293+0000 7f1e993ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1e94071730 0x7f1e9406f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:56.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.293+0000 7f1e993ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1e940ae000 0x7f1e9406b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:56.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.293+0000 7f1e993ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f1e9406bf00 0x7f1e940cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:56.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.293+0000 7f1e993ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e940ae4a0 con 0x7f1e94071730 2023-07-14T15:57:56.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.293+0000 7f1e993ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e94159870 con 0x7f1e940ae000 2023-07-14T15:57:56.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.293+0000 7f1e993ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e940ca790 con 0x7f1e9406bf00 2023-07-14T15:57:56.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.294+0000 7f1e92ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1e94071730 0x7f1e9406f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:56.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.294+0000 7f1e92ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1e94071730 0x7f1e9406f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44960/0 (socket says 172.21.15.37:44960) 2023-07-14T15:57:56.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.294+0000 7f1e92ffd700 1 -- 172.21.15.37:0/1142354140 learned_addr learned my addr 172.21.15.37:0/1142354140 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:56.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.294+0000 7f1e937fe700 1 --2- 172.21.15.37:0/1142354140 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f1e9406bf00 0x7f1e940cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:56.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.294+0000 7f1e927fc700 1 --2- 172.21.15.37:0/1142354140 >> v2:172.21.15.98:3300/0 conn(0x7f1e940ae000 0x7f1e9406b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:56.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.294+0000 7f1e92ffd700 1 -- 172.21.15.37:0/1142354140 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f1e9406bf00 msgr2=0x7f1e940cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:56.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.294+0000 7f1e92ffd700 1 --2- 172.21.15.37:0/1142354140 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f1e9406bf00 0x7f1e940cd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:56.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.294+0000 7f1e92ffd700 1 -- 172.21.15.37:0/1142354140 >> v2:172.21.15.98:3300/0 conn(0x7f1e940ae000 msgr2=0x7f1e9406b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:56.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.294+0000 7f1e92ffd700 1 --2- 172.21.15.37:0/1142354140 >> v2:172.21.15.98:3300/0 conn(0x7f1e940ae000 0x7f1e9406b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:56.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.294+0000 7f1e92ffd700 1 -- 172.21.15.37:0/1142354140 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e9406c300 con 0x7f1e94071730 2023-07-14T15:57:56.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.294+0000 7f1e937fe700 1 --2- 172.21.15.37:0/1142354140 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f1e9406bf00 0x7f1e940cd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:57:56.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.294+0000 7f1e927fc700 1 --2- 172.21.15.37:0/1142354140 >> v2:172.21.15.98:3300/0 conn(0x7f1e940ae000 0x7f1e9406b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:57:56.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.294+0000 7f1e92ffd700 1 --2- 172.21.15.37:0/1142354140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e94071730 0x7f1e9406f740 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f1e940cab30 tx=0x7f1e8400be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78e67e91e5671076 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:56.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.295+0000 7f1e91ffb700 1 -- 172.21.15.37:0/1142354140 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8400dd30 con 0x7f1e94071730 2023-07-14T15:57:56.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.295+0000 7f1e91ffb700 1 -- 172.21.15.37:0/1142354140 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e8400de90 con 0x7f1e94071730 2023-07-14T15:57:56.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.295+0000 7f1e91ffb700 1 -- 172.21.15.37:0/1142354140 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e84010690 con 0x7f1e94071730 2023-07-14T15:57:56.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.295+0000 7f1e993ff700 1 -- 172.21.15.37:0/1142354140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e94071730 msgr2=0x7f1e9406f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:56.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.295+0000 7f1e993ff700 1 --2- 172.21.15.37:0/1142354140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e94071730 0x7f1e9406f740 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f1e940cab30 tx=0x7f1e8400be70 comp rx=0 tx=0).stop 2023-07-14T15:57:56.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.295+0000 7f1e993ff700 1 -- 172.21.15.37:0/1142354140 shutdown_connections 2023-07-14T15:57:56.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.295+0000 7f1e993ff700 1 --2- 172.21.15.37:0/1142354140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e94071730 0x7f1e9406f740 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:56.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.295+0000 7f1e993ff700 1 --2- 172.21.15.37:0/1142354140 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f1e9406bf00 0x7f1e940cd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:56.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.295+0000 7f1e993ff700 1 --2- 172.21.15.37:0/1142354140 >> v2:172.21.15.98:3300/0 conn(0x7f1e940ae000 0x7f1e9406b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:56.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.295+0000 7f1e993ff700 1 -- 172.21.15.37:0/1142354140 >> 172.21.15.37:0/1142354140 conn(0x7f1e9406aac0 msgr2=0x7f1e940b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:56.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.295+0000 7f1e993ff700 1 -- 172.21.15.37:0/1142354140 shutdown_connections 2023-07-14T15:57:56.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.295+0000 7f1e993ff700 1 -- 172.21.15.37:0/1142354140 wait complete. 2023-07-14T15:57:56.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.297+0000 7f1e993ff700 1 Processor -- start 2023-07-14T15:57:56.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.297+0000 7f1e993ff700 1 -- start start 2023-07-14T15:57:56.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.298+0000 7f1e993ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1e9406bf00 0x7f1e9414d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:56.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.298+0000 7f1e993ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e94071730 0x7f1e9415a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:56.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.298+0000 7f1e993ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f1e940ae000 0x7f1e940b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:56.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.298+0000 7f1e993ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9415a900 con 0x7f1e94071730 2023-07-14T15:57:56.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.298+0000 7f1e993ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9415c2d0 con 0x7f1e9406bf00 2023-07-14T15:57:56.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.298+0000 7f1e993ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9415ab30 con 0x7f1e940ae000 2023-07-14T15:57:56.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.298+0000 7f1e927fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e94071730 0x7f1e9415a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:56.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.298+0000 7f1e927fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e94071730 0x7f1e9415a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44970/0 (socket says 172.21.15.37:44970) 2023-07-14T15:57:56.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.298+0000 7f1e927fc700 1 -- 172.21.15.37:0/942111240 learned_addr learned my addr 172.21.15.37:0/942111240 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:56.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.298+0000 7f1e937fe700 1 --2- 172.21.15.37:0/942111240 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f1e940ae000 0x7f1e940b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:56.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.299+0000 7f1e92ffd700 1 --2- 172.21.15.37:0/942111240 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1e9406bf00 0x7f1e9414d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:56.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.299+0000 7f1e927fc700 1 -- 172.21.15.37:0/942111240 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f1e940ae000 msgr2=0x7f1e940b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:56.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.299+0000 7f1e927fc700 1 --2- 172.21.15.37:0/942111240 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f1e940ae000 0x7f1e940b3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:56.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.299+0000 7f1e927fc700 1 -- 172.21.15.37:0/942111240 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1e9406bf00 msgr2=0x7f1e9414d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:56.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.299+0000 7f1e927fc700 1 --2- 172.21.15.37:0/942111240 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1e9406bf00 0x7f1e9414d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:56.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.299+0000 7f1e927fc700 1 -- 172.21.15.37:0/942111240 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e8400b7f0 con 0x7f1e94071730 2023-07-14T15:57:56.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.299+0000 7f1e92ffd700 1 --2- 172.21.15.37:0/942111240 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1e9406bf00 0x7f1e9414d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:57:56.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.299+0000 7f1e927fc700 1 --2- 172.21.15.37:0/942111240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e94071730 0x7f1e9415a3c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1e8800c7f0 tx=0x7f1e8800cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:56.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.299+0000 7f1e7b7fe700 1 -- 172.21.15.37:0/942111240 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e88011800 con 0x7f1e94071730 2023-07-14T15:57:56.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.299+0000 7f1e7b7fe700 1 -- 172.21.15.37:0/942111240 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e88011960 con 0x7f1e94071730 2023-07-14T15:57:56.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.299+0000 7f1e993ff700 1 -- 172.21.15.37:0/942111240 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e9415ae10 con 0x7f1e94071730 2023-07-14T15:57:56.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.299+0000 7f1e7b7fe700 1 -- 172.21.15.37:0/942111240 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e88011cf0 con 0x7f1e94071730 2023-07-14T15:57:56.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.300+0000 7f1e993ff700 1 -- 172.21.15.37:0/942111240 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e9415c620 con 0x7f1e94071730 2023-07-14T15:57:56.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.301+0000 7f1e993ff700 1 -- 172.21.15.37:0/942111240 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e940cb300 con 0x7f1e94071730 2023-07-14T15:57:56.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.302+0000 7f1e7b7fe700 1 -- 172.21.15.37:0/942111240 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f1e88018360 con 0x7f1e94071730 2023-07-14T15:57:56.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.302+0000 7f1e7b7fe700 1 --2- 172.21.15.37:0/942111240 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f1e8006ad70 0x7f1e8006d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:56.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.303+0000 7f1e7b7fe700 1 -- 172.21.15.37:0/942111240 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f1e880896b0 con 0x7f1e94071730 2023-07-14T15:57:56.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.303+0000 7f1e92ffd700 1 --2- 172.21.15.37:0/942111240 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f1e8006ad70 0x7f1e8006d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:56.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.304+0000 7f1e92ffd700 1 --2- 172.21.15.37:0/942111240 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f1e8006ad70 0x7f1e8006d220 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1e8400beb0 tx=0x7f1e84012000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:56.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.307+0000 7f1e7b7fe700 1 -- 172.21.15.37:0/942111240 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1e880544e0 con 0x7f1e94071730 2023-07-14T15:57:56.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:56.558+0000 7f1e993ff700 1 -- 172.21.15.37:0/942111240 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1e940ce880 con 0x7f1e94071730 2023-07-14T15:57:57.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.065+0000 7f1e7b7fe700 1 -- 172.21.15.37:0/942111240 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1e88057b00 con 0x7f1e94071730 2023-07-14T15:57:57.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.068+0000 7f1e993ff700 1 -- 172.21.15.37:0/942111240 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f1e8006ad70 msgr2=0x7f1e8006d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:57.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.068+0000 7f1e993ff700 1 --2- 172.21.15.37:0/942111240 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f1e8006ad70 0x7f1e8006d220 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1e8400beb0 tx=0x7f1e84012000 comp rx=0 tx=0).stop 2023-07-14T15:57:57.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.068+0000 7f1e993ff700 1 -- 172.21.15.37:0/942111240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e94071730 msgr2=0x7f1e9415a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:57.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.068+0000 7f1e993ff700 1 --2- 172.21.15.37:0/942111240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e94071730 0x7f1e9415a3c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1e8800c7f0 tx=0x7f1e8800cb00 comp rx=0 tx=0).stop 2023-07-14T15:57:57.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.069+0000 7f1e993ff700 1 -- 172.21.15.37:0/942111240 shutdown_connections 2023-07-14T15:57:57.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.069+0000 7f1e993ff700 1 --2- 172.21.15.37:0/942111240 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1e9406bf00 0x7f1e9414d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:57.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.069+0000 7f1e993ff700 1 --2- 172.21.15.37:0/942111240 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f1e8006ad70 0x7f1e8006d220 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:57.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.069+0000 7f1e993ff700 1 --2- 172.21.15.37:0/942111240 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f1e940ae000 0x7f1e940b3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:57.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.069+0000 7f1e993ff700 1 --2- 172.21.15.37:0/942111240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e94071730 0x7f1e9415a3c0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:57.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.069+0000 7f1e993ff700 1 -- 172.21.15.37:0/942111240 >> 172.21.15.37:0/942111240 conn(0x7f1e9406aac0 msgr2=0x7f1e94158c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:57.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.069+0000 7f1e993ff700 1 -- 172.21.15.37:0/942111240 shutdown_connections 2023-07-14T15:57:57.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.069+0000 7f1e993ff700 1 -- 172.21.15.37:0/942111240 wait complete. 2023-07-14T15:57:57.074 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-14T15:57:57.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.341+0000 7f284a3ff700 1 Processor -- start 2023-07-14T15:57:57.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.341+0000 7f284a3ff700 1 -- start start 2023-07-14T15:57:57.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.342+0000 7f284a3ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2844154870 0x7f284415b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:57.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.342+0000 7f284a3ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f28440ca360 0x7f28440b0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:57.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.342+0000 7f284a3ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f284415e000 con 0x7f2844154c40 2023-07-14T15:57:57.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.342+0000 7f284a3ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28440719d0 con 0x7f2844154870 2023-07-14T15:57:57.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.342+0000 7f284a3ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f284415e2a0 con 0x7f28440ca360 2023-07-14T15:57:57.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.342+0000 7f2843fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2844154870 0x7f284415b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:57.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.342+0000 7f2843fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2844154870 0x7f284415b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44976/0 (socket says 172.21.15.37:44976) 2023-07-14T15:57:57.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.342+0000 7f284899c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2844154c40 0x7f284406caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34460/0 (socket says 172.21.15.37:34460) 2023-07-14T15:57:57.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.342+0000 7f2843fff700 1 -- 172.21.15.37:0/1593090144 learned_addr learned my addr 172.21.15.37:0/1593090144 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:57.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.342+0000 7f28437fe700 1 --2- 172.21.15.37:0/1593090144 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f28440ca360 0x7f28440b0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:57.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.343+0000 7f2843fff700 1 -- 172.21.15.37:0/1593090144 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f28440ca360 msgr2=0x7f28440b0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:57.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.343+0000 7f2843fff700 1 --2- 172.21.15.37:0/1593090144 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f28440ca360 0x7f28440b0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:57.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.343+0000 7f2843fff700 1 -- 172.21.15.37:0/1593090144 >> v1:172.21.15.37:6789/0 conn(0x7f2844154c40 legacy=0x7f284406caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:57.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.343+0000 7f2843fff700 1 -- 172.21.15.37:0/1593090144 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f284415e580 con 0x7f2844154870 2023-07-14T15:57:57.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.343+0000 7f2842ffd700 1 -- 172.21.15.37:0/1593090144 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3564387327 0 0) 0x7f284415e000 con 0x7f2844154c40 2023-07-14T15:57:57.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.343+0000 7f2843fff700 1 --2- 172.21.15.37:0/1593090144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2844154870 0x7f284415b390 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f28340098f0 tx=0x7f2834009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=744e0edf102e2901 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:57.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.343+0000 7f2842ffd700 1 -- 172.21.15.37:0/1593090144 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2834011830 con 0x7f2844154870 2023-07-14T15:57:57.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.343+0000 7f2842ffd700 1 -- 172.21.15.37:0/1593090144 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2834011990 con 0x7f2844154870 2023-07-14T15:57:57.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.343+0000 7f2842ffd700 1 -- 172.21.15.37:0/1593090144 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2834011d20 con 0x7f2844154870 2023-07-14T15:57:57.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.344+0000 7f284a3ff700 1 -- 172.21.15.37:0/1593090144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2844154870 msgr2=0x7f284415b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:57.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.344+0000 7f284a3ff700 1 --2- 172.21.15.37:0/1593090144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2844154870 0x7f284415b390 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f28340098f0 tx=0x7f2834009c00 comp rx=0 tx=0).stop 2023-07-14T15:57:57.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.344+0000 7f284a3ff700 1 -- 172.21.15.37:0/1593090144 shutdown_connections 2023-07-14T15:57:57.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.344+0000 7f284a3ff700 1 --2- 172.21.15.37:0/1593090144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2844154870 0x7f284415b390 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:57.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.344+0000 7f284a3ff700 1 --2- 172.21.15.37:0/1593090144 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f28440ca360 0x7f28440b0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:57.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.344+0000 7f284a3ff700 1 -- 172.21.15.37:0/1593090144 >> 172.21.15.37:0/1593090144 conn(0x7f28440cb470 msgr2=0x7f28440cb870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:57.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.344+0000 7f284a3ff700 1 -- 172.21.15.37:0/1593090144 shutdown_connections 2023-07-14T15:57:57.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.344+0000 7f284a3ff700 1 -- 172.21.15.37:0/1593090144 wait complete. 2023-07-14T15:57:57.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.346+0000 7f284a3ff700 1 Processor -- start 2023-07-14T15:57:57.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.346+0000 7f284a3ff700 1 -- start start 2023-07-14T15:57:57.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.347+0000 7f284a3ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2844154870 0x7f28440c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:57.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.347+0000 7f284a3ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2844154c40 0x7f28440b2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:57.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.347+0000 7f284a3ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28440c5030 0x7f28440b2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:57.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.347+0000 7f284a3ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28440c5790 con 0x7f2844154870 2023-07-14T15:57:57.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.347+0000 7f284a3ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28440c54b0 con 0x7f28440c5030 2023-07-14T15:57:57.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.347+0000 7f284a3ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28441419c0 con 0x7f2844154c40 2023-07-14T15:57:57.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.347+0000 7f2843fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2844154870 0x7f28440c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:57.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.347+0000 7f2843fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2844154870 0x7f28440c97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44990/0 (socket says 172.21.15.37:44990) 2023-07-14T15:57:57.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.347+0000 7f2843fff700 1 -- 172.21.15.37:0/799971648 learned_addr learned my addr 172.21.15.37:0/799971648 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:57.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.347+0000 7f28437fe700 1 --2- 172.21.15.37:0/799971648 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2844154c40 0x7f28440b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:57.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.347+0000 7f284899c700 1 --2- 172.21.15.37:0/799971648 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28440c5030 0x7f28440b2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:57.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.348+0000 7f2843fff700 1 -- 172.21.15.37:0/799971648 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2844154c40 msgr2=0x7f28440b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:57.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.348+0000 7f2843fff700 1 --2- 172.21.15.37:0/799971648 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2844154c40 0x7f28440b2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:57.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.348+0000 7f2843fff700 1 -- 172.21.15.37:0/799971648 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28440c5030 msgr2=0x7f28440b2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:57.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.348+0000 7f2843fff700 1 --2- 172.21.15.37:0/799971648 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28440c5030 0x7f28440b2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:57.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.348+0000 7f2843fff700 1 -- 172.21.15.37:0/799971648 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2834009550 con 0x7f2844154870 2023-07-14T15:57:57.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.348+0000 7f284899c700 1 --2- 172.21.15.37:0/799971648 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28440c5030 0x7f28440b2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:57:57.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.348+0000 7f2843fff700 1 --2- 172.21.15.37:0/799971648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2844154870 0x7f28440c97d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f2844070470 tx=0x7f2834004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:57.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.348+0000 7f2840ff9700 1 -- 172.21.15.37:0/799971648 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2834004480 con 0x7f2844154870 2023-07-14T15:57:57.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.348+0000 7f2840ff9700 1 -- 172.21.15.37:0/799971648 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f283401f070 con 0x7f2844154870 2023-07-14T15:57:57.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.348+0000 7f284a3ff700 1 -- 172.21.15.37:0/799971648 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2844141ca0 con 0x7f2844154870 2023-07-14T15:57:57.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.348+0000 7f2840ff9700 1 -- 172.21.15.37:0/799971648 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28340038a0 con 0x7f2844154870 2023-07-14T15:57:57.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.348+0000 7f284a3ff700 1 -- 172.21.15.37:0/799971648 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28440c9d10 con 0x7f2844154870 2023-07-14T15:57:57.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.349+0000 7f284a3ff700 1 -- 172.21.15.37:0/799971648 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28440c2230 con 0x7f2844154870 2023-07-14T15:57:57.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.350+0000 7f2840ff9700 1 -- 172.21.15.37:0/799971648 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f2834021030 con 0x7f2844154870 2023-07-14T15:57:57.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.351+0000 7f2840ff9700 1 --2- 172.21.15.37:0/799971648 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f283006ad70 0x7f283006d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:57.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.351+0000 7f2840ff9700 1 -- 172.21.15.37:0/799971648 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f283408aaf0 con 0x7f2844154870 2023-07-14T15:57:57.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.352+0000 7f28437fe700 1 --2- 172.21.15.37:0/799971648 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f283006ad70 0x7f283006d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:57.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.352+0000 7f28437fe700 1 --2- 172.21.15.37:0/799971648 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f283006ad70 0x7f283006d220 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f284415a5b0 tx=0x7f2838008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:57.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.355+0000 7f2840ff9700 1 -- 172.21.15.37:0/799971648 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2834055bd0 con 0x7f2844154870 2023-07-14T15:57:57.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:57.565+0000 7f284a3ff700 1 -- 172.21.15.37:0/799971648 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2844067840 con 0x7f2844154870 2023-07-14T15:57:58.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.071+0000 7f2840ff9700 1 -- 172.21.15.37:0/799971648 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v40) v1 ==== 181+0+0 (secure 0 0 0) 0x7f28340591f0 con 0x7f2844154870 2023-07-14T15:57:58.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.074+0000 7f284a3ff700 1 -- 172.21.15.37:0/799971648 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f283006ad70 msgr2=0x7f283006d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:58.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.074+0000 7f284a3ff700 1 --2- 172.21.15.37:0/799971648 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f283006ad70 0x7f283006d220 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f284415a5b0 tx=0x7f2838008040 comp rx=0 tx=0).stop 2023-07-14T15:57:58.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.074+0000 7f284a3ff700 1 -- 172.21.15.37:0/799971648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2844154870 msgr2=0x7f28440c97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:58.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.074+0000 7f284a3ff700 1 --2- 172.21.15.37:0/799971648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2844154870 0x7f28440c97d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f2844070470 tx=0x7f2834004750 comp rx=0 tx=0).stop 2023-07-14T15:57:58.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.075+0000 7f284a3ff700 1 -- 172.21.15.37:0/799971648 shutdown_connections 2023-07-14T15:57:58.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.075+0000 7f284a3ff700 1 --2- 172.21.15.37:0/799971648 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28440c5030 0x7f28440b2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:58.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.075+0000 7f284a3ff700 1 --2- 172.21.15.37:0/799971648 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f283006ad70 0x7f283006d220 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:58.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.075+0000 7f284a3ff700 1 --2- 172.21.15.37:0/799971648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2844154870 0x7f28440c97d0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:58.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.075+0000 7f284a3ff700 1 --2- 172.21.15.37:0/799971648 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2844154c40 0x7f28440b2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:58.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.075+0000 7f284a3ff700 1 -- 172.21.15.37:0/799971648 >> 172.21.15.37:0/799971648 conn(0x7f28440cb470 msgr2=0x7f28440b0310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:58.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.075+0000 7f284a3ff700 1 -- 172.21.15.37:0/799971648 shutdown_connections 2023-07-14T15:57:58.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.075+0000 7f284a3ff700 1 -- 172.21.15.37:0/799971648 wait complete. 2023-07-14T15:57:58.062 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2023-07-14T15:57:58.078 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-14T15:57:58.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.301+0000 7fcbf79ff700 1 Processor -- start 2023-07-14T15:57:58.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.301+0000 7fcbf79ff700 1 -- start start 2023-07-14T15:57:58.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.302+0000 7fcbf79ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcbf01462d0 0x7fcbf00cd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:58.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.302+0000 7fcbf79ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbf00d1270 con 0x7fcbf00d2310 2023-07-14T15:57:58.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.302+0000 7fcbf79ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbf00d1550 con 0x7fcbf00cf780 2023-07-14T15:57:58.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.302+0000 7fcbf79ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbf00d1830 con 0x7fcbf01462d0 2023-07-14T15:57:58.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.302+0000 7fcbf579b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcbf01462d0 0x7fcbf00cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:58.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.302+0000 7fcbf579b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcbf01462d0 0x7fcbf00cd890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44994/0 (socket says 172.21.15.37:44994) 2023-07-14T15:57:58.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.302+0000 7fcbf579b700 1 -- 172.21.15.37:0/17205996 learned_addr learned my addr 172.21.15.37:0/17205996 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:58.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.302+0000 7fcbf4f9a700 1 --1- 172.21.15.37:0/17205996 >> v1:172.21.15.37:6789/0 conn(0x7fcbf00d2310 0x7fcbf00d09d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34464/0 (socket says 172.21.15.37:34464) 2023-07-14T15:57:58.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.303+0000 7fcbf579b700 1 -- 172.21.15.37:0/17205996 >> v1:172.21.15.98:6789/0 conn(0x7fcbf00cf780 legacy=0x7fcbf00cfba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:58.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.303+0000 7fcbf579b700 1 -- 172.21.15.37:0/17205996 >> v1:172.21.15.37:6789/0 conn(0x7fcbf00d2310 legacy=0x7fcbf00d09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:58.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.303+0000 7fcbf579b700 1 -- 172.21.15.37:0/17205996 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf00d1b10 con 0x7fcbf01462d0 2023-07-14T15:57:58.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.303+0000 7fcbe7fff700 1 -- 172.21.15.37:0/17205996 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1154554457 0 0) 0x7fcbf00d1270 con 0x7fcbf00d2310 2023-07-14T15:57:58.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.303+0000 7fcbf579b700 1 --2- 172.21.15.37:0/17205996 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbf01462d0 0x7fcbf00cd890 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fcbec0098f0 tx=0x7fcbec009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ebee2613108da2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:58.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.303+0000 7fcbe7fff700 1 -- 172.21.15.37:0/17205996 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbec00b8a0 con 0x7fcbf01462d0 2023-07-14T15:57:58.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.303+0000 7fcbe7fff700 1 -- 172.21.15.37:0/17205996 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbec00ba00 con 0x7fcbf01462d0 2023-07-14T15:57:58.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.303+0000 7fcbe7fff700 1 -- 172.21.15.37:0/17205996 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbec00bd90 con 0x7fcbf01462d0 2023-07-14T15:57:58.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.304+0000 7fcbf79ff700 1 -- 172.21.15.37:0/17205996 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbf01462d0 msgr2=0x7fcbf00cd890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:58.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.304+0000 7fcbf79ff700 1 --2- 172.21.15.37:0/17205996 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbf01462d0 0x7fcbf00cd890 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fcbec0098f0 tx=0x7fcbec009c00 comp rx=0 tx=0).stop 2023-07-14T15:57:58.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.304+0000 7fcbf79ff700 1 -- 172.21.15.37:0/17205996 shutdown_connections 2023-07-14T15:57:58.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.304+0000 7fcbf79ff700 1 --2- 172.21.15.37:0/17205996 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbf01462d0 0x7fcbf00cd890 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:58.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.304+0000 7fcbf79ff700 1 -- 172.21.15.37:0/17205996 >> 172.21.15.37:0/17205996 conn(0x7fcbf006a4d0 msgr2=0x7fcbf006a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:58.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.304+0000 7fcbf79ff700 1 -- 172.21.15.37:0/17205996 shutdown_connections 2023-07-14T15:57:58.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.304+0000 7fcbf79ff700 1 -- 172.21.15.37:0/17205996 wait complete. 2023-07-14T15:57:58.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.306+0000 7fcbf79ff700 1 Processor -- start 2023-07-14T15:57:58.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.306+0000 7fcbf79ff700 1 -- start start 2023-07-14T15:57:58.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.307+0000 7fcbf79ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbf00cf780 0x7fcbf015aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:58.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.307+0000 7fcbf79ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcbf00d2310 0x7fcbf015b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:58.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.307+0000 7fcbf79ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbf01462d0 0x7fcbf00c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:58.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.307+0000 7fcbf79ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf00c9410 con 0x7fcbf01462d0 2023-07-14T15:57:58.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.307+0000 7fcbf79ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf015b730 con 0x7fcbf00cf780 2023-07-14T15:57:58.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.307+0000 7fcbf79ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf00c7450 con 0x7fcbf00d2310 2023-07-14T15:57:58.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.307+0000 7fcbf5f9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbf01462d0 0x7fcbf00c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:58.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.307+0000 7fcbf5f9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbf01462d0 0x7fcbf00c8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45004/0 (socket says 172.21.15.37:45004) 2023-07-14T15:57:58.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.307+0000 7fcbf5f9c700 1 -- 172.21.15.37:0/2852711417 learned_addr learned my addr 172.21.15.37:0/2852711417 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:58.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.307+0000 7fcbf4f9a700 1 --2- 172.21.15.37:0/2852711417 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcbf00d2310 0x7fcbf015b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:58.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.307+0000 7fcbf579b700 1 --2- 172.21.15.37:0/2852711417 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbf00cf780 0x7fcbf015aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:58.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.308+0000 7fcbf5f9c700 1 -- 172.21.15.37:0/2852711417 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcbf00d2310 msgr2=0x7fcbf015b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:58.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.308+0000 7fcbf5f9c700 1 --2- 172.21.15.37:0/2852711417 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcbf00d2310 0x7fcbf015b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:58.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.308+0000 7fcbf5f9c700 1 -- 172.21.15.37:0/2852711417 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbf00cf780 msgr2=0x7fcbf015aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:58.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.308+0000 7fcbf5f9c700 1 --2- 172.21.15.37:0/2852711417 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbf00cf780 0x7fcbf015aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:58.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.308+0000 7fcbf5f9c700 1 -- 172.21.15.37:0/2852711417 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbec009550 con 0x7fcbf01462d0 2023-07-14T15:57:58.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.308+0000 7fcbf579b700 1 --2- 172.21.15.37:0/2852711417 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbf00cf780 0x7fcbf015aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:57:58.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.308+0000 7fcbf5f9c700 1 --2- 172.21.15.37:0/2852711417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbf01462d0 0x7fcbf00c8ed0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fcbe800cc50 tx=0x7fcbe800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:58.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.308+0000 7fcbe5ffb700 1 -- 172.21.15.37:0/2852711417 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe800ad80 con 0x7fcbf01462d0 2023-07-14T15:57:58.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.308+0000 7fcbe5ffb700 1 -- 172.21.15.37:0/2852711417 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe800ce50 con 0x7fcbf01462d0 2023-07-14T15:57:58.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.308+0000 7fcbe5ffb700 1 -- 172.21.15.37:0/2852711417 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8003c40 con 0x7fcbf01462d0 2023-07-14T15:57:58.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.308+0000 7fcbf79ff700 1 -- 172.21.15.37:0/2852711417 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbf00c7730 con 0x7fcbf01462d0 2023-07-14T15:57:58.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.308+0000 7fcbf79ff700 1 -- 172.21.15.37:0/2852711417 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbf00c7cf0 con 0x7fcbf01462d0 2023-07-14T15:57:58.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.309+0000 7fcbf79ff700 1 -- 172.21.15.37:0/2852711417 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbf00c7f10 con 0x7fcbf01462d0 2023-07-14T15:57:58.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.310+0000 7fcbe5ffb700 1 -- 172.21.15.37:0/2852711417 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7fcbe80050d0 con 0x7fcbf01462d0 2023-07-14T15:57:58.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.311+0000 7fcbe5ffb700 1 --2- 172.21.15.37:0/2852711417 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fcbd406ad70 0x7fcbd406d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:58.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.311+0000 7fcbe5ffb700 1 -- 172.21.15.37:0/2852711417 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5768+0+0 (secure 0 0 0) 0x7fcbe80894e0 con 0x7fcbf01462d0 2023-07-14T15:57:58.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.312+0000 7fcbf579b700 1 --2- 172.21.15.37:0/2852711417 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fcbd406ad70 0x7fcbd406d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:58.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.312+0000 7fcbf579b700 1 --2- 172.21.15.37:0/2852711417 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fcbd406ad70 0x7fcbd406d220 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fcbec009130 tx=0x7fcbec01c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:58.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.315+0000 7fcbe5ffb700 1 -- 172.21.15.37:0/2852711417 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fcbe8054650 con 0x7fcbf01462d0 2023-07-14T15:57:58.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:58.528+0000 7fcbf79ff700 1 -- 172.21.15.37:0/2852711417 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcbf0067840 con 0x7fcbf01462d0 2023-07-14T15:57:58.718 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T15:57:58.726 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T15:57:59.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.075+0000 7fcbe5ffb700 1 -- 172.21.15.37:0/2852711417 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v41) v1 ==== 169+0+0 (secure 0 0 0) 0x7fcbe8057c70 con 0x7fcbf01462d0 2023-07-14T15:57:59.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.080+0000 7fcbf79ff700 1 -- 172.21.15.37:0/2852711417 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fcbd406ad70 msgr2=0x7fcbd406d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:59.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.080+0000 7fcbf79ff700 1 --2- 172.21.15.37:0/2852711417 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fcbd406ad70 0x7fcbd406d220 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fcbec009130 tx=0x7fcbec01c040 comp rx=0 tx=0).stop 2023-07-14T15:57:59.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.080+0000 7fcbf79ff700 1 -- 172.21.15.37:0/2852711417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbf01462d0 msgr2=0x7fcbf00c8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:59.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.080+0000 7fcbf79ff700 1 --2- 172.21.15.37:0/2852711417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbf01462d0 0x7fcbf00c8ed0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fcbe800cc50 tx=0x7fcbe800a340 comp rx=0 tx=0).stop 2023-07-14T15:57:59.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.080+0000 7fcbf79ff700 1 -- 172.21.15.37:0/2852711417 shutdown_connections 2023-07-14T15:57:59.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.080+0000 7fcbf79ff700 1 --2- 172.21.15.37:0/2852711417 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcbf00cf780 0x7fcbf015aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:59.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.081+0000 7fcbf79ff700 1 --2- 172.21.15.37:0/2852711417 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fcbd406ad70 0x7fcbd406d220 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:59.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.081+0000 7fcbf79ff700 1 --2- 172.21.15.37:0/2852711417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbf01462d0 0x7fcbf00c8ed0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:59.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.081+0000 7fcbf79ff700 1 --2- 172.21.15.37:0/2852711417 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcbf00d2310 0x7fcbf015b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:59.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.081+0000 7fcbf79ff700 1 -- 172.21.15.37:0/2852711417 >> 172.21.15.37:0/2852711417 conn(0x7fcbf006a4d0 msgr2=0x7fcbf00b7c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:59.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.081+0000 7fcbf79ff700 1 -- 172.21.15.37:0/2852711417 shutdown_connections 2023-07-14T15:57:59.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.081+0000 7fcbf79ff700 1 -- 172.21.15.37:0/2852711417 wait complete. 2023-07-14T15:57:59.067 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2023-07-14T15:57:59.085 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-14T15:57:59.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.307+0000 7fcd983ff700 1 Processor -- start 2023-07-14T15:57:59.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.307+0000 7fcd983ff700 1 -- start start 2023-07-14T15:57:59.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.309+0000 7fcd983ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcd900cfd50 0x7fcd900d2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:59.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.309+0000 7fcd983ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fcd900b0ac0 0x7fcd900b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:59.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.309+0000 7fcd983ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd900b1840 con 0x7fcd900b1e80 2023-07-14T15:57:59.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.309+0000 7fcd983ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd9015ccf0 con 0x7fcd900b0ac0 2023-07-14T15:57:59.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.309+0000 7fcd983ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd900b2550 con 0x7fcd900cfd50 2023-07-14T15:57:59.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.309+0000 7fcd9599a700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fcd900b1e80 0x7fcd900b2d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34466/0 (socket says 172.21.15.37:34466) 2023-07-14T15:57:59.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.309+0000 7fcd9599a700 1 -- 172.21.15.37:0/587740238 learned_addr learned my addr 172.21.15.37:0/587740238 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:59.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.309+0000 7fcd95199700 1 -- 172.21.15.37:0/587740238 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1159384233 0 0) 0x7fcd900b1840 con 0x7fcd900b1e80 2023-07-14T15:57:59.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.309+0000 7fcd95199700 1 -- 172.21.15.37:0/587740238 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd7c0035b0 con 0x7fcd900b1e80 2023-07-14T15:57:59.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.309+0000 7fcd9699c700 1 --2- 172.21.15.37:0/587740238 >> v2:172.21.15.98:3300/0 conn(0x7fcd900b0ac0 0x7fcd900b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:59.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.309+0000 7fcd9619b700 1 --2- 172.21.15.37:0/587740238 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcd900cfd50 0x7fcd900d2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:59.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.310+0000 7fcd95199700 1 -- 172.21.15.37:0/587740238 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4091535468 0 0) 0x7fcd7c0035b0 con 0x7fcd900b1e80 2023-07-14T15:57:59.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.310+0000 7fcd95199700 1 -- 172.21.15.37:0/587740238 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcd900cfd50 msgr2=0x7fcd900d2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:59.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.310+0000 7fcd95199700 1 --2- 172.21.15.37:0/587740238 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcd900cfd50 0x7fcd900d2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:59.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.310+0000 7fcd95199700 1 -- 172.21.15.37:0/587740238 >> v2:172.21.15.98:3300/0 conn(0x7fcd900b0ac0 msgr2=0x7fcd900b0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:59.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.310+0000 7fcd95199700 1 --2- 172.21.15.37:0/587740238 >> v2:172.21.15.98:3300/0 conn(0x7fcd900b0ac0 0x7fcd900b0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:59.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.310+0000 7fcd95199700 1 -- 172.21.15.37:0/587740238 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd900b2830 con 0x7fcd900b1e80 2023-07-14T15:57:59.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.310+0000 7fcd95199700 1 -- 172.21.15.37:0/587740238 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48633207 0 0) 0x7fcd80001670 con 0x7fcd900b1e80 2023-07-14T15:57:59.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.310+0000 7fcd95199700 1 -- 172.21.15.37:0/587740238 >> v1:172.21.15.37:6789/0 conn(0x7fcd900b1e80 legacy=0x7fcd900b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:59.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.310+0000 7fcd95199700 1 --2- 172.21.15.37:0/587740238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd7c003a00 0x7fcd7c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:59.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.310+0000 7fcd95199700 1 --2- 172.21.15.37:0/587740238 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcd900cfd50 0x7fcd7c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:59.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.310+0000 7fcd95199700 1 --2- 172.21.15.37:0/587740238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd7c004d90 0x7fcd7c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:59.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.310+0000 7fcd95199700 1 -- 172.21.15.37:0/587740238 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9015ccf0 con 0x7fcd7c003a00 2023-07-14T15:57:59.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.310+0000 7fcd95199700 1 -- 172.21.15.37:0/587740238 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd900b2550 con 0x7fcd7c004d90 2023-07-14T15:57:59.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.310+0000 7fcd95199700 1 -- 172.21.15.37:0/587740238 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c00ba10 con 0x7fcd900cfd50 2023-07-14T15:57:59.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.310+0000 7fcd9619b700 1 --2- 172.21.15.37:0/587740238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd7c003a00 0x7fcd7c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:59.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.310+0000 7fcd9599a700 1 --2- 172.21.15.37:0/587740238 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcd900cfd50 0x7fcd7c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:59.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.310+0000 7fcd9699c700 1 --2- 172.21.15.37:0/587740238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd7c004d90 0x7fcd7c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:59.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.311+0000 7fcd9619b700 1 -- 172.21.15.37:0/587740238 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcd900cfd50 msgr2=0x7fcd7c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:59.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.311+0000 7fcd9619b700 1 --2- 172.21.15.37:0/587740238 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcd900cfd50 0x7fcd7c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:59.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.311+0000 7fcd9619b700 1 -- 172.21.15.37:0/587740238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd7c004d90 msgr2=0x7fcd7c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:57:59.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.311+0000 7fcd9619b700 1 --2- 172.21.15.37:0/587740238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd7c004d90 0x7fcd7c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:59.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.311+0000 7fcd9619b700 1 -- 172.21.15.37:0/587740238 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd7c0035b0 con 0x7fcd7c003a00 2023-07-14T15:57:59.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.311+0000 7fcd9619b700 1 --2- 172.21.15.37:0/587740238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd7c003a00 0x7fcd7c003e10 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c009b60 tx=0x7fcd7c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fd48848952d32d1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:59.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.311+0000 7fcd95199700 1 -- 172.21.15.37:0/587740238 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c00e6c0 con 0x7fcd7c003a00 2023-07-14T15:57:59.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.311+0000 7fcd95199700 1 -- 172.21.15.37:0/587740238 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd8c00e820 con 0x7fcd7c003a00 2023-07-14T15:57:59.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.311+0000 7fcd95199700 1 -- 172.21.15.37:0/587740238 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c00eb90 con 0x7fcd7c003a00 2023-07-14T15:57:59.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.312+0000 7fcd983ff700 1 -- 172.21.15.37:0/587740238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd7c003a00 msgr2=0x7fcd7c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:59.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.312+0000 7fcd983ff700 1 --2- 172.21.15.37:0/587740238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd7c003a00 0x7fcd7c003e10 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c009b60 tx=0x7fcd7c005880 comp rx=0 tx=0).stop 2023-07-14T15:57:59.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.312+0000 7fcd9699c700 1 -- 172.21.15.37:0/587740238 reap_dead start 2023-07-14T15:57:59.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.312+0000 7fcd983ff700 1 -- 172.21.15.37:0/587740238 shutdown_connections 2023-07-14T15:57:59.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.312+0000 7fcd983ff700 1 -- 172.21.15.37:0/587740238 >> 172.21.15.37:0/587740238 conn(0x7fcd9009c1c0 msgr2=0x7fcd900d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:59.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.312+0000 7fcd983ff700 1 -- 172.21.15.37:0/587740238 shutdown_connections 2023-07-14T15:57:59.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.312+0000 7fcd983ff700 1 -- 172.21.15.37:0/587740238 wait complete. 2023-07-14T15:57:59.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.314+0000 7fcd983ff700 1 Processor -- start 2023-07-14T15:57:59.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.314+0000 7fcd983ff700 1 -- start start 2023-07-14T15:57:59.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.315+0000 7fcd983ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd7c003a00 0x7fcd901e3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:59.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.315+0000 7fcd983ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcd901f5470 0x7fcd90151e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:59.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.315+0000 7fcd983ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd901f1e10 0x7fcd901e6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:59.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.315+0000 7fcd983ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd901f6380 con 0x7fcd901f1e10 2023-07-14T15:57:59.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.315+0000 7fcd983ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd900b72e0 con 0x7fcd7c003a00 2023-07-14T15:57:59.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.315+0000 7fcd983ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd90152370 con 0x7fcd901f5470 2023-07-14T15:57:59.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.315+0000 7fcd9699c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd901f1e10 0x7fcd901e6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:59.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.315+0000 7fcd9699c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd901f1e10 0x7fcd901e6450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45026/0 (socket says 172.21.15.37:45026) 2023-07-14T15:57:59.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.315+0000 7fcd9699c700 1 -- 172.21.15.37:0/2888198639 learned_addr learned my addr 172.21.15.37:0/2888198639 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:59.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.315+0000 7fcd9599a700 1 --2- 172.21.15.37:0/2888198639 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcd901f5470 0x7fcd90151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:59.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.315+0000 7fcd9619b700 1 --2- 172.21.15.37:0/2888198639 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd7c003a00 0x7fcd901e3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:59.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.315+0000 7fcd9699c700 1 -- 172.21.15.37:0/2888198639 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcd901f5470 msgr2=0x7fcd90151e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:59.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.315+0000 7fcd9699c700 1 --2- 172.21.15.37:0/2888198639 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcd901f5470 0x7fcd90151e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:59.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.315+0000 7fcd9699c700 1 -- 172.21.15.37:0/2888198639 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd7c003a00 msgr2=0x7fcd901e3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:59.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.315+0000 7fcd9699c700 1 --2- 172.21.15.37:0/2888198639 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd7c003a00 0x7fcd901e3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:59.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.315+0000 7fcd9699c700 1 -- 172.21.15.37:0/2888198639 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd900d02a0 con 0x7fcd901f1e10 2023-07-14T15:57:59.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.315+0000 7fcd9619b700 1 --2- 172.21.15.37:0/2888198639 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd7c003a00 0x7fcd901e3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:57:59.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.316+0000 7fcd9699c700 1 --2- 172.21.15.37:0/2888198639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd901f1e10 0x7fcd901e6450 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fcd9008d140 tx=0x7fcd880111d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:59.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.316+0000 7fcd86ffd700 1 -- 172.21.15.37:0/2888198639 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8800e070 con 0x7fcd901f1e10 2023-07-14T15:57:59.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.316+0000 7fcd86ffd700 1 -- 172.21.15.37:0/2888198639 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd88003cf0 con 0x7fcd901f1e10 2023-07-14T15:57:59.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.316+0000 7fcd983ff700 1 -- 172.21.15.37:0/2888198639 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd901f2780 con 0x7fcd901f1e10 2023-07-14T15:57:59.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.316+0000 7fcd86ffd700 1 -- 172.21.15.37:0/2888198639 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd880117f0 con 0x7fcd901f1e10 2023-07-14T15:57:59.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.316+0000 7fcd983ff700 1 -- 172.21.15.37:0/2888198639 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd901f2d40 con 0x7fcd901f1e10 2023-07-14T15:57:59.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.317+0000 7fcd983ff700 1 -- 172.21.15.37:0/2888198639 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd9006cea0 con 0x7fcd901f1e10 2023-07-14T15:57:59.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.318+0000 7fcd86ffd700 1 -- 172.21.15.37:0/2888198639 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7fcd88011950 con 0x7fcd901f1e10 2023-07-14T15:57:59.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.319+0000 7fcd86ffd700 1 --2- 172.21.15.37:0/2888198639 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fcd7406ad70 0x7fcd7406d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:59.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.319+0000 7fcd86ffd700 1 -- 172.21.15.37:0/2888198639 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fcd88089750 con 0x7fcd901f1e10 2023-07-14T15:57:59.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.319+0000 7fcd9619b700 1 --2- 172.21.15.37:0/2888198639 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fcd7406ad70 0x7fcd7406d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:59.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.320+0000 7fcd9619b700 1 --2- 172.21.15.37:0/2888198639 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fcd7406ad70 0x7fcd7406d220 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c0090b0 tx=0x7fcd8c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:59.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.323+0000 7fcd86ffd700 1 -- 172.21.15.37:0/2888198639 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fcd880549b0 con 0x7fcd901f1e10 2023-07-14T15:57:59.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.533+0000 7fcd983ff700 1 -- 172.21.15.37:0/2888198639 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fcd90067840 con 0x7fcd901f1e10 2023-07-14T15:57:59.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.537+0000 7fcd86ffd700 1 -- 172.21.15.37:0/2888198639 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcd88057fd0 con 0x7fcd901f1e10 2023-07-14T15:57:59.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.540+0000 7fcd983ff700 1 -- 172.21.15.37:0/2888198639 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fcd7406ad70 msgr2=0x7fcd7406d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:59.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.540+0000 7fcd983ff700 1 --2- 172.21.15.37:0/2888198639 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fcd7406ad70 0x7fcd7406d220 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c0090b0 tx=0x7fcd8c008030 comp rx=0 tx=0).stop 2023-07-14T15:57:59.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.540+0000 7fcd983ff700 1 -- 172.21.15.37:0/2888198639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd901f1e10 msgr2=0x7fcd901e6450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:59.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.540+0000 7fcd983ff700 1 --2- 172.21.15.37:0/2888198639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd901f1e10 0x7fcd901e6450 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fcd9008d140 tx=0x7fcd880111d0 comp rx=0 tx=0).stop 2023-07-14T15:57:59.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.540+0000 7fcd983ff700 1 -- 172.21.15.37:0/2888198639 shutdown_connections 2023-07-14T15:57:59.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.540+0000 7fcd983ff700 1 --2- 172.21.15.37:0/2888198639 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd7c003a00 0x7fcd901e3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:59.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.540+0000 7fcd983ff700 1 --2- 172.21.15.37:0/2888198639 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fcd7406ad70 0x7fcd7406d220 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:59.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.540+0000 7fcd983ff700 1 --2- 172.21.15.37:0/2888198639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd901f1e10 0x7fcd901e6450 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:59.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.540+0000 7fcd983ff700 1 --2- 172.21.15.37:0/2888198639 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fcd901f5470 0x7fcd90151e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:59.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.540+0000 7fcd983ff700 1 -- 172.21.15.37:0/2888198639 >> 172.21.15.37:0/2888198639 conn(0x7fcd9009c1c0 msgr2=0x7fcd900d2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:59.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.540+0000 7fcd983ff700 1 -- 172.21.15.37:0/2888198639 shutdown_connections 2023-07-14T15:57:59.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.540+0000 7fcd983ff700 1 -- 172.21.15.37:0/2888198639 wait complete. 2023-07-14T15:57:59.543 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots.test_subvolume_group_snapshot_unsupported_status' 2023-07-14T15:57:59.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.763+0000 7faf26fff700 1 Processor -- start 2023-07-14T15:57:59.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.763+0000 7faf26fff700 1 -- start start 2023-07-14T15:57:59.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.764+0000 7faf26fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7faf200c57a0 0x7faf20160690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:59.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.764+0000 7faf26fff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf200c3d40 con 0x7faf201601f0 2023-07-14T15:57:59.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.764+0000 7faf26fff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf200c4300 con 0x7faf200ccf10 2023-07-14T15:57:59.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.764+0000 7faf26fff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf20160bd0 con 0x7faf200c57a0 2023-07-14T15:57:59.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.764+0000 7faf1ffff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7faf201601f0 0x7faf200cb510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34468/0 (socket says 172.21.15.37:34468) 2023-07-14T15:57:59.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.764+0000 7faf1ffff700 1 -- 172.21.15.37:0/3233759178 learned_addr learned my addr 172.21.15.37:0/3233759178 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:57:59.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.765+0000 7faf2559c700 1 --2- 172.21.15.37:0/3233759178 >> v2:172.21.15.98:3300/0 conn(0x7faf200c57a0 0x7faf20160690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:59.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.765+0000 7faf1f7fe700 1 -- 172.21.15.37:0/3233759178 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3942965487 0 0) 0x7faf200c3d40 con 0x7faf201601f0 2023-07-14T15:57:59.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.765+0000 7faf1f7fe700 1 -- 172.21.15.37:0/3233759178 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf100035b0 con 0x7faf201601f0 2023-07-14T15:57:59.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.765+0000 7faf1f7fe700 1 -- 172.21.15.37:0/3233759178 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2169852746 0 0) 0x7faf200c4300 con 0x7faf200ccf10 2023-07-14T15:57:59.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.765+0000 7faf1f7fe700 1 -- 172.21.15.37:0/3233759178 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf200c3d40 con 0x7faf200ccf10 2023-07-14T15:57:59.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.765+0000 7faf2559c700 1 -- 172.21.15.37:0/3233759178 >> v1:172.21.15.98:6789/0 conn(0x7faf200ccf10 legacy=0x7faf200ac8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:59.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.765+0000 7faf2559c700 1 -- 172.21.15.37:0/3233759178 >> v1:172.21.15.37:6789/0 conn(0x7faf201601f0 legacy=0x7faf200cb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:59.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.765+0000 7faf2559c700 1 -- 172.21.15.37:0/3233759178 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf200cec80 con 0x7faf200c57a0 2023-07-14T15:57:59.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.765+0000 7faf2559c700 1 --2- 172.21.15.37:0/3233759178 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf200c57a0 0x7faf20160690 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7faf18009d90 tx=0x7faf1800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68930d807a6c5c28 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:59.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.766+0000 7faf1f7fe700 1 -- 172.21.15.37:0/3233759178 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1800e070 con 0x7faf200c57a0 2023-07-14T15:57:59.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.766+0000 7faf1f7fe700 1 -- 172.21.15.37:0/3233759178 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1800bb20 con 0x7faf200c57a0 2023-07-14T15:57:59.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.766+0000 7faf1f7fe700 1 -- 172.21.15.37:0/3233759178 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf18012430 con 0x7faf200c57a0 2023-07-14T15:57:59.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.766+0000 7faf26fff700 1 -- 172.21.15.37:0/3233759178 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf200c57a0 msgr2=0x7faf20160690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:59.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.766+0000 7faf26fff700 1 --2- 172.21.15.37:0/3233759178 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf200c57a0 0x7faf20160690 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7faf18009d90 tx=0x7faf1800b330 comp rx=0 tx=0).stop 2023-07-14T15:57:59.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.766+0000 7faf26fff700 1 -- 172.21.15.37:0/3233759178 shutdown_connections 2023-07-14T15:57:59.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.766+0000 7faf26fff700 1 --2- 172.21.15.37:0/3233759178 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf200c57a0 0x7faf20160690 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:59.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.766+0000 7faf26fff700 1 -- 172.21.15.37:0/3233759178 >> 172.21.15.37:0/3233759178 conn(0x7faf200b0ad0 msgr2=0x7faf200b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:57:59.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.766+0000 7faf26fff700 1 -- 172.21.15.37:0/3233759178 shutdown_connections 2023-07-14T15:57:59.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.766+0000 7faf26fff700 1 -- 172.21.15.37:0/3233759178 wait complete. 2023-07-14T15:57:59.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.768+0000 7faf26fff700 1 Processor -- start 2023-07-14T15:57:59.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.768+0000 7faf26fff700 1 -- start start 2023-07-14T15:57:59.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.769+0000 7faf26fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf200c57a0 0x7faf20134b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:59.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.769+0000 7faf26fff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7faf200ccf10 0x7faf20152d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:59.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.769+0000 7faf26fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf201601f0 0x7faf20071a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:59.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.769+0000 7faf26fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf201532a0 con 0x7faf201601f0 2023-07-14T15:57:59.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.769+0000 7faf26fff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf200b3120 con 0x7faf200c57a0 2023-07-14T15:57:59.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.769+0000 7faf26fff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf200b3400 con 0x7faf200ccf10 2023-07-14T15:57:59.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.769+0000 7faf2559c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf201601f0 0x7faf20071a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:59.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.769+0000 7faf2559c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf201601f0 0x7faf20071a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45038/0 (socket says 172.21.15.37:45038) 2023-07-14T15:57:59.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.769+0000 7faf2559c700 1 -- 172.21.15.37:0/3278288281 learned_addr learned my addr 172.21.15.37:0/3278288281 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:57:59.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.769+0000 7faf24d9b700 1 --2- 172.21.15.37:0/3278288281 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf200c57a0 0x7faf20134b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:59.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.770+0000 7faf1ffff700 1 --2- 172.21.15.37:0/3278288281 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7faf200ccf10 0x7faf20152d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:59.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.770+0000 7faf2559c700 1 -- 172.21.15.37:0/3278288281 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7faf200ccf10 msgr2=0x7faf20152d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:59.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.770+0000 7faf2559c700 1 --2- 172.21.15.37:0/3278288281 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7faf200ccf10 0x7faf20152d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:59.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.770+0000 7faf2559c700 1 -- 172.21.15.37:0/3278288281 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf200c57a0 msgr2=0x7faf20134b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:57:59.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.770+0000 7faf2559c700 1 --2- 172.21.15.37:0/3278288281 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf200c57a0 0x7faf20134b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:57:59.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.770+0000 7faf2559c700 1 -- 172.21.15.37:0/3278288281 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf18009a70 con 0x7faf201601f0 2023-07-14T15:57:59.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.770+0000 7faf2559c700 1 --2- 172.21.15.37:0/3278288281 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf201601f0 0x7faf20071a00 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7faf18014040 tx=0x7faf18004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:59.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.770+0000 7faf1d7fa700 1 -- 172.21.15.37:0/3278288281 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf18012430 con 0x7faf201601f0 2023-07-14T15:57:59.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.770+0000 7faf1d7fa700 1 -- 172.21.15.37:0/3278288281 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf18020070 con 0x7faf201601f0 2023-07-14T15:57:59.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.770+0000 7faf26fff700 1 -- 172.21.15.37:0/3278288281 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf200b36e0 con 0x7faf201601f0 2023-07-14T15:57:59.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.771+0000 7faf1d7fa700 1 -- 172.21.15.37:0/3278288281 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf18004280 con 0x7faf201601f0 2023-07-14T15:57:59.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.771+0000 7faf26fff700 1 -- 172.21.15.37:0/3278288281 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf200b3ca0 con 0x7faf201601f0 2023-07-14T15:57:59.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.772+0000 7faf26fff700 1 -- 172.21.15.37:0/3278288281 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf20067840 con 0x7faf201601f0 2023-07-14T15:57:59.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.772+0000 7faf1d7fa700 1 -- 172.21.15.37:0/3278288281 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7faf180043e0 con 0x7faf201601f0 2023-07-14T15:57:59.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.774+0000 7faf1d7fa700 1 --2- 172.21.15.37:0/3278288281 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7faf0406ad70 0x7faf0406d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:57:59.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.774+0000 7faf1d7fa700 1 -- 172.21.15.37:0/3278288281 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5296+0+0 (secure 0 0 0) 0x7faf18022070 con 0x7faf201601f0 2023-07-14T15:57:59.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.774+0000 7faf24d9b700 1 --2- 172.21.15.37:0/3278288281 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7faf0406ad70 0x7faf0406d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:57:59.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.775+0000 7faf24d9b700 1 --2- 172.21.15.37:0/3278288281 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7faf0406ad70 0x7faf0406d220 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7faf14001830 tx=0x7faf14009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:57:59.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:57:59.778+0000 7faf1d7fa700 1 -- 172.21.15.37:0/3278288281 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7faf180bd330 con 0x7faf201601f0 2023-07-14T15:58:00.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.067+0000 7faf26fff700 1 -- 172.21.15.37:0/3278288281 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots.test_subvolume_group_snapshot_unsupported_status"]} v 0) v1 -- 0x7faf200afff0 con 0x7faf201601f0 2023-07-14T15:58:00.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.076+0000 7faf1d7fa700 1 -- 172.21.15.37:0/3278288281 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots.test_subvolume_group_snapshot_unsupported_status"]}]=0 v129) v1 ==== 181+0+0 (secure 0 0 0) 0x7faf18056560 con 0x7faf201601f0 2023-07-14T15:58:00.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.078+0000 7faf26fff700 1 -- 172.21.15.37:0/3278288281 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7faf0406ad70 msgr2=0x7faf0406d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:00.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.078+0000 7faf26fff700 1 --2- 172.21.15.37:0/3278288281 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7faf0406ad70 0x7faf0406d220 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7faf14001830 tx=0x7faf14009040 comp rx=0 tx=0).stop 2023-07-14T15:58:00.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.078+0000 7faf26fff700 1 -- 172.21.15.37:0/3278288281 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf201601f0 msgr2=0x7faf20071a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:00.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.078+0000 7faf26fff700 1 --2- 172.21.15.37:0/3278288281 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf201601f0 0x7faf20071a00 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7faf18014040 tx=0x7faf18004ad0 comp rx=0 tx=0).stop 2023-07-14T15:58:00.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.078+0000 7faf26fff700 1 -- 172.21.15.37:0/3278288281 shutdown_connections 2023-07-14T15:58:00.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.078+0000 7faf26fff700 1 --2- 172.21.15.37:0/3278288281 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf200c57a0 0x7faf20134b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:00.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.078+0000 7faf26fff700 1 --2- 172.21.15.37:0/3278288281 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7faf0406ad70 0x7faf0406d220 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:00.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.078+0000 7faf26fff700 1 --2- 172.21.15.37:0/3278288281 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf201601f0 0x7faf20071a00 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:00.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.078+0000 7faf26fff700 1 --2- 172.21.15.37:0/3278288281 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7faf200ccf10 0x7faf20152d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:00.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.078+0000 7faf26fff700 1 -- 172.21.15.37:0/3278288281 >> 172.21.15.37:0/3278288281 conn(0x7faf200b0ad0 msgr2=0x7faf2015b210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:00.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.079+0000 7faf26fff700 1 -- 172.21.15.37:0/3278288281 shutdown_connections 2023-07-14T15:58:00.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.079+0000 7faf26fff700 1 -- 172.21.15.37:0/3278288281 wait complete. 2023-07-14T15:58:00.081 INFO:tasks.cephfs_test_runner:test_subvolume_group_snapshot_unsupported_status (tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots) ... ok 2023-07-14T15:58:00.082 INFO:tasks.cephfs_test_runner:Starting test: test_clean_stale_subvolume_snapshot_metadata (tasks.cephfs.test_volumes.TestSubvolumeSnapshots) 2023-07-14T15:58:00.082 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshots.test_clean_stale_subvolume_snapshot_metadata' 2023-07-14T15:58:00.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.299+0000 7f88d73ff700 1 Processor -- start 2023-07-14T15:58:00.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.300+0000 7f88d73ff700 1 -- start start 2023-07-14T15:58:00.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.301+0000 7f88d73ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f88d00b85f0 0x7f88d015d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:00.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.301+0000 7f88d73ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f88d00b54b0 0x7f88d00cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:00.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.301+0000 7f88d73ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88d00cf6b0 con 0x7f88d00b4910 2023-07-14T15:58:00.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.301+0000 7f88d73ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88d00cdc40 con 0x7f88d00b54b0 2023-07-14T15:58:00.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.301+0000 7f88d73ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88d015dba0 con 0x7f88d00b85f0 2023-07-14T15:58:00.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.301+0000 7f88d499a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f88d00b54b0 0x7f88d00cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:00.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.301+0000 7f88d499a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f88d00b54b0 0x7f88d00cfb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43764/0 (socket says 172.21.15.37:43764) 2023-07-14T15:58:00.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.301+0000 7f88d499a700 1 -- 172.21.15.37:0/1532766790 learned_addr learned my addr 172.21.15.37:0/1532766790 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:00.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.302+0000 7f88d519b700 1 --2- 172.21.15.37:0/1532766790 >> v2:172.21.15.98:3300/0 conn(0x7f88d00b85f0 0x7f88d015d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:00.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.302+0000 7f88d499a700 1 -- 172.21.15.37:0/1532766790 >> v2:172.21.15.98:3300/0 conn(0x7f88d00b85f0 msgr2=0x7f88d015d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:00.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.302+0000 7f88d499a700 1 --2- 172.21.15.37:0/1532766790 >> v2:172.21.15.98:3300/0 conn(0x7f88d00b85f0 0x7f88d015d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:00.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.302+0000 7f88d499a700 1 -- 172.21.15.37:0/1532766790 >> v1:172.21.15.98:6789/0 conn(0x7f88d00b4910 legacy=0x7f88d00b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:00.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.302+0000 7f88d499a700 1 -- 172.21.15.37:0/1532766790 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d00cf0a0 con 0x7f88d00b54b0 2023-07-14T15:58:00.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.302+0000 7f88d519b700 1 --2- 172.21.15.37:0/1532766790 >> v2:172.21.15.98:3300/0 conn(0x7f88d00b85f0 0x7f88d015d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:58:00.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.302+0000 7f88d499a700 1 --2- 172.21.15.37:0/1532766790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d00b54b0 0x7f88d00cfb40 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f88d006a110 tx=0x7f88c0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80682cca6d0a9fa5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:00.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.302+0000 7f88c7fff700 1 -- 172.21.15.37:0/1532766790 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c0004230 con 0x7f88d00b54b0 2023-07-14T15:58:00.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.302+0000 7f88c7fff700 1 -- 172.21.15.37:0/1532766790 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c0004390 con 0x7f88d00b54b0 2023-07-14T15:58:00.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.302+0000 7f88c7fff700 1 -- 172.21.15.37:0/1532766790 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c00036a0 con 0x7f88d00b54b0 2023-07-14T15:58:00.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.303+0000 7f88d73ff700 1 -- 172.21.15.37:0/1532766790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d00b54b0 msgr2=0x7f88d00cfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:00.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.303+0000 7f88d73ff700 1 --2- 172.21.15.37:0/1532766790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d00b54b0 0x7f88d00cfb40 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f88d006a110 tx=0x7f88c0009bd0 comp rx=0 tx=0).stop 2023-07-14T15:58:00.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.303+0000 7f88d73ff700 1 -- 172.21.15.37:0/1532766790 shutdown_connections 2023-07-14T15:58:00.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.303+0000 7f88d73ff700 1 --2- 172.21.15.37:0/1532766790 >> v2:172.21.15.98:3300/0 conn(0x7f88d00b85f0 0x7f88d015d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:00.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.303+0000 7f88d73ff700 1 --2- 172.21.15.37:0/1532766790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d00b54b0 0x7f88d00cfb40 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:00.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.303+0000 7f88d73ff700 1 -- 172.21.15.37:0/1532766790 >> 172.21.15.37:0/1532766790 conn(0x7f88d006a580 msgr2=0x7f88d006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:00.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.303+0000 7f88d73ff700 1 -- 172.21.15.37:0/1532766790 shutdown_connections 2023-07-14T15:58:00.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.303+0000 7f88d73ff700 1 -- 172.21.15.37:0/1532766790 wait complete. 2023-07-14T15:58:00.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.305+0000 7f88d73ff700 1 Processor -- start 2023-07-14T15:58:00.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.305+0000 7f88d73ff700 1 -- start start 2023-07-14T15:58:00.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.306+0000 7f88d73ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f88d00b4910 0x7f88d00c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:00.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.306+0000 7f88d73ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d00b54b0 0x7f88d00cc740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:00.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.306+0000 7f88d73ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88d00b85f0 0x7f88d01f1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:00.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.306+0000 7f88d73ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d00cd290 con 0x7f88d00b54b0 2023-07-14T15:58:00.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.306+0000 7f88d73ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d00ca660 con 0x7f88d00b85f0 2023-07-14T15:58:00.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.306+0000 7f88d73ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88d00b6a50 con 0x7f88d00b4910 2023-07-14T15:58:00.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.306+0000 7f88d499a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d00b54b0 0x7f88d00cc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:00.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.306+0000 7f88d499a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d00b54b0 0x7f88d00cc740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43780/0 (socket says 172.21.15.37:43780) 2023-07-14T15:58:00.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.306+0000 7f88d499a700 1 -- 172.21.15.37:0/1447758101 learned_addr learned my addr 172.21.15.37:0/1447758101 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:00.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.306+0000 7f88d599c700 1 --2- 172.21.15.37:0/1447758101 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88d00b85f0 0x7f88d01f1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:00.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.306+0000 7f88d519b700 1 --2- 172.21.15.37:0/1447758101 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f88d00b4910 0x7f88d00c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:00.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.306+0000 7f88d499a700 1 -- 172.21.15.37:0/1447758101 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f88d00b4910 msgr2=0x7f88d00c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:00.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.306+0000 7f88d499a700 1 --2- 172.21.15.37:0/1447758101 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f88d00b4910 0x7f88d00c9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:00.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.306+0000 7f88d499a700 1 -- 172.21.15.37:0/1447758101 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88d00b85f0 msgr2=0x7f88d01f1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:00.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.306+0000 7f88d499a700 1 --2- 172.21.15.37:0/1447758101 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88d00b85f0 0x7f88d01f1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:00.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.306+0000 7f88d499a700 1 -- 172.21.15.37:0/1447758101 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c0009550 con 0x7f88d00b54b0 2023-07-14T15:58:00.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.306+0000 7f88d519b700 1 --2- 172.21.15.37:0/1447758101 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f88d00b4910 0x7f88d00c9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:58:00.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.307+0000 7f88d499a700 1 --2- 172.21.15.37:0/1447758101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d00b54b0 0x7f88d00cc740 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f88d00673c0 tx=0x7f88c0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:00.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.307+0000 7f88c5ffb700 1 -- 172.21.15.37:0/1447758101 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c0003d80 con 0x7f88d00b54b0 2023-07-14T15:58:00.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.307+0000 7f88c5ffb700 1 -- 172.21.15.37:0/1447758101 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c001f070 con 0x7f88d00b54b0 2023-07-14T15:58:00.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.307+0000 7f88d73ff700 1 -- 172.21.15.37:0/1447758101 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88d00b6d30 con 0x7f88d00b54b0 2023-07-14T15:58:00.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.307+0000 7f88c5ffb700 1 -- 172.21.15.37:0/1447758101 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c0011870 con 0x7f88d00b54b0 2023-07-14T15:58:00.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.307+0000 7f88d73ff700 1 -- 172.21.15.37:0/1447758101 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88d00b72f0 con 0x7f88d00b54b0 2023-07-14T15:58:00.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.308+0000 7f88d73ff700 1 -- 172.21.15.37:0/1447758101 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88d0067840 con 0x7f88d00b54b0 2023-07-14T15:58:00.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.309+0000 7f88c5ffb700 1 -- 172.21.15.37:0/1447758101 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f88c0021030 con 0x7f88d00b54b0 2023-07-14T15:58:00.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.311+0000 7f88c5ffb700 1 --2- 172.21.15.37:0/1447758101 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f88b406ad70 0x7f88b406d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:00.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.311+0000 7f88c5ffb700 1 -- 172.21.15.37:0/1447758101 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f88c008a850 con 0x7f88d00b54b0 2023-07-14T15:58:00.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.311+0000 7f88d519b700 1 --2- 172.21.15.37:0/1447758101 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f88b406ad70 0x7f88b406d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:00.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.312+0000 7f88d519b700 1 --2- 172.21.15.37:0/1447758101 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f88b406ad70 0x7f88b406d220 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f88cc008910 tx=0x7f88cc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:00.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.315+0000 7f88c5ffb700 1 -- 172.21.15.37:0/1447758101 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f88c0055bc0 con 0x7f88d00b54b0 2023-07-14T15:58:00.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:00.607+0000 7f88d73ff700 1 -- 172.21.15.37:0/1447758101 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshots.test_clean_stale_subvolume_snapshot_metadata"]} v 0) v1 -- 0x7f88d006b440 con 0x7f88d00b54b0 2023-07-14T15:58:01.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.083+0000 7f88c5ffb700 1 -- 172.21.15.37:0/1447758101 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshots.test_clean_stale_subvolume_snapshot_metadata"]}]=0 v130) v1 ==== 175+0+0 (secure 0 0 0) 0x7f88c00591e0 con 0x7f88d00b54b0 2023-07-14T15:58:01.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.085+0000 7f88d73ff700 1 -- 172.21.15.37:0/1447758101 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f88b406ad70 msgr2=0x7f88b406d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:01.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.085+0000 7f88d73ff700 1 --2- 172.21.15.37:0/1447758101 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f88b406ad70 0x7f88b406d220 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f88cc008910 tx=0x7f88cc008040 comp rx=0 tx=0).stop 2023-07-14T15:58:01.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.085+0000 7f88d73ff700 1 -- 172.21.15.37:0/1447758101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d00b54b0 msgr2=0x7f88d00cc740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:01.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.085+0000 7f88d73ff700 1 --2- 172.21.15.37:0/1447758101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d00b54b0 0x7f88d00cc740 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f88d00673c0 tx=0x7f88c0004750 comp rx=0 tx=0).stop 2023-07-14T15:58:01.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.085+0000 7f88d73ff700 1 -- 172.21.15.37:0/1447758101 shutdown_connections 2023-07-14T15:58:01.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.085+0000 7f88d73ff700 1 --2- 172.21.15.37:0/1447758101 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88d00b85f0 0x7f88d01f1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:01.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.085+0000 7f88d73ff700 1 --2- 172.21.15.37:0/1447758101 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f88b406ad70 0x7f88b406d220 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:01.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.085+0000 7f88d73ff700 1 --2- 172.21.15.37:0/1447758101 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f88d00b4910 0x7f88d00c9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:01.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.085+0000 7f88d73ff700 1 --2- 172.21.15.37:0/1447758101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d00b54b0 0x7f88d00cc740 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:01.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.085+0000 7f88d73ff700 1 -- 172.21.15.37:0/1447758101 >> 172.21.15.37:0/1447758101 conn(0x7f88d006a580 msgr2=0x7f88d015d430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:01.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.086+0000 7f88d73ff700 1 -- 172.21.15.37:0/1447758101 shutdown_connections 2023-07-14T15:58:01.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.086+0000 7f88d73ff700 1 -- 172.21.15.37:0/1447758101 wait complete. 2023-07-14T15:58:01.089 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-14T15:58:01.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.311+0000 7fb8c25ff700 1 Processor -- start 2023-07-14T15:58:01.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.312+0000 7fb8c25ff700 1 -- start start 2023-07-14T15:58:01.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.313+0000 7fb8c25ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb8bc0b1e80 0x7fb8bc0d2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:01.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.313+0000 7fb8c25ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb8bc0b0ac0 0x7fb8bc0b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:01.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.313+0000 7fb8c25ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8bc0b1840 con 0x7fb8bc0cfd50 2023-07-14T15:58:01.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.313+0000 7fb8c25ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8bc15ccf0 con 0x7fb8bc0b1e80 2023-07-14T15:58:01.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.313+0000 7fb8c25ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8bc0b2550 con 0x7fb8bc0b0ac0 2023-07-14T15:58:01.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.313+0000 7fb8bb7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb8bc0b1e80 0x7fb8bc0d2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:01.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.313+0000 7fb8bbfff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb8bc0cfd50 0x7fb8bc0b2d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57562/0 (socket says 172.21.15.37:57562) 2023-07-14T15:58:01.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.313+0000 7fb8bbfff700 1 -- 172.21.15.37:0/3585713379 learned_addr learned my addr 172.21.15.37:0/3585713379 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:58:01.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.314+0000 7fb8bb7fe700 1 -- 172.21.15.37:0/3585713379 >> v2:172.21.15.98:3300/0 conn(0x7fb8bc0b0ac0 msgr2=0x7fb8bc0b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:01.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.314+0000 7fb8c0b9c700 1 --2- 172.21.15.37:0/3585713379 >> v2:172.21.15.98:3300/0 conn(0x7fb8bc0b0ac0 0x7fb8bc0b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:01.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.314+0000 7fb8bb7fe700 1 --2- 172.21.15.37:0/3585713379 >> v2:172.21.15.98:3300/0 conn(0x7fb8bc0b0ac0 0x7fb8bc0b0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:01.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.314+0000 7fb8baffd700 1 -- 172.21.15.37:0/3585713379 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1362491530 0 0) 0x7fb8bc0b1840 con 0x7fb8bc0cfd50 2023-07-14T15:58:01.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.314+0000 7fb8bb7fe700 1 -- 172.21.15.37:0/3585713379 >> v1:172.21.15.37:6789/0 conn(0x7fb8bc0cfd50 legacy=0x7fb8bc0b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:01.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.314+0000 7fb8bb7fe700 1 -- 172.21.15.37:0/3585713379 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8bc0b2830 con 0x7fb8bc0b1e80 2023-07-14T15:58:01.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.314+0000 7fb8c0b9c700 1 --2- 172.21.15.37:0/3585713379 >> v2:172.21.15.98:3300/0 conn(0x7fb8bc0b0ac0 0x7fb8bc0b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:58:01.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.314+0000 7fb8bb7fe700 1 --2- 172.21.15.37:0/3585713379 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8bc0b1e80 0x7fb8bc0d2880 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc0d23f0 tx=0x7fb8b0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2ef39b5c3b1e768 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:01.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.314+0000 7fb8baffd700 1 -- 172.21.15.37:0/3585713379 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b0011830 con 0x7fb8bc0b1e80 2023-07-14T15:58:01.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.314+0000 7fb8baffd700 1 -- 172.21.15.37:0/3585713379 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b0011990 con 0x7fb8bc0b1e80 2023-07-14T15:58:01.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.314+0000 7fb8baffd700 1 -- 172.21.15.37:0/3585713379 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b0011d20 con 0x7fb8bc0b1e80 2023-07-14T15:58:01.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.315+0000 7fb8c25ff700 1 -- 172.21.15.37:0/3585713379 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8bc0b1e80 msgr2=0x7fb8bc0d2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:01.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.315+0000 7fb8c25ff700 1 --2- 172.21.15.37:0/3585713379 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8bc0b1e80 0x7fb8bc0d2880 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc0d23f0 tx=0x7fb8b0009b20 comp rx=0 tx=0).stop 2023-07-14T15:58:01.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.315+0000 7fb8c25ff700 1 -- 172.21.15.37:0/3585713379 shutdown_connections 2023-07-14T15:58:01.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.315+0000 7fb8c25ff700 1 --2- 172.21.15.37:0/3585713379 >> v2:172.21.15.98:3300/0 conn(0x7fb8bc0b0ac0 0x7fb8bc0b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:01.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.315+0000 7fb8c25ff700 1 --2- 172.21.15.37:0/3585713379 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8bc0b1e80 0x7fb8bc0d2880 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:01.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.315+0000 7fb8c25ff700 1 -- 172.21.15.37:0/3585713379 >> 172.21.15.37:0/3585713379 conn(0x7fb8bc09c1c0 msgr2=0x7fb8bc0d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:01.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.315+0000 7fb8c25ff700 1 -- 172.21.15.37:0/3585713379 shutdown_connections 2023-07-14T15:58:01.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.315+0000 7fb8c25ff700 1 -- 172.21.15.37:0/3585713379 wait complete. 2023-07-14T15:58:01.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.317+0000 7fb8c25ff700 1 Processor -- start 2023-07-14T15:58:01.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.317+0000 7fb8c25ff700 1 -- start start 2023-07-14T15:58:01.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.318+0000 7fb8c25ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8bc0b0ac0 0x7fb8bc1e4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:01.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.318+0000 7fb8c25ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8bc0b1e80 0x7fb8bc1e5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:01.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.318+0000 7fb8c25ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb8bc0cfd50 0x7fb8bc1f1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:01.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.318+0000 7fb8c25ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8bc1579c0 con 0x7fb8bc0b1e80 2023-07-14T15:58:01.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.318+0000 7fb8c25ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8bc157c10 con 0x7fb8bc0b0ac0 2023-07-14T15:58:01.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.318+0000 7fb8c25ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8bc157ef0 con 0x7fb8bc0cfd50 2023-07-14T15:58:01.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.318+0000 7fb8bb7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8bc0b1e80 0x7fb8bc1e5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:01.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.318+0000 7fb8bb7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8bc0b1e80 0x7fb8bc1e5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43798/0 (socket says 172.21.15.37:43798) 2023-07-14T15:58:01.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.318+0000 7fb8bb7fe700 1 -- 172.21.15.37:0/1035695017 learned_addr learned my addr 172.21.15.37:0/1035695017 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:01.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.318+0000 7fb8bbfff700 1 --2- 172.21.15.37:0/1035695017 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8bc0b0ac0 0x7fb8bc1e4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:01.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.318+0000 7fb8c0b9c700 1 --2- 172.21.15.37:0/1035695017 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb8bc0cfd50 0x7fb8bc1f1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:01.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.318+0000 7fb8bb7fe700 1 -- 172.21.15.37:0/1035695017 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb8bc0cfd50 msgr2=0x7fb8bc1f1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:01.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.318+0000 7fb8bb7fe700 1 --2- 172.21.15.37:0/1035695017 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb8bc0cfd50 0x7fb8bc1f1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:01.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.318+0000 7fb8bb7fe700 1 -- 172.21.15.37:0/1035695017 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8bc0b0ac0 msgr2=0x7fb8bc1e4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:01.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.318+0000 7fb8bb7fe700 1 --2- 172.21.15.37:0/1035695017 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8bc0b0ac0 0x7fb8bc1e4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:01.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.318+0000 7fb8bb7fe700 1 -- 172.21.15.37:0/1035695017 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b00094a0 con 0x7fb8bc0b1e80 2023-07-14T15:58:01.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.318+0000 7fb8c0b9c700 1 --2- 172.21.15.37:0/1035695017 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb8bc0cfd50 0x7fb8bc1f1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:58:01.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.318+0000 7fb8bbfff700 1 --2- 172.21.15.37:0/1035695017 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8bc0b0ac0 0x7fb8bc1e4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:58:01.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.319+0000 7fb8bb7fe700 1 --2- 172.21.15.37:0/1035695017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8bc0b1e80 0x7fb8bc1e5f90 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0000c00 tx=0x7fb8b0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:01.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.319+0000 7fb8b8ff9700 1 -- 172.21.15.37:0/1035695017 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b00038a0 con 0x7fb8bc0b1e80 2023-07-14T15:58:01.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.319+0000 7fb8b8ff9700 1 -- 172.21.15.37:0/1035695017 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b001f070 con 0x7fb8bc0b1e80 2023-07-14T15:58:01.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.319+0000 7fb8c25ff700 1 -- 172.21.15.37:0/1035695017 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8bc1581d0 con 0x7fb8bc0b1e80 2023-07-14T15:58:01.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.319+0000 7fb8b8ff9700 1 -- 172.21.15.37:0/1035695017 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b0003c60 con 0x7fb8bc0b1e80 2023-07-14T15:58:01.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.319+0000 7fb8c25ff700 1 -- 172.21.15.37:0/1035695017 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8bc1e64d0 con 0x7fb8bc0b1e80 2023-07-14T15:58:01.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.320+0000 7fb8c25ff700 1 -- 172.21.15.37:0/1035695017 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8bc1586f0 con 0x7fb8bc0b1e80 2023-07-14T15:58:01.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.321+0000 7fb8b8ff9700 1 -- 172.21.15.37:0/1035695017 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7fb8b0026480 con 0x7fb8bc0b1e80 2023-07-14T15:58:01.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.322+0000 7fb8b8ff9700 1 --2- 172.21.15.37:0/1035695017 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb8a806ad70 0x7fb8a806d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:01.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.322+0000 7fb8b8ff9700 1 -- 172.21.15.37:0/1035695017 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fb8b0021070 con 0x7fb8bc0b1e80 2023-07-14T15:58:01.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.322+0000 7fb8bbfff700 1 --2- 172.21.15.37:0/1035695017 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb8a806ad70 0x7fb8a806d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:01.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.323+0000 7fb8bbfff700 1 --2- 172.21.15.37:0/1035695017 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb8a806ad70 0x7fb8a806d220 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac007fd0 tx=0x7fb8ac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:01.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.326+0000 7fb8b8ff9700 1 -- 172.21.15.37:0/1035695017 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb8bc1586f0 con 0x7fb8bc0b1e80 2023-07-14T15:58:01.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.535+0000 7fb8c25ff700 1 -- 172.21.15.37:0/1035695017 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fb8bc1586f0 con 0x7fb8bc0b1e80 2023-07-14T15:58:01.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.539+0000 7fb8b8ff9700 1 -- 172.21.15.37:0/1035695017 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb8bc1586f0 con 0x7fb8bc0b1e80 2023-07-14T15:58:01.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.542+0000 7fb8c25ff700 1 -- 172.21.15.37:0/1035695017 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb8a806ad70 msgr2=0x7fb8a806d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:01.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.542+0000 7fb8c25ff700 1 --2- 172.21.15.37:0/1035695017 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb8a806ad70 0x7fb8a806d220 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac007fd0 tx=0x7fb8ac009040 comp rx=0 tx=0).stop 2023-07-14T15:58:01.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.542+0000 7fb8c25ff700 1 -- 172.21.15.37:0/1035695017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8bc0b1e80 msgr2=0x7fb8bc1e5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:01.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.542+0000 7fb8c25ff700 1 --2- 172.21.15.37:0/1035695017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8bc0b1e80 0x7fb8bc1e5f90 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0000c00 tx=0x7fb8b0004750 comp rx=0 tx=0).stop 2023-07-14T15:58:01.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.542+0000 7fb8c25ff700 1 -- 172.21.15.37:0/1035695017 shutdown_connections 2023-07-14T15:58:01.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.542+0000 7fb8c25ff700 1 --2- 172.21.15.37:0/1035695017 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8bc0b0ac0 0x7fb8bc1e4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:01.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.542+0000 7fb8c25ff700 1 --2- 172.21.15.37:0/1035695017 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb8a806ad70 0x7fb8a806d220 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:01.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.542+0000 7fb8c25ff700 1 --2- 172.21.15.37:0/1035695017 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb8bc0cfd50 0x7fb8bc1f1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:01.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.542+0000 7fb8c25ff700 1 --2- 172.21.15.37:0/1035695017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8bc0b1e80 0x7fb8bc1e5f90 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:01.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.542+0000 7fb8c25ff700 1 -- 172.21.15.37:0/1035695017 >> 172.21.15.37:0/1035695017 conn(0x7fb8bc09c1c0 msgr2=0x7fb8bc0d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:01.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.542+0000 7fb8c25ff700 1 -- 172.21.15.37:0/1035695017 shutdown_connections 2023-07-14T15:58:01.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:01.542+0000 7fb8c25ff700 1 -- 172.21.15.37:0/1035695017 wait complete. 2023-07-14T15:58:01.544 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-14T15:58:01.544 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T15:58:01.640 DEBUG:teuthology.orchestra.run.smithi098:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T15:58:01.747 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-14T15:58:01.748 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-14T15:58:01.748 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T15:58:01.793 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348708k,nr_inodes=4087177,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=34,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275628k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-07-14T15:58:01.793 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-14T15:58:01.793 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T15:58:01.837 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345608k,nr_inodes=4086402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275008k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-07-14T15:58:01.838 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-14T15:58:01.838 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T15:58:01.881 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348708k,nr_inodes=4087177,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=34,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275628k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-07-14T15:58:01.882 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-14T15:58:01.882 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T15:58:01.925 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345608k,nr_inodes=4086402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275008k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-07-14T15:58:01.926 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-14T15:58:01.926 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T15:58:02.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.147+0000 7f9e05fff700 1 Processor -- start 2023-07-14T15:58:02.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.147+0000 7f9e05fff700 1 -- start start 2023-07-14T15:58:02.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.148+0000 7f9e05fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9e000b8b80 0x7f9e000b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:02.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.148+0000 7f9e05fff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f9e00160c50 0x7f9e000cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:02.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.148+0000 7f9e05fff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e000cf6f0 con 0x7f9e000cf8b0 2023-07-14T15:58:02.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.148+0000 7f9e05fff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e000d0de0 con 0x7f9e000b8b80 2023-07-14T15:58:02.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.148+0000 7f9e05fff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e000cd590 con 0x7f9e00160c50 2023-07-14T15:58:02.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.148+0000 7f9dff7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9e000b8b80 0x7f9e000b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:02.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.149+0000 7f9dff7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9e000b8b80 0x7f9e000b5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43800/0 (socket says 172.21.15.37:43800) 2023-07-14T15:58:02.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.149+0000 7f9dff7fe700 1 -- 172.21.15.37:0/1966837416 learned_addr learned my addr 172.21.15.37:0/1966837416 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:02.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.149+0000 7f9dfeffd700 1 --2- 172.21.15.37:0/1966837416 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f9e00160c50 0x7f9e000cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:02.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.149+0000 7f9dfffff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9e000cf8b0 0x7f9e000d1270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57566/0 (socket says 172.21.15.37:57566) 2023-07-14T15:58:02.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.149+0000 7f9dff7fe700 1 -- 172.21.15.37:0/1966837416 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f9e00160c50 msgr2=0x7f9e000cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:02.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.149+0000 7f9dff7fe700 1 --2- 172.21.15.37:0/1966837416 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f9e00160c50 0x7f9e000cf1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:02.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.149+0000 7f9dff7fe700 1 -- 172.21.15.37:0/1966837416 >> v1:172.21.15.37:6789/0 conn(0x7f9e000cf8b0 legacy=0x7f9e000d1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:02.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.149+0000 7f9dff7fe700 1 -- 172.21.15.37:0/1966837416 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e000cd870 con 0x7f9e000b8b80 2023-07-14T15:58:02.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.149+0000 7f9dff7fe700 1 --2- 172.21.15.37:0/1966837416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e000b8b80 0x7f9e000b5cf0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f9df00098f0 tx=0x7f9df0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca2cf63d73040626 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:02.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.149+0000 7f9dfe7fc700 1 -- 172.21.15.37:0/1966837416 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df0011830 con 0x7f9e000b8b80 2023-07-14T15:58:02.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.150+0000 7f9dfe7fc700 1 -- 172.21.15.37:0/1966837416 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df0011990 con 0x7f9e000b8b80 2023-07-14T15:58:02.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.150+0000 7f9dfe7fc700 1 -- 172.21.15.37:0/1966837416 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df0011d20 con 0x7f9e000b8b80 2023-07-14T15:58:02.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.150+0000 7f9e05fff700 1 -- 172.21.15.37:0/1966837416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e000b8b80 msgr2=0x7f9e000b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:02.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.150+0000 7f9e05fff700 1 --2- 172.21.15.37:0/1966837416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e000b8b80 0x7f9e000b5cf0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f9df00098f0 tx=0x7f9df0009c00 comp rx=0 tx=0).stop 2023-07-14T15:58:02.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.150+0000 7f9e05fff700 1 -- 172.21.15.37:0/1966837416 shutdown_connections 2023-07-14T15:58:02.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.150+0000 7f9e05fff700 1 --2- 172.21.15.37:0/1966837416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e000b8b80 0x7f9e000b5cf0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:02.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.150+0000 7f9e05fff700 1 --2- 172.21.15.37:0/1966837416 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f9e00160c50 0x7f9e000cf1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:02.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.150+0000 7f9e05fff700 1 -- 172.21.15.37:0/1966837416 >> 172.21.15.37:0/1966837416 conn(0x7f9e0006b150 msgr2=0x7f9e0006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:02.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.150+0000 7f9e05fff700 1 -- 172.21.15.37:0/1966837416 shutdown_connections 2023-07-14T15:58:02.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.150+0000 7f9e05fff700 1 -- 172.21.15.37:0/1966837416 wait complete. 2023-07-14T15:58:02.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.153+0000 7f9e05fff700 1 Processor -- start 2023-07-14T15:58:02.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.153+0000 7f9e05fff700 1 -- start start 2023-07-14T15:58:02.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.154+0000 7f9e05fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e000b8b80 0x7f9e000cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:02.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.154+0000 7f9e05fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e000cf8b0 0x7f9e000c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:02.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.154+0000 7f9e05fff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f9e00160c50 0x7f9e000c6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:02.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.154+0000 7f9e05fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e000cc910 con 0x7f9e000cf8b0 2023-07-14T15:58:02.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.154+0000 7f9e05fff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e000cb330 con 0x7f9e000b8b80 2023-07-14T15:58:02.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.154+0000 7f9e05fff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e000cb610 con 0x7f9e00160c50 2023-07-14T15:58:02.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.154+0000 7f9dfeffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e000cf8b0 0x7f9e000c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:02.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.154+0000 7f9dfeffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e000cf8b0 0x7f9e000c69d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43804/0 (socket says 172.21.15.37:43804) 2023-07-14T15:58:02.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.154+0000 7f9dfeffd700 1 -- 172.21.15.37:0/1504891750 learned_addr learned my addr 172.21.15.37:0/1504891750 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:02.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.155+0000 7f9dff7fe700 1 --2- 172.21.15.37:0/1504891750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e000b8b80 0x7f9e000cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:02.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.155+0000 7f9dfffff700 1 --2- 172.21.15.37:0/1504891750 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f9e00160c50 0x7f9e000c6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:02.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.155+0000 7f9dfeffd700 1 -- 172.21.15.37:0/1504891750 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f9e00160c50 msgr2=0x7f9e000c6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:02.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.155+0000 7f9dfeffd700 1 --2- 172.21.15.37:0/1504891750 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f9e00160c50 0x7f9e000c6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:02.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.155+0000 7f9dfeffd700 1 -- 172.21.15.37:0/1504891750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e000b8b80 msgr2=0x7f9e000cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:02.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.155+0000 7f9dfeffd700 1 --2- 172.21.15.37:0/1504891750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e000b8b80 0x7f9e000cc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:02.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.155+0000 7f9dfeffd700 1 -- 172.21.15.37:0/1504891750 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df0009550 con 0x7f9e000cf8b0 2023-07-14T15:58:02.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.155+0000 7f9dfeffd700 1 --2- 172.21.15.37:0/1504891750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e000cf8b0 0x7f9e000c69d0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f9df400e870 tx=0x7f9df400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:02.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.155+0000 7f9de7fff700 1 -- 172.21.15.37:0/1504891750 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df4009590 con 0x7f9e000cf8b0 2023-07-14T15:58:02.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.155+0000 7f9de7fff700 1 -- 172.21.15.37:0/1504891750 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df4013680 con 0x7f9e000cf8b0 2023-07-14T15:58:02.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.155+0000 7f9e05fff700 1 -- 172.21.15.37:0/1504891750 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e000cb8f0 con 0x7f9e000cf8b0 2023-07-14T15:58:02.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.155+0000 7f9de7fff700 1 -- 172.21.15.37:0/1504891750 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df40139f0 con 0x7f9e000cf8b0 2023-07-14T15:58:02.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.156+0000 7f9e05fff700 1 -- 172.21.15.37:0/1504891750 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e000cbeb0 con 0x7f9e000cf8b0 2023-07-14T15:58:02.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.157+0000 7f9e05fff700 1 -- 172.21.15.37:0/1504891750 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e00067840 con 0x7f9e000cf8b0 2023-07-14T15:58:02.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.158+0000 7f9de7fff700 1 -- 172.21.15.37:0/1504891750 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f9df4013b50 con 0x7f9e000cf8b0 2023-07-14T15:58:02.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.158+0000 7f9de7fff700 1 --2- 172.21.15.37:0/1504891750 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f9dec06ad70 0x7f9dec06d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:02.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.158+0000 7f9de7fff700 1 -- 172.21.15.37:0/1504891750 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f9df4088fd0 con 0x7f9e000cf8b0 2023-07-14T15:58:02.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.159+0000 7f9dff7fe700 1 --2- 172.21.15.37:0/1504891750 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f9dec06ad70 0x7f9dec06d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:02.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.160+0000 7f9dff7fe700 1 --2- 172.21.15.37:0/1504891750 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f9dec06ad70 0x7f9dec06d220 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9df0009c40 tx=0x7f9df0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:02.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.163+0000 7f9de7fff700 1 -- 172.21.15.37:0/1504891750 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9df4057e10 con 0x7f9e000cf8b0 2023-07-14T15:58:02.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.419+0000 7f9e05fff700 1 -- 172.21.15.37:0/1504891750 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9e0006c9b0 con 0x7f9e000cf8b0 2023-07-14T15:58:02.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.419+0000 7f9de7fff700 1 -- 172.21.15.37:0/1504891750 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f9df4021de0 con 0x7f9e000cf8b0 2023-07-14T15:58:02.404 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:58:02.404 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/1292294727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6835","nonce":1292294727},{"type":"v1","addr":"172.21.15.98:6837","nonce":1292294727}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4811,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1091097806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1091097806},{"type":"v1","addr":"172.21.15.37:6835","nonce":1091097806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5059,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6836/2838228048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2838228048},{"type":"v1","addr":"172.21.15.98:6836","nonce":2838228048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5565,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/2818676316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2818676316},{"type":"v1","addr":"172.21.15.37:6834","nonce":2818676316}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[]} 2023-07-14T15:58:02.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.422+0000 7f9e05fff700 1 -- 172.21.15.37:0/1504891750 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f9dec06ad70 msgr2=0x7f9dec06d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:02.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.422+0000 7f9e05fff700 1 --2- 172.21.15.37:0/1504891750 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f9dec06ad70 0x7f9dec06d220 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9df0009c40 tx=0x7f9df0008030 comp rx=0 tx=0).stop 2023-07-14T15:58:02.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.422+0000 7f9e05fff700 1 -- 172.21.15.37:0/1504891750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e000cf8b0 msgr2=0x7f9e000c69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:02.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.422+0000 7f9e05fff700 1 --2- 172.21.15.37:0/1504891750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e000cf8b0 0x7f9e000c69d0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f9df400e870 tx=0x7f9df400eb80 comp rx=0 tx=0).stop 2023-07-14T15:58:02.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.422+0000 7f9e05fff700 1 -- 172.21.15.37:0/1504891750 shutdown_connections 2023-07-14T15:58:02.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.422+0000 7f9e05fff700 1 --2- 172.21.15.37:0/1504891750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e000b8b80 0x7f9e000cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:02.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.422+0000 7f9e05fff700 1 --2- 172.21.15.37:0/1504891750 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f9dec06ad70 0x7f9dec06d220 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:02.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.422+0000 7f9e05fff700 1 --2- 172.21.15.37:0/1504891750 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f9e00160c50 0x7f9e000c6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:02.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.422+0000 7f9e05fff700 1 --2- 172.21.15.37:0/1504891750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e000cf8b0 0x7f9e000c69d0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:02.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.422+0000 7f9e05fff700 1 -- 172.21.15.37:0/1504891750 >> 172.21.15.37:0/1504891750 conn(0x7f9e0006b150 msgr2=0x7f9e0015cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:02.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.422+0000 7f9e05fff700 1 -- 172.21.15.37:0/1504891750 shutdown_connections 2023-07-14T15:58:02.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.422+0000 7f9e05fff700 1 -- 172.21.15.37:0/1504891750 wait complete. 2023-07-14T15:58:02.408 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 19 2023-07-14T15:58:02.425 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-14T15:58:02.426 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-14T15:58:02.426 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-14T15:58:02.426 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T15:58:02.427 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-14T15:58:02.427 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-14T15:58:02.428 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-14T15:58:02.428 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T15:58:02.429 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-14T15:58:02.429 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-14T15:58:02.430 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-14T15:58:02.430 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T15:58:02.431 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-14T15:58:02.431 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-14T15:58:02.432 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-14T15:58:02.432 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T15:58:02.441 INFO:tasks.ceph.mds.a:Stopped 2023-07-14T15:58:02.441 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-14T15:58:02.443 INFO:tasks.ceph.mds.c:Stopped 2023-07-14T15:58:02.443 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-14T15:58:02.444 INFO:tasks.ceph.mds.b:Stopped 2023-07-14T15:58:02.445 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-14T15:58:02.446 INFO:tasks.ceph.mds.d:Stopped 2023-07-14T15:58:02.446 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-14T15:58:02.491 INFO:tasks.ceph.mds.b:Started 2023-07-14T15:58:02.491 INFO:tasks.ceph.mds.a:Started 2023-07-14T15:58:02.492 DEBUG:teuthology.parallel:result is None 2023-07-14T15:58:02.492 DEBUG:teuthology.parallel:result is None 2023-07-14T15:58:02.494 INFO:tasks.ceph.mds.d:Started 2023-07-14T15:58:02.495 DEBUG:teuthology.parallel:result is None 2023-07-14T15:58:02.495 INFO:tasks.ceph.mds.c:Started 2023-07-14T15:58:02.496 DEBUG:teuthology.parallel:result is None 2023-07-14T15:58:02.496 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-14T15:58:02.635 INFO:tasks.ceph.mds.b.smithi098.stdout:starting mds.b at 2023-07-14T15:58:02.638 INFO:tasks.ceph.mds.d.smithi098.stdout:starting mds.d at 2023-07-14T15:58:02.642 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2023-07-14T15:58:02.648 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-07-14T15:58:02.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.726+0000 7f25659ff700 1 Processor -- start 2023-07-14T15:58:02.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.726+0000 7f25659ff700 1 -- start start 2023-07-14T15:58:02.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.727+0000 7f25659ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f25600adfe0 0x7f25600c9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:02.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.728+0000 7f25659ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f25600cbbf0 0x7f25600c9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:02.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.728+0000 7f25659ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25601598c0 con 0x7f25600cda10 2023-07-14T15:58:02.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.728+0000 7f25659ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f256015dec0 con 0x7f25600cbbf0 2023-07-14T15:58:02.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.728+0000 7f25659ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25600ccc50 con 0x7f25600adfe0 2023-07-14T15:58:02.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.728+0000 7f2557fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f25600cda10 0x7f25600cb4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57592/0 (socket says 172.21.15.37:57592) 2023-07-14T15:58:02.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.728+0000 7f2557fff700 1 -- 172.21.15.37:0/3403104993 learned_addr learned my addr 172.21.15.37:0/3403104993 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:58:02.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.728+0000 7f255f7fe700 1 --2- 172.21.15.37:0/3403104993 >> v2:172.21.15.37:3300/0 conn(0x7f25600cbbf0 0x7f25600c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:02.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.728+0000 7f255effd700 1 --2- 172.21.15.37:0/3403104993 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f25600adfe0 0x7f25600c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:02.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.728+0000 7f255e7fc700 1 -- 172.21.15.37:0/3403104993 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 594061275 0 0) 0x7f2548001110 con 0x7f25600cda10 2023-07-14T15:58:02.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.728+0000 7f255e7fc700 1 -- 172.21.15.37:0/3403104993 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f254c0035b0 con 0x7f25600cda10 2023-07-14T15:58:02.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.728+0000 7f255f7fe700 1 -- 172.21.15.37:0/3403104993 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f25600adfe0 msgr2=0x7f25600c9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:02.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.728+0000 7f255f7fe700 1 --2- 172.21.15.37:0/3403104993 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f25600adfe0 0x7f25600c9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:02.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.728+0000 7f255f7fe700 1 -- 172.21.15.37:0/3403104993 >> v1:172.21.15.37:6789/0 conn(0x7f25600cda10 legacy=0x7f25600cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:02.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.728+0000 7f255f7fe700 1 -- 172.21.15.37:0/3403104993 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25600ccf30 con 0x7f25600cbbf0 2023-07-14T15:58:02.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.729+0000 7f255f7fe700 1 --2- 172.21.15.37:0/3403104993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25600cbbf0 0x7f25600c9660 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2558009d90 tx=0x7f255800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9fb797291da1245 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:02.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.729+0000 7f255e7fc700 1 -- 172.21.15.37:0/3403104993 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255800e070 con 0x7f25600cbbf0 2023-07-14T15:58:02.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.729+0000 7f255e7fc700 1 -- 172.21.15.37:0/3403104993 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f255800bb20 con 0x7f25600cbbf0 2023-07-14T15:58:02.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.729+0000 7f255e7fc700 1 -- 172.21.15.37:0/3403104993 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255800be90 con 0x7f25600cbbf0 2023-07-14T15:58:02.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.729+0000 7f25659ff700 1 -- 172.21.15.37:0/3403104993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25600cbbf0 msgr2=0x7f25600c9660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:02.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.729+0000 7f25659ff700 1 --2- 172.21.15.37:0/3403104993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25600cbbf0 0x7f25600c9660 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2558009d90 tx=0x7f255800b330 comp rx=0 tx=0).stop 2023-07-14T15:58:02.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.730+0000 7f25659ff700 1 -- 172.21.15.37:0/3403104993 shutdown_connections 2023-07-14T15:58:02.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.730+0000 7f25659ff700 1 --2- 172.21.15.37:0/3403104993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25600cbbf0 0x7f25600c9660 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:02.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.730+0000 7f25659ff700 1 --2- 172.21.15.37:0/3403104993 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f25600adfe0 0x7f25600c9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:02.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.730+0000 7f25659ff700 1 -- 172.21.15.37:0/3403104993 >> 172.21.15.37:0/3403104993 conn(0x7f25600b0620 msgr2=0x7f25600b0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:02.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.730+0000 7f25659ff700 1 -- 172.21.15.37:0/3403104993 shutdown_connections 2023-07-14T15:58:02.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.730+0000 7f25659ff700 1 -- 172.21.15.37:0/3403104993 wait complete. 2023-07-14T15:58:02.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.732+0000 7f25659ff700 1 Processor -- start 2023-07-14T15:58:02.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.732+0000 7f25659ff700 1 -- start start 2023-07-14T15:58:02.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.734+0000 7f25659ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f25600adfe0 0x7f25600c8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:02.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.734+0000 7f25659ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25600cbbf0 0x7f25600c25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:02.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.734+0000 7f25659ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25600cda10 0x7f25600c2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:02.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.734+0000 7f25659ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2560157f60 con 0x7f25600cda10 2023-07-14T15:58:02.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.734+0000 7f25659ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25600c70b0 con 0x7f25600cbbf0 2023-07-14T15:58:02.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.734+0000 7f25659ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25600c7390 con 0x7f25600adfe0 2023-07-14T15:58:02.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.734+0000 7f255f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25600cda10 0x7f25600c2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:02.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.734+0000 7f255effd700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f25600adfe0 0x7f25600c8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:02.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.734+0000 7f255f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25600cda10 0x7f25600c2b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43854/0 (socket says 172.21.15.37:43854) 2023-07-14T15:58:02.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.734+0000 7f255f7fe700 1 -- 172.21.15.37:0/3028067999 learned_addr learned my addr 172.21.15.37:0/3028067999 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:02.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.734+0000 7f2557fff700 1 --2- 172.21.15.37:0/3028067999 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25600cbbf0 0x7f25600c25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:02.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.734+0000 7f255f7fe700 1 -- 172.21.15.37:0/3028067999 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f25600adfe0 msgr2=0x7f25600c8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:02.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.734+0000 7f255f7fe700 1 --2- 172.21.15.37:0/3028067999 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f25600adfe0 0x7f25600c8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:02.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.734+0000 7f255f7fe700 1 -- 172.21.15.37:0/3028067999 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25600cbbf0 msgr2=0x7f25600c25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:02.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.734+0000 7f255f7fe700 1 --2- 172.21.15.37:0/3028067999 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25600cbbf0 0x7f25600c25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:02.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.734+0000 7f255f7fe700 1 -- 172.21.15.37:0/3028067999 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2558009a70 con 0x7f25600cda10 2023-07-14T15:58:02.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.735+0000 7f255f7fe700 1 --2- 172.21.15.37:0/3028067999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25600cda10 0x7f25600c2b20 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f2558014040 tx=0x7f2558004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:02.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.735+0000 7f255cff9700 1 -- 172.21.15.37:0/3028067999 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2558004800 con 0x7f25600cda10 2023-07-14T15:58:02.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.735+0000 7f255cff9700 1 -- 172.21.15.37:0/3028067999 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2558020070 con 0x7f25600cda10 2023-07-14T15:58:02.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.735+0000 7f255cff9700 1 -- 172.21.15.37:0/3028067999 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25580276c0 con 0x7f25600cda10 2023-07-14T15:58:02.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.735+0000 7f25659ff700 1 -- 172.21.15.37:0/3028067999 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25600c7670 con 0x7f25600cda10 2023-07-14T15:58:02.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.735+0000 7f25659ff700 1 -- 172.21.15.37:0/3028067999 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25600c7c30 con 0x7f25600cda10 2023-07-14T15:58:02.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.736+0000 7f25659ff700 1 -- 172.21.15.37:0/3028067999 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25600c7e50 con 0x7f25600cda10 2023-07-14T15:58:02.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.737+0000 7f255cff9700 1 -- 172.21.15.37:0/3028067999 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f2558012430 con 0x7f25600cda10 2023-07-14T15:58:02.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.738+0000 7f255cff9700 1 --2- 172.21.15.37:0/3028067999 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f254006ad70 0x7f254006d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:02.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.738+0000 7f255cff9700 1 -- 172.21.15.37:0/3028067999 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f2558022070 con 0x7f25600cda10 2023-07-14T15:58:02.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.738+0000 7f255effd700 1 --2- 172.21.15.37:0/3028067999 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f254006ad70 0x7f254006d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:02.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.739+0000 7f255effd700 1 --2- 172.21.15.37:0/3028067999 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f254006ad70 0x7f254006d220 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2550009b40 tx=0x7f2550009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:02.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.742+0000 7f255cff9700 1 -- 172.21.15.37:0/3028067999 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2558056070 con 0x7f25600cda10 2023-07-14T15:58:02.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:02.968+0000 7f25659ff700 1 -- 172.21.15.37:0/3028067999 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f256004e210 con 0x7f25600cda10 2023-07-14T15:58:03.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.094+0000 7f255cff9700 1 -- 172.21.15.37:0/3028067999 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v43) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2558059690 con 0x7f25600cda10 2023-07-14T15:58:03.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.097+0000 7f25659ff700 1 -- 172.21.15.37:0/3028067999 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f254006ad70 msgr2=0x7f254006d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:03.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.097+0000 7f25659ff700 1 --2- 172.21.15.37:0/3028067999 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f254006ad70 0x7f254006d220 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2550009b40 tx=0x7f2550009210 comp rx=0 tx=0).stop 2023-07-14T15:58:03.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.097+0000 7f25659ff700 1 -- 172.21.15.37:0/3028067999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25600cda10 msgr2=0x7f25600c2b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:03.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.097+0000 7f25659ff700 1 --2- 172.21.15.37:0/3028067999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25600cda10 0x7f25600c2b20 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f2558014040 tx=0x7f2558004ad0 comp rx=0 tx=0).stop 2023-07-14T15:58:03.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.097+0000 7f25659ff700 1 -- 172.21.15.37:0/3028067999 shutdown_connections 2023-07-14T15:58:03.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.097+0000 7f25659ff700 1 --2- 172.21.15.37:0/3028067999 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f254006ad70 0x7f254006d220 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:03.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.097+0000 7f25659ff700 1 --2- 172.21.15.37:0/3028067999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25600cda10 0x7f25600c2b20 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:03.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.097+0000 7f25659ff700 1 --2- 172.21.15.37:0/3028067999 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f25600adfe0 0x7f25600c8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:03.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.097+0000 7f25659ff700 1 --2- 172.21.15.37:0/3028067999 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25600cbbf0 0x7f25600c25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:03.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.097+0000 7f25659ff700 1 -- 172.21.15.37:0/3028067999 >> 172.21.15.37:0/3028067999 conn(0x7f25600b0620 msgr2=0x7f25600cf030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:03.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.097+0000 7f25659ff700 1 -- 172.21.15.37:0/3028067999 shutdown_connections 2023-07-14T15:58:03.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.097+0000 7f25659ff700 1 -- 172.21.15.37:0/3028067999 wait complete. 2023-07-14T15:58:03.086 INFO:teuthology.orchestra.run.smithi037.stderr: removed all blocklist entries 2023-07-14T15:58:03.101 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-14T15:58:03.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.319+0000 7f34e61ff700 1 Processor -- start 2023-07-14T15:58:03.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.319+0000 7f34e61ff700 1 -- start start 2023-07-14T15:58:03.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.320+0000 7f34e61ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f34e01603d0 0x7f34e00cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:03.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.320+0000 7f34e61ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f34e00cfc90 0x7f34e00d00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:03.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.320+0000 7f34e61ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34e00d0630 con 0x7f34e00b01a0 2023-07-14T15:58:03.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.320+0000 7f34e61ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34e00b0570 con 0x7f34e01603d0 2023-07-14T15:58:03.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.320+0000 7f34e61ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e015cca0 con 0x7f34e00cfc90 2023-07-14T15:58:03.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.321+0000 7f34deffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f34e01603d0 0x7f34e00cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:03.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.321+0000 7f34deffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f34e01603d0 0x7f34e00cf530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43868/0 (socket says 172.21.15.37:43868) 2023-07-14T15:58:03.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.321+0000 7f34deffd700 1 -- 172.21.15.37:0/4100635158 learned_addr learned my addr 172.21.15.37:0/4100635158 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:03.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.321+0000 7f34dffff700 1 --2- 172.21.15.37:0/4100635158 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f34e00cfc90 0x7f34e00d00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:03.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.321+0000 7f34deffd700 1 -- 172.21.15.37:0/4100635158 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f34e00cfc90 msgr2=0x7f34e00d00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:03.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.321+0000 7f34deffd700 1 --2- 172.21.15.37:0/4100635158 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f34e00cfc90 0x7f34e00d00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:03.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.321+0000 7f34deffd700 1 -- 172.21.15.37:0/4100635158 >> v1:172.21.15.98:6789/0 conn(0x7f34e00b01a0 legacy=0x7f34e00cb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:03.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.321+0000 7f34deffd700 1 -- 172.21.15.37:0/4100635158 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e00b29d0 con 0x7f34e01603d0 2023-07-14T15:58:03.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.321+0000 7f34dffff700 1 --2- 172.21.15.37:0/4100635158 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f34e00cfc90 0x7f34e00d00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:58:03.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.321+0000 7f34deffd700 1 --2- 172.21.15.37:0/4100635158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34e01603d0 0x7f34e00cf530 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f34d40098f0 tx=0x7f34d4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0f6c13c6c3893b3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:03.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.322+0000 7f34de7fc700 1 -- 172.21.15.37:0/4100635158 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d400b8a0 con 0x7f34e01603d0 2023-07-14T15:58:03.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.322+0000 7f34de7fc700 1 -- 172.21.15.37:0/4100635158 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d400ba00 con 0x7f34e01603d0 2023-07-14T15:58:03.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.322+0000 7f34de7fc700 1 -- 172.21.15.37:0/4100635158 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d400bd90 con 0x7f34e01603d0 2023-07-14T15:58:03.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.322+0000 7f34e61ff700 1 -- 172.21.15.37:0/4100635158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34e01603d0 msgr2=0x7f34e00cf530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:03.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.322+0000 7f34e61ff700 1 --2- 172.21.15.37:0/4100635158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34e01603d0 0x7f34e00cf530 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f34d40098f0 tx=0x7f34d4009c00 comp rx=0 tx=0).stop 2023-07-14T15:58:03.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.322+0000 7f34e61ff700 1 -- 172.21.15.37:0/4100635158 shutdown_connections 2023-07-14T15:58:03.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.322+0000 7f34e61ff700 1 --2- 172.21.15.37:0/4100635158 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f34e00cfc90 0x7f34e00d00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:03.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.322+0000 7f34e61ff700 1 --2- 172.21.15.37:0/4100635158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34e01603d0 0x7f34e00cf530 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:03.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.322+0000 7f34e61ff700 1 -- 172.21.15.37:0/4100635158 >> 172.21.15.37:0/4100635158 conn(0x7f34e0065bd0 msgr2=0x7f34e0065fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:03.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.322+0000 7f34e61ff700 1 -- 172.21.15.37:0/4100635158 shutdown_connections 2023-07-14T15:58:03.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.322+0000 7f34e61ff700 1 -- 172.21.15.37:0/4100635158 wait complete. 2023-07-14T15:58:03.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.324+0000 7f34e61ff700 1 Processor -- start 2023-07-14T15:58:03.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.324+0000 7f34e61ff700 1 -- start start 2023-07-14T15:58:03.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.325+0000 7f34e61ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34e00b01a0 0x7f34e00c5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:03.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.325+0000 7f34e61ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f34e00cfc90 0x7f34e0158fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:03.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.325+0000 7f34e61ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34e01603d0 0x7f34e0153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:03.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.325+0000 7f34e61ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e00c45d0 con 0x7f34e01603d0 2023-07-14T15:58:03.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.325+0000 7f34e61ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e00ae160 con 0x7f34e00b01a0 2023-07-14T15:58:03.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.325+0000 7f34e61ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e00ade80 con 0x7f34e00cfc90 2023-07-14T15:58:03.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.325+0000 7f34dffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34e01603d0 0x7f34e0153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:03.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.325+0000 7f34dffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34e01603d0 0x7f34e0153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43872/0 (socket says 172.21.15.37:43872) 2023-07-14T15:58:03.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.325+0000 7f34dffff700 1 -- 172.21.15.37:0/2547767030 learned_addr learned my addr 172.21.15.37:0/2547767030 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:03.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.325+0000 7f34df7fe700 1 --2- 172.21.15.37:0/2547767030 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34e00b01a0 0x7f34e00c5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:03.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.325+0000 7f34deffd700 1 --2- 172.21.15.37:0/2547767030 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f34e00cfc90 0x7f34e0158fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:03.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.326+0000 7f34dffff700 1 -- 172.21.15.37:0/2547767030 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f34e00cfc90 msgr2=0x7f34e0158fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:03.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.326+0000 7f34dffff700 1 --2- 172.21.15.37:0/2547767030 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f34e00cfc90 0x7f34e0158fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:03.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.326+0000 7f34dffff700 1 -- 172.21.15.37:0/2547767030 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34e00b01a0 msgr2=0x7f34e00c5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:03.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.326+0000 7f34dffff700 1 --2- 172.21.15.37:0/2547767030 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34e00b01a0 0x7f34e00c5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:03.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.326+0000 7f34dffff700 1 -- 172.21.15.37:0/2547767030 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d4009550 con 0x7f34e01603d0 2023-07-14T15:58:03.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.326+0000 7f34df7fe700 1 --2- 172.21.15.37:0/2547767030 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34e00b01a0 0x7f34e00c5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:58:03.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.326+0000 7f34dffff700 1 --2- 172.21.15.37:0/2547767030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34e01603d0 0x7f34e0153dd0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f34d8007ef0 tx=0x7f34d800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:03.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.326+0000 7f34c7fff700 1 -- 172.21.15.37:0/2547767030 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d800dd80 con 0x7f34e01603d0 2023-07-14T15:58:03.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.326+0000 7f34c7fff700 1 -- 172.21.15.37:0/2547767030 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d800f040 con 0x7f34e01603d0 2023-07-14T15:58:03.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.326+0000 7f34e61ff700 1 -- 172.21.15.37:0/2547767030 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34e00c47b0 con 0x7f34e01603d0 2023-07-14T15:58:03.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.326+0000 7f34c7fff700 1 -- 172.21.15.37:0/2547767030 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d8003c60 con 0x7f34e01603d0 2023-07-14T15:58:03.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.327+0000 7f34e61ff700 1 -- 172.21.15.37:0/2547767030 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34e01594e0 con 0x7f34e01603d0 2023-07-14T15:58:03.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.328+0000 7f34e61ff700 1 -- 172.21.15.37:0/2547767030 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34e006d8c0 con 0x7f34e01603d0 2023-07-14T15:58:03.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.329+0000 7f34c7fff700 1 -- 172.21.15.37:0/2547767030 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f34d8004030 con 0x7f34e01603d0 2023-07-14T15:58:03.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.329+0000 7f34c7fff700 1 --2- 172.21.15.37:0/2547767030 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f34cc06ad70 0x7f34cc06d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:03.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.329+0000 7f34c7fff700 1 -- 172.21.15.37:0/2547767030 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f34d8089230 con 0x7f34e01603d0 2023-07-14T15:58:03.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.330+0000 7f34df7fe700 1 --2- 172.21.15.37:0/2547767030 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f34cc06ad70 0x7f34cc06d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:03.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.330+0000 7f34df7fe700 1 --2- 172.21.15.37:0/2547767030 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f34cc06ad70 0x7f34cc06d220 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f34d0007fd0 tx=0x7f34d0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:03.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.334+0000 7f34c7fff700 1 -- 172.21.15.37:0/2547767030 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f34d80545c0 con 0x7f34e01603d0 2023-07-14T15:58:03.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.626+0000 7f34e61ff700 1 -- 172.21.15.37:0/2547767030 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f34e00c4fb0 con 0x7f34e01603d0 2023-07-14T15:58:03.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.627+0000 7f34c7fff700 1 -- 172.21.15.37:0/2547767030 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f34e00c4fb0 con 0x7f34e01603d0 2023-07-14T15:58:03.611 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:58:03.611 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-14T15:58:03.611 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_dump": [ 2023-07-14T15:58:03.611 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:58:03.611 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.a", 2023-07-14T15:58:03.611 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDVb7FkSxzFNhAAhrnBBg5xGqPBvvevPq4vZA==", 2023-07-14T15:58:03.612 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-14T15:58:03.612 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-14T15:58:03.612 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-14T15:58:03.612 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-14T15:58:03.612 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-14T15:58:03.612 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:58:03.613 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-14T15:58:03.613 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:58:03.613 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.b", 2023-07-14T15:58:03.613 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDWb7FkZalZExAAqIzmfWzer/rftvB+irYM5w==", 2023-07-14T15:58:03.613 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-14T15:58:03.613 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-14T15:58:03.613 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-14T15:58:03.613 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-14T15:58:03.614 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-14T15:58:03.614 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:58:03.614 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-14T15:58:03.614 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:58:03.614 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.c", 2023-07-14T15:58:03.614 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDWb7FkbJCQBxAAO/cHg6ZdojgzYGv21flqgQ==", 2023-07-14T15:58:03.614 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-14T15:58:03.615 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-14T15:58:03.615 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-14T15:58:03.615 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-14T15:58:03.615 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-14T15:58:03.615 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:58:03.616 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-14T15:58:03.616 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:58:03.616 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.d", 2023-07-14T15:58:03.616 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDWb7FkxQ7WHhAAeMQ+8/ypEagYuBalxTGYew==", 2023-07-14T15:58:03.616 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-14T15:58:03.617 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-14T15:58:03.617 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-14T15:58:03.617 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-14T15:58:03.617 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-14T15:58:03.617 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:58:03.617 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-14T15:58:03.617 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:58:03.618 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.0", 2023-07-14T15:58:03.618 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDab7FkNzKhIBAAen9vSEkCJn7EoBVXNfnboA==", 2023-07-14T15:58:03.619 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-14T15:58:03.619 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-14T15:58:03.619 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-14T15:58:03.619 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-14T15:58:03.619 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:58:03.619 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-14T15:58:03.620 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:58:03.620 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.1", 2023-07-14T15:58:03.621 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDdb7FkTRmBNhAA15XBAQ7LMuahPxyg3bzAQA==", 2023-07-14T15:58:03.621 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-14T15:58:03.622 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-14T15:58:03.622 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-14T15:58:03.622 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-14T15:58:03.622 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:58:03.623 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-14T15:58:03.623 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:58:03.623 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.2", 2023-07-14T15:58:03.623 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDhb7FkLa6hARAAj31Jgen/BeAnuRrGAbQAmw==", 2023-07-14T15:58:03.624 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-14T15:58:03.624 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-14T15:58:03.624 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-14T15:58:03.625 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-14T15:58:03.625 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:58:03.625 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-14T15:58:03.626 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:58:03.626 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.3", 2023-07-14T15:58:03.626 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDkb7FkenwSCRAAW0MIsfBqfycPzHB6Pdwl6w==", 2023-07-14T15:58:03.626 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-14T15:58:03.627 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-14T15:58:03.627 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-14T15:58:03.627 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-14T15:58:03.628 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:58:03.628 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-14T15:58:03.629 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:58:03.629 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.4", 2023-07-14T15:58:03.629 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDqb7FkjSHhJBAAR61S7ufnwHSiG5gPeEt9mQ==", 2023-07-14T15:58:03.629 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-14T15:58:03.630 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-14T15:58:03.630 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-14T15:58:03.630 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-14T15:58:03.631 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:58:03.631 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-14T15:58:03.631 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:58:03.632 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.5", 2023-07-14T15:58:03.632 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDtb7Fke+lwKBAAry9Kdgwm+H6t2DdcOJ3g4w==", 2023-07-14T15:58:03.632 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-14T15:58:03.632 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-14T15:58:03.633 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-14T15:58:03.633 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-14T15:58:03.633 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:58:03.633 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-14T15:58:03.634 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:58:03.634 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.6", 2023-07-14T15:58:03.634 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDwb7FkJDxaKxAAZvh6zl1Yl1+r6Cp4jvpL/w==", 2023-07-14T15:58:03.634 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-14T15:58:03.635 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-14T15:58:03.635 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-14T15:58:03.635 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-14T15:58:03.635 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:58:03.636 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-14T15:58:03.636 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:58:03.636 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.7", 2023-07-14T15:58:03.637 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDzb7FkY3CbLhAAZ2N8iigUMGTFAXYIcWLk7g==", 2023-07-14T15:58:03.637 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-14T15:58:03.637 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-14T15:58:03.638 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-14T15:58:03.638 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-14T15:58:03.638 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:58:03.639 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-14T15:58:03.640 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:58:03.640 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.0", 2023-07-14T15:58:03.640 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDWb7Fk8l4jKRAAD40aK9YW0bgBjt3LF5EM2Q==", 2023-07-14T15:58:03.640 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-14T15:58:03.641 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-14T15:58:03.641 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow r", 2023-07-14T15:58:03.641 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-14T15:58:03.641 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:58:03.641 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-14T15:58:03.642 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:58:03.642 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.1", 2023-07-14T15:58:03.642 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDWb7FkGMrgOBAA5c0LB2Z158/t57ZiKLSM/A==", 2023-07-14T15:58:03.642 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-14T15:58:03.642 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-14T15:58:03.643 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-07-14T15:58:03.643 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-07-14T15:58:03.643 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-07-14T15:58:03.643 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:58:03.644 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-14T15:58:03.644 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:58:03.644 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.2", 2023-07-14T15:58:03.644 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDWb7FktFUuMRAA3DeSj/TCt1iOd1L5LjlLNA==", 2023-07-14T15:58:03.645 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-14T15:58:03.645 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-14T15:58:03.645 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-07-14T15:58:03.645 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-07-14T15:58:03.645 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-07-14T15:58:03.646 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:58:03.646 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-14T15:58:03.646 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:58:03.646 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.3", 2023-07-14T15:58:03.646 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDXb7FkmG/QBBAA8xqYve+K8TfT94oNGgVcuA==", 2023-07-14T15:58:03.647 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-14T15:58:03.647 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-14T15:58:03.647 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-07-14T15:58:03.647 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-07-14T15:58:03.647 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-07-14T15:58:03.647 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:58:03.648 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-14T15:58:03.648 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:58:03.648 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.admin", 2023-07-14T15:58:03.648 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDUb7FkahD2ORAAoGbK+5qqIEgbFF44lku8nA==", 2023-07-14T15:58:03.648 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-14T15:58:03.649 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-07-14T15:58:03.649 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-14T15:58:03.649 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-14T15:58:03.649 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-14T15:58:03.649 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:58:03.650 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-14T15:58:03.650 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:58:03.650 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.x", 2023-07-14T15:58:03.650 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDVb7FkfzV7LhAAg+oMjrhI7XaOhlYDUSa9ug==", 2023-07-14T15:58:03.650 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-14T15:58:03.651 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-07-14T15:58:03.651 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-07-14T15:58:03.651 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-14T15:58:03.651 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:58:03.652 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-14T15:58:03.652 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:58:03.652 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.y", 2023-07-14T15:58:03.652 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDVb7FkCOFSJhAAyIE5jprQPjAID/yxt6h/hw==", 2023-07-14T15:58:03.652 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-14T15:58:03.652 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-07-14T15:58:03.653 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-07-14T15:58:03.653 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-14T15:58:03.653 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:58:03.653 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:58:03.653 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-07-14T15:58:03.654 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-14T15:58:03.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.629+0000 7f34e61ff700 1 -- 172.21.15.37:0/2547767030 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f34cc06ad70 msgr2=0x7f34cc06d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:03.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.629+0000 7f34e61ff700 1 --2- 172.21.15.37:0/2547767030 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f34cc06ad70 0x7f34cc06d220 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f34d0007fd0 tx=0x7f34d0009040 comp rx=0 tx=0).stop 2023-07-14T15:58:03.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.629+0000 7f34e61ff700 1 -- 172.21.15.37:0/2547767030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34e01603d0 msgr2=0x7f34e0153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:03.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.629+0000 7f34e61ff700 1 --2- 172.21.15.37:0/2547767030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34e01603d0 0x7f34e0153dd0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f34d8007ef0 tx=0x7f34d800d3b0 comp rx=0 tx=0).stop 2023-07-14T15:58:03.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.629+0000 7f34e61ff700 1 -- 172.21.15.37:0/2547767030 shutdown_connections 2023-07-14T15:58:03.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.629+0000 7f34e61ff700 1 --2- 172.21.15.37:0/2547767030 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34e00b01a0 0x7f34e00c5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:03.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.629+0000 7f34e61ff700 1 --2- 172.21.15.37:0/2547767030 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f34cc06ad70 0x7f34cc06d220 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:03.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.629+0000 7f34e61ff700 1 --2- 172.21.15.37:0/2547767030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34e01603d0 0x7f34e0153dd0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:03.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.629+0000 7f34e61ff700 1 --2- 172.21.15.37:0/2547767030 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f34e00cfc90 0x7f34e0158fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:03.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.629+0000 7f34e61ff700 1 -- 172.21.15.37:0/2547767030 >> 172.21.15.37:0/2547767030 conn(0x7f34e0065bd0 msgr2=0x7f34e006c530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:03.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.629+0000 7f34e61ff700 1 -- 172.21.15.37:0/2547767030 shutdown_connections 2023-07-14T15:58:03.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.629+0000 7f34e61ff700 1 -- 172.21.15.37:0/2547767030 wait complete. 2023-07-14T15:58:03.658 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T15:58:03.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.875+0000 7f603a5ff700 1 Processor -- start 2023-07-14T15:58:03.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.876+0000 7f603a5ff700 1 -- start start 2023-07-14T15:58:03.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.877+0000 7f603a5ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f60340c9b30 0x7f60340ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:03.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.877+0000 7f603a5ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f6034159790 0x7f60340af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:03.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.877+0000 7f603a5ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60340c9540 con 0x7f60341593c0 2023-07-14T15:58:03.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.877+0000 7f603a5ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60340c9ff0 con 0x7f6034159790 2023-07-14T15:58:03.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.877+0000 7f603a5ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60340ce3d0 con 0x7f60340c9b30 2023-07-14T15:58:03.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.877+0000 7f60337fe700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f60340c9b30 0x7f60340ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:03.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.877+0000 7f6038b9c700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f6034159790 0x7f60340af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:03.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.877+0000 7f6033fff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f60341593c0 0x7f603415db60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.37:40316/0 (socket says 172.21.15.37:40316) 2023-07-14T15:58:03.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.877+0000 7f6033fff700 1 -- 172.21.15.37:0/1217760020 learned_addr learned my addr 172.21.15.37:0/1217760020 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:58:03.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.878+0000 7f6038b9c700 1 -- 172.21.15.37:0/1217760020 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f60340c9b30 msgr2=0x7f60340ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:03.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.878+0000 7f6038b9c700 1 --2- 172.21.15.37:0/1217760020 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f60340c9b30 0x7f60340ccce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:03.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.878+0000 7f6038b9c700 1 -- 172.21.15.37:0/1217760020 >> v1:172.21.15.98:6789/0 conn(0x7f60341593c0 legacy=0x7f603415db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:03.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.878+0000 7f6038b9c700 1 -- 172.21.15.37:0/1217760020 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60340ce6b0 con 0x7f6034159790 2023-07-14T15:58:03.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.878+0000 7f60337fe700 1 --2- 172.21.15.37:0/1217760020 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f60340c9b30 0x7f60340ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:58:03.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.878+0000 7f6038b9c700 1 --2- 172.21.15.37:0/1217760020 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6034159790 0x7f60340af940 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f602c009d90 tx=0x7f602c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=574f84d8edf8d1e2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:03.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.878+0000 7f6032ffd700 1 -- 172.21.15.37:0/1217760020 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602c00e070 con 0x7f6034159790 2023-07-14T15:58:03.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.878+0000 7f6032ffd700 1 -- 172.21.15.37:0/1217760020 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f602c00bb20 con 0x7f6034159790 2023-07-14T15:58:03.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.878+0000 7f6032ffd700 1 -- 172.21.15.37:0/1217760020 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602c012430 con 0x7f6034159790 2023-07-14T15:58:03.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.879+0000 7f603a5ff700 1 -- 172.21.15.37:0/1217760020 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6034159790 msgr2=0x7f60340af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:03.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.879+0000 7f603a5ff700 1 --2- 172.21.15.37:0/1217760020 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6034159790 0x7f60340af940 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f602c009d90 tx=0x7f602c00b330 comp rx=0 tx=0).stop 2023-07-14T15:58:03.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.879+0000 7f603a5ff700 1 -- 172.21.15.37:0/1217760020 shutdown_connections 2023-07-14T15:58:03.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.879+0000 7f603a5ff700 1 --2- 172.21.15.37:0/1217760020 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6034159790 0x7f60340af940 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:03.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.879+0000 7f603a5ff700 1 --2- 172.21.15.37:0/1217760020 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f60340c9b30 0x7f60340ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:03.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.879+0000 7f603a5ff700 1 -- 172.21.15.37:0/1217760020 >> 172.21.15.37:0/1217760020 conn(0x7f60340b08c0 msgr2=0x7f60340b0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:03.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.879+0000 7f603a5ff700 1 -- 172.21.15.37:0/1217760020 shutdown_connections 2023-07-14T15:58:03.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.879+0000 7f603a5ff700 1 -- 172.21.15.37:0/1217760020 wait complete. 2023-07-14T15:58:03.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.882+0000 7f603a5ff700 1 Processor -- start 2023-07-14T15:58:03.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.882+0000 7f603a5ff700 1 -- start start 2023-07-14T15:58:03.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.883+0000 7f603a5ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60340c9b30 0x7f60340b4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:03.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.883+0000 7f603a5ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f60341593c0 0x7f6034070840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:03.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.883+0000 7f603a5ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6034159790 0x7f60340b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:03.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.883+0000 7f603a5ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603415b270 con 0x7f60340c9b30 2023-07-14T15:58:03.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.883+0000 7f603a5ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603415c5f0 con 0x7f6034159790 2023-07-14T15:58:03.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.883+0000 7f603a5ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f603415c8d0 con 0x7f60341593c0 2023-07-14T15:58:03.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.883+0000 7f6033fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60340c9b30 0x7f60340b4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:03.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.883+0000 7f6033fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60340c9b30 0x7f60340b4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43882/0 (socket says 172.21.15.37:43882) 2023-07-14T15:58:03.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.883+0000 7f6033fff700 1 -- 172.21.15.37:0/3104103691 learned_addr learned my addr 172.21.15.37:0/3104103691 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:03.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.884+0000 7f60337fe700 1 --2- 172.21.15.37:0/3104103691 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f60341593c0 0x7f6034070840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:03.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.884+0000 7f6038b9c700 1 --2- 172.21.15.37:0/3104103691 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6034159790 0x7f60340b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:03.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.884+0000 7f6033fff700 1 -- 172.21.15.37:0/3104103691 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f60341593c0 msgr2=0x7f6034070840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:03.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.884+0000 7f6033fff700 1 --2- 172.21.15.37:0/3104103691 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f60341593c0 0x7f6034070840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:03.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.884+0000 7f6033fff700 1 -- 172.21.15.37:0/3104103691 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6034159790 msgr2=0x7f60340b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:03.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.884+0000 7f6033fff700 1 --2- 172.21.15.37:0/3104103691 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6034159790 0x7f60340b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:03.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.884+0000 7f6033fff700 1 -- 172.21.15.37:0/3104103691 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60280094a0 con 0x7f60340c9b30 2023-07-14T15:58:03.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.884+0000 7f6033fff700 1 --2- 172.21.15.37:0/3104103691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60340c9b30 0x7f60340b4640 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f602400c520 tx=0x7f602400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:03.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.884+0000 7f6030ff9700 1 -- 172.21.15.37:0/3104103691 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6024005d70 con 0x7f60340c9b30 2023-07-14T15:58:03.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.884+0000 7f6030ff9700 1 -- 172.21.15.37:0/3104103691 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60240070d0 con 0x7f60340c9b30 2023-07-14T15:58:03.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.884+0000 7f603a5ff700 1 -- 172.21.15.37:0/3104103691 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f602c009a70 con 0x7f60340c9b30 2023-07-14T15:58:03.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.884+0000 7f6030ff9700 1 -- 172.21.15.37:0/3104103691 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6024007440 con 0x7f60340c9b30 2023-07-14T15:58:03.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.885+0000 7f603a5ff700 1 -- 172.21.15.37:0/3104103691 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f603415af00 con 0x7f60340c9b30 2023-07-14T15:58:03.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.886+0000 7f603a5ff700 1 -- 172.21.15.37:0/3104103691 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6034067840 con 0x7f60340c9b30 2023-07-14T15:58:03.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.887+0000 7f6030ff9700 1 -- 172.21.15.37:0/3104103691 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f60240075a0 con 0x7f60340c9b30 2023-07-14T15:58:03.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.887+0000 7f6030ff9700 1 --2- 172.21.15.37:0/3104103691 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f602006ad70 0x7f602006d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:03.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.888+0000 7f6030ff9700 1 -- 172.21.15.37:0/3104103691 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f60240884f0 con 0x7f60340c9b30 2023-07-14T15:58:03.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.888+0000 7f60337fe700 1 --2- 172.21.15.37:0/3104103691 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f602006ad70 0x7f602006d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:03.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.889+0000 7f60337fe700 1 --2- 172.21.15.37:0/3104103691 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f602006ad70 0x7f602006d220 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f60341f5950 tx=0x7f6028009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:03.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:03.892+0000 7f6030ff9700 1 -- 172.21.15.37:0/3104103691 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f60240538b0 con 0x7f60340c9b30 2023-07-14T15:58:04.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.104+0000 7f603a5ff700 1 -- 172.21.15.37:0/3104103691 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60340b16e0 con 0x7f60340c9b30 2023-07-14T15:58:04.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.105+0000 7f6030ff9700 1 -- 172.21.15.37:0/3104103691 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+14629 (secure 0 0 0) 0x7f6024056ed0 con 0x7f60340c9b30 2023-07-14T15:58:04.089 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:58:04.090 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":45,"fsid":"9da30401-a779-4e46-aba6-00c2494c6c67","created":"2023-07-14T15:55:39.898867+0000","modified":"2023-07-14T15:58:03.099348+0000","last_up_change":"2023-07-14T15:55:53.025696+0000","last_in_change":"2023-07-14T15:55:43.388192+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T15:55:52.907261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T15:55:59.992839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d049535-7b87-4276-8fe5-0f74ba422d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6801","nonce":2783032392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6803","nonce":2783032392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6807","nonce":2783032392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6805","nonce":2783032392}]},"public_addr":"172.21.15.37:6801/2783032392","cluster_addr":"172.21.15.37:6803/2783032392","heartbeat_back_addr":"172.21.15.37:6807/2783032392","heartbeat_front_addr":"172.21.15.37:6805/2783032392","state":["exists","up"]},{"osd":1,"uuid":"79ec948d-ead2-4c2d-923a-dd6eeaac9dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6823","nonce":1190059746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6826","nonce":1190059746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6831","nonce":1190059746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6829","nonce":1190059746}]},"public_addr":"172.21.15.37:6823/1190059746","cluster_addr":"172.21.15.37:6826/1190059746","heartbeat_back_addr":"172.21.15.37:6831/1190059746","heartbeat_front_addr":"172.21.15.37:6829/1190059746","state":["exists","up"]},{"osd":2,"uuid":"a1db6690-c160-4366-9c82-2cca17e4bba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6809","nonce":2266223499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6813","nonce":2266223499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6820","nonce":2266223499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6816","nonce":2266223499}]},"public_addr":"172.21.15.37:6809/2266223499","cluster_addr":"172.21.15.37:6813/2266223499","heartbeat_back_addr":"172.21.15.37:6820/2266223499","heartbeat_front_addr":"172.21.15.37:6816/2266223499","state":["exists","up"]},{"osd":3,"uuid":"767b8220-e79a-4a86-a162-6b3b73198379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6812","nonce":4166694594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6817","nonce":4166694594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6828","nonce":4166694594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6822","nonce":4166694594}]},"public_addr":"172.21.15.37:6812/4166694594","cluster_addr":"172.21.15.37:6817/4166694594","heartbeat_back_addr":"172.21.15.37:6828/4166694594","heartbeat_front_addr":"172.21.15.37:6822/4166694594","state":["exists","up"]},{"osd":4,"uuid":"717bd773-ae7e-4236-ac79-900cf99a37c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6801","nonce":3529020407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6803","nonce":3529020407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6807","nonce":3529020407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6805","nonce":3529020407}]},"public_addr":"172.21.15.98:6801/3529020407","cluster_addr":"172.21.15.98:6803/3529020407","heartbeat_back_addr":"172.21.15.98:6807/3529020407","heartbeat_front_addr":"172.21.15.98:6805/3529020407","state":["exists","up"]},{"osd":5,"uuid":"a941d358-0f03-4136-a9b2-3a1c2e9358cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6817","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6819","nonce":2311501838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6821","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6823","nonce":2311501838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6829","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6831","nonce":2311501838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6825","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6827","nonce":2311501838}]},"public_addr":"172.21.15.98:6819/2311501838","cluster_addr":"172.21.15.98:6823/2311501838","heartbeat_back_addr":"172.21.15.98:6831/2311501838","heartbeat_front_addr":"172.21.15.98:6827/2311501838","state":["exists","up"]},{"osd":6,"uuid":"27153772-6d4b-479d-9953-0582e7b96743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6809","nonce":1144224691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6811","nonce":1144224691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6815","nonce":1144224691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6813","nonce":1144224691}]},"public_addr":"172.21.15.98:6809/1144224691","cluster_addr":"172.21.15.98:6811/1144224691","heartbeat_back_addr":"172.21.15.98:6815/1144224691","heartbeat_front_addr":"172.21.15.98:6813/1144224691","state":["exists","up"]},{"osd":7,"uuid":"d21ffc8e-40bb-47eb-af2c-e3e730d3fb76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6818","nonce":1144470927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6822","nonce":1144470927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6830","nonce":1144470927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6826","nonce":1144470927}]},"public_addr":"172.21.15.98:6818/1144470927","cluster_addr":"172.21.15.98:6822/1144470927","heartbeat_back_addr":"172.21.15.98:6830/1144470927","heartbeat_front_addr":"172.21.15.98:6826/1144470927","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.921114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.739210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.024016+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.002527+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.698127+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.813416+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.709351+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.815457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T15:58:04.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.108+0000 7f603a5ff700 1 -- 172.21.15.37:0/3104103691 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f602006ad70 msgr2=0x7f602006d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:04.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.108+0000 7f603a5ff700 1 --2- 172.21.15.37:0/3104103691 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f602006ad70 0x7f602006d220 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f60341f5950 tx=0x7f6028009210 comp rx=0 tx=0).stop 2023-07-14T15:58:04.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.108+0000 7f603a5ff700 1 -- 172.21.15.37:0/3104103691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60340c9b30 msgr2=0x7f60340b4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:04.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.108+0000 7f603a5ff700 1 --2- 172.21.15.37:0/3104103691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60340c9b30 0x7f60340b4640 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f602400c520 tx=0x7f602400c830 comp rx=0 tx=0).stop 2023-07-14T15:58:04.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.108+0000 7f603a5ff700 1 -- 172.21.15.37:0/3104103691 shutdown_connections 2023-07-14T15:58:04.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.108+0000 7f603a5ff700 1 --2- 172.21.15.37:0/3104103691 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6034159790 0x7f60340b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:04.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.108+0000 7f603a5ff700 1 --2- 172.21.15.37:0/3104103691 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f602006ad70 0x7f602006d220 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:04.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.108+0000 7f603a5ff700 1 --2- 172.21.15.37:0/3104103691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60340c9b30 0x7f60340b4640 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:04.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.108+0000 7f603a5ff700 1 --2- 172.21.15.37:0/3104103691 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f60341593c0 0x7f6034070840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:04.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.108+0000 7f603a5ff700 1 -- 172.21.15.37:0/3104103691 >> 172.21.15.37:0/3104103691 conn(0x7f60340b08c0 msgr2=0x7f603414f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:04.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.108+0000 7f603a5ff700 1 -- 172.21.15.37:0/3104103691 shutdown_connections 2023-07-14T15:58:04.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.108+0000 7f603a5ff700 1 -- 172.21.15.37:0/3104103691 wait complete. 2023-07-14T15:58:04.110 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T15:55:52.907261+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T15:55:59.992839+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T15:58:04.111 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T15:58:04.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.332+0000 7f2d8d1ff700 1 Processor -- start 2023-07-14T15:58:04.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.332+0000 7f2d8d1ff700 1 -- start start 2023-07-14T15:58:04.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.333+0000 7f2d8d1ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2d88071820 0x7f2d8806cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:04.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.333+0000 7f2d8d1ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2d8806d0c0 0x7f2d880c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:04.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.333+0000 7f2d8d1ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d880707f0 con 0x7f2d880cb430 2023-07-14T15:58:04.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.333+0000 7f2d8d1ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d88070a60 con 0x7f2d88071820 2023-07-14T15:58:04.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.333+0000 7f2d8d1ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d88070d40 con 0x7f2d8806d0c0 2023-07-14T15:58:04.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.334+0000 7f2d8659c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2d88071820 0x7f2d8806cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:04.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.334+0000 7f2d8659c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2d88071820 0x7f2d8806cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43898/0 (socket says 172.21.15.37:43898) 2023-07-14T15:58:04.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.334+0000 7f2d8659c700 1 -- 172.21.15.37:0/348589098 learned_addr learned my addr 172.21.15.37:0/348589098 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:04.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.334+0000 7f2d8759e700 1 --2- 172.21.15.37:0/348589098 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2d8806d0c0 0x7f2d880c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:04.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.334+0000 7f2d8659c700 1 -- 172.21.15.37:0/348589098 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2d8806d0c0 msgr2=0x7f2d880c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:04.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.334+0000 7f2d8659c700 1 --2- 172.21.15.37:0/348589098 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2d8806d0c0 0x7f2d880c90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:04.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.334+0000 7f2d8659c700 1 -- 172.21.15.37:0/348589098 >> v1:172.21.15.98:6789/0 conn(0x7f2d880cb430 legacy=0x7f2d880cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:04.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.334+0000 7f2d8659c700 1 -- 172.21.15.37:0/348589098 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d88071020 con 0x7f2d88071820 2023-07-14T15:58:04.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.335+0000 7f2d8659c700 1 --2- 172.21.15.37:0/348589098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d88071820 0x7f2d8806cb80 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c0098f0 tx=0x7f2d7c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91bef931dabaff7f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:04.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.335+0000 7f2d85d9b700 1 -- 172.21.15.37:0/348589098 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c011830 con 0x7f2d88071820 2023-07-14T15:58:04.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.335+0000 7f2d85d9b700 1 -- 172.21.15.37:0/348589098 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d7c011990 con 0x7f2d88071820 2023-07-14T15:58:04.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.335+0000 7f2d85d9b700 1 -- 172.21.15.37:0/348589098 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c011d20 con 0x7f2d88071820 2023-07-14T15:58:04.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.335+0000 7f2d8d1ff700 1 -- 172.21.15.37:0/348589098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d88071820 msgr2=0x7f2d8806cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:04.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.335+0000 7f2d8d1ff700 1 --2- 172.21.15.37:0/348589098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d88071820 0x7f2d8806cb80 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c0098f0 tx=0x7f2d7c009c00 comp rx=0 tx=0).stop 2023-07-14T15:58:04.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.335+0000 7f2d8d1ff700 1 -- 172.21.15.37:0/348589098 shutdown_connections 2023-07-14T15:58:04.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.335+0000 7f2d8d1ff700 1 --2- 172.21.15.37:0/348589098 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2d8806d0c0 0x7f2d880c90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:04.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.335+0000 7f2d8d1ff700 1 --2- 172.21.15.37:0/348589098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d88071820 0x7f2d8806cb80 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:04.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.336+0000 7f2d8d1ff700 1 -- 172.21.15.37:0/348589098 >> 172.21.15.37:0/348589098 conn(0x7f2d8806aac0 msgr2=0x7f2d880b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:04.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.336+0000 7f2d8d1ff700 1 -- 172.21.15.37:0/348589098 shutdown_connections 2023-07-14T15:58:04.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.336+0000 7f2d8d1ff700 1 -- 172.21.15.37:0/348589098 wait complete. 2023-07-14T15:58:04.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.337+0000 7f2d8d1ff700 1 Processor -- start 2023-07-14T15:58:04.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.338+0000 7f2d8d1ff700 1 -- start start 2023-07-14T15:58:04.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.339+0000 7f2d8d1ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d8806d0c0 0x7f2d88153cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:04.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.339+0000 7f2d8d1ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2d88071820 0x7f2d880cc630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:04.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.339+0000 7f2d8d1ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d880cb430 0x7f2d880afd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:04.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.339+0000 7f2d8d1ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d880cda90 con 0x7f2d880cb430 2023-07-14T15:58:04.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.339+0000 7f2d8d1ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d880cce80 con 0x7f2d8806d0c0 2023-07-14T15:58:04.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.339+0000 7f2d8d1ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d880cd160 con 0x7f2d88071820 2023-07-14T15:58:04.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.339+0000 7f2d8759e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d880cb430 0x7f2d880afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:04.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.339+0000 7f2d8759e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d880cb430 0x7f2d880afd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43902/0 (socket says 172.21.15.37:43902) 2023-07-14T15:58:04.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.339+0000 7f2d8759e700 1 -- 172.21.15.37:0/802914463 learned_addr learned my addr 172.21.15.37:0/802914463 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:04.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.339+0000 7f2d8659c700 1 --2- 172.21.15.37:0/802914463 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2d88071820 0x7f2d880cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:04.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.339+0000 7f2d86d9d700 1 --2- 172.21.15.37:0/802914463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d8806d0c0 0x7f2d88153cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:04.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.339+0000 7f2d8759e700 1 -- 172.21.15.37:0/802914463 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2d88071820 msgr2=0x7f2d880cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:04.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.339+0000 7f2d8759e700 1 --2- 172.21.15.37:0/802914463 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2d88071820 0x7f2d880cc630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:04.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.339+0000 7f2d8759e700 1 -- 172.21.15.37:0/802914463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d8806d0c0 msgr2=0x7f2d88153cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:04.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.339+0000 7f2d8759e700 1 --2- 172.21.15.37:0/802914463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d8806d0c0 0x7f2d88153cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:04.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.339+0000 7f2d8759e700 1 -- 172.21.15.37:0/802914463 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d7c009550 con 0x7f2d880cb430 2023-07-14T15:58:04.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.340+0000 7f2d8759e700 1 --2- 172.21.15.37:0/802914463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d880cb430 0x7f2d880afd80 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2d8000efc0 tx=0x7f2d8000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:04.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.340+0000 7f2d6f7fe700 1 -- 172.21.15.37:0/802914463 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d80009ea0 con 0x7f2d880cb430 2023-07-14T15:58:04.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.340+0000 7f2d6f7fe700 1 -- 172.21.15.37:0/802914463 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8000f040 con 0x7f2d880cb430 2023-07-14T15:58:04.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.340+0000 7f2d6f7fe700 1 -- 172.21.15.37:0/802914463 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8000ced0 con 0x7f2d880cb430 2023-07-14T15:58:04.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.340+0000 7f2d8d1ff700 1 -- 172.21.15.37:0/802914463 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d880cd440 con 0x7f2d880cb430 2023-07-14T15:58:04.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.340+0000 7f2d8d1ff700 1 -- 172.21.15.37:0/802914463 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d880ccb70 con 0x7f2d880cb430 2023-07-14T15:58:04.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.341+0000 7f2d8d1ff700 1 -- 172.21.15.37:0/802914463 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d880ca640 con 0x7f2d880cb430 2023-07-14T15:58:04.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.342+0000 7f2d6f7fe700 1 -- 172.21.15.37:0/802914463 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f2d80014480 con 0x7f2d880cb430 2023-07-14T15:58:04.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.343+0000 7f2d6f7fe700 1 --2- 172.21.15.37:0/802914463 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f2d7406ad70 0x7f2d7406d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:04.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.343+0000 7f2d6f7fe700 1 -- 172.21.15.37:0/802914463 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2d80089c00 con 0x7f2d880cb430 2023-07-14T15:58:04.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.344+0000 7f2d86d9d700 1 --2- 172.21.15.37:0/802914463 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f2d7406ad70 0x7f2d7406d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:04.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.344+0000 7f2d86d9d700 1 --2- 172.21.15.37:0/802914463 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f2d7406ad70 0x7f2d7406d220 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2d78007fd0 tx=0x7f2d78009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:04.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.347+0000 7f2d6f7fe700 1 -- 172.21.15.37:0/802914463 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2d80054e00 con 0x7f2d880cb430 2023-07-14T15:58:04.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.552+0000 7f2d8d1ff700 1 -- 172.21.15.37:0/802914463 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2d88067840 con 0x7f2d880cb430 2023-07-14T15:58:04.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.553+0000 7f2d6f7fe700 1 -- 172.21.15.37:0/802914463 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v45) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2d800180a0 con 0x7f2d880cb430 2023-07-14T15:58:04.538 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-14T15:58:04.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.555+0000 7f2d8d1ff700 1 -- 172.21.15.37:0/802914463 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f2d7406ad70 msgr2=0x7f2d7406d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:04.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.555+0000 7f2d8d1ff700 1 --2- 172.21.15.37:0/802914463 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f2d7406ad70 0x7f2d7406d220 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2d78007fd0 tx=0x7f2d78009040 comp rx=0 tx=0).stop 2023-07-14T15:58:04.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.555+0000 7f2d8d1ff700 1 -- 172.21.15.37:0/802914463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d880cb430 msgr2=0x7f2d880afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:04.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.555+0000 7f2d8d1ff700 1 --2- 172.21.15.37:0/802914463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d880cb430 0x7f2d880afd80 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2d8000efc0 tx=0x7f2d8000c3a0 comp rx=0 tx=0).stop 2023-07-14T15:58:04.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.555+0000 7f2d8d1ff700 1 -- 172.21.15.37:0/802914463 shutdown_connections 2023-07-14T15:58:04.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.555+0000 7f2d8d1ff700 1 --2- 172.21.15.37:0/802914463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d8806d0c0 0x7f2d88153cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:04.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.556+0000 7f2d8d1ff700 1 --2- 172.21.15.37:0/802914463 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f2d7406ad70 0x7f2d7406d220 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:04.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.556+0000 7f2d8d1ff700 1 --2- 172.21.15.37:0/802914463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d880cb430 0x7f2d880afd80 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:04.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.556+0000 7f2d8d1ff700 1 --2- 172.21.15.37:0/802914463 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2d88071820 0x7f2d880cc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:04.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.556+0000 7f2d8d1ff700 1 -- 172.21.15.37:0/802914463 >> 172.21.15.37:0/802914463 conn(0x7f2d8806aac0 msgr2=0x7f2d8806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:04.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.556+0000 7f2d8d1ff700 1 -- 172.21.15.37:0/802914463 shutdown_connections 2023-07-14T15:58:04.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.556+0000 7f2d8d1ff700 1 -- 172.21.15.37:0/802914463 wait complete. 2023-07-14T15:58:04.558 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T15:58:04.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.779+0000 7f15c31ff700 1 Processor -- start 2023-07-14T15:58:04.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.779+0000 7f15c31ff700 1 -- start start 2023-07-14T15:58:04.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.780+0000 7f15c31ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f15bc071730 0x7f15bc06f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:04.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.780+0000 7f15c31ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f15bc06c0d0 0x7f15bc0cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:04.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.780+0000 7f15c31ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15bc159870 con 0x7f15bc0ae000 2023-07-14T15:58:04.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.780+0000 7f15c31ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15bc0ae470 con 0x7f15bc06c0d0 2023-07-14T15:58:04.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.780+0000 7f15c31ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc0ca790 con 0x7f15bc071730 2023-07-14T15:58:04.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.781+0000 7f15bbfff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f15bc0ae000 0x7f15bc06b9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57596/0 (socket says 172.21.15.37:57596) 2023-07-14T15:58:04.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.781+0000 7f15bbfff700 1 -- 172.21.15.37:0/633781368 learned_addr learned my addr 172.21.15.37:0/633781368 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:58:04.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.781+0000 7f15c179c700 1 --2- 172.21.15.37:0/633781368 >> v2:172.21.15.98:3300/0 conn(0x7f15bc06c0d0 0x7f15bc0cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:04.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.781+0000 7f15c0f9b700 1 --2- 172.21.15.37:0/633781368 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f15bc071730 0x7f15bc06f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:04.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.781+0000 7f15bb7fe700 1 -- 172.21.15.37:0/633781368 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4076784605 0 0) 0x7f15bc159870 con 0x7f15bc0ae000 2023-07-14T15:58:04.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.781+0000 7f15bb7fe700 1 -- 172.21.15.37:0/633781368 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15ac0035b0 con 0x7f15bc0ae000 2023-07-14T15:58:04.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.781+0000 7f15c0f9b700 1 -- 172.21.15.37:0/633781368 >> v2:172.21.15.98:3300/0 conn(0x7f15bc06c0d0 msgr2=0x7f15bc0cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:04.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.781+0000 7f15c0f9b700 1 --2- 172.21.15.37:0/633781368 >> v2:172.21.15.98:3300/0 conn(0x7f15bc06c0d0 0x7f15bc0cd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:04.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.781+0000 7f15c0f9b700 1 -- 172.21.15.37:0/633781368 >> v1:172.21.15.37:6789/0 conn(0x7f15bc0ae000 legacy=0x7f15bc06b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:04.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.781+0000 7f15c0f9b700 1 -- 172.21.15.37:0/633781368 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15bc0cc780 con 0x7f15bc071730 2023-07-14T15:58:04.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.781+0000 7f15c179c700 1 --2- 172.21.15.37:0/633781368 >> v2:172.21.15.98:3300/0 conn(0x7f15bc06c0d0 0x7f15bc0cd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:58:04.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.782+0000 7f15c0f9b700 1 --2- 172.21.15.37:0/633781368 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f15bc071730 0x7f15bc06f740 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f15b0009840 tx=0x7f15b0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e61861277cc70a13 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:04.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.782+0000 7f15bb7fe700 1 -- 172.21.15.37:0/633781368 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b0011830 con 0x7f15bc071730 2023-07-14T15:58:04.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.782+0000 7f15bb7fe700 1 -- 172.21.15.37:0/633781368 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b0011990 con 0x7f15bc071730 2023-07-14T15:58:04.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.782+0000 7f15bb7fe700 1 -- 172.21.15.37:0/633781368 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b0011d00 con 0x7f15bc071730 2023-07-14T15:58:04.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.783+0000 7f15c31ff700 1 -- 172.21.15.37:0/633781368 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f15bc071730 msgr2=0x7f15bc06f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:04.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.783+0000 7f15c31ff700 1 --2- 172.21.15.37:0/633781368 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f15bc071730 0x7f15bc06f740 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f15b0009840 tx=0x7f15b0009b50 comp rx=0 tx=0).stop 2023-07-14T15:58:04.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.783+0000 7f15c31ff700 1 -- 172.21.15.37:0/633781368 shutdown_connections 2023-07-14T15:58:04.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.783+0000 7f15c31ff700 1 --2- 172.21.15.37:0/633781368 >> v2:172.21.15.98:3300/0 conn(0x7f15bc06c0d0 0x7f15bc0cd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:04.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.783+0000 7f15c31ff700 1 --2- 172.21.15.37:0/633781368 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f15bc071730 0x7f15bc06f740 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:04.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.783+0000 7f15c31ff700 1 -- 172.21.15.37:0/633781368 >> 172.21.15.37:0/633781368 conn(0x7f15bc06aac0 msgr2=0x7f15bc0b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:04.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.783+0000 7f15c31ff700 1 -- 172.21.15.37:0/633781368 shutdown_connections 2023-07-14T15:58:04.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.783+0000 7f15c31ff700 1 -- 172.21.15.37:0/633781368 wait complete. 2023-07-14T15:58:04.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.785+0000 7f15c31ff700 1 Processor -- start 2023-07-14T15:58:04.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.785+0000 7f15c31ff700 1 -- start start 2023-07-14T15:58:04.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.786+0000 7f15c31ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15bc06c0d0 0x7f15bc1f0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:04.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.786+0000 7f15c31ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15bc071730 0x7f15bc0b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:04.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.786+0000 7f15c31ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f15bc0ae000 0x7f15bc0c5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:04.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.786+0000 7f15c31ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc0b3d10 con 0x7f15bc071730 2023-07-14T15:58:04.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.786+0000 7f15c31ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc1f1600 con 0x7f15bc06c0d0 2023-07-14T15:58:04.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.786+0000 7f15c31ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc1f18e0 con 0x7f15bc0ae000 2023-07-14T15:58:04.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.786+0000 7f15bbfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15bc071730 0x7f15bc0b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:04.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.786+0000 7f15bbfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15bc071730 0x7f15bc0b37d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43912/0 (socket says 172.21.15.37:43912) 2023-07-14T15:58:04.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.786+0000 7f15bbfff700 1 -- 172.21.15.37:0/3493292985 learned_addr learned my addr 172.21.15.37:0/3493292985 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:04.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.786+0000 7f15c0f9b700 1 --2- 172.21.15.37:0/3493292985 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15bc06c0d0 0x7f15bc1f0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:04.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.786+0000 7f15c179c700 1 --2- 172.21.15.37:0/3493292985 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f15bc0ae000 0x7f15bc0c5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:04.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.786+0000 7f15bbfff700 1 -- 172.21.15.37:0/3493292985 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f15bc0ae000 msgr2=0x7f15bc0c5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:04.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.786+0000 7f15bbfff700 1 --2- 172.21.15.37:0/3493292985 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f15bc0ae000 0x7f15bc0c5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:04.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.786+0000 7f15bbfff700 1 -- 172.21.15.37:0/3493292985 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15bc06c0d0 msgr2=0x7f15bc1f0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:04.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.786+0000 7f15bbfff700 1 --2- 172.21.15.37:0/3493292985 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15bc06c0d0 0x7f15bc1f0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:04.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.786+0000 7f15bbfff700 1 -- 172.21.15.37:0/3493292985 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b4009a70 con 0x7f15bc071730 2023-07-14T15:58:04.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.786+0000 7f15c0f9b700 1 --2- 172.21.15.37:0/3493292985 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15bc06c0d0 0x7f15bc1f0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:58:04.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.786+0000 7f15c179c700 1 --2- 172.21.15.37:0/3493292985 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f15bc0ae000 0x7f15bc0c5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:58:04.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.787+0000 7f15bbfff700 1 --2- 172.21.15.37:0/3493292985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15bc071730 0x7f15bc0b37d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f15a800c4d0 tx=0x7f15a800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:04.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.787+0000 7f15b97fa700 1 -- 172.21.15.37:0/3493292985 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a8005d70 con 0x7f15bc071730 2023-07-14T15:58:04.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.787+0000 7f15b97fa700 1 -- 172.21.15.37:0/3493292985 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a80070d0 con 0x7f15bc071730 2023-07-14T15:58:04.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.787+0000 7f15b97fa700 1 -- 172.21.15.37:0/3493292985 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a8007440 con 0x7f15bc071730 2023-07-14T15:58:04.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.787+0000 7f15c31ff700 1 -- 172.21.15.37:0/3493292985 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15b00094a0 con 0x7f15bc071730 2023-07-14T15:58:04.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.787+0000 7f15c31ff700 1 -- 172.21.15.37:0/3493292985 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15bc0b1af0 con 0x7f15bc071730 2023-07-14T15:58:04.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.788+0000 7f15c31ff700 1 -- 172.21.15.37:0/3493292985 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15bc0cb300 con 0x7f15bc071730 2023-07-14T15:58:04.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.789+0000 7f15b97fa700 1 -- 172.21.15.37:0/3493292985 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f15a80075a0 con 0x7f15bc071730 2023-07-14T15:58:04.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.791+0000 7f15b97fa700 1 --2- 172.21.15.37:0/3493292985 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f15a006ad70 0x7f15a006d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:04.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.791+0000 7f15b97fa700 1 -- 172.21.15.37:0/3493292985 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f15a8088690 con 0x7f15bc071730 2023-07-14T15:58:04.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.791+0000 7f15c0f9b700 1 --2- 172.21.15.37:0/3493292985 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f15a006ad70 0x7f15a006d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:04.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.792+0000 7f15c0f9b700 1 --2- 172.21.15.37:0/3493292985 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f15a006ad70 0x7f15a006d220 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f15b0009fd0 tx=0x7f15b0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:04.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:04.795+0000 7f15b97fa700 1 -- 172.21.15.37:0/3493292985 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f15a8053a50 con 0x7f15bc071730 2023-07-14T15:58:04.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.002+0000 7f15c31ff700 1 -- 172.21.15.37:0/3493292985 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f15bc0ce880 con 0x7f15bc071730 2023-07-14T15:58:04.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.003+0000 7f15b97fa700 1 -- 172.21.15.37:0/3493292985 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v45) v1 ==== 92+0+10 (secure 0 0 0) 0x7f15a8057070 con 0x7f15bc071730 2023-07-14T15:58:04.988 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-14T15:58:04.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.005+0000 7f15c31ff700 1 -- 172.21.15.37:0/3493292985 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f15a006ad70 msgr2=0x7f15a006d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:04.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.005+0000 7f15c31ff700 1 --2- 172.21.15.37:0/3493292985 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f15a006ad70 0x7f15a006d220 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f15b0009fd0 tx=0x7f15b0008030 comp rx=0 tx=0).stop 2023-07-14T15:58:04.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.005+0000 7f15c31ff700 1 -- 172.21.15.37:0/3493292985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15bc071730 msgr2=0x7f15bc0b37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:04.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.005+0000 7f15c31ff700 1 --2- 172.21.15.37:0/3493292985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15bc071730 0x7f15bc0b37d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f15a800c4d0 tx=0x7f15a800c890 comp rx=0 tx=0).stop 2023-07-14T15:58:04.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.005+0000 7f15c31ff700 1 -- 172.21.15.37:0/3493292985 shutdown_connections 2023-07-14T15:58:04.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.005+0000 7f15c31ff700 1 --2- 172.21.15.37:0/3493292985 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15bc06c0d0 0x7f15bc1f0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:04.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.005+0000 7f15c31ff700 1 --2- 172.21.15.37:0/3493292985 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f15a006ad70 0x7f15a006d220 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:04.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.005+0000 7f15c31ff700 1 --2- 172.21.15.37:0/3493292985 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f15bc0ae000 0x7f15bc0c5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:04.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.005+0000 7f15c31ff700 1 --2- 172.21.15.37:0/3493292985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15bc071730 0x7f15bc0b37d0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:04.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.005+0000 7f15c31ff700 1 -- 172.21.15.37:0/3493292985 >> 172.21.15.37:0/3493292985 conn(0x7f15bc06aac0 msgr2=0x7f15bc0cea10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:04.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.005+0000 7f15c31ff700 1 -- 172.21.15.37:0/3493292985 shutdown_connections 2023-07-14T15:58:04.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.005+0000 7f15c31ff700 1 -- 172.21.15.37:0/3493292985 wait complete. 2023-07-14T15:58:05.007 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-14T15:58:05.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.226+0000 7f82619ff700 1 Processor -- start 2023-07-14T15:58:05.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.226+0000 7f82619ff700 1 -- start start 2023-07-14T15:58:05.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.227+0000 7f82619ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f825c0b85f0 0x7f825c15d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:05.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.227+0000 7f82619ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f825c0b54b0 0x7f825c0cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:05.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.227+0000 7f82619ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f825c0b4910 0x7f825c0b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:05.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.227+0000 7f82619ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f825c0b52b0 con 0x7f825c0b54b0 2023-07-14T15:58:05.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.227+0000 7f82619ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f825c0cf6b0 con 0x7f825c0b85f0 2023-07-14T15:58:05.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.227+0000 7f82619ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f825c0cdc40 con 0x7f825c0b4910 2023-07-14T15:58:05.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.227+0000 7f825a7fc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f825c0b54b0 0x7f825c0cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:05.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.228+0000 7f825a7fc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f825c0b54b0 0x7f825c0cfb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43914/0 (socket says 172.21.15.37:43914) 2023-07-14T15:58:05.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.228+0000 7f825a7fc700 1 -- 172.21.15.37:0/1754829961 learned_addr learned my addr 172.21.15.37:0/1754829961 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:05.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.228+0000 7f825affd700 1 --2- 172.21.15.37:0/1754829961 >> v2:172.21.15.98:3300/0 conn(0x7f825c0b85f0 0x7f825c15d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:05.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.228+0000 7f825b7fe700 1 --2- 172.21.15.37:0/1754829961 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f825c0b4910 0x7f825c0b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:05.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.228+0000 7f825a7fc700 1 -- 172.21.15.37:0/1754829961 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f825c0b4910 msgr2=0x7f825c0b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:05.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.228+0000 7f825a7fc700 1 --2- 172.21.15.37:0/1754829961 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f825c0b4910 0x7f825c0b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:05.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.228+0000 7f825a7fc700 1 -- 172.21.15.37:0/1754829961 >> v2:172.21.15.98:3300/0 conn(0x7f825c0b85f0 msgr2=0x7f825c15d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:05.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.228+0000 7f825a7fc700 1 --2- 172.21.15.37:0/1754829961 >> v2:172.21.15.98:3300/0 conn(0x7f825c0b85f0 0x7f825c15d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:05.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.228+0000 7f825a7fc700 1 -- 172.21.15.37:0/1754829961 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f825c15dba0 con 0x7f825c0b54b0 2023-07-14T15:58:05.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.228+0000 7f825affd700 1 --2- 172.21.15.37:0/1754829961 >> v2:172.21.15.98:3300/0 conn(0x7f825c0b85f0 0x7f825c15d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:58:05.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.228+0000 7f825a7fc700 1 --2- 172.21.15.37:0/1754829961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f825c0b54b0 0x7f825c0cfb40 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f825c06a110 tx=0x7f8250009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2800274ca4282df1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:05.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.229+0000 7f8259ffb700 1 -- 172.21.15.37:0/1754829961 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825000b870 con 0x7f825c0b54b0 2023-07-14T15:58:05.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.229+0000 7f8259ffb700 1 -- 172.21.15.37:0/1754829961 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f825000b9d0 con 0x7f825c0b54b0 2023-07-14T15:58:05.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.229+0000 7f8259ffb700 1 -- 172.21.15.37:0/1754829961 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825000bd60 con 0x7f825c0b54b0 2023-07-14T15:58:05.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.229+0000 7f82619ff700 1 -- 172.21.15.37:0/1754829961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f825c0b54b0 msgr2=0x7f825c0cfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:05.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.229+0000 7f82619ff700 1 --2- 172.21.15.37:0/1754829961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f825c0b54b0 0x7f825c0cfb40 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f825c06a110 tx=0x7f8250009bd0 comp rx=0 tx=0).stop 2023-07-14T15:58:05.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.229+0000 7f82619ff700 1 -- 172.21.15.37:0/1754829961 shutdown_connections 2023-07-14T15:58:05.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.229+0000 7f82619ff700 1 --2- 172.21.15.37:0/1754829961 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f825c0b4910 0x7f825c0b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:05.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.229+0000 7f82619ff700 1 --2- 172.21.15.37:0/1754829961 >> v2:172.21.15.98:3300/0 conn(0x7f825c0b85f0 0x7f825c15d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:05.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.229+0000 7f82619ff700 1 --2- 172.21.15.37:0/1754829961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f825c0b54b0 0x7f825c0cfb40 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:05.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.229+0000 7f82619ff700 1 -- 172.21.15.37:0/1754829961 >> 172.21.15.37:0/1754829961 conn(0x7f825c06a580 msgr2=0x7f825c06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:05.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.229+0000 7f82619ff700 1 -- 172.21.15.37:0/1754829961 shutdown_connections 2023-07-14T15:58:05.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.229+0000 7f82619ff700 1 -- 172.21.15.37:0/1754829961 wait complete. 2023-07-14T15:58:05.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.231+0000 7f82619ff700 1 Processor -- start 2023-07-14T15:58:05.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.231+0000 7f82619ff700 1 -- start start 2023-07-14T15:58:05.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.232+0000 7f82619ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f825c0b4910 0x7f825c1f2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:05.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.232+0000 7f82619ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f825c0b54b0 0x7f825c14e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:05.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.232+0000 7f82619ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f825c0b85f0 0x7f825c0c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:05.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.232+0000 7f82619ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825c1f29d0 con 0x7f825c0b54b0 2023-07-14T15:58:05.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.232+0000 7f82619ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825c0c7b00 con 0x7f825c0b4910 2023-07-14T15:58:05.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.232+0000 7f82619ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f825c0c6ef0 con 0x7f825c0b85f0 2023-07-14T15:58:05.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.232+0000 7f825a7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f825c0b54b0 0x7f825c14e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:05.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.232+0000 7f825a7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f825c0b54b0 0x7f825c14e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43916/0 (socket says 172.21.15.37:43916) 2023-07-14T15:58:05.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.232+0000 7f825a7fc700 1 -- 172.21.15.37:0/1074661136 learned_addr learned my addr 172.21.15.37:0/1074661136 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:05.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.233+0000 7f825affd700 1 --2- 172.21.15.37:0/1074661136 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f825c0b4910 0x7f825c1f2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:05.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.233+0000 7f825b7fe700 1 --2- 172.21.15.37:0/1074661136 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f825c0b85f0 0x7f825c0c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:05.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.233+0000 7f825a7fc700 1 -- 172.21.15.37:0/1074661136 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f825c0b85f0 msgr2=0x7f825c0c7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:05.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.233+0000 7f825a7fc700 1 --2- 172.21.15.37:0/1074661136 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f825c0b85f0 0x7f825c0c7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:05.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.233+0000 7f825a7fc700 1 -- 172.21.15.37:0/1074661136 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f825c0b4910 msgr2=0x7f825c1f2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:05.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.233+0000 7f825a7fc700 1 --2- 172.21.15.37:0/1074661136 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f825c0b4910 0x7f825c1f2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:05.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.233+0000 7f825a7fc700 1 -- 172.21.15.37:0/1074661136 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8250009550 con 0x7f825c0b54b0 2023-07-14T15:58:05.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.233+0000 7f825a7fc700 1 --2- 172.21.15.37:0/1074661136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f825c0b54b0 0x7f825c14e120 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f8250000c00 tx=0x7f8250004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:05.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.233+0000 7f8243fff700 1 -- 172.21.15.37:0/1074661136 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8250004540 con 0x7f825c0b54b0 2023-07-14T15:58:05.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.233+0000 7f8243fff700 1 -- 172.21.15.37:0/1074661136 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82500036a0 con 0x7f825c0b54b0 2023-07-14T15:58:05.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.233+0000 7f82619ff700 1 -- 172.21.15.37:0/1074661136 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f825c0c71d0 con 0x7f825c0b54b0 2023-07-14T15:58:05.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.233+0000 7f8243fff700 1 -- 172.21.15.37:0/1074661136 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8250003a50 con 0x7f825c0b54b0 2023-07-14T15:58:05.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.234+0000 7f82619ff700 1 -- 172.21.15.37:0/1074661136 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f825c0c7790 con 0x7f825c0b54b0 2023-07-14T15:58:05.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.235+0000 7f82619ff700 1 -- 172.21.15.37:0/1074661136 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f825c067840 con 0x7f825c0b54b0 2023-07-14T15:58:05.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.235+0000 7f8243fff700 1 -- 172.21.15.37:0/1074661136 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f8250021070 con 0x7f825c0b54b0 2023-07-14T15:58:05.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.236+0000 7f8243fff700 1 --2- 172.21.15.37:0/1074661136 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f824806ada0 0x7f824806d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:05.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.236+0000 7f8243fff700 1 -- 172.21.15.37:0/1074661136 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f825008a7a0 con 0x7f825c0b54b0 2023-07-14T15:58:05.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.237+0000 7f825affd700 1 --2- 172.21.15.37:0/1074661136 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f824806ada0 0x7f824806d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:05.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.238+0000 7f825affd700 1 --2- 172.21.15.37:0/1074661136 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f824806ada0 0x7f824806d250 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f824c00c940 tx=0x7f824c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:05.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.240+0000 7f8243fff700 1 -- 172.21.15.37:0/1074661136 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8250055ce0 con 0x7f825c0b54b0 2023-07-14T15:58:05.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.451+0000 7f82619ff700 1 -- 172.21.15.37:0/1074661136 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f825c06b440 con 0x7f825c0b54b0 2023-07-14T15:58:05.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.451+0000 7f8243fff700 1 -- 172.21.15.37:0/1074661136 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v45) v1 ==== 84+0+126 (secure 0 0 0) 0x7f8250059300 con 0x7f825c0b54b0 2023-07-14T15:58:05.436 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:58:05.436 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-07-14T15:58:05.436 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:58:05.436 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2023-07-14T15:58:05.436 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2023-07-14T15:58:05.436 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-14T15:58:05.437 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:58:05.437 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 2, 2023-07-14T15:58:05.437 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": "rbd" 2023-07-14T15:58:05.437 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:58:05.437 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-07-14T15:58:05.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.454+0000 7f82619ff700 1 -- 172.21.15.37:0/1074661136 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f824806ada0 msgr2=0x7f824806d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:05.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.454+0000 7f82619ff700 1 --2- 172.21.15.37:0/1074661136 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f824806ada0 0x7f824806d250 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f824c00c940 tx=0x7f824c008040 comp rx=0 tx=0).stop 2023-07-14T15:58:05.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.454+0000 7f82619ff700 1 -- 172.21.15.37:0/1074661136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f825c0b54b0 msgr2=0x7f825c14e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:05.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.454+0000 7f82619ff700 1 --2- 172.21.15.37:0/1074661136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f825c0b54b0 0x7f825c14e120 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f8250000c00 tx=0x7f8250004750 comp rx=0 tx=0).stop 2023-07-14T15:58:05.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.454+0000 7f82619ff700 1 -- 172.21.15.37:0/1074661136 shutdown_connections 2023-07-14T15:58:05.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.454+0000 7f82619ff700 1 --2- 172.21.15.37:0/1074661136 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f825c0b4910 0x7f825c1f2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:05.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.454+0000 7f82619ff700 1 --2- 172.21.15.37:0/1074661136 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f824806ada0 0x7f824806d250 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:05.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.454+0000 7f82619ff700 1 --2- 172.21.15.37:0/1074661136 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f825c0b85f0 0x7f825c0c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:05.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.454+0000 7f82619ff700 1 --2- 172.21.15.37:0/1074661136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f825c0b54b0 0x7f825c14e120 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:05.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.454+0000 7f82619ff700 1 -- 172.21.15.37:0/1074661136 >> 172.21.15.37:0/1074661136 conn(0x7f825c06a580 msgr2=0x7f825c0d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:05.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.454+0000 7f82619ff700 1 -- 172.21.15.37:0/1074661136 shutdown_connections 2023-07-14T15:58:05.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.454+0000 7f82619ff700 1 -- 172.21.15.37:0/1074661136 wait complete. 2023-07-14T15:58:05.456 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-14T15:58:05.457 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-14T15:58:05.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.678+0000 7f36125ff700 1 Processor -- start 2023-07-14T15:58:05.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.678+0000 7f36125ff700 1 -- start start 2023-07-14T15:58:05.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.679+0000 7f36125ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f360c1462d0 0x7f360c0cd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:05.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.679+0000 7f36125ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f360c0cf780 0x7f360c0cfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:05.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.679+0000 7f36125ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f360c0d0140 con 0x7f360c0d2310 2023-07-14T15:58:05.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.679+0000 7f36125ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f360c0d1270 con 0x7f360c0cf780 2023-07-14T15:58:05.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.679+0000 7f36125ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f360c0d1550 con 0x7f360c1462d0 2023-07-14T15:58:05.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.680+0000 7f360b7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f360c0d2310 0x7f360c0d09d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57600/0 (socket says 172.21.15.37:57600) 2023-07-14T15:58:05.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.680+0000 7f360b7fe700 1 -- 172.21.15.37:0/1471563354 learned_addr learned my addr 172.21.15.37:0/1471563354 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:58:05.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.680+0000 7f3610b9c700 1 --2- 172.21.15.37:0/1471563354 >> v2:172.21.15.37:3300/0 conn(0x7f360c0cf780 0x7f360c0cfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:05.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.680+0000 7f360bfff700 1 --2- 172.21.15.37:0/1471563354 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f360c1462d0 0x7f360c0cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:05.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.680+0000 7f360affd700 1 -- 172.21.15.37:0/1471563354 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3588775037 0 0) 0x7f360c0d0140 con 0x7f360c0d2310 2023-07-14T15:58:05.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.680+0000 7f360affd700 1 -- 172.21.15.37:0/1471563354 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35f40035b0 con 0x7f360c0d2310 2023-07-14T15:58:05.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.680+0000 7f3610b9c700 1 -- 172.21.15.37:0/1471563354 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f360c1462d0 msgr2=0x7f360c0cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:05.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.680+0000 7f3610b9c700 1 --2- 172.21.15.37:0/1471563354 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f360c1462d0 0x7f360c0cd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:05.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.680+0000 7f3610b9c700 1 -- 172.21.15.37:0/1471563354 >> v1:172.21.15.37:6789/0 conn(0x7f360c0d2310 legacy=0x7f360c0d09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:05.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.680+0000 7f3610b9c700 1 -- 172.21.15.37:0/1471563354 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f360c0d1830 con 0x7f360c0cf780 2023-07-14T15:58:05.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.680+0000 7f3610b9c700 1 --2- 172.21.15.37:0/1471563354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f360c0cf780 0x7f360c0cfc00 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f3604009d90 tx=0x7f360400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=454a3e77056e4112 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:05.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.681+0000 7f360affd700 1 -- 172.21.15.37:0/1471563354 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360400e070 con 0x7f360c0cf780 2023-07-14T15:58:05.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.681+0000 7f360affd700 1 -- 172.21.15.37:0/1471563354 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f360400bb20 con 0x7f360c0cf780 2023-07-14T15:58:05.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.681+0000 7f360affd700 1 -- 172.21.15.37:0/1471563354 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3604012430 con 0x7f360c0cf780 2023-07-14T15:58:05.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.681+0000 7f36125ff700 1 -- 172.21.15.37:0/1471563354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f360c0cf780 msgr2=0x7f360c0cfc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:05.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.681+0000 7f36125ff700 1 --2- 172.21.15.37:0/1471563354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f360c0cf780 0x7f360c0cfc00 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f3604009d90 tx=0x7f360400b330 comp rx=0 tx=0).stop 2023-07-14T15:58:05.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.681+0000 7f36125ff700 1 -- 172.21.15.37:0/1471563354 shutdown_connections 2023-07-14T15:58:05.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.681+0000 7f36125ff700 1 --2- 172.21.15.37:0/1471563354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f360c0cf780 0x7f360c0cfc00 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:05.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.681+0000 7f36125ff700 1 --2- 172.21.15.37:0/1471563354 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f360c1462d0 0x7f360c0cd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:05.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.681+0000 7f36125ff700 1 -- 172.21.15.37:0/1471563354 >> 172.21.15.37:0/1471563354 conn(0x7f360c06a4d0 msgr2=0x7f360c06a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:05.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.681+0000 7f36125ff700 1 -- 172.21.15.37:0/1471563354 shutdown_connections 2023-07-14T15:58:05.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.681+0000 7f36125ff700 1 -- 172.21.15.37:0/1471563354 wait complete. 2023-07-14T15:58:05.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.683+0000 7f36125ff700 1 Processor -- start 2023-07-14T15:58:05.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.683+0000 7f36125ff700 1 -- start start 2023-07-14T15:58:05.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.684+0000 7f36125ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f360c0cf780 0x7f360c0c9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:05.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.684+0000 7f36125ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f360c0d2310 0x7f360c0c6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:05.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.684+0000 7f36125ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f360c1462d0 0x7f360c1f17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:05.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.684+0000 7f36125ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f360c159b90 con 0x7f360c0d2310 2023-07-14T15:58:05.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.684+0000 7f36125ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f360c0b8060 con 0x7f360c0cf780 2023-07-14T15:58:05.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.684+0000 7f36125ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f360c1f1d00 con 0x7f360c1462d0 2023-07-14T15:58:05.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.684+0000 7f360b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f360c0d2310 0x7f360c0c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:05.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.685+0000 7f360b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f360c0d2310 0x7f360c0c6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43934/0 (socket says 172.21.15.37:43934) 2023-07-14T15:58:05.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.685+0000 7f360b7fe700 1 -- 172.21.15.37:0/406442004 learned_addr learned my addr 172.21.15.37:0/406442004 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:05.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.685+0000 7f360bfff700 1 --2- 172.21.15.37:0/406442004 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f360c0cf780 0x7f360c0c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:05.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.685+0000 7f3610b9c700 1 --2- 172.21.15.37:0/406442004 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f360c1462d0 0x7f360c1f17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:05.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.685+0000 7f360b7fe700 1 -- 172.21.15.37:0/406442004 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f360c1462d0 msgr2=0x7f360c1f17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:05.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.685+0000 7f360b7fe700 1 --2- 172.21.15.37:0/406442004 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f360c1462d0 0x7f360c1f17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:05.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.685+0000 7f360b7fe700 1 -- 172.21.15.37:0/406442004 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f360c0cf780 msgr2=0x7f360c0c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:05.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.685+0000 7f360b7fe700 1 --2- 172.21.15.37:0/406442004 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f360c0cf780 0x7f360c0c9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:05.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.685+0000 7f360b7fe700 1 -- 172.21.15.37:0/406442004 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3604009a70 con 0x7f360c0d2310 2023-07-14T15:58:05.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.685+0000 7f360b7fe700 1 --2- 172.21.15.37:0/406442004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f360c0d2310 0x7f360c0c6910 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f360000c700 tx=0x7f360000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:05.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.685+0000 7f3608ff9700 1 -- 172.21.15.37:0/406442004 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3600005d70 con 0x7f360c0d2310 2023-07-14T15:58:05.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.685+0000 7f3608ff9700 1 -- 172.21.15.37:0/406442004 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36000070d0 con 0x7f360c0d2310 2023-07-14T15:58:05.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.685+0000 7f3608ff9700 1 -- 172.21.15.37:0/406442004 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3600007460 con 0x7f360c0d2310 2023-07-14T15:58:05.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.685+0000 7f36125ff700 1 -- 172.21.15.37:0/406442004 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f360c0b7730 con 0x7f360c0d2310 2023-07-14T15:58:05.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.686+0000 7f36125ff700 1 -- 172.21.15.37:0/406442004 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f360c0b7cf0 con 0x7f360c0d2310 2023-07-14T15:58:05.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.687+0000 7f36125ff700 1 -- 172.21.15.37:0/406442004 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f360c067840 con 0x7f360c0d2310 2023-07-14T15:58:05.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.687+0000 7f3608ff9700 1 -- 172.21.15.37:0/406442004 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f36000075c0 con 0x7f360c0d2310 2023-07-14T15:58:05.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.688+0000 7f3608ff9700 1 --2- 172.21.15.37:0/406442004 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f35f806ad70 0x7f35f806d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:05.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.688+0000 7f3608ff9700 1 -- 172.21.15.37:0/406442004 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3600088710 con 0x7f360c0d2310 2023-07-14T15:58:05.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.689+0000 7f360bfff700 1 --2- 172.21.15.37:0/406442004 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f35f806ad70 0x7f35f806d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:05.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.690+0000 7f360bfff700 1 --2- 172.21.15.37:0/406442004 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f35f806ad70 0x7f35f806d220 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f360c0c9e80 tx=0x7f35fc009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:05.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.693+0000 7f3608ff9700 1 -- 172.21.15.37:0/406442004 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3600053ab0 con 0x7f360c0d2310 2023-07-14T15:58:05.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:05.907+0000 7f36125ff700 1 -- 172.21.15.37:0/406442004 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f360c0b81a0 con 0x7f360c0d2310 2023-07-14T15:58:06.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.705+0000 7f3608ff9700 1 -- 172.21.15.37:0/406442004 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v46) v1 ==== 138+0+0 (secure 0 0 0) 0x7f36000570d0 con 0x7f360c0d2310 2023-07-14T15:58:06.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.711+0000 7f36125ff700 1 -- 172.21.15.37:0/406442004 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f35f806ad70 msgr2=0x7f35f806d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:06.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.711+0000 7f36125ff700 1 --2- 172.21.15.37:0/406442004 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f35f806ad70 0x7f35f806d220 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f360c0c9e80 tx=0x7f35fc009210 comp rx=0 tx=0).stop 2023-07-14T15:58:06.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.711+0000 7f36125ff700 1 -- 172.21.15.37:0/406442004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f360c0d2310 msgr2=0x7f360c0c6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:06.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.711+0000 7f36125ff700 1 --2- 172.21.15.37:0/406442004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f360c0d2310 0x7f360c0c6910 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f360000c700 tx=0x7f360000ca10 comp rx=0 tx=0).stop 2023-07-14T15:58:06.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.711+0000 7f36125ff700 1 -- 172.21.15.37:0/406442004 shutdown_connections 2023-07-14T15:58:06.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.711+0000 7f36125ff700 1 --2- 172.21.15.37:0/406442004 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f360c0cf780 0x7f360c0c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:06.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.711+0000 7f36125ff700 1 --2- 172.21.15.37:0/406442004 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f35f806ad70 0x7f35f806d220 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:06.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.711+0000 7f36125ff700 1 --2- 172.21.15.37:0/406442004 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f360c1462d0 0x7f360c1f17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:06.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.711+0000 7f36125ff700 1 --2- 172.21.15.37:0/406442004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f360c0d2310 0x7f360c0c6910 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:06.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.711+0000 7f36125ff700 1 -- 172.21.15.37:0/406442004 >> 172.21.15.37:0/406442004 conn(0x7f360c06a4d0 msgr2=0x7f360c15c200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:06.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.712+0000 7f36125ff700 1 -- 172.21.15.37:0/406442004 shutdown_connections 2023-07-14T15:58:06.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.712+0000 7f36125ff700 1 -- 172.21.15.37:0/406442004 wait complete. 2023-07-14T15:58:06.698 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2023-07-14T15:58:06.718 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-14T15:58:06.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.946+0000 7f4e251ff700 1 Processor -- start 2023-07-14T15:58:06.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.946+0000 7f4e251ff700 1 -- start start 2023-07-14T15:58:06.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.948+0000 7f4e251ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f4e200b4840 0x7f4e200cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:06.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.948+0000 7f4e251ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4e200ce040 0x7f4e200cb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:06.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.948+0000 7f4e251ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e200cbe60 con 0x7f4e200cba30 2023-07-14T15:58:06.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.948+0000 7f4e251ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e2015ab10 con 0x7f4e200ce040 2023-07-14T15:58:06.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.948+0000 7f4e251ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e200cf7e0 con 0x7f4e200b4840 2023-07-14T15:58:06.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.948+0000 7f4e1e59c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4e200ce040 0x7f4e200cb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:06.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.948+0000 7f4e1e59c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4e200ce040 0x7f4e200cb4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43950/0 (socket says 172.21.15.37:43950) 2023-07-14T15:58:06.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.948+0000 7f4e1e59c700 1 -- 172.21.15.37:0/3796805553 learned_addr learned my addr 172.21.15.37:0/3796805553 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:06.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.948+0000 7f4e1ed9d700 1 --2- 172.21.15.37:0/3796805553 >> v2:172.21.15.98:3300/0 conn(0x7f4e200b4840 0x7f4e200cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:06.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.949+0000 7f4e1e59c700 1 -- 172.21.15.37:0/3796805553 >> v2:172.21.15.98:3300/0 conn(0x7f4e200b4840 msgr2=0x7f4e200cdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:06.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.949+0000 7f4e1e59c700 1 --2- 172.21.15.37:0/3796805553 >> v2:172.21.15.98:3300/0 conn(0x7f4e200b4840 0x7f4e200cdb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:06.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.949+0000 7f4e1e59c700 1 -- 172.21.15.37:0/3796805553 >> v1:172.21.15.98:6789/0 conn(0x7f4e200cba30 legacy=0x7f4e200cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:06.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.949+0000 7f4e1e59c700 1 -- 172.21.15.37:0/3796805553 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e200ce4e0 con 0x7f4e200ce040 2023-07-14T15:58:06.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.949+0000 7f4e1e59c700 1 --2- 172.21.15.37:0/3796805553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e200ce040 0x7f4e200cb4f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f4e2006c3e0 tx=0x7f4e14009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9561b9142ff7624 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:06.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.949+0000 7f4e1dd9b700 1 -- 172.21.15.37:0/3796805553 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e14011830 con 0x7f4e200ce040 2023-07-14T15:58:06.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.949+0000 7f4e1dd9b700 1 -- 172.21.15.37:0/3796805553 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e14011990 con 0x7f4e200ce040 2023-07-14T15:58:06.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.949+0000 7f4e1dd9b700 1 -- 172.21.15.37:0/3796805553 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e14011d20 con 0x7f4e200ce040 2023-07-14T15:58:06.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.950+0000 7f4e251ff700 1 -- 172.21.15.37:0/3796805553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e200ce040 msgr2=0x7f4e200cb4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:06.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.950+0000 7f4e251ff700 1 --2- 172.21.15.37:0/3796805553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e200ce040 0x7f4e200cb4f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f4e2006c3e0 tx=0x7f4e14009bd0 comp rx=0 tx=0).stop 2023-07-14T15:58:06.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.950+0000 7f4e251ff700 1 -- 172.21.15.37:0/3796805553 shutdown_connections 2023-07-14T15:58:06.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.950+0000 7f4e251ff700 1 --2- 172.21.15.37:0/3796805553 >> v2:172.21.15.98:3300/0 conn(0x7f4e200b4840 0x7f4e200cdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:06.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.950+0000 7f4e251ff700 1 --2- 172.21.15.37:0/3796805553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e200ce040 0x7f4e200cb4f0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:06.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.950+0000 7f4e251ff700 1 -- 172.21.15.37:0/3796805553 >> 172.21.15.37:0/3796805553 conn(0x7f4e200b0670 msgr2=0x7f4e200b0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:06.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.950+0000 7f4e251ff700 1 -- 172.21.15.37:0/3796805553 shutdown_connections 2023-07-14T15:58:06.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.950+0000 7f4e251ff700 1 -- 172.21.15.37:0/3796805553 wait complete. 2023-07-14T15:58:06.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.952+0000 7f4e251ff700 1 Processor -- start 2023-07-14T15:58:06.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.952+0000 7f4e251ff700 1 -- start start 2023-07-14T15:58:06.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.953+0000 7f4e251ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e200b4840 0x7f4e201e8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:06.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.953+0000 7f4e251ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4e200cba30 0x7f4e201528b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:06.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.953+0000 7f4e251ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e200ce040 0x7f4e2015cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:06.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.953+0000 7f4e251ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2015c950 con 0x7f4e200ce040 2023-07-14T15:58:06.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.953+0000 7f4e251ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e201e7670 con 0x7f4e200b4840 2023-07-14T15:58:06.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.953+0000 7f4e251ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e201e7950 con 0x7f4e200cba30 2023-07-14T15:58:06.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.953+0000 7f4e1f59e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e200ce040 0x7f4e2015cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:06.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.953+0000 7f4e1f59e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e200ce040 0x7f4e2015cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43954/0 (socket says 172.21.15.37:43954) 2023-07-14T15:58:06.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.953+0000 7f4e1f59e700 1 -- 172.21.15.37:0/207814478 learned_addr learned my addr 172.21.15.37:0/207814478 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:06.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.953+0000 7f4e1ed9d700 1 --2- 172.21.15.37:0/207814478 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e200b4840 0x7f4e201e8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:06.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.953+0000 7f4e1e59c700 1 --2- 172.21.15.37:0/207814478 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4e200cba30 0x7f4e201528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:06.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.954+0000 7f4e1f59e700 1 -- 172.21.15.37:0/207814478 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4e200cba30 msgr2=0x7f4e201528b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:06.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.954+0000 7f4e1f59e700 1 --2- 172.21.15.37:0/207814478 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4e200cba30 0x7f4e201528b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:06.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.954+0000 7f4e1f59e700 1 -- 172.21.15.37:0/207814478 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e200b4840 msgr2=0x7f4e201e8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:06.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.954+0000 7f4e1f59e700 1 --2- 172.21.15.37:0/207814478 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e200b4840 0x7f4e201e8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:06.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.954+0000 7f4e1f59e700 1 -- 172.21.15.37:0/207814478 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e14009550 con 0x7f4e200ce040 2023-07-14T15:58:06.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.954+0000 7f4e1f59e700 1 --2- 172.21.15.37:0/207814478 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e200ce040 0x7f4e2015cfc0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f4e1800cc50 tx=0x7f4e1800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:06.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.954+0000 7f4e077fe700 1 -- 172.21.15.37:0/207814478 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e18003c00 con 0x7f4e200ce040 2023-07-14T15:58:06.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.954+0000 7f4e077fe700 1 -- 172.21.15.37:0/207814478 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e18003d60 con 0x7f4e200ce040 2023-07-14T15:58:06.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.954+0000 7f4e251ff700 1 -- 172.21.15.37:0/207814478 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e201e7c30 con 0x7f4e200ce040 2023-07-14T15:58:06.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.954+0000 7f4e077fe700 1 -- 172.21.15.37:0/207814478 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1800aab0 con 0x7f4e200ce040 2023-07-14T15:58:06.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.954+0000 7f4e251ff700 1 -- 172.21.15.37:0/207814478 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e201e81f0 con 0x7f4e200ce040 2023-07-14T15:58:06.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.955+0000 7f4e251ff700 1 -- 172.21.15.37:0/207814478 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e20067840 con 0x7f4e200ce040 2023-07-14T15:58:06.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.956+0000 7f4e077fe700 1 -- 172.21.15.37:0/207814478 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f4e1800ac10 con 0x7f4e200ce040 2023-07-14T15:58:06.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.958+0000 7f4e077fe700 1 --2- 172.21.15.37:0/207814478 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4e0c06ad70 0x7f4e0c06d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:06.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.958+0000 7f4e077fe700 1 -- 172.21.15.37:0/207814478 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f4e18089350 con 0x7f4e200ce040 2023-07-14T15:58:06.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.958+0000 7f4e1ed9d700 1 --2- 172.21.15.37:0/207814478 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4e0c06ad70 0x7f4e0c06d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:06.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.959+0000 7f4e1ed9d700 1 --2- 172.21.15.37:0/207814478 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4e0c06ad70 0x7f4e0c06d220 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4e10009be0 tx=0x7f4e10009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:06.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:06.963+0000 7f4e077fe700 1 -- 172.21.15.37:0/207814478 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4e180544f0 con 0x7f4e200ce040 2023-07-14T15:58:07.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.173+0000 7f4e251ff700 1 -- 172.21.15.37:0/207814478 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f4e2006bce0 con 0x7f4e200ce040 2023-07-14T15:58:07.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.712+0000 7f4e077fe700 1 -- 172.21.15.37:0/207814478 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v47) v1 ==== 170+0+0 (secure 0 0 0) 0x7f4e18057b10 con 0x7f4e200ce040 2023-07-14T15:58:07.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.717+0000 7f4e251ff700 1 -- 172.21.15.37:0/207814478 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4e0c06ad70 msgr2=0x7f4e0c06d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:07.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.717+0000 7f4e251ff700 1 --2- 172.21.15.37:0/207814478 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4e0c06ad70 0x7f4e0c06d220 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4e10009be0 tx=0x7f4e10009210 comp rx=0 tx=0).stop 2023-07-14T15:58:07.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.717+0000 7f4e251ff700 1 -- 172.21.15.37:0/207814478 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e200ce040 msgr2=0x7f4e2015cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:07.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.717+0000 7f4e251ff700 1 --2- 172.21.15.37:0/207814478 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e200ce040 0x7f4e2015cfc0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f4e1800cc50 tx=0x7f4e1800cf60 comp rx=0 tx=0).stop 2023-07-14T15:58:07.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.720+0000 7f4e251ff700 1 -- 172.21.15.37:0/207814478 shutdown_connections 2023-07-14T15:58:07.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.720+0000 7f4e251ff700 1 --2- 172.21.15.37:0/207814478 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e200b4840 0x7f4e201e8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:07.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.720+0000 7f4e251ff700 1 --2- 172.21.15.37:0/207814478 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4e0c06ad70 0x7f4e0c06d220 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:07.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.720+0000 7f4e251ff700 1 --2- 172.21.15.37:0/207814478 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e200ce040 0x7f4e2015cfc0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:07.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.720+0000 7f4e251ff700 1 --2- 172.21.15.37:0/207814478 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4e200cba30 0x7f4e201528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:07.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.720+0000 7f4e251ff700 1 -- 172.21.15.37:0/207814478 >> 172.21.15.37:0/207814478 conn(0x7f4e200b0670 msgr2=0x7f4e200ad580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:07.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.723+0000 7f4e251ff700 1 -- 172.21.15.37:0/207814478 shutdown_connections 2023-07-14T15:58:07.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.723+0000 7f4e251ff700 1 -- 172.21.15.37:0/207814478 wait complete. 2023-07-14T15:58:07.713 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2023-07-14T15:58:07.736 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-14T15:58:07.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.959+0000 7f3666fff700 1 Processor -- start 2023-07-14T15:58:07.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.959+0000 7f3666fff700 1 -- start start 2023-07-14T15:58:07.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.960+0000 7f3666fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f366015fee0 0x7f366015ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:07.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.960+0000 7f3666fff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f366015dc50 con 0x7f36601603b0 2023-07-14T15:58:07.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.960+0000 7f3666fff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36600b2940 con 0x7f36600d1140 2023-07-14T15:58:07.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.960+0000 7f3666fff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36600b2c20 con 0x7f366015fee0 2023-07-14T15:58:07.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.960+0000 7f365ffff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f36601603b0 0x7f36600d0a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57614/0 (socket says 172.21.15.37:57614) 2023-07-14T15:58:07.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.960+0000 7f365ffff700 1 -- 172.21.15.37:0/379569813 learned_addr learned my addr 172.21.15.37:0/379569813 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:58:07.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.961+0000 7f3664d9b700 1 --2- 172.21.15.37:0/379569813 >> v2:172.21.15.98:3300/0 conn(0x7f366015fee0 0x7f366015ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:07.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.961+0000 7f365f7fe700 1 -- 172.21.15.37:0/379569813 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 613164261 0 0) 0x7f366015dc50 con 0x7f36601603b0 2023-07-14T15:58:07.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.961+0000 7f365f7fe700 1 -- 172.21.15.37:0/379569813 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36500035b0 con 0x7f36601603b0 2023-07-14T15:58:07.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.961+0000 7f365f7fe700 1 -- 172.21.15.37:0/379569813 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 855194878 0 0) 0x7f36600b2940 con 0x7f36600d1140 2023-07-14T15:58:07.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.961+0000 7f365f7fe700 1 -- 172.21.15.37:0/379569813 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f366015dc50 con 0x7f36600d1140 2023-07-14T15:58:07.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.961+0000 7f3664d9b700 1 -- 172.21.15.37:0/379569813 >> v1:172.21.15.98:6789/0 conn(0x7f36600d1140 legacy=0x7f36600b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:07.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.961+0000 7f3664d9b700 1 -- 172.21.15.37:0/379569813 >> v1:172.21.15.37:6789/0 conn(0x7f36601603b0 legacy=0x7f36600d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:07.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.961+0000 7f3664d9b700 1 -- 172.21.15.37:0/379569813 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36600b2f00 con 0x7f366015fee0 2023-07-14T15:58:07.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.961+0000 7f3664d9b700 1 --2- 172.21.15.37:0/379569813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f366015fee0 0x7f366015ded0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3654009840 tx=0x7f3654009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86886fb9349e4c04 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:07.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.962+0000 7f365f7fe700 1 -- 172.21.15.37:0/379569813 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3654011830 con 0x7f366015fee0 2023-07-14T15:58:07.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.962+0000 7f365f7fe700 1 -- 172.21.15.37:0/379569813 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3654011990 con 0x7f366015fee0 2023-07-14T15:58:07.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.962+0000 7f365f7fe700 1 -- 172.21.15.37:0/379569813 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3654011d20 con 0x7f366015fee0 2023-07-14T15:58:07.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.962+0000 7f3666fff700 1 -- 172.21.15.37:0/379569813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f366015fee0 msgr2=0x7f366015ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:07.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.962+0000 7f3666fff700 1 --2- 172.21.15.37:0/379569813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f366015fee0 0x7f366015ded0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3654009840 tx=0x7f3654009b50 comp rx=0 tx=0).stop 2023-07-14T15:58:07.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.962+0000 7f3666fff700 1 -- 172.21.15.37:0/379569813 shutdown_connections 2023-07-14T15:58:07.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.962+0000 7f3666fff700 1 --2- 172.21.15.37:0/379569813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f366015fee0 0x7f366015ded0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:07.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.962+0000 7f3666fff700 1 -- 172.21.15.37:0/379569813 >> 172.21.15.37:0/379569813 conn(0x7f366009c1b0 msgr2=0x7f36600d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:07.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.962+0000 7f3666fff700 1 -- 172.21.15.37:0/379569813 shutdown_connections 2023-07-14T15:58:07.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.963+0000 7f3666fff700 1 -- 172.21.15.37:0/379569813 wait complete. 2023-07-14T15:58:07.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.964+0000 7f3666fff700 1 Processor -- start 2023-07-14T15:58:07.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.964+0000 7f3666fff700 1 -- start start 2023-07-14T15:58:07.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.965+0000 7f3666fff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f36600d1140 0x7f36600afa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:07.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.965+0000 7f3666fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f366015fee0 0x7f36600c85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:07.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.965+0000 7f3666fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36601603b0 0x7f36600c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:07.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.965+0000 7f3666fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36600c7450 con 0x7f36601603b0 2023-07-14T15:58:07.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.965+0000 7f3666fff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36600aff50 con 0x7f366015fee0 2023-07-14T15:58:07.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.965+0000 7f3666fff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36600b7d50 con 0x7f36600d1140 2023-07-14T15:58:07.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.966+0000 7f3664d9b700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f36600d1140 0x7f36600afa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:07.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.966+0000 7f366559c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36601603b0 0x7f36600c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:07.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.966+0000 7f365ffff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f366015fee0 0x7f36600c85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:07.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.966+0000 7f3664d9b700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f36600d1140 0x7f36600afa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3301/0 says I am v2:172.21.15.37:48378/0 (socket says 172.21.15.37:48378) 2023-07-14T15:58:07.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.966+0000 7f3664d9b700 1 -- 172.21.15.37:0/2773089208 learned_addr learned my addr 172.21.15.37:0/2773089208 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:07.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.966+0000 7f3664d9b700 1 -- 172.21.15.37:0/2773089208 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f366015fee0 msgr2=0x7f36600c85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:07.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.966+0000 7f3664d9b700 1 --2- 172.21.15.37:0/2773089208 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f366015fee0 0x7f36600c85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:07.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.966+0000 7f3664d9b700 1 -- 172.21.15.37:0/2773089208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36601603b0 msgr2=0x7f36600c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:07.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.966+0000 7f3664d9b700 1 --2- 172.21.15.37:0/2773089208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36601603b0 0x7f36600c8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:07.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.966+0000 7f3664d9b700 1 -- 172.21.15.37:0/2773089208 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36540094a0 con 0x7f36600d1140 2023-07-14T15:58:07.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.966+0000 7f3664d9b700 1 --2- 172.21.15.37:0/2773089208 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f36600d1140 0x7f36600afa10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3654009fd0 tx=0x7f3654004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:07.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.967+0000 7f365d7fa700 1 -- 172.21.15.37:0/2773089208 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365401a8f0 con 0x7f36600d1140 2023-07-14T15:58:07.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.967+0000 7f365d7fa700 1 -- 172.21.15.37:0/2773089208 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f365401aa50 con 0x7f36600d1140 2023-07-14T15:58:07.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.967+0000 7f365d7fa700 1 -- 172.21.15.37:0/2773089208 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365401adc0 con 0x7f36600d1140 2023-07-14T15:58:07.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.967+0000 7f3666fff700 1 -- 172.21.15.37:0/2773089208 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36600b7a70 con 0x7f36600d1140 2023-07-14T15:58:07.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.967+0000 7f3666fff700 1 -- 172.21.15.37:0/2773089208 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36600c7dc0 con 0x7f36600d1140 2023-07-14T15:58:07.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.968+0000 7f3666fff700 1 -- 172.21.15.37:0/2773089208 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36600c7940 con 0x7f36600d1140 2023-07-14T15:58:07.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.969+0000 7f365d7fa700 1 -- 172.21.15.37:0/2773089208 <== mon.2 v2:172.21.15.98:3301/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f365402d3f0 con 0x7f36600d1140 2023-07-14T15:58:07.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.970+0000 7f365d7fa700 1 --2- 172.21.15.37:0/2773089208 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f364406ad70 0x7f364406d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:07.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.970+0000 7f365d7fa700 1 -- 172.21.15.37:0/2773089208 <== mon.2 v2:172.21.15.98:3301/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f365408a880 con 0x7f36600d1140 2023-07-14T15:58:07.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.970+0000 7f365ffff700 1 --2- 172.21.15.37:0/2773089208 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f364406ad70 0x7f364406d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:07.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.971+0000 7f365ffff700 1 --2- 172.21.15.37:0/2773089208 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f364406ad70 0x7f364406d220 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3660156c20 tx=0x7f364c007e00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:07.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:07.974+0000 7f365d7fa700 1 -- 172.21.15.37:0/2773089208 <== mon.2 v2:172.21.15.98:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3654055ad0 con 0x7f36600d1140 2023-07-14T15:58:08.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.226+0000 7f3666fff700 1 -- 172.21.15.37:0/2773089208 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f36600c7940 con 0x7f36600d1140 2023-07-14T15:58:08.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.716+0000 7f365d7fa700 1 -- 172.21.15.37:0/2773089208 <== mon.2 v2:172.21.15.98:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v22) v1 ==== 172+0+0 (secure 0 0 0) 0x7f36600c7940 con 0x7f36600d1140 2023-07-14T15:58:08.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.734+0000 7f3666fff700 1 -- 172.21.15.37:0/2773089208 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f364406ad70 msgr2=0x7f364406d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:08.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.734+0000 7f3666fff700 1 --2- 172.21.15.37:0/2773089208 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f364406ad70 0x7f364406d220 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3660156c20 tx=0x7f364c007e00 comp rx=0 tx=0).stop 2023-07-14T15:58:08.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.734+0000 7f3666fff700 1 -- 172.21.15.37:0/2773089208 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f36600d1140 msgr2=0x7f36600afa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:08.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.734+0000 7f3666fff700 1 --2- 172.21.15.37:0/2773089208 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f36600d1140 0x7f36600afa10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3654009fd0 tx=0x7f3654004750 comp rx=0 tx=0).stop 2023-07-14T15:58:08.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.734+0000 7f3666fff700 1 -- 172.21.15.37:0/2773089208 shutdown_connections 2023-07-14T15:58:08.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.734+0000 7f3666fff700 1 --2- 172.21.15.37:0/2773089208 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f364406ad70 0x7f364406d220 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:08.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.734+0000 7f3666fff700 1 --2- 172.21.15.37:0/2773089208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36601603b0 0x7f36600c8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:08.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.734+0000 7f3666fff700 1 --2- 172.21.15.37:0/2773089208 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f36600d1140 0x7f36600afa10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:08.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.734+0000 7f3666fff700 1 --2- 172.21.15.37:0/2773089208 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f366015fee0 0x7f36600c85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:08.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.734+0000 7f3666fff700 1 -- 172.21.15.37:0/2773089208 >> 172.21.15.37:0/2773089208 conn(0x7f366009c1b0 msgr2=0x7f366006a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:08.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.738+0000 7f3666fff700 1 -- 172.21.15.37:0/2773089208 shutdown_connections 2023-07-14T15:58:08.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.739+0000 7f3666fff700 1 -- 172.21.15.37:0/2773089208 wait complete. 2023-07-14T15:58:08.728 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 7 and data pool 8 2023-07-14T15:58:08.747 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T15:58:08.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.966+0000 7f29fa3ff700 1 Processor -- start 2023-07-14T15:58:08.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.966+0000 7f29fa3ff700 1 -- start start 2023-07-14T15:58:08.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.967+0000 7f29fa3ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f29f40b85f0 0x7f29f415d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:08.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.967+0000 7f29fa3ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f29f40b4910 0x7f29f40b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:08.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.967+0000 7f29fa3ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29f40cf6b0 con 0x7f29f40b54b0 2023-07-14T15:58:08.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.967+0000 7f29fa3ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29f40b5270 con 0x7f29f40b85f0 2023-07-14T15:58:08.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.967+0000 7f29fa3ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29f40cdc40 con 0x7f29f40b4910 2023-07-14T15:58:08.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.967+0000 7f29f3fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f29f40b85f0 0x7f29f415d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:08.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.967+0000 7f29f37fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f29f40b54b0 0x7f29f40cfb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57628/0 (socket says 172.21.15.37:57628) 2023-07-14T15:58:08.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.967+0000 7f29f37fe700 1 -- 172.21.15.37:0/1004039473 learned_addr learned my addr 172.21.15.37:0/1004039473 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:58:08.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.968+0000 7f29f899c700 1 --2- 172.21.15.37:0/1004039473 >> v2:172.21.15.98:3300/0 conn(0x7f29f40b4910 0x7f29f40b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:08.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.968+0000 7f29f3fff700 1 -- 172.21.15.37:0/1004039473 >> v2:172.21.15.98:3300/0 conn(0x7f29f40b4910 msgr2=0x7f29f40b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:08.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.968+0000 7f29f3fff700 1 --2- 172.21.15.37:0/1004039473 >> v2:172.21.15.98:3300/0 conn(0x7f29f40b4910 0x7f29f40b4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:08.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.968+0000 7f29f3fff700 1 -- 172.21.15.37:0/1004039473 >> v1:172.21.15.37:6789/0 conn(0x7f29f40b54b0 legacy=0x7f29f40cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:08.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.968+0000 7f29f3fff700 1 -- 172.21.15.37:0/1004039473 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f415dba0 con 0x7f29f40b85f0 2023-07-14T15:58:08.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.968+0000 7f29f3fff700 1 --2- 172.21.15.37:0/1004039473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29f40b85f0 0x7f29f415d660 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f29f4161270 tx=0x7f29e4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6e8517b60dcdb12 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:08.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.968+0000 7f29f2ffd700 1 -- 172.21.15.37:0/1004039473 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e4011830 con 0x7f29f40b85f0 2023-07-14T15:58:08.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.968+0000 7f29f2ffd700 1 -- 172.21.15.37:0/1004039473 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e4011990 con 0x7f29f40b85f0 2023-07-14T15:58:08.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.968+0000 7f29f2ffd700 1 -- 172.21.15.37:0/1004039473 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e4011d20 con 0x7f29f40b85f0 2023-07-14T15:58:08.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.969+0000 7f29fa3ff700 1 -- 172.21.15.37:0/1004039473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29f40b85f0 msgr2=0x7f29f415d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:08.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.969+0000 7f29fa3ff700 1 --2- 172.21.15.37:0/1004039473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29f40b85f0 0x7f29f415d660 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f29f4161270 tx=0x7f29e4009b20 comp rx=0 tx=0).stop 2023-07-14T15:58:08.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.969+0000 7f29fa3ff700 1 -- 172.21.15.37:0/1004039473 shutdown_connections 2023-07-14T15:58:08.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.969+0000 7f29fa3ff700 1 --2- 172.21.15.37:0/1004039473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29f40b85f0 0x7f29f415d660 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:08.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.969+0000 7f29fa3ff700 1 --2- 172.21.15.37:0/1004039473 >> v2:172.21.15.98:3300/0 conn(0x7f29f40b4910 0x7f29f40b4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:08.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.969+0000 7f29fa3ff700 1 -- 172.21.15.37:0/1004039473 >> 172.21.15.37:0/1004039473 conn(0x7f29f406a580 msgr2=0x7f29f406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:08.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.969+0000 7f29fa3ff700 1 -- 172.21.15.37:0/1004039473 shutdown_connections 2023-07-14T15:58:08.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.969+0000 7f29fa3ff700 1 -- 172.21.15.37:0/1004039473 wait complete. 2023-07-14T15:58:08.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.971+0000 7f29fa3ff700 1 Processor -- start 2023-07-14T15:58:08.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.971+0000 7f29fa3ff700 1 -- start start 2023-07-14T15:58:08.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.972+0000 7f29fa3ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f29f40b4910 0x7f29f40c6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:08.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.972+0000 7f29fa3ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29f40b54b0 0x7f29f4153ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:08.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.972+0000 7f29fa3ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f29f40b85f0 0x7f29f41e6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:08.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.972+0000 7f29fa3ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f4160ec0 con 0x7f29f40b54b0 2023-07-14T15:58:08.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.972+0000 7f29fa3ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f40cbc70 con 0x7f29f40b85f0 2023-07-14T15:58:08.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.972+0000 7f29fa3ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29f40cb380 con 0x7f29f40b4910 2023-07-14T15:58:08.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.972+0000 7f29f37fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29f40b54b0 0x7f29f4153ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:08.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.972+0000 7f29f37fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29f40b54b0 0x7f29f4153ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43986/0 (socket says 172.21.15.37:43986) 2023-07-14T15:58:08.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.972+0000 7f29f37fe700 1 -- 172.21.15.37:0/4255208189 learned_addr learned my addr 172.21.15.37:0/4255208189 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:08.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.973+0000 7f29f3fff700 1 --2- 172.21.15.37:0/4255208189 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f29f40b4910 0x7f29f40c6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:08.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.973+0000 7f29f899c700 1 --2- 172.21.15.37:0/4255208189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f29f40b85f0 0x7f29f41e6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:08.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.973+0000 7f29f37fe700 1 -- 172.21.15.37:0/4255208189 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f29f40b4910 msgr2=0x7f29f40c6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:08.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.973+0000 7f29f37fe700 1 --2- 172.21.15.37:0/4255208189 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f29f40b4910 0x7f29f40c6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:08.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.973+0000 7f29f37fe700 1 -- 172.21.15.37:0/4255208189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f29f40b85f0 msgr2=0x7f29f41e6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:08.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.973+0000 7f29f37fe700 1 --2- 172.21.15.37:0/4255208189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f29f40b85f0 0x7f29f41e6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:08.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.973+0000 7f29f37fe700 1 -- 172.21.15.37:0/4255208189 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e40094a0 con 0x7f29f40b54b0 2023-07-14T15:58:08.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.973+0000 7f29f37fe700 1 --2- 172.21.15.37:0/4255208189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29f40b54b0 0x7f29f4153ef0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f29e800c550 tx=0x7f29e800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:08.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.973+0000 7f29f0ff9700 1 -- 172.21.15.37:0/4255208189 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e8005d70 con 0x7f29f40b54b0 2023-07-14T15:58:08.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.973+0000 7f29f0ff9700 1 -- 172.21.15.37:0/4255208189 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e80070d0 con 0x7f29f40b54b0 2023-07-14T15:58:08.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.973+0000 7f29f0ff9700 1 -- 172.21.15.37:0/4255208189 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e8007440 con 0x7f29f40b54b0 2023-07-14T15:58:08.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.973+0000 7f29fa3ff700 1 -- 172.21.15.37:0/4255208189 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29f40cb620 con 0x7f29f40b54b0 2023-07-14T15:58:08.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.974+0000 7f29fa3ff700 1 -- 172.21.15.37:0/4255208189 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f4154980 con 0x7f29f40b54b0 2023-07-14T15:58:08.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.975+0000 7f29fa3ff700 1 -- 172.21.15.37:0/4255208189 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29f40d2a50 con 0x7f29f40b54b0 2023-07-14T15:58:08.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.976+0000 7f29f0ff9700 1 -- 172.21.15.37:0/4255208189 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f29e80075a0 con 0x7f29f40b54b0 2023-07-14T15:58:08.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.977+0000 7f29f0ff9700 1 --2- 172.21.15.37:0/4255208189 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f29e006ad40 0x7f29e006d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:08.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.977+0000 7f29f0ff9700 1 -- 172.21.15.37:0/4255208189 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f29e8088980 con 0x7f29f40b54b0 2023-07-14T15:58:08.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.977+0000 7f29f3fff700 1 --2- 172.21.15.37:0/4255208189 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f29e006ad40 0x7f29e006d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:08.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.978+0000 7f29f3fff700 1 --2- 172.21.15.37:0/4255208189 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f29e006ad40 0x7f29e006d1f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f29e40090b0 tx=0x7f29e401c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:08.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:08.981+0000 7f29f0ff9700 1 -- 172.21.15.37:0/4255208189 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f29e80539f0 con 0x7f29f40b54b0 2023-07-14T15:58:09.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.191+0000 7f29fa3ff700 1 -- 172.21.15.37:0/4255208189 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29f4067840 con 0x7f29f40b54b0 2023-07-14T15:58:09.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.192+0000 7f29f0ff9700 1 -- 172.21.15.37:0/4255208189 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+18294 (secure 0 0 0) 0x7f29e8057010 con 0x7f29f40b54b0 2023-07-14T15:58:09.177 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:58:09.177 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":48,"fsid":"9da30401-a779-4e46-aba6-00c2494c6c67","created":"2023-07-14T15:55:39.898867+0000","modified":"2023-07-14T15:58:08.227699+0000","last_up_change":"2023-07-14T15:55:53.025696+0000","last_in_change":"2023-07-14T15:55:43.388192+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T15:55:52.907261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T15:55:59.992839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-14T15:58:05.947379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-14T15:58:07.213413+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d049535-7b87-4276-8fe5-0f74ba422d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6801","nonce":2783032392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6803","nonce":2783032392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6807","nonce":2783032392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6805","nonce":2783032392}]},"public_addr":"172.21.15.37:6801/2783032392","cluster_addr":"172.21.15.37:6803/2783032392","heartbeat_back_addr":"172.21.15.37:6807/2783032392","heartbeat_front_addr":"172.21.15.37:6805/2783032392","state":["exists","up"]},{"osd":1,"uuid":"79ec948d-ead2-4c2d-923a-dd6eeaac9dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6823","nonce":1190059746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6826","nonce":1190059746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6831","nonce":1190059746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6829","nonce":1190059746}]},"public_addr":"172.21.15.37:6823/1190059746","cluster_addr":"172.21.15.37:6826/1190059746","heartbeat_back_addr":"172.21.15.37:6831/1190059746","heartbeat_front_addr":"172.21.15.37:6829/1190059746","state":["exists","up"]},{"osd":2,"uuid":"a1db6690-c160-4366-9c82-2cca17e4bba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6809","nonce":2266223499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6813","nonce":2266223499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6820","nonce":2266223499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6816","nonce":2266223499}]},"public_addr":"172.21.15.37:6809/2266223499","cluster_addr":"172.21.15.37:6813/2266223499","heartbeat_back_addr":"172.21.15.37:6820/2266223499","heartbeat_front_addr":"172.21.15.37:6816/2266223499","state":["exists","up"]},{"osd":3,"uuid":"767b8220-e79a-4a86-a162-6b3b73198379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6812","nonce":4166694594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6817","nonce":4166694594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6828","nonce":4166694594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6822","nonce":4166694594}]},"public_addr":"172.21.15.37:6812/4166694594","cluster_addr":"172.21.15.37:6817/4166694594","heartbeat_back_addr":"172.21.15.37:6828/4166694594","heartbeat_front_addr":"172.21.15.37:6822/4166694594","state":["exists","up"]},{"osd":4,"uuid":"717bd773-ae7e-4236-ac79-900cf99a37c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6801","nonce":3529020407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6803","nonce":3529020407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6807","nonce":3529020407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6805","nonce":3529020407}]},"public_addr":"172.21.15.98:6801/3529020407","cluster_addr":"172.21.15.98:6803/3529020407","heartbeat_back_addr":"172.21.15.98:6807/3529020407","heartbeat_front_addr":"172.21.15.98:6805/3529020407","state":["exists","up"]},{"osd":5,"uuid":"a941d358-0f03-4136-a9b2-3a1c2e9358cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6817","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6819","nonce":2311501838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6821","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6823","nonce":2311501838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6829","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6831","nonce":2311501838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6825","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6827","nonce":2311501838}]},"public_addr":"172.21.15.98:6819/2311501838","cluster_addr":"172.21.15.98:6823/2311501838","heartbeat_back_addr":"172.21.15.98:6831/2311501838","heartbeat_front_addr":"172.21.15.98:6827/2311501838","state":["exists","up"]},{"osd":6,"uuid":"27153772-6d4b-479d-9953-0582e7b96743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6809","nonce":1144224691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6811","nonce":1144224691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6815","nonce":1144224691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6813","nonce":1144224691}]},"public_addr":"172.21.15.98:6809/1144224691","cluster_addr":"172.21.15.98:6811/1144224691","heartbeat_back_addr":"172.21.15.98:6815/1144224691","heartbeat_front_addr":"172.21.15.98:6813/1144224691","state":["exists","up"]},{"osd":7,"uuid":"d21ffc8e-40bb-47eb-af2c-e3e730d3fb76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6818","nonce":1144470927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6822","nonce":1144470927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6830","nonce":1144470927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6826","nonce":1144470927}]},"public_addr":"172.21.15.98:6818/1144470927","cluster_addr":"172.21.15.98:6822/1144470927","heartbeat_back_addr":"172.21.15.98:6830/1144470927","heartbeat_front_addr":"172.21.15.98:6826/1144470927","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.921114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.739210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.024016+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.002527+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.698127+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.813416+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.709351+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.815457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T15:58:09.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.195+0000 7f29fa3ff700 1 -- 172.21.15.37:0/4255208189 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f29e006ad40 msgr2=0x7f29e006d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:09.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.195+0000 7f29fa3ff700 1 --2- 172.21.15.37:0/4255208189 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f29e006ad40 0x7f29e006d1f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f29e40090b0 tx=0x7f29e401c040 comp rx=0 tx=0).stop 2023-07-14T15:58:09.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.195+0000 7f29fa3ff700 1 -- 172.21.15.37:0/4255208189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29f40b54b0 msgr2=0x7f29f4153ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:09.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.195+0000 7f29fa3ff700 1 --2- 172.21.15.37:0/4255208189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29f40b54b0 0x7f29f4153ef0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f29e800c550 tx=0x7f29e800c910 comp rx=0 tx=0).stop 2023-07-14T15:58:09.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.195+0000 7f29fa3ff700 1 -- 172.21.15.37:0/4255208189 shutdown_connections 2023-07-14T15:58:09.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.195+0000 7f29fa3ff700 1 --2- 172.21.15.37:0/4255208189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f29f40b85f0 0x7f29f41e6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:09.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.195+0000 7f29fa3ff700 1 --2- 172.21.15.37:0/4255208189 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f29e006ad40 0x7f29e006d1f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:09.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.195+0000 7f29fa3ff700 1 --2- 172.21.15.37:0/4255208189 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f29f40b4910 0x7f29f40c6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:09.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.195+0000 7f29fa3ff700 1 --2- 172.21.15.37:0/4255208189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29f40b54b0 0x7f29f4153ef0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:09.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.195+0000 7f29fa3ff700 1 -- 172.21.15.37:0/4255208189 >> 172.21.15.37:0/4255208189 conn(0x7f29f406a580 msgr2=0x7f29f406a950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:09.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.195+0000 7f29fa3ff700 1 -- 172.21.15.37:0/4255208189 shutdown_connections 2023-07-14T15:58:09.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.195+0000 7f29fa3ff700 1 -- 172.21.15.37:0/4255208189 wait complete. 2023-07-14T15:58:09.197 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T15:58:09.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.415+0000 7f4f40bff700 1 Processor -- start 2023-07-14T15:58:09.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.415+0000 7f4f40bff700 1 -- start start 2023-07-14T15:58:09.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.416+0000 7f4f40bff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f4f3c0b8650 0x7f4f3c0d0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:09.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.416+0000 7f4f40bff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4f3c0b24e0 0x7f4f3c0cf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:09.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.417+0000 7f4f40bff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f3c0cd540 con 0x7f4f3c0cfbd0 2023-07-14T15:58:09.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.417+0000 7f4f40bff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f3c0d1000 con 0x7f4f3c0b24e0 2023-07-14T15:58:09.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.417+0000 7f4f40bff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f3c160f70 con 0x7f4f3c0b8650 2023-07-14T15:58:09.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.417+0000 7f4f33fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4f3c0b24e0 0x7f4f3c0cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:09.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.417+0000 7f4f33fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4f3c0b24e0 0x7f4f3c0cf690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43996/0 (socket says 172.21.15.37:43996) 2023-07-14T15:58:09.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.417+0000 7f4f33fff700 1 -- 172.21.15.37:0/1394611453 learned_addr learned my addr 172.21.15.37:0/1394611453 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:09.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.417+0000 7f4f3ad9d700 1 --1- 172.21.15.37:0/1394611453 >> v1:172.21.15.37:6789/0 conn(0x7f4f3c0cfbd0 0x7f4f3c0b4970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57632/0 (socket says 172.21.15.37:57632) 2023-07-14T15:58:09.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.417+0000 7f4f3a59c700 1 --2- 172.21.15.37:0/1394611453 >> v2:172.21.15.98:3300/0 conn(0x7f4f3c0b8650 0x7f4f3c0d0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:09.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.417+0000 7f4f33fff700 1 -- 172.21.15.37:0/1394611453 >> v2:172.21.15.98:3300/0 conn(0x7f4f3c0b8650 msgr2=0x7f4f3c0d0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:09.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.417+0000 7f4f33fff700 1 --2- 172.21.15.37:0/1394611453 >> v2:172.21.15.98:3300/0 conn(0x7f4f3c0b8650 0x7f4f3c0d0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:09.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.417+0000 7f4f33fff700 1 -- 172.21.15.37:0/1394611453 >> v1:172.21.15.37:6789/0 conn(0x7f4f3c0cfbd0 legacy=0x7f4f3c0b4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:09.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.417+0000 7f4f33fff700 1 -- 172.21.15.37:0/1394611453 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f3c0cd790 con 0x7f4f3c0b24e0 2023-07-14T15:58:09.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.418+0000 7f4f33fff700 1 --2- 172.21.15.37:0/1394611453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f3c0b24e0 0x7f4f3c0cf690 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c06cec0 tx=0x7f4f24009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3624e91d89f635dd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:09.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.418+0000 7f4f39d9b700 1 -- 172.21.15.37:0/1394611453 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2400b870 con 0x7f4f3c0b24e0 2023-07-14T15:58:09.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.418+0000 7f4f39d9b700 1 -- 172.21.15.37:0/1394611453 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2400b9d0 con 0x7f4f3c0b24e0 2023-07-14T15:58:09.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.418+0000 7f4f39d9b700 1 -- 172.21.15.37:0/1394611453 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2400bd60 con 0x7f4f3c0b24e0 2023-07-14T15:58:09.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.418+0000 7f4f40bff700 1 -- 172.21.15.37:0/1394611453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f3c0b24e0 msgr2=0x7f4f3c0cf690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:09.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.418+0000 7f4f40bff700 1 --2- 172.21.15.37:0/1394611453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f3c0b24e0 0x7f4f3c0cf690 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c06cec0 tx=0x7f4f24009bd0 comp rx=0 tx=0).stop 2023-07-14T15:58:09.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.419+0000 7f4f40bff700 1 -- 172.21.15.37:0/1394611453 shutdown_connections 2023-07-14T15:58:09.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.419+0000 7f4f40bff700 1 --2- 172.21.15.37:0/1394611453 >> v2:172.21.15.98:3300/0 conn(0x7f4f3c0b8650 0x7f4f3c0d0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:09.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.419+0000 7f4f40bff700 1 --2- 172.21.15.37:0/1394611453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f3c0b24e0 0x7f4f3c0cf690 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:09.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.419+0000 7f4f40bff700 1 -- 172.21.15.37:0/1394611453 >> 172.21.15.37:0/1394611453 conn(0x7f4f3c06c0f0 msgr2=0x7f4f3c06c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:09.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.419+0000 7f4f40bff700 1 -- 172.21.15.37:0/1394611453 shutdown_connections 2023-07-14T15:58:09.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.419+0000 7f4f40bff700 1 -- 172.21.15.37:0/1394611453 wait complete. 2023-07-14T15:58:09.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.420+0000 7f4f40bff700 1 Processor -- start 2023-07-14T15:58:09.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.420+0000 7f4f40bff700 1 -- start start 2023-07-14T15:58:09.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.421+0000 7f4f40bff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4f3c0b24e0 0x7f4f3c15ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:09.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.421+0000 7f4f40bff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f3c0b8650 0x7f4f3c1f2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:09.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.421+0000 7f4f40bff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f3c0cfbd0 0x7f4f3c1e6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:09.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.421+0000 7f4f40bff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c1e5e70 con 0x7f4f3c0cfbd0 2023-07-14T15:58:09.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.421+0000 7f4f40bff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c15bbf0 con 0x7f4f3c0b8650 2023-07-14T15:58:09.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.421+0000 7f4f40bff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c1e60c0 con 0x7f4f3c0b24e0 2023-07-14T15:58:09.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.422+0000 7f4f3ad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f3c0cfbd0 0x7f4f3c1e6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:09.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.422+0000 7f4f3ad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f3c0cfbd0 0x7f4f3c1e6e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44006/0 (socket says 172.21.15.37:44006) 2023-07-14T15:58:09.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.422+0000 7f4f3ad9d700 1 -- 172.21.15.37:0/2177832902 learned_addr learned my addr 172.21.15.37:0/2177832902 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:09.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.422+0000 7f4f3a59c700 1 --2- 172.21.15.37:0/2177832902 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4f3c0b24e0 0x7f4f3c15ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:09.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.422+0000 7f4f33fff700 1 --2- 172.21.15.37:0/2177832902 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f3c0b8650 0x7f4f3c1f2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:09.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.422+0000 7f4f3ad9d700 1 -- 172.21.15.37:0/2177832902 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4f3c0b24e0 msgr2=0x7f4f3c15ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:09.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.422+0000 7f4f3ad9d700 1 --2- 172.21.15.37:0/2177832902 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4f3c0b24e0 0x7f4f3c15ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:09.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.422+0000 7f4f3ad9d700 1 -- 172.21.15.37:0/2177832902 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f3c0b8650 msgr2=0x7f4f3c1f2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:09.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.422+0000 7f4f3ad9d700 1 --2- 172.21.15.37:0/2177832902 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f3c0b8650 0x7f4f3c1f2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:09.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.422+0000 7f4f3ad9d700 1 -- 172.21.15.37:0/2177832902 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f24009550 con 0x7f4f3c0cfbd0 2023-07-14T15:58:09.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.423+0000 7f4f3ad9d700 1 --2- 172.21.15.37:0/2177832902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f3c0cfbd0 0x7f4f3c1e6e80 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f4f3400cbc0 tx=0x7f4f3400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:09.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.423+0000 7f4f32ffd700 1 -- 172.21.15.37:0/2177832902 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3400a9e0 con 0x7f4f3c0cfbd0 2023-07-14T15:58:09.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.423+0000 7f4f32ffd700 1 -- 172.21.15.37:0/2177832902 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3400ab40 con 0x7f4f3c0cfbd0 2023-07-14T15:58:09.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.423+0000 7f4f40bff700 1 -- 172.21.15.37:0/2177832902 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f3c1e63a0 con 0x7f4f3c0cfbd0 2023-07-14T15:58:09.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.423+0000 7f4f32ffd700 1 -- 172.21.15.37:0/2177832902 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f34007070 con 0x7f4f3c0cfbd0 2023-07-14T15:58:09.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.423+0000 7f4f40bff700 1 -- 172.21.15.37:0/2177832902 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f3c1e6960 con 0x7f4f3c0cfbd0 2023-07-14T15:58:09.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.424+0000 7f4f40bff700 1 -- 172.21.15.37:0/2177832902 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f3c067840 con 0x7f4f3c0cfbd0 2023-07-14T15:58:09.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.425+0000 7f4f32ffd700 1 -- 172.21.15.37:0/2177832902 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f4f340071d0 con 0x7f4f3c0cfbd0 2023-07-14T15:58:09.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.426+0000 7f4f32ffd700 1 --2- 172.21.15.37:0/2177832902 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4f1c06ad70 0x7f4f1c06d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:09.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.426+0000 7f4f32ffd700 1 -- 172.21.15.37:0/2177832902 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4f34089090 con 0x7f4f3c0cfbd0 2023-07-14T15:58:09.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.427+0000 7f4f3a59c700 1 --2- 172.21.15.37:0/2177832902 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4f1c06ad70 0x7f4f1c06d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:09.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.428+0000 7f4f3a59c700 1 --2- 172.21.15.37:0/2177832902 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4f1c06ad70 0x7f4f1c06d220 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c1e8c40 tx=0x7f4f2c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:09.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.431+0000 7f4f32ffd700 1 -- 172.21.15.37:0/2177832902 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4f34054190 con 0x7f4f3c0cfbd0 2023-07-14T15:58:09.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.640+0000 7f4f40bff700 1 -- 172.21.15.37:0/2177832902 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f3c06af10 con 0x7f4f3c0cfbd0 2023-07-14T15:58:09.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.641+0000 7f4f32ffd700 1 -- 172.21.15.37:0/2177832902 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+18294 (secure 0 0 0) 0x7f4f34017090 con 0x7f4f3c0cfbd0 2023-07-14T15:58:09.626 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:58:09.627 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":48,"fsid":"9da30401-a779-4e46-aba6-00c2494c6c67","created":"2023-07-14T15:55:39.898867+0000","modified":"2023-07-14T15:58:08.227699+0000","last_up_change":"2023-07-14T15:55:53.025696+0000","last_in_change":"2023-07-14T15:55:43.388192+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T15:55:52.907261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T15:55:59.992839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-14T15:58:05.947379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-14T15:58:07.213413+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d049535-7b87-4276-8fe5-0f74ba422d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6801","nonce":2783032392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6803","nonce":2783032392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6807","nonce":2783032392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6805","nonce":2783032392}]},"public_addr":"172.21.15.37:6801/2783032392","cluster_addr":"172.21.15.37:6803/2783032392","heartbeat_back_addr":"172.21.15.37:6807/2783032392","heartbeat_front_addr":"172.21.15.37:6805/2783032392","state":["exists","up"]},{"osd":1,"uuid":"79ec948d-ead2-4c2d-923a-dd6eeaac9dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6823","nonce":1190059746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6826","nonce":1190059746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6831","nonce":1190059746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6829","nonce":1190059746}]},"public_addr":"172.21.15.37:6823/1190059746","cluster_addr":"172.21.15.37:6826/1190059746","heartbeat_back_addr":"172.21.15.37:6831/1190059746","heartbeat_front_addr":"172.21.15.37:6829/1190059746","state":["exists","up"]},{"osd":2,"uuid":"a1db6690-c160-4366-9c82-2cca17e4bba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6809","nonce":2266223499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6813","nonce":2266223499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6820","nonce":2266223499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6816","nonce":2266223499}]},"public_addr":"172.21.15.37:6809/2266223499","cluster_addr":"172.21.15.37:6813/2266223499","heartbeat_back_addr":"172.21.15.37:6820/2266223499","heartbeat_front_addr":"172.21.15.37:6816/2266223499","state":["exists","up"]},{"osd":3,"uuid":"767b8220-e79a-4a86-a162-6b3b73198379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6812","nonce":4166694594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6817","nonce":4166694594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6828","nonce":4166694594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6822","nonce":4166694594}]},"public_addr":"172.21.15.37:6812/4166694594","cluster_addr":"172.21.15.37:6817/4166694594","heartbeat_back_addr":"172.21.15.37:6828/4166694594","heartbeat_front_addr":"172.21.15.37:6822/4166694594","state":["exists","up"]},{"osd":4,"uuid":"717bd773-ae7e-4236-ac79-900cf99a37c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6801","nonce":3529020407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6803","nonce":3529020407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6807","nonce":3529020407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6805","nonce":3529020407}]},"public_addr":"172.21.15.98:6801/3529020407","cluster_addr":"172.21.15.98:6803/3529020407","heartbeat_back_addr":"172.21.15.98:6807/3529020407","heartbeat_front_addr":"172.21.15.98:6805/3529020407","state":["exists","up"]},{"osd":5,"uuid":"a941d358-0f03-4136-a9b2-3a1c2e9358cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6817","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6819","nonce":2311501838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6821","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6823","nonce":2311501838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6829","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6831","nonce":2311501838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6825","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6827","nonce":2311501838}]},"public_addr":"172.21.15.98:6819/2311501838","cluster_addr":"172.21.15.98:6823/2311501838","heartbeat_back_addr":"172.21.15.98:6831/2311501838","heartbeat_front_addr":"172.21.15.98:6827/2311501838","state":["exists","up"]},{"osd":6,"uuid":"27153772-6d4b-479d-9953-0582e7b96743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6809","nonce":1144224691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6811","nonce":1144224691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6815","nonce":1144224691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6813","nonce":1144224691}]},"public_addr":"172.21.15.98:6809/1144224691","cluster_addr":"172.21.15.98:6811/1144224691","heartbeat_back_addr":"172.21.15.98:6815/1144224691","heartbeat_front_addr":"172.21.15.98:6813/1144224691","state":["exists","up"]},{"osd":7,"uuid":"d21ffc8e-40bb-47eb-af2c-e3e730d3fb76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6818","nonce":1144470927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6822","nonce":1144470927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6830","nonce":1144470927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6826","nonce":1144470927}]},"public_addr":"172.21.15.98:6818/1144470927","cluster_addr":"172.21.15.98:6822/1144470927","heartbeat_back_addr":"172.21.15.98:6830/1144470927","heartbeat_front_addr":"172.21.15.98:6826/1144470927","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.921114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.739210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.024016+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.002527+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.698127+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.813416+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.709351+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.815457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T15:58:09.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.643+0000 7f4f40bff700 1 -- 172.21.15.37:0/2177832902 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4f1c06ad70 msgr2=0x7f4f1c06d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:09.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.643+0000 7f4f40bff700 1 --2- 172.21.15.37:0/2177832902 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4f1c06ad70 0x7f4f1c06d220 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c1e8c40 tx=0x7f4f2c008040 comp rx=0 tx=0).stop 2023-07-14T15:58:09.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.643+0000 7f4f40bff700 1 -- 172.21.15.37:0/2177832902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f3c0cfbd0 msgr2=0x7f4f3c1e6e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:09.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.643+0000 7f4f40bff700 1 --2- 172.21.15.37:0/2177832902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f3c0cfbd0 0x7f4f3c1e6e80 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f4f3400cbc0 tx=0x7f4f3400ced0 comp rx=0 tx=0).stop 2023-07-14T15:58:09.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.643+0000 7f4f40bff700 1 -- 172.21.15.37:0/2177832902 shutdown_connections 2023-07-14T15:58:09.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.643+0000 7f4f40bff700 1 --2- 172.21.15.37:0/2177832902 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4f1c06ad70 0x7f4f1c06d220 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:09.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.643+0000 7f4f40bff700 1 --2- 172.21.15.37:0/2177832902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f3c0cfbd0 0x7f4f3c1e6e80 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:09.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.643+0000 7f4f40bff700 1 --2- 172.21.15.37:0/2177832902 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4f3c0b24e0 0x7f4f3c15ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:09.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.644+0000 7f4f40bff700 1 --2- 172.21.15.37:0/2177832902 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f3c0b8650 0x7f4f3c1f2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:09.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.644+0000 7f4f40bff700 1 -- 172.21.15.37:0/2177832902 >> 172.21.15.37:0/2177832902 conn(0x7f4f3c06c0f0 msgr2=0x7f4f3c0b3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:09.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.644+0000 7f4f40bff700 1 -- 172.21.15.37:0/2177832902 shutdown_connections 2023-07-14T15:58:09.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.644+0000 7f4f40bff700 1 -- 172.21.15.37:0/2177832902 wait complete. 2023-07-14T15:58:09.646 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-14T15:58:09.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.870+0000 7fd1427ff700 1 Processor -- start 2023-07-14T15:58:09.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.870+0000 7fd1427ff700 1 -- start start 2023-07-14T15:58:09.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.871+0000 7fd1427ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd13c15fee0 0x7fd13c15ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:09.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.871+0000 7fd1427ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd13c0d1140 0x7fd13c0b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:09.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.871+0000 7fd1427ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd13c15dc50 con 0x7fd13c1603b0 2023-07-14T15:58:09.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.871+0000 7fd1427ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd13c0b2940 con 0x7fd13c15fee0 2023-07-14T15:58:09.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.871+0000 7fd1427ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd13c0b2c20 con 0x7fd13c0d1140 2023-07-14T15:58:09.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.872+0000 7fd140d9c700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd13c0d1140 0x7fd13c0b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:09.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.872+0000 7fd140d9c700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd13c0d1140 0x7fd13c0b39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3301/0 says I am v2:172.21.15.37:48412/0 (socket says 172.21.15.37:48412) 2023-07-14T15:58:09.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.872+0000 7fd140d9c700 1 -- 172.21.15.37:0/3649893696 learned_addr learned my addr 172.21.15.37:0/3649893696 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:09.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.872+0000 7fd13b7fe700 1 --1- 172.21.15.37:0/3649893696 >> v1:172.21.15.98:6789/0 conn(0x7fd13c1603b0 0x7fd13c0d0a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.37:40352/0 (socket says 172.21.15.37:40352) 2023-07-14T15:58:09.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.872+0000 7fd13bfff700 1 --2- 172.21.15.37:0/3649893696 >> v2:172.21.15.98:3300/0 conn(0x7fd13c15fee0 0x7fd13c15ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:09.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.872+0000 7fd13affd700 1 -- 172.21.15.37:0/3649893696 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1566870760 0 0) 0x7fd13c15dc50 con 0x7fd13c1603b0 2023-07-14T15:58:09.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.872+0000 7fd140d9c700 1 -- 172.21.15.37:0/3649893696 >> v2:172.21.15.98:3300/0 conn(0x7fd13c15fee0 msgr2=0x7fd13c15ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:09.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.872+0000 7fd140d9c700 1 --2- 172.21.15.37:0/3649893696 >> v2:172.21.15.98:3300/0 conn(0x7fd13c15fee0 0x7fd13c15ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:09.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.872+0000 7fd140d9c700 1 -- 172.21.15.37:0/3649893696 >> v1:172.21.15.98:6789/0 conn(0x7fd13c1603b0 legacy=0x7fd13c0d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:09.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.872+0000 7fd140d9c700 1 -- 172.21.15.37:0/3649893696 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd13c0b2f00 con 0x7fd13c0d1140 2023-07-14T15:58:09.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.872+0000 7fd140d9c700 1 --2- 172.21.15.37:0/3649893696 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd13c0d1140 0x7fd13c0b39e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd134009e50 tx=0x7fd13400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3460c38fa80baf01 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:09.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.873+0000 7fd13affd700 1 -- 172.21.15.37:0/3649893696 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13400e070 con 0x7fd13c0d1140 2023-07-14T15:58:09.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.873+0000 7fd13affd700 1 -- 172.21.15.37:0/3649893696 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd13400b910 con 0x7fd13c0d1140 2023-07-14T15:58:09.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.873+0000 7fd13affd700 1 -- 172.21.15.37:0/3649893696 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13400bcc0 con 0x7fd13c0d1140 2023-07-14T15:58:09.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.873+0000 7fd1427ff700 1 -- 172.21.15.37:0/3649893696 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd13c0d1140 msgr2=0x7fd13c0b39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:09.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.873+0000 7fd1427ff700 1 --2- 172.21.15.37:0/3649893696 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd13c0d1140 0x7fd13c0b39e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd134009e50 tx=0x7fd13400b330 comp rx=0 tx=0).stop 2023-07-14T15:58:09.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.873+0000 7fd1427ff700 1 -- 172.21.15.37:0/3649893696 shutdown_connections 2023-07-14T15:58:09.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.873+0000 7fd1427ff700 1 --2- 172.21.15.37:0/3649893696 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd13c0d1140 0x7fd13c0b39e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:09.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.873+0000 7fd1427ff700 1 --2- 172.21.15.37:0/3649893696 >> v2:172.21.15.98:3300/0 conn(0x7fd13c15fee0 0x7fd13c15ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:09.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.873+0000 7fd1427ff700 1 -- 172.21.15.37:0/3649893696 >> 172.21.15.37:0/3649893696 conn(0x7fd13c09c1b0 msgr2=0x7fd13c0d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:09.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.873+0000 7fd1427ff700 1 -- 172.21.15.37:0/3649893696 shutdown_connections 2023-07-14T15:58:09.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.874+0000 7fd1427ff700 1 -- 172.21.15.37:0/3649893696 wait complete. 2023-07-14T15:58:09.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.875+0000 7fd1427ff700 1 Processor -- start 2023-07-14T15:58:09.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.875+0000 7fd1427ff700 1 -- start start 2023-07-14T15:58:09.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.876+0000 7fd1427ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd13c0d1140 0x7fd13c0b0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:09.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.876+0000 7fd1427ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd13c15fee0 0x7fd13c0b0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:09.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.876+0000 7fd1427ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd13c1603b0 0x7fd13c0b68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:09.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.876+0000 7fd1427ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13c0c90c0 con 0x7fd13c0d1140 2023-07-14T15:58:09.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.876+0000 7fd1427ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13c0c9550 con 0x7fd13c15fee0 2023-07-14T15:58:09.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.876+0000 7fd1427ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd13c0c84b0 con 0x7fd13c1603b0 2023-07-14T15:58:09.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.877+0000 7fd13bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd13c0d1140 0x7fd13c0b0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:09.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.877+0000 7fd13bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd13c0d1140 0x7fd13c0b0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44008/0 (socket says 172.21.15.37:44008) 2023-07-14T15:58:09.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.877+0000 7fd13bfff700 1 -- 172.21.15.37:0/731474092 learned_addr learned my addr 172.21.15.37:0/731474092 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:09.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.877+0000 7fd13b7fe700 1 --2- 172.21.15.37:0/731474092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd13c15fee0 0x7fd13c0b0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:09.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.877+0000 7fd140d9c700 1 --2- 172.21.15.37:0/731474092 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd13c1603b0 0x7fd13c0b68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:09.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.877+0000 7fd13bfff700 1 -- 172.21.15.37:0/731474092 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd13c1603b0 msgr2=0x7fd13c0b68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:09.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.877+0000 7fd13bfff700 1 --2- 172.21.15.37:0/731474092 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd13c1603b0 0x7fd13c0b68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:09.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.877+0000 7fd13bfff700 1 -- 172.21.15.37:0/731474092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd13c15fee0 msgr2=0x7fd13c0b0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:09.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.877+0000 7fd13bfff700 1 --2- 172.21.15.37:0/731474092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd13c15fee0 0x7fd13c0b0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:09.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.877+0000 7fd13bfff700 1 -- 172.21.15.37:0/731474092 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd134009b30 con 0x7fd13c0d1140 2023-07-14T15:58:09.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.877+0000 7fd13bfff700 1 --2- 172.21.15.37:0/731474092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd13c0d1140 0x7fd13c0b0a60 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fd12c00e9b0 tx=0x7fd12c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:09.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.877+0000 7fd138ff9700 1 -- 172.21.15.37:0/731474092 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c009710 con 0x7fd13c0d1140 2023-07-14T15:58:09.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.878+0000 7fd138ff9700 1 -- 172.21.15.37:0/731474092 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12c00ee50 con 0x7fd13c0d1140 2023-07-14T15:58:09.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.878+0000 7fd1427ff700 1 -- 172.21.15.37:0/731474092 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd13c0c8790 con 0x7fd13c0d1140 2023-07-14T15:58:09.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.878+0000 7fd138ff9700 1 -- 172.21.15.37:0/731474092 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c00ca50 con 0x7fd13c0d1140 2023-07-14T15:58:09.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.878+0000 7fd1427ff700 1 -- 172.21.15.37:0/731474092 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd13c0c8d50 con 0x7fd13c0d1140 2023-07-14T15:58:09.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.879+0000 7fd1427ff700 1 -- 172.21.15.37:0/731474092 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd13c067840 con 0x7fd13c0d1140 2023-07-14T15:58:09.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.880+0000 7fd138ff9700 1 -- 172.21.15.37:0/731474092 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7fd12c00cbb0 con 0x7fd13c0d1140 2023-07-14T15:58:09.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.881+0000 7fd138ff9700 1 --2- 172.21.15.37:0/731474092 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd12806ad70 0x7fd12806d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:09.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.881+0000 7fd138ff9700 1 -- 172.21.15.37:0/731474092 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd12c089500 con 0x7fd13c0d1140 2023-07-14T15:58:09.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.881+0000 7fd13b7fe700 1 --2- 172.21.15.37:0/731474092 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd12806ad70 0x7fd12806d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:09.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.882+0000 7fd13b7fe700 1 --2- 172.21.15.37:0/731474092 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd12806ad70 0x7fd12806d220 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd13c0b5e60 tx=0x7fd130007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:09.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:09.885+0000 7fd138ff9700 1 -- 172.21.15.37:0/731474092 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd12c057fe0 con 0x7fd13c0d1140 2023-07-14T15:58:10.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.144+0000 7fd1427ff700 1 -- 172.21.15.37:0/731474092 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd13c0d2200 con 0x7fd13c0d1140 2023-07-14T15:58:10.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.751+0000 7fd138ff9700 1 -- 172.21.15.37:0/731474092 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v24) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd12c00ce60 con 0x7fd13c0d1140 2023-07-14T15:58:10.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.754+0000 7fd1427ff700 1 -- 172.21.15.37:0/731474092 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd12806ad70 msgr2=0x7fd12806d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:10.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.754+0000 7fd1427ff700 1 --2- 172.21.15.37:0/731474092 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd12806ad70 0x7fd12806d220 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd13c0b5e60 tx=0x7fd130007de0 comp rx=0 tx=0).stop 2023-07-14T15:58:10.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.754+0000 7fd1427ff700 1 -- 172.21.15.37:0/731474092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd13c0d1140 msgr2=0x7fd13c0b0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:10.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.754+0000 7fd1427ff700 1 --2- 172.21.15.37:0/731474092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd13c0d1140 0x7fd13c0b0a60 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fd12c00e9b0 tx=0x7fd12c00ecc0 comp rx=0 tx=0).stop 2023-07-14T15:58:10.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.754+0000 7fd1427ff700 1 -- 172.21.15.37:0/731474092 shutdown_connections 2023-07-14T15:58:10.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.754+0000 7fd1427ff700 1 --2- 172.21.15.37:0/731474092 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd12806ad70 0x7fd12806d220 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:10.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.754+0000 7fd1427ff700 1 --2- 172.21.15.37:0/731474092 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd13c1603b0 0x7fd13c0b68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:10.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.754+0000 7fd1427ff700 1 --2- 172.21.15.37:0/731474092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd13c0d1140 0x7fd13c0b0a60 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:10.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.754+0000 7fd1427ff700 1 --2- 172.21.15.37:0/731474092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd13c15fee0 0x7fd13c0b0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:10.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.755+0000 7fd1427ff700 1 -- 172.21.15.37:0/731474092 >> 172.21.15.37:0/731474092 conn(0x7fd13c09c1b0 msgr2=0x7fd13c15de40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:10.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.755+0000 7fd1427ff700 1 -- 172.21.15.37:0/731474092 shutdown_connections 2023-07-14T15:58:10.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.755+0000 7fd1427ff700 1 -- 172.21.15.37:0/731474092 wait complete. 2023-07-14T15:58:10.759 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-14T15:58:10.760 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-14T15:58:10.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.983+0000 7fc2c59ff700 1 Processor -- start 2023-07-14T15:58:10.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.983+0000 7fc2c59ff700 1 -- start start 2023-07-14T15:58:10.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.984+0000 7fc2c59ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc2c00ce990 0x7fc2c00cce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:10.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.984+0000 7fc2c59ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fc2c00ad8c0 0x7fc2c00add60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:10.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.984+0000 7fc2c59ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2c006fb80 con 0x7fc2c00c9a70 2023-07-14T15:58:10.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.984+0000 7fc2c59ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2c00cfd60 con 0x7fc2c00ad8c0 2023-07-14T15:58:10.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.984+0000 7fc2c59ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c00ae2a0 con 0x7fc2c00ce990 2023-07-14T15:58:10.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.985+0000 7fc2beffd700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc2c00ce990 0x7fc2c00cce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:10.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.985+0000 7fc2bf7fe700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fc2c00ad8c0 0x7fc2c00add60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:10.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.985+0000 7fc2be7fc700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fc2c00c9a70 0x7fc2c00cf650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.37:34730/0 (socket says 172.21.15.37:34730) 2023-07-14T15:58:10.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.985+0000 7fc2be7fc700 1 -- 172.21.15.37:0/1129214498 learned_addr learned my addr 172.21.15.37:0/1129214498 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:58:10.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.985+0000 7fc2bdffb700 1 -- 172.21.15.37:0/1129214498 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 278940101 0 0) 0x7fc2c006fb80 con 0x7fc2c00c9a70 2023-07-14T15:58:10.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.986+0000 7fc2bf7fe700 1 -- 172.21.15.37:0/1129214498 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc2c00ce990 msgr2=0x7fc2c00cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:10.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.986+0000 7fc2bf7fe700 1 --2- 172.21.15.37:0/1129214498 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc2c00ce990 0x7fc2c00cce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:10.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.986+0000 7fc2bf7fe700 1 -- 172.21.15.37:0/1129214498 >> v1:172.21.15.98:6789/0 conn(0x7fc2c00c9a70 legacy=0x7fc2c00cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:10.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.986+0000 7fc2bf7fe700 1 -- 172.21.15.37:0/1129214498 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c0070700 con 0x7fc2c00ad8c0 2023-07-14T15:58:10.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.986+0000 7fc2beffd700 1 --2- 172.21.15.37:0/1129214498 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc2c00ce990 0x7fc2c00cce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:58:10.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.986+0000 7fc2bf7fe700 1 --2- 172.21.15.37:0/1129214498 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc2c00ad8c0 0x7fc2c00add60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8009d90 tx=0x7fc2b800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa92f3d7a145d79a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:10.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.986+0000 7fc2bdffb700 1 -- 172.21.15.37:0/1129214498 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b800e070 con 0x7fc2c00ad8c0 2023-07-14T15:58:10.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.986+0000 7fc2bdffb700 1 -- 172.21.15.37:0/1129214498 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b800bb20 con 0x7fc2c00ad8c0 2023-07-14T15:58:10.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.986+0000 7fc2bdffb700 1 -- 172.21.15.37:0/1129214498 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b8012430 con 0x7fc2c00ad8c0 2023-07-14T15:58:10.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.987+0000 7fc2c59ff700 1 -- 172.21.15.37:0/1129214498 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc2c00ad8c0 msgr2=0x7fc2c00add60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:10.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.987+0000 7fc2c59ff700 1 --2- 172.21.15.37:0/1129214498 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc2c00ad8c0 0x7fc2c00add60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8009d90 tx=0x7fc2b800b330 comp rx=0 tx=0).stop 2023-07-14T15:58:10.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.987+0000 7fc2c59ff700 1 -- 172.21.15.37:0/1129214498 shutdown_connections 2023-07-14T15:58:10.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.987+0000 7fc2c59ff700 1 --2- 172.21.15.37:0/1129214498 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc2c00ad8c0 0x7fc2c00add60 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:10.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.987+0000 7fc2c59ff700 1 --2- 172.21.15.37:0/1129214498 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc2c00ce990 0x7fc2c00cce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:10.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.987+0000 7fc2c59ff700 1 -- 172.21.15.37:0/1129214498 >> 172.21.15.37:0/1129214498 conn(0x7fc2c00b1760 msgr2=0x7fc2c00cef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:10.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.987+0000 7fc2c59ff700 1 -- 172.21.15.37:0/1129214498 shutdown_connections 2023-07-14T15:58:10.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.987+0000 7fc2c59ff700 1 -- 172.21.15.37:0/1129214498 wait complete. 2023-07-14T15:58:10.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.989+0000 7fc2c59ff700 1 Processor -- start 2023-07-14T15:58:10.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.989+0000 7fc2c59ff700 1 -- start start 2023-07-14T15:58:10.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.990+0000 7fc2c59ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2c00ad8c0 0x7fc2c015a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:10.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.990+0000 7fc2c59ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc2c00c9a70 0x7fc2c015a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:10.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.990+0000 7fc2c59ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc2c00ce990 0x7fc2c00c54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:10.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.990+0000 7fc2c59ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c015ee90 con 0x7fc2c00ad8c0 2023-07-14T15:58:10.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.990+0000 7fc2c59ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c015f150 con 0x7fc2c00ce990 2023-07-14T15:58:10.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.990+0000 7fc2c59ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c015b0e0 con 0x7fc2c00c9a70 2023-07-14T15:58:10.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.990+0000 7fc2beffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2c00ad8c0 0x7fc2c015a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:10.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.990+0000 7fc2beffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2c00ad8c0 0x7fc2c015a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49466/0 (socket says 172.21.15.37:49466) 2023-07-14T15:58:10.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.990+0000 7fc2beffd700 1 -- 172.21.15.37:0/69878014 learned_addr learned my addr 172.21.15.37:0/69878014 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:10.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.990+0000 7fc2bf7fe700 1 --2- 172.21.15.37:0/69878014 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc2c00ce990 0x7fc2c00c54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:10.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.990+0000 7fc2be7fc700 1 --2- 172.21.15.37:0/69878014 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc2c00c9a70 0x7fc2c015a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:10.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.990+0000 7fc2beffd700 1 -- 172.21.15.37:0/69878014 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc2c00c9a70 msgr2=0x7fc2c015a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:10.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.990+0000 7fc2beffd700 1 --2- 172.21.15.37:0/69878014 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc2c00c9a70 0x7fc2c015a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:10.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.990+0000 7fc2beffd700 1 -- 172.21.15.37:0/69878014 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc2c00ce990 msgr2=0x7fc2c00c54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:10.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.990+0000 7fc2beffd700 1 --2- 172.21.15.37:0/69878014 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc2c00ce990 0x7fc2c00c54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:10.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.990+0000 7fc2beffd700 1 -- 172.21.15.37:0/69878014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b00094a0 con 0x7fc2c00ad8c0 2023-07-14T15:58:10.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.991+0000 7fc2beffd700 1 --2- 172.21.15.37:0/69878014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2c00ad8c0 0x7fc2c015a840 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fc2b000ec10 tx=0x7fc2b000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:10.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.991+0000 7fc2a7fff700 1 -- 172.21.15.37:0/69878014 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b0009760 con 0x7fc2c00ad8c0 2023-07-14T15:58:10.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.991+0000 7fc2a7fff700 1 -- 172.21.15.37:0/69878014 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b000c850 con 0x7fc2c00ad8c0 2023-07-14T15:58:10.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.991+0000 7fc2a7fff700 1 -- 172.21.15.37:0/69878014 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b000cbe0 con 0x7fc2c00ad8c0 2023-07-14T15:58:10.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.991+0000 7fc2c59ff700 1 -- 172.21.15.37:0/69878014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2b8009a70 con 0x7fc2c00ad8c0 2023-07-14T15:58:10.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.991+0000 7fc2c59ff700 1 -- 172.21.15.37:0/69878014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2c015d3d0 con 0x7fc2c00ad8c0 2023-07-14T15:58:10.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.992+0000 7fc2c59ff700 1 -- 172.21.15.37:0/69878014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2c015f430 con 0x7fc2c00ad8c0 2023-07-14T15:58:10.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.993+0000 7fc2a7fff700 1 -- 172.21.15.37:0/69878014 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7fc2b000cd40 con 0x7fc2c00ad8c0 2023-07-14T15:58:10.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.994+0000 7fc2a7fff700 1 --2- 172.21.15.37:0/69878014 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc2ac06ad70 0x7fc2ac06d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:10.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.995+0000 7fc2a7fff700 1 -- 172.21.15.37:0/69878014 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc2b0089830 con 0x7fc2c00ad8c0 2023-07-14T15:58:10.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.995+0000 7fc2be7fc700 1 --2- 172.21.15.37:0/69878014 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc2ac06ad70 0x7fc2ac06d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:10.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.996+0000 7fc2be7fc700 1 --2- 172.21.15.37:0/69878014 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc2ac06ad70 0x7fc2ac06d220 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc2c00c4d60 tx=0x7fc2b4007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:10.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:10.999+0000 7fc2a7fff700 1 -- 172.21.15.37:0/69878014 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc2b0054880 con 0x7fc2c00ad8c0 2023-07-14T15:58:11.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.254+0000 7fc2c59ff700 1 -- 172.21.15.37:0/69878014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc2c0067840 con 0x7fc2c00ad8c0 2023-07-14T15:58:11.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.759+0000 7fc2a7fff700 1 -- 172.21.15.37:0/69878014 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v25) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc2b0057ea0 con 0x7fc2c00ad8c0 2023-07-14T15:58:11.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.762+0000 7fc2c59ff700 1 -- 172.21.15.37:0/69878014 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc2ac06ad70 msgr2=0x7fc2ac06d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:11.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.762+0000 7fc2c59ff700 1 --2- 172.21.15.37:0/69878014 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc2ac06ad70 0x7fc2ac06d220 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc2c00c4d60 tx=0x7fc2b4007de0 comp rx=0 tx=0).stop 2023-07-14T15:58:11.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.762+0000 7fc2c59ff700 1 -- 172.21.15.37:0/69878014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2c00ad8c0 msgr2=0x7fc2c015a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:11.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.762+0000 7fc2c59ff700 1 --2- 172.21.15.37:0/69878014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2c00ad8c0 0x7fc2c015a840 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fc2b000ec10 tx=0x7fc2b000ef20 comp rx=0 tx=0).stop 2023-07-14T15:58:11.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.762+0000 7fc2c59ff700 1 -- 172.21.15.37:0/69878014 shutdown_connections 2023-07-14T15:58:11.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.762+0000 7fc2c59ff700 1 --2- 172.21.15.37:0/69878014 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc2c00ce990 0x7fc2c00c54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:11.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.762+0000 7fc2c59ff700 1 --2- 172.21.15.37:0/69878014 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc2ac06ad70 0x7fc2ac06d220 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:11.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.762+0000 7fc2c59ff700 1 --2- 172.21.15.37:0/69878014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2c00ad8c0 0x7fc2c015a840 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:11.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.762+0000 7fc2c59ff700 1 --2- 172.21.15.37:0/69878014 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc2c00c9a70 0x7fc2c015a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:11.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.762+0000 7fc2c59ff700 1 -- 172.21.15.37:0/69878014 >> 172.21.15.37:0/69878014 conn(0x7fc2c00b1760 msgr2=0x7fc2c00c9250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:11.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.762+0000 7fc2c59ff700 1 -- 172.21.15.37:0/69878014 shutdown_connections 2023-07-14T15:58:11.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.763+0000 7fc2c59ff700 1 -- 172.21.15.37:0/69878014 wait complete. 2023-07-14T15:58:11.767 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-14T15:58:11.767 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T15:58:11.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.988+0000 7fe698dff700 1 Processor -- start 2023-07-14T15:58:11.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.988+0000 7fe698dff700 1 -- start start 2023-07-14T15:58:11.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.989+0000 7fe698dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe6940cffc0 0x7fe6940b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:11.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.989+0000 7fe698dff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe694160c50 0x7fe6940cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:11.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.989+0000 7fe698dff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6940cf6f0 con 0x7fe6940b8b80 2023-07-14T15:58:11.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.989+0000 7fe698dff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6940d0de0 con 0x7fe694160c50 2023-07-14T15:58:11.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.989+0000 7fe698dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6941610f0 con 0x7fe6940cffc0 2023-07-14T15:58:11.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.990+0000 7fe692d9d700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe694160c50 0x7fe6940cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:11.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.990+0000 7fe68bfff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe6940cffc0 0x7fe6940b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:11.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.990+0000 7fe68bfff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe6940cffc0 0x7fe6940b5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3301/0 says I am v2:172.21.15.37:50644/0 (socket says 172.21.15.37:50644) 2023-07-14T15:58:11.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.990+0000 7fe68bfff700 1 -- 172.21.15.37:0/205834635 learned_addr learned my addr 172.21.15.37:0/205834635 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:11.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.990+0000 7fe69259c700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7fe6940b8b80 0x7fe6940cf8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.37:34736/0 (socket says 172.21.15.37:34736) 2023-07-14T15:58:11.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.990+0000 7fe692d9d700 1 -- 172.21.15.37:0/205834635 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe6940cffc0 msgr2=0x7fe6940b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:11.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.990+0000 7fe692d9d700 1 --2- 172.21.15.37:0/205834635 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe6940cffc0 0x7fe6940b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:11.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.990+0000 7fe692d9d700 1 -- 172.21.15.37:0/205834635 >> v1:172.21.15.98:6789/0 conn(0x7fe6940b8b80 legacy=0x7fe6940cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:11.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.990+0000 7fe692d9d700 1 -- 172.21.15.37:0/205834635 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6940cd590 con 0x7fe694160c50 2023-07-14T15:58:11.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.991+0000 7fe692d9d700 1 --2- 172.21.15.37:0/205834635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe694160c50 0x7fe6940cf1b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe68c009d90 tx=0x7fe68c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6f993b71abf275e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:11.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.991+0000 7fe691d9b700 1 -- 172.21.15.37:0/205834635 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68c00e070 con 0x7fe694160c50 2023-07-14T15:58:11.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.991+0000 7fe691d9b700 1 -- 172.21.15.37:0/205834635 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe68c00bb20 con 0x7fe694160c50 2023-07-14T15:58:11.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.991+0000 7fe691d9b700 1 -- 172.21.15.37:0/205834635 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68c012430 con 0x7fe694160c50 2023-07-14T15:58:11.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.992+0000 7fe698dff700 1 -- 172.21.15.37:0/205834635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe694160c50 msgr2=0x7fe6940cf1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:11.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.992+0000 7fe698dff700 1 --2- 172.21.15.37:0/205834635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe694160c50 0x7fe6940cf1b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe68c009d90 tx=0x7fe68c00b330 comp rx=0 tx=0).stop 2023-07-14T15:58:11.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.992+0000 7fe698dff700 1 -- 172.21.15.37:0/205834635 shutdown_connections 2023-07-14T15:58:11.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.992+0000 7fe698dff700 1 --2- 172.21.15.37:0/205834635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe694160c50 0x7fe6940cf1b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:11.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.992+0000 7fe698dff700 1 --2- 172.21.15.37:0/205834635 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe6940cffc0 0x7fe6940b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:11.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.992+0000 7fe698dff700 1 -- 172.21.15.37:0/205834635 >> 172.21.15.37:0/205834635 conn(0x7fe69406b150 msgr2=0x7fe69406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:11.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.992+0000 7fe698dff700 1 -- 172.21.15.37:0/205834635 shutdown_connections 2023-07-14T15:58:11.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.992+0000 7fe698dff700 1 -- 172.21.15.37:0/205834635 wait complete. 2023-07-14T15:58:11.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.993+0000 7fe698dff700 1 Processor -- start 2023-07-14T15:58:11.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.994+0000 7fe698dff700 1 -- start start 2023-07-14T15:58:11.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.995+0000 7fe698dff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe6940b8b80 0x7fe694151300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:11.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.995+0000 7fe698dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe6940cffc0 0x7fe6940c91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:11.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.995+0000 7fe698dff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe694160c50 0x7fe6940c9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:11.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.995+0000 7fe698dff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6940c7d10 con 0x7fe694160c50 2023-07-14T15:58:11.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.995+0000 7fe698dff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6940c7ff0 con 0x7fe6940b8b80 2023-07-14T15:58:11.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.995+0000 7fe698dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6940c82d0 con 0x7fe6940cffc0 2023-07-14T15:58:11.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.995+0000 7fe692d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe694160c50 0x7fe6940c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:11.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.995+0000 7fe692d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe694160c50 0x7fe6940c9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49474/0 (socket says 172.21.15.37:49474) 2023-07-14T15:58:11.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.995+0000 7fe692d9d700 1 -- 172.21.15.37:0/2500616148 learned_addr learned my addr 172.21.15.37:0/2500616148 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:11.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.995+0000 7fe68bfff700 1 --2- 172.21.15.37:0/2500616148 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe6940cffc0 0x7fe6940c91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:11.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.995+0000 7fe69259c700 1 --2- 172.21.15.37:0/2500616148 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe6940b8b80 0x7fe694151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:11.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.995+0000 7fe692d9d700 1 -- 172.21.15.37:0/2500616148 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe6940cffc0 msgr2=0x7fe6940c91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:11.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.995+0000 7fe692d9d700 1 --2- 172.21.15.37:0/2500616148 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe6940cffc0 0x7fe6940c91e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:11.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.995+0000 7fe692d9d700 1 -- 172.21.15.37:0/2500616148 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe6940b8b80 msgr2=0x7fe694151300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:11.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.995+0000 7fe692d9d700 1 --2- 172.21.15.37:0/2500616148 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe6940b8b80 0x7fe694151300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:11.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.995+0000 7fe692d9d700 1 -- 172.21.15.37:0/2500616148 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe68c009a70 con 0x7fe694160c50 2023-07-14T15:58:11.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.996+0000 7fe692d9d700 1 --2- 172.21.15.37:0/2500616148 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe694160c50 0x7fe6940c9720 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fe68c014040 tx=0x7fe68c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:11.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.996+0000 7fe68affd700 1 -- 172.21.15.37:0/2500616148 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68c012430 con 0x7fe694160c50 2023-07-14T15:58:11.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.996+0000 7fe68affd700 1 -- 172.21.15.37:0/2500616148 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe68c020070 con 0x7fe694160c50 2023-07-14T15:58:11.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.996+0000 7fe68affd700 1 -- 172.21.15.37:0/2500616148 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68c003ea0 con 0x7fe694160c50 2023-07-14T15:58:11.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.996+0000 7fe698dff700 1 -- 172.21.15.37:0/2500616148 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6940c85b0 con 0x7fe694160c50 2023-07-14T15:58:11.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.996+0000 7fe698dff700 1 -- 172.21.15.37:0/2500616148 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6940c7a20 con 0x7fe694160c50 2023-07-14T15:58:11.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.997+0000 7fe698dff700 1 -- 172.21.15.37:0/2500616148 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6940c8ad0 con 0x7fe694160c50 2023-07-14T15:58:11.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.998+0000 7fe68affd700 1 -- 172.21.15.37:0/2500616148 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7fe68c004280 con 0x7fe694160c50 2023-07-14T15:58:11.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.999+0000 7fe68affd700 1 --2- 172.21.15.37:0/2500616148 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe67406ad70 0x7fe67406d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:11.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.999+0000 7fe68affd700 1 -- 172.21.15.37:0/2500616148 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe68c022070 con 0x7fe694160c50 2023-07-14T15:58:11.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:11.999+0000 7fe69259c700 1 --2- 172.21.15.37:0/2500616148 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe67406ad70 0x7fe67406d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:11.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.000+0000 7fe69259c700 1 --2- 172.21.15.37:0/2500616148 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe67406ad70 0x7fe67406d220 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe684000f60 tx=0x7fe684007d10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:11.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.003+0000 7fe68affd700 1 -- 172.21.15.37:0/2500616148 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe6940c8ad0 con 0x7fe694160c50 2023-07-14T15:58:12.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.255+0000 7fe698dff700 1 -- 172.21.15.37:0/2500616148 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6940c8ad0 con 0x7fe694160c50 2023-07-14T15:58:12.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.256+0000 7fe68affd700 1 -- 172.21.15.37:0/2500616148 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4709 (secure 0 0 0) 0x7fe6940c8ad0 con 0x7fe694160c50 2023-07-14T15:58:12.242 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:58:12.242 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5132,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/1552421235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":1552421235},{"type":"v1","addr":"172.21.15.98:6837","nonce":1552421235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5135,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/4269801846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4269801846},{"type":"v1","addr":"172.21.15.37:6833","nonce":4269801846}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5470,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/3115632546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":3115632546},{"type":"v1","addr":"172.21.15.98:6835","nonce":3115632546}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T15:58:08.228046+0000","modified":"2023-07-14T15:58:11.751169+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5652":{"gid":5652,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/4236968434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":4236968434},{"type":"v1","addr":"172.21.15.37:6835","nonce":4236968434}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-14T15:58:12.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.258+0000 7fe698dff700 1 -- 172.21.15.37:0/2500616148 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe67406ad70 msgr2=0x7fe67406d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:12.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.258+0000 7fe698dff700 1 --2- 172.21.15.37:0/2500616148 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe67406ad70 0x7fe67406d220 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe684000f60 tx=0x7fe684007d10 comp rx=0 tx=0).stop 2023-07-14T15:58:12.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.258+0000 7fe698dff700 1 -- 172.21.15.37:0/2500616148 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe694160c50 msgr2=0x7fe6940c9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:12.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.258+0000 7fe698dff700 1 --2- 172.21.15.37:0/2500616148 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe694160c50 0x7fe6940c9720 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fe68c014040 tx=0x7fe68c004ad0 comp rx=0 tx=0).stop 2023-07-14T15:58:12.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.258+0000 7fe698dff700 1 -- 172.21.15.37:0/2500616148 shutdown_connections 2023-07-14T15:58:12.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.258+0000 7fe698dff700 1 --2- 172.21.15.37:0/2500616148 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe6940b8b80 0x7fe694151300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:12.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.258+0000 7fe698dff700 1 --2- 172.21.15.37:0/2500616148 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe67406ad70 0x7fe67406d220 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:12.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.258+0000 7fe698dff700 1 --2- 172.21.15.37:0/2500616148 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe694160c50 0x7fe6940c9720 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:12.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.258+0000 7fe698dff700 1 --2- 172.21.15.37:0/2500616148 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe6940cffc0 0x7fe6940c91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:12.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.258+0000 7fe698dff700 1 -- 172.21.15.37:0/2500616148 >> 172.21.15.37:0/2500616148 conn(0x7fe69406b150 msgr2=0x7fe69415cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:12.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.258+0000 7fe698dff700 1 -- 172.21.15.37:0/2500616148 shutdown_connections 2023-07-14T15:58:12.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.259+0000 7fe698dff700 1 -- 172.21.15.37:0/2500616148 wait complete. 2023-07-14T15:58:12.248 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 25 2023-07-14T15:58:12.261 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T15:58:12.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.478+0000 7f4bb23ff700 1 Processor -- start 2023-07-14T15:58:12.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.478+0000 7f4bb23ff700 1 -- start start 2023-07-14T15:58:12.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.479+0000 7f4bb23ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4bac15a440 0x7f4bac0cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:12.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.479+0000 7f4bb23ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4bac15a810 0x7f4bac0ce230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:12.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.479+0000 7f4bb23ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bac0b0650 con 0x7f4bac0afae0 2023-07-14T15:58:12.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.479+0000 7f4bb23ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bac0cb5e0 con 0x7f4bac15a440 2023-07-14T15:58:12.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.479+0000 7f4bb23ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac0cb880 con 0x7f4bac15a810 2023-07-14T15:58:12.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.480+0000 7f4babfff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4bac15a440 0x7f4bac0cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:12.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.480+0000 7f4babfff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4bac15a440 0x7f4bac0cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49478/0 (socket says 172.21.15.37:49478) 2023-07-14T15:58:12.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.480+0000 7f4babfff700 1 -- 172.21.15.37:0/2139927850 learned_addr learned my addr 172.21.15.37:0/2139927850 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:12.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.480+0000 7f4bab7fe700 1 --2- 172.21.15.37:0/2139927850 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4bac15a810 0x7f4bac0ce230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:12.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.480+0000 7f4babfff700 1 -- 172.21.15.37:0/2139927850 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4bac15a810 msgr2=0x7f4bac0ce230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:12.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.480+0000 7f4babfff700 1 --2- 172.21.15.37:0/2139927850 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4bac15a810 0x7f4bac0ce230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:12.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.480+0000 7f4babfff700 1 -- 172.21.15.37:0/2139927850 >> v1:172.21.15.98:6789/0 conn(0x7f4bac0afae0 legacy=0x7f4bac0aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:12.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.480+0000 7f4babfff700 1 -- 172.21.15.37:0/2139927850 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bac0cbb60 con 0x7f4bac15a440 2023-07-14T15:58:12.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.480+0000 7f4babfff700 1 --2- 172.21.15.37:0/2139927850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bac15a440 0x7f4bac0cdcf0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c0098f0 tx=0x7f4b9c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1e7e98e999138f6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:12.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.481+0000 7f4baaffd700 1 -- 172.21.15.37:0/2139927850 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c00b8a0 con 0x7f4bac15a440 2023-07-14T15:58:12.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.481+0000 7f4baaffd700 1 -- 172.21.15.37:0/2139927850 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9c00ba00 con 0x7f4bac15a440 2023-07-14T15:58:12.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.481+0000 7f4baaffd700 1 -- 172.21.15.37:0/2139927850 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c00bd90 con 0x7f4bac15a440 2023-07-14T15:58:12.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.481+0000 7f4bb23ff700 1 -- 172.21.15.37:0/2139927850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bac15a440 msgr2=0x7f4bac0cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:12.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.481+0000 7f4bb23ff700 1 --2- 172.21.15.37:0/2139927850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bac15a440 0x7f4bac0cdcf0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c0098f0 tx=0x7f4b9c009c00 comp rx=0 tx=0).stop 2023-07-14T15:58:12.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.481+0000 7f4bb23ff700 1 -- 172.21.15.37:0/2139927850 shutdown_connections 2023-07-14T15:58:12.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.481+0000 7f4bb23ff700 1 --2- 172.21.15.37:0/2139927850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bac15a440 0x7f4bac0cdcf0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:12.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.481+0000 7f4bb23ff700 1 --2- 172.21.15.37:0/2139927850 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4bac15a810 0x7f4bac0ce230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:12.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.481+0000 7f4bb23ff700 1 -- 172.21.15.37:0/2139927850 >> 172.21.15.37:0/2139927850 conn(0x7f4bac0b08c0 msgr2=0x7f4bac0b0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:12.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.481+0000 7f4bb23ff700 1 -- 172.21.15.37:0/2139927850 shutdown_connections 2023-07-14T15:58:12.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.481+0000 7f4bb23ff700 1 -- 172.21.15.37:0/2139927850 wait complete. 2023-07-14T15:58:12.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.484+0000 7f4bb23ff700 1 Processor -- start 2023-07-14T15:58:12.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.484+0000 7f4bb23ff700 1 -- start start 2023-07-14T15:58:12.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.485+0000 7f4bb23ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bac0afae0 0x7f4bac1498a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:12.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.485+0000 7f4bb23ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4bac15a440 0x7f4bac15ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:12.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.485+0000 7f4bb23ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4bac15a810 0x7f4bac14e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:12.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.485+0000 7f4bb23ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac15ae60 con 0x7f4bac0afae0 2023-07-14T15:58:12.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.485+0000 7f4bb23ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac15cfd0 con 0x7f4bac15a440 2023-07-14T15:58:12.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.485+0000 7f4bb23ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac1f3aa0 con 0x7f4bac15a810 2023-07-14T15:58:12.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.485+0000 7f4babfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bac0afae0 0x7f4bac1498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:12.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.485+0000 7f4babfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bac0afae0 0x7f4bac1498a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49484/0 (socket says 172.21.15.37:49484) 2023-07-14T15:58:12.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.485+0000 7f4babfff700 1 -- 172.21.15.37:0/2757664252 learned_addr learned my addr 172.21.15.37:0/2757664252 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:12.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.486+0000 7f4bab7fe700 1 --2- 172.21.15.37:0/2757664252 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4bac15a440 0x7f4bac15ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:12.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.486+0000 7f4bb099c700 1 --2- 172.21.15.37:0/2757664252 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4bac15a810 0x7f4bac14e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:12.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.486+0000 7f4babfff700 1 -- 172.21.15.37:0/2757664252 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4bac15a810 msgr2=0x7f4bac14e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:12.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.486+0000 7f4babfff700 1 --2- 172.21.15.37:0/2757664252 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4bac15a810 0x7f4bac14e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:12.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.486+0000 7f4babfff700 1 -- 172.21.15.37:0/2757664252 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4bac15a440 msgr2=0x7f4bac15ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:12.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.486+0000 7f4babfff700 1 --2- 172.21.15.37:0/2757664252 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4bac15a440 0x7f4bac15ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:12.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.486+0000 7f4babfff700 1 -- 172.21.15.37:0/2757664252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b9c009550 con 0x7f4bac0afae0 2023-07-14T15:58:12.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.486+0000 7f4babfff700 1 --2- 172.21.15.37:0/2757664252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bac0afae0 0x7f4bac1498a0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c000c00 tx=0x7f4b9c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:12.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.486+0000 7f4ba8ff9700 1 -- 172.21.15.37:0/2757664252 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c004300 con 0x7f4bac0afae0 2023-07-14T15:58:12.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.486+0000 7f4ba8ff9700 1 -- 172.21.15.37:0/2757664252 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9c01f070 con 0x7f4bac0afae0 2023-07-14T15:58:12.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.486+0000 7f4ba8ff9700 1 -- 172.21.15.37:0/2757664252 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c0036a0 con 0x7f4bac0afae0 2023-07-14T15:58:12.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.486+0000 7f4bb23ff700 1 -- 172.21.15.37:0/2757664252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bac1f3d80 con 0x7f4bac0afae0 2023-07-14T15:58:12.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.487+0000 7f4bb23ff700 1 -- 172.21.15.37:0/2757664252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bac15c6b0 con 0x7f4bac0afae0 2023-07-14T15:58:12.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.488+0000 7f4bb23ff700 1 -- 172.21.15.37:0/2757664252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bac15afa0 con 0x7f4bac0afae0 2023-07-14T15:58:12.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.489+0000 7f4ba8ff9700 1 -- 172.21.15.37:0/2757664252 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f4b9c021030 con 0x7f4bac0afae0 2023-07-14T15:58:12.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.489+0000 7f4ba8ff9700 1 --2- 172.21.15.37:0/2757664252 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4b9806ad70 0x7f4b9806d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:12.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.490+0000 7f4ba8ff9700 1 -- 172.21.15.37:0/2757664252 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4b9c08a870 con 0x7f4bac0afae0 2023-07-14T15:58:12.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.490+0000 7f4bab7fe700 1 --2- 172.21.15.37:0/2757664252 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4b9806ad70 0x7f4b9806d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:12.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.491+0000 7f4bab7fe700 1 --2- 172.21.15.37:0/2757664252 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4b9806ad70 0x7f4b9806d220 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4bac156b70 tx=0x7f4ba0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:12.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.494+0000 7f4ba8ff9700 1 -- 172.21.15.37:0/2757664252 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4b9c055840 con 0x7f4bac0afae0 2023-07-14T15:58:12.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.702+0000 7f4bb23ff700 1 -- 172.21.15.37:0/2757664252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4bac0aff40 con 0x7f4bac0afae0 2023-07-14T15:58:12.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.703+0000 7f4ba8ff9700 1 -- 172.21.15.37:0/2757664252 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+18281 (secure 0 0 0) 0x7f4b9c058e60 con 0x7f4bac0afae0 2023-07-14T15:58:12.687 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:58:12.687 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":49,"fsid":"9da30401-a779-4e46-aba6-00c2494c6c67","created":"2023-07-14T15:55:39.898867+0000","modified":"2023-07-14T15:58:09.712394+0000","last_up_change":"2023-07-14T15:55:53.025696+0000","last_in_change":"2023-07-14T15:55:43.388192+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T15:55:52.907261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T15:55:59.992839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-14T15:58:05.947379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-14T15:58:07.213413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d049535-7b87-4276-8fe5-0f74ba422d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6801","nonce":2783032392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6803","nonce":2783032392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6807","nonce":2783032392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6805","nonce":2783032392}]},"public_addr":"172.21.15.37:6801/2783032392","cluster_addr":"172.21.15.37:6803/2783032392","heartbeat_back_addr":"172.21.15.37:6807/2783032392","heartbeat_front_addr":"172.21.15.37:6805/2783032392","state":["exists","up"]},{"osd":1,"uuid":"79ec948d-ead2-4c2d-923a-dd6eeaac9dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6823","nonce":1190059746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6826","nonce":1190059746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6831","nonce":1190059746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6829","nonce":1190059746}]},"public_addr":"172.21.15.37:6823/1190059746","cluster_addr":"172.21.15.37:6826/1190059746","heartbeat_back_addr":"172.21.15.37:6831/1190059746","heartbeat_front_addr":"172.21.15.37:6829/1190059746","state":["exists","up"]},{"osd":2,"uuid":"a1db6690-c160-4366-9c82-2cca17e4bba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6809","nonce":2266223499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6813","nonce":2266223499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6820","nonce":2266223499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6816","nonce":2266223499}]},"public_addr":"172.21.15.37:6809/2266223499","cluster_addr":"172.21.15.37:6813/2266223499","heartbeat_back_addr":"172.21.15.37:6820/2266223499","heartbeat_front_addr":"172.21.15.37:6816/2266223499","state":["exists","up"]},{"osd":3,"uuid":"767b8220-e79a-4a86-a162-6b3b73198379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6812","nonce":4166694594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6817","nonce":4166694594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6828","nonce":4166694594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6822","nonce":4166694594}]},"public_addr":"172.21.15.37:6812/4166694594","cluster_addr":"172.21.15.37:6817/4166694594","heartbeat_back_addr":"172.21.15.37:6828/4166694594","heartbeat_front_addr":"172.21.15.37:6822/4166694594","state":["exists","up"]},{"osd":4,"uuid":"717bd773-ae7e-4236-ac79-900cf99a37c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6801","nonce":3529020407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6803","nonce":3529020407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6807","nonce":3529020407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6805","nonce":3529020407}]},"public_addr":"172.21.15.98:6801/3529020407","cluster_addr":"172.21.15.98:6803/3529020407","heartbeat_back_addr":"172.21.15.98:6807/3529020407","heartbeat_front_addr":"172.21.15.98:6805/3529020407","state":["exists","up"]},{"osd":5,"uuid":"a941d358-0f03-4136-a9b2-3a1c2e9358cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6817","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6819","nonce":2311501838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6821","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6823","nonce":2311501838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6829","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6831","nonce":2311501838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6825","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6827","nonce":2311501838}]},"public_addr":"172.21.15.98:6819/2311501838","cluster_addr":"172.21.15.98:6823/2311501838","heartbeat_back_addr":"172.21.15.98:6831/2311501838","heartbeat_front_addr":"172.21.15.98:6827/2311501838","state":["exists","up"]},{"osd":6,"uuid":"27153772-6d4b-479d-9953-0582e7b96743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6809","nonce":1144224691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6811","nonce":1144224691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6815","nonce":1144224691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6813","nonce":1144224691}]},"public_addr":"172.21.15.98:6809/1144224691","cluster_addr":"172.21.15.98:6811/1144224691","heartbeat_back_addr":"172.21.15.98:6815/1144224691","heartbeat_front_addr":"172.21.15.98:6813/1144224691","state":["exists","up"]},{"osd":7,"uuid":"d21ffc8e-40bb-47eb-af2c-e3e730d3fb76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6818","nonce":1144470927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6822","nonce":1144470927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6830","nonce":1144470927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6826","nonce":1144470927}]},"public_addr":"172.21.15.98:6818/1144470927","cluster_addr":"172.21.15.98:6822/1144470927","heartbeat_back_addr":"172.21.15.98:6830/1144470927","heartbeat_front_addr":"172.21.15.98:6826/1144470927","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.921114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.739210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.024016+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.002527+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.698127+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.813416+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.709351+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.815457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T15:58:12.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.705+0000 7f4bb23ff700 1 -- 172.21.15.37:0/2757664252 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4b9806ad70 msgr2=0x7f4b9806d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:12.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.705+0000 7f4bb23ff700 1 --2- 172.21.15.37:0/2757664252 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4b9806ad70 0x7f4b9806d220 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4bac156b70 tx=0x7f4ba0008040 comp rx=0 tx=0).stop 2023-07-14T15:58:12.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.705+0000 7f4bb23ff700 1 -- 172.21.15.37:0/2757664252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bac0afae0 msgr2=0x7f4bac1498a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:12.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.705+0000 7f4bb23ff700 1 --2- 172.21.15.37:0/2757664252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bac0afae0 0x7f4bac1498a0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c000c00 tx=0x7f4b9c004750 comp rx=0 tx=0).stop 2023-07-14T15:58:12.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.706+0000 7f4bb23ff700 1 -- 172.21.15.37:0/2757664252 shutdown_connections 2023-07-14T15:58:12.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.706+0000 7f4bb23ff700 1 --2- 172.21.15.37:0/2757664252 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4b9806ad70 0x7f4b9806d220 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:12.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.706+0000 7f4bb23ff700 1 --2- 172.21.15.37:0/2757664252 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4bac15a810 0x7f4bac14e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:12.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.706+0000 7f4bb23ff700 1 --2- 172.21.15.37:0/2757664252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bac0afae0 0x7f4bac1498a0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:12.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.706+0000 7f4bb23ff700 1 --2- 172.21.15.37:0/2757664252 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4bac15a440 0x7f4bac15ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:12.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.706+0000 7f4bb23ff700 1 -- 172.21.15.37:0/2757664252 >> 172.21.15.37:0/2757664252 conn(0x7f4bac0b08c0 msgr2=0x7f4bac150490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:12.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.706+0000 7f4bb23ff700 1 -- 172.21.15.37:0/2757664252 shutdown_connections 2023-07-14T15:58:12.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.706+0000 7f4bb23ff700 1 -- 172.21.15.37:0/2757664252 wait complete. 2023-07-14T15:58:12.709 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-14T15:58:12.709 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T15:58:12.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.927+0000 7f55be3ff700 1 Processor -- start 2023-07-14T15:58:12.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.928+0000 7f55be3ff700 1 -- start start 2023-07-14T15:58:12.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.929+0000 7f55be3ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f55b80b24e0 0x7f55b80cf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:12.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.929+0000 7f55be3ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f55b80cfbd0 0x7f55b815cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:12.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.929+0000 7f55be3ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55b80cd540 con 0x7f55b80b8650 2023-07-14T15:58:12.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.929+0000 7f55be3ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55b8160f70 con 0x7f55b80b24e0 2023-07-14T15:58:12.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.929+0000 7f55be3ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55b80cd790 con 0x7f55b80cfbd0 2023-07-14T15:58:12.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.929+0000 7f55b7fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f55b80b8650 0x7f55b80d0ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47002/0 (socket says 172.21.15.37:47002) 2023-07-14T15:58:12.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.929+0000 7f55b7fff700 1 -- 172.21.15.37:0/4026977574 learned_addr learned my addr 172.21.15.37:0/4026977574 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:58:12.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.929+0000 7f55b77fe700 1 --2- 172.21.15.37:0/4026977574 >> v2:172.21.15.37:3300/0 conn(0x7f55b80b24e0 0x7f55b80cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:12.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.929+0000 7f55bc99c700 1 --2- 172.21.15.37:0/4026977574 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f55b80cfbd0 0x7f55b815cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:12.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.929+0000 7f55b6ffd700 1 -- 172.21.15.37:0/4026977574 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3054895018 0 0) 0x7f55b80cd540 con 0x7f55b80b8650 2023-07-14T15:58:12.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.930+0000 7f55b6ffd700 1 -- 172.21.15.37:0/4026977574 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55a00035b0 con 0x7f55b80b8650 2023-07-14T15:58:12.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.930+0000 7f55b77fe700 1 -- 172.21.15.37:0/4026977574 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f55b80cfbd0 msgr2=0x7f55b815cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:12.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.930+0000 7f55b77fe700 1 --2- 172.21.15.37:0/4026977574 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f55b80cfbd0 0x7f55b815cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:12.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.930+0000 7f55b77fe700 1 -- 172.21.15.37:0/4026977574 >> v1:172.21.15.37:6789/0 conn(0x7f55b80b8650 legacy=0x7f55b80d0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:12.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.930+0000 7f55b77fe700 1 -- 172.21.15.37:0/4026977574 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b80cda70 con 0x7f55b80b24e0 2023-07-14T15:58:12.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.930+0000 7f55bc99c700 1 --2- 172.21.15.37:0/4026977574 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f55b80cfbd0 0x7f55b815cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:58:12.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.930+0000 7f55b77fe700 1 --2- 172.21.15.37:0/4026977574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55b80b24e0 0x7f55b80cf690 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f55ac009840 tx=0x7f55ac009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50bebecd72c7a953 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:12.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.930+0000 7f55b6ffd700 1 -- 172.21.15.37:0/4026977574 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ac011830 con 0x7f55b80b24e0 2023-07-14T15:58:12.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.930+0000 7f55b6ffd700 1 -- 172.21.15.37:0/4026977574 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55ac011990 con 0x7f55b80b24e0 2023-07-14T15:58:12.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.930+0000 7f55b6ffd700 1 -- 172.21.15.37:0/4026977574 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ac011d20 con 0x7f55b80b24e0 2023-07-14T15:58:12.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.931+0000 7f55be3ff700 1 -- 172.21.15.37:0/4026977574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55b80b24e0 msgr2=0x7f55b80cf690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:12.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.931+0000 7f55be3ff700 1 --2- 172.21.15.37:0/4026977574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55b80b24e0 0x7f55b80cf690 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f55ac009840 tx=0x7f55ac009b50 comp rx=0 tx=0).stop 2023-07-14T15:58:12.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.931+0000 7f55be3ff700 1 -- 172.21.15.37:0/4026977574 shutdown_connections 2023-07-14T15:58:12.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.931+0000 7f55be3ff700 1 --2- 172.21.15.37:0/4026977574 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f55b80cfbd0 0x7f55b815cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:12.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.931+0000 7f55be3ff700 1 --2- 172.21.15.37:0/4026977574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55b80b24e0 0x7f55b80cf690 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:12.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.931+0000 7f55be3ff700 1 -- 172.21.15.37:0/4026977574 >> 172.21.15.37:0/4026977574 conn(0x7f55b806c0f0 msgr2=0x7f55b806c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:12.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.931+0000 7f55be3ff700 1 -- 172.21.15.37:0/4026977574 shutdown_connections 2023-07-14T15:58:12.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.931+0000 7f55be3ff700 1 -- 172.21.15.37:0/4026977574 wait complete. 2023-07-14T15:58:12.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.933+0000 7f55be3ff700 1 Processor -- start 2023-07-14T15:58:12.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.933+0000 7f55be3ff700 1 -- start start 2023-07-14T15:58:12.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.934+0000 7f55be3ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55b80b24e0 0x7f55b81512e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:12.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.934+0000 7f55be3ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55b80b8650 0x7f55b80c9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:12.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.934+0000 7f55be3ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f55b80cfbd0 0x7f55b80c9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:12.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.934+0000 7f55be3ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b80cce80 con 0x7f55b80b24e0 2023-07-14T15:58:12.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.934+0000 7f55be3ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b80cc0c0 con 0x7f55b80b8650 2023-07-14T15:58:12.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.934+0000 7f55be3ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55b80cc3a0 con 0x7f55b80cfbd0 2023-07-14T15:58:12.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.934+0000 7f55b7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55b80b24e0 0x7f55b81512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:12.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.934+0000 7f55b7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55b80b24e0 0x7f55b81512e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49504/0 (socket says 172.21.15.37:49504) 2023-07-14T15:58:12.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.934+0000 7f55b7fff700 1 -- 172.21.15.37:0/2688696720 learned_addr learned my addr 172.21.15.37:0/2688696720 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:12.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.934+0000 7f55b77fe700 1 --2- 172.21.15.37:0/2688696720 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55b80b8650 0x7f55b80c9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:12.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.934+0000 7f55bc99c700 1 --2- 172.21.15.37:0/2688696720 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f55b80cfbd0 0x7f55b80c9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:12.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.934+0000 7f55b7fff700 1 -- 172.21.15.37:0/2688696720 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f55b80cfbd0 msgr2=0x7f55b80c9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:12.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.934+0000 7f55b7fff700 1 --2- 172.21.15.37:0/2688696720 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f55b80cfbd0 0x7f55b80c9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:12.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.934+0000 7f55b7fff700 1 -- 172.21.15.37:0/2688696720 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55b80b8650 msgr2=0x7f55b80c9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:12.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.934+0000 7f55b7fff700 1 --2- 172.21.15.37:0/2688696720 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55b80b8650 0x7f55b80c9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:12.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.934+0000 7f55b7fff700 1 -- 172.21.15.37:0/2688696720 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55ac0094a0 con 0x7f55b80b24e0 2023-07-14T15:58:12.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.934+0000 7f55bc99c700 1 --2- 172.21.15.37:0/2688696720 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f55b80cfbd0 0x7f55b80c9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:58:12.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.935+0000 7f55b7fff700 1 --2- 172.21.15.37:0/2688696720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55b80b24e0 0x7f55b81512e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f55a800c700 tx=0x7f55a800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:12.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.935+0000 7f55b4ff9700 1 -- 172.21.15.37:0/2688696720 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a8005d70 con 0x7f55b80b24e0 2023-07-14T15:58:12.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.935+0000 7f55b4ff9700 1 -- 172.21.15.37:0/2688696720 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a80070d0 con 0x7f55b80b24e0 2023-07-14T15:58:12.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.935+0000 7f55be3ff700 1 -- 172.21.15.37:0/2688696720 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55b80cc680 con 0x7f55b80b24e0 2023-07-14T15:58:12.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.935+0000 7f55b4ff9700 1 -- 172.21.15.37:0/2688696720 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a8007460 con 0x7f55b80b24e0 2023-07-14T15:58:12.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.935+0000 7f55be3ff700 1 -- 172.21.15.37:0/2688696720 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55b815d9c0 con 0x7f55b80b24e0 2023-07-14T15:58:12.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.936+0000 7f55be3ff700 1 -- 172.21.15.37:0/2688696720 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55b80ccba0 con 0x7f55b80b24e0 2023-07-14T15:58:12.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.937+0000 7f55b4ff9700 1 -- 172.21.15.37:0/2688696720 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f55a80075c0 con 0x7f55b80b24e0 2023-07-14T15:58:12.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.938+0000 7f55b4ff9700 1 --2- 172.21.15.37:0/2688696720 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f55a406ad70 0x7f55a406d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:12.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.938+0000 7f55b4ff9700 1 -- 172.21.15.37:0/2688696720 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f55a8088b40 con 0x7f55b80b24e0 2023-07-14T15:58:12.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.938+0000 7f55b77fe700 1 --2- 172.21.15.37:0/2688696720 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f55a406ad70 0x7f55a406d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:12.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.939+0000 7f55b77fe700 1 --2- 172.21.15.37:0/2688696720 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f55a406ad70 0x7f55a406d220 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f55ac000c00 tx=0x7f55ac008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:12.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:12.942+0000 7f55b4ff9700 1 -- 172.21.15.37:0/2688696720 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f55b80ccba0 con 0x7f55b80b24e0 2023-07-14T15:58:13.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.148+0000 7f55be3ff700 1 -- 172.21.15.37:0/2688696720 --> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f55b80cf140 con 0x7f55a406ad70 2023-07-14T15:58:13.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.159+0000 7f55b4ff9700 1 -- 172.21.15.37:0/2688696720 <== mgr.4100 v2:172.21.15.98:6832/3163748069 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+307716 (secure 0 0 0) 0x7f55ac011b00 con 0x7f55a406ad70 2023-07-14T15:58:13.146 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:58:13.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.163+0000 7f55be3ff700 1 -- 172.21.15.37:0/2688696720 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f55a406ad70 msgr2=0x7f55a406d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:13.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.163+0000 7f55be3ff700 1 --2- 172.21.15.37:0/2688696720 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f55a406ad70 0x7f55a406d220 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f55ac000c00 tx=0x7f55ac008030 comp rx=0 tx=0).stop 2023-07-14T15:58:13.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.163+0000 7f55be3ff700 1 -- 172.21.15.37:0/2688696720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55b80b24e0 msgr2=0x7f55b81512e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:13.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.163+0000 7f55be3ff700 1 --2- 172.21.15.37:0/2688696720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55b80b24e0 0x7f55b81512e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f55a800c700 tx=0x7f55a800ca10 comp rx=0 tx=0).stop 2023-07-14T15:58:13.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.163+0000 7f55be3ff700 1 -- 172.21.15.37:0/2688696720 shutdown_connections 2023-07-14T15:58:13.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.164+0000 7f55be3ff700 1 --2- 172.21.15.37:0/2688696720 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f55a406ad70 0x7f55a406d220 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:13.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.164+0000 7f55be3ff700 1 --2- 172.21.15.37:0/2688696720 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f55b80cfbd0 0x7f55b80c9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:13.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.164+0000 7f55be3ff700 1 --2- 172.21.15.37:0/2688696720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55b80b24e0 0x7f55b81512e0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:13.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.164+0000 7f55be3ff700 1 --2- 172.21.15.37:0/2688696720 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55b80b8650 0x7f55b80c9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:13.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.164+0000 7f55be3ff700 1 -- 172.21.15.37:0/2688696720 >> 172.21.15.37:0/2688696720 conn(0x7f55b806c0f0 msgr2=0x7f55b80b7a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:13.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.164+0000 7f55be3ff700 1 -- 172.21.15.37:0/2688696720 shutdown_connections 2023-07-14T15:58:13.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.164+0000 7f55be3ff700 1 -- 172.21.15.37:0/2688696720 wait complete. 2023-07-14T15:58:13.150 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-14T15:58:13.166 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":113,"stamp":"2023-07-14T15:58:12.884243+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591020,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":165,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":124,"ondisk_log_size":124,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":73,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":229212,"kb_used_data":5404,"kb_used_omap":0,"kb_used_meta":223744,"kb_avail":754745508,"statfs":{"total":773094113280,"available":772859400192,"internally_reserved":0,"allocated":5533696,"data_stored":3017866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":229113856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":652,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001623"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.249271+0000","last_change":"2023-07-14T15:58:08.744537+0000","last_active":"2023-07-14T15:58:10.249271+0000","last_peered":"2023-07-14T15:58:10.249271+0000","last_clean":"2023-07-14T15:58:10.249271+0000","last_became_active":"2023-07-14T15:58:08.743330+0000","last_became_peered":"2023-07-14T15:58:08.743330+0000","last_unstale":"2023-07-14T15:58:10.249271+0000","last_undegraded":"2023-07-14T15:58:10.249271+0000","last_fullsized":"2023-07-14T15:58:10.249271+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:49:26.687765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.719573+0000","last_change":"2023-07-14T15:58:07.719573+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.719573+0000","last_undegraded":"2023-07-14T15:58:07.719573+0000","last_fullsized":"2023-07-14T15:58:07.719573+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.717902+0000","last_change":"2023-07-14T15:58:07.717902+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.717902+0000","last_undegraded":"2023-07-14T15:58:07.717902+0000","last_fullsized":"2023-07-14T15:58:07.717902+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167815+0000","last_change":"2023-07-14T15:58:08.736155+0000","last_active":"2023-07-14T15:58:10.167815+0000","last_peered":"2023-07-14T15:58:10.167815+0000","last_clean":"2023-07-14T15:58:10.167815+0000","last_became_active":"2023-07-14T15:58:08.735812+0000","last_became_peered":"2023-07-14T15:58:08.735812+0000","last_unstale":"2023-07-14T15:58:10.167815+0000","last_undegraded":"2023-07-14T15:58:10.167815+0000","last_fullsized":"2023-07-14T15:58:10.167815+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:48:06.896474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.717572+0000","last_change":"2023-07-14T15:58:07.717572+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.717572+0000","last_undegraded":"2023-07-14T15:58:07.717572+0000","last_fullsized":"2023-07-14T15:58:07.717572+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.722593+0000","last_change":"2023-07-14T15:58:07.722593+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.722593+0000","last_undegraded":"2023-07-14T15:58:07.722593+0000","last_fullsized":"2023-07-14T15:58:07.722593+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.721460+0000","last_change":"2023-07-14T15:58:07.721460+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.721460+0000","last_undegraded":"2023-07-14T15:58:07.721460+0000","last_fullsized":"2023-07-14T15:58:07.721460+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.724630+0000","last_change":"2023-07-14T15:58:07.724630+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.724630+0000","last_undegraded":"2023-07-14T15:58:07.724630+0000","last_fullsized":"2023-07-14T15:58:07.724630+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.718319+0000","last_change":"2023-07-14T15:58:07.718319+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.718319+0000","last_undegraded":"2023-07-14T15:58:07.718319+0000","last_fullsized":"2023-07-14T15:58:07.718319+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.727661+0000","last_change":"2023-07-14T15:58:07.727661+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.727661+0000","last_undegraded":"2023-07-14T15:58:07.727661+0000","last_fullsized":"2023-07-14T15:58:07.727661+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.249087+0000","last_change":"2023-07-14T15:58:08.741999+0000","last_active":"2023-07-14T15:58:10.249087+0000","last_peered":"2023-07-14T15:58:10.249087+0000","last_clean":"2023-07-14T15:58:10.249087+0000","last_became_active":"2023-07-14T15:58:08.741574+0000","last_became_peered":"2023-07-14T15:58:08.741574+0000","last_unstale":"2023-07-14T15:58:10.249087+0000","last_undegraded":"2023-07-14T15:58:10.249087+0000","last_fullsized":"2023-07-14T15:58:10.249087+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:32:57.904943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.722663+0000","last_change":"2023-07-14T15:58:07.722663+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.722663+0000","last_undegraded":"2023-07-14T15:58:07.722663+0000","last_fullsized":"2023-07-14T15:58:07.722663+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.723606+0000","last_change":"2023-07-14T15:58:07.723606+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.723606+0000","last_undegraded":"2023-07-14T15:58:07.723606+0000","last_fullsized":"2023-07-14T15:58:07.723606+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.248843+0000","last_change":"2023-07-14T15:58:08.741798+0000","last_active":"2023-07-14T15:58:10.248843+0000","last_peered":"2023-07-14T15:58:10.248843+0000","last_clean":"2023-07-14T15:58:10.248843+0000","last_became_active":"2023-07-14T15:58:08.741528+0000","last_became_peered":"2023-07-14T15:58:08.741528+0000","last_unstale":"2023-07-14T15:58:10.248843+0000","last_undegraded":"2023-07-14T15:58:10.248843+0000","last_fullsized":"2023-07-14T15:58:10.248843+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:01:10.579696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167899+0000","last_change":"2023-07-14T15:58:08.739487+0000","last_active":"2023-07-14T15:58:10.167899+0000","last_peered":"2023-07-14T15:58:10.167899+0000","last_clean":"2023-07-14T15:58:10.167899+0000","last_became_active":"2023-07-14T15:58:08.739163+0000","last_became_peered":"2023-07-14T15:58:08.739163+0000","last_unstale":"2023-07-14T15:58:10.167899+0000","last_undegraded":"2023-07-14T15:58:10.167899+0000","last_fullsized":"2023-07-14T15:58:10.167899+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:50:25.208038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.724137+0000","last_change":"2023-07-14T15:58:07.724137+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.724137+0000","last_undegraded":"2023-07-14T15:58:07.724137+0000","last_fullsized":"2023-07-14T15:58:07.724137+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.249161+0000","last_change":"2023-07-14T15:58:08.744838+0000","last_active":"2023-07-14T15:58:10.249161+0000","last_peered":"2023-07-14T15:58:10.249161+0000","last_clean":"2023-07-14T15:58:10.249161+0000","last_became_active":"2023-07-14T15:58:08.744465+0000","last_became_peered":"2023-07-14T15:58:08.744465+0000","last_unstale":"2023-07-14T15:58:10.249161+0000","last_undegraded":"2023-07-14T15:58:10.249161+0000","last_fullsized":"2023-07-14T15:58:10.249161+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:07:13.860410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167818+0000","last_change":"2023-07-14T15:58:08.734559+0000","last_active":"2023-07-14T15:58:10.167818+0000","last_peered":"2023-07-14T15:58:10.167818+0000","last_clean":"2023-07-14T15:58:10.167818+0000","last_became_active":"2023-07-14T15:58:08.734286+0000","last_became_peered":"2023-07-14T15:58:08.734286+0000","last_unstale":"2023-07-14T15:58:10.167818+0000","last_undegraded":"2023-07-14T15:58:10.167818+0000","last_fullsized":"2023-07-14T15:58:10.167818+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:59:06.223997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.717241+0000","last_change":"2023-07-14T15:58:07.717241+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.717241+0000","last_undegraded":"2023-07-14T15:58:07.717241+0000","last_fullsized":"2023-07-14T15:58:07.717241+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.722074+0000","last_change":"2023-07-14T15:58:07.722074+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.722074+0000","last_undegraded":"2023-07-14T15:58:07.722074+0000","last_fullsized":"2023-07-14T15:58:07.722074+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167688+0000","last_change":"2023-07-14T15:58:08.735232+0000","last_active":"2023-07-14T15:58:10.167688+0000","last_peered":"2023-07-14T15:58:10.167688+0000","last_clean":"2023-07-14T15:58:10.167688+0000","last_became_active":"2023-07-14T15:58:08.734945+0000","last_became_peered":"2023-07-14T15:58:08.734945+0000","last_unstale":"2023-07-14T15:58:10.167688+0000","last_undegraded":"2023-07-14T15:58:10.167688+0000","last_fullsized":"2023-07-14T15:58:10.167688+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:27:25.126730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.716580+0000","last_change":"2023-07-14T15:58:07.716580+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.716580+0000","last_undegraded":"2023-07-14T15:58:07.716580+0000","last_fullsized":"2023-07-14T15:58:07.716580+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.715960+0000","last_change":"2023-07-14T15:58:07.715960+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.715960+0000","last_undegraded":"2023-07-14T15:58:07.715960+0000","last_fullsized":"2023-07-14T15:58:07.715960+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.715860+0000","last_change":"2023-07-14T15:58:07.715860+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.715860+0000","last_undegraded":"2023-07-14T15:58:07.715860+0000","last_fullsized":"2023-07-14T15:58:07.715860+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.249170+0000","last_change":"2023-07-14T15:58:08.735284+0000","last_active":"2023-07-14T15:58:10.249170+0000","last_peered":"2023-07-14T15:58:10.249170+0000","last_clean":"2023-07-14T15:58:10.249170+0000","last_became_active":"2023-07-14T15:58:08.734958+0000","last_became_peered":"2023-07-14T15:58:08.734958+0000","last_unstale":"2023-07-14T15:58:10.249170+0000","last_undegraded":"2023-07-14T15:58:10.249170+0000","last_fullsized":"2023-07-14T15:58:10.249170+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:32:16.092808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.717249+0000","last_change":"2023-07-14T15:58:07.717249+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.717249+0000","last_undegraded":"2023-07-14T15:58:07.717249+0000","last_fullsized":"2023-07-14T15:58:07.717249+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.723323+0000","last_change":"2023-07-14T15:58:07.723323+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.723323+0000","last_undegraded":"2023-07-14T15:58:07.723323+0000","last_fullsized":"2023-07-14T15:58:07.723323+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.721609+0000","last_change":"2023-07-14T15:58:07.721609+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.721609+0000","last_undegraded":"2023-07-14T15:58:07.721609+0000","last_fullsized":"2023-07-14T15:58:07.721609+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.249000+0000","last_change":"2023-07-14T15:58:08.732111+0000","last_active":"2023-07-14T15:58:10.249000+0000","last_peered":"2023-07-14T15:58:10.249000+0000","last_clean":"2023-07-14T15:58:10.249000+0000","last_became_active":"2023-07-14T15:58:08.731797+0000","last_became_peered":"2023-07-14T15:58:08.731797+0000","last_unstale":"2023-07-14T15:58:10.249000+0000","last_undegraded":"2023-07-14T15:58:10.249000+0000","last_fullsized":"2023-07-14T15:58:10.249000+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:16:58.489649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.724231+0000","last_change":"2023-07-14T15:58:07.724231+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.724231+0000","last_undegraded":"2023-07-14T15:58:07.724231+0000","last_fullsized":"2023-07-14T15:58:07.724231+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.715371+0000","last_change":"2023-07-14T15:58:07.715371+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.715371+0000","last_undegraded":"2023-07-14T15:58:07.715371+0000","last_fullsized":"2023-07-14T15:58:07.715371+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.717880+0000","last_change":"2023-07-14T15:58:07.717880+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.717880+0000","last_undegraded":"2023-07-14T15:58:07.717880+0000","last_fullsized":"2023-07-14T15:58:07.717880+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.722527+0000","last_change":"2023-07-14T15:58:07.722527+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.722527+0000","last_undegraded":"2023-07-14T15:58:07.722527+0000","last_fullsized":"2023-07-14T15:58:07.722527+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"48'4","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T15:58:08.745933+0000","last_change":"2023-07-14T15:58:07.732535+0000","last_active":"2023-07-14T15:58:08.745933+0000","last_peered":"2023-07-14T15:58:08.745933+0000","last_clean":"2023-07-14T15:58:08.745933+0000","last_became_active":"2023-07-14T15:58:07.732169+0000","last_became_peered":"2023-07-14T15:58:07.732169+0000","last_unstale":"2023-07-14T15:58:08.745933+0000","last_undegraded":"2023-07-14T15:58:08.745933+0000","last_fullsized":"2023-07-14T15:58:08.745933+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:04:44.440538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.722080+0000","last_change":"2023-07-14T15:58:07.722080+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.722080+0000","last_undegraded":"2023-07-14T15:58:07.722080+0000","last_fullsized":"2023-07-14T15:58:07.722080+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.741501+0000","last_change":"2023-07-14T15:58:07.736542+0000","last_active":"2023-07-14T15:58:07.741501+0000","last_peered":"2023-07-14T15:58:07.741501+0000","last_clean":"2023-07-14T15:58:07.741501+0000","last_became_active":"2023-07-14T15:58:07.736266+0000","last_became_peered":"2023-07-14T15:58:07.736266+0000","last_unstale":"2023-07-14T15:58:07.741501+0000","last_undegraded":"2023-07-14T15:58:07.741501+0000","last_fullsized":"2023-07-14T15:58:07.741501+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:40:23.569681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.722548+0000","last_change":"2023-07-14T15:58:07.722548+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.722548+0000","last_undegraded":"2023-07-14T15:58:07.722548+0000","last_fullsized":"2023-07-14T15:58:07.722548+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.737548+0000","last_change":"2023-07-14T15:58:07.732950+0000","last_active":"2023-07-14T15:58:07.737548+0000","last_peered":"2023-07-14T15:58:07.737548+0000","last_clean":"2023-07-14T15:58:07.737548+0000","last_became_active":"2023-07-14T15:58:07.732689+0000","last_became_peered":"2023-07-14T15:58:07.732689+0000","last_unstale":"2023-07-14T15:58:07.737548+0000","last_undegraded":"2023-07-14T15:58:07.737548+0000","last_fullsized":"2023-07-14T15:58:07.737548+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:40:23.569681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.722352+0000","last_change":"2023-07-14T15:58:07.722352+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.722352+0000","last_undegraded":"2023-07-14T15:58:07.722352+0000","last_fullsized":"2023-07-14T15:58:07.722352+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.733584+0000","last_change":"2023-07-14T15:58:07.730127+0000","last_active":"2023-07-14T15:58:07.733584+0000","last_peered":"2023-07-14T15:58:07.733584+0000","last_clean":"2023-07-14T15:58:07.733584+0000","last_became_active":"2023-07-14T15:58:07.729851+0000","last_became_peered":"2023-07-14T15:58:07.729851+0000","last_unstale":"2023-07-14T15:58:07.733584+0000","last_undegraded":"2023-07-14T15:58:07.733584+0000","last_fullsized":"2023-07-14T15:58:07.733584+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:19:55.658364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T15:58:08.741259+0000","last_change":"2023-07-14T15:58:08.738154+0000","last_active":"2023-07-14T15:58:08.741259+0000","last_peered":"2023-07-14T15:58:08.741259+0000","last_clean":"2023-07-14T15:58:08.741259+0000","last_became_active":"2023-07-14T15:58:08.737703+0000","last_became_peered":"2023-07-14T15:58:08.737703+0000","last_unstale":"2023-07-14T15:58:08.741259+0000","last_undegraded":"2023-07-14T15:58:08.741259+0000","last_fullsized":"2023-07-14T15:58:08.741259+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:03:03.027389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.741464+0000","last_change":"2023-07-14T15:58:07.734870+0000","last_active":"2023-07-14T15:58:07.741464+0000","last_peered":"2023-07-14T15:58:07.741464+0000","last_clean":"2023-07-14T15:58:07.741464+0000","last_became_active":"2023-07-14T15:58:07.734521+0000","last_became_peered":"2023-07-14T15:58:07.734521+0000","last_unstale":"2023-07-14T15:58:07.741464+0000","last_undegraded":"2023-07-14T15:58:07.741464+0000","last_fullsized":"2023-07-14T15:58:07.741464+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:04:55.555557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.722513+0000","last_change":"2023-07-14T15:58:07.722513+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.722513+0000","last_undegraded":"2023-07-14T15:58:07.722513+0000","last_fullsized":"2023-07-14T15:58:07.722513+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.733616+0000","last_change":"2023-07-14T15:58:07.730993+0000","last_active":"2023-07-14T15:58:07.733616+0000","last_peered":"2023-07-14T15:58:07.733616+0000","last_clean":"2023-07-14T15:58:07.733616+0000","last_became_active":"2023-07-14T15:58:07.730720+0000","last_became_peered":"2023-07-14T15:58:07.730720+0000","last_unstale":"2023-07-14T15:58:07.733616+0000","last_undegraded":"2023-07-14T15:58:07.733616+0000","last_fullsized":"2023-07-14T15:58:07.733616+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:39:22.857254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.728183+0000","last_change":"2023-07-14T15:58:07.728183+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.728183+0000","last_undegraded":"2023-07-14T15:58:07.728183+0000","last_fullsized":"2023-07-14T15:58:07.728183+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.737442+0000","last_change":"2023-07-14T15:58:07.731842+0000","last_active":"2023-07-14T15:58:07.737442+0000","last_peered":"2023-07-14T15:58:07.737442+0000","last_clean":"2023-07-14T15:58:07.737442+0000","last_became_active":"2023-07-14T15:58:07.731549+0000","last_became_peered":"2023-07-14T15:58:07.731549+0000","last_unstale":"2023-07-14T15:58:07.737442+0000","last_undegraded":"2023-07-14T15:58:07.737442+0000","last_fullsized":"2023-07-14T15:58:07.737442+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:32:01.344833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.168035+0000","last_change":"2023-07-14T15:58:08.743009+0000","last_active":"2023-07-14T15:58:10.168035+0000","last_peered":"2023-07-14T15:58:10.168035+0000","last_clean":"2023-07-14T15:58:10.168035+0000","last_became_active":"2023-07-14T15:58:08.742750+0000","last_became_peered":"2023-07-14T15:58:08.742750+0000","last_unstale":"2023-07-14T15:58:10.168035+0000","last_undegraded":"2023-07-14T15:58:10.168035+0000","last_fullsized":"2023-07-14T15:58:10.168035+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:11:50.083029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.732673+0000","last_change":"2023-07-14T15:58:07.728189+0000","last_active":"2023-07-14T15:58:07.732673+0000","last_peered":"2023-07-14T15:58:07.732673+0000","last_clean":"2023-07-14T15:58:07.732673+0000","last_became_active":"2023-07-14T15:58:07.727897+0000","last_became_peered":"2023-07-14T15:58:07.727897+0000","last_unstale":"2023-07-14T15:58:07.732673+0000","last_undegraded":"2023-07-14T15:58:07.732673+0000","last_fullsized":"2023-07-14T15:58:07.732673+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:15:03.507329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T15:58:08.733233+0000","last_change":"2023-07-14T15:58:08.731665+0000","last_active":"2023-07-14T15:58:08.733233+0000","last_peered":"2023-07-14T15:58:08.733233+0000","last_clean":"2023-07-14T15:58:08.733233+0000","last_became_active":"2023-07-14T15:58:08.731371+0000","last_became_peered":"2023-07-14T15:58:08.731371+0000","last_unstale":"2023-07-14T15:58:08.733233+0000","last_undegraded":"2023-07-14T15:58:08.733233+0000","last_fullsized":"2023-07-14T15:58:08.733233+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:20:11.481399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.168035+0000","last_change":"2023-07-14T15:58:07.728755+0000","last_active":"2023-07-14T15:58:10.168035+0000","last_peered":"2023-07-14T15:58:10.168035+0000","last_clean":"2023-07-14T15:58:10.168035+0000","last_became_active":"2023-07-14T15:58:07.728401+0000","last_became_peered":"2023-07-14T15:58:07.728401+0000","last_unstale":"2023-07-14T15:58:10.168035+0000","last_undegraded":"2023-07-14T15:58:10.168035+0000","last_fullsized":"2023-07-14T15:58:10.168035+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:52:41.611985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167935+0000","last_change":"2023-07-14T15:58:08.737207+0000","last_active":"2023-07-14T15:58:10.167935+0000","last_peered":"2023-07-14T15:58:10.167935+0000","last_clean":"2023-07-14T15:58:10.167935+0000","last_became_active":"2023-07-14T15:58:08.736904+0000","last_became_peered":"2023-07-14T15:58:08.736904+0000","last_unstale":"2023-07-14T15:58:10.167935+0000","last_undegraded":"2023-07-14T15:58:10.167935+0000","last_fullsized":"2023-07-14T15:58:10.167935+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:11:51.639080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167883+0000","last_change":"2023-07-14T15:58:07.733957+0000","last_active":"2023-07-14T15:58:10.167883+0000","last_peered":"2023-07-14T15:58:10.167883+0000","last_clean":"2023-07-14T15:58:10.167883+0000","last_became_active":"2023-07-14T15:58:07.733635+0000","last_became_peered":"2023-07-14T15:58:07.733635+0000","last_unstale":"2023-07-14T15:58:10.167883+0000","last_undegraded":"2023-07-14T15:58:10.167883+0000","last_fullsized":"2023-07-14T15:58:10.167883+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:26:47.764384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.248658+0000","last_change":"2023-07-14T15:58:08.743461+0000","last_active":"2023-07-14T15:58:10.248658+0000","last_peered":"2023-07-14T15:58:10.248658+0000","last_clean":"2023-07-14T15:58:10.248658+0000","last_became_active":"2023-07-14T15:58:08.743075+0000","last_became_peered":"2023-07-14T15:58:08.743075+0000","last_unstale":"2023-07-14T15:58:10.248658+0000","last_undegraded":"2023-07-14T15:58:10.248658+0000","last_fullsized":"2023-07-14T15:58:10.248658+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:37:43.533403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.738451+0000","last_change":"2023-07-14T15:58:07.736023+0000","last_active":"2023-07-14T15:58:07.738451+0000","last_peered":"2023-07-14T15:58:07.738451+0000","last_clean":"2023-07-14T15:58:07.738451+0000","last_became_active":"2023-07-14T15:58:07.735713+0000","last_became_peered":"2023-07-14T15:58:07.735713+0000","last_unstale":"2023-07-14T15:58:07.738451+0000","last_undegraded":"2023-07-14T15:58:07.738451+0000","last_fullsized":"2023-07-14T15:58:07.738451+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:28:54.149444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.717011+0000","last_change":"2023-07-14T15:58:07.717011+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.717011+0000","last_undegraded":"2023-07-14T15:58:07.717011+0000","last_fullsized":"2023-07-14T15:58:07.717011+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.742704+0000","last_change":"2023-07-14T15:58:07.742068+0000","last_active":"2023-07-14T15:58:07.742704+0000","last_peered":"2023-07-14T15:58:07.742704+0000","last_clean":"2023-07-14T15:58:07.742704+0000","last_became_active":"2023-07-14T15:58:07.741718+0000","last_became_peered":"2023-07-14T15:58:07.741718+0000","last_unstale":"2023-07-14T15:58:07.742704+0000","last_undegraded":"2023-07-14T15:58:07.742704+0000","last_fullsized":"2023-07-14T15:58:07.742704+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:58:10.417450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.723416+0000","last_change":"2023-07-14T15:58:07.723416+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.723416+0000","last_undegraded":"2023-07-14T15:58:07.723416+0000","last_fullsized":"2023-07-14T15:58:07.723416+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.741397+0000","last_change":"2023-07-14T15:58:07.735958+0000","last_active":"2023-07-14T15:58:07.741397+0000","last_peered":"2023-07-14T15:58:07.741397+0000","last_clean":"2023-07-14T15:58:07.741397+0000","last_became_active":"2023-07-14T15:58:07.735649+0000","last_became_peered":"2023-07-14T15:58:07.735649+0000","last_unstale":"2023-07-14T15:58:07.741397+0000","last_undegraded":"2023-07-14T15:58:07.741397+0000","last_fullsized":"2023-07-14T15:58:07.741397+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:26:05.861976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.249076+0000","last_change":"2023-07-14T15:58:08.741837+0000","last_active":"2023-07-14T15:58:10.249076+0000","last_peered":"2023-07-14T15:58:10.249076+0000","last_clean":"2023-07-14T15:58:10.249076+0000","last_became_active":"2023-07-14T15:58:08.741224+0000","last_became_peered":"2023-07-14T15:58:08.741224+0000","last_unstale":"2023-07-14T15:58:10.249076+0000","last_undegraded":"2023-07-14T15:58:10.249076+0000","last_fullsized":"2023-07-14T15:58:10.249076+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:18:49.473467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167804+0000","last_change":"2023-07-14T15:58:07.734306+0000","last_active":"2023-07-14T15:58:10.167804+0000","last_peered":"2023-07-14T15:58:10.167804+0000","last_clean":"2023-07-14T15:58:10.167804+0000","last_became_active":"2023-07-14T15:58:07.733956+0000","last_became_peered":"2023-07-14T15:58:07.733956+0000","last_unstale":"2023-07-14T15:58:10.167804+0000","last_undegraded":"2023-07-14T15:58:10.167804+0000","last_fullsized":"2023-07-14T15:58:10.167804+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:32:13.169004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.726184+0000","last_change":"2023-07-14T15:58:07.726184+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.726184+0000","last_undegraded":"2023-07-14T15:58:07.726184+0000","last_fullsized":"2023-07-14T15:58:07.726184+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.733252+0000","last_change":"2023-07-14T15:58:07.728853+0000","last_active":"2023-07-14T15:58:07.733252+0000","last_peered":"2023-07-14T15:58:07.733252+0000","last_clean":"2023-07-14T15:58:07.733252+0000","last_became_active":"2023-07-14T15:58:07.728594+0000","last_became_peered":"2023-07-14T15:58:07.728594+0000","last_unstale":"2023-07-14T15:58:07.733252+0000","last_undegraded":"2023-07-14T15:58:07.733252+0000","last_fullsized":"2023-07-14T15:58:07.733252+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:24:04.951787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.717478+0000","last_change":"2023-07-14T15:58:07.717478+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.717478+0000","last_undegraded":"2023-07-14T15:58:07.717478+0000","last_fullsized":"2023-07-14T15:58:07.717478+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.738564+0000","last_change":"2023-07-14T15:58:07.734654+0000","last_active":"2023-07-14T15:58:07.738564+0000","last_peered":"2023-07-14T15:58:07.738564+0000","last_clean":"2023-07-14T15:58:07.738564+0000","last_became_active":"2023-07-14T15:58:07.734360+0000","last_became_peered":"2023-07-14T15:58:07.734360+0000","last_unstale":"2023-07-14T15:58:07.738564+0000","last_undegraded":"2023-07-14T15:58:07.738564+0000","last_fullsized":"2023-07-14T15:58:07.738564+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:50:37.553786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.720869+0000","last_change":"2023-07-14T15:58:07.720869+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.720869+0000","last_undegraded":"2023-07-14T15:58:07.720869+0000","last_fullsized":"2023-07-14T15:58:07.720869+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.741501+0000","last_change":"2023-07-14T15:58:07.736644+0000","last_active":"2023-07-14T15:58:07.741501+0000","last_peered":"2023-07-14T15:58:07.741501+0000","last_clean":"2023-07-14T15:58:07.741501+0000","last_became_active":"2023-07-14T15:58:07.736358+0000","last_became_peered":"2023-07-14T15:58:07.736358+0000","last_unstale":"2023-07-14T15:58:07.741501+0000","last_undegraded":"2023-07-14T15:58:07.741501+0000","last_fullsized":"2023-07-14T15:58:07.741501+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:07:07.548207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.248655+0000","last_change":"2023-07-14T15:58:08.735289+0000","last_active":"2023-07-14T15:58:10.248655+0000","last_peered":"2023-07-14T15:58:10.248655+0000","last_clean":"2023-07-14T15:58:10.248655+0000","last_became_active":"2023-07-14T15:58:08.734993+0000","last_became_peered":"2023-07-14T15:58:08.734993+0000","last_unstale":"2023-07-14T15:58:10.248655+0000","last_undegraded":"2023-07-14T15:58:10.248655+0000","last_fullsized":"2023-07-14T15:58:10.248655+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:26:31.914734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.738599+0000","last_change":"2023-07-14T15:58:07.734503+0000","last_active":"2023-07-14T15:58:07.738599+0000","last_peered":"2023-07-14T15:58:07.738599+0000","last_clean":"2023-07-14T15:58:07.738599+0000","last_became_active":"2023-07-14T15:58:07.734137+0000","last_became_peered":"2023-07-14T15:58:07.734137+0000","last_unstale":"2023-07-14T15:58:07.738599+0000","last_undegraded":"2023-07-14T15:58:07.738599+0000","last_fullsized":"2023-07-14T15:58:07.738599+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:26:43.367167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.718942+0000","last_change":"2023-07-14T15:58:07.718942+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.718942+0000","last_undegraded":"2023-07-14T15:58:07.718942+0000","last_fullsized":"2023-07-14T15:58:07.718942+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"48'1","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167821+0000","last_change":"2023-07-14T15:58:07.725878+0000","last_active":"2023-07-14T15:58:10.167821+0000","last_peered":"2023-07-14T15:58:10.167821+0000","last_clean":"2023-07-14T15:58:10.167821+0000","last_became_active":"2023-07-14T15:58:07.725549+0000","last_became_peered":"2023-07-14T15:58:07.725549+0000","last_unstale":"2023-07-14T15:58:10.167821+0000","last_undegraded":"2023-07-14T15:58:10.167821+0000","last_fullsized":"2023-07-14T15:58:10.167821+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:22:14.282584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.723135+0000","last_change":"2023-07-14T15:58:07.723135+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.723135+0000","last_undegraded":"2023-07-14T15:58:07.723135+0000","last_fullsized":"2023-07-14T15:58:07.723135+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.738614+0000","last_change":"2023-07-14T15:58:07.736136+0000","last_active":"2023-07-14T15:58:07.738614+0000","last_peered":"2023-07-14T15:58:07.738614+0000","last_clean":"2023-07-14T15:58:07.738614+0000","last_became_active":"2023-07-14T15:58:07.735841+0000","last_became_peered":"2023-07-14T15:58:07.735841+0000","last_unstale":"2023-07-14T15:58:07.738614+0000","last_undegraded":"2023-07-14T15:58:07.738614+0000","last_fullsized":"2023-07-14T15:58:07.738614+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:55:42.052044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.721077+0000","last_change":"2023-07-14T15:58:07.721077+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.721077+0000","last_undegraded":"2023-07-14T15:58:07.721077+0000","last_fullsized":"2023-07-14T15:58:07.721077+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"48'2","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.248871+0000","last_change":"2023-07-14T15:58:07.731047+0000","last_active":"2023-07-14T15:58:10.248871+0000","last_peered":"2023-07-14T15:58:10.248871+0000","last_clean":"2023-07-14T15:58:10.248871+0000","last_became_active":"2023-07-14T15:58:07.730760+0000","last_became_peered":"2023-07-14T15:58:07.730760+0000","last_unstale":"2023-07-14T15:58:10.248871+0000","last_undegraded":"2023-07-14T15:58:10.248871+0000","last_fullsized":"2023-07-14T15:58:10.248871+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:54:17.765585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167946+0000","last_change":"2023-07-14T15:58:08.738893+0000","last_active":"2023-07-14T15:58:10.167946+0000","last_peered":"2023-07-14T15:58:10.167946+0000","last_clean":"2023-07-14T15:58:10.167946+0000","last_became_active":"2023-07-14T15:58:08.738584+0000","last_became_peered":"2023-07-14T15:58:08.738584+0000","last_unstale":"2023-07-14T15:58:10.167946+0000","last_undegraded":"2023-07-14T15:58:10.167946+0000","last_fullsized":"2023-07-14T15:58:10.167946+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:32:48.130235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.738512+0000","last_change":"2023-07-14T15:58:07.732320+0000","last_active":"2023-07-14T15:58:07.738512+0000","last_peered":"2023-07-14T15:58:07.738512+0000","last_clean":"2023-07-14T15:58:07.738512+0000","last_became_active":"2023-07-14T15:58:07.732044+0000","last_became_peered":"2023-07-14T15:58:07.732044+0000","last_unstale":"2023-07-14T15:58:07.738512+0000","last_undegraded":"2023-07-14T15:58:07.738512+0000","last_fullsized":"2023-07-14T15:58:07.738512+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:45:12.894608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.248814+0000","last_change":"2023-07-14T15:58:08.743134+0000","last_active":"2023-07-14T15:58:10.248814+0000","last_peered":"2023-07-14T15:58:10.248814+0000","last_clean":"2023-07-14T15:58:10.248814+0000","last_became_active":"2023-07-14T15:58:08.742797+0000","last_became_peered":"2023-07-14T15:58:08.742797+0000","last_unstale":"2023-07-14T15:58:10.248814+0000","last_undegraded":"2023-07-14T15:58:10.248814+0000","last_fullsized":"2023-07-14T15:58:10.248814+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:08:36.025877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.737725+0000","last_change":"2023-07-14T15:58:07.733527+0000","last_active":"2023-07-14T15:58:07.737725+0000","last_peered":"2023-07-14T15:58:07.737725+0000","last_clean":"2023-07-14T15:58:07.737725+0000","last_became_active":"2023-07-14T15:58:07.733219+0000","last_became_peered":"2023-07-14T15:58:07.733219+0000","last_unstale":"2023-07-14T15:58:07.737725+0000","last_undegraded":"2023-07-14T15:58:07.737725+0000","last_fullsized":"2023-07-14T15:58:07.737725+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:26:43.367167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.724269+0000","last_change":"2023-07-14T15:58:07.724269+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.724269+0000","last_undegraded":"2023-07-14T15:58:07.724269+0000","last_fullsized":"2023-07-14T15:58:07.724269+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.735135+0000","last_change":"2023-07-14T15:58:07.731843+0000","last_active":"2023-07-14T15:58:07.735135+0000","last_peered":"2023-07-14T15:58:07.735135+0000","last_clean":"2023-07-14T15:58:07.735135+0000","last_became_active":"2023-07-14T15:58:07.731548+0000","last_became_peered":"2023-07-14T15:58:07.731548+0000","last_unstale":"2023-07-14T15:58:07.735135+0000","last_undegraded":"2023-07-14T15:58:07.735135+0000","last_fullsized":"2023-07-14T15:58:07.735135+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:48:57.461682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.723098+0000","last_change":"2023-07-14T15:58:07.723098+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.723098+0000","last_undegraded":"2023-07-14T15:58:07.723098+0000","last_fullsized":"2023-07-14T15:58:07.723098+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.731640+0000","last_change":"2023-07-14T15:58:07.728047+0000","last_active":"2023-07-14T15:58:07.731640+0000","last_peered":"2023-07-14T15:58:07.731640+0000","last_clean":"2023-07-14T15:58:07.731640+0000","last_became_active":"2023-07-14T15:58:07.727789+0000","last_became_peered":"2023-07-14T15:58:07.727789+0000","last_unstale":"2023-07-14T15:58:07.731640+0000","last_undegraded":"2023-07-14T15:58:07.731640+0000","last_fullsized":"2023-07-14T15:58:07.731640+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:16:03.073064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":62,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.727542+0000","last_change":"2023-07-14T15:56:02.621850+0000","last_active":"2023-07-14T15:58:07.727542+0000","last_peered":"2023-07-14T15:58:07.727542+0000","last_clean":"2023-07-14T15:58:07.727542+0000","last_became_active":"2023-07-14T15:56:02.621471+0000","last_became_peered":"2023-07-14T15:56:02.621471+0000","last_unstale":"2023-07-14T15:58:07.727542+0000","last_undegraded":"2023-07-14T15:58:07.727542+0000","last_fullsized":"2023-07-14T15:58:07.727542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:50:29.634950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167727+0000","last_change":"2023-07-14T15:58:08.735834+0000","last_active":"2023-07-14T15:58:10.167727+0000","last_peered":"2023-07-14T15:58:10.167727+0000","last_clean":"2023-07-14T15:58:10.167727+0000","last_became_active":"2023-07-14T15:58:08.735483+0000","last_became_peered":"2023-07-14T15:58:08.735483+0000","last_unstale":"2023-07-14T15:58:10.167727+0000","last_undegraded":"2023-07-14T15:58:10.167727+0000","last_fullsized":"2023-07-14T15:58:10.167727+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:24:16.022757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.737332+0000","last_change":"2023-07-14T15:58:07.732308+0000","last_active":"2023-07-14T15:58:07.737332+0000","last_peered":"2023-07-14T15:58:07.737332+0000","last_clean":"2023-07-14T15:58:07.737332+0000","last_became_active":"2023-07-14T15:58:07.732001+0000","last_became_peered":"2023-07-14T15:58:07.732001+0000","last_unstale":"2023-07-14T15:58:07.737332+0000","last_undegraded":"2023-07-14T15:58:07.737332+0000","last_fullsized":"2023-07-14T15:58:07.737332+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:23:53.549331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":64,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.725964+0000","last_change":"2023-07-14T15:56:02.621963+0000","last_active":"2023-07-14T15:58:07.725964+0000","last_peered":"2023-07-14T15:58:07.725964+0000","last_clean":"2023-07-14T15:58:07.725964+0000","last_became_active":"2023-07-14T15:56:02.621678+0000","last_became_peered":"2023-07-14T15:56:02.621678+0000","last_unstale":"2023-07-14T15:58:07.725964+0000","last_undegraded":"2023-07-14T15:58:07.725964+0000","last_fullsized":"2023-07-14T15:58:07.725964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:17:21.248756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.716992+0000","last_change":"2023-07-14T15:58:07.716992+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.716992+0000","last_undegraded":"2023-07-14T15:58:07.716992+0000","last_fullsized":"2023-07-14T15:58:07.716992+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.732661+0000","last_change":"2023-07-14T15:58:07.729039+0000","last_active":"2023-07-14T15:58:07.732661+0000","last_peered":"2023-07-14T15:58:07.732661+0000","last_clean":"2023-07-14T15:58:07.732661+0000","last_became_active":"2023-07-14T15:58:07.728779+0000","last_became_peered":"2023-07-14T15:58:07.728779+0000","last_unstale":"2023-07-14T15:58:07.732661+0000","last_undegraded":"2023-07-14T15:58:07.732661+0000","last_fullsized":"2023-07-14T15:58:07.732661+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:32:07.890972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.727698+0000","last_change":"2023-07-14T15:56:01.925110+0000","last_active":"2023-07-14T15:58:07.727698+0000","last_peered":"2023-07-14T15:58:07.727698+0000","last_clean":"2023-07-14T15:58:07.727698+0000","last_became_active":"2023-07-14T15:56:01.924723+0000","last_became_peered":"2023-07-14T15:56:01.924723+0000","last_unstale":"2023-07-14T15:58:07.727698+0000","last_undegraded":"2023-07-14T15:58:07.727698+0000","last_fullsized":"2023-07-14T15:58:07.727698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:46:51.667515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T15:58:08.733483+0000","last_change":"2023-07-14T15:58:08.730413+0000","last_active":"2023-07-14T15:58:08.733483+0000","last_peered":"2023-07-14T15:58:08.733483+0000","last_clean":"2023-07-14T15:58:08.733483+0000","last_became_active":"2023-07-14T15:58:08.730120+0000","last_became_peered":"2023-07-14T15:58:08.730120+0000","last_unstale":"2023-07-14T15:58:08.733483+0000","last_undegraded":"2023-07-14T15:58:08.733483+0000","last_fullsized":"2023-07-14T15:58:08.733483+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:24:06.908513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.737745+0000","last_change":"2023-07-14T15:58:07.734443+0000","last_active":"2023-07-14T15:58:07.737745+0000","last_peered":"2023-07-14T15:58:07.737745+0000","last_clean":"2023-07-14T15:58:07.737745+0000","last_became_active":"2023-07-14T15:58:07.734185+0000","last_became_peered":"2023-07-14T15:58:07.734185+0000","last_unstale":"2023-07-14T15:58:07.737745+0000","last_undegraded":"2023-07-14T15:58:07.737745+0000","last_fullsized":"2023-07-14T15:58:07.737745+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:07:07.548207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":64,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.726148+0000","last_change":"2023-07-14T15:56:01.923465+0000","last_active":"2023-07-14T15:58:07.726148+0000","last_peered":"2023-07-14T15:58:07.726148+0000","last_clean":"2023-07-14T15:58:07.726148+0000","last_became_active":"2023-07-14T15:56:01.923160+0000","last_became_peered":"2023-07-14T15:56:01.923160+0000","last_unstale":"2023-07-14T15:58:07.726148+0000","last_undegraded":"2023-07-14T15:58:07.726148+0000","last_fullsized":"2023-07-14T15:58:07.726148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:37:17.847750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":210,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167486+0000","last_change":"2023-07-14T15:55:54.040065+0000","last_active":"2023-07-14T15:58:10.167486+0000","last_peered":"2023-07-14T15:58:10.167486+0000","last_clean":"2023-07-14T15:58:10.167486+0000","last_became_active":"2023-07-14T15:55:54.038885+0000","last_became_peered":"2023-07-14T15:55:54.038885+0000","last_unstale":"2023-07-14T15:58:10.167486+0000","last_undegraded":"2023-07-14T15:58:10.167486+0000","last_fullsized":"2023-07-14T15:58:10.167486+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:55:53.025696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:55:53.025696+0000","last_clean_scrub_stamp":"2023-07-14T15:55:53.025696+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:02:02.551339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.721138+0000","last_change":"2023-07-14T15:58:07.721138+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.721138+0000","last_undegraded":"2023-07-14T15:58:07.721138+0000","last_fullsized":"2023-07-14T15:58:07.721138+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.738477+0000","last_change":"2023-07-14T15:58:07.736838+0000","last_active":"2023-07-14T15:58:07.738477+0000","last_peered":"2023-07-14T15:58:07.738477+0000","last_clean":"2023-07-14T15:58:07.738477+0000","last_became_active":"2023-07-14T15:58:07.735691+0000","last_became_peered":"2023-07-14T15:58:07.735691+0000","last_unstale":"2023-07-14T15:58:07.738477+0000","last_undegraded":"2023-07-14T15:58:07.738477+0000","last_fullsized":"2023-07-14T15:58:07.738477+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:20:19.529745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":64,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.725920+0000","last_change":"2023-07-14T15:56:01.920714+0000","last_active":"2023-07-14T15:58:07.725920+0000","last_peered":"2023-07-14T15:58:07.725920+0000","last_clean":"2023-07-14T15:58:07.725920+0000","last_became_active":"2023-07-14T15:56:01.920325+0000","last_became_peered":"2023-07-14T15:56:01.920325+0000","last_unstale":"2023-07-14T15:58:07.725920+0000","last_undegraded":"2023-07-14T15:58:07.725920+0000","last_fullsized":"2023-07-14T15:58:07.725920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:14:38.312671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.724821+0000","last_change":"2023-07-14T15:58:07.724821+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.724821+0000","last_undegraded":"2023-07-14T15:58:07.724821+0000","last_fullsized":"2023-07-14T15:58:07.724821+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167704+0000","last_change":"2023-07-14T15:58:07.736616+0000","last_active":"2023-07-14T15:58:10.167704+0000","last_peered":"2023-07-14T15:58:10.167704+0000","last_clean":"2023-07-14T15:58:10.167704+0000","last_became_active":"2023-07-14T15:58:07.736315+0000","last_became_peered":"2023-07-14T15:58:07.736315+0000","last_unstale":"2023-07-14T15:58:10.167704+0000","last_undegraded":"2023-07-14T15:58:10.167704+0000","last_fullsized":"2023-07-14T15:58:10.167704+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:23:07.012317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":64,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.726654+0000","last_change":"2023-07-14T15:56:01.923631+0000","last_active":"2023-07-14T15:58:07.726654+0000","last_peered":"2023-07-14T15:58:07.726654+0000","last_clean":"2023-07-14T15:58:07.726654+0000","last_became_active":"2023-07-14T15:56:01.922783+0000","last_became_peered":"2023-07-14T15:56:01.922783+0000","last_unstale":"2023-07-14T15:58:07.726654+0000","last_undegraded":"2023-07-14T15:58:07.726654+0000","last_fullsized":"2023-07-14T15:58:07.726654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:49:34.604728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.721620+0000","last_change":"2023-07-14T15:58:07.721620+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.721620+0000","last_undegraded":"2023-07-14T15:58:07.721620+0000","last_fullsized":"2023-07-14T15:58:07.721620+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.737804+0000","last_change":"2023-07-14T15:58:07.734768+0000","last_active":"2023-07-14T15:58:07.737804+0000","last_peered":"2023-07-14T15:58:07.737804+0000","last_clean":"2023-07-14T15:58:07.737804+0000","last_became_active":"2023-07-14T15:58:07.734498+0000","last_became_peered":"2023-07-14T15:58:07.734498+0000","last_unstale":"2023-07-14T15:58:07.737804+0000","last_undegraded":"2023-07-14T15:58:07.737804+0000","last_fullsized":"2023-07-14T15:58:07.737804+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:26:05.861976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":55,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.719245+0000","last_change":"2023-07-14T15:56:01.965649+0000","last_active":"2023-07-14T15:58:07.719245+0000","last_peered":"2023-07-14T15:58:07.719245+0000","last_clean":"2023-07-14T15:58:07.719245+0000","last_became_active":"2023-07-14T15:56:01.965344+0000","last_became_peered":"2023-07-14T15:56:01.965344+0000","last_unstale":"2023-07-14T15:58:07.719245+0000","last_undegraded":"2023-07-14T15:58:07.719245+0000","last_fullsized":"2023-07-14T15:58:07.719245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:49:21.926040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.718370+0000","last_change":"2023-07-14T15:58:07.718370+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.718370+0000","last_undegraded":"2023-07-14T15:58:07.718370+0000","last_fullsized":"2023-07-14T15:58:07.718370+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.733972+0000","last_change":"2023-07-14T15:58:07.730397+0000","last_active":"2023-07-14T15:58:07.733972+0000","last_peered":"2023-07-14T15:58:07.733972+0000","last_clean":"2023-07-14T15:58:07.733972+0000","last_became_active":"2023-07-14T15:58:07.729703+0000","last_became_peered":"2023-07-14T15:58:07.729703+0000","last_unstale":"2023-07-14T15:58:07.733972+0000","last_undegraded":"2023-07-14T15:58:07.733972+0000","last_fullsized":"2023-07-14T15:58:07.733972+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:20:56.952309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.726496+0000","last_change":"2023-07-14T15:56:01.966578+0000","last_active":"2023-07-14T15:58:07.726496+0000","last_peered":"2023-07-14T15:58:07.726496+0000","last_clean":"2023-07-14T15:58:07.726496+0000","last_became_active":"2023-07-14T15:56:01.966216+0000","last_became_peered":"2023-07-14T15:56:01.966216+0000","last_unstale":"2023-07-14T15:58:07.726496+0000","last_undegraded":"2023-07-14T15:58:07.726496+0000","last_fullsized":"2023-07-14T15:58:07.726496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:54:53.435442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":652,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476767,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":528,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":540672,"data_stored":228600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.44800000000000001,"15min":0.45000000000000001},"min":{"1min":0.29799999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.58999999999999997,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.753},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.46300000000000002,"15min":0.47299999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.57599999999999996,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.52000000000000002}]},{"osd":1,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.57799999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.52100000000000002,"15min":0.52300000000000002},"min":{"1min":0.38600000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.67500000000000004,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.435}]},{"osd":2,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.504,"15min":0.505},"min":{"1min":0.40300000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.66700000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.74199999999999999,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.67500000000000004}]},{"osd":4,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.755,"15min":0.76500000000000001},"min":{"1min":0.503,"5min":0.441,"15min":0.441},"max":{"1min":1.0189999999999999,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.76600000000000001,"15min":0.77400000000000002},"min":{"1min":0.53900000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.88400000000000001,"5min":1.542,"15min":1.542},"last":0.77300000000000002}]},{"osd":5,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.84199999999999997,"15min":0.85599999999999998},"min":{"1min":0.625,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.95299999999999996,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.84599999999999997,"15min":0.85699999999999998},"min":{"1min":0.60899999999999999,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.94599999999999995,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.97499999999999998}]},{"osd":6,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.80800000000000005,"15min":0.81899999999999995},"min":{"1min":0.55900000000000005,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.98799999999999999,"5min":1.52,"15min":1.52},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.79900000000000004,"15min":0.81200000000000006},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.86099999999999999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.86399999999999999}]},{"osd":7,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.77400000000000002,"15min":0.77700000000000002},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.96499999999999997,"5min":1.232,"15min":1.232},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.84299999999999997,"15min":0.85699999999999998},"min":{"1min":0.55500000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.94899999999999995,"5min":1.478,"15min":1.478},"last":0.83299999999999996}]}]},{"osd":0,"up_from":16,"seq":68719476768,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":528,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":540672,"data_stored":228600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42299999999999999,"15min":0.42399999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.67500000000000004,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.48499999999999999,"15min":0.48899999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.61599999999999999,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.498}]},{"osd":2,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.499,"15min":0.5},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.50800000000000001,"15min":0.505},"min":{"1min":0.41499999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.41299999999999998}]},{"osd":3,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47899999999999998,"15min":0.48099999999999998},"min":{"1min":0.38100000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.60699999999999998,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.57299999999999995,"15min":0.57699999999999996},"min":{"1min":0.42399999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76500000000000001,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.434}]},{"osd":4,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.99399999999999999,"5min":1.04,"15min":1.04},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.78000000000000003,"15min":0.78900000000000003},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.91000000000000003,"5min":1.331,"15min":1.331},"last":0.85999999999999999}]},{"osd":5,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.60999999999999999,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.119,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.56999999999999995,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0289999999999999,"5min":1.087,"15min":1.087},"last":0.877}]},{"osd":6,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.77500000000000002,"15min":0.78100000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0029999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.80100000000000005,"15min":0.80500000000000005},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.056,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.72799999999999998}]},{"osd":7,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.80100000000000005,"15min":0.80800000000000005},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.99399999999999999,"5min":1.262,"15min":1.262},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.79700000000000004,"15min":0.80100000000000005},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.97799999999999998,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.79200000000000004}]}]},{"osd":6,"up_from":14,"seq":60129542175,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":556,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":569344,"data_stored":242963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.621,"15min":0.61699999999999999},"min":{"1min":0.40999999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.82399999999999995,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64700000000000002,"15min":0.64600000000000002},"min":{"1min":0.496,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81599999999999995,"5min":1.266,"15min":1.266},"last":0.60699999999999998}]},{"osd":1,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.69799999999999995,"15min":0.70299999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88700000000000001,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.72199999999999998,"15min":0.71699999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.86699999999999999}]},{"osd":2,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.88500000000000001,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.68600000000000005,"15min":0.69099999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.75600000000000001}]},{"osd":3,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.78200000000000003,"15min":0.80400000000000005},"min":{"1min":0.48099999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.85999999999999999,"5min":3.141,"15min":3.141},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.752,"15min":0.753},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.94999999999999996,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.68200000000000005}]},{"osd":4,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.63,"15min":0.63300000000000001},"min":{"1min":0.432,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.83499999999999996,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.70899999999999996,"15min":0.71199999999999997},"min":{"1min":0.47599999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.92300000000000004,"5min":1.024,"15min":1.024},"last":0.55100000000000005}]},{"osd":5,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.748,"15min":0.751},"min":{"1min":0.51700000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.96999999999999997,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73599999999999999,"15min":0.73999999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.012,"5min":1.091,"15min":1.091},"last":0.80200000000000005}]},{"osd":7,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.72499999999999998,"15min":0.72899999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.92500000000000004,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.82399999999999995,"15min":0.82899999999999996},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":0.996,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.83899999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542174,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":1136,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1163264,"data_stored":832819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.60699999999999998,"15min":0.64200000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.53100000000000003,"5min":4.5519999999999996,"15min":4.5519999999999996},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":1.147,"15min":1.2609999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.70899999999999996,"5min":15.911,"15min":15.911},"last":0.53500000000000003}]},{"osd":2,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.45700000000000002,"15min":0.46400000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.53300000000000003,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.436},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.67300000000000004,"15min":0.70599999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.57299999999999995,"5min":4.5140000000000002,"15min":4.5140000000000002},"last":0.55700000000000005}]},{"osd":3,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.70199999999999996,"15min":0.73599999999999999},"min":{"1min":0.378,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.65500000000000003,"5min":4.452,"15min":4.452},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.70299999999999996,"15min":0.73899999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.57999999999999996,"5min":4.2279999999999998,"15min":4.2279999999999998},"last":0.48599999999999999}]},{"osd":4,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.88400000000000001,"15min":0.92000000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.81899999999999995,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.92200000000000004,"15min":0.95999999999999996},"min":{"1min":0.52400000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.95699999999999996,"5min":4.9109999999999996,"15min":4.9109999999999996},"last":0.61099999999999999}]},{"osd":5,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.90000000000000002,"15min":0.93300000000000005},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.98999999999999999,"5min":4.1269999999999998,"15min":4.1269999999999998},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.93799999999999994,"15min":0.97399999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.93700000000000006,"5min":4.585,"15min":4.585},"last":0.67700000000000005}]},{"osd":6,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.93300000000000005,"15min":0.97099999999999997},"min":{"1min":0.56899999999999995,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0369999999999999,"5min":4.9880000000000004,"15min":4.9880000000000004},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.92900000000000005,"15min":0.96299999999999997},"min":{"1min":0.58499999999999996,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94599999999999995,"5min":4.1660000000000004,"15min":4.1660000000000004},"last":0.747}]},{"osd":7,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.98199999999999998,"15min":1.0249999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.0429999999999999,"5min":4.9530000000000003,"15min":4.9530000000000003},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.94599999999999995,"15min":0.98099999999999998},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.048,"5min":4.1959999999999997,"15min":4.1959999999999997},"last":0.79000000000000004}]}]},{"osd":2,"up_from":15,"seq":64424509471,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":528384,"data_stored":221972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.42699999999999999,"15min":0.433},"min":{"1min":0.32200000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.51900000000000002,"5min":0.62,"15min":0.62},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.47299999999999998,"15min":0.48299999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.57999999999999996,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.39600000000000002}]},{"osd":1,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.52400000000000002,"15min":0.53100000000000003},"min":{"1min":0.315,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76200000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.46899999999999997,"15min":0.47099999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.65100000000000002,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.436}]},{"osd":3,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.58799999999999997,"15min":0.60199999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.63600000000000001,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.53200000000000003,"15min":0.53800000000000003},"min":{"1min":0.433,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.53700000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.53500000000000003}]},{"osd":4,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.72399999999999998,"15min":0.72799999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.169,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.74299999999999999,"15min":0.747},"min":{"1min":0.53300000000000003,"5min":0.437,"15min":0.437},"max":{"1min":0.90100000000000002,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.62}]},{"osd":5,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.77300000000000002,"15min":0.78100000000000003},"min":{"1min":0.55700000000000005,"5min":0.505,"15min":0.505},"max":{"1min":1.002,"5min":1.391,"15min":1.391},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.75600000000000001,"15min":0.76200000000000001},"min":{"1min":0.50700000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.153,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.66200000000000003}]},{"osd":6,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.79000000000000004,"15min":0.80300000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0960000000000001,"5min":1.51,"15min":1.51},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.81599999999999995,"15min":0.82999999999999996},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1319999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.73599999999999999}]},{"osd":7,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.78300000000000003,"15min":0.79400000000000004},"min":{"1min":0.54700000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.048,"5min":1.288,"15min":1.288},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.81799999999999995,"15min":0.82799999999999996},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.71899999999999997}]}]},{"osd":4,"up_from":15,"seq":64424509470,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":528384,"data_stored":221972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.67700000000000005,"15min":0.68700000000000006},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.64700000000000002,"15min":0.65700000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88300000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.496}]},{"osd":1,"last update":"Fri Jul 14 15:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.67000000000000004,"15min":0.67600000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.81999999999999995,"5min":0.87,"15min":0.87},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.65100000000000002,"15min":0.66000000000000003},"min":{"1min":0.44400000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.82899999999999996,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.47599999999999998}]},{"osd":2,"last update":"Fri Jul 14 15:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64400000000000002,"15min":0.65000000000000002},"min":{"1min":0.441,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.71599999999999997,"15min":0.72899999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.80900000000000005,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.55100000000000005}]},{"osd":3,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.68400000000000005,"15min":0.68799999999999994},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.86699999999999999,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.72799999999999998,"15min":0.73499999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.94299999999999995,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.752}]},{"osd":5,"last update":"Fri Jul 14 15:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65900000000000003,"15min":0.66400000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.83499999999999996,"5min":1.119,"15min":1.119},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.70699999999999996,"15min":0.71599999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.88200000000000001,"5min":1.157,"15min":1.157},"last":0.71999999999999997}]},{"osd":6,"last update":"Fri Jul 14 15:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.70199999999999996,"15min":0.71399999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.86199999999999999,"5min":1.04,"15min":1.04},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.89800000000000002,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.66400000000000003}]},{"osd":7,"last update":"Fri Jul 14 15:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.755,"15min":0.76700000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93799999999999994,"5min":1.202,"15min":1.202},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.77900000000000003,"15min":0.79100000000000004},"min":{"1min":0.53900000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.92100000000000004,"5min":1.137,"15min":1.137},"last":0.65600000000000003}]}]},{"osd":5,"up_from":15,"seq":64424509472,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28060,"kb_used_data":1108,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343780,"statfs":{"total":96636764160,"available":96608030720,"internally_reserved":0,"allocated":1134592,"data_stored":818968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.66400000000000003,"15min":0.67200000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.86099999999999999,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.97799999999999998,"15min":1.038},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.80600000000000005,"5min":8.1500000000000004,"15min":8.1500000000000004},"last":0.64200000000000002}]},{"osd":1,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.67200000000000004,"15min":0.67600000000000005},"min":{"1min":0.51200000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.98799999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.66400000000000003,"15min":0.67000000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.76800000000000002,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.54200000000000004}]},{"osd":2,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.75800000000000001,"15min":0.77100000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.873,"5min":1.085,"15min":1.085},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.72499999999999998,"15min":0.73699999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.86599999999999999,"5min":1.048,"15min":1.048},"last":0.56699999999999995}]},{"osd":3,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.69299999999999995,"15min":0.70099999999999996},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.82299999999999995,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.80000000000000004,"15min":0.81000000000000005},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":0.91700000000000004,"5min":1.083,"15min":1.083},"last":0.75900000000000001}]},{"osd":4,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68999999999999995,"15min":0.69199999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.65700000000000003,"15min":0.66300000000000003},"min":{"1min":0.441,"5min":0.438,"15min":0.438},"max":{"1min":0.82099999999999995,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.61599999999999999}]},{"osd":6,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.69899999999999995,"15min":0.71299999999999997},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.871,"5min":1.121,"15min":1.121},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.78700000000000003,"15min":0.80100000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.93799999999999994,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":1.1699999999999999}]},{"osd":7,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.74399999999999999,"15min":0.751},"min":{"1min":0.58199999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.875,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":1.149},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.81699999999999995,"15min":0.83099999999999996},"min":{"1min":0.53800000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.94699999999999995,"5min":1.605,"15min":1.605},"last":1.492}]}]},{"osd":7,"up_from":15,"seq":64424509471,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":528384,"data_stored":221972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.61799999999999999,"15min":0.61499999999999999},"min":{"1min":0.39300000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0089999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.80400000000000005,"15min":0.82499999999999996},"min":{"1min":0.44400000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0820000000000001,"5min":4.5919999999999996,"15min":4.5919999999999996},"last":0.74199999999999999}]},{"osd":1,"last update":"Fri Jul 14 15:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.66700000000000004,"15min":0.66900000000000004},"min":{"1min":0.442,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98299999999999998,"5min":1,"15min":1},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.86199999999999999,"15min":0.89600000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88100000000000001,"5min":4.665,"15min":4.665},"last":0.79200000000000004}]},{"osd":2,"last update":"Fri Jul 14 15:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.872,"15min":0.91200000000000003},"min":{"1min":0.50600000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.86699999999999999,"5min":5.4089999999999998,"15min":5.4089999999999998},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.76700000000000002,"15min":0.77500000000000002},"min":{"1min":0.497,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0389999999999999,"5min":2.165,"15min":2.165},"last":0.88200000000000001}]},{"osd":3,"last update":"Fri Jul 14 15:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.753,"15min":0.76100000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.96199999999999997,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.80600000000000005,"15min":0.82399999999999995},"min":{"1min":0.49299999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.92500000000000004,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":0.77000000000000002}]},{"osd":4,"last update":"Fri Jul 14 15:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.63900000000000001,"15min":0.64100000000000001},"min":{"1min":0.41099999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89200000000000002,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.65400000000000003,"15min":0.65900000000000003},"min":{"1min":0.37,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.77800000000000002,"5min":1.111,"15min":1.111},"last":0.67600000000000005}]},{"osd":5,"last update":"Fri Jul 14 15:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.65100000000000002,"15min":0.65900000000000003},"min":{"1min":0.40400000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.80500000000000005,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.73799999999999999,"15min":0.747},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.89800000000000002,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.90500000000000003}]},{"osd":6,"last update":"Fri Jul 14 15:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69799999999999995,"15min":0.70499999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84799999999999998,"5min":1.042,"15min":1.042},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.76100000000000001,"15min":0.77700000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.83799999999999997,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.83699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T15:58:13.173 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T15:58:13.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.423+0000 7f4513bff700 1 Processor -- start 2023-07-14T15:58:13.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.423+0000 7f4513bff700 1 -- start start 2023-07-14T15:58:13.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.424+0000 7f4513bff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f450c0b85f0 0x7f450c15d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:13.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.424+0000 7f4513bff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f450c0b54b0 0x7f450c0cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:13.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.424+0000 7f4513bff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f450c0cf6b0 con 0x7f450c0b4910 2023-07-14T15:58:13.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.424+0000 7f4513bff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f450c0cdc40 con 0x7f450c0b54b0 2023-07-14T15:58:13.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.424+0000 7f4513bff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f450c15dba0 con 0x7f450c0b85f0 2023-07-14T15:58:13.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.424+0000 7f451119a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f450c0b54b0 0x7f450c0cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:13.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.424+0000 7f451219c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f450c0b4910 0x7f450c0b4d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47010/0 (socket says 172.21.15.37:47010) 2023-07-14T15:58:13.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.424+0000 7f451219c700 1 -- 172.21.15.37:0/2966752775 learned_addr learned my addr 172.21.15.37:0/2966752775 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:58:13.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.425+0000 7f451199b700 1 --2- 172.21.15.37:0/2966752775 >> v2:172.21.15.98:3300/0 conn(0x7f450c0b85f0 0x7f450c15d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:13.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.425+0000 7f451119a700 1 -- 172.21.15.37:0/2966752775 >> v2:172.21.15.98:3300/0 conn(0x7f450c0b85f0 msgr2=0x7f450c15d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:13.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.425+0000 7f451119a700 1 --2- 172.21.15.37:0/2966752775 >> v2:172.21.15.98:3300/0 conn(0x7f450c0b85f0 0x7f450c15d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:13.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.425+0000 7f451119a700 1 -- 172.21.15.37:0/2966752775 >> v1:172.21.15.37:6789/0 conn(0x7f450c0b4910 legacy=0x7f450c0b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:13.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.425+0000 7f451119a700 1 -- 172.21.15.37:0/2966752775 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f450c0cf0a0 con 0x7f450c0b54b0 2023-07-14T15:58:13.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.425+0000 7f4510999700 1 -- 172.21.15.37:0/2966752775 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2547389384 0 0) 0x7f450c0cf6b0 con 0x7f450c0b4910 2023-07-14T15:58:13.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.425+0000 7f451119a700 1 --2- 172.21.15.37:0/2966752775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f450c0b54b0 0x7f450c0cfb40 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f450c06a110 tx=0x7f44fc009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a710603dac11c1d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:13.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.425+0000 7f4510999700 1 -- 172.21.15.37:0/2966752775 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44fc011830 con 0x7f450c0b54b0 2023-07-14T15:58:13.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.426+0000 7f4510999700 1 -- 172.21.15.37:0/2966752775 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44fc011990 con 0x7f450c0b54b0 2023-07-14T15:58:13.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.426+0000 7f4510999700 1 -- 172.21.15.37:0/2966752775 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44fc011d20 con 0x7f450c0b54b0 2023-07-14T15:58:13.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.426+0000 7f4513bff700 1 -- 172.21.15.37:0/2966752775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f450c0b54b0 msgr2=0x7f450c0cfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:13.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.426+0000 7f4513bff700 1 --2- 172.21.15.37:0/2966752775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f450c0b54b0 0x7f450c0cfb40 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f450c06a110 tx=0x7f44fc009b20 comp rx=0 tx=0).stop 2023-07-14T15:58:13.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.426+0000 7f4513bff700 1 -- 172.21.15.37:0/2966752775 shutdown_connections 2023-07-14T15:58:13.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.426+0000 7f4513bff700 1 --2- 172.21.15.37:0/2966752775 >> v2:172.21.15.98:3300/0 conn(0x7f450c0b85f0 0x7f450c15d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:13.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.426+0000 7f4513bff700 1 --2- 172.21.15.37:0/2966752775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f450c0b54b0 0x7f450c0cfb40 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:13.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.426+0000 7f4513bff700 1 -- 172.21.15.37:0/2966752775 >> 172.21.15.37:0/2966752775 conn(0x7f450c06a580 msgr2=0x7f450c06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:13.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.426+0000 7f4513bff700 1 -- 172.21.15.37:0/2966752775 shutdown_connections 2023-07-14T15:58:13.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.426+0000 7f4513bff700 1 -- 172.21.15.37:0/2966752775 wait complete. 2023-07-14T15:58:13.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.428+0000 7f4513bff700 1 Processor -- start 2023-07-14T15:58:13.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.428+0000 7f4513bff700 1 -- start start 2023-07-14T15:58:13.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.429+0000 7f4513bff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f450c0b4910 0x7f450c1e60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:13.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.429+0000 7f4513bff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f450c0b54b0 0x7f450c1491e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:13.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.429+0000 7f4513bff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f450c0b85f0 0x7f450c1e8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:13.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.429+0000 7f4513bff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450c1e9ee0 con 0x7f450c0b85f0 2023-07-14T15:58:13.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.429+0000 7f4513bff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450c0c92f0 con 0x7f450c0b54b0 2023-07-14T15:58:13.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.429+0000 7f4513bff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f450c1e9400 con 0x7f450c0b4910 2023-07-14T15:58:13.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.429+0000 7f451219c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f450c0b85f0 0x7f450c1e8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:13.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.429+0000 7f451219c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f450c0b85f0 0x7f450c1e8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49532/0 (socket says 172.21.15.37:49532) 2023-07-14T15:58:13.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.429+0000 7f451219c700 1 -- 172.21.15.37:0/3356292603 learned_addr learned my addr 172.21.15.37:0/3356292603 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:13.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.430+0000 7f451199b700 1 --2- 172.21.15.37:0/3356292603 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f450c0b4910 0x7f450c1e60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:13.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.430+0000 7f451119a700 1 --2- 172.21.15.37:0/3356292603 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f450c0b54b0 0x7f450c1491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:13.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.430+0000 7f451219c700 1 -- 172.21.15.37:0/3356292603 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f450c0b4910 msgr2=0x7f450c1e60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:13.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.430+0000 7f451219c700 1 --2- 172.21.15.37:0/3356292603 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f450c0b4910 0x7f450c1e60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:13.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.430+0000 7f451219c700 1 -- 172.21.15.37:0/3356292603 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f450c0b54b0 msgr2=0x7f450c1491e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:13.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.430+0000 7f451219c700 1 --2- 172.21.15.37:0/3356292603 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f450c0b54b0 0x7f450c1491e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:13.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.430+0000 7f451219c700 1 -- 172.21.15.37:0/3356292603 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44fc0094a0 con 0x7f450c0b85f0 2023-07-14T15:58:13.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.430+0000 7f451199b700 1 --2- 172.21.15.37:0/3356292603 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f450c0b4910 0x7f450c1e60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:58:13.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.430+0000 7f451119a700 1 --2- 172.21.15.37:0/3356292603 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f450c0b54b0 0x7f450c1491e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:58:13.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.430+0000 7f451219c700 1 --2- 172.21.15.37:0/3356292603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f450c0b85f0 0x7f450c1e8580 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f45040011e0 tx=0x7f450400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:13.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.430+0000 7f45027fc700 1 -- 172.21.15.37:0/3356292603 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4504004c80 con 0x7f450c0b85f0 2023-07-14T15:58:13.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.430+0000 7f45027fc700 1 -- 172.21.15.37:0/3356292603 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4504004de0 con 0x7f450c0b85f0 2023-07-14T15:58:13.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.430+0000 7f4513bff700 1 -- 172.21.15.37:0/3356292603 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f450c1e96e0 con 0x7f450c0b85f0 2023-07-14T15:58:13.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.430+0000 7f45027fc700 1 -- 172.21.15.37:0/3356292603 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45040072d0 con 0x7f450c0b85f0 2023-07-14T15:58:13.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.430+0000 7f4513bff700 1 -- 172.21.15.37:0/3356292603 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f450c149720 con 0x7f450c0b85f0 2023-07-14T15:58:13.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.431+0000 7f4513bff700 1 -- 172.21.15.37:0/3356292603 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f450c1e9c00 con 0x7f450c0b85f0 2023-07-14T15:58:13.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.432+0000 7f45027fc700 1 -- 172.21.15.37:0/3356292603 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f4504007430 con 0x7f450c0b85f0 2023-07-14T15:58:13.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.433+0000 7f45027fc700 1 --2- 172.21.15.37:0/3356292603 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f44f006ad70 0x7f44f006d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:13.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.433+0000 7f45027fc700 1 -- 172.21.15.37:0/3356292603 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4504089210 con 0x7f450c0b85f0 2023-07-14T15:58:13.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.434+0000 7f451199b700 1 --2- 172.21.15.37:0/3356292603 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f44f006ad70 0x7f44f006d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:13.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.434+0000 7f451199b700 1 --2- 172.21.15.37:0/3356292603 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f44f006ad70 0x7f44f006d220 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f450c15baf0 tx=0x7f450800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:13.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.438+0000 7f45027fc700 1 -- 172.21.15.37:0/3356292603 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f450c1e9c00 con 0x7f450c0b85f0 2023-07-14T15:58:13.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.641+0000 7f4513bff700 1 -- 172.21.15.37:0/3356292603 --> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f450c0cd680 con 0x7f44f006ad70 2023-07-14T15:58:13.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.650+0000 7f45027fc700 1 -- 172.21.15.37:0/3356292603 <== mgr.4100 v2:172.21.15.98:6832/3163748069 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+307716 (secure 0 0 0) 0x7f4508007c60 con 0x7f44f006ad70 2023-07-14T15:58:13.637 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:58:13.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.654+0000 7f4513bff700 1 -- 172.21.15.37:0/3356292603 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f44f006ad70 msgr2=0x7f44f006d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:13.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.654+0000 7f4513bff700 1 --2- 172.21.15.37:0/3356292603 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f44f006ad70 0x7f44f006d220 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f450c15baf0 tx=0x7f450800b040 comp rx=0 tx=0).stop 2023-07-14T15:58:13.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.654+0000 7f4513bff700 1 -- 172.21.15.37:0/3356292603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f450c0b85f0 msgr2=0x7f450c1e8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:13.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.654+0000 7f4513bff700 1 --2- 172.21.15.37:0/3356292603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f450c0b85f0 0x7f450c1e8580 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f45040011e0 tx=0x7f450400c8b0 comp rx=0 tx=0).stop 2023-07-14T15:58:13.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.654+0000 7f4513bff700 1 -- 172.21.15.37:0/3356292603 shutdown_connections 2023-07-14T15:58:13.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.654+0000 7f4513bff700 1 --2- 172.21.15.37:0/3356292603 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f44f006ad70 0x7f44f006d220 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:13.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.654+0000 7f4513bff700 1 --2- 172.21.15.37:0/3356292603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f450c0b85f0 0x7f450c1e8580 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:13.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.654+0000 7f4513bff700 1 --2- 172.21.15.37:0/3356292603 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f450c0b4910 0x7f450c1e60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:13.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.654+0000 7f4513bff700 1 --2- 172.21.15.37:0/3356292603 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f450c0b54b0 0x7f450c1491e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:13.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.654+0000 7f4513bff700 1 -- 172.21.15.37:0/3356292603 >> 172.21.15.37:0/3356292603 conn(0x7f450c06a580 msgr2=0x7f450c0d14a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:13.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.655+0000 7f4513bff700 1 -- 172.21.15.37:0/3356292603 shutdown_connections 2023-07-14T15:58:13.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.655+0000 7f4513bff700 1 -- 172.21.15.37:0/3356292603 wait complete. 2023-07-14T15:58:13.641 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-14T15:58:13.657 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":113,"stamp":"2023-07-14T15:58:12.884243+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591020,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":165,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":124,"ondisk_log_size":124,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":73,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":229212,"kb_used_data":5404,"kb_used_omap":0,"kb_used_meta":223744,"kb_avail":754745508,"statfs":{"total":773094113280,"available":772859400192,"internally_reserved":0,"allocated":5533696,"data_stored":3017866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":229113856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":652,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001623"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.249271+0000","last_change":"2023-07-14T15:58:08.744537+0000","last_active":"2023-07-14T15:58:10.249271+0000","last_peered":"2023-07-14T15:58:10.249271+0000","last_clean":"2023-07-14T15:58:10.249271+0000","last_became_active":"2023-07-14T15:58:08.743330+0000","last_became_peered":"2023-07-14T15:58:08.743330+0000","last_unstale":"2023-07-14T15:58:10.249271+0000","last_undegraded":"2023-07-14T15:58:10.249271+0000","last_fullsized":"2023-07-14T15:58:10.249271+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:49:26.687765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.719573+0000","last_change":"2023-07-14T15:58:07.719573+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.719573+0000","last_undegraded":"2023-07-14T15:58:07.719573+0000","last_fullsized":"2023-07-14T15:58:07.719573+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.717902+0000","last_change":"2023-07-14T15:58:07.717902+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.717902+0000","last_undegraded":"2023-07-14T15:58:07.717902+0000","last_fullsized":"2023-07-14T15:58:07.717902+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167815+0000","last_change":"2023-07-14T15:58:08.736155+0000","last_active":"2023-07-14T15:58:10.167815+0000","last_peered":"2023-07-14T15:58:10.167815+0000","last_clean":"2023-07-14T15:58:10.167815+0000","last_became_active":"2023-07-14T15:58:08.735812+0000","last_became_peered":"2023-07-14T15:58:08.735812+0000","last_unstale":"2023-07-14T15:58:10.167815+0000","last_undegraded":"2023-07-14T15:58:10.167815+0000","last_fullsized":"2023-07-14T15:58:10.167815+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:48:06.896474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.717572+0000","last_change":"2023-07-14T15:58:07.717572+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.717572+0000","last_undegraded":"2023-07-14T15:58:07.717572+0000","last_fullsized":"2023-07-14T15:58:07.717572+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.722593+0000","last_change":"2023-07-14T15:58:07.722593+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.722593+0000","last_undegraded":"2023-07-14T15:58:07.722593+0000","last_fullsized":"2023-07-14T15:58:07.722593+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.721460+0000","last_change":"2023-07-14T15:58:07.721460+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.721460+0000","last_undegraded":"2023-07-14T15:58:07.721460+0000","last_fullsized":"2023-07-14T15:58:07.721460+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.724630+0000","last_change":"2023-07-14T15:58:07.724630+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.724630+0000","last_undegraded":"2023-07-14T15:58:07.724630+0000","last_fullsized":"2023-07-14T15:58:07.724630+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.718319+0000","last_change":"2023-07-14T15:58:07.718319+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.718319+0000","last_undegraded":"2023-07-14T15:58:07.718319+0000","last_fullsized":"2023-07-14T15:58:07.718319+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.727661+0000","last_change":"2023-07-14T15:58:07.727661+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.727661+0000","last_undegraded":"2023-07-14T15:58:07.727661+0000","last_fullsized":"2023-07-14T15:58:07.727661+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.249087+0000","last_change":"2023-07-14T15:58:08.741999+0000","last_active":"2023-07-14T15:58:10.249087+0000","last_peered":"2023-07-14T15:58:10.249087+0000","last_clean":"2023-07-14T15:58:10.249087+0000","last_became_active":"2023-07-14T15:58:08.741574+0000","last_became_peered":"2023-07-14T15:58:08.741574+0000","last_unstale":"2023-07-14T15:58:10.249087+0000","last_undegraded":"2023-07-14T15:58:10.249087+0000","last_fullsized":"2023-07-14T15:58:10.249087+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:32:57.904943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.722663+0000","last_change":"2023-07-14T15:58:07.722663+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.722663+0000","last_undegraded":"2023-07-14T15:58:07.722663+0000","last_fullsized":"2023-07-14T15:58:07.722663+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.723606+0000","last_change":"2023-07-14T15:58:07.723606+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.723606+0000","last_undegraded":"2023-07-14T15:58:07.723606+0000","last_fullsized":"2023-07-14T15:58:07.723606+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.248843+0000","last_change":"2023-07-14T15:58:08.741798+0000","last_active":"2023-07-14T15:58:10.248843+0000","last_peered":"2023-07-14T15:58:10.248843+0000","last_clean":"2023-07-14T15:58:10.248843+0000","last_became_active":"2023-07-14T15:58:08.741528+0000","last_became_peered":"2023-07-14T15:58:08.741528+0000","last_unstale":"2023-07-14T15:58:10.248843+0000","last_undegraded":"2023-07-14T15:58:10.248843+0000","last_fullsized":"2023-07-14T15:58:10.248843+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:01:10.579696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167899+0000","last_change":"2023-07-14T15:58:08.739487+0000","last_active":"2023-07-14T15:58:10.167899+0000","last_peered":"2023-07-14T15:58:10.167899+0000","last_clean":"2023-07-14T15:58:10.167899+0000","last_became_active":"2023-07-14T15:58:08.739163+0000","last_became_peered":"2023-07-14T15:58:08.739163+0000","last_unstale":"2023-07-14T15:58:10.167899+0000","last_undegraded":"2023-07-14T15:58:10.167899+0000","last_fullsized":"2023-07-14T15:58:10.167899+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:50:25.208038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.724137+0000","last_change":"2023-07-14T15:58:07.724137+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.724137+0000","last_undegraded":"2023-07-14T15:58:07.724137+0000","last_fullsized":"2023-07-14T15:58:07.724137+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.249161+0000","last_change":"2023-07-14T15:58:08.744838+0000","last_active":"2023-07-14T15:58:10.249161+0000","last_peered":"2023-07-14T15:58:10.249161+0000","last_clean":"2023-07-14T15:58:10.249161+0000","last_became_active":"2023-07-14T15:58:08.744465+0000","last_became_peered":"2023-07-14T15:58:08.744465+0000","last_unstale":"2023-07-14T15:58:10.249161+0000","last_undegraded":"2023-07-14T15:58:10.249161+0000","last_fullsized":"2023-07-14T15:58:10.249161+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:07:13.860410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167818+0000","last_change":"2023-07-14T15:58:08.734559+0000","last_active":"2023-07-14T15:58:10.167818+0000","last_peered":"2023-07-14T15:58:10.167818+0000","last_clean":"2023-07-14T15:58:10.167818+0000","last_became_active":"2023-07-14T15:58:08.734286+0000","last_became_peered":"2023-07-14T15:58:08.734286+0000","last_unstale":"2023-07-14T15:58:10.167818+0000","last_undegraded":"2023-07-14T15:58:10.167818+0000","last_fullsized":"2023-07-14T15:58:10.167818+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:59:06.223997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.717241+0000","last_change":"2023-07-14T15:58:07.717241+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.717241+0000","last_undegraded":"2023-07-14T15:58:07.717241+0000","last_fullsized":"2023-07-14T15:58:07.717241+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.722074+0000","last_change":"2023-07-14T15:58:07.722074+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.722074+0000","last_undegraded":"2023-07-14T15:58:07.722074+0000","last_fullsized":"2023-07-14T15:58:07.722074+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167688+0000","last_change":"2023-07-14T15:58:08.735232+0000","last_active":"2023-07-14T15:58:10.167688+0000","last_peered":"2023-07-14T15:58:10.167688+0000","last_clean":"2023-07-14T15:58:10.167688+0000","last_became_active":"2023-07-14T15:58:08.734945+0000","last_became_peered":"2023-07-14T15:58:08.734945+0000","last_unstale":"2023-07-14T15:58:10.167688+0000","last_undegraded":"2023-07-14T15:58:10.167688+0000","last_fullsized":"2023-07-14T15:58:10.167688+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:27:25.126730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.716580+0000","last_change":"2023-07-14T15:58:07.716580+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.716580+0000","last_undegraded":"2023-07-14T15:58:07.716580+0000","last_fullsized":"2023-07-14T15:58:07.716580+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.715960+0000","last_change":"2023-07-14T15:58:07.715960+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.715960+0000","last_undegraded":"2023-07-14T15:58:07.715960+0000","last_fullsized":"2023-07-14T15:58:07.715960+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.715860+0000","last_change":"2023-07-14T15:58:07.715860+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.715860+0000","last_undegraded":"2023-07-14T15:58:07.715860+0000","last_fullsized":"2023-07-14T15:58:07.715860+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.249170+0000","last_change":"2023-07-14T15:58:08.735284+0000","last_active":"2023-07-14T15:58:10.249170+0000","last_peered":"2023-07-14T15:58:10.249170+0000","last_clean":"2023-07-14T15:58:10.249170+0000","last_became_active":"2023-07-14T15:58:08.734958+0000","last_became_peered":"2023-07-14T15:58:08.734958+0000","last_unstale":"2023-07-14T15:58:10.249170+0000","last_undegraded":"2023-07-14T15:58:10.249170+0000","last_fullsized":"2023-07-14T15:58:10.249170+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:32:16.092808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.717249+0000","last_change":"2023-07-14T15:58:07.717249+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.717249+0000","last_undegraded":"2023-07-14T15:58:07.717249+0000","last_fullsized":"2023-07-14T15:58:07.717249+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.723323+0000","last_change":"2023-07-14T15:58:07.723323+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.723323+0000","last_undegraded":"2023-07-14T15:58:07.723323+0000","last_fullsized":"2023-07-14T15:58:07.723323+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.721609+0000","last_change":"2023-07-14T15:58:07.721609+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.721609+0000","last_undegraded":"2023-07-14T15:58:07.721609+0000","last_fullsized":"2023-07-14T15:58:07.721609+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.249000+0000","last_change":"2023-07-14T15:58:08.732111+0000","last_active":"2023-07-14T15:58:10.249000+0000","last_peered":"2023-07-14T15:58:10.249000+0000","last_clean":"2023-07-14T15:58:10.249000+0000","last_became_active":"2023-07-14T15:58:08.731797+0000","last_became_peered":"2023-07-14T15:58:08.731797+0000","last_unstale":"2023-07-14T15:58:10.249000+0000","last_undegraded":"2023-07-14T15:58:10.249000+0000","last_fullsized":"2023-07-14T15:58:10.249000+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:16:58.489649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.724231+0000","last_change":"2023-07-14T15:58:07.724231+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.724231+0000","last_undegraded":"2023-07-14T15:58:07.724231+0000","last_fullsized":"2023-07-14T15:58:07.724231+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.715371+0000","last_change":"2023-07-14T15:58:07.715371+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.715371+0000","last_undegraded":"2023-07-14T15:58:07.715371+0000","last_fullsized":"2023-07-14T15:58:07.715371+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.717880+0000","last_change":"2023-07-14T15:58:07.717880+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.717880+0000","last_undegraded":"2023-07-14T15:58:07.717880+0000","last_fullsized":"2023-07-14T15:58:07.717880+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.722527+0000","last_change":"2023-07-14T15:58:07.722527+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.722527+0000","last_undegraded":"2023-07-14T15:58:07.722527+0000","last_fullsized":"2023-07-14T15:58:07.722527+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"48'4","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T15:58:08.745933+0000","last_change":"2023-07-14T15:58:07.732535+0000","last_active":"2023-07-14T15:58:08.745933+0000","last_peered":"2023-07-14T15:58:08.745933+0000","last_clean":"2023-07-14T15:58:08.745933+0000","last_became_active":"2023-07-14T15:58:07.732169+0000","last_became_peered":"2023-07-14T15:58:07.732169+0000","last_unstale":"2023-07-14T15:58:08.745933+0000","last_undegraded":"2023-07-14T15:58:08.745933+0000","last_fullsized":"2023-07-14T15:58:08.745933+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:04:44.440538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.722080+0000","last_change":"2023-07-14T15:58:07.722080+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.722080+0000","last_undegraded":"2023-07-14T15:58:07.722080+0000","last_fullsized":"2023-07-14T15:58:07.722080+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.741501+0000","last_change":"2023-07-14T15:58:07.736542+0000","last_active":"2023-07-14T15:58:07.741501+0000","last_peered":"2023-07-14T15:58:07.741501+0000","last_clean":"2023-07-14T15:58:07.741501+0000","last_became_active":"2023-07-14T15:58:07.736266+0000","last_became_peered":"2023-07-14T15:58:07.736266+0000","last_unstale":"2023-07-14T15:58:07.741501+0000","last_undegraded":"2023-07-14T15:58:07.741501+0000","last_fullsized":"2023-07-14T15:58:07.741501+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:40:23.569681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.722548+0000","last_change":"2023-07-14T15:58:07.722548+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.722548+0000","last_undegraded":"2023-07-14T15:58:07.722548+0000","last_fullsized":"2023-07-14T15:58:07.722548+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.737548+0000","last_change":"2023-07-14T15:58:07.732950+0000","last_active":"2023-07-14T15:58:07.737548+0000","last_peered":"2023-07-14T15:58:07.737548+0000","last_clean":"2023-07-14T15:58:07.737548+0000","last_became_active":"2023-07-14T15:58:07.732689+0000","last_became_peered":"2023-07-14T15:58:07.732689+0000","last_unstale":"2023-07-14T15:58:07.737548+0000","last_undegraded":"2023-07-14T15:58:07.737548+0000","last_fullsized":"2023-07-14T15:58:07.737548+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:40:23.569681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.722352+0000","last_change":"2023-07-14T15:58:07.722352+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.722352+0000","last_undegraded":"2023-07-14T15:58:07.722352+0000","last_fullsized":"2023-07-14T15:58:07.722352+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.733584+0000","last_change":"2023-07-14T15:58:07.730127+0000","last_active":"2023-07-14T15:58:07.733584+0000","last_peered":"2023-07-14T15:58:07.733584+0000","last_clean":"2023-07-14T15:58:07.733584+0000","last_became_active":"2023-07-14T15:58:07.729851+0000","last_became_peered":"2023-07-14T15:58:07.729851+0000","last_unstale":"2023-07-14T15:58:07.733584+0000","last_undegraded":"2023-07-14T15:58:07.733584+0000","last_fullsized":"2023-07-14T15:58:07.733584+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:19:55.658364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T15:58:08.741259+0000","last_change":"2023-07-14T15:58:08.738154+0000","last_active":"2023-07-14T15:58:08.741259+0000","last_peered":"2023-07-14T15:58:08.741259+0000","last_clean":"2023-07-14T15:58:08.741259+0000","last_became_active":"2023-07-14T15:58:08.737703+0000","last_became_peered":"2023-07-14T15:58:08.737703+0000","last_unstale":"2023-07-14T15:58:08.741259+0000","last_undegraded":"2023-07-14T15:58:08.741259+0000","last_fullsized":"2023-07-14T15:58:08.741259+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:03:03.027389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.741464+0000","last_change":"2023-07-14T15:58:07.734870+0000","last_active":"2023-07-14T15:58:07.741464+0000","last_peered":"2023-07-14T15:58:07.741464+0000","last_clean":"2023-07-14T15:58:07.741464+0000","last_became_active":"2023-07-14T15:58:07.734521+0000","last_became_peered":"2023-07-14T15:58:07.734521+0000","last_unstale":"2023-07-14T15:58:07.741464+0000","last_undegraded":"2023-07-14T15:58:07.741464+0000","last_fullsized":"2023-07-14T15:58:07.741464+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:04:55.555557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.722513+0000","last_change":"2023-07-14T15:58:07.722513+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.722513+0000","last_undegraded":"2023-07-14T15:58:07.722513+0000","last_fullsized":"2023-07-14T15:58:07.722513+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.733616+0000","last_change":"2023-07-14T15:58:07.730993+0000","last_active":"2023-07-14T15:58:07.733616+0000","last_peered":"2023-07-14T15:58:07.733616+0000","last_clean":"2023-07-14T15:58:07.733616+0000","last_became_active":"2023-07-14T15:58:07.730720+0000","last_became_peered":"2023-07-14T15:58:07.730720+0000","last_unstale":"2023-07-14T15:58:07.733616+0000","last_undegraded":"2023-07-14T15:58:07.733616+0000","last_fullsized":"2023-07-14T15:58:07.733616+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:39:22.857254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.728183+0000","last_change":"2023-07-14T15:58:07.728183+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.728183+0000","last_undegraded":"2023-07-14T15:58:07.728183+0000","last_fullsized":"2023-07-14T15:58:07.728183+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.737442+0000","last_change":"2023-07-14T15:58:07.731842+0000","last_active":"2023-07-14T15:58:07.737442+0000","last_peered":"2023-07-14T15:58:07.737442+0000","last_clean":"2023-07-14T15:58:07.737442+0000","last_became_active":"2023-07-14T15:58:07.731549+0000","last_became_peered":"2023-07-14T15:58:07.731549+0000","last_unstale":"2023-07-14T15:58:07.737442+0000","last_undegraded":"2023-07-14T15:58:07.737442+0000","last_fullsized":"2023-07-14T15:58:07.737442+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:32:01.344833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.168035+0000","last_change":"2023-07-14T15:58:08.743009+0000","last_active":"2023-07-14T15:58:10.168035+0000","last_peered":"2023-07-14T15:58:10.168035+0000","last_clean":"2023-07-14T15:58:10.168035+0000","last_became_active":"2023-07-14T15:58:08.742750+0000","last_became_peered":"2023-07-14T15:58:08.742750+0000","last_unstale":"2023-07-14T15:58:10.168035+0000","last_undegraded":"2023-07-14T15:58:10.168035+0000","last_fullsized":"2023-07-14T15:58:10.168035+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:11:50.083029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.732673+0000","last_change":"2023-07-14T15:58:07.728189+0000","last_active":"2023-07-14T15:58:07.732673+0000","last_peered":"2023-07-14T15:58:07.732673+0000","last_clean":"2023-07-14T15:58:07.732673+0000","last_became_active":"2023-07-14T15:58:07.727897+0000","last_became_peered":"2023-07-14T15:58:07.727897+0000","last_unstale":"2023-07-14T15:58:07.732673+0000","last_undegraded":"2023-07-14T15:58:07.732673+0000","last_fullsized":"2023-07-14T15:58:07.732673+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:15:03.507329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T15:58:08.733233+0000","last_change":"2023-07-14T15:58:08.731665+0000","last_active":"2023-07-14T15:58:08.733233+0000","last_peered":"2023-07-14T15:58:08.733233+0000","last_clean":"2023-07-14T15:58:08.733233+0000","last_became_active":"2023-07-14T15:58:08.731371+0000","last_became_peered":"2023-07-14T15:58:08.731371+0000","last_unstale":"2023-07-14T15:58:08.733233+0000","last_undegraded":"2023-07-14T15:58:08.733233+0000","last_fullsized":"2023-07-14T15:58:08.733233+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:20:11.481399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.168035+0000","last_change":"2023-07-14T15:58:07.728755+0000","last_active":"2023-07-14T15:58:10.168035+0000","last_peered":"2023-07-14T15:58:10.168035+0000","last_clean":"2023-07-14T15:58:10.168035+0000","last_became_active":"2023-07-14T15:58:07.728401+0000","last_became_peered":"2023-07-14T15:58:07.728401+0000","last_unstale":"2023-07-14T15:58:10.168035+0000","last_undegraded":"2023-07-14T15:58:10.168035+0000","last_fullsized":"2023-07-14T15:58:10.168035+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:52:41.611985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167935+0000","last_change":"2023-07-14T15:58:08.737207+0000","last_active":"2023-07-14T15:58:10.167935+0000","last_peered":"2023-07-14T15:58:10.167935+0000","last_clean":"2023-07-14T15:58:10.167935+0000","last_became_active":"2023-07-14T15:58:08.736904+0000","last_became_peered":"2023-07-14T15:58:08.736904+0000","last_unstale":"2023-07-14T15:58:10.167935+0000","last_undegraded":"2023-07-14T15:58:10.167935+0000","last_fullsized":"2023-07-14T15:58:10.167935+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:11:51.639080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167883+0000","last_change":"2023-07-14T15:58:07.733957+0000","last_active":"2023-07-14T15:58:10.167883+0000","last_peered":"2023-07-14T15:58:10.167883+0000","last_clean":"2023-07-14T15:58:10.167883+0000","last_became_active":"2023-07-14T15:58:07.733635+0000","last_became_peered":"2023-07-14T15:58:07.733635+0000","last_unstale":"2023-07-14T15:58:10.167883+0000","last_undegraded":"2023-07-14T15:58:10.167883+0000","last_fullsized":"2023-07-14T15:58:10.167883+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:26:47.764384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.248658+0000","last_change":"2023-07-14T15:58:08.743461+0000","last_active":"2023-07-14T15:58:10.248658+0000","last_peered":"2023-07-14T15:58:10.248658+0000","last_clean":"2023-07-14T15:58:10.248658+0000","last_became_active":"2023-07-14T15:58:08.743075+0000","last_became_peered":"2023-07-14T15:58:08.743075+0000","last_unstale":"2023-07-14T15:58:10.248658+0000","last_undegraded":"2023-07-14T15:58:10.248658+0000","last_fullsized":"2023-07-14T15:58:10.248658+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:37:43.533403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.738451+0000","last_change":"2023-07-14T15:58:07.736023+0000","last_active":"2023-07-14T15:58:07.738451+0000","last_peered":"2023-07-14T15:58:07.738451+0000","last_clean":"2023-07-14T15:58:07.738451+0000","last_became_active":"2023-07-14T15:58:07.735713+0000","last_became_peered":"2023-07-14T15:58:07.735713+0000","last_unstale":"2023-07-14T15:58:07.738451+0000","last_undegraded":"2023-07-14T15:58:07.738451+0000","last_fullsized":"2023-07-14T15:58:07.738451+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:28:54.149444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.717011+0000","last_change":"2023-07-14T15:58:07.717011+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.717011+0000","last_undegraded":"2023-07-14T15:58:07.717011+0000","last_fullsized":"2023-07-14T15:58:07.717011+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.742704+0000","last_change":"2023-07-14T15:58:07.742068+0000","last_active":"2023-07-14T15:58:07.742704+0000","last_peered":"2023-07-14T15:58:07.742704+0000","last_clean":"2023-07-14T15:58:07.742704+0000","last_became_active":"2023-07-14T15:58:07.741718+0000","last_became_peered":"2023-07-14T15:58:07.741718+0000","last_unstale":"2023-07-14T15:58:07.742704+0000","last_undegraded":"2023-07-14T15:58:07.742704+0000","last_fullsized":"2023-07-14T15:58:07.742704+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:58:10.417450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.723416+0000","last_change":"2023-07-14T15:58:07.723416+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.723416+0000","last_undegraded":"2023-07-14T15:58:07.723416+0000","last_fullsized":"2023-07-14T15:58:07.723416+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.741397+0000","last_change":"2023-07-14T15:58:07.735958+0000","last_active":"2023-07-14T15:58:07.741397+0000","last_peered":"2023-07-14T15:58:07.741397+0000","last_clean":"2023-07-14T15:58:07.741397+0000","last_became_active":"2023-07-14T15:58:07.735649+0000","last_became_peered":"2023-07-14T15:58:07.735649+0000","last_unstale":"2023-07-14T15:58:07.741397+0000","last_undegraded":"2023-07-14T15:58:07.741397+0000","last_fullsized":"2023-07-14T15:58:07.741397+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:26:05.861976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.249076+0000","last_change":"2023-07-14T15:58:08.741837+0000","last_active":"2023-07-14T15:58:10.249076+0000","last_peered":"2023-07-14T15:58:10.249076+0000","last_clean":"2023-07-14T15:58:10.249076+0000","last_became_active":"2023-07-14T15:58:08.741224+0000","last_became_peered":"2023-07-14T15:58:08.741224+0000","last_unstale":"2023-07-14T15:58:10.249076+0000","last_undegraded":"2023-07-14T15:58:10.249076+0000","last_fullsized":"2023-07-14T15:58:10.249076+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:18:49.473467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167804+0000","last_change":"2023-07-14T15:58:07.734306+0000","last_active":"2023-07-14T15:58:10.167804+0000","last_peered":"2023-07-14T15:58:10.167804+0000","last_clean":"2023-07-14T15:58:10.167804+0000","last_became_active":"2023-07-14T15:58:07.733956+0000","last_became_peered":"2023-07-14T15:58:07.733956+0000","last_unstale":"2023-07-14T15:58:10.167804+0000","last_undegraded":"2023-07-14T15:58:10.167804+0000","last_fullsized":"2023-07-14T15:58:10.167804+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:32:13.169004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.726184+0000","last_change":"2023-07-14T15:58:07.726184+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.726184+0000","last_undegraded":"2023-07-14T15:58:07.726184+0000","last_fullsized":"2023-07-14T15:58:07.726184+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.733252+0000","last_change":"2023-07-14T15:58:07.728853+0000","last_active":"2023-07-14T15:58:07.733252+0000","last_peered":"2023-07-14T15:58:07.733252+0000","last_clean":"2023-07-14T15:58:07.733252+0000","last_became_active":"2023-07-14T15:58:07.728594+0000","last_became_peered":"2023-07-14T15:58:07.728594+0000","last_unstale":"2023-07-14T15:58:07.733252+0000","last_undegraded":"2023-07-14T15:58:07.733252+0000","last_fullsized":"2023-07-14T15:58:07.733252+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:24:04.951787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.717478+0000","last_change":"2023-07-14T15:58:07.717478+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.717478+0000","last_undegraded":"2023-07-14T15:58:07.717478+0000","last_fullsized":"2023-07-14T15:58:07.717478+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.738564+0000","last_change":"2023-07-14T15:58:07.734654+0000","last_active":"2023-07-14T15:58:07.738564+0000","last_peered":"2023-07-14T15:58:07.738564+0000","last_clean":"2023-07-14T15:58:07.738564+0000","last_became_active":"2023-07-14T15:58:07.734360+0000","last_became_peered":"2023-07-14T15:58:07.734360+0000","last_unstale":"2023-07-14T15:58:07.738564+0000","last_undegraded":"2023-07-14T15:58:07.738564+0000","last_fullsized":"2023-07-14T15:58:07.738564+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:50:37.553786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.720869+0000","last_change":"2023-07-14T15:58:07.720869+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.720869+0000","last_undegraded":"2023-07-14T15:58:07.720869+0000","last_fullsized":"2023-07-14T15:58:07.720869+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.741501+0000","last_change":"2023-07-14T15:58:07.736644+0000","last_active":"2023-07-14T15:58:07.741501+0000","last_peered":"2023-07-14T15:58:07.741501+0000","last_clean":"2023-07-14T15:58:07.741501+0000","last_became_active":"2023-07-14T15:58:07.736358+0000","last_became_peered":"2023-07-14T15:58:07.736358+0000","last_unstale":"2023-07-14T15:58:07.741501+0000","last_undegraded":"2023-07-14T15:58:07.741501+0000","last_fullsized":"2023-07-14T15:58:07.741501+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:07:07.548207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.248655+0000","last_change":"2023-07-14T15:58:08.735289+0000","last_active":"2023-07-14T15:58:10.248655+0000","last_peered":"2023-07-14T15:58:10.248655+0000","last_clean":"2023-07-14T15:58:10.248655+0000","last_became_active":"2023-07-14T15:58:08.734993+0000","last_became_peered":"2023-07-14T15:58:08.734993+0000","last_unstale":"2023-07-14T15:58:10.248655+0000","last_undegraded":"2023-07-14T15:58:10.248655+0000","last_fullsized":"2023-07-14T15:58:10.248655+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:26:31.914734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.738599+0000","last_change":"2023-07-14T15:58:07.734503+0000","last_active":"2023-07-14T15:58:07.738599+0000","last_peered":"2023-07-14T15:58:07.738599+0000","last_clean":"2023-07-14T15:58:07.738599+0000","last_became_active":"2023-07-14T15:58:07.734137+0000","last_became_peered":"2023-07-14T15:58:07.734137+0000","last_unstale":"2023-07-14T15:58:07.738599+0000","last_undegraded":"2023-07-14T15:58:07.738599+0000","last_fullsized":"2023-07-14T15:58:07.738599+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:26:43.367167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.718942+0000","last_change":"2023-07-14T15:58:07.718942+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.718942+0000","last_undegraded":"2023-07-14T15:58:07.718942+0000","last_fullsized":"2023-07-14T15:58:07.718942+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"48'1","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167821+0000","last_change":"2023-07-14T15:58:07.725878+0000","last_active":"2023-07-14T15:58:10.167821+0000","last_peered":"2023-07-14T15:58:10.167821+0000","last_clean":"2023-07-14T15:58:10.167821+0000","last_became_active":"2023-07-14T15:58:07.725549+0000","last_became_peered":"2023-07-14T15:58:07.725549+0000","last_unstale":"2023-07-14T15:58:10.167821+0000","last_undegraded":"2023-07-14T15:58:10.167821+0000","last_fullsized":"2023-07-14T15:58:10.167821+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:22:14.282584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.723135+0000","last_change":"2023-07-14T15:58:07.723135+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.723135+0000","last_undegraded":"2023-07-14T15:58:07.723135+0000","last_fullsized":"2023-07-14T15:58:07.723135+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.738614+0000","last_change":"2023-07-14T15:58:07.736136+0000","last_active":"2023-07-14T15:58:07.738614+0000","last_peered":"2023-07-14T15:58:07.738614+0000","last_clean":"2023-07-14T15:58:07.738614+0000","last_became_active":"2023-07-14T15:58:07.735841+0000","last_became_peered":"2023-07-14T15:58:07.735841+0000","last_unstale":"2023-07-14T15:58:07.738614+0000","last_undegraded":"2023-07-14T15:58:07.738614+0000","last_fullsized":"2023-07-14T15:58:07.738614+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:55:42.052044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.721077+0000","last_change":"2023-07-14T15:58:07.721077+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.721077+0000","last_undegraded":"2023-07-14T15:58:07.721077+0000","last_fullsized":"2023-07-14T15:58:07.721077+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"48'2","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.248871+0000","last_change":"2023-07-14T15:58:07.731047+0000","last_active":"2023-07-14T15:58:10.248871+0000","last_peered":"2023-07-14T15:58:10.248871+0000","last_clean":"2023-07-14T15:58:10.248871+0000","last_became_active":"2023-07-14T15:58:07.730760+0000","last_became_peered":"2023-07-14T15:58:07.730760+0000","last_unstale":"2023-07-14T15:58:10.248871+0000","last_undegraded":"2023-07-14T15:58:10.248871+0000","last_fullsized":"2023-07-14T15:58:10.248871+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:54:17.765585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167946+0000","last_change":"2023-07-14T15:58:08.738893+0000","last_active":"2023-07-14T15:58:10.167946+0000","last_peered":"2023-07-14T15:58:10.167946+0000","last_clean":"2023-07-14T15:58:10.167946+0000","last_became_active":"2023-07-14T15:58:08.738584+0000","last_became_peered":"2023-07-14T15:58:08.738584+0000","last_unstale":"2023-07-14T15:58:10.167946+0000","last_undegraded":"2023-07-14T15:58:10.167946+0000","last_fullsized":"2023-07-14T15:58:10.167946+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:32:48.130235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.738512+0000","last_change":"2023-07-14T15:58:07.732320+0000","last_active":"2023-07-14T15:58:07.738512+0000","last_peered":"2023-07-14T15:58:07.738512+0000","last_clean":"2023-07-14T15:58:07.738512+0000","last_became_active":"2023-07-14T15:58:07.732044+0000","last_became_peered":"2023-07-14T15:58:07.732044+0000","last_unstale":"2023-07-14T15:58:07.738512+0000","last_undegraded":"2023-07-14T15:58:07.738512+0000","last_fullsized":"2023-07-14T15:58:07.738512+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:45:12.894608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.248814+0000","last_change":"2023-07-14T15:58:08.743134+0000","last_active":"2023-07-14T15:58:10.248814+0000","last_peered":"2023-07-14T15:58:10.248814+0000","last_clean":"2023-07-14T15:58:10.248814+0000","last_became_active":"2023-07-14T15:58:08.742797+0000","last_became_peered":"2023-07-14T15:58:08.742797+0000","last_unstale":"2023-07-14T15:58:10.248814+0000","last_undegraded":"2023-07-14T15:58:10.248814+0000","last_fullsized":"2023-07-14T15:58:10.248814+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:08:36.025877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.737725+0000","last_change":"2023-07-14T15:58:07.733527+0000","last_active":"2023-07-14T15:58:07.737725+0000","last_peered":"2023-07-14T15:58:07.737725+0000","last_clean":"2023-07-14T15:58:07.737725+0000","last_became_active":"2023-07-14T15:58:07.733219+0000","last_became_peered":"2023-07-14T15:58:07.733219+0000","last_unstale":"2023-07-14T15:58:07.737725+0000","last_undegraded":"2023-07-14T15:58:07.737725+0000","last_fullsized":"2023-07-14T15:58:07.737725+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:26:43.367167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.724269+0000","last_change":"2023-07-14T15:58:07.724269+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.724269+0000","last_undegraded":"2023-07-14T15:58:07.724269+0000","last_fullsized":"2023-07-14T15:58:07.724269+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.735135+0000","last_change":"2023-07-14T15:58:07.731843+0000","last_active":"2023-07-14T15:58:07.735135+0000","last_peered":"2023-07-14T15:58:07.735135+0000","last_clean":"2023-07-14T15:58:07.735135+0000","last_became_active":"2023-07-14T15:58:07.731548+0000","last_became_peered":"2023-07-14T15:58:07.731548+0000","last_unstale":"2023-07-14T15:58:07.735135+0000","last_undegraded":"2023-07-14T15:58:07.735135+0000","last_fullsized":"2023-07-14T15:58:07.735135+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:48:57.461682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.723098+0000","last_change":"2023-07-14T15:58:07.723098+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.723098+0000","last_undegraded":"2023-07-14T15:58:07.723098+0000","last_fullsized":"2023-07-14T15:58:07.723098+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.731640+0000","last_change":"2023-07-14T15:58:07.728047+0000","last_active":"2023-07-14T15:58:07.731640+0000","last_peered":"2023-07-14T15:58:07.731640+0000","last_clean":"2023-07-14T15:58:07.731640+0000","last_became_active":"2023-07-14T15:58:07.727789+0000","last_became_peered":"2023-07-14T15:58:07.727789+0000","last_unstale":"2023-07-14T15:58:07.731640+0000","last_undegraded":"2023-07-14T15:58:07.731640+0000","last_fullsized":"2023-07-14T15:58:07.731640+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:16:03.073064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":62,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.727542+0000","last_change":"2023-07-14T15:56:02.621850+0000","last_active":"2023-07-14T15:58:07.727542+0000","last_peered":"2023-07-14T15:58:07.727542+0000","last_clean":"2023-07-14T15:58:07.727542+0000","last_became_active":"2023-07-14T15:56:02.621471+0000","last_became_peered":"2023-07-14T15:56:02.621471+0000","last_unstale":"2023-07-14T15:58:07.727542+0000","last_undegraded":"2023-07-14T15:58:07.727542+0000","last_fullsized":"2023-07-14T15:58:07.727542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:50:29.634950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167727+0000","last_change":"2023-07-14T15:58:08.735834+0000","last_active":"2023-07-14T15:58:10.167727+0000","last_peered":"2023-07-14T15:58:10.167727+0000","last_clean":"2023-07-14T15:58:10.167727+0000","last_became_active":"2023-07-14T15:58:08.735483+0000","last_became_peered":"2023-07-14T15:58:08.735483+0000","last_unstale":"2023-07-14T15:58:10.167727+0000","last_undegraded":"2023-07-14T15:58:10.167727+0000","last_fullsized":"2023-07-14T15:58:10.167727+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:24:16.022757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.737332+0000","last_change":"2023-07-14T15:58:07.732308+0000","last_active":"2023-07-14T15:58:07.737332+0000","last_peered":"2023-07-14T15:58:07.737332+0000","last_clean":"2023-07-14T15:58:07.737332+0000","last_became_active":"2023-07-14T15:58:07.732001+0000","last_became_peered":"2023-07-14T15:58:07.732001+0000","last_unstale":"2023-07-14T15:58:07.737332+0000","last_undegraded":"2023-07-14T15:58:07.737332+0000","last_fullsized":"2023-07-14T15:58:07.737332+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:23:53.549331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":64,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.725964+0000","last_change":"2023-07-14T15:56:02.621963+0000","last_active":"2023-07-14T15:58:07.725964+0000","last_peered":"2023-07-14T15:58:07.725964+0000","last_clean":"2023-07-14T15:58:07.725964+0000","last_became_active":"2023-07-14T15:56:02.621678+0000","last_became_peered":"2023-07-14T15:56:02.621678+0000","last_unstale":"2023-07-14T15:58:07.725964+0000","last_undegraded":"2023-07-14T15:58:07.725964+0000","last_fullsized":"2023-07-14T15:58:07.725964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:17:21.248756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.716992+0000","last_change":"2023-07-14T15:58:07.716992+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.716992+0000","last_undegraded":"2023-07-14T15:58:07.716992+0000","last_fullsized":"2023-07-14T15:58:07.716992+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.732661+0000","last_change":"2023-07-14T15:58:07.729039+0000","last_active":"2023-07-14T15:58:07.732661+0000","last_peered":"2023-07-14T15:58:07.732661+0000","last_clean":"2023-07-14T15:58:07.732661+0000","last_became_active":"2023-07-14T15:58:07.728779+0000","last_became_peered":"2023-07-14T15:58:07.728779+0000","last_unstale":"2023-07-14T15:58:07.732661+0000","last_undegraded":"2023-07-14T15:58:07.732661+0000","last_fullsized":"2023-07-14T15:58:07.732661+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:32:07.890972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.727698+0000","last_change":"2023-07-14T15:56:01.925110+0000","last_active":"2023-07-14T15:58:07.727698+0000","last_peered":"2023-07-14T15:58:07.727698+0000","last_clean":"2023-07-14T15:58:07.727698+0000","last_became_active":"2023-07-14T15:56:01.924723+0000","last_became_peered":"2023-07-14T15:56:01.924723+0000","last_unstale":"2023-07-14T15:58:07.727698+0000","last_undegraded":"2023-07-14T15:58:07.727698+0000","last_fullsized":"2023-07-14T15:58:07.727698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:46:51.667515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T15:58:08.733483+0000","last_change":"2023-07-14T15:58:08.730413+0000","last_active":"2023-07-14T15:58:08.733483+0000","last_peered":"2023-07-14T15:58:08.733483+0000","last_clean":"2023-07-14T15:58:08.733483+0000","last_became_active":"2023-07-14T15:58:08.730120+0000","last_became_peered":"2023-07-14T15:58:08.730120+0000","last_unstale":"2023-07-14T15:58:08.733483+0000","last_undegraded":"2023-07-14T15:58:08.733483+0000","last_fullsized":"2023-07-14T15:58:08.733483+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:24:06.908513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.737745+0000","last_change":"2023-07-14T15:58:07.734443+0000","last_active":"2023-07-14T15:58:07.737745+0000","last_peered":"2023-07-14T15:58:07.737745+0000","last_clean":"2023-07-14T15:58:07.737745+0000","last_became_active":"2023-07-14T15:58:07.734185+0000","last_became_peered":"2023-07-14T15:58:07.734185+0000","last_unstale":"2023-07-14T15:58:07.737745+0000","last_undegraded":"2023-07-14T15:58:07.737745+0000","last_fullsized":"2023-07-14T15:58:07.737745+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:07:07.548207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":64,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.726148+0000","last_change":"2023-07-14T15:56:01.923465+0000","last_active":"2023-07-14T15:58:07.726148+0000","last_peered":"2023-07-14T15:58:07.726148+0000","last_clean":"2023-07-14T15:58:07.726148+0000","last_became_active":"2023-07-14T15:56:01.923160+0000","last_became_peered":"2023-07-14T15:56:01.923160+0000","last_unstale":"2023-07-14T15:58:07.726148+0000","last_undegraded":"2023-07-14T15:58:07.726148+0000","last_fullsized":"2023-07-14T15:58:07.726148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:37:17.847750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":210,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167486+0000","last_change":"2023-07-14T15:55:54.040065+0000","last_active":"2023-07-14T15:58:10.167486+0000","last_peered":"2023-07-14T15:58:10.167486+0000","last_clean":"2023-07-14T15:58:10.167486+0000","last_became_active":"2023-07-14T15:55:54.038885+0000","last_became_peered":"2023-07-14T15:55:54.038885+0000","last_unstale":"2023-07-14T15:58:10.167486+0000","last_undegraded":"2023-07-14T15:58:10.167486+0000","last_fullsized":"2023-07-14T15:58:10.167486+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:55:53.025696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:55:53.025696+0000","last_clean_scrub_stamp":"2023-07-14T15:55:53.025696+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:02:02.551339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.721138+0000","last_change":"2023-07-14T15:58:07.721138+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.721138+0000","last_undegraded":"2023-07-14T15:58:07.721138+0000","last_fullsized":"2023-07-14T15:58:07.721138+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.738477+0000","last_change":"2023-07-14T15:58:07.736838+0000","last_active":"2023-07-14T15:58:07.738477+0000","last_peered":"2023-07-14T15:58:07.738477+0000","last_clean":"2023-07-14T15:58:07.738477+0000","last_became_active":"2023-07-14T15:58:07.735691+0000","last_became_peered":"2023-07-14T15:58:07.735691+0000","last_unstale":"2023-07-14T15:58:07.738477+0000","last_undegraded":"2023-07-14T15:58:07.738477+0000","last_fullsized":"2023-07-14T15:58:07.738477+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:20:19.529745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":64,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.725920+0000","last_change":"2023-07-14T15:56:01.920714+0000","last_active":"2023-07-14T15:58:07.725920+0000","last_peered":"2023-07-14T15:58:07.725920+0000","last_clean":"2023-07-14T15:58:07.725920+0000","last_became_active":"2023-07-14T15:56:01.920325+0000","last_became_peered":"2023-07-14T15:56:01.920325+0000","last_unstale":"2023-07-14T15:58:07.725920+0000","last_undegraded":"2023-07-14T15:58:07.725920+0000","last_fullsized":"2023-07-14T15:58:07.725920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:14:38.312671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.724821+0000","last_change":"2023-07-14T15:58:07.724821+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.724821+0000","last_undegraded":"2023-07-14T15:58:07.724821+0000","last_fullsized":"2023-07-14T15:58:07.724821+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167704+0000","last_change":"2023-07-14T15:58:07.736616+0000","last_active":"2023-07-14T15:58:10.167704+0000","last_peered":"2023-07-14T15:58:10.167704+0000","last_clean":"2023-07-14T15:58:10.167704+0000","last_became_active":"2023-07-14T15:58:07.736315+0000","last_became_peered":"2023-07-14T15:58:07.736315+0000","last_unstale":"2023-07-14T15:58:10.167704+0000","last_undegraded":"2023-07-14T15:58:10.167704+0000","last_fullsized":"2023-07-14T15:58:10.167704+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:23:07.012317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":64,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.726654+0000","last_change":"2023-07-14T15:56:01.923631+0000","last_active":"2023-07-14T15:58:07.726654+0000","last_peered":"2023-07-14T15:58:07.726654+0000","last_clean":"2023-07-14T15:58:07.726654+0000","last_became_active":"2023-07-14T15:56:01.922783+0000","last_became_peered":"2023-07-14T15:56:01.922783+0000","last_unstale":"2023-07-14T15:58:07.726654+0000","last_undegraded":"2023-07-14T15:58:07.726654+0000","last_fullsized":"2023-07-14T15:58:07.726654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:49:34.604728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.721620+0000","last_change":"2023-07-14T15:58:07.721620+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.721620+0000","last_undegraded":"2023-07-14T15:58:07.721620+0000","last_fullsized":"2023-07-14T15:58:07.721620+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.737804+0000","last_change":"2023-07-14T15:58:07.734768+0000","last_active":"2023-07-14T15:58:07.737804+0000","last_peered":"2023-07-14T15:58:07.737804+0000","last_clean":"2023-07-14T15:58:07.737804+0000","last_became_active":"2023-07-14T15:58:07.734498+0000","last_became_peered":"2023-07-14T15:58:07.734498+0000","last_unstale":"2023-07-14T15:58:07.737804+0000","last_undegraded":"2023-07-14T15:58:07.737804+0000","last_fullsized":"2023-07-14T15:58:07.737804+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:26:05.861976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":55,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.719245+0000","last_change":"2023-07-14T15:56:01.965649+0000","last_active":"2023-07-14T15:58:07.719245+0000","last_peered":"2023-07-14T15:58:07.719245+0000","last_clean":"2023-07-14T15:58:07.719245+0000","last_became_active":"2023-07-14T15:56:01.965344+0000","last_became_peered":"2023-07-14T15:56:01.965344+0000","last_unstale":"2023-07-14T15:58:07.719245+0000","last_undegraded":"2023-07-14T15:58:07.719245+0000","last_fullsized":"2023-07-14T15:58:07.719245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:49:21.926040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.718370+0000","last_change":"2023-07-14T15:58:07.718370+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.718370+0000","last_undegraded":"2023-07-14T15:58:07.718370+0000","last_fullsized":"2023-07-14T15:58:07.718370+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.733972+0000","last_change":"2023-07-14T15:58:07.730397+0000","last_active":"2023-07-14T15:58:07.733972+0000","last_peered":"2023-07-14T15:58:07.733972+0000","last_clean":"2023-07-14T15:58:07.733972+0000","last_became_active":"2023-07-14T15:58:07.729703+0000","last_became_peered":"2023-07-14T15:58:07.729703+0000","last_unstale":"2023-07-14T15:58:07.733972+0000","last_undegraded":"2023-07-14T15:58:07.733972+0000","last_fullsized":"2023-07-14T15:58:07.733972+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:20:56.952309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.726496+0000","last_change":"2023-07-14T15:56:01.966578+0000","last_active":"2023-07-14T15:58:07.726496+0000","last_peered":"2023-07-14T15:58:07.726496+0000","last_clean":"2023-07-14T15:58:07.726496+0000","last_became_active":"2023-07-14T15:56:01.966216+0000","last_became_peered":"2023-07-14T15:56:01.966216+0000","last_unstale":"2023-07-14T15:58:07.726496+0000","last_undegraded":"2023-07-14T15:58:07.726496+0000","last_fullsized":"2023-07-14T15:58:07.726496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:54:53.435442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":652,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476767,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":528,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":540672,"data_stored":228600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.44800000000000001,"15min":0.45000000000000001},"min":{"1min":0.29799999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.58999999999999997,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.753},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.46300000000000002,"15min":0.47299999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.57599999999999996,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.52000000000000002}]},{"osd":1,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.57799999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.52100000000000002,"15min":0.52300000000000002},"min":{"1min":0.38600000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.67500000000000004,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.435}]},{"osd":2,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.504,"15min":0.505},"min":{"1min":0.40300000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.66700000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.74199999999999999,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.67500000000000004}]},{"osd":4,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.755,"15min":0.76500000000000001},"min":{"1min":0.503,"5min":0.441,"15min":0.441},"max":{"1min":1.0189999999999999,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.76600000000000001,"15min":0.77400000000000002},"min":{"1min":0.53900000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.88400000000000001,"5min":1.542,"15min":1.542},"last":0.77300000000000002}]},{"osd":5,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.84199999999999997,"15min":0.85599999999999998},"min":{"1min":0.625,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.95299999999999996,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.84599999999999997,"15min":0.85699999999999998},"min":{"1min":0.60899999999999999,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.94599999999999995,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.97499999999999998}]},{"osd":6,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.80800000000000005,"15min":0.81899999999999995},"min":{"1min":0.55900000000000005,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.98799999999999999,"5min":1.52,"15min":1.52},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.79900000000000004,"15min":0.81200000000000006},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.86099999999999999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.86399999999999999}]},{"osd":7,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.77400000000000002,"15min":0.77700000000000002},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.96499999999999997,"5min":1.232,"15min":1.232},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.84299999999999997,"15min":0.85699999999999998},"min":{"1min":0.55500000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.94899999999999995,"5min":1.478,"15min":1.478},"last":0.83299999999999996}]}]},{"osd":0,"up_from":16,"seq":68719476768,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":528,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":540672,"data_stored":228600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42299999999999999,"15min":0.42399999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.67500000000000004,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.48499999999999999,"15min":0.48899999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.61599999999999999,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.498}]},{"osd":2,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.499,"15min":0.5},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.50800000000000001,"15min":0.505},"min":{"1min":0.41499999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.41299999999999998}]},{"osd":3,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47899999999999998,"15min":0.48099999999999998},"min":{"1min":0.38100000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.60699999999999998,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.57299999999999995,"15min":0.57699999999999996},"min":{"1min":0.42399999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76500000000000001,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.434}]},{"osd":4,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.99399999999999999,"5min":1.04,"15min":1.04},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.78000000000000003,"15min":0.78900000000000003},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.91000000000000003,"5min":1.331,"15min":1.331},"last":0.85999999999999999}]},{"osd":5,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.60999999999999999,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.119,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.56999999999999995,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0289999999999999,"5min":1.087,"15min":1.087},"last":0.877}]},{"osd":6,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.77500000000000002,"15min":0.78100000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0029999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.80100000000000005,"15min":0.80500000000000005},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.056,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.72799999999999998}]},{"osd":7,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.80100000000000005,"15min":0.80800000000000005},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.99399999999999999,"5min":1.262,"15min":1.262},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.79700000000000004,"15min":0.80100000000000005},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.97799999999999998,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.79200000000000004}]}]},{"osd":6,"up_from":14,"seq":60129542175,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":556,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":569344,"data_stored":242963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.621,"15min":0.61699999999999999},"min":{"1min":0.40999999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.82399999999999995,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64700000000000002,"15min":0.64600000000000002},"min":{"1min":0.496,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81599999999999995,"5min":1.266,"15min":1.266},"last":0.60699999999999998}]},{"osd":1,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.69799999999999995,"15min":0.70299999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88700000000000001,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.72199999999999998,"15min":0.71699999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.86699999999999999}]},{"osd":2,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.88500000000000001,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.68600000000000005,"15min":0.69099999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.75600000000000001}]},{"osd":3,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.78200000000000003,"15min":0.80400000000000005},"min":{"1min":0.48099999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.85999999999999999,"5min":3.141,"15min":3.141},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.752,"15min":0.753},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.94999999999999996,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.68200000000000005}]},{"osd":4,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.63,"15min":0.63300000000000001},"min":{"1min":0.432,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.83499999999999996,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.70899999999999996,"15min":0.71199999999999997},"min":{"1min":0.47599999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.92300000000000004,"5min":1.024,"15min":1.024},"last":0.55100000000000005}]},{"osd":5,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.748,"15min":0.751},"min":{"1min":0.51700000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.96999999999999997,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73599999999999999,"15min":0.73999999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.012,"5min":1.091,"15min":1.091},"last":0.80200000000000005}]},{"osd":7,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.72499999999999998,"15min":0.72899999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.92500000000000004,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.82399999999999995,"15min":0.82899999999999996},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":0.996,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.83899999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542174,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":1136,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1163264,"data_stored":832819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.60699999999999998,"15min":0.64200000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.53100000000000003,"5min":4.5519999999999996,"15min":4.5519999999999996},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":1.147,"15min":1.2609999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.70899999999999996,"5min":15.911,"15min":15.911},"last":0.53500000000000003}]},{"osd":2,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.45700000000000002,"15min":0.46400000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.53300000000000003,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.436},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.67300000000000004,"15min":0.70599999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.57299999999999995,"5min":4.5140000000000002,"15min":4.5140000000000002},"last":0.55700000000000005}]},{"osd":3,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.70199999999999996,"15min":0.73599999999999999},"min":{"1min":0.378,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.65500000000000003,"5min":4.452,"15min":4.452},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.70299999999999996,"15min":0.73899999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.57999999999999996,"5min":4.2279999999999998,"15min":4.2279999999999998},"last":0.48599999999999999}]},{"osd":4,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.88400000000000001,"15min":0.92000000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.81899999999999995,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.92200000000000004,"15min":0.95999999999999996},"min":{"1min":0.52400000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.95699999999999996,"5min":4.9109999999999996,"15min":4.9109999999999996},"last":0.61099999999999999}]},{"osd":5,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.90000000000000002,"15min":0.93300000000000005},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.98999999999999999,"5min":4.1269999999999998,"15min":4.1269999999999998},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.93799999999999994,"15min":0.97399999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.93700000000000006,"5min":4.585,"15min":4.585},"last":0.67700000000000005}]},{"osd":6,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.93300000000000005,"15min":0.97099999999999997},"min":{"1min":0.56899999999999995,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0369999999999999,"5min":4.9880000000000004,"15min":4.9880000000000004},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.92900000000000005,"15min":0.96299999999999997},"min":{"1min":0.58499999999999996,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94599999999999995,"5min":4.1660000000000004,"15min":4.1660000000000004},"last":0.747}]},{"osd":7,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.98199999999999998,"15min":1.0249999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.0429999999999999,"5min":4.9530000000000003,"15min":4.9530000000000003},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.94599999999999995,"15min":0.98099999999999998},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.048,"5min":4.1959999999999997,"15min":4.1959999999999997},"last":0.79000000000000004}]}]},{"osd":2,"up_from":15,"seq":64424509471,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":528384,"data_stored":221972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.42699999999999999,"15min":0.433},"min":{"1min":0.32200000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.51900000000000002,"5min":0.62,"15min":0.62},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.47299999999999998,"15min":0.48299999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.57999999999999996,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.39600000000000002}]},{"osd":1,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.52400000000000002,"15min":0.53100000000000003},"min":{"1min":0.315,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76200000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.46899999999999997,"15min":0.47099999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.65100000000000002,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.436}]},{"osd":3,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.58799999999999997,"15min":0.60199999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.63600000000000001,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.53200000000000003,"15min":0.53800000000000003},"min":{"1min":0.433,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.53700000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.53500000000000003}]},{"osd":4,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.72399999999999998,"15min":0.72799999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.169,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.74299999999999999,"15min":0.747},"min":{"1min":0.53300000000000003,"5min":0.437,"15min":0.437},"max":{"1min":0.90100000000000002,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.62}]},{"osd":5,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.77300000000000002,"15min":0.78100000000000003},"min":{"1min":0.55700000000000005,"5min":0.505,"15min":0.505},"max":{"1min":1.002,"5min":1.391,"15min":1.391},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.75600000000000001,"15min":0.76200000000000001},"min":{"1min":0.50700000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.153,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.66200000000000003}]},{"osd":6,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.79000000000000004,"15min":0.80300000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0960000000000001,"5min":1.51,"15min":1.51},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.81599999999999995,"15min":0.82999999999999996},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1319999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.73599999999999999}]},{"osd":7,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.78300000000000003,"15min":0.79400000000000004},"min":{"1min":0.54700000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.048,"5min":1.288,"15min":1.288},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.81799999999999995,"15min":0.82799999999999996},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.71899999999999997}]}]},{"osd":4,"up_from":15,"seq":64424509470,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":528384,"data_stored":221972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.67700000000000005,"15min":0.68700000000000006},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.64700000000000002,"15min":0.65700000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88300000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.496}]},{"osd":1,"last update":"Fri Jul 14 15:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.67000000000000004,"15min":0.67600000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.81999999999999995,"5min":0.87,"15min":0.87},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.65100000000000002,"15min":0.66000000000000003},"min":{"1min":0.44400000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.82899999999999996,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.47599999999999998}]},{"osd":2,"last update":"Fri Jul 14 15:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64400000000000002,"15min":0.65000000000000002},"min":{"1min":0.441,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.71599999999999997,"15min":0.72899999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.80900000000000005,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.55100000000000005}]},{"osd":3,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.68400000000000005,"15min":0.68799999999999994},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.86699999999999999,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.72799999999999998,"15min":0.73499999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.94299999999999995,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.752}]},{"osd":5,"last update":"Fri Jul 14 15:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65900000000000003,"15min":0.66400000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.83499999999999996,"5min":1.119,"15min":1.119},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.70699999999999996,"15min":0.71599999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.88200000000000001,"5min":1.157,"15min":1.157},"last":0.71999999999999997}]},{"osd":6,"last update":"Fri Jul 14 15:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.70199999999999996,"15min":0.71399999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.86199999999999999,"5min":1.04,"15min":1.04},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.89800000000000002,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.66400000000000003}]},{"osd":7,"last update":"Fri Jul 14 15:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.755,"15min":0.76700000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93799999999999994,"5min":1.202,"15min":1.202},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.77900000000000003,"15min":0.79100000000000004},"min":{"1min":0.53900000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.92100000000000004,"5min":1.137,"15min":1.137},"last":0.65600000000000003}]}]},{"osd":5,"up_from":15,"seq":64424509472,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28060,"kb_used_data":1108,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343780,"statfs":{"total":96636764160,"available":96608030720,"internally_reserved":0,"allocated":1134592,"data_stored":818968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.66400000000000003,"15min":0.67200000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.86099999999999999,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.97799999999999998,"15min":1.038},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.80600000000000005,"5min":8.1500000000000004,"15min":8.1500000000000004},"last":0.64200000000000002}]},{"osd":1,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.67200000000000004,"15min":0.67600000000000005},"min":{"1min":0.51200000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.98799999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.66400000000000003,"15min":0.67000000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.76800000000000002,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.54200000000000004}]},{"osd":2,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.75800000000000001,"15min":0.77100000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.873,"5min":1.085,"15min":1.085},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.72499999999999998,"15min":0.73699999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.86599999999999999,"5min":1.048,"15min":1.048},"last":0.56699999999999995}]},{"osd":3,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.69299999999999995,"15min":0.70099999999999996},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.82299999999999995,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.80000000000000004,"15min":0.81000000000000005},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":0.91700000000000004,"5min":1.083,"15min":1.083},"last":0.75900000000000001}]},{"osd":4,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68999999999999995,"15min":0.69199999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.65700000000000003,"15min":0.66300000000000003},"min":{"1min":0.441,"5min":0.438,"15min":0.438},"max":{"1min":0.82099999999999995,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.61599999999999999}]},{"osd":6,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.69899999999999995,"15min":0.71299999999999997},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.871,"5min":1.121,"15min":1.121},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.78700000000000003,"15min":0.80100000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.93799999999999994,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":1.1699999999999999}]},{"osd":7,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.74399999999999999,"15min":0.751},"min":{"1min":0.58199999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.875,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":1.149},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.81699999999999995,"15min":0.83099999999999996},"min":{"1min":0.53800000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.94699999999999995,"5min":1.605,"15min":1.605},"last":1.492}]}]},{"osd":7,"up_from":15,"seq":64424509471,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":528384,"data_stored":221972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.61799999999999999,"15min":0.61499999999999999},"min":{"1min":0.39300000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0089999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.80400000000000005,"15min":0.82499999999999996},"min":{"1min":0.44400000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0820000000000001,"5min":4.5919999999999996,"15min":4.5919999999999996},"last":0.74199999999999999}]},{"osd":1,"last update":"Fri Jul 14 15:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.66700000000000004,"15min":0.66900000000000004},"min":{"1min":0.442,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98299999999999998,"5min":1,"15min":1},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.86199999999999999,"15min":0.89600000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88100000000000001,"5min":4.665,"15min":4.665},"last":0.79200000000000004}]},{"osd":2,"last update":"Fri Jul 14 15:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.872,"15min":0.91200000000000003},"min":{"1min":0.50600000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.86699999999999999,"5min":5.4089999999999998,"15min":5.4089999999999998},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.76700000000000002,"15min":0.77500000000000002},"min":{"1min":0.497,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0389999999999999,"5min":2.165,"15min":2.165},"last":0.88200000000000001}]},{"osd":3,"last update":"Fri Jul 14 15:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.753,"15min":0.76100000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.96199999999999997,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.80600000000000005,"15min":0.82399999999999995},"min":{"1min":0.49299999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.92500000000000004,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":0.77000000000000002}]},{"osd":4,"last update":"Fri Jul 14 15:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.63900000000000001,"15min":0.64100000000000001},"min":{"1min":0.41099999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89200000000000002,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.65400000000000003,"15min":0.65900000000000003},"min":{"1min":0.37,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.77800000000000002,"5min":1.111,"15min":1.111},"last":0.67600000000000005}]},{"osd":5,"last update":"Fri Jul 14 15:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.65100000000000002,"15min":0.65900000000000003},"min":{"1min":0.40400000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.80500000000000005,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.73799999999999999,"15min":0.747},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.89800000000000002,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.90500000000000003}]},{"osd":6,"last update":"Fri Jul 14 15:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69799999999999995,"15min":0.70499999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84799999999999998,"5min":1.042,"15min":1.042},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.76100000000000001,"15min":0.77700000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.83799999999999997,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.83699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T15:58:13.664 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T15:58:13.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.914+0000 7f68c63ff700 1 Processor -- start 2023-07-14T15:58:13.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.914+0000 7f68c63ff700 1 -- start start 2023-07-14T15:58:13.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.915+0000 7f68c63ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f68c00b8720 0x7f68c0160190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:13.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.915+0000 7f68c63ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68c00cd760 con 0x7f68c00d2680 2023-07-14T15:58:13.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.915+0000 7f68c63ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68c00d18a0 con 0x7f68c00b20d0 2023-07-14T15:58:13.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.915+0000 7f68c63ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68c00cd4f0 con 0x7f68c00b8720 2023-07-14T15:58:13.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.915+0000 7f68c499c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f68c00d2680 0x7f68c00d2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47014/0 (socket says 172.21.15.37:47014) 2023-07-14T15:58:13.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.915+0000 7f68c499c700 1 -- 172.21.15.37:0/3394663781 learned_addr learned my addr 172.21.15.37:0/3394663781 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:58:13.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.916+0000 7f68bffff700 1 --2- 172.21.15.37:0/3394663781 >> v2:172.21.15.98:3300/0 conn(0x7f68c00b8720 0x7f68c0160190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:13.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.916+0000 7f68beffd700 1 -- 172.21.15.37:0/3394663781 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 88781280 0 0) 0x7f68c00cd760 con 0x7f68c00d2680 2023-07-14T15:58:13.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.916+0000 7f68beffd700 1 -- 172.21.15.37:0/3394663781 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68a80035b0 con 0x7f68c00d2680 2023-07-14T15:58:13.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.916+0000 7f68beffd700 1 -- 172.21.15.37:0/3394663781 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4216103494 0 0) 0x7f68c00d18a0 con 0x7f68c00b20d0 2023-07-14T15:58:13.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.916+0000 7f68beffd700 1 -- 172.21.15.37:0/3394663781 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68c00cd760 con 0x7f68c00b20d0 2023-07-14T15:58:13.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.916+0000 7f68bffff700 1 -- 172.21.15.37:0/3394663781 >> v1:172.21.15.98:6789/0 conn(0x7f68c00b20d0 legacy=0x7f68c01606d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:13.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.916+0000 7f68bffff700 1 -- 172.21.15.37:0/3394663781 >> v1:172.21.15.37:6789/0 conn(0x7f68c00d2680 legacy=0x7f68c00d2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:13.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.916+0000 7f68bffff700 1 -- 172.21.15.37:0/3394663781 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c00d1b80 con 0x7f68c00b8720 2023-07-14T15:58:13.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.916+0000 7f68bffff700 1 --2- 172.21.15.37:0/3394663781 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68c00b8720 0x7f68c0160190 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f68b0009840 tx=0x7f68b0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f766df5d280d3970 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:13.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.917+0000 7f68beffd700 1 -- 172.21.15.37:0/3394663781 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b0011830 con 0x7f68c00b8720 2023-07-14T15:58:13.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.917+0000 7f68beffd700 1 -- 172.21.15.37:0/3394663781 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b0011990 con 0x7f68c00b8720 2023-07-14T15:58:13.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.917+0000 7f68beffd700 1 -- 172.21.15.37:0/3394663781 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b0011d20 con 0x7f68c00b8720 2023-07-14T15:58:13.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.917+0000 7f68c63ff700 1 -- 172.21.15.37:0/3394663781 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68c00b8720 msgr2=0x7f68c0160190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:13.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.917+0000 7f68c63ff700 1 --2- 172.21.15.37:0/3394663781 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68c00b8720 0x7f68c0160190 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f68b0009840 tx=0x7f68b0009b50 comp rx=0 tx=0).stop 2023-07-14T15:58:13.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.917+0000 7f68c63ff700 1 -- 172.21.15.37:0/3394663781 shutdown_connections 2023-07-14T15:58:13.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.917+0000 7f68c63ff700 1 --2- 172.21.15.37:0/3394663781 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68c00b8720 0x7f68c0160190 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:13.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.917+0000 7f68c63ff700 1 -- 172.21.15.37:0/3394663781 >> 172.21.15.37:0/3394663781 conn(0x7f68c006a510 msgr2=0x7f68c006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:13.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.917+0000 7f68c63ff700 1 -- 172.21.15.37:0/3394663781 shutdown_connections 2023-07-14T15:58:13.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.917+0000 7f68c63ff700 1 -- 172.21.15.37:0/3394663781 wait complete. 2023-07-14T15:58:13.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.920+0000 7f68c63ff700 1 Processor -- start 2023-07-14T15:58:13.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.920+0000 7f68c63ff700 1 -- start start 2023-07-14T15:58:13.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.921+0000 7f68c63ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68c00b20d0 0x7f68c00c8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:13.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.921+0000 7f68c63ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68c00b8720 0x7f68c01e8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:13.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.921+0000 7f68c63ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f68c00d2680 0x7f68c00c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:13.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.921+0000 7f68c63ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c00c8320 con 0x7f68c00b20d0 2023-07-14T15:58:13.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.921+0000 7f68c63ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c00c8c60 con 0x7f68c00b8720 2023-07-14T15:58:13.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.921+0000 7f68c63ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c00c76a0 con 0x7f68c00d2680 2023-07-14T15:58:13.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.922+0000 7f68bffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68c00b20d0 0x7f68c00c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:13.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.922+0000 7f68bffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68c00b20d0 0x7f68c00c8720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49540/0 (socket says 172.21.15.37:49540) 2023-07-14T15:58:13.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.922+0000 7f68bffff700 1 -- 172.21.15.37:0/3644446095 learned_addr learned my addr 172.21.15.37:0/3644446095 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:13.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.922+0000 7f68bf7fe700 1 --2- 172.21.15.37:0/3644446095 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68c00b8720 0x7f68c01e8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:13.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.922+0000 7f68c499c700 1 --2- 172.21.15.37:0/3644446095 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f68c00d2680 0x7f68c00c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:13.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.922+0000 7f68bffff700 1 -- 172.21.15.37:0/3644446095 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f68c00d2680 msgr2=0x7f68c00c69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:13.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.922+0000 7f68bffff700 1 --2- 172.21.15.37:0/3644446095 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f68c00d2680 0x7f68c00c69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:13.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.922+0000 7f68bffff700 1 -- 172.21.15.37:0/3644446095 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68c00b8720 msgr2=0x7f68c01e8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:13.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.922+0000 7f68bffff700 1 --2- 172.21.15.37:0/3644446095 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68c00b8720 0x7f68c01e8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:13.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.922+0000 7f68bffff700 1 -- 172.21.15.37:0/3644446095 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b00094a0 con 0x7f68c00b20d0 2023-07-14T15:58:13.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.922+0000 7f68bffff700 1 --2- 172.21.15.37:0/3644446095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68c00b20d0 0x7f68c00c8720 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f68b00090b0 tx=0x7f68b0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:13.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.923+0000 7f68bcff9700 1 -- 172.21.15.37:0/3644446095 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b001a6e0 con 0x7f68c00b20d0 2023-07-14T15:58:13.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.923+0000 7f68bcff9700 1 -- 172.21.15.37:0/3644446095 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b001a840 con 0x7f68c00b20d0 2023-07-14T15:58:13.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.923+0000 7f68bcff9700 1 -- 172.21.15.37:0/3644446095 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b001abb0 con 0x7f68c00b20d0 2023-07-14T15:58:13.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.923+0000 7f68c63ff700 1 -- 172.21.15.37:0/3644446095 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68c00c7980 con 0x7f68c00b20d0 2023-07-14T15:58:13.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.923+0000 7f68c63ff700 1 -- 172.21.15.37:0/3644446095 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68c00c7f40 con 0x7f68c00b20d0 2023-07-14T15:58:13.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.924+0000 7f68c63ff700 1 -- 172.21.15.37:0/3644446095 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68c00c8590 con 0x7f68c00b20d0 2023-07-14T15:58:13.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.925+0000 7f68bcff9700 1 -- 172.21.15.37:0/3644446095 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f68b0022070 con 0x7f68c00b20d0 2023-07-14T15:58:13.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.926+0000 7f68bcff9700 1 --2- 172.21.15.37:0/3644446095 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f68ac06ad70 0x7f68ac06d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:13.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.926+0000 7f68bcff9700 1 -- 172.21.15.37:0/3644446095 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f68b008a180 con 0x7f68c00b20d0 2023-07-14T15:58:13.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.926+0000 7f68bf7fe700 1 --2- 172.21.15.37:0/3644446095 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f68ac06ad70 0x7f68ac06d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:13.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.927+0000 7f68bf7fe700 1 --2- 172.21.15.37:0/3644446095 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f68ac06ad70 0x7f68ac06d220 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f68b40011e0 tx=0x7f68b4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:13.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:13.930+0000 7f68bcff9700 1 -- 172.21.15.37:0/3644446095 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f68b0055200 con 0x7f68c00b20d0 2023-07-14T15:58:14.080 INFO:tasks.ceph.mds.c.smithi037.stderr:2023-07-14T15:58:14.097+0000 7efd38ff1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-14T15:58:14.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.133+0000 7f68c63ff700 1 -- 172.21.15.37:0/3644446095 --> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f68c00cdbf0 con 0x7f68ac06ad70 2023-07-14T15:58:14.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.143+0000 7f68bcff9700 1 -- 172.21.15.37:0/3644446095 <== mgr.4100 v2:172.21.15.98:6832/3163748069 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+307716 (secure 0 0 0) 0x7f68b4001570 con 0x7f68ac06ad70 2023-07-14T15:58:14.131 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:58:14.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.148+0000 7f68c63ff700 1 -- 172.21.15.37:0/3644446095 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f68ac06ad70 msgr2=0x7f68ac06d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:14.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.148+0000 7f68c63ff700 1 --2- 172.21.15.37:0/3644446095 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f68ac06ad70 0x7f68ac06d220 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f68b40011e0 tx=0x7f68b4009040 comp rx=0 tx=0).stop 2023-07-14T15:58:14.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.148+0000 7f68c63ff700 1 -- 172.21.15.37:0/3644446095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68c00b20d0 msgr2=0x7f68c00c8720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:14.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.148+0000 7f68c63ff700 1 --2- 172.21.15.37:0/3644446095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68c00b20d0 0x7f68c00c8720 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f68b00090b0 tx=0x7f68b0004750 comp rx=0 tx=0).stop 2023-07-14T15:58:14.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.148+0000 7f68c63ff700 1 -- 172.21.15.37:0/3644446095 shutdown_connections 2023-07-14T15:58:14.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.148+0000 7f68c63ff700 1 --2- 172.21.15.37:0/3644446095 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f68ac06ad70 0x7f68ac06d220 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:14.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.148+0000 7f68c63ff700 1 --2- 172.21.15.37:0/3644446095 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f68c00d2680 0x7f68c00c69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:14.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.148+0000 7f68c63ff700 1 --2- 172.21.15.37:0/3644446095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68c00b20d0 0x7f68c00c8720 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:14.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.148+0000 7f68c63ff700 1 --2- 172.21.15.37:0/3644446095 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68c00b8720 0x7f68c01e8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:14.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.148+0000 7f68c63ff700 1 -- 172.21.15.37:0/3644446095 >> 172.21.15.37:0/3644446095 conn(0x7f68c006a510 msgr2=0x7f68c00b41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:14.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.148+0000 7f68c63ff700 1 -- 172.21.15.37:0/3644446095 shutdown_connections 2023-07-14T15:58:14.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.148+0000 7f68c63ff700 1 -- 172.21.15.37:0/3644446095 wait complete. 2023-07-14T15:58:14.136 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-14T15:58:14.150 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":113,"stamp":"2023-07-14T15:58:12.884243+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591020,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":165,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":124,"ondisk_log_size":124,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":73,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":229212,"kb_used_data":5404,"kb_used_omap":0,"kb_used_meta":223744,"kb_avail":754745508,"statfs":{"total":773094113280,"available":772859400192,"internally_reserved":0,"allocated":5533696,"data_stored":3017866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":229113856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":652,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001623"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.249271+0000","last_change":"2023-07-14T15:58:08.744537+0000","last_active":"2023-07-14T15:58:10.249271+0000","last_peered":"2023-07-14T15:58:10.249271+0000","last_clean":"2023-07-14T15:58:10.249271+0000","last_became_active":"2023-07-14T15:58:08.743330+0000","last_became_peered":"2023-07-14T15:58:08.743330+0000","last_unstale":"2023-07-14T15:58:10.249271+0000","last_undegraded":"2023-07-14T15:58:10.249271+0000","last_fullsized":"2023-07-14T15:58:10.249271+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:49:26.687765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.719573+0000","last_change":"2023-07-14T15:58:07.719573+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.719573+0000","last_undegraded":"2023-07-14T15:58:07.719573+0000","last_fullsized":"2023-07-14T15:58:07.719573+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.717902+0000","last_change":"2023-07-14T15:58:07.717902+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.717902+0000","last_undegraded":"2023-07-14T15:58:07.717902+0000","last_fullsized":"2023-07-14T15:58:07.717902+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167815+0000","last_change":"2023-07-14T15:58:08.736155+0000","last_active":"2023-07-14T15:58:10.167815+0000","last_peered":"2023-07-14T15:58:10.167815+0000","last_clean":"2023-07-14T15:58:10.167815+0000","last_became_active":"2023-07-14T15:58:08.735812+0000","last_became_peered":"2023-07-14T15:58:08.735812+0000","last_unstale":"2023-07-14T15:58:10.167815+0000","last_undegraded":"2023-07-14T15:58:10.167815+0000","last_fullsized":"2023-07-14T15:58:10.167815+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:48:06.896474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.717572+0000","last_change":"2023-07-14T15:58:07.717572+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.717572+0000","last_undegraded":"2023-07-14T15:58:07.717572+0000","last_fullsized":"2023-07-14T15:58:07.717572+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.722593+0000","last_change":"2023-07-14T15:58:07.722593+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.722593+0000","last_undegraded":"2023-07-14T15:58:07.722593+0000","last_fullsized":"2023-07-14T15:58:07.722593+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.721460+0000","last_change":"2023-07-14T15:58:07.721460+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.721460+0000","last_undegraded":"2023-07-14T15:58:07.721460+0000","last_fullsized":"2023-07-14T15:58:07.721460+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.724630+0000","last_change":"2023-07-14T15:58:07.724630+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.724630+0000","last_undegraded":"2023-07-14T15:58:07.724630+0000","last_fullsized":"2023-07-14T15:58:07.724630+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.718319+0000","last_change":"2023-07-14T15:58:07.718319+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.718319+0000","last_undegraded":"2023-07-14T15:58:07.718319+0000","last_fullsized":"2023-07-14T15:58:07.718319+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.727661+0000","last_change":"2023-07-14T15:58:07.727661+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.727661+0000","last_undegraded":"2023-07-14T15:58:07.727661+0000","last_fullsized":"2023-07-14T15:58:07.727661+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.249087+0000","last_change":"2023-07-14T15:58:08.741999+0000","last_active":"2023-07-14T15:58:10.249087+0000","last_peered":"2023-07-14T15:58:10.249087+0000","last_clean":"2023-07-14T15:58:10.249087+0000","last_became_active":"2023-07-14T15:58:08.741574+0000","last_became_peered":"2023-07-14T15:58:08.741574+0000","last_unstale":"2023-07-14T15:58:10.249087+0000","last_undegraded":"2023-07-14T15:58:10.249087+0000","last_fullsized":"2023-07-14T15:58:10.249087+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:32:57.904943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.722663+0000","last_change":"2023-07-14T15:58:07.722663+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.722663+0000","last_undegraded":"2023-07-14T15:58:07.722663+0000","last_fullsized":"2023-07-14T15:58:07.722663+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.723606+0000","last_change":"2023-07-14T15:58:07.723606+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.723606+0000","last_undegraded":"2023-07-14T15:58:07.723606+0000","last_fullsized":"2023-07-14T15:58:07.723606+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.248843+0000","last_change":"2023-07-14T15:58:08.741798+0000","last_active":"2023-07-14T15:58:10.248843+0000","last_peered":"2023-07-14T15:58:10.248843+0000","last_clean":"2023-07-14T15:58:10.248843+0000","last_became_active":"2023-07-14T15:58:08.741528+0000","last_became_peered":"2023-07-14T15:58:08.741528+0000","last_unstale":"2023-07-14T15:58:10.248843+0000","last_undegraded":"2023-07-14T15:58:10.248843+0000","last_fullsized":"2023-07-14T15:58:10.248843+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:01:10.579696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167899+0000","last_change":"2023-07-14T15:58:08.739487+0000","last_active":"2023-07-14T15:58:10.167899+0000","last_peered":"2023-07-14T15:58:10.167899+0000","last_clean":"2023-07-14T15:58:10.167899+0000","last_became_active":"2023-07-14T15:58:08.739163+0000","last_became_peered":"2023-07-14T15:58:08.739163+0000","last_unstale":"2023-07-14T15:58:10.167899+0000","last_undegraded":"2023-07-14T15:58:10.167899+0000","last_fullsized":"2023-07-14T15:58:10.167899+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:50:25.208038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.724137+0000","last_change":"2023-07-14T15:58:07.724137+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.724137+0000","last_undegraded":"2023-07-14T15:58:07.724137+0000","last_fullsized":"2023-07-14T15:58:07.724137+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.249161+0000","last_change":"2023-07-14T15:58:08.744838+0000","last_active":"2023-07-14T15:58:10.249161+0000","last_peered":"2023-07-14T15:58:10.249161+0000","last_clean":"2023-07-14T15:58:10.249161+0000","last_became_active":"2023-07-14T15:58:08.744465+0000","last_became_peered":"2023-07-14T15:58:08.744465+0000","last_unstale":"2023-07-14T15:58:10.249161+0000","last_undegraded":"2023-07-14T15:58:10.249161+0000","last_fullsized":"2023-07-14T15:58:10.249161+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:07:13.860410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167818+0000","last_change":"2023-07-14T15:58:08.734559+0000","last_active":"2023-07-14T15:58:10.167818+0000","last_peered":"2023-07-14T15:58:10.167818+0000","last_clean":"2023-07-14T15:58:10.167818+0000","last_became_active":"2023-07-14T15:58:08.734286+0000","last_became_peered":"2023-07-14T15:58:08.734286+0000","last_unstale":"2023-07-14T15:58:10.167818+0000","last_undegraded":"2023-07-14T15:58:10.167818+0000","last_fullsized":"2023-07-14T15:58:10.167818+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:59:06.223997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.717241+0000","last_change":"2023-07-14T15:58:07.717241+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.717241+0000","last_undegraded":"2023-07-14T15:58:07.717241+0000","last_fullsized":"2023-07-14T15:58:07.717241+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.722074+0000","last_change":"2023-07-14T15:58:07.722074+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.722074+0000","last_undegraded":"2023-07-14T15:58:07.722074+0000","last_fullsized":"2023-07-14T15:58:07.722074+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167688+0000","last_change":"2023-07-14T15:58:08.735232+0000","last_active":"2023-07-14T15:58:10.167688+0000","last_peered":"2023-07-14T15:58:10.167688+0000","last_clean":"2023-07-14T15:58:10.167688+0000","last_became_active":"2023-07-14T15:58:08.734945+0000","last_became_peered":"2023-07-14T15:58:08.734945+0000","last_unstale":"2023-07-14T15:58:10.167688+0000","last_undegraded":"2023-07-14T15:58:10.167688+0000","last_fullsized":"2023-07-14T15:58:10.167688+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:27:25.126730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.716580+0000","last_change":"2023-07-14T15:58:07.716580+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.716580+0000","last_undegraded":"2023-07-14T15:58:07.716580+0000","last_fullsized":"2023-07-14T15:58:07.716580+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.715960+0000","last_change":"2023-07-14T15:58:07.715960+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.715960+0000","last_undegraded":"2023-07-14T15:58:07.715960+0000","last_fullsized":"2023-07-14T15:58:07.715960+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.715860+0000","last_change":"2023-07-14T15:58:07.715860+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.715860+0000","last_undegraded":"2023-07-14T15:58:07.715860+0000","last_fullsized":"2023-07-14T15:58:07.715860+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.249170+0000","last_change":"2023-07-14T15:58:08.735284+0000","last_active":"2023-07-14T15:58:10.249170+0000","last_peered":"2023-07-14T15:58:10.249170+0000","last_clean":"2023-07-14T15:58:10.249170+0000","last_became_active":"2023-07-14T15:58:08.734958+0000","last_became_peered":"2023-07-14T15:58:08.734958+0000","last_unstale":"2023-07-14T15:58:10.249170+0000","last_undegraded":"2023-07-14T15:58:10.249170+0000","last_fullsized":"2023-07-14T15:58:10.249170+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:32:16.092808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.717249+0000","last_change":"2023-07-14T15:58:07.717249+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.717249+0000","last_undegraded":"2023-07-14T15:58:07.717249+0000","last_fullsized":"2023-07-14T15:58:07.717249+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.723323+0000","last_change":"2023-07-14T15:58:07.723323+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.723323+0000","last_undegraded":"2023-07-14T15:58:07.723323+0000","last_fullsized":"2023-07-14T15:58:07.723323+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.721609+0000","last_change":"2023-07-14T15:58:07.721609+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.721609+0000","last_undegraded":"2023-07-14T15:58:07.721609+0000","last_fullsized":"2023-07-14T15:58:07.721609+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.249000+0000","last_change":"2023-07-14T15:58:08.732111+0000","last_active":"2023-07-14T15:58:10.249000+0000","last_peered":"2023-07-14T15:58:10.249000+0000","last_clean":"2023-07-14T15:58:10.249000+0000","last_became_active":"2023-07-14T15:58:08.731797+0000","last_became_peered":"2023-07-14T15:58:08.731797+0000","last_unstale":"2023-07-14T15:58:10.249000+0000","last_undegraded":"2023-07-14T15:58:10.249000+0000","last_fullsized":"2023-07-14T15:58:10.249000+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:16:58.489649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.724231+0000","last_change":"2023-07-14T15:58:07.724231+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.724231+0000","last_undegraded":"2023-07-14T15:58:07.724231+0000","last_fullsized":"2023-07-14T15:58:07.724231+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.715371+0000","last_change":"2023-07-14T15:58:07.715371+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.715371+0000","last_undegraded":"2023-07-14T15:58:07.715371+0000","last_fullsized":"2023-07-14T15:58:07.715371+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.717880+0000","last_change":"2023-07-14T15:58:07.717880+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.717880+0000","last_undegraded":"2023-07-14T15:58:07.717880+0000","last_fullsized":"2023-07-14T15:58:07.717880+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.722527+0000","last_change":"2023-07-14T15:58:07.722527+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.722527+0000","last_undegraded":"2023-07-14T15:58:07.722527+0000","last_fullsized":"2023-07-14T15:58:07.722527+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"48'4","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T15:58:08.745933+0000","last_change":"2023-07-14T15:58:07.732535+0000","last_active":"2023-07-14T15:58:08.745933+0000","last_peered":"2023-07-14T15:58:08.745933+0000","last_clean":"2023-07-14T15:58:08.745933+0000","last_became_active":"2023-07-14T15:58:07.732169+0000","last_became_peered":"2023-07-14T15:58:07.732169+0000","last_unstale":"2023-07-14T15:58:08.745933+0000","last_undegraded":"2023-07-14T15:58:08.745933+0000","last_fullsized":"2023-07-14T15:58:08.745933+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:04:44.440538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.722080+0000","last_change":"2023-07-14T15:58:07.722080+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.722080+0000","last_undegraded":"2023-07-14T15:58:07.722080+0000","last_fullsized":"2023-07-14T15:58:07.722080+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.741501+0000","last_change":"2023-07-14T15:58:07.736542+0000","last_active":"2023-07-14T15:58:07.741501+0000","last_peered":"2023-07-14T15:58:07.741501+0000","last_clean":"2023-07-14T15:58:07.741501+0000","last_became_active":"2023-07-14T15:58:07.736266+0000","last_became_peered":"2023-07-14T15:58:07.736266+0000","last_unstale":"2023-07-14T15:58:07.741501+0000","last_undegraded":"2023-07-14T15:58:07.741501+0000","last_fullsized":"2023-07-14T15:58:07.741501+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:40:23.569681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.722548+0000","last_change":"2023-07-14T15:58:07.722548+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.722548+0000","last_undegraded":"2023-07-14T15:58:07.722548+0000","last_fullsized":"2023-07-14T15:58:07.722548+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.737548+0000","last_change":"2023-07-14T15:58:07.732950+0000","last_active":"2023-07-14T15:58:07.737548+0000","last_peered":"2023-07-14T15:58:07.737548+0000","last_clean":"2023-07-14T15:58:07.737548+0000","last_became_active":"2023-07-14T15:58:07.732689+0000","last_became_peered":"2023-07-14T15:58:07.732689+0000","last_unstale":"2023-07-14T15:58:07.737548+0000","last_undegraded":"2023-07-14T15:58:07.737548+0000","last_fullsized":"2023-07-14T15:58:07.737548+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:40:23.569681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.722352+0000","last_change":"2023-07-14T15:58:07.722352+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.722352+0000","last_undegraded":"2023-07-14T15:58:07.722352+0000","last_fullsized":"2023-07-14T15:58:07.722352+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.733584+0000","last_change":"2023-07-14T15:58:07.730127+0000","last_active":"2023-07-14T15:58:07.733584+0000","last_peered":"2023-07-14T15:58:07.733584+0000","last_clean":"2023-07-14T15:58:07.733584+0000","last_became_active":"2023-07-14T15:58:07.729851+0000","last_became_peered":"2023-07-14T15:58:07.729851+0000","last_unstale":"2023-07-14T15:58:07.733584+0000","last_undegraded":"2023-07-14T15:58:07.733584+0000","last_fullsized":"2023-07-14T15:58:07.733584+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:19:55.658364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T15:58:08.741259+0000","last_change":"2023-07-14T15:58:08.738154+0000","last_active":"2023-07-14T15:58:08.741259+0000","last_peered":"2023-07-14T15:58:08.741259+0000","last_clean":"2023-07-14T15:58:08.741259+0000","last_became_active":"2023-07-14T15:58:08.737703+0000","last_became_peered":"2023-07-14T15:58:08.737703+0000","last_unstale":"2023-07-14T15:58:08.741259+0000","last_undegraded":"2023-07-14T15:58:08.741259+0000","last_fullsized":"2023-07-14T15:58:08.741259+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:03:03.027389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.741464+0000","last_change":"2023-07-14T15:58:07.734870+0000","last_active":"2023-07-14T15:58:07.741464+0000","last_peered":"2023-07-14T15:58:07.741464+0000","last_clean":"2023-07-14T15:58:07.741464+0000","last_became_active":"2023-07-14T15:58:07.734521+0000","last_became_peered":"2023-07-14T15:58:07.734521+0000","last_unstale":"2023-07-14T15:58:07.741464+0000","last_undegraded":"2023-07-14T15:58:07.741464+0000","last_fullsized":"2023-07-14T15:58:07.741464+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:04:55.555557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.722513+0000","last_change":"2023-07-14T15:58:07.722513+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.722513+0000","last_undegraded":"2023-07-14T15:58:07.722513+0000","last_fullsized":"2023-07-14T15:58:07.722513+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.733616+0000","last_change":"2023-07-14T15:58:07.730993+0000","last_active":"2023-07-14T15:58:07.733616+0000","last_peered":"2023-07-14T15:58:07.733616+0000","last_clean":"2023-07-14T15:58:07.733616+0000","last_became_active":"2023-07-14T15:58:07.730720+0000","last_became_peered":"2023-07-14T15:58:07.730720+0000","last_unstale":"2023-07-14T15:58:07.733616+0000","last_undegraded":"2023-07-14T15:58:07.733616+0000","last_fullsized":"2023-07-14T15:58:07.733616+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:39:22.857254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.728183+0000","last_change":"2023-07-14T15:58:07.728183+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.728183+0000","last_undegraded":"2023-07-14T15:58:07.728183+0000","last_fullsized":"2023-07-14T15:58:07.728183+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.737442+0000","last_change":"2023-07-14T15:58:07.731842+0000","last_active":"2023-07-14T15:58:07.737442+0000","last_peered":"2023-07-14T15:58:07.737442+0000","last_clean":"2023-07-14T15:58:07.737442+0000","last_became_active":"2023-07-14T15:58:07.731549+0000","last_became_peered":"2023-07-14T15:58:07.731549+0000","last_unstale":"2023-07-14T15:58:07.737442+0000","last_undegraded":"2023-07-14T15:58:07.737442+0000","last_fullsized":"2023-07-14T15:58:07.737442+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:32:01.344833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.168035+0000","last_change":"2023-07-14T15:58:08.743009+0000","last_active":"2023-07-14T15:58:10.168035+0000","last_peered":"2023-07-14T15:58:10.168035+0000","last_clean":"2023-07-14T15:58:10.168035+0000","last_became_active":"2023-07-14T15:58:08.742750+0000","last_became_peered":"2023-07-14T15:58:08.742750+0000","last_unstale":"2023-07-14T15:58:10.168035+0000","last_undegraded":"2023-07-14T15:58:10.168035+0000","last_fullsized":"2023-07-14T15:58:10.168035+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:11:50.083029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.732673+0000","last_change":"2023-07-14T15:58:07.728189+0000","last_active":"2023-07-14T15:58:07.732673+0000","last_peered":"2023-07-14T15:58:07.732673+0000","last_clean":"2023-07-14T15:58:07.732673+0000","last_became_active":"2023-07-14T15:58:07.727897+0000","last_became_peered":"2023-07-14T15:58:07.727897+0000","last_unstale":"2023-07-14T15:58:07.732673+0000","last_undegraded":"2023-07-14T15:58:07.732673+0000","last_fullsized":"2023-07-14T15:58:07.732673+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:15:03.507329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T15:58:08.733233+0000","last_change":"2023-07-14T15:58:08.731665+0000","last_active":"2023-07-14T15:58:08.733233+0000","last_peered":"2023-07-14T15:58:08.733233+0000","last_clean":"2023-07-14T15:58:08.733233+0000","last_became_active":"2023-07-14T15:58:08.731371+0000","last_became_peered":"2023-07-14T15:58:08.731371+0000","last_unstale":"2023-07-14T15:58:08.733233+0000","last_undegraded":"2023-07-14T15:58:08.733233+0000","last_fullsized":"2023-07-14T15:58:08.733233+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:20:11.481399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.168035+0000","last_change":"2023-07-14T15:58:07.728755+0000","last_active":"2023-07-14T15:58:10.168035+0000","last_peered":"2023-07-14T15:58:10.168035+0000","last_clean":"2023-07-14T15:58:10.168035+0000","last_became_active":"2023-07-14T15:58:07.728401+0000","last_became_peered":"2023-07-14T15:58:07.728401+0000","last_unstale":"2023-07-14T15:58:10.168035+0000","last_undegraded":"2023-07-14T15:58:10.168035+0000","last_fullsized":"2023-07-14T15:58:10.168035+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:52:41.611985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167935+0000","last_change":"2023-07-14T15:58:08.737207+0000","last_active":"2023-07-14T15:58:10.167935+0000","last_peered":"2023-07-14T15:58:10.167935+0000","last_clean":"2023-07-14T15:58:10.167935+0000","last_became_active":"2023-07-14T15:58:08.736904+0000","last_became_peered":"2023-07-14T15:58:08.736904+0000","last_unstale":"2023-07-14T15:58:10.167935+0000","last_undegraded":"2023-07-14T15:58:10.167935+0000","last_fullsized":"2023-07-14T15:58:10.167935+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:11:51.639080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167883+0000","last_change":"2023-07-14T15:58:07.733957+0000","last_active":"2023-07-14T15:58:10.167883+0000","last_peered":"2023-07-14T15:58:10.167883+0000","last_clean":"2023-07-14T15:58:10.167883+0000","last_became_active":"2023-07-14T15:58:07.733635+0000","last_became_peered":"2023-07-14T15:58:07.733635+0000","last_unstale":"2023-07-14T15:58:10.167883+0000","last_undegraded":"2023-07-14T15:58:10.167883+0000","last_fullsized":"2023-07-14T15:58:10.167883+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:26:47.764384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.248658+0000","last_change":"2023-07-14T15:58:08.743461+0000","last_active":"2023-07-14T15:58:10.248658+0000","last_peered":"2023-07-14T15:58:10.248658+0000","last_clean":"2023-07-14T15:58:10.248658+0000","last_became_active":"2023-07-14T15:58:08.743075+0000","last_became_peered":"2023-07-14T15:58:08.743075+0000","last_unstale":"2023-07-14T15:58:10.248658+0000","last_undegraded":"2023-07-14T15:58:10.248658+0000","last_fullsized":"2023-07-14T15:58:10.248658+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:37:43.533403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.738451+0000","last_change":"2023-07-14T15:58:07.736023+0000","last_active":"2023-07-14T15:58:07.738451+0000","last_peered":"2023-07-14T15:58:07.738451+0000","last_clean":"2023-07-14T15:58:07.738451+0000","last_became_active":"2023-07-14T15:58:07.735713+0000","last_became_peered":"2023-07-14T15:58:07.735713+0000","last_unstale":"2023-07-14T15:58:07.738451+0000","last_undegraded":"2023-07-14T15:58:07.738451+0000","last_fullsized":"2023-07-14T15:58:07.738451+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:28:54.149444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.717011+0000","last_change":"2023-07-14T15:58:07.717011+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.717011+0000","last_undegraded":"2023-07-14T15:58:07.717011+0000","last_fullsized":"2023-07-14T15:58:07.717011+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.742704+0000","last_change":"2023-07-14T15:58:07.742068+0000","last_active":"2023-07-14T15:58:07.742704+0000","last_peered":"2023-07-14T15:58:07.742704+0000","last_clean":"2023-07-14T15:58:07.742704+0000","last_became_active":"2023-07-14T15:58:07.741718+0000","last_became_peered":"2023-07-14T15:58:07.741718+0000","last_unstale":"2023-07-14T15:58:07.742704+0000","last_undegraded":"2023-07-14T15:58:07.742704+0000","last_fullsized":"2023-07-14T15:58:07.742704+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:58:10.417450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.723416+0000","last_change":"2023-07-14T15:58:07.723416+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.723416+0000","last_undegraded":"2023-07-14T15:58:07.723416+0000","last_fullsized":"2023-07-14T15:58:07.723416+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.741397+0000","last_change":"2023-07-14T15:58:07.735958+0000","last_active":"2023-07-14T15:58:07.741397+0000","last_peered":"2023-07-14T15:58:07.741397+0000","last_clean":"2023-07-14T15:58:07.741397+0000","last_became_active":"2023-07-14T15:58:07.735649+0000","last_became_peered":"2023-07-14T15:58:07.735649+0000","last_unstale":"2023-07-14T15:58:07.741397+0000","last_undegraded":"2023-07-14T15:58:07.741397+0000","last_fullsized":"2023-07-14T15:58:07.741397+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:26:05.861976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.249076+0000","last_change":"2023-07-14T15:58:08.741837+0000","last_active":"2023-07-14T15:58:10.249076+0000","last_peered":"2023-07-14T15:58:10.249076+0000","last_clean":"2023-07-14T15:58:10.249076+0000","last_became_active":"2023-07-14T15:58:08.741224+0000","last_became_peered":"2023-07-14T15:58:08.741224+0000","last_unstale":"2023-07-14T15:58:10.249076+0000","last_undegraded":"2023-07-14T15:58:10.249076+0000","last_fullsized":"2023-07-14T15:58:10.249076+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:18:49.473467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167804+0000","last_change":"2023-07-14T15:58:07.734306+0000","last_active":"2023-07-14T15:58:10.167804+0000","last_peered":"2023-07-14T15:58:10.167804+0000","last_clean":"2023-07-14T15:58:10.167804+0000","last_became_active":"2023-07-14T15:58:07.733956+0000","last_became_peered":"2023-07-14T15:58:07.733956+0000","last_unstale":"2023-07-14T15:58:10.167804+0000","last_undegraded":"2023-07-14T15:58:10.167804+0000","last_fullsized":"2023-07-14T15:58:10.167804+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:32:13.169004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.726184+0000","last_change":"2023-07-14T15:58:07.726184+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.726184+0000","last_undegraded":"2023-07-14T15:58:07.726184+0000","last_fullsized":"2023-07-14T15:58:07.726184+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.733252+0000","last_change":"2023-07-14T15:58:07.728853+0000","last_active":"2023-07-14T15:58:07.733252+0000","last_peered":"2023-07-14T15:58:07.733252+0000","last_clean":"2023-07-14T15:58:07.733252+0000","last_became_active":"2023-07-14T15:58:07.728594+0000","last_became_peered":"2023-07-14T15:58:07.728594+0000","last_unstale":"2023-07-14T15:58:07.733252+0000","last_undegraded":"2023-07-14T15:58:07.733252+0000","last_fullsized":"2023-07-14T15:58:07.733252+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:24:04.951787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.717478+0000","last_change":"2023-07-14T15:58:07.717478+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.717478+0000","last_undegraded":"2023-07-14T15:58:07.717478+0000","last_fullsized":"2023-07-14T15:58:07.717478+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.738564+0000","last_change":"2023-07-14T15:58:07.734654+0000","last_active":"2023-07-14T15:58:07.738564+0000","last_peered":"2023-07-14T15:58:07.738564+0000","last_clean":"2023-07-14T15:58:07.738564+0000","last_became_active":"2023-07-14T15:58:07.734360+0000","last_became_peered":"2023-07-14T15:58:07.734360+0000","last_unstale":"2023-07-14T15:58:07.738564+0000","last_undegraded":"2023-07-14T15:58:07.738564+0000","last_fullsized":"2023-07-14T15:58:07.738564+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:50:37.553786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.720869+0000","last_change":"2023-07-14T15:58:07.720869+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.720869+0000","last_undegraded":"2023-07-14T15:58:07.720869+0000","last_fullsized":"2023-07-14T15:58:07.720869+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.741501+0000","last_change":"2023-07-14T15:58:07.736644+0000","last_active":"2023-07-14T15:58:07.741501+0000","last_peered":"2023-07-14T15:58:07.741501+0000","last_clean":"2023-07-14T15:58:07.741501+0000","last_became_active":"2023-07-14T15:58:07.736358+0000","last_became_peered":"2023-07-14T15:58:07.736358+0000","last_unstale":"2023-07-14T15:58:07.741501+0000","last_undegraded":"2023-07-14T15:58:07.741501+0000","last_fullsized":"2023-07-14T15:58:07.741501+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:07:07.548207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.248655+0000","last_change":"2023-07-14T15:58:08.735289+0000","last_active":"2023-07-14T15:58:10.248655+0000","last_peered":"2023-07-14T15:58:10.248655+0000","last_clean":"2023-07-14T15:58:10.248655+0000","last_became_active":"2023-07-14T15:58:08.734993+0000","last_became_peered":"2023-07-14T15:58:08.734993+0000","last_unstale":"2023-07-14T15:58:10.248655+0000","last_undegraded":"2023-07-14T15:58:10.248655+0000","last_fullsized":"2023-07-14T15:58:10.248655+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:26:31.914734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.738599+0000","last_change":"2023-07-14T15:58:07.734503+0000","last_active":"2023-07-14T15:58:07.738599+0000","last_peered":"2023-07-14T15:58:07.738599+0000","last_clean":"2023-07-14T15:58:07.738599+0000","last_became_active":"2023-07-14T15:58:07.734137+0000","last_became_peered":"2023-07-14T15:58:07.734137+0000","last_unstale":"2023-07-14T15:58:07.738599+0000","last_undegraded":"2023-07-14T15:58:07.738599+0000","last_fullsized":"2023-07-14T15:58:07.738599+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:26:43.367167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.718942+0000","last_change":"2023-07-14T15:58:07.718942+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.718942+0000","last_undegraded":"2023-07-14T15:58:07.718942+0000","last_fullsized":"2023-07-14T15:58:07.718942+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"48'1","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167821+0000","last_change":"2023-07-14T15:58:07.725878+0000","last_active":"2023-07-14T15:58:10.167821+0000","last_peered":"2023-07-14T15:58:10.167821+0000","last_clean":"2023-07-14T15:58:10.167821+0000","last_became_active":"2023-07-14T15:58:07.725549+0000","last_became_peered":"2023-07-14T15:58:07.725549+0000","last_unstale":"2023-07-14T15:58:10.167821+0000","last_undegraded":"2023-07-14T15:58:10.167821+0000","last_fullsized":"2023-07-14T15:58:10.167821+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:22:14.282584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.723135+0000","last_change":"2023-07-14T15:58:07.723135+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.723135+0000","last_undegraded":"2023-07-14T15:58:07.723135+0000","last_fullsized":"2023-07-14T15:58:07.723135+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.738614+0000","last_change":"2023-07-14T15:58:07.736136+0000","last_active":"2023-07-14T15:58:07.738614+0000","last_peered":"2023-07-14T15:58:07.738614+0000","last_clean":"2023-07-14T15:58:07.738614+0000","last_became_active":"2023-07-14T15:58:07.735841+0000","last_became_peered":"2023-07-14T15:58:07.735841+0000","last_unstale":"2023-07-14T15:58:07.738614+0000","last_undegraded":"2023-07-14T15:58:07.738614+0000","last_fullsized":"2023-07-14T15:58:07.738614+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:55:42.052044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.721077+0000","last_change":"2023-07-14T15:58:07.721077+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.721077+0000","last_undegraded":"2023-07-14T15:58:07.721077+0000","last_fullsized":"2023-07-14T15:58:07.721077+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"48'2","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.248871+0000","last_change":"2023-07-14T15:58:07.731047+0000","last_active":"2023-07-14T15:58:10.248871+0000","last_peered":"2023-07-14T15:58:10.248871+0000","last_clean":"2023-07-14T15:58:10.248871+0000","last_became_active":"2023-07-14T15:58:07.730760+0000","last_became_peered":"2023-07-14T15:58:07.730760+0000","last_unstale":"2023-07-14T15:58:10.248871+0000","last_undegraded":"2023-07-14T15:58:10.248871+0000","last_fullsized":"2023-07-14T15:58:10.248871+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:54:17.765585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167946+0000","last_change":"2023-07-14T15:58:08.738893+0000","last_active":"2023-07-14T15:58:10.167946+0000","last_peered":"2023-07-14T15:58:10.167946+0000","last_clean":"2023-07-14T15:58:10.167946+0000","last_became_active":"2023-07-14T15:58:08.738584+0000","last_became_peered":"2023-07-14T15:58:08.738584+0000","last_unstale":"2023-07-14T15:58:10.167946+0000","last_undegraded":"2023-07-14T15:58:10.167946+0000","last_fullsized":"2023-07-14T15:58:10.167946+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:32:48.130235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.738512+0000","last_change":"2023-07-14T15:58:07.732320+0000","last_active":"2023-07-14T15:58:07.738512+0000","last_peered":"2023-07-14T15:58:07.738512+0000","last_clean":"2023-07-14T15:58:07.738512+0000","last_became_active":"2023-07-14T15:58:07.732044+0000","last_became_peered":"2023-07-14T15:58:07.732044+0000","last_unstale":"2023-07-14T15:58:07.738512+0000","last_undegraded":"2023-07-14T15:58:07.738512+0000","last_fullsized":"2023-07-14T15:58:07.738512+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:45:12.894608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.248814+0000","last_change":"2023-07-14T15:58:08.743134+0000","last_active":"2023-07-14T15:58:10.248814+0000","last_peered":"2023-07-14T15:58:10.248814+0000","last_clean":"2023-07-14T15:58:10.248814+0000","last_became_active":"2023-07-14T15:58:08.742797+0000","last_became_peered":"2023-07-14T15:58:08.742797+0000","last_unstale":"2023-07-14T15:58:10.248814+0000","last_undegraded":"2023-07-14T15:58:10.248814+0000","last_fullsized":"2023-07-14T15:58:10.248814+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:08:36.025877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.737725+0000","last_change":"2023-07-14T15:58:07.733527+0000","last_active":"2023-07-14T15:58:07.737725+0000","last_peered":"2023-07-14T15:58:07.737725+0000","last_clean":"2023-07-14T15:58:07.737725+0000","last_became_active":"2023-07-14T15:58:07.733219+0000","last_became_peered":"2023-07-14T15:58:07.733219+0000","last_unstale":"2023-07-14T15:58:07.737725+0000","last_undegraded":"2023-07-14T15:58:07.737725+0000","last_fullsized":"2023-07-14T15:58:07.737725+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:26:43.367167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.724269+0000","last_change":"2023-07-14T15:58:07.724269+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.724269+0000","last_undegraded":"2023-07-14T15:58:07.724269+0000","last_fullsized":"2023-07-14T15:58:07.724269+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.735135+0000","last_change":"2023-07-14T15:58:07.731843+0000","last_active":"2023-07-14T15:58:07.735135+0000","last_peered":"2023-07-14T15:58:07.735135+0000","last_clean":"2023-07-14T15:58:07.735135+0000","last_became_active":"2023-07-14T15:58:07.731548+0000","last_became_peered":"2023-07-14T15:58:07.731548+0000","last_unstale":"2023-07-14T15:58:07.735135+0000","last_undegraded":"2023-07-14T15:58:07.735135+0000","last_fullsized":"2023-07-14T15:58:07.735135+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:48:57.461682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.723098+0000","last_change":"2023-07-14T15:58:07.723098+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.723098+0000","last_undegraded":"2023-07-14T15:58:07.723098+0000","last_fullsized":"2023-07-14T15:58:07.723098+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.731640+0000","last_change":"2023-07-14T15:58:07.728047+0000","last_active":"2023-07-14T15:58:07.731640+0000","last_peered":"2023-07-14T15:58:07.731640+0000","last_clean":"2023-07-14T15:58:07.731640+0000","last_became_active":"2023-07-14T15:58:07.727789+0000","last_became_peered":"2023-07-14T15:58:07.727789+0000","last_unstale":"2023-07-14T15:58:07.731640+0000","last_undegraded":"2023-07-14T15:58:07.731640+0000","last_fullsized":"2023-07-14T15:58:07.731640+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:16:03.073064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":62,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.727542+0000","last_change":"2023-07-14T15:56:02.621850+0000","last_active":"2023-07-14T15:58:07.727542+0000","last_peered":"2023-07-14T15:58:07.727542+0000","last_clean":"2023-07-14T15:58:07.727542+0000","last_became_active":"2023-07-14T15:56:02.621471+0000","last_became_peered":"2023-07-14T15:56:02.621471+0000","last_unstale":"2023-07-14T15:58:07.727542+0000","last_undegraded":"2023-07-14T15:58:07.727542+0000","last_fullsized":"2023-07-14T15:58:07.727542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:50:29.634950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167727+0000","last_change":"2023-07-14T15:58:08.735834+0000","last_active":"2023-07-14T15:58:10.167727+0000","last_peered":"2023-07-14T15:58:10.167727+0000","last_clean":"2023-07-14T15:58:10.167727+0000","last_became_active":"2023-07-14T15:58:08.735483+0000","last_became_peered":"2023-07-14T15:58:08.735483+0000","last_unstale":"2023-07-14T15:58:10.167727+0000","last_undegraded":"2023-07-14T15:58:10.167727+0000","last_fullsized":"2023-07-14T15:58:10.167727+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:24:16.022757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.737332+0000","last_change":"2023-07-14T15:58:07.732308+0000","last_active":"2023-07-14T15:58:07.737332+0000","last_peered":"2023-07-14T15:58:07.737332+0000","last_clean":"2023-07-14T15:58:07.737332+0000","last_became_active":"2023-07-14T15:58:07.732001+0000","last_became_peered":"2023-07-14T15:58:07.732001+0000","last_unstale":"2023-07-14T15:58:07.737332+0000","last_undegraded":"2023-07-14T15:58:07.737332+0000","last_fullsized":"2023-07-14T15:58:07.737332+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:23:53.549331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":64,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.725964+0000","last_change":"2023-07-14T15:56:02.621963+0000","last_active":"2023-07-14T15:58:07.725964+0000","last_peered":"2023-07-14T15:58:07.725964+0000","last_clean":"2023-07-14T15:58:07.725964+0000","last_became_active":"2023-07-14T15:56:02.621678+0000","last_became_peered":"2023-07-14T15:56:02.621678+0000","last_unstale":"2023-07-14T15:58:07.725964+0000","last_undegraded":"2023-07-14T15:58:07.725964+0000","last_fullsized":"2023-07-14T15:58:07.725964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:17:21.248756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.716992+0000","last_change":"2023-07-14T15:58:07.716992+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.716992+0000","last_undegraded":"2023-07-14T15:58:07.716992+0000","last_fullsized":"2023-07-14T15:58:07.716992+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.732661+0000","last_change":"2023-07-14T15:58:07.729039+0000","last_active":"2023-07-14T15:58:07.732661+0000","last_peered":"2023-07-14T15:58:07.732661+0000","last_clean":"2023-07-14T15:58:07.732661+0000","last_became_active":"2023-07-14T15:58:07.728779+0000","last_became_peered":"2023-07-14T15:58:07.728779+0000","last_unstale":"2023-07-14T15:58:07.732661+0000","last_undegraded":"2023-07-14T15:58:07.732661+0000","last_fullsized":"2023-07-14T15:58:07.732661+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:32:07.890972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.727698+0000","last_change":"2023-07-14T15:56:01.925110+0000","last_active":"2023-07-14T15:58:07.727698+0000","last_peered":"2023-07-14T15:58:07.727698+0000","last_clean":"2023-07-14T15:58:07.727698+0000","last_became_active":"2023-07-14T15:56:01.924723+0000","last_became_peered":"2023-07-14T15:56:01.924723+0000","last_unstale":"2023-07-14T15:58:07.727698+0000","last_undegraded":"2023-07-14T15:58:07.727698+0000","last_fullsized":"2023-07-14T15:58:07.727698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:46:51.667515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-14T15:58:08.733483+0000","last_change":"2023-07-14T15:58:08.730413+0000","last_active":"2023-07-14T15:58:08.733483+0000","last_peered":"2023-07-14T15:58:08.733483+0000","last_clean":"2023-07-14T15:58:08.733483+0000","last_became_active":"2023-07-14T15:58:08.730120+0000","last_became_peered":"2023-07-14T15:58:08.730120+0000","last_unstale":"2023-07-14T15:58:08.733483+0000","last_undegraded":"2023-07-14T15:58:08.733483+0000","last_fullsized":"2023-07-14T15:58:08.733483+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:24:06.908513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.737745+0000","last_change":"2023-07-14T15:58:07.734443+0000","last_active":"2023-07-14T15:58:07.737745+0000","last_peered":"2023-07-14T15:58:07.737745+0000","last_clean":"2023-07-14T15:58:07.737745+0000","last_became_active":"2023-07-14T15:58:07.734185+0000","last_became_peered":"2023-07-14T15:58:07.734185+0000","last_unstale":"2023-07-14T15:58:07.737745+0000","last_undegraded":"2023-07-14T15:58:07.737745+0000","last_fullsized":"2023-07-14T15:58:07.737745+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:07:07.548207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":64,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.726148+0000","last_change":"2023-07-14T15:56:01.923465+0000","last_active":"2023-07-14T15:58:07.726148+0000","last_peered":"2023-07-14T15:58:07.726148+0000","last_clean":"2023-07-14T15:58:07.726148+0000","last_became_active":"2023-07-14T15:56:01.923160+0000","last_became_peered":"2023-07-14T15:56:01.923160+0000","last_unstale":"2023-07-14T15:58:07.726148+0000","last_undegraded":"2023-07-14T15:58:07.726148+0000","last_fullsized":"2023-07-14T15:58:07.726148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:37:17.847750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":210,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167486+0000","last_change":"2023-07-14T15:55:54.040065+0000","last_active":"2023-07-14T15:58:10.167486+0000","last_peered":"2023-07-14T15:58:10.167486+0000","last_clean":"2023-07-14T15:58:10.167486+0000","last_became_active":"2023-07-14T15:55:54.038885+0000","last_became_peered":"2023-07-14T15:55:54.038885+0000","last_unstale":"2023-07-14T15:58:10.167486+0000","last_undegraded":"2023-07-14T15:58:10.167486+0000","last_fullsized":"2023-07-14T15:58:10.167486+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:55:53.025696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:55:53.025696+0000","last_clean_scrub_stamp":"2023-07-14T15:55:53.025696+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:02:02.551339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.721138+0000","last_change":"2023-07-14T15:58:07.721138+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.721138+0000","last_undegraded":"2023-07-14T15:58:07.721138+0000","last_fullsized":"2023-07-14T15:58:07.721138+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.738477+0000","last_change":"2023-07-14T15:58:07.736838+0000","last_active":"2023-07-14T15:58:07.738477+0000","last_peered":"2023-07-14T15:58:07.738477+0000","last_clean":"2023-07-14T15:58:07.738477+0000","last_became_active":"2023-07-14T15:58:07.735691+0000","last_became_peered":"2023-07-14T15:58:07.735691+0000","last_unstale":"2023-07-14T15:58:07.738477+0000","last_undegraded":"2023-07-14T15:58:07.738477+0000","last_fullsized":"2023-07-14T15:58:07.738477+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:20:19.529745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":64,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.725920+0000","last_change":"2023-07-14T15:56:01.920714+0000","last_active":"2023-07-14T15:58:07.725920+0000","last_peered":"2023-07-14T15:58:07.725920+0000","last_clean":"2023-07-14T15:58:07.725920+0000","last_became_active":"2023-07-14T15:56:01.920325+0000","last_became_peered":"2023-07-14T15:56:01.920325+0000","last_unstale":"2023-07-14T15:58:07.725920+0000","last_undegraded":"2023-07-14T15:58:07.725920+0000","last_fullsized":"2023-07-14T15:58:07.725920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:14:38.312671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.724821+0000","last_change":"2023-07-14T15:58:07.724821+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.724821+0000","last_undegraded":"2023-07-14T15:58:07.724821+0000","last_fullsized":"2023-07-14T15:58:07.724821+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167704+0000","last_change":"2023-07-14T15:58:07.736616+0000","last_active":"2023-07-14T15:58:10.167704+0000","last_peered":"2023-07-14T15:58:10.167704+0000","last_clean":"2023-07-14T15:58:10.167704+0000","last_became_active":"2023-07-14T15:58:07.736315+0000","last_became_peered":"2023-07-14T15:58:07.736315+0000","last_unstale":"2023-07-14T15:58:10.167704+0000","last_undegraded":"2023-07-14T15:58:10.167704+0000","last_fullsized":"2023-07-14T15:58:10.167704+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:23:07.012317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":64,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.726654+0000","last_change":"2023-07-14T15:56:01.923631+0000","last_active":"2023-07-14T15:58:07.726654+0000","last_peered":"2023-07-14T15:58:07.726654+0000","last_clean":"2023-07-14T15:58:07.726654+0000","last_became_active":"2023-07-14T15:56:01.922783+0000","last_became_peered":"2023-07-14T15:56:01.922783+0000","last_unstale":"2023-07-14T15:58:07.726654+0000","last_undegraded":"2023-07-14T15:58:07.726654+0000","last_fullsized":"2023-07-14T15:58:07.726654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:49:34.604728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.721620+0000","last_change":"2023-07-14T15:58:07.721620+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.721620+0000","last_undegraded":"2023-07-14T15:58:07.721620+0000","last_fullsized":"2023-07-14T15:58:07.721620+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.737804+0000","last_change":"2023-07-14T15:58:07.734768+0000","last_active":"2023-07-14T15:58:07.737804+0000","last_peered":"2023-07-14T15:58:07.737804+0000","last_clean":"2023-07-14T15:58:07.737804+0000","last_became_active":"2023-07-14T15:58:07.734498+0000","last_became_peered":"2023-07-14T15:58:07.734498+0000","last_unstale":"2023-07-14T15:58:07.737804+0000","last_undegraded":"2023-07-14T15:58:07.737804+0000","last_fullsized":"2023-07-14T15:58:07.737804+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:26:05.861976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":55,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.719245+0000","last_change":"2023-07-14T15:56:01.965649+0000","last_active":"2023-07-14T15:58:07.719245+0000","last_peered":"2023-07-14T15:58:07.719245+0000","last_clean":"2023-07-14T15:58:07.719245+0000","last_became_active":"2023-07-14T15:56:01.965344+0000","last_became_peered":"2023-07-14T15:56:01.965344+0000","last_unstale":"2023-07-14T15:58:07.719245+0000","last_undegraded":"2023-07-14T15:58:07.719245+0000","last_fullsized":"2023-07-14T15:58:07.719245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:49:21.926040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-07-14T15:58:07.718370+0000","last_change":"2023-07-14T15:58:07.718370+0000","last_active":"2023-07-14T15:58:07.703703+0000","last_peered":"2023-07-14T15:58:07.703703+0000","last_clean":"2023-07-14T15:58:07.703703+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T15:58:07.718370+0000","last_undegraded":"2023-07-14T15:58:07.718370+0000","last_fullsized":"2023-07-14T15:58:07.718370+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.733972+0000","last_change":"2023-07-14T15:58:07.730397+0000","last_active":"2023-07-14T15:58:07.733972+0000","last_peered":"2023-07-14T15:58:07.733972+0000","last_clean":"2023-07-14T15:58:07.733972+0000","last_became_active":"2023-07-14T15:58:07.729703+0000","last_became_peered":"2023-07-14T15:58:07.729703+0000","last_unstale":"2023-07-14T15:58:07.733972+0000","last_undegraded":"2023-07-14T15:58:07.733972+0000","last_fullsized":"2023-07-14T15:58:07.733972+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:20:56.952309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-07-14T15:58:07.726496+0000","last_change":"2023-07-14T15:56:01.966578+0000","last_active":"2023-07-14T15:58:07.726496+0000","last_peered":"2023-07-14T15:58:07.726496+0000","last_clean":"2023-07-14T15:58:07.726496+0000","last_became_active":"2023-07-14T15:56:01.966216+0000","last_became_peered":"2023-07-14T15:56:01.966216+0000","last_unstale":"2023-07-14T15:58:07.726496+0000","last_undegraded":"2023-07-14T15:58:07.726496+0000","last_fullsized":"2023-07-14T15:58:07.726496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:54:53.435442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":652,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476767,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":528,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":540672,"data_stored":228600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.44800000000000001,"15min":0.45000000000000001},"min":{"1min":0.29799999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.58999999999999997,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.753},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.46300000000000002,"15min":0.47299999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.57599999999999996,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.52000000000000002}]},{"osd":1,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.57799999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.52100000000000002,"15min":0.52300000000000002},"min":{"1min":0.38600000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.67500000000000004,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.435}]},{"osd":2,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.504,"15min":0.505},"min":{"1min":0.40300000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.66700000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.74199999999999999,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.67500000000000004}]},{"osd":4,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.755,"15min":0.76500000000000001},"min":{"1min":0.503,"5min":0.441,"15min":0.441},"max":{"1min":1.0189999999999999,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.76600000000000001,"15min":0.77400000000000002},"min":{"1min":0.53900000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.88400000000000001,"5min":1.542,"15min":1.542},"last":0.77300000000000002}]},{"osd":5,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.84199999999999997,"15min":0.85599999999999998},"min":{"1min":0.625,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.95299999999999996,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.84599999999999997,"15min":0.85699999999999998},"min":{"1min":0.60899999999999999,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.94599999999999995,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.97499999999999998}]},{"osd":6,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.80800000000000005,"15min":0.81899999999999995},"min":{"1min":0.55900000000000005,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.98799999999999999,"5min":1.52,"15min":1.52},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.79900000000000004,"15min":0.81200000000000006},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.86099999999999999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.86399999999999999}]},{"osd":7,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.77400000000000002,"15min":0.77700000000000002},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.96499999999999997,"5min":1.232,"15min":1.232},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.84299999999999997,"15min":0.85699999999999998},"min":{"1min":0.55500000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.94899999999999995,"5min":1.478,"15min":1.478},"last":0.83299999999999996}]}]},{"osd":0,"up_from":16,"seq":68719476768,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":528,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":540672,"data_stored":228600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42299999999999999,"15min":0.42399999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.67500000000000004,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.48499999999999999,"15min":0.48899999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.61599999999999999,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.498}]},{"osd":2,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.499,"15min":0.5},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.50800000000000001,"15min":0.505},"min":{"1min":0.41499999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.41299999999999998}]},{"osd":3,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47899999999999998,"15min":0.48099999999999998},"min":{"1min":0.38100000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.60699999999999998,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.57299999999999995,"15min":0.57699999999999996},"min":{"1min":0.42399999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76500000000000001,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.434}]},{"osd":4,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.99399999999999999,"5min":1.04,"15min":1.04},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.78000000000000003,"15min":0.78900000000000003},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.91000000000000003,"5min":1.331,"15min":1.331},"last":0.85999999999999999}]},{"osd":5,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.60999999999999999,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.119,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.56999999999999995,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0289999999999999,"5min":1.087,"15min":1.087},"last":0.877}]},{"osd":6,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.77500000000000002,"15min":0.78100000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0029999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.80100000000000005,"15min":0.80500000000000005},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.056,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.72799999999999998}]},{"osd":7,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.80100000000000005,"15min":0.80800000000000005},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.99399999999999999,"5min":1.262,"15min":1.262},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.79700000000000004,"15min":0.80100000000000005},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.97799999999999998,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.79200000000000004}]}]},{"osd":6,"up_from":14,"seq":60129542175,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":556,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":569344,"data_stored":242963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.621,"15min":0.61699999999999999},"min":{"1min":0.40999999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.82399999999999995,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64700000000000002,"15min":0.64600000000000002},"min":{"1min":0.496,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81599999999999995,"5min":1.266,"15min":1.266},"last":0.60699999999999998}]},{"osd":1,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.69799999999999995,"15min":0.70299999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88700000000000001,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.72199999999999998,"15min":0.71699999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.86699999999999999}]},{"osd":2,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.88500000000000001,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.68600000000000005,"15min":0.69099999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.75600000000000001}]},{"osd":3,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.78200000000000003,"15min":0.80400000000000005},"min":{"1min":0.48099999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.85999999999999999,"5min":3.141,"15min":3.141},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.752,"15min":0.753},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.94999999999999996,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.68200000000000005}]},{"osd":4,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.63,"15min":0.63300000000000001},"min":{"1min":0.432,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.83499999999999996,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.70899999999999996,"15min":0.71199999999999997},"min":{"1min":0.47599999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.92300000000000004,"5min":1.024,"15min":1.024},"last":0.55100000000000005}]},{"osd":5,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.748,"15min":0.751},"min":{"1min":0.51700000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.96999999999999997,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73599999999999999,"15min":0.73999999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.012,"5min":1.091,"15min":1.091},"last":0.80200000000000005}]},{"osd":7,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.72499999999999998,"15min":0.72899999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.92500000000000004,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.82399999999999995,"15min":0.82899999999999996},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":0.996,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.83899999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542174,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":1136,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1163264,"data_stored":832819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.60699999999999998,"15min":0.64200000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.53100000000000003,"5min":4.5519999999999996,"15min":4.5519999999999996},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":1.147,"15min":1.2609999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.70899999999999996,"5min":15.911,"15min":15.911},"last":0.53500000000000003}]},{"osd":2,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.45700000000000002,"15min":0.46400000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.53300000000000003,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.436},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.67300000000000004,"15min":0.70599999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.57299999999999995,"5min":4.5140000000000002,"15min":4.5140000000000002},"last":0.55700000000000005}]},{"osd":3,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.70199999999999996,"15min":0.73599999999999999},"min":{"1min":0.378,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.65500000000000003,"5min":4.452,"15min":4.452},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.70299999999999996,"15min":0.73899999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.57999999999999996,"5min":4.2279999999999998,"15min":4.2279999999999998},"last":0.48599999999999999}]},{"osd":4,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.88400000000000001,"15min":0.92000000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.81899999999999995,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.92200000000000004,"15min":0.95999999999999996},"min":{"1min":0.52400000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.95699999999999996,"5min":4.9109999999999996,"15min":4.9109999999999996},"last":0.61099999999999999}]},{"osd":5,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.90000000000000002,"15min":0.93300000000000005},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.98999999999999999,"5min":4.1269999999999998,"15min":4.1269999999999998},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.93799999999999994,"15min":0.97399999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.93700000000000006,"5min":4.585,"15min":4.585},"last":0.67700000000000005}]},{"osd":6,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.93300000000000005,"15min":0.97099999999999997},"min":{"1min":0.56899999999999995,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0369999999999999,"5min":4.9880000000000004,"15min":4.9880000000000004},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.92900000000000005,"15min":0.96299999999999997},"min":{"1min":0.58499999999999996,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94599999999999995,"5min":4.1660000000000004,"15min":4.1660000000000004},"last":0.747}]},{"osd":7,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.98199999999999998,"15min":1.0249999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.0429999999999999,"5min":4.9530000000000003,"15min":4.9530000000000003},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.94599999999999995,"15min":0.98099999999999998},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.048,"5min":4.1959999999999997,"15min":4.1959999999999997},"last":0.79000000000000004}]}]},{"osd":2,"up_from":15,"seq":64424509471,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":528384,"data_stored":221972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.42699999999999999,"15min":0.433},"min":{"1min":0.32200000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.51900000000000002,"5min":0.62,"15min":0.62},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.47299999999999998,"15min":0.48299999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.57999999999999996,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.39600000000000002}]},{"osd":1,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.52400000000000002,"15min":0.53100000000000003},"min":{"1min":0.315,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76200000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.46899999999999997,"15min":0.47099999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.65100000000000002,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.436}]},{"osd":3,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.58799999999999997,"15min":0.60199999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.63600000000000001,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.53200000000000003,"15min":0.53800000000000003},"min":{"1min":0.433,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.53700000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.53500000000000003}]},{"osd":4,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.72399999999999998,"15min":0.72799999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.169,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.74299999999999999,"15min":0.747},"min":{"1min":0.53300000000000003,"5min":0.437,"15min":0.437},"max":{"1min":0.90100000000000002,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.62}]},{"osd":5,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.77300000000000002,"15min":0.78100000000000003},"min":{"1min":0.55700000000000005,"5min":0.505,"15min":0.505},"max":{"1min":1.002,"5min":1.391,"15min":1.391},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.75600000000000001,"15min":0.76200000000000001},"min":{"1min":0.50700000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.153,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.66200000000000003}]},{"osd":6,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.79000000000000004,"15min":0.80300000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0960000000000001,"5min":1.51,"15min":1.51},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.81599999999999995,"15min":0.82999999999999996},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1319999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.73599999999999999}]},{"osd":7,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.78300000000000003,"15min":0.79400000000000004},"min":{"1min":0.54700000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.048,"5min":1.288,"15min":1.288},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.81799999999999995,"15min":0.82799999999999996},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.71899999999999997}]}]},{"osd":4,"up_from":15,"seq":64424509470,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":528384,"data_stored":221972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.67700000000000005,"15min":0.68700000000000006},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.64700000000000002,"15min":0.65700000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88300000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.496}]},{"osd":1,"last update":"Fri Jul 14 15:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.67000000000000004,"15min":0.67600000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.81999999999999995,"5min":0.87,"15min":0.87},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.65100000000000002,"15min":0.66000000000000003},"min":{"1min":0.44400000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.82899999999999996,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.47599999999999998}]},{"osd":2,"last update":"Fri Jul 14 15:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64400000000000002,"15min":0.65000000000000002},"min":{"1min":0.441,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.71599999999999997,"15min":0.72899999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.80900000000000005,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.55100000000000005}]},{"osd":3,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.68400000000000005,"15min":0.68799999999999994},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.86699999999999999,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.72799999999999998,"15min":0.73499999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.94299999999999995,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.752}]},{"osd":5,"last update":"Fri Jul 14 15:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65900000000000003,"15min":0.66400000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.83499999999999996,"5min":1.119,"15min":1.119},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.70699999999999996,"15min":0.71599999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.88200000000000001,"5min":1.157,"15min":1.157},"last":0.71999999999999997}]},{"osd":6,"last update":"Fri Jul 14 15:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.70199999999999996,"15min":0.71399999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.86199999999999999,"5min":1.04,"15min":1.04},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.89800000000000002,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.66400000000000003}]},{"osd":7,"last update":"Fri Jul 14 15:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.755,"15min":0.76700000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93799999999999994,"5min":1.202,"15min":1.202},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.77900000000000003,"15min":0.79100000000000004},"min":{"1min":0.53900000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.92100000000000004,"5min":1.137,"15min":1.137},"last":0.65600000000000003}]}]},{"osd":5,"up_from":15,"seq":64424509472,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28060,"kb_used_data":1108,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343780,"statfs":{"total":96636764160,"available":96608030720,"internally_reserved":0,"allocated":1134592,"data_stored":818968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.66400000000000003,"15min":0.67200000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.86099999999999999,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.97799999999999998,"15min":1.038},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.80600000000000005,"5min":8.1500000000000004,"15min":8.1500000000000004},"last":0.64200000000000002}]},{"osd":1,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.67200000000000004,"15min":0.67600000000000005},"min":{"1min":0.51200000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.98799999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.66400000000000003,"15min":0.67000000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.76800000000000002,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.54200000000000004}]},{"osd":2,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.75800000000000001,"15min":0.77100000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.873,"5min":1.085,"15min":1.085},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.72499999999999998,"15min":0.73699999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.86599999999999999,"5min":1.048,"15min":1.048},"last":0.56699999999999995}]},{"osd":3,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.69299999999999995,"15min":0.70099999999999996},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.82299999999999995,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.80000000000000004,"15min":0.81000000000000005},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":0.91700000000000004,"5min":1.083,"15min":1.083},"last":0.75900000000000001}]},{"osd":4,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68999999999999995,"15min":0.69199999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.65700000000000003,"15min":0.66300000000000003},"min":{"1min":0.441,"5min":0.438,"15min":0.438},"max":{"1min":0.82099999999999995,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.61599999999999999}]},{"osd":6,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.69899999999999995,"15min":0.71299999999999997},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.871,"5min":1.121,"15min":1.121},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.78700000000000003,"15min":0.80100000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.93799999999999994,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":1.1699999999999999}]},{"osd":7,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.74399999999999999,"15min":0.751},"min":{"1min":0.58199999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.875,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":1.149},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.81699999999999995,"15min":0.83099999999999996},"min":{"1min":0.53800000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.94699999999999995,"5min":1.605,"15min":1.605},"last":1.492}]}]},{"osd":7,"up_from":15,"seq":64424509471,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":528384,"data_stored":221972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.61799999999999999,"15min":0.61499999999999999},"min":{"1min":0.39300000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0089999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.80400000000000005,"15min":0.82499999999999996},"min":{"1min":0.44400000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0820000000000001,"5min":4.5919999999999996,"15min":4.5919999999999996},"last":0.74199999999999999}]},{"osd":1,"last update":"Fri Jul 14 15:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.66700000000000004,"15min":0.66900000000000004},"min":{"1min":0.442,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98299999999999998,"5min":1,"15min":1},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.86199999999999999,"15min":0.89600000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88100000000000001,"5min":4.665,"15min":4.665},"last":0.79200000000000004}]},{"osd":2,"last update":"Fri Jul 14 15:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.872,"15min":0.91200000000000003},"min":{"1min":0.50600000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.86699999999999999,"5min":5.4089999999999998,"15min":5.4089999999999998},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.76700000000000002,"15min":0.77500000000000002},"min":{"1min":0.497,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0389999999999999,"5min":2.165,"15min":2.165},"last":0.88200000000000001}]},{"osd":3,"last update":"Fri Jul 14 15:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.753,"15min":0.76100000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.96199999999999997,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.80600000000000005,"15min":0.82399999999999995},"min":{"1min":0.49299999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.92500000000000004,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":0.77000000000000002}]},{"osd":4,"last update":"Fri Jul 14 15:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.63900000000000001,"15min":0.64100000000000001},"min":{"1min":0.41099999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89200000000000002,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.65400000000000003,"15min":0.65900000000000003},"min":{"1min":0.37,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.77800000000000002,"5min":1.111,"15min":1.111},"last":0.67600000000000005}]},{"osd":5,"last update":"Fri Jul 14 15:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.65100000000000002,"15min":0.65900000000000003},"min":{"1min":0.40400000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.80500000000000005,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.73799999999999999,"15min":0.747},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.89800000000000002,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.90500000000000003}]},{"osd":6,"last update":"Fri Jul 14 15:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69799999999999995,"15min":0.70499999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84799999999999998,"5min":1.042,"15min":1.042},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.76100000000000001,"15min":0.77700000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.83799999999999997,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.83699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T15:58:14.156 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3e is not active+clean 2023-07-14T15:58:14.157 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:58:07.719573+0000', 'last_change': '2023-07-14T15:58:07.719573+0000', 'last_active': '2023-07-14T15:58:07.703703+0000', 'last_peered': '2023-07-14T15:58:07.703703+0000', 'last_clean': '2023-07-14T15:58:07.703703+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:58:07.719573+0000', 'last_undegraded': '2023-07-14T15:58:07.719573+0000', 'last_fullsized': '2023-07-14T15:58:07.719573+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_clean_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T15:58:14.157 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3d is not active+clean 2023-07-14T15:58:14.158 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:58:07.717902+0000', 'last_change': '2023-07-14T15:58:07.717902+0000', 'last_active': '2023-07-14T15:58:07.703703+0000', 'last_peered': '2023-07-14T15:58:07.703703+0000', 'last_clean': '2023-07-14T15:58:07.703703+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:58:07.717902+0000', 'last_undegraded': '2023-07-14T15:58:07.717902+0000', 'last_fullsized': '2023-07-14T15:58:07.717902+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_clean_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T15:58:14.158 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3b is not active+clean 2023-07-14T15:58:14.158 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:58:07.717572+0000', 'last_change': '2023-07-14T15:58:07.717572+0000', 'last_active': '2023-07-14T15:58:07.703703+0000', 'last_peered': '2023-07-14T15:58:07.703703+0000', 'last_clean': '2023-07-14T15:58:07.703703+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:58:07.717572+0000', 'last_undegraded': '2023-07-14T15:58:07.717572+0000', 'last_fullsized': '2023-07-14T15:58:07.717572+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_clean_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T15:58:14.159 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3a is not active+clean 2023-07-14T15:58:14.159 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:58:07.722593+0000', 'last_change': '2023-07-14T15:58:07.722593+0000', 'last_active': '2023-07-14T15:58:07.703703+0000', 'last_peered': '2023-07-14T15:58:07.703703+0000', 'last_clean': '2023-07-14T15:58:07.703703+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:58:07.722593+0000', 'last_undegraded': '2023-07-14T15:58:07.722593+0000', 'last_fullsized': '2023-07-14T15:58:07.722593+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_clean_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T15:58:14.159 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.39 is not active+clean 2023-07-14T15:58:14.160 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:58:07.721460+0000', 'last_change': '2023-07-14T15:58:07.721460+0000', 'last_active': '2023-07-14T15:58:07.703703+0000', 'last_peered': '2023-07-14T15:58:07.703703+0000', 'last_clean': '2023-07-14T15:58:07.703703+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:58:07.721460+0000', 'last_undegraded': '2023-07-14T15:58:07.721460+0000', 'last_fullsized': '2023-07-14T15:58:07.721460+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_clean_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T15:58:14.160 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.38 is not active+clean 2023-07-14T15:58:14.160 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:58:07.724630+0000', 'last_change': '2023-07-14T15:58:07.724630+0000', 'last_active': '2023-07-14T15:58:07.703703+0000', 'last_peered': '2023-07-14T15:58:07.703703+0000', 'last_clean': '2023-07-14T15:58:07.703703+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:58:07.724630+0000', 'last_undegraded': '2023-07-14T15:58:07.724630+0000', 'last_fullsized': '2023-07-14T15:58:07.724630+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_clean_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T15:58:14.161 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.37 is not active+clean 2023-07-14T15:58:14.161 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:58:07.718319+0000', 'last_change': '2023-07-14T15:58:07.718319+0000', 'last_active': '2023-07-14T15:58:07.703703+0000', 'last_peered': '2023-07-14T15:58:07.703703+0000', 'last_clean': '2023-07-14T15:58:07.703703+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:58:07.718319+0000', 'last_undegraded': '2023-07-14T15:58:07.718319+0000', 'last_fullsized': '2023-07-14T15:58:07.718319+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_clean_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T15:58:14.161 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.36 is not active+clean 2023-07-14T15:58:14.162 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:58:07.727661+0000', 'last_change': '2023-07-14T15:58:07.727661+0000', 'last_active': '2023-07-14T15:58:07.703703+0000', 'last_peered': '2023-07-14T15:58:07.703703+0000', 'last_clean': '2023-07-14T15:58:07.703703+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:58:07.727661+0000', 'last_undegraded': '2023-07-14T15:58:07.727661+0000', 'last_fullsized': '2023-07-14T15:58:07.727661+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_clean_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T15:58:14.162 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.34 is not active+clean 2023-07-14T15:58:14.162 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:58:07.722663+0000', 'last_change': '2023-07-14T15:58:07.722663+0000', 'last_active': '2023-07-14T15:58:07.703703+0000', 'last_peered': '2023-07-14T15:58:07.703703+0000', 'last_clean': '2023-07-14T15:58:07.703703+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:58:07.722663+0000', 'last_undegraded': '2023-07-14T15:58:07.722663+0000', 'last_fullsized': '2023-07-14T15:58:07.722663+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_clean_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T15:58:14.163 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.33 is not active+clean 2023-07-14T15:58:14.163 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:58:07.723606+0000', 'last_change': '2023-07-14T15:58:07.723606+0000', 'last_active': '2023-07-14T15:58:07.703703+0000', 'last_peered': '2023-07-14T15:58:07.703703+0000', 'last_clean': '2023-07-14T15:58:07.703703+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:58:07.723606+0000', 'last_undegraded': '2023-07-14T15:58:07.723606+0000', 'last_fullsized': '2023-07-14T15:58:07.723606+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_clean_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T15:58:14.163 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.30 is not active+clean 2023-07-14T15:58:14.164 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:58:07.724137+0000', 'last_change': '2023-07-14T15:58:07.724137+0000', 'last_active': '2023-07-14T15:58:07.703703+0000', 'last_peered': '2023-07-14T15:58:07.703703+0000', 'last_clean': '2023-07-14T15:58:07.703703+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:58:07.724137+0000', 'last_undegraded': '2023-07-14T15:58:07.724137+0000', 'last_fullsized': '2023-07-14T15:58:07.724137+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_clean_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T15:58:14.164 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2d is not active+clean 2023-07-14T15:58:14.164 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:58:07.717241+0000', 'last_change': '2023-07-14T15:58:07.717241+0000', 'last_active': '2023-07-14T15:58:07.703703+0000', 'last_peered': '2023-07-14T15:58:07.703703+0000', 'last_clean': '2023-07-14T15:58:07.703703+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:58:07.717241+0000', 'last_undegraded': '2023-07-14T15:58:07.717241+0000', 'last_fullsized': '2023-07-14T15:58:07.717241+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_clean_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T15:58:14.165 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2c is not active+clean 2023-07-14T15:58:14.165 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:58:07.722074+0000', 'last_change': '2023-07-14T15:58:07.722074+0000', 'last_active': '2023-07-14T15:58:07.703703+0000', 'last_peered': '2023-07-14T15:58:07.703703+0000', 'last_clean': '2023-07-14T15:58:07.703703+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:58:07.722074+0000', 'last_undegraded': '2023-07-14T15:58:07.722074+0000', 'last_fullsized': '2023-07-14T15:58:07.722074+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_clean_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T15:58:14.165 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2a is not active+clean 2023-07-14T15:58:14.166 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:58:07.716580+0000', 'last_change': '2023-07-14T15:58:07.716580+0000', 'last_active': '2023-07-14T15:58:07.703703+0000', 'last_peered': '2023-07-14T15:58:07.703703+0000', 'last_clean': '2023-07-14T15:58:07.703703+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:58:07.716580+0000', 'last_undegraded': '2023-07-14T15:58:07.716580+0000', 'last_fullsized': '2023-07-14T15:58:07.716580+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_clean_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T15:58:14.166 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.29 is not active+clean 2023-07-14T15:58:14.166 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:58:07.715960+0000', 'last_change': '2023-07-14T15:58:07.715960+0000', 'last_active': '2023-07-14T15:58:07.703703+0000', 'last_peered': '2023-07-14T15:58:07.703703+0000', 'last_clean': '2023-07-14T15:58:07.703703+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:58:07.715960+0000', 'last_undegraded': '2023-07-14T15:58:07.715960+0000', 'last_fullsized': '2023-07-14T15:58:07.715960+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_clean_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T15:58:14.167 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.28 is not active+clean 2023-07-14T15:58:14.167 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:58:07.715860+0000', 'last_change': '2023-07-14T15:58:07.715860+0000', 'last_active': '2023-07-14T15:58:07.703703+0000', 'last_peered': '2023-07-14T15:58:07.703703+0000', 'last_clean': '2023-07-14T15:58:07.703703+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:58:07.715860+0000', 'last_undegraded': '2023-07-14T15:58:07.715860+0000', 'last_fullsized': '2023-07-14T15:58:07.715860+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_clean_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T15:58:14.167 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.26 is not active+clean 2023-07-14T15:58:14.168 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:58:07.717249+0000', 'last_change': '2023-07-14T15:58:07.717249+0000', 'last_active': '2023-07-14T15:58:07.703703+0000', 'last_peered': '2023-07-14T15:58:07.703703+0000', 'last_clean': '2023-07-14T15:58:07.703703+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:58:07.717249+0000', 'last_undegraded': '2023-07-14T15:58:07.717249+0000', 'last_fullsized': '2023-07-14T15:58:07.717249+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_clean_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T15:58:14.168 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.25 is not active+clean 2023-07-14T15:58:14.168 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:58:07.723323+0000', 'last_change': '2023-07-14T15:58:07.723323+0000', 'last_active': '2023-07-14T15:58:07.703703+0000', 'last_peered': '2023-07-14T15:58:07.703703+0000', 'last_clean': '2023-07-14T15:58:07.703703+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:58:07.723323+0000', 'last_undegraded': '2023-07-14T15:58:07.723323+0000', 'last_fullsized': '2023-07-14T15:58:07.723323+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_clean_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T15:58:14.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.24 is not active+clean 2023-07-14T15:58:14.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:58:07.721609+0000', 'last_change': '2023-07-14T15:58:07.721609+0000', 'last_active': '2023-07-14T15:58:07.703703+0000', 'last_peered': '2023-07-14T15:58:07.703703+0000', 'last_clean': '2023-07-14T15:58:07.703703+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:58:07.721609+0000', 'last_undegraded': '2023-07-14T15:58:07.721609+0000', 'last_fullsized': '2023-07-14T15:58:07.721609+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_clean_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T15:58:14.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.22 is not active+clean 2023-07-14T15:58:14.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:58:07.724231+0000', 'last_change': '2023-07-14T15:58:07.724231+0000', 'last_active': '2023-07-14T15:58:07.703703+0000', 'last_peered': '2023-07-14T15:58:07.703703+0000', 'last_clean': '2023-07-14T15:58:07.703703+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:58:07.724231+0000', 'last_undegraded': '2023-07-14T15:58:07.724231+0000', 'last_fullsized': '2023-07-14T15:58:07.724231+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_clean_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T15:58:14.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.21 is not active+clean 2023-07-14T15:58:14.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:58:07.715371+0000', 'last_change': '2023-07-14T15:58:07.715371+0000', 'last_active': '2023-07-14T15:58:07.703703+0000', 'last_peered': '2023-07-14T15:58:07.703703+0000', 'last_clean': '2023-07-14T15:58:07.703703+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:58:07.715371+0000', 'last_undegraded': '2023-07-14T15:58:07.715371+0000', 'last_fullsized': '2023-07-14T15:58:07.715371+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_clean_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T15:58:14.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.20 is not active+clean 2023-07-14T15:58:14.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:58:07.717880+0000', 'last_change': '2023-07-14T15:58:07.717880+0000', 'last_active': '2023-07-14T15:58:07.703703+0000', 'last_peered': '2023-07-14T15:58:07.703703+0000', 'last_clean': '2023-07-14T15:58:07.703703+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:58:07.717880+0000', 'last_undegraded': '2023-07-14T15:58:07.717880+0000', 'last_fullsized': '2023-07-14T15:58:07.717880+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_clean_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T15:58:14.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.10 is not active+clean 2023-07-14T15:58:14.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:58:07.722527+0000', 'last_change': '2023-07-14T15:58:07.722527+0000', 'last_active': '2023-07-14T15:58:07.703703+0000', 'last_peered': '2023-07-14T15:58:07.703703+0000', 'last_clean': '2023-07-14T15:58:07.703703+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:58:07.722527+0000', 'last_undegraded': '2023-07-14T15:58:07.722527+0000', 'last_fullsized': '2023-07-14T15:58:07.722527+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_clean_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T15:58:14.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.11 is not active+clean 2023-07-14T15:58:14.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:58:07.722080+0000', 'last_change': '2023-07-14T15:58:07.722080+0000', 'last_active': '2023-07-14T15:58:07.703703+0000', 'last_peered': '2023-07-14T15:58:07.703703+0000', 'last_clean': '2023-07-14T15:58:07.703703+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:58:07.722080+0000', 'last_undegraded': '2023-07-14T15:58:07.722080+0000', 'last_fullsized': '2023-07-14T15:58:07.722080+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_clean_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T15:58:14.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.12 is not active+clean 2023-07-14T15:58:14.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:58:07.722548+0000', 'last_change': '2023-07-14T15:58:07.722548+0000', 'last_active': '2023-07-14T15:58:07.703703+0000', 'last_peered': '2023-07-14T15:58:07.703703+0000', 'last_clean': '2023-07-14T15:58:07.703703+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:58:07.722548+0000', 'last_undegraded': '2023-07-14T15:58:07.722548+0000', 'last_fullsized': '2023-07-14T15:58:07.722548+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_clean_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T15:58:14.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.13 is not active+clean 2023-07-14T15:58:14.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:58:07.722352+0000', 'last_change': '2023-07-14T15:58:07.722352+0000', 'last_active': '2023-07-14T15:58:07.703703+0000', 'last_peered': '2023-07-14T15:58:07.703703+0000', 'last_clean': '2023-07-14T15:58:07.703703+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:58:07.722352+0000', 'last_undegraded': '2023-07-14T15:58:07.722352+0000', 'last_fullsized': '2023-07-14T15:58:07.722352+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_clean_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T15:58:14.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.15 is not active+clean 2023-07-14T15:58:14.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:58:07.722513+0000', 'last_change': '2023-07-14T15:58:07.722513+0000', 'last_active': '2023-07-14T15:58:07.703703+0000', 'last_peered': '2023-07-14T15:58:07.703703+0000', 'last_clean': '2023-07-14T15:58:07.703703+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:58:07.722513+0000', 'last_undegraded': '2023-07-14T15:58:07.722513+0000', 'last_fullsized': '2023-07-14T15:58:07.722513+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_clean_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T15:58:14.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.16 is not active+clean 2023-07-14T15:58:14.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:58:07.728183+0000', 'last_change': '2023-07-14T15:58:07.728183+0000', 'last_active': '2023-07-14T15:58:07.703703+0000', 'last_peered': '2023-07-14T15:58:07.703703+0000', 'last_clean': '2023-07-14T15:58:07.703703+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:58:07.728183+0000', 'last_undegraded': '2023-07-14T15:58:07.728183+0000', 'last_fullsized': '2023-07-14T15:58:07.728183+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_clean_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T15:58:14.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1b is not active+clean 2023-07-14T15:58:14.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:58:07.717011+0000', 'last_change': '2023-07-14T15:58:07.717011+0000', 'last_active': '2023-07-14T15:58:07.703703+0000', 'last_peered': '2023-07-14T15:58:07.703703+0000', 'last_clean': '2023-07-14T15:58:07.703703+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:58:07.717011+0000', 'last_undegraded': '2023-07-14T15:58:07.717011+0000', 'last_fullsized': '2023-07-14T15:58:07.717011+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_clean_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T15:58:14.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1c is not active+clean 2023-07-14T15:58:14.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:58:07.723416+0000', 'last_change': '2023-07-14T15:58:07.723416+0000', 'last_active': '2023-07-14T15:58:07.703703+0000', 'last_peered': '2023-07-14T15:58:07.703703+0000', 'last_clean': '2023-07-14T15:58:07.703703+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:58:07.723416+0000', 'last_undegraded': '2023-07-14T15:58:07.723416+0000', 'last_fullsized': '2023-07-14T15:58:07.723416+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_clean_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T15:58:14.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1e is not active+clean 2023-07-14T15:58:14.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:58:07.726184+0000', 'last_change': '2023-07-14T15:58:07.726184+0000', 'last_active': '2023-07-14T15:58:07.703703+0000', 'last_peered': '2023-07-14T15:58:07.703703+0000', 'last_clean': '2023-07-14T15:58:07.703703+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:58:07.726184+0000', 'last_undegraded': '2023-07-14T15:58:07.726184+0000', 'last_fullsized': '2023-07-14T15:58:07.726184+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_clean_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T15:58:14.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1f is not active+clean 2023-07-14T15:58:14.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:58:07.717478+0000', 'last_change': '2023-07-14T15:58:07.717478+0000', 'last_active': '2023-07-14T15:58:07.703703+0000', 'last_peered': '2023-07-14T15:58:07.703703+0000', 'last_clean': '2023-07-14T15:58:07.703703+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:58:07.717478+0000', 'last_undegraded': '2023-07-14T15:58:07.717478+0000', 'last_fullsized': '2023-07-14T15:58:07.717478+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_clean_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T15:58:14.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.0 is not active+clean 2023-07-14T15:58:14.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:58:07.720869+0000', 'last_change': '2023-07-14T15:58:07.720869+0000', 'last_active': '2023-07-14T15:58:07.703703+0000', 'last_peered': '2023-07-14T15:58:07.703703+0000', 'last_clean': '2023-07-14T15:58:07.703703+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:58:07.720869+0000', 'last_undegraded': '2023-07-14T15:58:07.720869+0000', 'last_fullsized': '2023-07-14T15:58:07.720869+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_clean_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T15:58:14.179 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2 is not active+clean 2023-07-14T15:58:14.179 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:58:07.718942+0000', 'last_change': '2023-07-14T15:58:07.718942+0000', 'last_active': '2023-07-14T15:58:07.703703+0000', 'last_peered': '2023-07-14T15:58:07.703703+0000', 'last_clean': '2023-07-14T15:58:07.703703+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:58:07.718942+0000', 'last_undegraded': '2023-07-14T15:58:07.718942+0000', 'last_fullsized': '2023-07-14T15:58:07.718942+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_clean_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T15:58:14.179 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3 is not active+clean 2023-07-14T15:58:14.180 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:58:07.723135+0000', 'last_change': '2023-07-14T15:58:07.723135+0000', 'last_active': '2023-07-14T15:58:07.703703+0000', 'last_peered': '2023-07-14T15:58:07.703703+0000', 'last_clean': '2023-07-14T15:58:07.703703+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:58:07.723135+0000', 'last_undegraded': '2023-07-14T15:58:07.723135+0000', 'last_fullsized': '2023-07-14T15:58:07.723135+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_clean_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T15:58:14.180 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.4 is not active+clean 2023-07-14T15:58:14.180 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:58:07.721077+0000', 'last_change': '2023-07-14T15:58:07.721077+0000', 'last_active': '2023-07-14T15:58:07.703703+0000', 'last_peered': '2023-07-14T15:58:07.703703+0000', 'last_clean': '2023-07-14T15:58:07.703703+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:58:07.721077+0000', 'last_undegraded': '2023-07-14T15:58:07.721077+0000', 'last_fullsized': '2023-07-14T15:58:07.721077+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_clean_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T15:58:14.181 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.7 is not active+clean 2023-07-14T15:58:14.181 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:58:07.724269+0000', 'last_change': '2023-07-14T15:58:07.724269+0000', 'last_active': '2023-07-14T15:58:07.703703+0000', 'last_peered': '2023-07-14T15:58:07.703703+0000', 'last_clean': '2023-07-14T15:58:07.703703+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:58:07.724269+0000', 'last_undegraded': '2023-07-14T15:58:07.724269+0000', 'last_fullsized': '2023-07-14T15:58:07.724269+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_clean_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T15:58:14.181 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.e is not active+clean 2023-07-14T15:58:14.181 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:58:07.723098+0000', 'last_change': '2023-07-14T15:58:07.723098+0000', 'last_active': '2023-07-14T15:58:07.703703+0000', 'last_peered': '2023-07-14T15:58:07.703703+0000', 'last_clean': '2023-07-14T15:58:07.703703+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:58:07.723098+0000', 'last_undegraded': '2023-07-14T15:58:07.723098+0000', 'last_fullsized': '2023-07-14T15:58:07.723098+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_clean_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T15:58:14.182 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.b is not active+clean 2023-07-14T15:58:14.182 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:58:07.716992+0000', 'last_change': '2023-07-14T15:58:07.716992+0000', 'last_active': '2023-07-14T15:58:07.703703+0000', 'last_peered': '2023-07-14T15:58:07.703703+0000', 'last_clean': '2023-07-14T15:58:07.703703+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:58:07.716992+0000', 'last_undegraded': '2023-07-14T15:58:07.716992+0000', 'last_fullsized': '2023-07-14T15:58:07.716992+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_clean_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T15:58:14.182 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.a is not active+clean 2023-07-14T15:58:14.183 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:58:07.721138+0000', 'last_change': '2023-07-14T15:58:07.721138+0000', 'last_active': '2023-07-14T15:58:07.703703+0000', 'last_peered': '2023-07-14T15:58:07.703703+0000', 'last_clean': '2023-07-14T15:58:07.703703+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:58:07.721138+0000', 'last_undegraded': '2023-07-14T15:58:07.721138+0000', 'last_fullsized': '2023-07-14T15:58:07.721138+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_clean_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T15:58:14.183 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.f is not active+clean 2023-07-14T15:58:14.183 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:58:07.724821+0000', 'last_change': '2023-07-14T15:58:07.724821+0000', 'last_active': '2023-07-14T15:58:07.703703+0000', 'last_peered': '2023-07-14T15:58:07.703703+0000', 'last_clean': '2023-07-14T15:58:07.703703+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:58:07.724821+0000', 'last_undegraded': '2023-07-14T15:58:07.724821+0000', 'last_fullsized': '2023-07-14T15:58:07.724821+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_clean_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T15:58:14.184 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.c is not active+clean 2023-07-14T15:58:14.184 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:58:07.721620+0000', 'last_change': '2023-07-14T15:58:07.721620+0000', 'last_active': '2023-07-14T15:58:07.703703+0000', 'last_peered': '2023-07-14T15:58:07.703703+0000', 'last_clean': '2023-07-14T15:58:07.703703+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:58:07.721620+0000', 'last_undegraded': '2023-07-14T15:58:07.721620+0000', 'last_fullsized': '2023-07-14T15:58:07.721620+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_clean_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T15:58:14.184 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.d is not active+clean 2023-07-14T15:58:14.185 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-07-14T15:58:07.718370+0000', 'last_change': '2023-07-14T15:58:07.718370+0000', 'last_active': '2023-07-14T15:58:07.703703+0000', 'last_peered': '2023-07-14T15:58:07.703703+0000', 'last_clean': '2023-07-14T15:58:07.703703+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T15:58:07.718370+0000', 'last_undegraded': '2023-07-14T15:58:07.718370+0000', 'last_fullsized': '2023-07-14T15:58:07.718370+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'last_clean_scrub_stamp': '2023-07-14T15:58:07.703703+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T15:58:14.185 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-14T15:58:14.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.405+0000 7f54bfdff700 1 Processor -- start 2023-07-14T15:58:14.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.405+0000 7f54bfdff700 1 -- start start 2023-07-14T15:58:14.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.406+0000 7f54bfdff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f54b80b5cf0 0x7f54b8160c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:14.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.406+0000 7f54bfdff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b80d0de0 con 0x7f54b80b8b80 2023-07-14T15:58:14.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.406+0000 7f54bfdff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b80cd590 con 0x7f54b80cffc0 2023-07-14T15:58:14.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.406+0000 7f54bfdff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54b8161190 con 0x7f54b80b5cf0 2023-07-14T15:58:14.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.407+0000 7f54bdb9b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f54b80b8b80 0x7f54b80cf8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47030/0 (socket says 172.21.15.37:47030) 2023-07-14T15:58:14.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.407+0000 7f54bdb9b700 1 -- 172.21.15.37:0/1061407148 learned_addr learned my addr 172.21.15.37:0/1061407148 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:58:14.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.407+0000 7f54be39c700 1 --2- 172.21.15.37:0/1061407148 >> v2:172.21.15.98:3300/0 conn(0x7f54b80b5cf0 0x7f54b8160c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:14.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.407+0000 7f54bcb99700 1 -- 172.21.15.37:0/1061407148 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2758194944 0 0) 0x7f54b80d0de0 con 0x7f54b80b8b80 2023-07-14T15:58:14.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.407+0000 7f54bcb99700 1 -- 172.21.15.37:0/1061407148 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54a40035b0 con 0x7f54b80b8b80 2023-07-14T15:58:14.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.407+0000 7f54bcb99700 1 -- 172.21.15.37:0/1061407148 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4080114361 0 0) 0x7f54b80cd590 con 0x7f54b80cffc0 2023-07-14T15:58:14.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.407+0000 7f54bcb99700 1 -- 172.21.15.37:0/1061407148 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54b80d0de0 con 0x7f54b80cffc0 2023-07-14T15:58:14.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.407+0000 7f54be39c700 1 -- 172.21.15.37:0/1061407148 >> v1:172.21.15.98:6789/0 conn(0x7f54b80cffc0 legacy=0x7f54b80d1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:14.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.407+0000 7f54be39c700 1 -- 172.21.15.37:0/1061407148 >> v1:172.21.15.37:6789/0 conn(0x7f54b80b8b80 legacy=0x7f54b80cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:14.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.407+0000 7f54bcb99700 1 -- 172.21.15.37:0/1061407148 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 47241304 0 0) 0x7f54a40035b0 con 0x7f54b80b8b80 2023-07-14T15:58:14.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.408+0000 7f54be39c700 1 -- 172.21.15.37:0/1061407148 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b80cd870 con 0x7f54b80b5cf0 2023-07-14T15:58:14.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.408+0000 7f54be39c700 1 --2- 172.21.15.37:0/1061407148 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54b80b5cf0 0x7f54b8160c50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f54b0009d90 tx=0x7f54b000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81279f391bf08180 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:14.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.408+0000 7f54bcb99700 1 -- 172.21.15.37:0/1061407148 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b000e070 con 0x7f54b80b5cf0 2023-07-14T15:58:14.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.408+0000 7f54bcb99700 1 -- 172.21.15.37:0/1061407148 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b0003a20 con 0x7f54b80b5cf0 2023-07-14T15:58:14.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.408+0000 7f54bcb99700 1 -- 172.21.15.37:0/1061407148 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b4001670 con 0x7f54b80b5cf0 2023-07-14T15:58:14.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.409+0000 7f54bfdff700 1 -- 172.21.15.37:0/1061407148 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54b80b5cf0 msgr2=0x7f54b8160c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:14.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.409+0000 7f54bfdff700 1 --2- 172.21.15.37:0/1061407148 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54b80b5cf0 0x7f54b8160c50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f54b0009d90 tx=0x7f54b000b330 comp rx=0 tx=0).stop 2023-07-14T15:58:14.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.409+0000 7f54bfdff700 1 -- 172.21.15.37:0/1061407148 shutdown_connections 2023-07-14T15:58:14.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.409+0000 7f54bfdff700 1 --2- 172.21.15.37:0/1061407148 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54b80b5cf0 0x7f54b8160c50 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:14.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.409+0000 7f54bfdff700 1 -- 172.21.15.37:0/1061407148 >> 172.21.15.37:0/1061407148 conn(0x7f54b806b150 msgr2=0x7f54b806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:14.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.409+0000 7f54bfdff700 1 -- 172.21.15.37:0/1061407148 shutdown_connections 2023-07-14T15:58:14.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.409+0000 7f54bfdff700 1 -- 172.21.15.37:0/1061407148 wait complete. 2023-07-14T15:58:14.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.410+0000 7f54bfdff700 1 Processor -- start 2023-07-14T15:58:14.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.411+0000 7f54bfdff700 1 -- start start 2023-07-14T15:58:14.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.411+0000 7f54bfdff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54b80b5cf0 0x7f54b80b4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:14.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.412+0000 7f54bfdff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54b80b8b80 0x7f54b80c9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:14.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.412+0000 7f54bfdff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f54b80cffc0 0x7f54b815e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:14.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.412+0000 7f54bfdff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b80b4600 con 0x7f54b80b8b80 2023-07-14T15:58:14.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.412+0000 7f54bfdff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b81f25e0 con 0x7f54b80b5cf0 2023-07-14T15:58:14.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.412+0000 7f54bfdff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b80b3050 con 0x7f54b80cffc0 2023-07-14T15:58:14.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.412+0000 7f54bd39a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54b80b8b80 0x7f54b80c9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:14.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.412+0000 7f54bd39a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54b80b8b80 0x7f54b80c9f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49552/0 (socket says 172.21.15.37:49552) 2023-07-14T15:58:14.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.412+0000 7f54bd39a700 1 -- 172.21.15.37:0/524422848 learned_addr learned my addr 172.21.15.37:0/524422848 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:14.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.412+0000 7f54bdb9b700 1 --2- 172.21.15.37:0/524422848 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54b80b5cf0 0x7f54b80b4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:14.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.412+0000 7f54be39c700 1 --2- 172.21.15.37:0/524422848 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f54b80cffc0 0x7f54b815e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:14.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.412+0000 7f54bd39a700 1 -- 172.21.15.37:0/524422848 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f54b80cffc0 msgr2=0x7f54b815e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:14.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.412+0000 7f54bd39a700 1 --2- 172.21.15.37:0/524422848 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f54b80cffc0 0x7f54b815e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:14.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.412+0000 7f54bd39a700 1 -- 172.21.15.37:0/524422848 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54b80b5cf0 msgr2=0x7f54b80b4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:14.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.412+0000 7f54bd39a700 1 --2- 172.21.15.37:0/524422848 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54b80b5cf0 0x7f54b80b4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:14.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.412+0000 7f54bd39a700 1 -- 172.21.15.37:0/524422848 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b0009a70 con 0x7f54b80b8b80 2023-07-14T15:58:14.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.413+0000 7f54bd39a700 1 --2- 172.21.15.37:0/524422848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54b80b8b80 0x7f54b80c9f70 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f54a800c430 tx=0x7f54a800c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:14.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.413+0000 7f54ae7fc700 1 -- 172.21.15.37:0/524422848 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a80050d0 con 0x7f54b80b8b80 2023-07-14T15:58:14.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.413+0000 7f54ae7fc700 1 -- 172.21.15.37:0/524422848 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a8005250 con 0x7f54b80b8b80 2023-07-14T15:58:14.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.413+0000 7f54bfdff700 1 -- 172.21.15.37:0/524422848 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54b80b3330 con 0x7f54b80b8b80 2023-07-14T15:58:14.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.413+0000 7f54ae7fc700 1 -- 172.21.15.37:0/524422848 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a8003680 con 0x7f54b80b8b80 2023-07-14T15:58:14.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.413+0000 7f54bfdff700 1 -- 172.21.15.37:0/524422848 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54b80b3ee0 con 0x7f54b80b8b80 2023-07-14T15:58:14.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.414+0000 7f54bfdff700 1 -- 172.21.15.37:0/524422848 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54b80b4740 con 0x7f54b80b8b80 2023-07-14T15:58:14.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.415+0000 7f54ae7fc700 1 -- 172.21.15.37:0/524422848 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f54a80037e0 con 0x7f54b80b8b80 2023-07-14T15:58:14.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.416+0000 7f54ae7fc700 1 --2- 172.21.15.37:0/524422848 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f549c06ad70 0x7f549c06d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:14.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.416+0000 7f54ae7fc700 1 -- 172.21.15.37:0/524422848 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f54a8088890 con 0x7f54b80b8b80 2023-07-14T15:58:14.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.416+0000 7f54bdb9b700 1 --2- 172.21.15.37:0/524422848 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f549c06ad70 0x7f549c06d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:14.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.417+0000 7f54bdb9b700 1 --2- 172.21.15.37:0/524422848 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f549c06ad70 0x7f549c06d220 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f54b815f520 tx=0x7f54b4000ed0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:14.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.420+0000 7f54ae7fc700 1 -- 172.21.15.37:0/524422848 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f54b80b4740 con 0x7f54b80b8b80 2023-07-14T15:58:14.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.713+0000 7f54bfdff700 1 -- 172.21.15.37:0/524422848 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f54b80b4740 con 0x7f54b80b8b80 2023-07-14T15:58:14.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.714+0000 7f54ae7fc700 1 -- 172.21.15.37:0/524422848 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1516 (secure 0 0 0) 0x7f54b80b4740 con 0x7f54b80b8b80 2023-07-14T15:58:14.698 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:58:14.698 INFO:teuthology.orchestra.run.smithi037.stdout:{"fsid":"9da30401-a779-4e46-aba6-00c2494c6c67","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":154,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":49,"num_osds":8,"num_up_osds":8,"osd_up_since":1689350153,"num_in_osds":8,"osd_in_since":1689350143,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":62},{"state_name":"creating+peering","count":43}],"num_pgs":105,"num_pools":4,"num_objects":6,"data_bytes":591020,"bytes_used":234713088,"bytes_avail":772859400192,"bytes_total":773094113280,"inactive_pgs_ratio":0.40952381491661072,"write_bytes_sec":341,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":25,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":5652}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-07-14T15:57:56.880422+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-07-14T15:58:14.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.716+0000 7f54bfdff700 1 -- 172.21.15.37:0/524422848 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f549c06ad70 msgr2=0x7f549c06d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:14.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.716+0000 7f54bfdff700 1 --2- 172.21.15.37:0/524422848 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f549c06ad70 0x7f549c06d220 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f54b815f520 tx=0x7f54b4000ed0 comp rx=0 tx=0).stop 2023-07-14T15:58:14.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.716+0000 7f54bfdff700 1 -- 172.21.15.37:0/524422848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54b80b8b80 msgr2=0x7f54b80c9f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:14.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.716+0000 7f54bfdff700 1 --2- 172.21.15.37:0/524422848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54b80b8b80 0x7f54b80c9f70 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f54a800c430 tx=0x7f54a800c740 comp rx=0 tx=0).stop 2023-07-14T15:58:14.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.716+0000 7f54bfdff700 1 -- 172.21.15.37:0/524422848 shutdown_connections 2023-07-14T15:58:14.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.716+0000 7f54bfdff700 1 --2- 172.21.15.37:0/524422848 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54b80b5cf0 0x7f54b80b4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:14.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.716+0000 7f54bfdff700 1 --2- 172.21.15.37:0/524422848 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f549c06ad70 0x7f549c06d220 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:14.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.716+0000 7f54bfdff700 1 --2- 172.21.15.37:0/524422848 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f54b80cffc0 0x7f54b815e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:14.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.716+0000 7f54bfdff700 1 --2- 172.21.15.37:0/524422848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54b80b8b80 0x7f54b80c9f70 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:14.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.716+0000 7f54bfdff700 1 -- 172.21.15.37:0/524422848 >> 172.21.15.37:0/524422848 conn(0x7f54b806b150 msgr2=0x7f54b815cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:14.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.716+0000 7f54bfdff700 1 -- 172.21.15.37:0/524422848 shutdown_connections 2023-07-14T15:58:14.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.716+0000 7f54bfdff700 1 -- 172.21.15.37:0/524422848 wait complete. 2023-07-14T15:58:14.718 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-14T15:58:14.718 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T15:58:14.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.937+0000 7f00f53ff700 1 Processor -- start 2023-07-14T15:58:14.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.937+0000 7f00f53ff700 1 -- start start 2023-07-14T15:58:14.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.938+0000 7f00f53ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f00f00b24e0 0x7f00f00cf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:14.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.939+0000 7f00f53ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00f00cd540 con 0x7f00f00b8650 2023-07-14T15:58:14.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.939+0000 7f00f53ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00f0160f70 con 0x7f00f00cfbd0 2023-07-14T15:58:14.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.939+0000 7f00f53ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f00cd790 con 0x7f00f00b24e0 2023-07-14T15:58:14.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.939+0000 7f00eeffd700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f00f00b8650 0x7f00f00d0ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47042/0 (socket says 172.21.15.37:47042) 2023-07-14T15:58:14.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.939+0000 7f00eeffd700 1 -- 172.21.15.37:0/2683056204 learned_addr learned my addr 172.21.15.37:0/2683056204 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:58:14.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.939+0000 7f00e7fff700 1 --2- 172.21.15.37:0/2683056204 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f00f00b24e0 0x7f00f00cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:14.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.939+0000 7f00ee7fc700 1 -- 172.21.15.37:0/2683056204 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 847066208 0 0) 0x7f00f00cd540 con 0x7f00f00b8650 2023-07-14T15:58:14.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.939+0000 7f00ee7fc700 1 -- 172.21.15.37:0/2683056204 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00dc0035b0 con 0x7f00f00b8650 2023-07-14T15:58:14.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.939+0000 7f00ee7fc700 1 -- 172.21.15.37:0/2683056204 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3895128591 0 0) 0x7f00f0160f70 con 0x7f00f00cfbd0 2023-07-14T15:58:14.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.939+0000 7f00ee7fc700 1 -- 172.21.15.37:0/2683056204 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00f00cd540 con 0x7f00f00cfbd0 2023-07-14T15:58:14.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.940+0000 7f00ee7fc700 1 -- 172.21.15.37:0/2683056204 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2551520452 0 0) 0x7f00dc0035b0 con 0x7f00f00b8650 2023-07-14T15:58:14.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.940+0000 7f00ee7fc700 1 -- 172.21.15.37:0/2683056204 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f00f00b24e0 msgr2=0x7f00f00cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:14.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.940+0000 7f00ee7fc700 1 --2- 172.21.15.37:0/2683056204 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f00f00b24e0 0x7f00f00cf690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:14.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.940+0000 7f00ee7fc700 1 -- 172.21.15.37:0/2683056204 >> v1:172.21.15.98:6789/0 conn(0x7f00f00cfbd0 legacy=0x7f00f015cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:14.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.940+0000 7f00ee7fc700 1 -- 172.21.15.37:0/2683056204 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f00cda70 con 0x7f00f00b8650 2023-07-14T15:58:14.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.940+0000 7f00ee7fc700 1 -- 172.21.15.37:0/2683056204 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48633207 0 0) 0x7f00e0001670 con 0x7f00f00b8650 2023-07-14T15:58:14.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.940+0000 7f00e7fff700 1 --2- 172.21.15.37:0/2683056204 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f00f00b24e0 0x7f00f00cf690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:58:14.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.940+0000 7f00ee7fc700 1 -- 172.21.15.37:0/2683056204 >> v1:172.21.15.37:6789/0 conn(0x7f00f00b8650 legacy=0x7f00f00d0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:14.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.940+0000 7f00ee7fc700 1 --2- 172.21.15.37:0/2683056204 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f00dc003bc0 0x7f00dc003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:14.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.940+0000 7f00ee7fc700 1 --2- 172.21.15.37:0/2683056204 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f00f00b24e0 0x7f00dc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:14.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.940+0000 7f00ee7fc700 1 --2- 172.21.15.37:0/2683056204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00dc004d90 0x7f00dc005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:14.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.940+0000 7f00ee7fc700 1 -- 172.21.15.37:0/2683056204 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f00cd790 con 0x7f00dc004d90 2023-07-14T15:58:14.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.940+0000 7f00ee7fc700 1 -- 172.21.15.37:0/2683056204 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc00bac0 con 0x7f00dc003bc0 2023-07-14T15:58:14.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.940+0000 7f00ee7fc700 1 -- 172.21.15.37:0/2683056204 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc00bc00 con 0x7f00f00b24e0 2023-07-14T15:58:14.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.940+0000 7f00ef7fe700 1 --2- 172.21.15.37:0/2683056204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00dc004d90 0x7f00dc005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:14.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.940+0000 7f00eeffd700 1 --2- 172.21.15.37:0/2683056204 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f00dc003bc0 0x7f00dc003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:14.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.940+0000 7f00e7fff700 1 --2- 172.21.15.37:0/2683056204 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f00f00b24e0 0x7f00dc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:14.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.940+0000 7f00ef7fe700 1 -- 172.21.15.37:0/2683056204 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f00f00b24e0 msgr2=0x7f00dc004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:14.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.940+0000 7f00ef7fe700 1 --2- 172.21.15.37:0/2683056204 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f00f00b24e0 0x7f00dc004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:14.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.940+0000 7f00ef7fe700 1 -- 172.21.15.37:0/2683056204 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f00dc003bc0 msgr2=0x7f00dc003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:14.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.940+0000 7f00ef7fe700 1 --2- 172.21.15.37:0/2683056204 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f00dc003bc0 0x7f00dc003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:14.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.940+0000 7f00ef7fe700 1 -- 172.21.15.37:0/2683056204 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d80094a0 con 0x7f00dc004d90 2023-07-14T15:58:14.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.941+0000 7f00ef7fe700 1 --2- 172.21.15.37:0/2683056204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00dc004d90 0x7f00dc005200 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f00e800c2f0 tx=0x7f00dc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8940c297d04e1e9f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:14.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.941+0000 7f00ee7fc700 1 -- 172.21.15.37:0/2683056204 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e8001f30 con 0x7f00dc004d90 2023-07-14T15:58:14.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.941+0000 7f00ee7fc700 1 -- 172.21.15.37:0/2683056204 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e800ce90 con 0x7f00dc004d90 2023-07-14T15:58:14.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.941+0000 7f00ee7fc700 1 -- 172.21.15.37:0/2683056204 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e8003c40 con 0x7f00dc004d90 2023-07-14T15:58:14.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.941+0000 7f00f53ff700 1 -- 172.21.15.37:0/2683056204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00dc004d90 msgr2=0x7f00dc005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:14.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.941+0000 7f00f53ff700 1 --2- 172.21.15.37:0/2683056204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00dc004d90 0x7f00dc005200 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f00e800c2f0 tx=0x7f00dc005880 comp rx=0 tx=0).stop 2023-07-14T15:58:14.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.941+0000 7f00ef7fe700 1 -- 172.21.15.37:0/2683056204 reap_dead start 2023-07-14T15:58:14.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.941+0000 7f00f53ff700 1 -- 172.21.15.37:0/2683056204 shutdown_connections 2023-07-14T15:58:14.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.941+0000 7f00f53ff700 1 -- 172.21.15.37:0/2683056204 >> 172.21.15.37:0/2683056204 conn(0x7f00f006c0f0 msgr2=0x7f00f006c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:14.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.942+0000 7f00f53ff700 1 -- 172.21.15.37:0/2683056204 shutdown_connections 2023-07-14T15:58:14.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.942+0000 7f00f53ff700 1 -- 172.21.15.37:0/2683056204 wait complete. 2023-07-14T15:58:14.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.943+0000 7f00f53ff700 1 Processor -- start 2023-07-14T15:58:14.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.943+0000 7f00f53ff700 1 -- start start 2023-07-14T15:58:14.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.944+0000 7f00f53ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f00dc004d90 0x7f00f00cb010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:14.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.944+0000 7f00f53ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00f006dad0 0x7f00f006fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:14.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.944+0000 7f00f53ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f00f015ec40 0x7f00f015a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:14.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.944+0000 7f00f53ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f00703b0 con 0x7f00f006dad0 2023-07-14T15:58:14.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.944+0000 7f00f53ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f006df40 con 0x7f00f015ec40 2023-07-14T15:58:14.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.944+0000 7f00f53ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f0070630 con 0x7f00dc004d90 2023-07-14T15:58:14.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.945+0000 7f00e7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00f006dad0 0x7f00f006fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:14.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.945+0000 7f00e7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00f006dad0 0x7f00f006fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49578/0 (socket says 172.21.15.37:49578) 2023-07-14T15:58:14.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.945+0000 7f00e7fff700 1 -- 172.21.15.37:0/3153325281 learned_addr learned my addr 172.21.15.37:0/3153325281 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:14.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.945+0000 7f00ef7fe700 1 --2- 172.21.15.37:0/3153325281 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f00f015ec40 0x7f00f015a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:14.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.945+0000 7f00eeffd700 1 --2- 172.21.15.37:0/3153325281 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f00dc004d90 0x7f00f00cb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:14.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.945+0000 7f00e7fff700 1 -- 172.21.15.37:0/3153325281 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f00dc004d90 msgr2=0x7f00f00cb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:14.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.945+0000 7f00e7fff700 1 --2- 172.21.15.37:0/3153325281 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f00dc004d90 0x7f00f00cb010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:14.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.945+0000 7f00e7fff700 1 -- 172.21.15.37:0/3153325281 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f00f015ec40 msgr2=0x7f00f015a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:14.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.945+0000 7f00e7fff700 1 --2- 172.21.15.37:0/3153325281 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f00f015ec40 0x7f00f015a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:14.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.945+0000 7f00e7fff700 1 -- 172.21.15.37:0/3153325281 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f0070910 con 0x7f00f006dad0 2023-07-14T15:58:14.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.945+0000 7f00e7fff700 1 --2- 172.21.15.37:0/3153325281 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00f006dad0 0x7f00f006fe70 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f00d8011cd0 tx=0x7f00d8009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:14.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.946+0000 7f00e77fe700 1 -- 172.21.15.37:0/3153325281 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d800f9a0 con 0x7f00f006dad0 2023-07-14T15:58:14.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.946+0000 7f00e77fe700 1 -- 172.21.15.37:0/3153325281 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d800fb00 con 0x7f00f006dad0 2023-07-14T15:58:14.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.946+0000 7f00e77fe700 1 -- 172.21.15.37:0/3153325281 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d800fe90 con 0x7f00f006dad0 2023-07-14T15:58:14.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.946+0000 7f00f53ff700 1 -- 172.21.15.37:0/3153325281 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00f015cde0 con 0x7f00f006dad0 2023-07-14T15:58:14.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.946+0000 7f00f53ff700 1 -- 172.21.15.37:0/3153325281 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00f015d3a0 con 0x7f00f006dad0 2023-07-14T15:58:14.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.947+0000 7f00f53ff700 1 -- 172.21.15.37:0/3153325281 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00f015d710 con 0x7f00f006dad0 2023-07-14T15:58:14.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.948+0000 7f00e77fe700 1 -- 172.21.15.37:0/3153325281 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f00d8004020 con 0x7f00f006dad0 2023-07-14T15:58:14.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.949+0000 7f00e77fe700 1 --2- 172.21.15.37:0/3153325281 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f00d006ad70 0x7f00d006d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:14.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.949+0000 7f00e77fe700 1 -- 172.21.15.37:0/3153325281 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f00d8089da0 con 0x7f00f006dad0 2023-07-14T15:58:14.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.949+0000 7f00eeffd700 1 --2- 172.21.15.37:0/3153325281 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f00d006ad70 0x7f00d006d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:14.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.950+0000 7f00eeffd700 1 --2- 172.21.15.37:0/3153325281 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f00d006ad70 0x7f00d006d220 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f00e0000c00 tx=0x7f00e0001df0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:14.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:14.953+0000 7f00e77fe700 1 -- 172.21.15.37:0/3153325281 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f00d8054df0 con 0x7f00f006dad0 2023-07-14T15:58:15.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:15.157+0000 7f00f53ff700 1 -- 172.21.15.37:0/3153325281 --> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f00f00cf140 con 0x7f00d006ad70 2023-07-14T15:58:15.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:15.167+0000 7f00e77fe700 1 -- 172.21.15.37:0/3153325281 <== mgr.4100 v2:172.21.15.98:6832/3163748069 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311343 (secure 0 0 0) 0x7f00e00070c0 con 0x7f00d006ad70 2023-07-14T15:58:15.155 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:58:15.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:15.171+0000 7f00f53ff700 1 -- 172.21.15.37:0/3153325281 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f00d006ad70 msgr2=0x7f00d006d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:15.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:15.171+0000 7f00f53ff700 1 --2- 172.21.15.37:0/3153325281 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f00d006ad70 0x7f00d006d220 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f00e0000c00 tx=0x7f00e0001df0 comp rx=0 tx=0).stop 2023-07-14T15:58:15.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:15.171+0000 7f00f53ff700 1 -- 172.21.15.37:0/3153325281 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00f006dad0 msgr2=0x7f00f006fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:15.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:15.171+0000 7f00f53ff700 1 --2- 172.21.15.37:0/3153325281 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00f006dad0 0x7f00f006fe70 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f00d8011cd0 tx=0x7f00d8009ed0 comp rx=0 tx=0).stop 2023-07-14T15:58:15.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:15.171+0000 7f00f53ff700 1 -- 172.21.15.37:0/3153325281 shutdown_connections 2023-07-14T15:58:15.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:15.171+0000 7f00f53ff700 1 --2- 172.21.15.37:0/3153325281 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f00f015ec40 0x7f00f015a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:15.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:15.171+0000 7f00f53ff700 1 --2- 172.21.15.37:0/3153325281 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f00d006ad70 0x7f00d006d220 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:15.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:15.171+0000 7f00f53ff700 1 --2- 172.21.15.37:0/3153325281 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f00dc004d90 0x7f00f00cb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:15.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:15.171+0000 7f00f53ff700 1 --2- 172.21.15.37:0/3153325281 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00f006dad0 0x7f00f006fe70 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:15.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:15.171+0000 7f00f53ff700 1 -- 172.21.15.37:0/3153325281 >> 172.21.15.37:0/3153325281 conn(0x7f00f006c0f0 msgr2=0x7f00f00b5d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:15.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:15.171+0000 7f00f53ff700 1 -- 172.21.15.37:0/3153325281 shutdown_connections 2023-07-14T15:58:15.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:15.171+0000 7f00f53ff700 1 -- 172.21.15.37:0/3153325281 wait complete. 2023-07-14T15:58:15.159 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-14T15:58:15.173 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2023-07-14T15:58:14.884827+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":229448,"kb_used_data":5640,"kb_used_omap":0,"kb_used_meta":223744,"kb_avail":754745272,"statfs":{"total":773094113280,"available":772859158528,"internally_reserved":0,"allocated":5775360,"data_stored":3124508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":229113856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.169888"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.249271+0000","last_change":"2023-07-14T15:58:08.744537+0000","last_active":"2023-07-14T15:58:10.249271+0000","last_peered":"2023-07-14T15:58:10.249271+0000","last_clean":"2023-07-14T15:58:10.249271+0000","last_became_active":"2023-07-14T15:58:08.743330+0000","last_became_peered":"2023-07-14T15:58:08.743330+0000","last_unstale":"2023-07-14T15:58:10.249271+0000","last_undegraded":"2023-07-14T15:58:10.249271+0000","last_fullsized":"2023-07-14T15:58:10.249271+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:49:26.687765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.511225+0000","last_change":"2023-07-14T15:58:08.734285+0000","last_active":"2023-07-14T15:58:10.511225+0000","last_peered":"2023-07-14T15:58:10.511225+0000","last_clean":"2023-07-14T15:58:10.511225+0000","last_became_active":"2023-07-14T15:58:08.734031+0000","last_became_peered":"2023-07-14T15:58:08.734031+0000","last_unstale":"2023-07-14T15:58:10.511225+0000","last_undegraded":"2023-07-14T15:58:10.511225+0000","last_fullsized":"2023-07-14T15:58:10.511225+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:24:06.908513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.721370+0000","last_change":"2023-07-14T15:58:08.735230+0000","last_active":"2023-07-14T15:58:09.721370+0000","last_peered":"2023-07-14T15:58:09.721370+0000","last_clean":"2023-07-14T15:58:09.721370+0000","last_became_active":"2023-07-14T15:58:08.734922+0000","last_became_peered":"2023-07-14T15:58:08.734922+0000","last_unstale":"2023-07-14T15:58:09.721370+0000","last_undegraded":"2023-07-14T15:58:09.721370+0000","last_fullsized":"2023-07-14T15:58:09.721370+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:39:41.597494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167815+0000","last_change":"2023-07-14T15:58:08.736155+0000","last_active":"2023-07-14T15:58:10.167815+0000","last_peered":"2023-07-14T15:58:10.167815+0000","last_clean":"2023-07-14T15:58:10.167815+0000","last_became_active":"2023-07-14T15:58:08.735812+0000","last_became_peered":"2023-07-14T15:58:08.735812+0000","last_unstale":"2023-07-14T15:58:10.167815+0000","last_undegraded":"2023-07-14T15:58:10.167815+0000","last_fullsized":"2023-07-14T15:58:10.167815+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:48:06.896474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.511546+0000","last_change":"2023-07-14T15:58:08.735103+0000","last_active":"2023-07-14T15:58:10.511546+0000","last_peered":"2023-07-14T15:58:10.511546+0000","last_clean":"2023-07-14T15:58:10.511546+0000","last_became_active":"2023-07-14T15:58:08.734805+0000","last_became_peered":"2023-07-14T15:58:08.734805+0000","last_unstale":"2023-07-14T15:58:10.511546+0000","last_undegraded":"2023-07-14T15:58:10.511546+0000","last_fullsized":"2023-07-14T15:58:10.511546+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:38:05.211272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.911301+0000","last_change":"2023-07-14T15:58:08.732408+0000","last_active":"2023-07-14T15:58:09.911301+0000","last_peered":"2023-07-14T15:58:09.911301+0000","last_clean":"2023-07-14T15:58:09.911301+0000","last_became_active":"2023-07-14T15:58:08.732069+0000","last_became_peered":"2023-07-14T15:58:08.732069+0000","last_unstale":"2023-07-14T15:58:09.911301+0000","last_undegraded":"2023-07-14T15:58:09.911301+0000","last_fullsized":"2023-07-14T15:58:09.911301+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:24:42.998893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.719148+0000","last_change":"2023-07-14T15:58:08.739256+0000","last_active":"2023-07-14T15:58:09.719148+0000","last_peered":"2023-07-14T15:58:09.719148+0000","last_clean":"2023-07-14T15:58:09.719148+0000","last_became_active":"2023-07-14T15:58:08.738964+0000","last_became_peered":"2023-07-14T15:58:08.738964+0000","last_unstale":"2023-07-14T15:58:09.719148+0000","last_undegraded":"2023-07-14T15:58:09.719148+0000","last_fullsized":"2023-07-14T15:58:09.719148+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:47:44.057204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.911055+0000","last_change":"2023-07-14T15:58:08.730355+0000","last_active":"2023-07-14T15:58:09.911055+0000","last_peered":"2023-07-14T15:58:09.911055+0000","last_clean":"2023-07-14T15:58:09.911055+0000","last_became_active":"2023-07-14T15:58:08.730089+0000","last_became_peered":"2023-07-14T15:58:08.730089+0000","last_unstale":"2023-07-14T15:58:09.911055+0000","last_undegraded":"2023-07-14T15:58:09.911055+0000","last_fullsized":"2023-07-14T15:58:09.911055+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:47:44.057204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.721545+0000","last_change":"2023-07-14T15:58:08.740471+0000","last_active":"2023-07-14T15:58:09.721545+0000","last_peered":"2023-07-14T15:58:09.721545+0000","last_clean":"2023-07-14T15:58:09.721545+0000","last_became_active":"2023-07-14T15:58:08.740200+0000","last_became_peered":"2023-07-14T15:58:08.740200+0000","last_unstale":"2023-07-14T15:58:09.721545+0000","last_undegraded":"2023-07-14T15:58:09.721545+0000","last_fullsized":"2023-07-14T15:58:09.721545+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:34:32.677159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.719649+0000","last_change":"2023-07-14T15:58:08.733544+0000","last_active":"2023-07-14T15:58:09.719649+0000","last_peered":"2023-07-14T15:58:09.719649+0000","last_clean":"2023-07-14T15:58:09.719649+0000","last_became_active":"2023-07-14T15:58:08.733284+0000","last_became_peered":"2023-07-14T15:58:08.733284+0000","last_unstale":"2023-07-14T15:58:09.719649+0000","last_undegraded":"2023-07-14T15:58:09.719649+0000","last_fullsized":"2023-07-14T15:58:09.719649+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:17:56.741403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.249087+0000","last_change":"2023-07-14T15:58:08.741999+0000","last_active":"2023-07-14T15:58:10.249087+0000","last_peered":"2023-07-14T15:58:10.249087+0000","last_clean":"2023-07-14T15:58:10.249087+0000","last_became_active":"2023-07-14T15:58:08.741574+0000","last_became_peered":"2023-07-14T15:58:08.741574+0000","last_unstale":"2023-07-14T15:58:10.249087+0000","last_undegraded":"2023-07-14T15:58:10.249087+0000","last_fullsized":"2023-07-14T15:58:10.249087+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:32:57.904943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.911190+0000","last_change":"2023-07-14T15:58:08.741197+0000","last_active":"2023-07-14T15:58:09.911190+0000","last_peered":"2023-07-14T15:58:09.911190+0000","last_clean":"2023-07-14T15:58:09.911190+0000","last_became_active":"2023-07-14T15:58:08.740823+0000","last_became_peered":"2023-07-14T15:58:08.740823+0000","last_unstale":"2023-07-14T15:58:09.911190+0000","last_undegraded":"2023-07-14T15:58:09.911190+0000","last_fullsized":"2023-07-14T15:58:09.911190+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:43:09.019373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.911317+0000","last_change":"2023-07-14T15:58:08.738088+0000","last_active":"2023-07-14T15:58:09.911317+0000","last_peered":"2023-07-14T15:58:09.911317+0000","last_clean":"2023-07-14T15:58:09.911317+0000","last_became_active":"2023-07-14T15:58:08.737794+0000","last_became_peered":"2023-07-14T15:58:08.737794+0000","last_unstale":"2023-07-14T15:58:09.911317+0000","last_undegraded":"2023-07-14T15:58:09.911317+0000","last_fullsized":"2023-07-14T15:58:09.911317+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:35:39.872451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.248843+0000","last_change":"2023-07-14T15:58:08.741798+0000","last_active":"2023-07-14T15:58:10.248843+0000","last_peered":"2023-07-14T15:58:10.248843+0000","last_clean":"2023-07-14T15:58:10.248843+0000","last_became_active":"2023-07-14T15:58:08.741528+0000","last_became_peered":"2023-07-14T15:58:08.741528+0000","last_unstale":"2023-07-14T15:58:10.248843+0000","last_undegraded":"2023-07-14T15:58:10.248843+0000","last_fullsized":"2023-07-14T15:58:10.248843+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:01:10.579696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167899+0000","last_change":"2023-07-14T15:58:08.739487+0000","last_active":"2023-07-14T15:58:10.167899+0000","last_peered":"2023-07-14T15:58:10.167899+0000","last_clean":"2023-07-14T15:58:10.167899+0000","last_became_active":"2023-07-14T15:58:08.739163+0000","last_became_peered":"2023-07-14T15:58:08.739163+0000","last_unstale":"2023-07-14T15:58:10.167899+0000","last_undegraded":"2023-07-14T15:58:10.167899+0000","last_fullsized":"2023-07-14T15:58:10.167899+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:50:25.208038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.911180+0000","last_change":"2023-07-14T15:58:08.741815+0000","last_active":"2023-07-14T15:58:09.911180+0000","last_peered":"2023-07-14T15:58:09.911180+0000","last_clean":"2023-07-14T15:58:09.911180+0000","last_became_active":"2023-07-14T15:58:08.741565+0000","last_became_peered":"2023-07-14T15:58:08.741565+0000","last_unstale":"2023-07-14T15:58:09.911180+0000","last_undegraded":"2023-07-14T15:58:09.911180+0000","last_fullsized":"2023-07-14T15:58:09.911180+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:40:30.625900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.249161+0000","last_change":"2023-07-14T15:58:08.744838+0000","last_active":"2023-07-14T15:58:10.249161+0000","last_peered":"2023-07-14T15:58:10.249161+0000","last_clean":"2023-07-14T15:58:10.249161+0000","last_became_active":"2023-07-14T15:58:08.744465+0000","last_became_peered":"2023-07-14T15:58:08.744465+0000","last_unstale":"2023-07-14T15:58:10.249161+0000","last_undegraded":"2023-07-14T15:58:10.249161+0000","last_fullsized":"2023-07-14T15:58:10.249161+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:07:13.860410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167818+0000","last_change":"2023-07-14T15:58:08.734559+0000","last_active":"2023-07-14T15:58:10.167818+0000","last_peered":"2023-07-14T15:58:10.167818+0000","last_clean":"2023-07-14T15:58:10.167818+0000","last_became_active":"2023-07-14T15:58:08.734286+0000","last_became_peered":"2023-07-14T15:58:08.734286+0000","last_unstale":"2023-07-14T15:58:10.167818+0000","last_undegraded":"2023-07-14T15:58:10.167818+0000","last_fullsized":"2023-07-14T15:58:10.167818+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:59:06.223997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.721474+0000","last_change":"2023-07-14T15:58:08.733384+0000","last_active":"2023-07-14T15:58:09.721474+0000","last_peered":"2023-07-14T15:58:09.721474+0000","last_clean":"2023-07-14T15:58:09.721474+0000","last_became_active":"2023-07-14T15:58:08.733096+0000","last_became_peered":"2023-07-14T15:58:08.733096+0000","last_unstale":"2023-07-14T15:58:09.721474+0000","last_undegraded":"2023-07-14T15:58:09.721474+0000","last_fullsized":"2023-07-14T15:58:09.721474+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:02:52.172329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.511733+0000","last_change":"2023-07-14T15:58:08.735489+0000","last_active":"2023-07-14T15:58:10.511733+0000","last_peered":"2023-07-14T15:58:10.511733+0000","last_clean":"2023-07-14T15:58:10.511733+0000","last_became_active":"2023-07-14T15:58:08.735207+0000","last_became_peered":"2023-07-14T15:58:08.735207+0000","last_unstale":"2023-07-14T15:58:10.511733+0000","last_undegraded":"2023-07-14T15:58:10.511733+0000","last_fullsized":"2023-07-14T15:58:10.511733+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:33:31.961842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167688+0000","last_change":"2023-07-14T15:58:08.735232+0000","last_active":"2023-07-14T15:58:10.167688+0000","last_peered":"2023-07-14T15:58:10.167688+0000","last_clean":"2023-07-14T15:58:10.167688+0000","last_became_active":"2023-07-14T15:58:08.734945+0000","last_became_peered":"2023-07-14T15:58:08.734945+0000","last_unstale":"2023-07-14T15:58:10.167688+0000","last_undegraded":"2023-07-14T15:58:10.167688+0000","last_fullsized":"2023-07-14T15:58:10.167688+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:27:25.126730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.721336+0000","last_change":"2023-07-14T15:58:08.738592+0000","last_active":"2023-07-14T15:58:09.721336+0000","last_peered":"2023-07-14T15:58:09.721336+0000","last_clean":"2023-07-14T15:58:09.721336+0000","last_became_active":"2023-07-14T15:58:08.738111+0000","last_became_peered":"2023-07-14T15:58:08.738111+0000","last_unstale":"2023-07-14T15:58:09.721336+0000","last_undegraded":"2023-07-14T15:58:09.721336+0000","last_fullsized":"2023-07-14T15:58:09.721336+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:40:01.920748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.720949+0000","last_change":"2023-07-14T15:58:08.736434+0000","last_active":"2023-07-14T15:58:09.720949+0000","last_peered":"2023-07-14T15:58:09.720949+0000","last_clean":"2023-07-14T15:58:09.720949+0000","last_became_active":"2023-07-14T15:58:08.736176+0000","last_became_peered":"2023-07-14T15:58:08.736176+0000","last_unstale":"2023-07-14T15:58:09.720949+0000","last_undegraded":"2023-07-14T15:58:09.720949+0000","last_fullsized":"2023-07-14T15:58:09.720949+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:48:08.009344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.720891+0000","last_change":"2023-07-14T15:58:08.744189+0000","last_active":"2023-07-14T15:58:09.720891+0000","last_peered":"2023-07-14T15:58:09.720891+0000","last_clean":"2023-07-14T15:58:09.720891+0000","last_became_active":"2023-07-14T15:58:08.743857+0000","last_became_peered":"2023-07-14T15:58:08.743857+0000","last_unstale":"2023-07-14T15:58:09.720891+0000","last_undegraded":"2023-07-14T15:58:09.720891+0000","last_fullsized":"2023-07-14T15:58:09.720891+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:07:05.042003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.249170+0000","last_change":"2023-07-14T15:58:08.735284+0000","last_active":"2023-07-14T15:58:10.249170+0000","last_peered":"2023-07-14T15:58:10.249170+0000","last_clean":"2023-07-14T15:58:10.249170+0000","last_became_active":"2023-07-14T15:58:08.734958+0000","last_became_peered":"2023-07-14T15:58:08.734958+0000","last_unstale":"2023-07-14T15:58:10.249170+0000","last_undegraded":"2023-07-14T15:58:10.249170+0000","last_fullsized":"2023-07-14T15:58:10.249170+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:32:16.092808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.721600+0000","last_change":"2023-07-14T15:58:08.741622+0000","last_active":"2023-07-14T15:58:09.721600+0000","last_peered":"2023-07-14T15:58:09.721600+0000","last_clean":"2023-07-14T15:58:09.721600+0000","last_became_active":"2023-07-14T15:58:08.741248+0000","last_became_peered":"2023-07-14T15:58:08.741248+0000","last_unstale":"2023-07-14T15:58:09.721600+0000","last_undegraded":"2023-07-14T15:58:09.721600+0000","last_fullsized":"2023-07-14T15:58:09.721600+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:20:08.810872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.911339+0000","last_change":"2023-07-14T15:58:08.731586+0000","last_active":"2023-07-14T15:58:09.911339+0000","last_peered":"2023-07-14T15:58:09.911339+0000","last_clean":"2023-07-14T15:58:09.911339+0000","last_became_active":"2023-07-14T15:58:08.731203+0000","last_became_peered":"2023-07-14T15:58:08.731203+0000","last_unstale":"2023-07-14T15:58:09.911339+0000","last_undegraded":"2023-07-14T15:58:09.911339+0000","last_fullsized":"2023-07-14T15:58:09.911339+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:33:43.846392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.511656+0000","last_change":"2023-07-14T15:58:08.736455+0000","last_active":"2023-07-14T15:58:10.511656+0000","last_peered":"2023-07-14T15:58:10.511656+0000","last_clean":"2023-07-14T15:58:10.511656+0000","last_became_active":"2023-07-14T15:58:08.736153+0000","last_became_peered":"2023-07-14T15:58:08.736153+0000","last_unstale":"2023-07-14T15:58:10.511656+0000","last_undegraded":"2023-07-14T15:58:10.511656+0000","last_fullsized":"2023-07-14T15:58:10.511656+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:21:39.877464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.249000+0000","last_change":"2023-07-14T15:58:08.732111+0000","last_active":"2023-07-14T15:58:10.249000+0000","last_peered":"2023-07-14T15:58:10.249000+0000","last_clean":"2023-07-14T15:58:10.249000+0000","last_became_active":"2023-07-14T15:58:08.731797+0000","last_became_peered":"2023-07-14T15:58:08.731797+0000","last_unstale":"2023-07-14T15:58:10.249000+0000","last_undegraded":"2023-07-14T15:58:10.249000+0000","last_fullsized":"2023-07-14T15:58:10.249000+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:16:58.489649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.719643+0000","last_change":"2023-07-14T15:58:08.735559+0000","last_active":"2023-07-14T15:58:09.719643+0000","last_peered":"2023-07-14T15:58:09.719643+0000","last_clean":"2023-07-14T15:58:09.719643+0000","last_became_active":"2023-07-14T15:58:08.735282+0000","last_became_peered":"2023-07-14T15:58:08.735282+0000","last_unstale":"2023-07-14T15:58:09.719643+0000","last_undegraded":"2023-07-14T15:58:09.719643+0000","last_fullsized":"2023-07-14T15:58:09.719643+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:28:18.721489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.721163+0000","last_change":"2023-07-14T15:58:08.739112+0000","last_active":"2023-07-14T15:58:09.721163+0000","last_peered":"2023-07-14T15:58:09.721163+0000","last_clean":"2023-07-14T15:58:09.721163+0000","last_became_active":"2023-07-14T15:58:08.738821+0000","last_became_peered":"2023-07-14T15:58:08.738821+0000","last_unstale":"2023-07-14T15:58:09.721163+0000","last_undegraded":"2023-07-14T15:58:09.721163+0000","last_fullsized":"2023-07-14T15:58:09.721163+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:43:34.680274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.510890+0000","last_change":"2023-07-14T15:58:08.729316+0000","last_active":"2023-07-14T15:58:10.510890+0000","last_peered":"2023-07-14T15:58:10.510890+0000","last_clean":"2023-07-14T15:58:10.510890+0000","last_became_active":"2023-07-14T15:58:08.729047+0000","last_became_peered":"2023-07-14T15:58:08.729047+0000","last_unstale":"2023-07-14T15:58:10.510890+0000","last_undegraded":"2023-07-14T15:58:10.510890+0000","last_fullsized":"2023-07-14T15:58:10.510890+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:50:26.301699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.719576+0000","last_change":"2023-07-14T15:58:08.736368+0000","last_active":"2023-07-14T15:58:09.719576+0000","last_peered":"2023-07-14T15:58:09.719576+0000","last_clean":"2023-07-14T15:58:09.719576+0000","last_became_active":"2023-07-14T15:58:08.736096+0000","last_became_peered":"2023-07-14T15:58:08.736096+0000","last_unstale":"2023-07-14T15:58:09.719576+0000","last_undegraded":"2023-07-14T15:58:09.719576+0000","last_fullsized":"2023-07-14T15:58:09.719576+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:47:02.564963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"48'4","reported_seq":17,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.511388+0000","last_change":"2023-07-14T15:58:07.732535+0000","last_active":"2023-07-14T15:58:10.511388+0000","last_peered":"2023-07-14T15:58:10.511388+0000","last_clean":"2023-07-14T15:58:10.511388+0000","last_became_active":"2023-07-14T15:58:07.732169+0000","last_became_peered":"2023-07-14T15:58:07.732169+0000","last_unstale":"2023-07-14T15:58:10.511388+0000","last_undegraded":"2023-07-14T15:58:10.511388+0000","last_fullsized":"2023-07-14T15:58:10.511388+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:33:30.958848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.719614+0000","last_change":"2023-07-14T15:58:08.740360+0000","last_active":"2023-07-14T15:58:09.719614+0000","last_peered":"2023-07-14T15:58:09.719614+0000","last_clean":"2023-07-14T15:58:09.719614+0000","last_became_active":"2023-07-14T15:58:08.739889+0000","last_became_peered":"2023-07-14T15:58:08.739889+0000","last_unstale":"2023-07-14T15:58:09.719614+0000","last_undegraded":"2023-07-14T15:58:09.719614+0000","last_fullsized":"2023-07-14T15:58:09.719614+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:14:22.034369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"48'1","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.911463+0000","last_change":"2023-07-14T15:58:07.736542+0000","last_active":"2023-07-14T15:58:09.911463+0000","last_peered":"2023-07-14T15:58:09.911463+0000","last_clean":"2023-07-14T15:58:09.911463+0000","last_became_active":"2023-07-14T15:58:07.736266+0000","last_became_peered":"2023-07-14T15:58:07.736266+0000","last_unstale":"2023-07-14T15:58:09.911463+0000","last_undegraded":"2023-07-14T15:58:09.911463+0000","last_fullsized":"2023-07-14T15:58:09.911463+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:58:25.104060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.719824+0000","last_change":"2023-07-14T15:58:08.733891+0000","last_active":"2023-07-14T15:58:09.719824+0000","last_peered":"2023-07-14T15:58:09.719824+0000","last_clean":"2023-07-14T15:58:09.719824+0000","last_became_active":"2023-07-14T15:58:08.733554+0000","last_became_peered":"2023-07-14T15:58:08.733554+0000","last_unstale":"2023-07-14T15:58:09.719824+0000","last_undegraded":"2023-07-14T15:58:09.719824+0000","last_fullsized":"2023-07-14T15:58:09.719824+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:48:42.366546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"48'2","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.719658+0000","last_change":"2023-07-14T15:58:07.732950+0000","last_active":"2023-07-14T15:58:09.719658+0000","last_peered":"2023-07-14T15:58:09.719658+0000","last_clean":"2023-07-14T15:58:09.719658+0000","last_became_active":"2023-07-14T15:58:07.732689+0000","last_became_peered":"2023-07-14T15:58:07.732689+0000","last_unstale":"2023-07-14T15:58:09.719658+0000","last_undegraded":"2023-07-14T15:58:09.719658+0000","last_fullsized":"2023-07-14T15:58:09.719658+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:58:25.104060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.719188+0000","last_change":"2023-07-14T15:58:08.735976+0000","last_active":"2023-07-14T15:58:09.719188+0000","last_peered":"2023-07-14T15:58:09.719188+0000","last_clean":"2023-07-14T15:58:09.719188+0000","last_became_active":"2023-07-14T15:58:08.735488+0000","last_became_peered":"2023-07-14T15:58:08.735488+0000","last_unstale":"2023-07-14T15:58:09.719188+0000","last_undegraded":"2023-07-14T15:58:09.719188+0000","last_fullsized":"2023-07-14T15:58:09.719188+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:38:58.679622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"48'2","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.511571+0000","last_change":"2023-07-14T15:58:07.730127+0000","last_active":"2023-07-14T15:58:10.511571+0000","last_peered":"2023-07-14T15:58:10.511571+0000","last_clean":"2023-07-14T15:58:10.511571+0000","last_became_active":"2023-07-14T15:58:07.729851+0000","last_became_peered":"2023-07-14T15:58:07.729851+0000","last_unstale":"2023-07-14T15:58:10.511571+0000","last_undegraded":"2023-07-14T15:58:10.511571+0000","last_fullsized":"2023-07-14T15:58:10.511571+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:18:22.332457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.510952+0000","last_change":"2023-07-14T15:58:08.738154+0000","last_active":"2023-07-14T15:58:10.510952+0000","last_peered":"2023-07-14T15:58:10.510952+0000","last_clean":"2023-07-14T15:58:10.510952+0000","last_became_active":"2023-07-14T15:58:08.737703+0000","last_became_peered":"2023-07-14T15:58:08.737703+0000","last_unstale":"2023-07-14T15:58:10.510952+0000","last_undegraded":"2023-07-14T15:58:10.510952+0000","last_fullsized":"2023-07-14T15:58:10.510952+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:21:39.877464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"48'1","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.721784+0000","last_change":"2023-07-14T15:58:07.734870+0000","last_active":"2023-07-14T15:58:09.721784+0000","last_peered":"2023-07-14T15:58:09.721784+0000","last_clean":"2023-07-14T15:58:09.721784+0000","last_became_active":"2023-07-14T15:58:07.734521+0000","last_became_peered":"2023-07-14T15:58:07.734521+0000","last_unstale":"2023-07-14T15:58:09.721784+0000","last_undegraded":"2023-07-14T15:58:09.721784+0000","last_fullsized":"2023-07-14T15:58:09.721784+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:53:32.760685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.720086+0000","last_change":"2023-07-14T15:58:08.736978+0000","last_active":"2023-07-14T15:58:09.720086+0000","last_peered":"2023-07-14T15:58:09.720086+0000","last_clean":"2023-07-14T15:58:09.720086+0000","last_became_active":"2023-07-14T15:58:08.736679+0000","last_became_peered":"2023-07-14T15:58:08.736679+0000","last_unstale":"2023-07-14T15:58:09.720086+0000","last_undegraded":"2023-07-14T15:58:09.720086+0000","last_fullsized":"2023-07-14T15:58:09.720086+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:00:53.470860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"48'1","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.719823+0000","last_change":"2023-07-14T15:58:07.730993+0000","last_active":"2023-07-14T15:58:09.719823+0000","last_peered":"2023-07-14T15:58:09.719823+0000","last_clean":"2023-07-14T15:58:09.719823+0000","last_became_active":"2023-07-14T15:58:07.730720+0000","last_became_peered":"2023-07-14T15:58:07.730720+0000","last_unstale":"2023-07-14T15:58:09.719823+0000","last_undegraded":"2023-07-14T15:58:09.719823+0000","last_fullsized":"2023-07-14T15:58:09.719823+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:59:05.167230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.719443+0000","last_change":"2023-07-14T15:58:08.739925+0000","last_active":"2023-07-14T15:58:09.719443+0000","last_peered":"2023-07-14T15:58:09.719443+0000","last_clean":"2023-07-14T15:58:09.719443+0000","last_became_active":"2023-07-14T15:58:08.737667+0000","last_became_peered":"2023-07-14T15:58:08.737667+0000","last_unstale":"2023-07-14T15:58:09.719443+0000","last_undegraded":"2023-07-14T15:58:09.719443+0000","last_fullsized":"2023-07-14T15:58:09.719443+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:35:39.872451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.719622+0000","last_change":"2023-07-14T15:58:07.731842+0000","last_active":"2023-07-14T15:58:09.719622+0000","last_peered":"2023-07-14T15:58:09.719622+0000","last_clean":"2023-07-14T15:58:09.719622+0000","last_became_active":"2023-07-14T15:58:07.731549+0000","last_became_peered":"2023-07-14T15:58:07.731549+0000","last_unstale":"2023-07-14T15:58:09.719622+0000","last_undegraded":"2023-07-14T15:58:09.719622+0000","last_fullsized":"2023-07-14T15:58:09.719622+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:14:46.719426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.168035+0000","last_change":"2023-07-14T15:58:08.743009+0000","last_active":"2023-07-14T15:58:10.168035+0000","last_peered":"2023-07-14T15:58:10.168035+0000","last_clean":"2023-07-14T15:58:10.168035+0000","last_became_active":"2023-07-14T15:58:08.742750+0000","last_became_peered":"2023-07-14T15:58:08.742750+0000","last_unstale":"2023-07-14T15:58:10.168035+0000","last_undegraded":"2023-07-14T15:58:10.168035+0000","last_fullsized":"2023-07-14T15:58:10.168035+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:11:50.083029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.720955+0000","last_change":"2023-07-14T15:58:07.728189+0000","last_active":"2023-07-14T15:58:09.720955+0000","last_peered":"2023-07-14T15:58:09.720955+0000","last_clean":"2023-07-14T15:58:09.720955+0000","last_became_active":"2023-07-14T15:58:07.727897+0000","last_became_peered":"2023-07-14T15:58:07.727897+0000","last_unstale":"2023-07-14T15:58:09.720955+0000","last_undegraded":"2023-07-14T15:58:09.720955+0000","last_fullsized":"2023-07-14T15:58:09.720955+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:13:56.583860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.510577+0000","last_change":"2023-07-14T15:58:08.731665+0000","last_active":"2023-07-14T15:58:10.510577+0000","last_peered":"2023-07-14T15:58:10.510577+0000","last_clean":"2023-07-14T15:58:10.510577+0000","last_became_active":"2023-07-14T15:58:08.731371+0000","last_became_peered":"2023-07-14T15:58:08.731371+0000","last_unstale":"2023-07-14T15:58:10.510577+0000","last_undegraded":"2023-07-14T15:58:10.510577+0000","last_fullsized":"2023-07-14T15:58:10.510577+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:38:05.211272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.168035+0000","last_change":"2023-07-14T15:58:07.728755+0000","last_active":"2023-07-14T15:58:10.168035+0000","last_peered":"2023-07-14T15:58:10.168035+0000","last_clean":"2023-07-14T15:58:10.168035+0000","last_became_active":"2023-07-14T15:58:07.728401+0000","last_became_peered":"2023-07-14T15:58:07.728401+0000","last_unstale":"2023-07-14T15:58:10.168035+0000","last_undegraded":"2023-07-14T15:58:10.168035+0000","last_fullsized":"2023-07-14T15:58:10.168035+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:52:41.611985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167935+0000","last_change":"2023-07-14T15:58:08.737207+0000","last_active":"2023-07-14T15:58:10.167935+0000","last_peered":"2023-07-14T15:58:10.167935+0000","last_clean":"2023-07-14T15:58:10.167935+0000","last_became_active":"2023-07-14T15:58:08.736904+0000","last_became_peered":"2023-07-14T15:58:08.736904+0000","last_unstale":"2023-07-14T15:58:10.167935+0000","last_undegraded":"2023-07-14T15:58:10.167935+0000","last_fullsized":"2023-07-14T15:58:10.167935+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:11:51.639080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167883+0000","last_change":"2023-07-14T15:58:07.733957+0000","last_active":"2023-07-14T15:58:10.167883+0000","last_peered":"2023-07-14T15:58:10.167883+0000","last_clean":"2023-07-14T15:58:10.167883+0000","last_became_active":"2023-07-14T15:58:07.733635+0000","last_became_peered":"2023-07-14T15:58:07.733635+0000","last_unstale":"2023-07-14T15:58:10.167883+0000","last_undegraded":"2023-07-14T15:58:10.167883+0000","last_fullsized":"2023-07-14T15:58:10.167883+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:26:47.764384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.248658+0000","last_change":"2023-07-14T15:58:08.743461+0000","last_active":"2023-07-14T15:58:10.248658+0000","last_peered":"2023-07-14T15:58:10.248658+0000","last_clean":"2023-07-14T15:58:10.248658+0000","last_became_active":"2023-07-14T15:58:08.743075+0000","last_became_peered":"2023-07-14T15:58:08.743075+0000","last_unstale":"2023-07-14T15:58:10.248658+0000","last_undegraded":"2023-07-14T15:58:10.248658+0000","last_fullsized":"2023-07-14T15:58:10.248658+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:37:43.533403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.15","version":"48'3","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.720179+0000","last_change":"2023-07-14T15:58:07.736023+0000","last_active":"2023-07-14T15:58:09.720179+0000","last_peered":"2023-07-14T15:58:09.720179+0000","last_clean":"2023-07-14T15:58:09.720179+0000","last_became_active":"2023-07-14T15:58:07.735713+0000","last_became_peered":"2023-07-14T15:58:07.735713+0000","last_unstale":"2023-07-14T15:58:09.720179+0000","last_undegraded":"2023-07-14T15:58:09.720179+0000","last_fullsized":"2023-07-14T15:58:09.720179+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:30:31.650310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.511358+0000","last_change":"2023-07-14T15:58:08.732253+0000","last_active":"2023-07-14T15:58:10.511358+0000","last_peered":"2023-07-14T15:58:10.511358+0000","last_clean":"2023-07-14T15:58:10.511358+0000","last_became_active":"2023-07-14T15:58:08.731924+0000","last_became_peered":"2023-07-14T15:58:08.731924+0000","last_unstale":"2023-07-14T15:58:10.511358+0000","last_undegraded":"2023-07-14T15:58:10.511358+0000","last_fullsized":"2023-07-14T15:58:10.511358+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:57:49.081908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"48'6","reported_seq":19,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.719815+0000","last_change":"2023-07-14T15:58:07.742068+0000","last_active":"2023-07-14T15:58:09.719815+0000","last_peered":"2023-07-14T15:58:09.719815+0000","last_clean":"2023-07-14T15:58:09.719815+0000","last_became_active":"2023-07-14T15:58:07.741718+0000","last_became_peered":"2023-07-14T15:58:07.741718+0000","last_unstale":"2023-07-14T15:58:09.719815+0000","last_undegraded":"2023-07-14T15:58:09.719815+0000","last_fullsized":"2023-07-14T15:58:09.719815+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:52:53.832447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.720010+0000","last_change":"2023-07-14T15:58:08.736941+0000","last_active":"2023-07-14T15:58:09.720010+0000","last_peered":"2023-07-14T15:58:09.720010+0000","last_clean":"2023-07-14T15:58:09.720010+0000","last_became_active":"2023-07-14T15:58:08.736565+0000","last_became_peered":"2023-07-14T15:58:08.736565+0000","last_unstale":"2023-07-14T15:58:09.720010+0000","last_undegraded":"2023-07-14T15:58:09.720010+0000","last_fullsized":"2023-07-14T15:58:09.720010+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:40:23.111433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"48'2","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.911521+0000","last_change":"2023-07-14T15:58:07.735958+0000","last_active":"2023-07-14T15:58:09.911521+0000","last_peered":"2023-07-14T15:58:09.911521+0000","last_clean":"2023-07-14T15:58:09.911521+0000","last_became_active":"2023-07-14T15:58:07.735649+0000","last_became_peered":"2023-07-14T15:58:07.735649+0000","last_unstale":"2023-07-14T15:58:09.911521+0000","last_undegraded":"2023-07-14T15:58:09.911521+0000","last_fullsized":"2023-07-14T15:58:09.911521+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:17:59.455151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.249076+0000","last_change":"2023-07-14T15:58:08.741837+0000","last_active":"2023-07-14T15:58:10.249076+0000","last_peered":"2023-07-14T15:58:10.249076+0000","last_clean":"2023-07-14T15:58:10.249076+0000","last_became_active":"2023-07-14T15:58:08.741224+0000","last_became_peered":"2023-07-14T15:58:08.741224+0000","last_unstale":"2023-07-14T15:58:10.249076+0000","last_undegraded":"2023-07-14T15:58:10.249076+0000","last_fullsized":"2023-07-14T15:58:10.249076+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:18:49.473467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167804+0000","last_change":"2023-07-14T15:58:07.734306+0000","last_active":"2023-07-14T15:58:10.167804+0000","last_peered":"2023-07-14T15:58:10.167804+0000","last_clean":"2023-07-14T15:58:10.167804+0000","last_became_active":"2023-07-14T15:58:07.733956+0000","last_became_peered":"2023-07-14T15:58:07.733956+0000","last_unstale":"2023-07-14T15:58:10.167804+0000","last_undegraded":"2023-07-14T15:58:10.167804+0000","last_fullsized":"2023-07-14T15:58:10.167804+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:32:13.169004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.911245+0000","last_change":"2023-07-14T15:58:08.731841+0000","last_active":"2023-07-14T15:58:09.911245+0000","last_peered":"2023-07-14T15:58:09.911245+0000","last_clean":"2023-07-14T15:58:09.911245+0000","last_became_active":"2023-07-14T15:58:08.731513+0000","last_became_peered":"2023-07-14T15:58:08.731513+0000","last_unstale":"2023-07-14T15:58:09.911245+0000","last_undegraded":"2023-07-14T15:58:09.911245+0000","last_fullsized":"2023-07-14T15:58:09.911245+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:38:58.679622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.511198+0000","last_change":"2023-07-14T15:58:07.728853+0000","last_active":"2023-07-14T15:58:10.511198+0000","last_peered":"2023-07-14T15:58:10.511198+0000","last_clean":"2023-07-14T15:58:10.511198+0000","last_became_active":"2023-07-14T15:58:07.728594+0000","last_became_peered":"2023-07-14T15:58:07.728594+0000","last_unstale":"2023-07-14T15:58:10.511198+0000","last_undegraded":"2023-07-14T15:58:10.511198+0000","last_fullsized":"2023-07-14T15:58:10.511198+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:34:18.438758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.721769+0000","last_change":"2023-07-14T15:58:08.739622+0000","last_active":"2023-07-14T15:58:09.721769+0000","last_peered":"2023-07-14T15:58:09.721769+0000","last_clean":"2023-07-14T15:58:09.721769+0000","last_became_active":"2023-07-14T15:58:08.739352+0000","last_became_peered":"2023-07-14T15:58:08.739352+0000","last_unstale":"2023-07-14T15:58:09.721769+0000","last_undegraded":"2023-07-14T15:58:09.721769+0000","last_fullsized":"2023-07-14T15:58:09.721769+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:15:25.859416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"48'8","reported_seq":21,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.911341+0000","last_change":"2023-07-14T15:58:07.734654+0000","last_active":"2023-07-14T15:58:09.911341+0000","last_peered":"2023-07-14T15:58:09.911341+0000","last_clean":"2023-07-14T15:58:09.911341+0000","last_became_active":"2023-07-14T15:58:07.734360+0000","last_became_peered":"2023-07-14T15:58:07.734360+0000","last_unstale":"2023-07-14T15:58:09.911341+0000","last_undegraded":"2023-07-14T15:58:09.911341+0000","last_fullsized":"2023-07-14T15:58:09.911341+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:29:48.437581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.719544+0000","last_change":"2023-07-14T15:58:08.736111+0000","last_active":"2023-07-14T15:58:09.719544+0000","last_peered":"2023-07-14T15:58:09.719544+0000","last_clean":"2023-07-14T15:58:09.719544+0000","last_became_active":"2023-07-14T15:58:08.735822+0000","last_became_peered":"2023-07-14T15:58:08.735822+0000","last_unstale":"2023-07-14T15:58:09.719544+0000","last_undegraded":"2023-07-14T15:58:09.719544+0000","last_fullsized":"2023-07-14T15:58:09.719544+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:29:49.440576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"48'1","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.911730+0000","last_change":"2023-07-14T15:58:07.736644+0000","last_active":"2023-07-14T15:58:09.911730+0000","last_peered":"2023-07-14T15:58:09.911730+0000","last_clean":"2023-07-14T15:58:09.911730+0000","last_became_active":"2023-07-14T15:58:07.736358+0000","last_became_peered":"2023-07-14T15:58:07.736358+0000","last_unstale":"2023-07-14T15:58:09.911730+0000","last_undegraded":"2023-07-14T15:58:09.911730+0000","last_fullsized":"2023-07-14T15:58:09.911730+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:11:08.963759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.248655+0000","last_change":"2023-07-14T15:58:08.735289+0000","last_active":"2023-07-14T15:58:10.248655+0000","last_peered":"2023-07-14T15:58:10.248655+0000","last_clean":"2023-07-14T15:58:10.248655+0000","last_became_active":"2023-07-14T15:58:08.734993+0000","last_became_peered":"2023-07-14T15:58:08.734993+0000","last_unstale":"2023-07-14T15:58:10.248655+0000","last_undegraded":"2023-07-14T15:58:10.248655+0000","last_fullsized":"2023-07-14T15:58:10.248655+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:26:31.914734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"48'2","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.911510+0000","last_change":"2023-07-14T15:58:07.734503+0000","last_active":"2023-07-14T15:58:09.911510+0000","last_peered":"2023-07-14T15:58:09.911510+0000","last_clean":"2023-07-14T15:58:09.911510+0000","last_became_active":"2023-07-14T15:58:07.734137+0000","last_became_peered":"2023-07-14T15:58:07.734137+0000","last_unstale":"2023-07-14T15:58:09.911510+0000","last_undegraded":"2023-07-14T15:58:09.911510+0000","last_fullsized":"2023-07-14T15:58:09.911510+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:01:42.004665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.511233+0000","last_change":"2023-07-14T15:58:08.723001+0000","last_active":"2023-07-14T15:58:10.511233+0000","last_peered":"2023-07-14T15:58:10.511233+0000","last_clean":"2023-07-14T15:58:10.511233+0000","last_became_active":"2023-07-14T15:58:08.722673+0000","last_became_peered":"2023-07-14T15:58:08.722673+0000","last_unstale":"2023-07-14T15:58:10.511233+0000","last_undegraded":"2023-07-14T15:58:10.511233+0000","last_fullsized":"2023-07-14T15:58:10.511233+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:20:11.481399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"48'1","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167821+0000","last_change":"2023-07-14T15:58:07.725878+0000","last_active":"2023-07-14T15:58:10.167821+0000","last_peered":"2023-07-14T15:58:10.167821+0000","last_clean":"2023-07-14T15:58:10.167821+0000","last_became_active":"2023-07-14T15:58:07.725549+0000","last_became_peered":"2023-07-14T15:58:07.725549+0000","last_unstale":"2023-07-14T15:58:10.167821+0000","last_undegraded":"2023-07-14T15:58:10.167821+0000","last_fullsized":"2023-07-14T15:58:10.167821+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:22:14.282584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.911416+0000","last_change":"2023-07-14T15:58:08.731902+0000","last_active":"2023-07-14T15:58:09.911416+0000","last_peered":"2023-07-14T15:58:09.911416+0000","last_clean":"2023-07-14T15:58:09.911416+0000","last_became_active":"2023-07-14T15:58:08.731573+0000","last_became_peered":"2023-07-14T15:58:08.731573+0000","last_unstale":"2023-07-14T15:58:09.911416+0000","last_undegraded":"2023-07-14T15:58:09.911416+0000","last_fullsized":"2023-07-14T15:58:09.911416+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:17:56.741403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.511808+0000","last_change":"2023-07-14T15:58:07.736136+0000","last_active":"2023-07-14T15:58:10.511808+0000","last_peered":"2023-07-14T15:58:10.511808+0000","last_clean":"2023-07-14T15:58:10.511808+0000","last_became_active":"2023-07-14T15:58:07.735841+0000","last_became_peered":"2023-07-14T15:58:07.735841+0000","last_unstale":"2023-07-14T15:58:10.511808+0000","last_undegraded":"2023-07-14T15:58:10.511808+0000","last_fullsized":"2023-07-14T15:58:10.511808+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:36:18.704813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.511490+0000","last_change":"2023-07-14T15:58:08.735840+0000","last_active":"2023-07-14T15:58:10.511490+0000","last_peered":"2023-07-14T15:58:10.511490+0000","last_clean":"2023-07-14T15:58:10.511490+0000","last_became_active":"2023-07-14T15:58:08.735526+0000","last_became_peered":"2023-07-14T15:58:08.735526+0000","last_unstale":"2023-07-14T15:58:10.511490+0000","last_undegraded":"2023-07-14T15:58:10.511490+0000","last_fullsized":"2023-07-14T15:58:10.511490+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:28:18.956176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"48'2","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.248871+0000","last_change":"2023-07-14T15:58:07.731047+0000","last_active":"2023-07-14T15:58:10.248871+0000","last_peered":"2023-07-14T15:58:10.248871+0000","last_clean":"2023-07-14T15:58:10.248871+0000","last_became_active":"2023-07-14T15:58:07.730760+0000","last_became_peered":"2023-07-14T15:58:07.730760+0000","last_unstale":"2023-07-14T15:58:10.248871+0000","last_undegraded":"2023-07-14T15:58:10.248871+0000","last_fullsized":"2023-07-14T15:58:10.248871+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:54:17.765585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167946+0000","last_change":"2023-07-14T15:58:08.738893+0000","last_active":"2023-07-14T15:58:10.167946+0000","last_peered":"2023-07-14T15:58:10.167946+0000","last_clean":"2023-07-14T15:58:10.167946+0000","last_became_active":"2023-07-14T15:58:08.738584+0000","last_became_peered":"2023-07-14T15:58:08.738584+0000","last_unstale":"2023-07-14T15:58:10.167946+0000","last_undegraded":"2023-07-14T15:58:10.167946+0000","last_fullsized":"2023-07-14T15:58:10.167946+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:32:48.130235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.721306+0000","last_change":"2023-07-14T15:58:07.732320+0000","last_active":"2023-07-14T15:58:09.721306+0000","last_peered":"2023-07-14T15:58:09.721306+0000","last_clean":"2023-07-14T15:58:09.721306+0000","last_became_active":"2023-07-14T15:58:07.732044+0000","last_became_peered":"2023-07-14T15:58:07.732044+0000","last_unstale":"2023-07-14T15:58:09.721306+0000","last_undegraded":"2023-07-14T15:58:09.721306+0000","last_fullsized":"2023-07-14T15:58:09.721306+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:00:30.483880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.248814+0000","last_change":"2023-07-14T15:58:08.743134+0000","last_active":"2023-07-14T15:58:10.248814+0000","last_peered":"2023-07-14T15:58:10.248814+0000","last_clean":"2023-07-14T15:58:10.248814+0000","last_became_active":"2023-07-14T15:58:08.742797+0000","last_became_peered":"2023-07-14T15:58:08.742797+0000","last_unstale":"2023-07-14T15:58:10.248814+0000","last_undegraded":"2023-07-14T15:58:10.248814+0000","last_fullsized":"2023-07-14T15:58:10.248814+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:08:36.025877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.719224+0000","last_change":"2023-07-14T15:58:07.733527+0000","last_active":"2023-07-14T15:58:09.719224+0000","last_peered":"2023-07-14T15:58:09.719224+0000","last_clean":"2023-07-14T15:58:09.719224+0000","last_became_active":"2023-07-14T15:58:07.733219+0000","last_became_peered":"2023-07-14T15:58:07.733219+0000","last_unstale":"2023-07-14T15:58:09.719224+0000","last_undegraded":"2023-07-14T15:58:09.719224+0000","last_fullsized":"2023-07-14T15:58:09.719224+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:43:08.016378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.911708+0000","last_change":"2023-07-14T15:58:08.729550+0000","last_active":"2023-07-14T15:58:09.911708+0000","last_peered":"2023-07-14T15:58:09.911708+0000","last_clean":"2023-07-14T15:58:09.911708+0000","last_became_active":"2023-07-14T15:58:08.729192+0000","last_became_peered":"2023-07-14T15:58:08.729192+0000","last_unstale":"2023-07-14T15:58:09.911708+0000","last_undegraded":"2023-07-14T15:58:09.911708+0000","last_fullsized":"2023-07-14T15:58:09.911708+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:34:44.918977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.719153+0000","last_change":"2023-07-14T15:58:07.731843+0000","last_active":"2023-07-14T15:58:09.719153+0000","last_peered":"2023-07-14T15:58:09.719153+0000","last_clean":"2023-07-14T15:58:09.719153+0000","last_became_active":"2023-07-14T15:58:07.731548+0000","last_became_peered":"2023-07-14T15:58:07.731548+0000","last_unstale":"2023-07-14T15:58:09.719153+0000","last_undegraded":"2023-07-14T15:58:09.719153+0000","last_fullsized":"2023-07-14T15:58:09.719153+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:40:29.622905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.719657+0000","last_change":"2023-07-14T15:58:08.737720+0000","last_active":"2023-07-14T15:58:09.719657+0000","last_peered":"2023-07-14T15:58:09.719657+0000","last_clean":"2023-07-14T15:58:09.719657+0000","last_became_active":"2023-07-14T15:58:08.737165+0000","last_became_peered":"2023-07-14T15:58:08.737165+0000","last_unstale":"2023-07-14T15:58:09.719657+0000","last_undegraded":"2023-07-14T15:58:09.719657+0000","last_fullsized":"2023-07-14T15:58:09.719657+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:18:00.458145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.511325+0000","last_change":"2023-07-14T15:58:07.728047+0000","last_active":"2023-07-14T15:58:10.511325+0000","last_peered":"2023-07-14T15:58:10.511325+0000","last_clean":"2023-07-14T15:58:10.511325+0000","last_became_active":"2023-07-14T15:58:07.727789+0000","last_became_peered":"2023-07-14T15:58:07.727789+0000","last_unstale":"2023-07-14T15:58:10.511325+0000","last_undegraded":"2023-07-14T15:58:10.511325+0000","last_fullsized":"2023-07-14T15:58:10.511325+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:04:44.440538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.719873+0000","last_change":"2023-07-14T15:56:02.621850+0000","last_active":"2023-07-14T15:58:09.719873+0000","last_peered":"2023-07-14T15:58:09.719873+0000","last_clean":"2023-07-14T15:58:09.719873+0000","last_became_active":"2023-07-14T15:56:02.621471+0000","last_became_peered":"2023-07-14T15:56:02.621471+0000","last_unstale":"2023-07-14T15:58:09.719873+0000","last_undegraded":"2023-07-14T15:58:09.719873+0000","last_fullsized":"2023-07-14T15:58:09.719873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:09:03.169593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167727+0000","last_change":"2023-07-14T15:58:08.735834+0000","last_active":"2023-07-14T15:58:10.167727+0000","last_peered":"2023-07-14T15:58:10.167727+0000","last_clean":"2023-07-14T15:58:10.167727+0000","last_became_active":"2023-07-14T15:58:08.735483+0000","last_became_peered":"2023-07-14T15:58:08.735483+0000","last_unstale":"2023-07-14T15:58:10.167727+0000","last_undegraded":"2023-07-14T15:58:10.167727+0000","last_fullsized":"2023-07-14T15:58:10.167727+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:24:16.022757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"48'2","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.720016+0000","last_change":"2023-07-14T15:58:07.732308+0000","last_active":"2023-07-14T15:58:09.720016+0000","last_peered":"2023-07-14T15:58:09.720016+0000","last_clean":"2023-07-14T15:58:09.720016+0000","last_became_active":"2023-07-14T15:58:07.732001+0000","last_became_peered":"2023-07-14T15:58:07.732001+0000","last_unstale":"2023-07-14T15:58:09.720016+0000","last_undegraded":"2023-07-14T15:58:09.720016+0000","last_fullsized":"2023-07-14T15:58:09.720016+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:00:20.751111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":68,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.719963+0000","last_change":"2023-07-14T15:56:02.621963+0000","last_active":"2023-07-14T15:58:09.719963+0000","last_peered":"2023-07-14T15:58:09.719963+0000","last_clean":"2023-07-14T15:58:09.719963+0000","last_became_active":"2023-07-14T15:56:02.621678+0000","last_became_peered":"2023-07-14T15:56:02.621678+0000","last_unstale":"2023-07-14T15:58:09.719963+0000","last_undegraded":"2023-07-14T15:58:09.719963+0000","last_fullsized":"2023-07-14T15:58:09.719963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:05:12.975493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.721712+0000","last_change":"2023-07-14T15:58:08.732988+0000","last_active":"2023-07-14T15:58:09.721712+0000","last_peered":"2023-07-14T15:58:09.721712+0000","last_clean":"2023-07-14T15:58:09.721712+0000","last_became_active":"2023-07-14T15:58:08.732713+0000","last_became_peered":"2023-07-14T15:58:08.732713+0000","last_unstale":"2023-07-14T15:58:09.721712+0000","last_undegraded":"2023-07-14T15:58:09.721712+0000","last_fullsized":"2023-07-14T15:58:09.721712+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:50:49.909750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.721620+0000","last_change":"2023-07-14T15:58:07.729039+0000","last_active":"2023-07-14T15:58:09.721620+0000","last_peered":"2023-07-14T15:58:09.721620+0000","last_clean":"2023-07-14T15:58:09.721620+0000","last_became_active":"2023-07-14T15:58:07.728779+0000","last_became_peered":"2023-07-14T15:58:07.728779+0000","last_unstale":"2023-07-14T15:58:09.721620+0000","last_undegraded":"2023-07-14T15:58:09.721620+0000","last_fullsized":"2023-07-14T15:58:09.721620+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:09:40.024162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":60,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.911043+0000","last_change":"2023-07-14T15:56:01.925110+0000","last_active":"2023-07-14T15:58:09.911043+0000","last_peered":"2023-07-14T15:58:09.911043+0000","last_clean":"2023-07-14T15:58:09.911043+0000","last_became_active":"2023-07-14T15:56:01.924723+0000","last_became_peered":"2023-07-14T15:56:01.924723+0000","last_unstale":"2023-07-14T15:58:09.911043+0000","last_undegraded":"2023-07-14T15:58:09.911043+0000","last_fullsized":"2023-07-14T15:58:09.911043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:50:35.501921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.510688+0000","last_change":"2023-07-14T15:58:08.730413+0000","last_active":"2023-07-14T15:58:10.510688+0000","last_peered":"2023-07-14T15:58:10.510688+0000","last_clean":"2023-07-14T15:58:10.510688+0000","last_became_active":"2023-07-14T15:58:08.730120+0000","last_became_peered":"2023-07-14T15:58:08.730120+0000","last_unstale":"2023-07-14T15:58:10.510688+0000","last_undegraded":"2023-07-14T15:58:10.510688+0000","last_fullsized":"2023-07-14T15:58:10.510688+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:18:23.335452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"49'1","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.719869+0000","last_change":"2023-07-14T15:58:07.734443+0000","last_active":"2023-07-14T15:58:09.719869+0000","last_peered":"2023-07-14T15:58:09.719869+0000","last_clean":"2023-07-14T15:58:09.719869+0000","last_became_active":"2023-07-14T15:58:07.734185+0000","last_became_peered":"2023-07-14T15:58:07.734185+0000","last_unstale":"2023-07-14T15:58:09.719869+0000","last_undegraded":"2023-07-14T15:58:09.719869+0000","last_fullsized":"2023-07-14T15:58:09.719869+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:34:43.915982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":68,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.719936+0000","last_change":"2023-07-14T15:56:01.923465+0000","last_active":"2023-07-14T15:58:09.719936+0000","last_peered":"2023-07-14T15:58:09.719936+0000","last_clean":"2023-07-14T15:58:09.719936+0000","last_became_active":"2023-07-14T15:56:01.923160+0000","last_became_peered":"2023-07-14T15:56:01.923160+0000","last_unstale":"2023-07-14T15:58:09.719936+0000","last_undegraded":"2023-07-14T15:58:09.719936+0000","last_fullsized":"2023-07-14T15:58:09.719936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:59:22.428045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":210,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167486+0000","last_change":"2023-07-14T15:55:54.040065+0000","last_active":"2023-07-14T15:58:10.167486+0000","last_peered":"2023-07-14T15:58:10.167486+0000","last_clean":"2023-07-14T15:58:10.167486+0000","last_became_active":"2023-07-14T15:55:54.038885+0000","last_became_peered":"2023-07-14T15:55:54.038885+0000","last_unstale":"2023-07-14T15:58:10.167486+0000","last_undegraded":"2023-07-14T15:58:10.167486+0000","last_fullsized":"2023-07-14T15:58:10.167486+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:55:53.025696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:55:53.025696+0000","last_clean_scrub_stamp":"2023-07-14T15:55:53.025696+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:02:02.551339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.719307+0000","last_change":"2023-07-14T15:58:08.736125+0000","last_active":"2023-07-14T15:58:09.719307+0000","last_peered":"2023-07-14T15:58:09.719307+0000","last_clean":"2023-07-14T15:58:09.719307+0000","last_became_active":"2023-07-14T15:58:08.735774+0000","last_became_peered":"2023-07-14T15:58:08.735774+0000","last_unstale":"2023-07-14T15:58:09.719307+0000","last_undegraded":"2023-07-14T15:58:09.719307+0000","last_fullsized":"2023-07-14T15:58:09.719307+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:24:42.998893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.720213+0000","last_change":"2023-07-14T15:58:07.736838+0000","last_active":"2023-07-14T15:58:09.720213+0000","last_peered":"2023-07-14T15:58:09.720213+0000","last_clean":"2023-07-14T15:58:09.720213+0000","last_became_active":"2023-07-14T15:58:07.735691+0000","last_became_peered":"2023-07-14T15:58:07.735691+0000","last_unstale":"2023-07-14T15:58:09.720213+0000","last_undegraded":"2023-07-14T15:58:09.720213+0000","last_fullsized":"2023-07-14T15:58:09.720213+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:11:00.437830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":68,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.719707+0000","last_change":"2023-07-14T15:56:01.920714+0000","last_active":"2023-07-14T15:58:09.719707+0000","last_peered":"2023-07-14T15:58:09.719707+0000","last_clean":"2023-07-14T15:58:09.719707+0000","last_became_active":"2023-07-14T15:56:01.920325+0000","last_became_peered":"2023-07-14T15:56:01.920325+0000","last_unstale":"2023-07-14T15:58:09.719707+0000","last_undegraded":"2023-07-14T15:58:09.719707+0000","last_fullsized":"2023-07-14T15:58:09.719707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:38:02.085831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.911645+0000","last_change":"2023-07-14T15:58:08.735014+0000","last_active":"2023-07-14T15:58:09.911645+0000","last_peered":"2023-07-14T15:58:09.911645+0000","last_clean":"2023-07-14T15:58:09.911645+0000","last_became_active":"2023-07-14T15:58:08.733335+0000","last_became_peered":"2023-07-14T15:58:08.733335+0000","last_unstale":"2023-07-14T15:58:09.911645+0000","last_undegraded":"2023-07-14T15:58:09.911645+0000","last_fullsized":"2023-07-14T15:58:09.911645+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:52:54.835442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167704+0000","last_change":"2023-07-14T15:58:07.736616+0000","last_active":"2023-07-14T15:58:10.167704+0000","last_peered":"2023-07-14T15:58:10.167704+0000","last_clean":"2023-07-14T15:58:10.167704+0000","last_became_active":"2023-07-14T15:58:07.736315+0000","last_became_peered":"2023-07-14T15:58:07.736315+0000","last_unstale":"2023-07-14T15:58:10.167704+0000","last_undegraded":"2023-07-14T15:58:10.167704+0000","last_fullsized":"2023-07-14T15:58:10.167704+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:23:07.012317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":68,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.720300+0000","last_change":"2023-07-14T15:56:01.923631+0000","last_active":"2023-07-14T15:58:09.720300+0000","last_peered":"2023-07-14T15:58:09.720300+0000","last_clean":"2023-07-14T15:58:09.720300+0000","last_became_active":"2023-07-14T15:56:01.922783+0000","last_became_peered":"2023-07-14T15:56:01.922783+0000","last_unstale":"2023-07-14T15:58:09.720300+0000","last_undegraded":"2023-07-14T15:58:09.720300+0000","last_fullsized":"2023-07-14T15:58:09.720300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:03:05.448312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.719758+0000","last_change":"2023-07-14T15:58:08.730935+0000","last_active":"2023-07-14T15:58:09.719758+0000","last_peered":"2023-07-14T15:58:09.719758+0000","last_clean":"2023-07-14T15:58:09.719758+0000","last_became_active":"2023-07-14T15:58:08.730640+0000","last_became_peered":"2023-07-14T15:58:08.730640+0000","last_unstale":"2023-07-14T15:58:09.719758+0000","last_undegraded":"2023-07-14T15:58:09.719758+0000","last_fullsized":"2023-07-14T15:58:09.719758+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:01:43.007660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.719496+0000","last_change":"2023-07-14T15:58:07.734768+0000","last_active":"2023-07-14T15:58:09.719496+0000","last_peered":"2023-07-14T15:58:09.719496+0000","last_clean":"2023-07-14T15:58:09.719496+0000","last_became_active":"2023-07-14T15:58:07.734498+0000","last_became_peered":"2023-07-14T15:58:07.734498+0000","last_unstale":"2023-07-14T15:58:09.719496+0000","last_undegraded":"2023-07-14T15:58:09.719496+0000","last_fullsized":"2023-07-14T15:58:09.719496+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:33:42.843397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":60,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.721702+0000","last_change":"2023-07-14T15:56:01.965649+0000","last_active":"2023-07-14T15:58:09.721702+0000","last_peered":"2023-07-14T15:58:09.721702+0000","last_clean":"2023-07-14T15:58:09.721702+0000","last_became_active":"2023-07-14T15:56:01.965344+0000","last_became_peered":"2023-07-14T15:56:01.965344+0000","last_unstale":"2023-07-14T15:58:09.721702+0000","last_undegraded":"2023-07-14T15:58:09.721702+0000","last_fullsized":"2023-07-14T15:58:09.721702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:21:21.789908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.511344+0000","last_change":"2023-07-14T15:58:08.730629+0000","last_active":"2023-07-14T15:58:10.511344+0000","last_peered":"2023-07-14T15:58:10.511344+0000","last_clean":"2023-07-14T15:58:10.511344+0000","last_became_active":"2023-07-14T15:58:08.730333+0000","last_became_peered":"2023-07-14T15:58:08.730333+0000","last_unstale":"2023-07-14T15:58:10.511344+0000","last_undegraded":"2023-07-14T15:58:10.511344+0000","last_fullsized":"2023-07-14T15:58:10.511344+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:03:03.027389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.721540+0000","last_change":"2023-07-14T15:58:07.730397+0000","last_active":"2023-07-14T15:58:09.721540+0000","last_peered":"2023-07-14T15:58:09.721540+0000","last_clean":"2023-07-14T15:58:09.721540+0000","last_became_active":"2023-07-14T15:58:07.729703+0000","last_became_peered":"2023-07-14T15:58:07.729703+0000","last_unstale":"2023-07-14T15:58:09.721540+0000","last_undegraded":"2023-07-14T15:58:09.721540+0000","last_fullsized":"2023-07-14T15:58:09.721540+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:26:46.788380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":68,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.720144+0000","last_change":"2023-07-14T15:56:01.966578+0000","last_active":"2023-07-14T15:58:09.720144+0000","last_peered":"2023-07-14T15:58:09.720144+0000","last_clean":"2023-07-14T15:58:09.720144+0000","last_became_active":"2023-07-14T15:56:01.966216+0000","last_became_peered":"2023-07-14T15:56:01.966216+0000","last_unstale":"2023-07-14T15:58:09.720144+0000","last_undegraded":"2023-07-14T15:58:09.720144+0000","last_fullsized":"2023-07-14T15:58:09.720144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:37:59.644169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476768,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31604,"kb_used_data":556,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340236,"statfs":{"total":96636764160,"available":96604401664,"internally_reserved":0,"allocated":569344,"data_stored":242471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.44800000000000001,"15min":0.45000000000000001},"min":{"1min":0.29799999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.58999999999999997,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.438},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.46300000000000002,"15min":0.47299999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.57599999999999996,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.58799999999999997}]},{"osd":1,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.57799999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.52100000000000002,"15min":0.52300000000000002},"min":{"1min":0.38600000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.67500000000000004,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.69099999999999995}]},{"osd":2,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.504,"15min":0.505},"min":{"1min":0.40300000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.66700000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.74199999999999999,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.621}]},{"osd":4,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.755,"15min":0.76500000000000001},"min":{"1min":0.503,"5min":0.441,"15min":0.441},"max":{"1min":1.0189999999999999,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.76600000000000001,"15min":0.77400000000000002},"min":{"1min":0.53900000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.88400000000000001,"5min":1.542,"15min":1.542},"last":0.54700000000000004}]},{"osd":5,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.84199999999999997,"15min":0.85599999999999998},"min":{"1min":0.625,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.95299999999999996,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.84599999999999997,"15min":0.85699999999999998},"min":{"1min":0.60899999999999999,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.94599999999999995,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.74199999999999999}]},{"osd":6,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.80800000000000005,"15min":0.81899999999999995},"min":{"1min":0.55900000000000005,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.98799999999999999,"5min":1.52,"15min":1.52},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.79900000000000004,"15min":0.81200000000000006},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.86099999999999999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.64300000000000002}]},{"osd":7,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.77400000000000002,"15min":0.77700000000000002},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.96499999999999997,"5min":1.232,"15min":1.232},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.84299999999999997,"15min":0.85699999999999998},"min":{"1min":0.55500000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.94899999999999995,"5min":1.478,"15min":1.478},"last":0.65500000000000003}]}]},{"osd":0,"up_from":16,"seq":68719476769,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":556,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":569344,"data_stored":242963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42299999999999999,"15min":0.42399999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.67500000000000004,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.48499999999999999,"15min":0.48899999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.61599999999999999,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.46600000000000003}]},{"osd":2,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.499,"15min":0.5},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.442},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.50800000000000001,"15min":0.505},"min":{"1min":0.41499999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.497}]},{"osd":3,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47899999999999998,"15min":0.48099999999999998},"min":{"1min":0.38100000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.60699999999999998,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.57299999999999995,"15min":0.57699999999999996},"min":{"1min":0.42399999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76500000000000001,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.52300000000000002}]},{"osd":4,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.99399999999999999,"5min":1.04,"15min":1.04},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.78000000000000003,"15min":0.78900000000000003},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.91000000000000003,"5min":1.331,"15min":1.331},"last":0.72299999999999998}]},{"osd":5,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.60999999999999999,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.119,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.56999999999999995,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0289999999999999,"5min":1.087,"15min":1.087},"last":0.65100000000000002}]},{"osd":6,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.77500000000000002,"15min":0.78100000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0029999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.80100000000000005,"15min":0.80500000000000005},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.056,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.74299999999999999}]},{"osd":7,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.80100000000000005,"15min":0.80800000000000005},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.99399999999999999,"5min":1.262,"15min":1.262},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.79700000000000004,"15min":0.80100000000000005},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.97799999999999998,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.77500000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542175,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":556,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":569344,"data_stored":242963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.621,"15min":0.61699999999999999},"min":{"1min":0.40999999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.82399999999999995,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64700000000000002,"15min":0.64600000000000002},"min":{"1min":0.496,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81599999999999995,"5min":1.266,"15min":1.266},"last":0.60699999999999998}]},{"osd":1,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.69799999999999995,"15min":0.70299999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88700000000000001,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.72199999999999998,"15min":0.71699999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.86699999999999999}]},{"osd":2,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.88500000000000001,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.68600000000000005,"15min":0.69099999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.75600000000000001}]},{"osd":3,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.78200000000000003,"15min":0.80400000000000005},"min":{"1min":0.48099999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.85999999999999999,"5min":3.141,"15min":3.141},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.752,"15min":0.753},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.94999999999999996,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.68200000000000005}]},{"osd":4,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.63,"15min":0.63300000000000001},"min":{"1min":0.432,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.83499999999999996,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.70899999999999996,"15min":0.71199999999999997},"min":{"1min":0.47599999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.92300000000000004,"5min":1.024,"15min":1.024},"last":0.55100000000000005}]},{"osd":5,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.748,"15min":0.751},"min":{"1min":0.51700000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.96999999999999997,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73599999999999999,"15min":0.73999999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.012,"5min":1.091,"15min":1.091},"last":0.80200000000000005}]},{"osd":7,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.72499999999999998,"15min":0.72899999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.92500000000000004,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.82399999999999995,"15min":0.82899999999999996},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":0.996,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.83899999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542174,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":1136,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1163264,"data_stored":832819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.60699999999999998,"15min":0.64200000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.53100000000000003,"5min":4.5519999999999996,"15min":4.5519999999999996},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":1.147,"15min":1.2609999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.70899999999999996,"5min":15.911,"15min":15.911},"last":0.53500000000000003}]},{"osd":2,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.45700000000000002,"15min":0.46400000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.53300000000000003,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.436},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.67300000000000004,"15min":0.70599999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.57299999999999995,"5min":4.5140000000000002,"15min":4.5140000000000002},"last":0.55700000000000005}]},{"osd":3,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.70199999999999996,"15min":0.73599999999999999},"min":{"1min":0.378,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.65500000000000003,"5min":4.452,"15min":4.452},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.70299999999999996,"15min":0.73899999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.57999999999999996,"5min":4.2279999999999998,"15min":4.2279999999999998},"last":0.48599999999999999}]},{"osd":4,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.88400000000000001,"15min":0.92000000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.81899999999999995,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.92200000000000004,"15min":0.95999999999999996},"min":{"1min":0.52400000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.95699999999999996,"5min":4.9109999999999996,"15min":4.9109999999999996},"last":0.61099999999999999}]},{"osd":5,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.90000000000000002,"15min":0.93300000000000005},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.98999999999999999,"5min":4.1269999999999998,"15min":4.1269999999999998},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.93799999999999994,"15min":0.97399999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.93700000000000006,"5min":4.585,"15min":4.585},"last":0.67700000000000005}]},{"osd":6,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.93300000000000005,"15min":0.97099999999999997},"min":{"1min":0.56899999999999995,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0369999999999999,"5min":4.9880000000000004,"15min":4.9880000000000004},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.92900000000000005,"15min":0.96299999999999997},"min":{"1min":0.58499999999999996,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94599999999999995,"5min":4.1660000000000004,"15min":4.1660000000000004},"last":0.747}]},{"osd":7,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.98199999999999998,"15min":1.0249999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.0429999999999999,"5min":4.9530000000000003,"15min":4.9530000000000003},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.94599999999999995,"15min":0.98099999999999998},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.048,"5min":4.1959999999999997,"15min":4.1959999999999997},"last":0.79000000000000004}]}]},{"osd":2,"up_from":15,"seq":64424509472,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":556,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":569344,"data_stored":242415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.42699999999999999,"15min":0.433},"min":{"1min":0.32200000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.51900000000000002,"5min":0.62,"15min":0.62},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.47299999999999998,"15min":0.48299999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.57999999999999996,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.39600000000000002}]},{"osd":1,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.52400000000000002,"15min":0.53100000000000003},"min":{"1min":0.315,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76200000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.46899999999999997,"15min":0.47099999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.65100000000000002,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.43099999999999999}]},{"osd":3,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.58799999999999997,"15min":0.60199999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.63600000000000001,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.53200000000000003,"15min":0.53800000000000003},"min":{"1min":0.433,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.53700000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.48799999999999999}]},{"osd":4,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.72399999999999998,"15min":0.72799999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.169,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.74299999999999999,"15min":0.747},"min":{"1min":0.53300000000000003,"5min":0.437,"15min":0.437},"max":{"1min":0.90100000000000002,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.68899999999999995}]},{"osd":5,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.77300000000000002,"15min":0.78100000000000003},"min":{"1min":0.55700000000000005,"5min":0.505,"15min":0.505},"max":{"1min":1.002,"5min":1.391,"15min":1.391},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.75600000000000001,"15min":0.76200000000000001},"min":{"1min":0.50700000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.153,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.69999999999999996}]},{"osd":6,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.79000000000000004,"15min":0.80300000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0960000000000001,"5min":1.51,"15min":1.51},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.81599999999999995,"15min":0.82999999999999996},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1319999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.74299999999999999}]},{"osd":7,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.78300000000000003,"15min":0.79400000000000004},"min":{"1min":0.54700000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.048,"5min":1.288,"15min":1.288},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.81799999999999995,"15min":0.82799999999999996},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.72899999999999998}]}]},{"osd":4,"up_from":15,"seq":64424509471,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":572,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":585728,"data_stored":244037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.67700000000000005,"15min":0.68700000000000006},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.503},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.64700000000000002,"15min":0.65700000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88300000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.69699999999999995}]},{"osd":1,"last update":"Fri Jul 14 15:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.67000000000000004,"15min":0.67600000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.81999999999999995,"5min":0.87,"15min":0.87},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.65100000000000002,"15min":0.66000000000000003},"min":{"1min":0.44400000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.82899999999999996,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.47299999999999998}]},{"osd":2,"last update":"Fri Jul 14 15:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64400000000000002,"15min":0.65000000000000002},"min":{"1min":0.441,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.71599999999999997,"15min":0.72899999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.80900000000000005,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.52800000000000002}]},{"osd":3,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.68400000000000005,"15min":0.68799999999999994},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.86699999999999999,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.72799999999999998,"15min":0.73499999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.94299999999999995,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.65600000000000003}]},{"osd":5,"last update":"Fri Jul 14 15:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65900000000000003,"15min":0.66400000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.83499999999999996,"5min":1.119,"15min":1.119},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.70699999999999996,"15min":0.71599999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.88200000000000001,"5min":1.157,"15min":1.157},"last":0.60799999999999998}]},{"osd":6,"last update":"Fri Jul 14 15:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.70199999999999996,"15min":0.71399999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.86199999999999999,"5min":1.04,"15min":1.04},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.89800000000000002,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.80600000000000005}]},{"osd":7,"last update":"Fri Jul 14 15:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.755,"15min":0.76700000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93799999999999994,"5min":1.202,"15min":1.202},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.77900000000000003,"15min":0.79100000000000004},"min":{"1min":0.53900000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.92100000000000004,"5min":1.137,"15min":1.137},"last":0.85899999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509473,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28100,"kb_used_data":1148,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343740,"statfs":{"total":96636764160,"available":96607989760,"internally_reserved":0,"allocated":1175552,"data_stored":834403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.66400000000000003,"15min":0.67200000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.86099999999999999,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.97799999999999998,"15min":1.038},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.80600000000000005,"5min":8.1500000000000004,"15min":8.1500000000000004},"last":0.93700000000000006}]},{"osd":1,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.67200000000000004,"15min":0.67600000000000005},"min":{"1min":0.51200000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.98799999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.66400000000000003,"15min":0.67000000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.76800000000000002,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.82899999999999996}]},{"osd":2,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.75800000000000001,"15min":0.77100000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.873,"5min":1.085,"15min":1.085},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.72499999999999998,"15min":0.73699999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.86599999999999999,"5min":1.048,"15min":1.048},"last":0.84399999999999997}]},{"osd":3,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.69299999999999995,"15min":0.70099999999999996},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.82299999999999995,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.80000000000000004,"15min":0.81000000000000005},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":0.91700000000000004,"5min":1.083,"15min":1.083},"last":1.0009999999999999}]},{"osd":4,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68999999999999995,"15min":0.69199999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.62,"5min":0.65700000000000003,"15min":0.66300000000000003},"min":{"1min":0.441,"5min":0.438,"15min":0.438},"max":{"1min":0.82099999999999995,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.60799999999999998}]},{"osd":6,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.69899999999999995,"15min":0.71299999999999997},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.871,"5min":1.121,"15min":1.121},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.78700000000000003,"15min":0.80100000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.93799999999999994,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.64100000000000001}]},{"osd":7,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.74399999999999999,"15min":0.751},"min":{"1min":0.58199999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.875,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.81699999999999995,"15min":0.83099999999999996},"min":{"1min":0.53800000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.94699999999999995,"5min":1.605,"15min":1.605},"last":0.76700000000000002}]}]},{"osd":7,"up_from":15,"seq":64424509472,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":573440,"data_stored":242437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.61799999999999999,"15min":0.61499999999999999},"min":{"1min":0.39300000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0089999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.497},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.80400000000000005,"15min":0.82499999999999996},"min":{"1min":0.44400000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0820000000000001,"5min":4.5919999999999996,"15min":4.5919999999999996},"last":0.51900000000000002}]},{"osd":1,"last update":"Fri Jul 14 15:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.66700000000000004,"15min":0.66900000000000004},"min":{"1min":0.442,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98299999999999998,"5min":1,"15min":1},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.86199999999999999,"15min":0.89600000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88100000000000001,"5min":4.665,"15min":4.665},"last":0.81499999999999995}]},{"osd":2,"last update":"Fri Jul 14 15:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.872,"15min":0.91200000000000003},"min":{"1min":0.50600000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.86699999999999999,"5min":5.4089999999999998,"15min":5.4089999999999998},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.76700000000000002,"15min":0.77500000000000002},"min":{"1min":0.497,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0389999999999999,"5min":2.165,"15min":2.165},"last":0.68999999999999995}]},{"osd":3,"last update":"Fri Jul 14 15:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.753,"15min":0.76100000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.96199999999999997,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.80600000000000005,"15min":0.82399999999999995},"min":{"1min":0.49299999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.92500000000000004,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":0.77200000000000002}]},{"osd":4,"last update":"Fri Jul 14 15:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.63900000000000001,"15min":0.64100000000000001},"min":{"1min":0.41099999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89200000000000002,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.748},{"interface":"front","average":{"1min":0.624,"5min":0.65400000000000003,"15min":0.65900000000000003},"min":{"1min":0.37,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.77800000000000002,"5min":1.111,"15min":1.111},"last":0.88300000000000001}]},{"osd":5,"last update":"Fri Jul 14 15:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.65100000000000002,"15min":0.65900000000000003},"min":{"1min":0.40400000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.80500000000000005,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.73799999999999999,"15min":0.747},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.89800000000000002,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.79400000000000004}]},{"osd":6,"last update":"Fri Jul 14 15:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69799999999999995,"15min":0.70499999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84799999999999998,"5min":1.042,"15min":1.042},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.76100000000000001,"15min":0.77700000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.83799999999999997,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.97699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T15:58:18.182 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T15:58:18.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.410+0000 7f2dc5bff700 1 Processor -- start 2023-07-14T15:58:18.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.410+0000 7f2dc5bff700 1 -- start start 2023-07-14T15:58:18.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.411+0000 7f2dc5bff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f2dc006c750 0x7f2dc00b2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:18.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.411+0000 7f2dc5bff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2dc006b690 0x7f2dc00d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:18.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.411+0000 7f2dc5bff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dc00cfc60 con 0x7f2dc006cb20 2023-07-14T15:58:18.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.411+0000 7f2dc5bff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dc00cff40 con 0x7f2dc006b690 2023-07-14T15:58:18.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.411+0000 7f2dc5bff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dc00d0220 con 0x7f2dc006c750 2023-07-14T15:58:18.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.412+0000 7f2dbeffd700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2dc006cb20 0x7f2dc006af80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47050/0 (socket says 172.21.15.37:47050) 2023-07-14T15:58:18.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.412+0000 7f2dbeffd700 1 -- 172.21.15.37:0/995412770 learned_addr learned my addr 172.21.15.37:0/995412770 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:58:18.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.412+0000 7f2dbffff700 1 --2- 172.21.15.37:0/995412770 >> v2:172.21.15.37:3300/0 conn(0x7f2dc006b690 0x7f2dc00d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:18.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.412+0000 7f2dbf7fe700 1 --2- 172.21.15.37:0/995412770 >> v2:172.21.15.98:3300/0 conn(0x7f2dc006c750 0x7f2dc00b2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:18.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.412+0000 7f2dbe7fc700 1 -- 172.21.15.37:0/995412770 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 668369058 0 0) 0x7f2dc00cfc60 con 0x7f2dc006cb20 2023-07-14T15:58:18.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.412+0000 7f2dbe7fc700 1 -- 172.21.15.37:0/995412770 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2da80035b0 con 0x7f2dc006cb20 2023-07-14T15:58:18.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.412+0000 7f2dbffff700 1 -- 172.21.15.37:0/995412770 >> v2:172.21.15.98:3300/0 conn(0x7f2dc006c750 msgr2=0x7f2dc00b2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:18.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.412+0000 7f2dbffff700 1 --2- 172.21.15.37:0/995412770 >> v2:172.21.15.98:3300/0 conn(0x7f2dc006c750 0x7f2dc00b2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:18.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.412+0000 7f2dbffff700 1 -- 172.21.15.37:0/995412770 >> v1:172.21.15.37:6789/0 conn(0x7f2dc006cb20 legacy=0x7f2dc006af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:18.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.412+0000 7f2dbffff700 1 -- 172.21.15.37:0/995412770 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc00d0500 con 0x7f2dc006b690 2023-07-14T15:58:18.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.412+0000 7f2dbffff700 1 --2- 172.21.15.37:0/995412770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2dc006b690 0x7f2dc00d0a20 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f2dc00669b0 tx=0x7f2db800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daa2a4a7ed490151 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:18.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.413+0000 7f2dbe7fc700 1 -- 172.21.15.37:0/995412770 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db800e070 con 0x7f2dc006b690 2023-07-14T15:58:18.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.413+0000 7f2dbe7fc700 1 -- 172.21.15.37:0/995412770 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db800bb20 con 0x7f2dc006b690 2023-07-14T15:58:18.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.413+0000 7f2dbe7fc700 1 -- 172.21.15.37:0/995412770 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db800be90 con 0x7f2dc006b690 2023-07-14T15:58:18.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.413+0000 7f2dc5bff700 1 -- 172.21.15.37:0/995412770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2dc006b690 msgr2=0x7f2dc00d0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:18.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.413+0000 7f2dc5bff700 1 --2- 172.21.15.37:0/995412770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2dc006b690 0x7f2dc00d0a20 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f2dc00669b0 tx=0x7f2db800b330 comp rx=0 tx=0).stop 2023-07-14T15:58:18.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.413+0000 7f2dc5bff700 1 -- 172.21.15.37:0/995412770 shutdown_connections 2023-07-14T15:58:18.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.413+0000 7f2dc5bff700 1 --2- 172.21.15.37:0/995412770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2dc006b690 0x7f2dc00d0a20 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:18.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.413+0000 7f2dc5bff700 1 --2- 172.21.15.37:0/995412770 >> v2:172.21.15.98:3300/0 conn(0x7f2dc006c750 0x7f2dc00b2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:18.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.413+0000 7f2dc5bff700 1 -- 172.21.15.37:0/995412770 >> 172.21.15.37:0/995412770 conn(0x7f2dc006d9a0 msgr2=0x7f2dc006dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:18.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.413+0000 7f2dc5bff700 1 -- 172.21.15.37:0/995412770 shutdown_connections 2023-07-14T15:58:18.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.414+0000 7f2dc5bff700 1 -- 172.21.15.37:0/995412770 wait complete. 2023-07-14T15:58:18.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.415+0000 7f2dc5bff700 1 Processor -- start 2023-07-14T15:58:18.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.415+0000 7f2dc5bff700 1 -- start start 2023-07-14T15:58:18.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.416+0000 7f2dc5bff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2dc006b690 0x7f2dc00ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:18.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.416+0000 7f2dc5bff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2dc006c750 0x7f2dc0153970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:18.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.416+0000 7f2dc5bff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2dc006cb20 0x7f2dc01e8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:18.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.416+0000 7f2dc5bff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc00b3ae0 con 0x7f2dc006c750 2023-07-14T15:58:18.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.416+0000 7f2dc5bff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc01e8d00 con 0x7f2dc006b690 2023-07-14T15:58:18.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.416+0000 7f2dc5bff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc00b3d30 con 0x7f2dc006cb20 2023-07-14T15:58:18.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.417+0000 7f2dbeffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2dc006c750 0x7f2dc0153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:18.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.417+0000 7f2dbeffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2dc006c750 0x7f2dc0153970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49604/0 (socket says 172.21.15.37:49604) 2023-07-14T15:58:18.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.417+0000 7f2dbeffd700 1 -- 172.21.15.37:0/3229092247 learned_addr learned my addr 172.21.15.37:0/3229092247 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:18.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.417+0000 7f2dbf7fe700 1 --2- 172.21.15.37:0/3229092247 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2dc006b690 0x7f2dc00ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:18.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.417+0000 7f2dbffff700 1 --2- 172.21.15.37:0/3229092247 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2dc006cb20 0x7f2dc01e8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:18.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.417+0000 7f2dbeffd700 1 -- 172.21.15.37:0/3229092247 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2dc006cb20 msgr2=0x7f2dc01e8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:18.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.417+0000 7f2dbeffd700 1 --2- 172.21.15.37:0/3229092247 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2dc006cb20 0x7f2dc01e8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:18.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.417+0000 7f2dbeffd700 1 -- 172.21.15.37:0/3229092247 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2dc006b690 msgr2=0x7f2dc00ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:18.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.417+0000 7f2dbeffd700 1 --2- 172.21.15.37:0/3229092247 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2dc006b690 0x7f2dc00ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:18.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.417+0000 7f2dbeffd700 1 -- 172.21.15.37:0/3229092247 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db8009a70 con 0x7f2dc006c750 2023-07-14T15:58:18.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.417+0000 7f2dbeffd700 1 --2- 172.21.15.37:0/3229092247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2dc006c750 0x7f2dc0153970 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f2db400c430 tx=0x7f2db400c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:18.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.417+0000 7f2da7fff700 1 -- 172.21.15.37:0/3229092247 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db400cea0 con 0x7f2dc006c750 2023-07-14T15:58:18.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.418+0000 7f2da7fff700 1 -- 172.21.15.37:0/3229092247 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db4005d70 con 0x7f2dc006c750 2023-07-14T15:58:18.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.418+0000 7f2da7fff700 1 -- 172.21.15.37:0/3229092247 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db4007310 con 0x7f2dc006c750 2023-07-14T15:58:18.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.418+0000 7f2dc5bff700 1 -- 172.21.15.37:0/3229092247 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dc00b4010 con 0x7f2dc006c750 2023-07-14T15:58:18.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.418+0000 7f2dc5bff700 1 -- 172.21.15.37:0/3229092247 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dc01544a0 con 0x7f2dc006c750 2023-07-14T15:58:18.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.419+0000 7f2dc5bff700 1 -- 172.21.15.37:0/3229092247 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dc00b4530 con 0x7f2dc006c750 2023-07-14T15:58:18.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.420+0000 7f2da7fff700 1 -- 172.21.15.37:0/3229092247 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f2db4007470 con 0x7f2dc006c750 2023-07-14T15:58:18.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.421+0000 7f2da7fff700 1 --2- 172.21.15.37:0/3229092247 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f2dac06ad70 0x7f2dac06d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:18.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.421+0000 7f2da7fff700 1 -- 172.21.15.37:0/3229092247 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2db4088870 con 0x7f2dc006c750 2023-07-14T15:58:18.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.421+0000 7f2dbf7fe700 1 --2- 172.21.15.37:0/3229092247 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f2dac06ad70 0x7f2dac06d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:18.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.422+0000 7f2dbf7fe700 1 --2- 172.21.15.37:0/3229092247 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f2dac06ad70 0x7f2dac06d220 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2db0009be0 tx=0x7f2db0009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:18.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.425+0000 7f2da7fff700 1 -- 172.21.15.37:0/3229092247 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2dc00b4530 con 0x7f2dc006c750 2023-07-14T15:58:18.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.625+0000 7f2dc5bff700 1 -- 172.21.15.37:0/3229092247 --> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2dc00cb300 con 0x7f2dac06ad70 2023-07-14T15:58:18.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.635+0000 7f2da7fff700 1 -- 172.21.15.37:0/3229092247 <== mgr.4100 v2:172.21.15.98:6832/3163748069 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311343 (secure 0 0 0) 0x7f2db0011860 con 0x7f2dac06ad70 2023-07-14T15:58:18.624 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:58:18.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.639+0000 7f2dc5bff700 1 -- 172.21.15.37:0/3229092247 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f2dac06ad70 msgr2=0x7f2dac06d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:18.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.639+0000 7f2dc5bff700 1 --2- 172.21.15.37:0/3229092247 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f2dac06ad70 0x7f2dac06d220 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2db0009be0 tx=0x7f2db0009210 comp rx=0 tx=0).stop 2023-07-14T15:58:18.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.639+0000 7f2dc5bff700 1 -- 172.21.15.37:0/3229092247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2dc006c750 msgr2=0x7f2dc0153970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:18.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.639+0000 7f2dc5bff700 1 --2- 172.21.15.37:0/3229092247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2dc006c750 0x7f2dc0153970 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f2db400c430 tx=0x7f2db400c740 comp rx=0 tx=0).stop 2023-07-14T15:58:18.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.639+0000 7f2dc5bff700 1 -- 172.21.15.37:0/3229092247 shutdown_connections 2023-07-14T15:58:18.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.639+0000 7f2dc5bff700 1 --2- 172.21.15.37:0/3229092247 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2dc006b690 0x7f2dc00ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:18.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.639+0000 7f2dc5bff700 1 --2- 172.21.15.37:0/3229092247 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f2dac06ad70 0x7f2dac06d220 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:18.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.639+0000 7f2dc5bff700 1 --2- 172.21.15.37:0/3229092247 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2dc006cb20 0x7f2dc01e8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:18.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.639+0000 7f2dc5bff700 1 --2- 172.21.15.37:0/3229092247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2dc006c750 0x7f2dc0153970 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:18.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.639+0000 7f2dc5bff700 1 -- 172.21.15.37:0/3229092247 >> 172.21.15.37:0/3229092247 conn(0x7f2dc006d9a0 msgr2=0x7f2dc006f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:18.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.639+0000 7f2dc5bff700 1 -- 172.21.15.37:0/3229092247 shutdown_connections 2023-07-14T15:58:18.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.640+0000 7f2dc5bff700 1 -- 172.21.15.37:0/3229092247 wait complete. 2023-07-14T15:58:18.629 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-14T15:58:18.643 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":115,"stamp":"2023-07-14T15:58:16.885430+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":229448,"kb_used_data":5640,"kb_used_omap":0,"kb_used_meta":223744,"kb_avail":754745272,"statfs":{"total":773094113280,"available":772859158528,"internally_reserved":0,"allocated":5775360,"data_stored":3124508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":229113856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.171132"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.249271+0000","last_change":"2023-07-14T15:58:08.744537+0000","last_active":"2023-07-14T15:58:10.249271+0000","last_peered":"2023-07-14T15:58:10.249271+0000","last_clean":"2023-07-14T15:58:10.249271+0000","last_became_active":"2023-07-14T15:58:08.743330+0000","last_became_peered":"2023-07-14T15:58:08.743330+0000","last_unstale":"2023-07-14T15:58:10.249271+0000","last_undegraded":"2023-07-14T15:58:10.249271+0000","last_fullsized":"2023-07-14T15:58:10.249271+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:49:26.687765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.511225+0000","last_change":"2023-07-14T15:58:08.734285+0000","last_active":"2023-07-14T15:58:10.511225+0000","last_peered":"2023-07-14T15:58:10.511225+0000","last_clean":"2023-07-14T15:58:10.511225+0000","last_became_active":"2023-07-14T15:58:08.734031+0000","last_became_peered":"2023-07-14T15:58:08.734031+0000","last_unstale":"2023-07-14T15:58:10.511225+0000","last_undegraded":"2023-07-14T15:58:10.511225+0000","last_fullsized":"2023-07-14T15:58:10.511225+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:24:06.908513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.721370+0000","last_change":"2023-07-14T15:58:08.735230+0000","last_active":"2023-07-14T15:58:09.721370+0000","last_peered":"2023-07-14T15:58:09.721370+0000","last_clean":"2023-07-14T15:58:09.721370+0000","last_became_active":"2023-07-14T15:58:08.734922+0000","last_became_peered":"2023-07-14T15:58:08.734922+0000","last_unstale":"2023-07-14T15:58:09.721370+0000","last_undegraded":"2023-07-14T15:58:09.721370+0000","last_fullsized":"2023-07-14T15:58:09.721370+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:39:41.597494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167815+0000","last_change":"2023-07-14T15:58:08.736155+0000","last_active":"2023-07-14T15:58:10.167815+0000","last_peered":"2023-07-14T15:58:10.167815+0000","last_clean":"2023-07-14T15:58:10.167815+0000","last_became_active":"2023-07-14T15:58:08.735812+0000","last_became_peered":"2023-07-14T15:58:08.735812+0000","last_unstale":"2023-07-14T15:58:10.167815+0000","last_undegraded":"2023-07-14T15:58:10.167815+0000","last_fullsized":"2023-07-14T15:58:10.167815+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:48:06.896474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.511546+0000","last_change":"2023-07-14T15:58:08.735103+0000","last_active":"2023-07-14T15:58:10.511546+0000","last_peered":"2023-07-14T15:58:10.511546+0000","last_clean":"2023-07-14T15:58:10.511546+0000","last_became_active":"2023-07-14T15:58:08.734805+0000","last_became_peered":"2023-07-14T15:58:08.734805+0000","last_unstale":"2023-07-14T15:58:10.511546+0000","last_undegraded":"2023-07-14T15:58:10.511546+0000","last_fullsized":"2023-07-14T15:58:10.511546+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:38:05.211272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.911301+0000","last_change":"2023-07-14T15:58:08.732408+0000","last_active":"2023-07-14T15:58:09.911301+0000","last_peered":"2023-07-14T15:58:09.911301+0000","last_clean":"2023-07-14T15:58:09.911301+0000","last_became_active":"2023-07-14T15:58:08.732069+0000","last_became_peered":"2023-07-14T15:58:08.732069+0000","last_unstale":"2023-07-14T15:58:09.911301+0000","last_undegraded":"2023-07-14T15:58:09.911301+0000","last_fullsized":"2023-07-14T15:58:09.911301+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:24:42.998893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.719148+0000","last_change":"2023-07-14T15:58:08.739256+0000","last_active":"2023-07-14T15:58:09.719148+0000","last_peered":"2023-07-14T15:58:09.719148+0000","last_clean":"2023-07-14T15:58:09.719148+0000","last_became_active":"2023-07-14T15:58:08.738964+0000","last_became_peered":"2023-07-14T15:58:08.738964+0000","last_unstale":"2023-07-14T15:58:09.719148+0000","last_undegraded":"2023-07-14T15:58:09.719148+0000","last_fullsized":"2023-07-14T15:58:09.719148+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:47:44.057204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.911055+0000","last_change":"2023-07-14T15:58:08.730355+0000","last_active":"2023-07-14T15:58:09.911055+0000","last_peered":"2023-07-14T15:58:09.911055+0000","last_clean":"2023-07-14T15:58:09.911055+0000","last_became_active":"2023-07-14T15:58:08.730089+0000","last_became_peered":"2023-07-14T15:58:08.730089+0000","last_unstale":"2023-07-14T15:58:09.911055+0000","last_undegraded":"2023-07-14T15:58:09.911055+0000","last_fullsized":"2023-07-14T15:58:09.911055+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:47:44.057204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.721545+0000","last_change":"2023-07-14T15:58:08.740471+0000","last_active":"2023-07-14T15:58:09.721545+0000","last_peered":"2023-07-14T15:58:09.721545+0000","last_clean":"2023-07-14T15:58:09.721545+0000","last_became_active":"2023-07-14T15:58:08.740200+0000","last_became_peered":"2023-07-14T15:58:08.740200+0000","last_unstale":"2023-07-14T15:58:09.721545+0000","last_undegraded":"2023-07-14T15:58:09.721545+0000","last_fullsized":"2023-07-14T15:58:09.721545+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:34:32.677159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.719649+0000","last_change":"2023-07-14T15:58:08.733544+0000","last_active":"2023-07-14T15:58:09.719649+0000","last_peered":"2023-07-14T15:58:09.719649+0000","last_clean":"2023-07-14T15:58:09.719649+0000","last_became_active":"2023-07-14T15:58:08.733284+0000","last_became_peered":"2023-07-14T15:58:08.733284+0000","last_unstale":"2023-07-14T15:58:09.719649+0000","last_undegraded":"2023-07-14T15:58:09.719649+0000","last_fullsized":"2023-07-14T15:58:09.719649+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:17:56.741403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.249087+0000","last_change":"2023-07-14T15:58:08.741999+0000","last_active":"2023-07-14T15:58:10.249087+0000","last_peered":"2023-07-14T15:58:10.249087+0000","last_clean":"2023-07-14T15:58:10.249087+0000","last_became_active":"2023-07-14T15:58:08.741574+0000","last_became_peered":"2023-07-14T15:58:08.741574+0000","last_unstale":"2023-07-14T15:58:10.249087+0000","last_undegraded":"2023-07-14T15:58:10.249087+0000","last_fullsized":"2023-07-14T15:58:10.249087+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:32:57.904943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.911190+0000","last_change":"2023-07-14T15:58:08.741197+0000","last_active":"2023-07-14T15:58:09.911190+0000","last_peered":"2023-07-14T15:58:09.911190+0000","last_clean":"2023-07-14T15:58:09.911190+0000","last_became_active":"2023-07-14T15:58:08.740823+0000","last_became_peered":"2023-07-14T15:58:08.740823+0000","last_unstale":"2023-07-14T15:58:09.911190+0000","last_undegraded":"2023-07-14T15:58:09.911190+0000","last_fullsized":"2023-07-14T15:58:09.911190+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:43:09.019373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.911317+0000","last_change":"2023-07-14T15:58:08.738088+0000","last_active":"2023-07-14T15:58:09.911317+0000","last_peered":"2023-07-14T15:58:09.911317+0000","last_clean":"2023-07-14T15:58:09.911317+0000","last_became_active":"2023-07-14T15:58:08.737794+0000","last_became_peered":"2023-07-14T15:58:08.737794+0000","last_unstale":"2023-07-14T15:58:09.911317+0000","last_undegraded":"2023-07-14T15:58:09.911317+0000","last_fullsized":"2023-07-14T15:58:09.911317+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:35:39.872451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.248843+0000","last_change":"2023-07-14T15:58:08.741798+0000","last_active":"2023-07-14T15:58:10.248843+0000","last_peered":"2023-07-14T15:58:10.248843+0000","last_clean":"2023-07-14T15:58:10.248843+0000","last_became_active":"2023-07-14T15:58:08.741528+0000","last_became_peered":"2023-07-14T15:58:08.741528+0000","last_unstale":"2023-07-14T15:58:10.248843+0000","last_undegraded":"2023-07-14T15:58:10.248843+0000","last_fullsized":"2023-07-14T15:58:10.248843+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:01:10.579696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167899+0000","last_change":"2023-07-14T15:58:08.739487+0000","last_active":"2023-07-14T15:58:10.167899+0000","last_peered":"2023-07-14T15:58:10.167899+0000","last_clean":"2023-07-14T15:58:10.167899+0000","last_became_active":"2023-07-14T15:58:08.739163+0000","last_became_peered":"2023-07-14T15:58:08.739163+0000","last_unstale":"2023-07-14T15:58:10.167899+0000","last_undegraded":"2023-07-14T15:58:10.167899+0000","last_fullsized":"2023-07-14T15:58:10.167899+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:50:25.208038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.911180+0000","last_change":"2023-07-14T15:58:08.741815+0000","last_active":"2023-07-14T15:58:09.911180+0000","last_peered":"2023-07-14T15:58:09.911180+0000","last_clean":"2023-07-14T15:58:09.911180+0000","last_became_active":"2023-07-14T15:58:08.741565+0000","last_became_peered":"2023-07-14T15:58:08.741565+0000","last_unstale":"2023-07-14T15:58:09.911180+0000","last_undegraded":"2023-07-14T15:58:09.911180+0000","last_fullsized":"2023-07-14T15:58:09.911180+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:40:30.625900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.249161+0000","last_change":"2023-07-14T15:58:08.744838+0000","last_active":"2023-07-14T15:58:10.249161+0000","last_peered":"2023-07-14T15:58:10.249161+0000","last_clean":"2023-07-14T15:58:10.249161+0000","last_became_active":"2023-07-14T15:58:08.744465+0000","last_became_peered":"2023-07-14T15:58:08.744465+0000","last_unstale":"2023-07-14T15:58:10.249161+0000","last_undegraded":"2023-07-14T15:58:10.249161+0000","last_fullsized":"2023-07-14T15:58:10.249161+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:07:13.860410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167818+0000","last_change":"2023-07-14T15:58:08.734559+0000","last_active":"2023-07-14T15:58:10.167818+0000","last_peered":"2023-07-14T15:58:10.167818+0000","last_clean":"2023-07-14T15:58:10.167818+0000","last_became_active":"2023-07-14T15:58:08.734286+0000","last_became_peered":"2023-07-14T15:58:08.734286+0000","last_unstale":"2023-07-14T15:58:10.167818+0000","last_undegraded":"2023-07-14T15:58:10.167818+0000","last_fullsized":"2023-07-14T15:58:10.167818+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:59:06.223997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.721474+0000","last_change":"2023-07-14T15:58:08.733384+0000","last_active":"2023-07-14T15:58:09.721474+0000","last_peered":"2023-07-14T15:58:09.721474+0000","last_clean":"2023-07-14T15:58:09.721474+0000","last_became_active":"2023-07-14T15:58:08.733096+0000","last_became_peered":"2023-07-14T15:58:08.733096+0000","last_unstale":"2023-07-14T15:58:09.721474+0000","last_undegraded":"2023-07-14T15:58:09.721474+0000","last_fullsized":"2023-07-14T15:58:09.721474+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:02:52.172329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.511733+0000","last_change":"2023-07-14T15:58:08.735489+0000","last_active":"2023-07-14T15:58:10.511733+0000","last_peered":"2023-07-14T15:58:10.511733+0000","last_clean":"2023-07-14T15:58:10.511733+0000","last_became_active":"2023-07-14T15:58:08.735207+0000","last_became_peered":"2023-07-14T15:58:08.735207+0000","last_unstale":"2023-07-14T15:58:10.511733+0000","last_undegraded":"2023-07-14T15:58:10.511733+0000","last_fullsized":"2023-07-14T15:58:10.511733+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:33:31.961842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167688+0000","last_change":"2023-07-14T15:58:08.735232+0000","last_active":"2023-07-14T15:58:10.167688+0000","last_peered":"2023-07-14T15:58:10.167688+0000","last_clean":"2023-07-14T15:58:10.167688+0000","last_became_active":"2023-07-14T15:58:08.734945+0000","last_became_peered":"2023-07-14T15:58:08.734945+0000","last_unstale":"2023-07-14T15:58:10.167688+0000","last_undegraded":"2023-07-14T15:58:10.167688+0000","last_fullsized":"2023-07-14T15:58:10.167688+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:27:25.126730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.721336+0000","last_change":"2023-07-14T15:58:08.738592+0000","last_active":"2023-07-14T15:58:09.721336+0000","last_peered":"2023-07-14T15:58:09.721336+0000","last_clean":"2023-07-14T15:58:09.721336+0000","last_became_active":"2023-07-14T15:58:08.738111+0000","last_became_peered":"2023-07-14T15:58:08.738111+0000","last_unstale":"2023-07-14T15:58:09.721336+0000","last_undegraded":"2023-07-14T15:58:09.721336+0000","last_fullsized":"2023-07-14T15:58:09.721336+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:40:01.920748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.720949+0000","last_change":"2023-07-14T15:58:08.736434+0000","last_active":"2023-07-14T15:58:09.720949+0000","last_peered":"2023-07-14T15:58:09.720949+0000","last_clean":"2023-07-14T15:58:09.720949+0000","last_became_active":"2023-07-14T15:58:08.736176+0000","last_became_peered":"2023-07-14T15:58:08.736176+0000","last_unstale":"2023-07-14T15:58:09.720949+0000","last_undegraded":"2023-07-14T15:58:09.720949+0000","last_fullsized":"2023-07-14T15:58:09.720949+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:48:08.009344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.720891+0000","last_change":"2023-07-14T15:58:08.744189+0000","last_active":"2023-07-14T15:58:09.720891+0000","last_peered":"2023-07-14T15:58:09.720891+0000","last_clean":"2023-07-14T15:58:09.720891+0000","last_became_active":"2023-07-14T15:58:08.743857+0000","last_became_peered":"2023-07-14T15:58:08.743857+0000","last_unstale":"2023-07-14T15:58:09.720891+0000","last_undegraded":"2023-07-14T15:58:09.720891+0000","last_fullsized":"2023-07-14T15:58:09.720891+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:07:05.042003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.249170+0000","last_change":"2023-07-14T15:58:08.735284+0000","last_active":"2023-07-14T15:58:10.249170+0000","last_peered":"2023-07-14T15:58:10.249170+0000","last_clean":"2023-07-14T15:58:10.249170+0000","last_became_active":"2023-07-14T15:58:08.734958+0000","last_became_peered":"2023-07-14T15:58:08.734958+0000","last_unstale":"2023-07-14T15:58:10.249170+0000","last_undegraded":"2023-07-14T15:58:10.249170+0000","last_fullsized":"2023-07-14T15:58:10.249170+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:32:16.092808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.721600+0000","last_change":"2023-07-14T15:58:08.741622+0000","last_active":"2023-07-14T15:58:09.721600+0000","last_peered":"2023-07-14T15:58:09.721600+0000","last_clean":"2023-07-14T15:58:09.721600+0000","last_became_active":"2023-07-14T15:58:08.741248+0000","last_became_peered":"2023-07-14T15:58:08.741248+0000","last_unstale":"2023-07-14T15:58:09.721600+0000","last_undegraded":"2023-07-14T15:58:09.721600+0000","last_fullsized":"2023-07-14T15:58:09.721600+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:20:08.810872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.911339+0000","last_change":"2023-07-14T15:58:08.731586+0000","last_active":"2023-07-14T15:58:09.911339+0000","last_peered":"2023-07-14T15:58:09.911339+0000","last_clean":"2023-07-14T15:58:09.911339+0000","last_became_active":"2023-07-14T15:58:08.731203+0000","last_became_peered":"2023-07-14T15:58:08.731203+0000","last_unstale":"2023-07-14T15:58:09.911339+0000","last_undegraded":"2023-07-14T15:58:09.911339+0000","last_fullsized":"2023-07-14T15:58:09.911339+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:33:43.846392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.511656+0000","last_change":"2023-07-14T15:58:08.736455+0000","last_active":"2023-07-14T15:58:10.511656+0000","last_peered":"2023-07-14T15:58:10.511656+0000","last_clean":"2023-07-14T15:58:10.511656+0000","last_became_active":"2023-07-14T15:58:08.736153+0000","last_became_peered":"2023-07-14T15:58:08.736153+0000","last_unstale":"2023-07-14T15:58:10.511656+0000","last_undegraded":"2023-07-14T15:58:10.511656+0000","last_fullsized":"2023-07-14T15:58:10.511656+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:21:39.877464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.249000+0000","last_change":"2023-07-14T15:58:08.732111+0000","last_active":"2023-07-14T15:58:10.249000+0000","last_peered":"2023-07-14T15:58:10.249000+0000","last_clean":"2023-07-14T15:58:10.249000+0000","last_became_active":"2023-07-14T15:58:08.731797+0000","last_became_peered":"2023-07-14T15:58:08.731797+0000","last_unstale":"2023-07-14T15:58:10.249000+0000","last_undegraded":"2023-07-14T15:58:10.249000+0000","last_fullsized":"2023-07-14T15:58:10.249000+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:16:58.489649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.719643+0000","last_change":"2023-07-14T15:58:08.735559+0000","last_active":"2023-07-14T15:58:09.719643+0000","last_peered":"2023-07-14T15:58:09.719643+0000","last_clean":"2023-07-14T15:58:09.719643+0000","last_became_active":"2023-07-14T15:58:08.735282+0000","last_became_peered":"2023-07-14T15:58:08.735282+0000","last_unstale":"2023-07-14T15:58:09.719643+0000","last_undegraded":"2023-07-14T15:58:09.719643+0000","last_fullsized":"2023-07-14T15:58:09.719643+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:28:18.721489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.721163+0000","last_change":"2023-07-14T15:58:08.739112+0000","last_active":"2023-07-14T15:58:09.721163+0000","last_peered":"2023-07-14T15:58:09.721163+0000","last_clean":"2023-07-14T15:58:09.721163+0000","last_became_active":"2023-07-14T15:58:08.738821+0000","last_became_peered":"2023-07-14T15:58:08.738821+0000","last_unstale":"2023-07-14T15:58:09.721163+0000","last_undegraded":"2023-07-14T15:58:09.721163+0000","last_fullsized":"2023-07-14T15:58:09.721163+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:43:34.680274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.510890+0000","last_change":"2023-07-14T15:58:08.729316+0000","last_active":"2023-07-14T15:58:10.510890+0000","last_peered":"2023-07-14T15:58:10.510890+0000","last_clean":"2023-07-14T15:58:10.510890+0000","last_became_active":"2023-07-14T15:58:08.729047+0000","last_became_peered":"2023-07-14T15:58:08.729047+0000","last_unstale":"2023-07-14T15:58:10.510890+0000","last_undegraded":"2023-07-14T15:58:10.510890+0000","last_fullsized":"2023-07-14T15:58:10.510890+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:50:26.301699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.719576+0000","last_change":"2023-07-14T15:58:08.736368+0000","last_active":"2023-07-14T15:58:09.719576+0000","last_peered":"2023-07-14T15:58:09.719576+0000","last_clean":"2023-07-14T15:58:09.719576+0000","last_became_active":"2023-07-14T15:58:08.736096+0000","last_became_peered":"2023-07-14T15:58:08.736096+0000","last_unstale":"2023-07-14T15:58:09.719576+0000","last_undegraded":"2023-07-14T15:58:09.719576+0000","last_fullsized":"2023-07-14T15:58:09.719576+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:47:02.564963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"48'4","reported_seq":17,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.511388+0000","last_change":"2023-07-14T15:58:07.732535+0000","last_active":"2023-07-14T15:58:10.511388+0000","last_peered":"2023-07-14T15:58:10.511388+0000","last_clean":"2023-07-14T15:58:10.511388+0000","last_became_active":"2023-07-14T15:58:07.732169+0000","last_became_peered":"2023-07-14T15:58:07.732169+0000","last_unstale":"2023-07-14T15:58:10.511388+0000","last_undegraded":"2023-07-14T15:58:10.511388+0000","last_fullsized":"2023-07-14T15:58:10.511388+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:33:30.958848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.719614+0000","last_change":"2023-07-14T15:58:08.740360+0000","last_active":"2023-07-14T15:58:09.719614+0000","last_peered":"2023-07-14T15:58:09.719614+0000","last_clean":"2023-07-14T15:58:09.719614+0000","last_became_active":"2023-07-14T15:58:08.739889+0000","last_became_peered":"2023-07-14T15:58:08.739889+0000","last_unstale":"2023-07-14T15:58:09.719614+0000","last_undegraded":"2023-07-14T15:58:09.719614+0000","last_fullsized":"2023-07-14T15:58:09.719614+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:14:22.034369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"48'1","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.911463+0000","last_change":"2023-07-14T15:58:07.736542+0000","last_active":"2023-07-14T15:58:09.911463+0000","last_peered":"2023-07-14T15:58:09.911463+0000","last_clean":"2023-07-14T15:58:09.911463+0000","last_became_active":"2023-07-14T15:58:07.736266+0000","last_became_peered":"2023-07-14T15:58:07.736266+0000","last_unstale":"2023-07-14T15:58:09.911463+0000","last_undegraded":"2023-07-14T15:58:09.911463+0000","last_fullsized":"2023-07-14T15:58:09.911463+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:58:25.104060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.719824+0000","last_change":"2023-07-14T15:58:08.733891+0000","last_active":"2023-07-14T15:58:09.719824+0000","last_peered":"2023-07-14T15:58:09.719824+0000","last_clean":"2023-07-14T15:58:09.719824+0000","last_became_active":"2023-07-14T15:58:08.733554+0000","last_became_peered":"2023-07-14T15:58:08.733554+0000","last_unstale":"2023-07-14T15:58:09.719824+0000","last_undegraded":"2023-07-14T15:58:09.719824+0000","last_fullsized":"2023-07-14T15:58:09.719824+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:48:42.366546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"48'2","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.719658+0000","last_change":"2023-07-14T15:58:07.732950+0000","last_active":"2023-07-14T15:58:09.719658+0000","last_peered":"2023-07-14T15:58:09.719658+0000","last_clean":"2023-07-14T15:58:09.719658+0000","last_became_active":"2023-07-14T15:58:07.732689+0000","last_became_peered":"2023-07-14T15:58:07.732689+0000","last_unstale":"2023-07-14T15:58:09.719658+0000","last_undegraded":"2023-07-14T15:58:09.719658+0000","last_fullsized":"2023-07-14T15:58:09.719658+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:58:25.104060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.719188+0000","last_change":"2023-07-14T15:58:08.735976+0000","last_active":"2023-07-14T15:58:09.719188+0000","last_peered":"2023-07-14T15:58:09.719188+0000","last_clean":"2023-07-14T15:58:09.719188+0000","last_became_active":"2023-07-14T15:58:08.735488+0000","last_became_peered":"2023-07-14T15:58:08.735488+0000","last_unstale":"2023-07-14T15:58:09.719188+0000","last_undegraded":"2023-07-14T15:58:09.719188+0000","last_fullsized":"2023-07-14T15:58:09.719188+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:38:58.679622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"48'2","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.511571+0000","last_change":"2023-07-14T15:58:07.730127+0000","last_active":"2023-07-14T15:58:10.511571+0000","last_peered":"2023-07-14T15:58:10.511571+0000","last_clean":"2023-07-14T15:58:10.511571+0000","last_became_active":"2023-07-14T15:58:07.729851+0000","last_became_peered":"2023-07-14T15:58:07.729851+0000","last_unstale":"2023-07-14T15:58:10.511571+0000","last_undegraded":"2023-07-14T15:58:10.511571+0000","last_fullsized":"2023-07-14T15:58:10.511571+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:18:22.332457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.510952+0000","last_change":"2023-07-14T15:58:08.738154+0000","last_active":"2023-07-14T15:58:10.510952+0000","last_peered":"2023-07-14T15:58:10.510952+0000","last_clean":"2023-07-14T15:58:10.510952+0000","last_became_active":"2023-07-14T15:58:08.737703+0000","last_became_peered":"2023-07-14T15:58:08.737703+0000","last_unstale":"2023-07-14T15:58:10.510952+0000","last_undegraded":"2023-07-14T15:58:10.510952+0000","last_fullsized":"2023-07-14T15:58:10.510952+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:21:39.877464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"48'1","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.721784+0000","last_change":"2023-07-14T15:58:07.734870+0000","last_active":"2023-07-14T15:58:09.721784+0000","last_peered":"2023-07-14T15:58:09.721784+0000","last_clean":"2023-07-14T15:58:09.721784+0000","last_became_active":"2023-07-14T15:58:07.734521+0000","last_became_peered":"2023-07-14T15:58:07.734521+0000","last_unstale":"2023-07-14T15:58:09.721784+0000","last_undegraded":"2023-07-14T15:58:09.721784+0000","last_fullsized":"2023-07-14T15:58:09.721784+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:53:32.760685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.720086+0000","last_change":"2023-07-14T15:58:08.736978+0000","last_active":"2023-07-14T15:58:09.720086+0000","last_peered":"2023-07-14T15:58:09.720086+0000","last_clean":"2023-07-14T15:58:09.720086+0000","last_became_active":"2023-07-14T15:58:08.736679+0000","last_became_peered":"2023-07-14T15:58:08.736679+0000","last_unstale":"2023-07-14T15:58:09.720086+0000","last_undegraded":"2023-07-14T15:58:09.720086+0000","last_fullsized":"2023-07-14T15:58:09.720086+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:00:53.470860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"48'1","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.719823+0000","last_change":"2023-07-14T15:58:07.730993+0000","last_active":"2023-07-14T15:58:09.719823+0000","last_peered":"2023-07-14T15:58:09.719823+0000","last_clean":"2023-07-14T15:58:09.719823+0000","last_became_active":"2023-07-14T15:58:07.730720+0000","last_became_peered":"2023-07-14T15:58:07.730720+0000","last_unstale":"2023-07-14T15:58:09.719823+0000","last_undegraded":"2023-07-14T15:58:09.719823+0000","last_fullsized":"2023-07-14T15:58:09.719823+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:59:05.167230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.719443+0000","last_change":"2023-07-14T15:58:08.739925+0000","last_active":"2023-07-14T15:58:09.719443+0000","last_peered":"2023-07-14T15:58:09.719443+0000","last_clean":"2023-07-14T15:58:09.719443+0000","last_became_active":"2023-07-14T15:58:08.737667+0000","last_became_peered":"2023-07-14T15:58:08.737667+0000","last_unstale":"2023-07-14T15:58:09.719443+0000","last_undegraded":"2023-07-14T15:58:09.719443+0000","last_fullsized":"2023-07-14T15:58:09.719443+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:35:39.872451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.719622+0000","last_change":"2023-07-14T15:58:07.731842+0000","last_active":"2023-07-14T15:58:09.719622+0000","last_peered":"2023-07-14T15:58:09.719622+0000","last_clean":"2023-07-14T15:58:09.719622+0000","last_became_active":"2023-07-14T15:58:07.731549+0000","last_became_peered":"2023-07-14T15:58:07.731549+0000","last_unstale":"2023-07-14T15:58:09.719622+0000","last_undegraded":"2023-07-14T15:58:09.719622+0000","last_fullsized":"2023-07-14T15:58:09.719622+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:14:46.719426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.168035+0000","last_change":"2023-07-14T15:58:08.743009+0000","last_active":"2023-07-14T15:58:10.168035+0000","last_peered":"2023-07-14T15:58:10.168035+0000","last_clean":"2023-07-14T15:58:10.168035+0000","last_became_active":"2023-07-14T15:58:08.742750+0000","last_became_peered":"2023-07-14T15:58:08.742750+0000","last_unstale":"2023-07-14T15:58:10.168035+0000","last_undegraded":"2023-07-14T15:58:10.168035+0000","last_fullsized":"2023-07-14T15:58:10.168035+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:11:50.083029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.720955+0000","last_change":"2023-07-14T15:58:07.728189+0000","last_active":"2023-07-14T15:58:09.720955+0000","last_peered":"2023-07-14T15:58:09.720955+0000","last_clean":"2023-07-14T15:58:09.720955+0000","last_became_active":"2023-07-14T15:58:07.727897+0000","last_became_peered":"2023-07-14T15:58:07.727897+0000","last_unstale":"2023-07-14T15:58:09.720955+0000","last_undegraded":"2023-07-14T15:58:09.720955+0000","last_fullsized":"2023-07-14T15:58:09.720955+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:13:56.583860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.510577+0000","last_change":"2023-07-14T15:58:08.731665+0000","last_active":"2023-07-14T15:58:10.510577+0000","last_peered":"2023-07-14T15:58:10.510577+0000","last_clean":"2023-07-14T15:58:10.510577+0000","last_became_active":"2023-07-14T15:58:08.731371+0000","last_became_peered":"2023-07-14T15:58:08.731371+0000","last_unstale":"2023-07-14T15:58:10.510577+0000","last_undegraded":"2023-07-14T15:58:10.510577+0000","last_fullsized":"2023-07-14T15:58:10.510577+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:38:05.211272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.168035+0000","last_change":"2023-07-14T15:58:07.728755+0000","last_active":"2023-07-14T15:58:10.168035+0000","last_peered":"2023-07-14T15:58:10.168035+0000","last_clean":"2023-07-14T15:58:10.168035+0000","last_became_active":"2023-07-14T15:58:07.728401+0000","last_became_peered":"2023-07-14T15:58:07.728401+0000","last_unstale":"2023-07-14T15:58:10.168035+0000","last_undegraded":"2023-07-14T15:58:10.168035+0000","last_fullsized":"2023-07-14T15:58:10.168035+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:52:41.611985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167935+0000","last_change":"2023-07-14T15:58:08.737207+0000","last_active":"2023-07-14T15:58:10.167935+0000","last_peered":"2023-07-14T15:58:10.167935+0000","last_clean":"2023-07-14T15:58:10.167935+0000","last_became_active":"2023-07-14T15:58:08.736904+0000","last_became_peered":"2023-07-14T15:58:08.736904+0000","last_unstale":"2023-07-14T15:58:10.167935+0000","last_undegraded":"2023-07-14T15:58:10.167935+0000","last_fullsized":"2023-07-14T15:58:10.167935+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:11:51.639080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167883+0000","last_change":"2023-07-14T15:58:07.733957+0000","last_active":"2023-07-14T15:58:10.167883+0000","last_peered":"2023-07-14T15:58:10.167883+0000","last_clean":"2023-07-14T15:58:10.167883+0000","last_became_active":"2023-07-14T15:58:07.733635+0000","last_became_peered":"2023-07-14T15:58:07.733635+0000","last_unstale":"2023-07-14T15:58:10.167883+0000","last_undegraded":"2023-07-14T15:58:10.167883+0000","last_fullsized":"2023-07-14T15:58:10.167883+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:26:47.764384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.248658+0000","last_change":"2023-07-14T15:58:08.743461+0000","last_active":"2023-07-14T15:58:10.248658+0000","last_peered":"2023-07-14T15:58:10.248658+0000","last_clean":"2023-07-14T15:58:10.248658+0000","last_became_active":"2023-07-14T15:58:08.743075+0000","last_became_peered":"2023-07-14T15:58:08.743075+0000","last_unstale":"2023-07-14T15:58:10.248658+0000","last_undegraded":"2023-07-14T15:58:10.248658+0000","last_fullsized":"2023-07-14T15:58:10.248658+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:37:43.533403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.15","version":"48'3","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.720179+0000","last_change":"2023-07-14T15:58:07.736023+0000","last_active":"2023-07-14T15:58:09.720179+0000","last_peered":"2023-07-14T15:58:09.720179+0000","last_clean":"2023-07-14T15:58:09.720179+0000","last_became_active":"2023-07-14T15:58:07.735713+0000","last_became_peered":"2023-07-14T15:58:07.735713+0000","last_unstale":"2023-07-14T15:58:09.720179+0000","last_undegraded":"2023-07-14T15:58:09.720179+0000","last_fullsized":"2023-07-14T15:58:09.720179+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:30:31.650310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.511358+0000","last_change":"2023-07-14T15:58:08.732253+0000","last_active":"2023-07-14T15:58:10.511358+0000","last_peered":"2023-07-14T15:58:10.511358+0000","last_clean":"2023-07-14T15:58:10.511358+0000","last_became_active":"2023-07-14T15:58:08.731924+0000","last_became_peered":"2023-07-14T15:58:08.731924+0000","last_unstale":"2023-07-14T15:58:10.511358+0000","last_undegraded":"2023-07-14T15:58:10.511358+0000","last_fullsized":"2023-07-14T15:58:10.511358+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:57:49.081908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"48'6","reported_seq":19,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.719815+0000","last_change":"2023-07-14T15:58:07.742068+0000","last_active":"2023-07-14T15:58:09.719815+0000","last_peered":"2023-07-14T15:58:09.719815+0000","last_clean":"2023-07-14T15:58:09.719815+0000","last_became_active":"2023-07-14T15:58:07.741718+0000","last_became_peered":"2023-07-14T15:58:07.741718+0000","last_unstale":"2023-07-14T15:58:09.719815+0000","last_undegraded":"2023-07-14T15:58:09.719815+0000","last_fullsized":"2023-07-14T15:58:09.719815+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:52:53.832447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.720010+0000","last_change":"2023-07-14T15:58:08.736941+0000","last_active":"2023-07-14T15:58:09.720010+0000","last_peered":"2023-07-14T15:58:09.720010+0000","last_clean":"2023-07-14T15:58:09.720010+0000","last_became_active":"2023-07-14T15:58:08.736565+0000","last_became_peered":"2023-07-14T15:58:08.736565+0000","last_unstale":"2023-07-14T15:58:09.720010+0000","last_undegraded":"2023-07-14T15:58:09.720010+0000","last_fullsized":"2023-07-14T15:58:09.720010+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:40:23.111433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"48'2","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.911521+0000","last_change":"2023-07-14T15:58:07.735958+0000","last_active":"2023-07-14T15:58:09.911521+0000","last_peered":"2023-07-14T15:58:09.911521+0000","last_clean":"2023-07-14T15:58:09.911521+0000","last_became_active":"2023-07-14T15:58:07.735649+0000","last_became_peered":"2023-07-14T15:58:07.735649+0000","last_unstale":"2023-07-14T15:58:09.911521+0000","last_undegraded":"2023-07-14T15:58:09.911521+0000","last_fullsized":"2023-07-14T15:58:09.911521+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:17:59.455151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.249076+0000","last_change":"2023-07-14T15:58:08.741837+0000","last_active":"2023-07-14T15:58:10.249076+0000","last_peered":"2023-07-14T15:58:10.249076+0000","last_clean":"2023-07-14T15:58:10.249076+0000","last_became_active":"2023-07-14T15:58:08.741224+0000","last_became_peered":"2023-07-14T15:58:08.741224+0000","last_unstale":"2023-07-14T15:58:10.249076+0000","last_undegraded":"2023-07-14T15:58:10.249076+0000","last_fullsized":"2023-07-14T15:58:10.249076+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:18:49.473467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167804+0000","last_change":"2023-07-14T15:58:07.734306+0000","last_active":"2023-07-14T15:58:10.167804+0000","last_peered":"2023-07-14T15:58:10.167804+0000","last_clean":"2023-07-14T15:58:10.167804+0000","last_became_active":"2023-07-14T15:58:07.733956+0000","last_became_peered":"2023-07-14T15:58:07.733956+0000","last_unstale":"2023-07-14T15:58:10.167804+0000","last_undegraded":"2023-07-14T15:58:10.167804+0000","last_fullsized":"2023-07-14T15:58:10.167804+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:32:13.169004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.911245+0000","last_change":"2023-07-14T15:58:08.731841+0000","last_active":"2023-07-14T15:58:09.911245+0000","last_peered":"2023-07-14T15:58:09.911245+0000","last_clean":"2023-07-14T15:58:09.911245+0000","last_became_active":"2023-07-14T15:58:08.731513+0000","last_became_peered":"2023-07-14T15:58:08.731513+0000","last_unstale":"2023-07-14T15:58:09.911245+0000","last_undegraded":"2023-07-14T15:58:09.911245+0000","last_fullsized":"2023-07-14T15:58:09.911245+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:38:58.679622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.511198+0000","last_change":"2023-07-14T15:58:07.728853+0000","last_active":"2023-07-14T15:58:10.511198+0000","last_peered":"2023-07-14T15:58:10.511198+0000","last_clean":"2023-07-14T15:58:10.511198+0000","last_became_active":"2023-07-14T15:58:07.728594+0000","last_became_peered":"2023-07-14T15:58:07.728594+0000","last_unstale":"2023-07-14T15:58:10.511198+0000","last_undegraded":"2023-07-14T15:58:10.511198+0000","last_fullsized":"2023-07-14T15:58:10.511198+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:34:18.438758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.721769+0000","last_change":"2023-07-14T15:58:08.739622+0000","last_active":"2023-07-14T15:58:09.721769+0000","last_peered":"2023-07-14T15:58:09.721769+0000","last_clean":"2023-07-14T15:58:09.721769+0000","last_became_active":"2023-07-14T15:58:08.739352+0000","last_became_peered":"2023-07-14T15:58:08.739352+0000","last_unstale":"2023-07-14T15:58:09.721769+0000","last_undegraded":"2023-07-14T15:58:09.721769+0000","last_fullsized":"2023-07-14T15:58:09.721769+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:15:25.859416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"48'8","reported_seq":21,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.911341+0000","last_change":"2023-07-14T15:58:07.734654+0000","last_active":"2023-07-14T15:58:09.911341+0000","last_peered":"2023-07-14T15:58:09.911341+0000","last_clean":"2023-07-14T15:58:09.911341+0000","last_became_active":"2023-07-14T15:58:07.734360+0000","last_became_peered":"2023-07-14T15:58:07.734360+0000","last_unstale":"2023-07-14T15:58:09.911341+0000","last_undegraded":"2023-07-14T15:58:09.911341+0000","last_fullsized":"2023-07-14T15:58:09.911341+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:29:48.437581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.719544+0000","last_change":"2023-07-14T15:58:08.736111+0000","last_active":"2023-07-14T15:58:09.719544+0000","last_peered":"2023-07-14T15:58:09.719544+0000","last_clean":"2023-07-14T15:58:09.719544+0000","last_became_active":"2023-07-14T15:58:08.735822+0000","last_became_peered":"2023-07-14T15:58:08.735822+0000","last_unstale":"2023-07-14T15:58:09.719544+0000","last_undegraded":"2023-07-14T15:58:09.719544+0000","last_fullsized":"2023-07-14T15:58:09.719544+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:29:49.440576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"48'1","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.911730+0000","last_change":"2023-07-14T15:58:07.736644+0000","last_active":"2023-07-14T15:58:09.911730+0000","last_peered":"2023-07-14T15:58:09.911730+0000","last_clean":"2023-07-14T15:58:09.911730+0000","last_became_active":"2023-07-14T15:58:07.736358+0000","last_became_peered":"2023-07-14T15:58:07.736358+0000","last_unstale":"2023-07-14T15:58:09.911730+0000","last_undegraded":"2023-07-14T15:58:09.911730+0000","last_fullsized":"2023-07-14T15:58:09.911730+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:11:08.963759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.248655+0000","last_change":"2023-07-14T15:58:08.735289+0000","last_active":"2023-07-14T15:58:10.248655+0000","last_peered":"2023-07-14T15:58:10.248655+0000","last_clean":"2023-07-14T15:58:10.248655+0000","last_became_active":"2023-07-14T15:58:08.734993+0000","last_became_peered":"2023-07-14T15:58:08.734993+0000","last_unstale":"2023-07-14T15:58:10.248655+0000","last_undegraded":"2023-07-14T15:58:10.248655+0000","last_fullsized":"2023-07-14T15:58:10.248655+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:26:31.914734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"48'2","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.911510+0000","last_change":"2023-07-14T15:58:07.734503+0000","last_active":"2023-07-14T15:58:09.911510+0000","last_peered":"2023-07-14T15:58:09.911510+0000","last_clean":"2023-07-14T15:58:09.911510+0000","last_became_active":"2023-07-14T15:58:07.734137+0000","last_became_peered":"2023-07-14T15:58:07.734137+0000","last_unstale":"2023-07-14T15:58:09.911510+0000","last_undegraded":"2023-07-14T15:58:09.911510+0000","last_fullsized":"2023-07-14T15:58:09.911510+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:01:42.004665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.511233+0000","last_change":"2023-07-14T15:58:08.723001+0000","last_active":"2023-07-14T15:58:10.511233+0000","last_peered":"2023-07-14T15:58:10.511233+0000","last_clean":"2023-07-14T15:58:10.511233+0000","last_became_active":"2023-07-14T15:58:08.722673+0000","last_became_peered":"2023-07-14T15:58:08.722673+0000","last_unstale":"2023-07-14T15:58:10.511233+0000","last_undegraded":"2023-07-14T15:58:10.511233+0000","last_fullsized":"2023-07-14T15:58:10.511233+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:20:11.481399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"48'1","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167821+0000","last_change":"2023-07-14T15:58:07.725878+0000","last_active":"2023-07-14T15:58:10.167821+0000","last_peered":"2023-07-14T15:58:10.167821+0000","last_clean":"2023-07-14T15:58:10.167821+0000","last_became_active":"2023-07-14T15:58:07.725549+0000","last_became_peered":"2023-07-14T15:58:07.725549+0000","last_unstale":"2023-07-14T15:58:10.167821+0000","last_undegraded":"2023-07-14T15:58:10.167821+0000","last_fullsized":"2023-07-14T15:58:10.167821+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:22:14.282584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.911416+0000","last_change":"2023-07-14T15:58:08.731902+0000","last_active":"2023-07-14T15:58:09.911416+0000","last_peered":"2023-07-14T15:58:09.911416+0000","last_clean":"2023-07-14T15:58:09.911416+0000","last_became_active":"2023-07-14T15:58:08.731573+0000","last_became_peered":"2023-07-14T15:58:08.731573+0000","last_unstale":"2023-07-14T15:58:09.911416+0000","last_undegraded":"2023-07-14T15:58:09.911416+0000","last_fullsized":"2023-07-14T15:58:09.911416+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:17:56.741403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.511808+0000","last_change":"2023-07-14T15:58:07.736136+0000","last_active":"2023-07-14T15:58:10.511808+0000","last_peered":"2023-07-14T15:58:10.511808+0000","last_clean":"2023-07-14T15:58:10.511808+0000","last_became_active":"2023-07-14T15:58:07.735841+0000","last_became_peered":"2023-07-14T15:58:07.735841+0000","last_unstale":"2023-07-14T15:58:10.511808+0000","last_undegraded":"2023-07-14T15:58:10.511808+0000","last_fullsized":"2023-07-14T15:58:10.511808+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:36:18.704813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.511490+0000","last_change":"2023-07-14T15:58:08.735840+0000","last_active":"2023-07-14T15:58:10.511490+0000","last_peered":"2023-07-14T15:58:10.511490+0000","last_clean":"2023-07-14T15:58:10.511490+0000","last_became_active":"2023-07-14T15:58:08.735526+0000","last_became_peered":"2023-07-14T15:58:08.735526+0000","last_unstale":"2023-07-14T15:58:10.511490+0000","last_undegraded":"2023-07-14T15:58:10.511490+0000","last_fullsized":"2023-07-14T15:58:10.511490+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:28:18.956176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"48'2","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.248871+0000","last_change":"2023-07-14T15:58:07.731047+0000","last_active":"2023-07-14T15:58:10.248871+0000","last_peered":"2023-07-14T15:58:10.248871+0000","last_clean":"2023-07-14T15:58:10.248871+0000","last_became_active":"2023-07-14T15:58:07.730760+0000","last_became_peered":"2023-07-14T15:58:07.730760+0000","last_unstale":"2023-07-14T15:58:10.248871+0000","last_undegraded":"2023-07-14T15:58:10.248871+0000","last_fullsized":"2023-07-14T15:58:10.248871+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:54:17.765585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167946+0000","last_change":"2023-07-14T15:58:08.738893+0000","last_active":"2023-07-14T15:58:10.167946+0000","last_peered":"2023-07-14T15:58:10.167946+0000","last_clean":"2023-07-14T15:58:10.167946+0000","last_became_active":"2023-07-14T15:58:08.738584+0000","last_became_peered":"2023-07-14T15:58:08.738584+0000","last_unstale":"2023-07-14T15:58:10.167946+0000","last_undegraded":"2023-07-14T15:58:10.167946+0000","last_fullsized":"2023-07-14T15:58:10.167946+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:32:48.130235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.721306+0000","last_change":"2023-07-14T15:58:07.732320+0000","last_active":"2023-07-14T15:58:09.721306+0000","last_peered":"2023-07-14T15:58:09.721306+0000","last_clean":"2023-07-14T15:58:09.721306+0000","last_became_active":"2023-07-14T15:58:07.732044+0000","last_became_peered":"2023-07-14T15:58:07.732044+0000","last_unstale":"2023-07-14T15:58:09.721306+0000","last_undegraded":"2023-07-14T15:58:09.721306+0000","last_fullsized":"2023-07-14T15:58:09.721306+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:00:30.483880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.248814+0000","last_change":"2023-07-14T15:58:08.743134+0000","last_active":"2023-07-14T15:58:10.248814+0000","last_peered":"2023-07-14T15:58:10.248814+0000","last_clean":"2023-07-14T15:58:10.248814+0000","last_became_active":"2023-07-14T15:58:08.742797+0000","last_became_peered":"2023-07-14T15:58:08.742797+0000","last_unstale":"2023-07-14T15:58:10.248814+0000","last_undegraded":"2023-07-14T15:58:10.248814+0000","last_fullsized":"2023-07-14T15:58:10.248814+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:08:36.025877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.719224+0000","last_change":"2023-07-14T15:58:07.733527+0000","last_active":"2023-07-14T15:58:09.719224+0000","last_peered":"2023-07-14T15:58:09.719224+0000","last_clean":"2023-07-14T15:58:09.719224+0000","last_became_active":"2023-07-14T15:58:07.733219+0000","last_became_peered":"2023-07-14T15:58:07.733219+0000","last_unstale":"2023-07-14T15:58:09.719224+0000","last_undegraded":"2023-07-14T15:58:09.719224+0000","last_fullsized":"2023-07-14T15:58:09.719224+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:43:08.016378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.911708+0000","last_change":"2023-07-14T15:58:08.729550+0000","last_active":"2023-07-14T15:58:09.911708+0000","last_peered":"2023-07-14T15:58:09.911708+0000","last_clean":"2023-07-14T15:58:09.911708+0000","last_became_active":"2023-07-14T15:58:08.729192+0000","last_became_peered":"2023-07-14T15:58:08.729192+0000","last_unstale":"2023-07-14T15:58:09.911708+0000","last_undegraded":"2023-07-14T15:58:09.911708+0000","last_fullsized":"2023-07-14T15:58:09.911708+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:34:44.918977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.719153+0000","last_change":"2023-07-14T15:58:07.731843+0000","last_active":"2023-07-14T15:58:09.719153+0000","last_peered":"2023-07-14T15:58:09.719153+0000","last_clean":"2023-07-14T15:58:09.719153+0000","last_became_active":"2023-07-14T15:58:07.731548+0000","last_became_peered":"2023-07-14T15:58:07.731548+0000","last_unstale":"2023-07-14T15:58:09.719153+0000","last_undegraded":"2023-07-14T15:58:09.719153+0000","last_fullsized":"2023-07-14T15:58:09.719153+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:40:29.622905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.719657+0000","last_change":"2023-07-14T15:58:08.737720+0000","last_active":"2023-07-14T15:58:09.719657+0000","last_peered":"2023-07-14T15:58:09.719657+0000","last_clean":"2023-07-14T15:58:09.719657+0000","last_became_active":"2023-07-14T15:58:08.737165+0000","last_became_peered":"2023-07-14T15:58:08.737165+0000","last_unstale":"2023-07-14T15:58:09.719657+0000","last_undegraded":"2023-07-14T15:58:09.719657+0000","last_fullsized":"2023-07-14T15:58:09.719657+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:18:00.458145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.511325+0000","last_change":"2023-07-14T15:58:07.728047+0000","last_active":"2023-07-14T15:58:10.511325+0000","last_peered":"2023-07-14T15:58:10.511325+0000","last_clean":"2023-07-14T15:58:10.511325+0000","last_became_active":"2023-07-14T15:58:07.727789+0000","last_became_peered":"2023-07-14T15:58:07.727789+0000","last_unstale":"2023-07-14T15:58:10.511325+0000","last_undegraded":"2023-07-14T15:58:10.511325+0000","last_fullsized":"2023-07-14T15:58:10.511325+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:04:44.440538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.719873+0000","last_change":"2023-07-14T15:56:02.621850+0000","last_active":"2023-07-14T15:58:09.719873+0000","last_peered":"2023-07-14T15:58:09.719873+0000","last_clean":"2023-07-14T15:58:09.719873+0000","last_became_active":"2023-07-14T15:56:02.621471+0000","last_became_peered":"2023-07-14T15:56:02.621471+0000","last_unstale":"2023-07-14T15:58:09.719873+0000","last_undegraded":"2023-07-14T15:58:09.719873+0000","last_fullsized":"2023-07-14T15:58:09.719873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:09:03.169593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167727+0000","last_change":"2023-07-14T15:58:08.735834+0000","last_active":"2023-07-14T15:58:10.167727+0000","last_peered":"2023-07-14T15:58:10.167727+0000","last_clean":"2023-07-14T15:58:10.167727+0000","last_became_active":"2023-07-14T15:58:08.735483+0000","last_became_peered":"2023-07-14T15:58:08.735483+0000","last_unstale":"2023-07-14T15:58:10.167727+0000","last_undegraded":"2023-07-14T15:58:10.167727+0000","last_fullsized":"2023-07-14T15:58:10.167727+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:24:16.022757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"48'2","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.720016+0000","last_change":"2023-07-14T15:58:07.732308+0000","last_active":"2023-07-14T15:58:09.720016+0000","last_peered":"2023-07-14T15:58:09.720016+0000","last_clean":"2023-07-14T15:58:09.720016+0000","last_became_active":"2023-07-14T15:58:07.732001+0000","last_became_peered":"2023-07-14T15:58:07.732001+0000","last_unstale":"2023-07-14T15:58:09.720016+0000","last_undegraded":"2023-07-14T15:58:09.720016+0000","last_fullsized":"2023-07-14T15:58:09.720016+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:00:20.751111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":68,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.719963+0000","last_change":"2023-07-14T15:56:02.621963+0000","last_active":"2023-07-14T15:58:09.719963+0000","last_peered":"2023-07-14T15:58:09.719963+0000","last_clean":"2023-07-14T15:58:09.719963+0000","last_became_active":"2023-07-14T15:56:02.621678+0000","last_became_peered":"2023-07-14T15:56:02.621678+0000","last_unstale":"2023-07-14T15:58:09.719963+0000","last_undegraded":"2023-07-14T15:58:09.719963+0000","last_fullsized":"2023-07-14T15:58:09.719963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:05:12.975493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.721712+0000","last_change":"2023-07-14T15:58:08.732988+0000","last_active":"2023-07-14T15:58:09.721712+0000","last_peered":"2023-07-14T15:58:09.721712+0000","last_clean":"2023-07-14T15:58:09.721712+0000","last_became_active":"2023-07-14T15:58:08.732713+0000","last_became_peered":"2023-07-14T15:58:08.732713+0000","last_unstale":"2023-07-14T15:58:09.721712+0000","last_undegraded":"2023-07-14T15:58:09.721712+0000","last_fullsized":"2023-07-14T15:58:09.721712+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:50:49.909750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.721620+0000","last_change":"2023-07-14T15:58:07.729039+0000","last_active":"2023-07-14T15:58:09.721620+0000","last_peered":"2023-07-14T15:58:09.721620+0000","last_clean":"2023-07-14T15:58:09.721620+0000","last_became_active":"2023-07-14T15:58:07.728779+0000","last_became_peered":"2023-07-14T15:58:07.728779+0000","last_unstale":"2023-07-14T15:58:09.721620+0000","last_undegraded":"2023-07-14T15:58:09.721620+0000","last_fullsized":"2023-07-14T15:58:09.721620+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:09:40.024162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":60,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.911043+0000","last_change":"2023-07-14T15:56:01.925110+0000","last_active":"2023-07-14T15:58:09.911043+0000","last_peered":"2023-07-14T15:58:09.911043+0000","last_clean":"2023-07-14T15:58:09.911043+0000","last_became_active":"2023-07-14T15:56:01.924723+0000","last_became_peered":"2023-07-14T15:56:01.924723+0000","last_unstale":"2023-07-14T15:58:09.911043+0000","last_undegraded":"2023-07-14T15:58:09.911043+0000","last_fullsized":"2023-07-14T15:58:09.911043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:50:35.501921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.510688+0000","last_change":"2023-07-14T15:58:08.730413+0000","last_active":"2023-07-14T15:58:10.510688+0000","last_peered":"2023-07-14T15:58:10.510688+0000","last_clean":"2023-07-14T15:58:10.510688+0000","last_became_active":"2023-07-14T15:58:08.730120+0000","last_became_peered":"2023-07-14T15:58:08.730120+0000","last_unstale":"2023-07-14T15:58:10.510688+0000","last_undegraded":"2023-07-14T15:58:10.510688+0000","last_fullsized":"2023-07-14T15:58:10.510688+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:18:23.335452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"49'1","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.719869+0000","last_change":"2023-07-14T15:58:07.734443+0000","last_active":"2023-07-14T15:58:09.719869+0000","last_peered":"2023-07-14T15:58:09.719869+0000","last_clean":"2023-07-14T15:58:09.719869+0000","last_became_active":"2023-07-14T15:58:07.734185+0000","last_became_peered":"2023-07-14T15:58:07.734185+0000","last_unstale":"2023-07-14T15:58:09.719869+0000","last_undegraded":"2023-07-14T15:58:09.719869+0000","last_fullsized":"2023-07-14T15:58:09.719869+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:34:43.915982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":68,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.719936+0000","last_change":"2023-07-14T15:56:01.923465+0000","last_active":"2023-07-14T15:58:09.719936+0000","last_peered":"2023-07-14T15:58:09.719936+0000","last_clean":"2023-07-14T15:58:09.719936+0000","last_became_active":"2023-07-14T15:56:01.923160+0000","last_became_peered":"2023-07-14T15:56:01.923160+0000","last_unstale":"2023-07-14T15:58:09.719936+0000","last_undegraded":"2023-07-14T15:58:09.719936+0000","last_fullsized":"2023-07-14T15:58:09.719936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:59:22.428045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":210,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167486+0000","last_change":"2023-07-14T15:55:54.040065+0000","last_active":"2023-07-14T15:58:10.167486+0000","last_peered":"2023-07-14T15:58:10.167486+0000","last_clean":"2023-07-14T15:58:10.167486+0000","last_became_active":"2023-07-14T15:55:54.038885+0000","last_became_peered":"2023-07-14T15:55:54.038885+0000","last_unstale":"2023-07-14T15:58:10.167486+0000","last_undegraded":"2023-07-14T15:58:10.167486+0000","last_fullsized":"2023-07-14T15:58:10.167486+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:55:53.025696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:55:53.025696+0000","last_clean_scrub_stamp":"2023-07-14T15:55:53.025696+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:02:02.551339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.719307+0000","last_change":"2023-07-14T15:58:08.736125+0000","last_active":"2023-07-14T15:58:09.719307+0000","last_peered":"2023-07-14T15:58:09.719307+0000","last_clean":"2023-07-14T15:58:09.719307+0000","last_became_active":"2023-07-14T15:58:08.735774+0000","last_became_peered":"2023-07-14T15:58:08.735774+0000","last_unstale":"2023-07-14T15:58:09.719307+0000","last_undegraded":"2023-07-14T15:58:09.719307+0000","last_fullsized":"2023-07-14T15:58:09.719307+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:24:42.998893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.720213+0000","last_change":"2023-07-14T15:58:07.736838+0000","last_active":"2023-07-14T15:58:09.720213+0000","last_peered":"2023-07-14T15:58:09.720213+0000","last_clean":"2023-07-14T15:58:09.720213+0000","last_became_active":"2023-07-14T15:58:07.735691+0000","last_became_peered":"2023-07-14T15:58:07.735691+0000","last_unstale":"2023-07-14T15:58:09.720213+0000","last_undegraded":"2023-07-14T15:58:09.720213+0000","last_fullsized":"2023-07-14T15:58:09.720213+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:11:00.437830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":68,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.719707+0000","last_change":"2023-07-14T15:56:01.920714+0000","last_active":"2023-07-14T15:58:09.719707+0000","last_peered":"2023-07-14T15:58:09.719707+0000","last_clean":"2023-07-14T15:58:09.719707+0000","last_became_active":"2023-07-14T15:56:01.920325+0000","last_became_peered":"2023-07-14T15:56:01.920325+0000","last_unstale":"2023-07-14T15:58:09.719707+0000","last_undegraded":"2023-07-14T15:58:09.719707+0000","last_fullsized":"2023-07-14T15:58:09.719707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:38:02.085831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.911645+0000","last_change":"2023-07-14T15:58:08.735014+0000","last_active":"2023-07-14T15:58:09.911645+0000","last_peered":"2023-07-14T15:58:09.911645+0000","last_clean":"2023-07-14T15:58:09.911645+0000","last_became_active":"2023-07-14T15:58:08.733335+0000","last_became_peered":"2023-07-14T15:58:08.733335+0000","last_unstale":"2023-07-14T15:58:09.911645+0000","last_undegraded":"2023-07-14T15:58:09.911645+0000","last_fullsized":"2023-07-14T15:58:09.911645+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:52:54.835442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.167704+0000","last_change":"2023-07-14T15:58:07.736616+0000","last_active":"2023-07-14T15:58:10.167704+0000","last_peered":"2023-07-14T15:58:10.167704+0000","last_clean":"2023-07-14T15:58:10.167704+0000","last_became_active":"2023-07-14T15:58:07.736315+0000","last_became_peered":"2023-07-14T15:58:07.736315+0000","last_unstale":"2023-07-14T15:58:10.167704+0000","last_undegraded":"2023-07-14T15:58:10.167704+0000","last_fullsized":"2023-07-14T15:58:10.167704+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:23:07.012317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":68,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.720300+0000","last_change":"2023-07-14T15:56:01.923631+0000","last_active":"2023-07-14T15:58:09.720300+0000","last_peered":"2023-07-14T15:58:09.720300+0000","last_clean":"2023-07-14T15:58:09.720300+0000","last_became_active":"2023-07-14T15:56:01.922783+0000","last_became_peered":"2023-07-14T15:56:01.922783+0000","last_unstale":"2023-07-14T15:58:09.720300+0000","last_undegraded":"2023-07-14T15:58:09.720300+0000","last_fullsized":"2023-07-14T15:58:09.720300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:03:05.448312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.719758+0000","last_change":"2023-07-14T15:58:08.730935+0000","last_active":"2023-07-14T15:58:09.719758+0000","last_peered":"2023-07-14T15:58:09.719758+0000","last_clean":"2023-07-14T15:58:09.719758+0000","last_became_active":"2023-07-14T15:58:08.730640+0000","last_became_peered":"2023-07-14T15:58:08.730640+0000","last_unstale":"2023-07-14T15:58:09.719758+0000","last_undegraded":"2023-07-14T15:58:09.719758+0000","last_fullsized":"2023-07-14T15:58:09.719758+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:01:43.007660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.719496+0000","last_change":"2023-07-14T15:58:07.734768+0000","last_active":"2023-07-14T15:58:09.719496+0000","last_peered":"2023-07-14T15:58:09.719496+0000","last_clean":"2023-07-14T15:58:09.719496+0000","last_became_active":"2023-07-14T15:58:07.734498+0000","last_became_peered":"2023-07-14T15:58:07.734498+0000","last_unstale":"2023-07-14T15:58:09.719496+0000","last_undegraded":"2023-07-14T15:58:09.719496+0000","last_fullsized":"2023-07-14T15:58:09.719496+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:33:42.843397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":60,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.721702+0000","last_change":"2023-07-14T15:56:01.965649+0000","last_active":"2023-07-14T15:58:09.721702+0000","last_peered":"2023-07-14T15:58:09.721702+0000","last_clean":"2023-07-14T15:58:09.721702+0000","last_became_active":"2023-07-14T15:56:01.965344+0000","last_became_peered":"2023-07-14T15:56:01.965344+0000","last_unstale":"2023-07-14T15:58:09.721702+0000","last_undegraded":"2023-07-14T15:58:09.721702+0000","last_fullsized":"2023-07-14T15:58:09.721702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:21:21.789908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:10.511344+0000","last_change":"2023-07-14T15:58:08.730629+0000","last_active":"2023-07-14T15:58:10.511344+0000","last_peered":"2023-07-14T15:58:10.511344+0000","last_clean":"2023-07-14T15:58:10.511344+0000","last_became_active":"2023-07-14T15:58:08.730333+0000","last_became_peered":"2023-07-14T15:58:08.730333+0000","last_unstale":"2023-07-14T15:58:10.511344+0000","last_undegraded":"2023-07-14T15:58:10.511344+0000","last_fullsized":"2023-07-14T15:58:10.511344+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:07.703703+0000","last_clean_scrub_stamp":"2023-07-14T15:58:07.703703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:03:03.027389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.721540+0000","last_change":"2023-07-14T15:58:07.730397+0000","last_active":"2023-07-14T15:58:09.721540+0000","last_peered":"2023-07-14T15:58:09.721540+0000","last_clean":"2023-07-14T15:58:09.721540+0000","last_became_active":"2023-07-14T15:58:07.729703+0000","last_became_peered":"2023-07-14T15:58:07.729703+0000","last_unstale":"2023-07-14T15:58:09.721540+0000","last_undegraded":"2023-07-14T15:58:09.721540+0000","last_fullsized":"2023-07-14T15:58:09.721540+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:06.700708+0000","last_clean_scrub_stamp":"2023-07-14T15:58:06.700708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:26:46.788380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":68,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-07-14T15:58:09.720144+0000","last_change":"2023-07-14T15:56:01.966578+0000","last_active":"2023-07-14T15:58:09.720144+0000","last_peered":"2023-07-14T15:58:09.720144+0000","last_clean":"2023-07-14T15:58:09.720144+0000","last_became_active":"2023-07-14T15:56:01.966216+0000","last_became_peered":"2023-07-14T15:56:01.966216+0000","last_unstale":"2023-07-14T15:58:09.720144+0000","last_undegraded":"2023-07-14T15:58:09.720144+0000","last_fullsized":"2023-07-14T15:58:09.720144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:37:59.644169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476768,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31604,"kb_used_data":556,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340236,"statfs":{"total":96636764160,"available":96604401664,"internally_reserved":0,"allocated":569344,"data_stored":242471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.44800000000000001,"15min":0.45000000000000001},"min":{"1min":0.29799999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.58999999999999997,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.438},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.46300000000000002,"15min":0.47299999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.57599999999999996,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.58799999999999997}]},{"osd":1,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.57799999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.52100000000000002,"15min":0.52300000000000002},"min":{"1min":0.38600000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.67500000000000004,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.69099999999999995}]},{"osd":2,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.504,"15min":0.505},"min":{"1min":0.40300000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.66700000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.74199999999999999,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.621}]},{"osd":4,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.755,"15min":0.76500000000000001},"min":{"1min":0.503,"5min":0.441,"15min":0.441},"max":{"1min":1.0189999999999999,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.76600000000000001,"15min":0.77400000000000002},"min":{"1min":0.53900000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.88400000000000001,"5min":1.542,"15min":1.542},"last":0.54700000000000004}]},{"osd":5,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.84199999999999997,"15min":0.85599999999999998},"min":{"1min":0.625,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.95299999999999996,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.84599999999999997,"15min":0.85699999999999998},"min":{"1min":0.60899999999999999,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.94599999999999995,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.74199999999999999}]},{"osd":6,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.80800000000000005,"15min":0.81899999999999995},"min":{"1min":0.55900000000000005,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.98799999999999999,"5min":1.52,"15min":1.52},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.79900000000000004,"15min":0.81200000000000006},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.86099999999999999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.64300000000000002}]},{"osd":7,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.77400000000000002,"15min":0.77700000000000002},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.96499999999999997,"5min":1.232,"15min":1.232},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.84299999999999997,"15min":0.85699999999999998},"min":{"1min":0.55500000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.94899999999999995,"5min":1.478,"15min":1.478},"last":0.65500000000000003}]}]},{"osd":0,"up_from":16,"seq":68719476769,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":556,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":569344,"data_stored":242963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42299999999999999,"15min":0.42399999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.67500000000000004,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.48499999999999999,"15min":0.48899999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.61599999999999999,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.46600000000000003}]},{"osd":2,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.499,"15min":0.5},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.442},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.50800000000000001,"15min":0.505},"min":{"1min":0.41499999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.497}]},{"osd":3,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47899999999999998,"15min":0.48099999999999998},"min":{"1min":0.38100000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.60699999999999998,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.57299999999999995,"15min":0.57699999999999996},"min":{"1min":0.42399999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76500000000000001,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.52300000000000002}]},{"osd":4,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.99399999999999999,"5min":1.04,"15min":1.04},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.78000000000000003,"15min":0.78900000000000003},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.91000000000000003,"5min":1.331,"15min":1.331},"last":0.72299999999999998}]},{"osd":5,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.60999999999999999,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.119,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.56999999999999995,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0289999999999999,"5min":1.087,"15min":1.087},"last":0.65100000000000002}]},{"osd":6,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.77500000000000002,"15min":0.78100000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0029999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.80100000000000005,"15min":0.80500000000000005},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.056,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.74299999999999999}]},{"osd":7,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.80100000000000005,"15min":0.80800000000000005},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.99399999999999999,"5min":1.262,"15min":1.262},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.79700000000000004,"15min":0.80100000000000005},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.97799999999999998,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.77500000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542175,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":556,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":569344,"data_stored":242963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.621,"15min":0.61699999999999999},"min":{"1min":0.40999999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.82399999999999995,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64700000000000002,"15min":0.64600000000000002},"min":{"1min":0.496,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81599999999999995,"5min":1.266,"15min":1.266},"last":0.60699999999999998}]},{"osd":1,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.69799999999999995,"15min":0.70299999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88700000000000001,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.72199999999999998,"15min":0.71699999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.86699999999999999}]},{"osd":2,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.88500000000000001,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.68600000000000005,"15min":0.69099999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.75600000000000001}]},{"osd":3,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.78200000000000003,"15min":0.80400000000000005},"min":{"1min":0.48099999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.85999999999999999,"5min":3.141,"15min":3.141},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.752,"15min":0.753},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.94999999999999996,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.68200000000000005}]},{"osd":4,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.63,"15min":0.63300000000000001},"min":{"1min":0.432,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.83499999999999996,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.70899999999999996,"15min":0.71199999999999997},"min":{"1min":0.47599999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.92300000000000004,"5min":1.024,"15min":1.024},"last":0.55100000000000005}]},{"osd":5,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.748,"15min":0.751},"min":{"1min":0.51700000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.96999999999999997,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73599999999999999,"15min":0.73999999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.012,"5min":1.091,"15min":1.091},"last":0.80200000000000005}]},{"osd":7,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.72499999999999998,"15min":0.72899999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.92500000000000004,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.82399999999999995,"15min":0.82899999999999996},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":0.996,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.83899999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542174,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":1136,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1163264,"data_stored":832819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.60699999999999998,"15min":0.64200000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.53100000000000003,"5min":4.5519999999999996,"15min":4.5519999999999996},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":1.147,"15min":1.2609999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.70899999999999996,"5min":15.911,"15min":15.911},"last":0.53500000000000003}]},{"osd":2,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.45700000000000002,"15min":0.46400000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.53300000000000003,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.436},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.67300000000000004,"15min":0.70599999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.57299999999999995,"5min":4.5140000000000002,"15min":4.5140000000000002},"last":0.55700000000000005}]},{"osd":3,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.70199999999999996,"15min":0.73599999999999999},"min":{"1min":0.378,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.65500000000000003,"5min":4.452,"15min":4.452},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.70299999999999996,"15min":0.73899999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.57999999999999996,"5min":4.2279999999999998,"15min":4.2279999999999998},"last":0.48599999999999999}]},{"osd":4,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.88400000000000001,"15min":0.92000000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.81899999999999995,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.92200000000000004,"15min":0.95999999999999996},"min":{"1min":0.52400000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.95699999999999996,"5min":4.9109999999999996,"15min":4.9109999999999996},"last":0.61099999999999999}]},{"osd":5,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.90000000000000002,"15min":0.93300000000000005},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.98999999999999999,"5min":4.1269999999999998,"15min":4.1269999999999998},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.93799999999999994,"15min":0.97399999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.93700000000000006,"5min":4.585,"15min":4.585},"last":0.67700000000000005}]},{"osd":6,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.93300000000000005,"15min":0.97099999999999997},"min":{"1min":0.56899999999999995,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0369999999999999,"5min":4.9880000000000004,"15min":4.9880000000000004},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.92900000000000005,"15min":0.96299999999999997},"min":{"1min":0.58499999999999996,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94599999999999995,"5min":4.1660000000000004,"15min":4.1660000000000004},"last":0.747}]},{"osd":7,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.98199999999999998,"15min":1.0249999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.0429999999999999,"5min":4.9530000000000003,"15min":4.9530000000000003},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.94599999999999995,"15min":0.98099999999999998},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.048,"5min":4.1959999999999997,"15min":4.1959999999999997},"last":0.79000000000000004}]}]},{"osd":2,"up_from":15,"seq":64424509472,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":556,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":569344,"data_stored":242415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.42699999999999999,"15min":0.433},"min":{"1min":0.32200000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.51900000000000002,"5min":0.62,"15min":0.62},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.47299999999999998,"15min":0.48299999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.57999999999999996,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.39600000000000002}]},{"osd":1,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.52400000000000002,"15min":0.53100000000000003},"min":{"1min":0.315,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76200000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.46899999999999997,"15min":0.47099999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.65100000000000002,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.43099999999999999}]},{"osd":3,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.58799999999999997,"15min":0.60199999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.63600000000000001,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.53200000000000003,"15min":0.53800000000000003},"min":{"1min":0.433,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.53700000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.48799999999999999}]},{"osd":4,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.72399999999999998,"15min":0.72799999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.169,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.74299999999999999,"15min":0.747},"min":{"1min":0.53300000000000003,"5min":0.437,"15min":0.437},"max":{"1min":0.90100000000000002,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.68899999999999995}]},{"osd":5,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.77300000000000002,"15min":0.78100000000000003},"min":{"1min":0.55700000000000005,"5min":0.505,"15min":0.505},"max":{"1min":1.002,"5min":1.391,"15min":1.391},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.75600000000000001,"15min":0.76200000000000001},"min":{"1min":0.50700000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.153,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.69999999999999996}]},{"osd":6,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.79000000000000004,"15min":0.80300000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0960000000000001,"5min":1.51,"15min":1.51},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.81599999999999995,"15min":0.82999999999999996},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1319999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.74299999999999999}]},{"osd":7,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.78300000000000003,"15min":0.79400000000000004},"min":{"1min":0.54700000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.048,"5min":1.288,"15min":1.288},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.81799999999999995,"15min":0.82799999999999996},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.72899999999999998}]}]},{"osd":4,"up_from":15,"seq":64424509471,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":572,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":585728,"data_stored":244037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.67700000000000005,"15min":0.68700000000000006},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.503},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.64700000000000002,"15min":0.65700000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88300000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.69699999999999995}]},{"osd":1,"last update":"Fri Jul 14 15:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.67000000000000004,"15min":0.67600000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.81999999999999995,"5min":0.87,"15min":0.87},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.65100000000000002,"15min":0.66000000000000003},"min":{"1min":0.44400000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.82899999999999996,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.47299999999999998}]},{"osd":2,"last update":"Fri Jul 14 15:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64400000000000002,"15min":0.65000000000000002},"min":{"1min":0.441,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.71599999999999997,"15min":0.72899999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.80900000000000005,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.52800000000000002}]},{"osd":3,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.68400000000000005,"15min":0.68799999999999994},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.86699999999999999,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.72799999999999998,"15min":0.73499999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.94299999999999995,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.65600000000000003}]},{"osd":5,"last update":"Fri Jul 14 15:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65900000000000003,"15min":0.66400000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.83499999999999996,"5min":1.119,"15min":1.119},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.70699999999999996,"15min":0.71599999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.88200000000000001,"5min":1.157,"15min":1.157},"last":0.60799999999999998}]},{"osd":6,"last update":"Fri Jul 14 15:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.70199999999999996,"15min":0.71399999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.86199999999999999,"5min":1.04,"15min":1.04},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.89800000000000002,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.80600000000000005}]},{"osd":7,"last update":"Fri Jul 14 15:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.755,"15min":0.76700000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93799999999999994,"5min":1.202,"15min":1.202},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.77900000000000003,"15min":0.79100000000000004},"min":{"1min":0.53900000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.92100000000000004,"5min":1.137,"15min":1.137},"last":0.85899999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509473,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28100,"kb_used_data":1148,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343740,"statfs":{"total":96636764160,"available":96607989760,"internally_reserved":0,"allocated":1175552,"data_stored":834403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.66400000000000003,"15min":0.67200000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.86099999999999999,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.97799999999999998,"15min":1.038},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.80600000000000005,"5min":8.1500000000000004,"15min":8.1500000000000004},"last":0.93700000000000006}]},{"osd":1,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.67200000000000004,"15min":0.67600000000000005},"min":{"1min":0.51200000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.98799999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.66400000000000003,"15min":0.67000000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.76800000000000002,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.82899999999999996}]},{"osd":2,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.75800000000000001,"15min":0.77100000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.873,"5min":1.085,"15min":1.085},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.72499999999999998,"15min":0.73699999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.86599999999999999,"5min":1.048,"15min":1.048},"last":0.84399999999999997}]},{"osd":3,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.69299999999999995,"15min":0.70099999999999996},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.82299999999999995,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.80000000000000004,"15min":0.81000000000000005},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":0.91700000000000004,"5min":1.083,"15min":1.083},"last":1.0009999999999999}]},{"osd":4,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68999999999999995,"15min":0.69199999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.62,"5min":0.65700000000000003,"15min":0.66300000000000003},"min":{"1min":0.441,"5min":0.438,"15min":0.438},"max":{"1min":0.82099999999999995,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.60799999999999998}]},{"osd":6,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.69899999999999995,"15min":0.71299999999999997},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.871,"5min":1.121,"15min":1.121},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.78700000000000003,"15min":0.80100000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.93799999999999994,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.64100000000000001}]},{"osd":7,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.74399999999999999,"15min":0.751},"min":{"1min":0.58199999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.875,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.81699999999999995,"15min":0.83099999999999996},"min":{"1min":0.53800000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.94699999999999995,"5min":1.605,"15min":1.605},"last":0.76700000000000002}]}]},{"osd":7,"up_from":15,"seq":64424509472,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":573440,"data_stored":242437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.61799999999999999,"15min":0.61499999999999999},"min":{"1min":0.39300000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0089999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.497},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.80400000000000005,"15min":0.82499999999999996},"min":{"1min":0.44400000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0820000000000001,"5min":4.5919999999999996,"15min":4.5919999999999996},"last":0.51900000000000002}]},{"osd":1,"last update":"Fri Jul 14 15:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.66700000000000004,"15min":0.66900000000000004},"min":{"1min":0.442,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98299999999999998,"5min":1,"15min":1},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.86199999999999999,"15min":0.89600000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88100000000000001,"5min":4.665,"15min":4.665},"last":0.81499999999999995}]},{"osd":2,"last update":"Fri Jul 14 15:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.872,"15min":0.91200000000000003},"min":{"1min":0.50600000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.86699999999999999,"5min":5.4089999999999998,"15min":5.4089999999999998},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.76700000000000002,"15min":0.77500000000000002},"min":{"1min":0.497,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0389999999999999,"5min":2.165,"15min":2.165},"last":0.68999999999999995}]},{"osd":3,"last update":"Fri Jul 14 15:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.753,"15min":0.76100000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.96199999999999997,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.80600000000000005,"15min":0.82399999999999995},"min":{"1min":0.49299999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.92500000000000004,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":0.77200000000000002}]},{"osd":4,"last update":"Fri Jul 14 15:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.63900000000000001,"15min":0.64100000000000001},"min":{"1min":0.41099999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89200000000000002,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.748},{"interface":"front","average":{"1min":0.624,"5min":0.65400000000000003,"15min":0.65900000000000003},"min":{"1min":0.37,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.77800000000000002,"5min":1.111,"15min":1.111},"last":0.88300000000000001}]},{"osd":5,"last update":"Fri Jul 14 15:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.65100000000000002,"15min":0.65900000000000003},"min":{"1min":0.40400000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.80500000000000005,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.73799999999999999,"15min":0.747},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.89800000000000002,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.79400000000000004}]},{"osd":6,"last update":"Fri Jul 14 15:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69799999999999995,"15min":0.70499999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84799999999999998,"5min":1.042,"15min":1.042},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.76100000000000001,"15min":0.77700000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.83799999999999997,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.97699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T15:58:18.657 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-14T15:58:18.657 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-14T15:58:18.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.908+0000 7fa8b21ff700 1 Processor -- start 2023-07-14T15:58:18.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.908+0000 7fa8b21ff700 1 -- start start 2023-07-14T15:58:18.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.909+0000 7fa8b21ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa8ac15ff50 0x7fa8ac0d0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:18.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.909+0000 7fa8b21ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa8ac0d2ab0 0x7fa8ac0d0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:18.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.909+0000 7fa8b21ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa8ac0b2820 0x7fa8ac0b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:18.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.909+0000 7fa8b21ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8ac0b4720 con 0x7fa8ac0b2820 2023-07-14T15:58:18.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.909+0000 7fa8b21ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8ac0b3a50 con 0x7fa8ac0d2ab0 2023-07-14T15:58:18.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.909+0000 7fa8b21ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac0b0560 con 0x7fa8ac15ff50 2023-07-14T15:58:18.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.910+0000 7fa8abfff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa8ac0b2820 0x7fa8ac0b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:18.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.910+0000 7fa8abfff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa8ac0b2820 0x7fa8ac0b2cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49606/0 (socket says 172.21.15.37:49606) 2023-07-14T15:58:18.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.910+0000 7fa8abfff700 1 -- 172.21.15.37:0/4179952390 learned_addr learned my addr 172.21.15.37:0/4179952390 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:18.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.910+0000 7fa8ab7fe700 1 --2- 172.21.15.37:0/4179952390 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa8ac15ff50 0x7fa8ac0d0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:18.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.910+0000 7fa8aaffd700 1 --2- 172.21.15.37:0/4179952390 >> v2:172.21.15.98:3300/0 conn(0x7fa8ac0d2ab0 0x7fa8ac0d0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:18.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.910+0000 7fa8abfff700 1 -- 172.21.15.37:0/4179952390 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa8ac15ff50 msgr2=0x7fa8ac0d0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:18.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.910+0000 7fa8abfff700 1 --2- 172.21.15.37:0/4179952390 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa8ac15ff50 0x7fa8ac0d0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:18.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.910+0000 7fa8abfff700 1 -- 172.21.15.37:0/4179952390 >> v2:172.21.15.98:3300/0 conn(0x7fa8ac0d2ab0 msgr2=0x7fa8ac0d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:18.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.910+0000 7fa8abfff700 1 --2- 172.21.15.37:0/4179952390 >> v2:172.21.15.98:3300/0 conn(0x7fa8ac0d2ab0 0x7fa8ac0d0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:18.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.910+0000 7fa8abfff700 1 -- 172.21.15.37:0/4179952390 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8ac0b0b20 con 0x7fa8ac0b2820 2023-07-14T15:58:18.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.910+0000 7fa8abfff700 1 --2- 172.21.15.37:0/4179952390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8ac0b2820 0x7fa8ac0b2cc0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac08c080 tx=0x7fa8a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eed750613879fc3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:18.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.911+0000 7fa8aa7fc700 1 -- 172.21.15.37:0/4179952390 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a400e070 con 0x7fa8ac0b2820 2023-07-14T15:58:18.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.911+0000 7fa8aa7fc700 1 -- 172.21.15.37:0/4179952390 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a400b910 con 0x7fa8ac0b2820 2023-07-14T15:58:18.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.911+0000 7fa8aa7fc700 1 -- 172.21.15.37:0/4179952390 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a400bcc0 con 0x7fa8ac0b2820 2023-07-14T15:58:18.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.911+0000 7fa8b21ff700 1 -- 172.21.15.37:0/4179952390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8ac0b2820 msgr2=0x7fa8ac0b2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:18.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.911+0000 7fa8b21ff700 1 --2- 172.21.15.37:0/4179952390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8ac0b2820 0x7fa8ac0b2cc0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac08c080 tx=0x7fa8a400b330 comp rx=0 tx=0).stop 2023-07-14T15:58:18.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.911+0000 7fa8b21ff700 1 -- 172.21.15.37:0/4179952390 shutdown_connections 2023-07-14T15:58:18.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.911+0000 7fa8b21ff700 1 --2- 172.21.15.37:0/4179952390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8ac0b2820 0x7fa8ac0b2cc0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:18.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.911+0000 7fa8b21ff700 1 --2- 172.21.15.37:0/4179952390 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa8ac15ff50 0x7fa8ac0d0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:18.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.911+0000 7fa8b21ff700 1 --2- 172.21.15.37:0/4179952390 >> v2:172.21.15.98:3300/0 conn(0x7fa8ac0d2ab0 0x7fa8ac0d0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:18.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.911+0000 7fa8b21ff700 1 -- 172.21.15.37:0/4179952390 >> 172.21.15.37:0/4179952390 conn(0x7fa8ac09c1f0 msgr2=0x7fa8ac0d2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:18.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.911+0000 7fa8b21ff700 1 -- 172.21.15.37:0/4179952390 shutdown_connections 2023-07-14T15:58:18.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.911+0000 7fa8b21ff700 1 -- 172.21.15.37:0/4179952390 wait complete. 2023-07-14T15:58:18.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.913+0000 7fa8b21ff700 1 Processor -- start 2023-07-14T15:58:18.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.913+0000 7fa8b21ff700 1 -- start start 2023-07-14T15:58:18.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.914+0000 7fa8b21ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8ac0b2820 0x7fa8ac1f4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:18.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.914+0000 7fa8b21ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8ac15ff50 0x7fa8ac0c69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:18.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.914+0000 7fa8b21ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa8ac1f32c0 0x7fa8ac0c6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:18.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.914+0000 7fa8b21ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac1f2520 con 0x7fa8ac0b2820 2023-07-14T15:58:18.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.914+0000 7fa8b21ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac0c9570 con 0x7fa8ac15ff50 2023-07-14T15:58:18.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.914+0000 7fa8b21ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac0c9850 con 0x7fa8ac1f32c0 2023-07-14T15:58:18.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.914+0000 7fa8ab7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8ac0b2820 0x7fa8ac1f4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:18.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.914+0000 7fa8ab7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8ac0b2820 0x7fa8ac1f4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49618/0 (socket says 172.21.15.37:49618) 2023-07-14T15:58:18.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.914+0000 7fa8ab7fe700 1 -- 172.21.15.37:0/4169312242 learned_addr learned my addr 172.21.15.37:0/4169312242 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:18.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.915+0000 7fa8aaffd700 1 --2- 172.21.15.37:0/4169312242 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8ac15ff50 0x7fa8ac0c69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:18.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.915+0000 7fa8abfff700 1 --2- 172.21.15.37:0/4169312242 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa8ac1f32c0 0x7fa8ac0c6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:18.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.915+0000 7fa8ab7fe700 1 -- 172.21.15.37:0/4169312242 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa8ac1f32c0 msgr2=0x7fa8ac0c6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:18.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.915+0000 7fa8ab7fe700 1 --2- 172.21.15.37:0/4169312242 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa8ac1f32c0 0x7fa8ac0c6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:18.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.915+0000 7fa8ab7fe700 1 -- 172.21.15.37:0/4169312242 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8ac15ff50 msgr2=0x7fa8ac0c69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:18.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.915+0000 7fa8ab7fe700 1 --2- 172.21.15.37:0/4169312242 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8ac15ff50 0x7fa8ac0c69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:18.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.915+0000 7fa8ab7fe700 1 -- 172.21.15.37:0/4169312242 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a4009b30 con 0x7fa8ac0b2820 2023-07-14T15:58:18.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.915+0000 7fa8ab7fe700 1 --2- 172.21.15.37:0/4169312242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8ac0b2820 0x7fa8ac1f4e80 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fa89c00e870 tx=0x7fa89c00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:18.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.915+0000 7fa893fff700 1 -- 172.21.15.37:0/4169312242 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89c009590 con 0x7fa8ac0b2820 2023-07-14T15:58:18.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.915+0000 7fa893fff700 1 -- 172.21.15.37:0/4169312242 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89c00ee70 con 0x7fa8ac0b2820 2023-07-14T15:58:18.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.915+0000 7fa893fff700 1 -- 172.21.15.37:0/4169312242 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89c00ca50 con 0x7fa8ac0b2820 2023-07-14T15:58:18.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.915+0000 7fa8b21ff700 1 -- 172.21.15.37:0/4169312242 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8ac0b6de0 con 0x7fa8ac0b2820 2023-07-14T15:58:18.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.916+0000 7fa8b21ff700 1 -- 172.21.15.37:0/4169312242 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8ac0b73a0 con 0x7fa8ac0b2820 2023-07-14T15:58:18.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.917+0000 7fa8b21ff700 1 -- 172.21.15.37:0/4169312242 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8ac0b2690 con 0x7fa8ac0b2820 2023-07-14T15:58:18.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.918+0000 7fa893fff700 1 -- 172.21.15.37:0/4169312242 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7fa89c00cbb0 con 0x7fa8ac0b2820 2023-07-14T15:58:18.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.918+0000 7fa893fff700 1 --2- 172.21.15.37:0/4169312242 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa89806ad70 0x7fa89806d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:18.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.919+0000 7fa893fff700 1 -- 172.21.15.37:0/4169312242 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa89c089570 con 0x7fa8ac0b2820 2023-07-14T15:58:18.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.919+0000 7fa8aaffd700 1 --2- 172.21.15.37:0/4169312242 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa89806ad70 0x7fa89806d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:18.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.920+0000 7fa8aaffd700 1 --2- 172.21.15.37:0/4169312242 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa89806ad70 0x7fa89806d220 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac1f67b0 tx=0x7fa8a0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:18.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:18.923+0000 7fa893fff700 1 -- 172.21.15.37:0/4169312242 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa89c057f40 con 0x7fa8ac0b2820 2023-07-14T15:58:19.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.211+0000 7fa8b21ff700 1 -- 172.21.15.37:0/4169312242 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fa8ac067840 con 0x7fa8ac0b2820 2023-07-14T15:58:19.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.218+0000 7fa893fff700 1 -- 172.21.15.37:0/4169312242 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+147 (secure 0 0 0) 0x7fa89c00ce60 con 0x7fa8ac0b2820 2023-07-14T15:58:19.202 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2023-07-14T15:58:19.202 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDWb7Fk8l4jKRAAD40aK9YW0bgBjt3LF5EM2Q== 2023-07-14T15:58:19.203 INFO:teuthology.orchestra.run.smithi037.stdout: caps mds = "allow" 2023-07-14T15:58:19.203 INFO:teuthology.orchestra.run.smithi037.stdout: caps mon = "allow r" 2023-07-14T15:58:19.203 INFO:teuthology.orchestra.run.smithi037.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-14T15:58:19.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.220+0000 7fa8b21ff700 1 -- 172.21.15.37:0/4169312242 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa89806ad70 msgr2=0x7fa89806d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:19.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.220+0000 7fa8b21ff700 1 --2- 172.21.15.37:0/4169312242 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa89806ad70 0x7fa89806d220 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac1f67b0 tx=0x7fa8a0008040 comp rx=0 tx=0).stop 2023-07-14T15:58:19.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.220+0000 7fa8b21ff700 1 -- 172.21.15.37:0/4169312242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8ac0b2820 msgr2=0x7fa8ac1f4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:19.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.220+0000 7fa8b21ff700 1 --2- 172.21.15.37:0/4169312242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8ac0b2820 0x7fa8ac1f4e80 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fa89c00e870 tx=0x7fa89c00ec30 comp rx=0 tx=0).stop 2023-07-14T15:58:19.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.220+0000 7fa8b21ff700 1 -- 172.21.15.37:0/4169312242 shutdown_connections 2023-07-14T15:58:19.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.220+0000 7fa8b21ff700 1 --2- 172.21.15.37:0/4169312242 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa89806ad70 0x7fa89806d220 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:19.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.220+0000 7fa8b21ff700 1 --2- 172.21.15.37:0/4169312242 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa8ac1f32c0 0x7fa8ac0c6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:19.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.220+0000 7fa8b21ff700 1 --2- 172.21.15.37:0/4169312242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8ac0b2820 0x7fa8ac1f4e80 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:19.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.220+0000 7fa8b21ff700 1 --2- 172.21.15.37:0/4169312242 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8ac15ff50 0x7fa8ac0c69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:19.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.220+0000 7fa8b21ff700 1 -- 172.21.15.37:0/4169312242 >> 172.21.15.37:0/4169312242 conn(0x7fa8ac09c1f0 msgr2=0x7fa8ac0d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:19.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.220+0000 7fa8b21ff700 1 -- 172.21.15.37:0/4169312242 shutdown_connections 2023-07-14T15:58:19.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.220+0000 7fa8b21ff700 1 -- 172.21.15.37:0/4169312242 wait complete. 2023-07-14T15:58:19.207 INFO:teuthology.orchestra.run.smithi037.stderr:updated caps for client.0 2023-07-14T15:58:19.223 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T15:58:19.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.439+0000 7f7f4a7ff700 1 Processor -- start 2023-07-14T15:58:19.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.439+0000 7f7f4a7ff700 1 -- start start 2023-07-14T15:58:19.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.440+0000 7f7f4a7ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f7f440b8650 0x7f7f440d0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:19.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.440+0000 7f7f4a7ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7f440cfda0 0x7f7f4415cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:19.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.440+0000 7f7f4a7ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f440cd540 con 0x7f7f440b24e0 2023-07-14T15:58:19.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.441+0000 7f7f4a7ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f440d1000 con 0x7f7f440cfda0 2023-07-14T15:58:19.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.441+0000 7f7f4a7ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f440d0220 con 0x7f7f440b8650 2023-07-14T15:58:19.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.441+0000 7f7f437fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7f440b24e0 0x7f7f440cf690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47058/0 (socket says 172.21.15.37:47058) 2023-07-14T15:58:19.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.441+0000 7f7f437fe700 1 -- 172.21.15.37:0/88305190 learned_addr learned my addr 172.21.15.37:0/88305190 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:58:19.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.441+0000 7f7f48d9c700 1 --2- 172.21.15.37:0/88305190 >> v2:172.21.15.37:3300/0 conn(0x7f7f440cfda0 0x7f7f4415cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:19.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.441+0000 7f7f43fff700 1 --2- 172.21.15.37:0/88305190 >> v2:172.21.15.98:3300/0 conn(0x7f7f440b8650 0x7f7f440d0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:19.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.441+0000 7f7f42ffd700 1 -- 172.21.15.37:0/88305190 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 602825290 0 0) 0x7f7f440cd540 con 0x7f7f440b24e0 2023-07-14T15:58:19.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.441+0000 7f7f42ffd700 1 -- 172.21.15.37:0/88305190 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f2c0035b0 con 0x7f7f440b24e0 2023-07-14T15:58:19.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.441+0000 7f7f48d9c700 1 -- 172.21.15.37:0/88305190 >> v2:172.21.15.98:3300/0 conn(0x7f7f440b8650 msgr2=0x7f7f440d0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:19.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.441+0000 7f7f48d9c700 1 --2- 172.21.15.37:0/88305190 >> v2:172.21.15.98:3300/0 conn(0x7f7f440b8650 0x7f7f440d0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:19.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.441+0000 7f7f48d9c700 1 -- 172.21.15.37:0/88305190 >> v1:172.21.15.37:6789/0 conn(0x7f7f440b24e0 legacy=0x7f7f440cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:19.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.441+0000 7f7f48d9c700 1 -- 172.21.15.37:0/88305190 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f44160f70 con 0x7f7f440cfda0 2023-07-14T15:58:19.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.442+0000 7f7f48d9c700 1 --2- 172.21.15.37:0/88305190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f440cfda0 0x7f7f4415cc20 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f7f4406cec0 tx=0x7f7f3c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7236557cd1756a88 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:19.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.442+0000 7f7f42ffd700 1 -- 172.21.15.37:0/88305190 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c00e070 con 0x7f7f440cfda0 2023-07-14T15:58:19.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.442+0000 7f7f42ffd700 1 -- 172.21.15.37:0/88305190 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f3c00bb20 con 0x7f7f440cfda0 2023-07-14T15:58:19.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.442+0000 7f7f42ffd700 1 -- 172.21.15.37:0/88305190 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c012430 con 0x7f7f440cfda0 2023-07-14T15:58:19.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.442+0000 7f7f4a7ff700 1 -- 172.21.15.37:0/88305190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f440cfda0 msgr2=0x7f7f4415cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:19.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.442+0000 7f7f4a7ff700 1 --2- 172.21.15.37:0/88305190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f440cfda0 0x7f7f4415cc20 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f7f4406cec0 tx=0x7f7f3c00b330 comp rx=0 tx=0).stop 2023-07-14T15:58:19.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.443+0000 7f7f4a7ff700 1 -- 172.21.15.37:0/88305190 shutdown_connections 2023-07-14T15:58:19.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.443+0000 7f7f4a7ff700 1 --2- 172.21.15.37:0/88305190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f440cfda0 0x7f7f4415cc20 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:19.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.443+0000 7f7f4a7ff700 1 --2- 172.21.15.37:0/88305190 >> v2:172.21.15.98:3300/0 conn(0x7f7f440b8650 0x7f7f440d0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:19.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.443+0000 7f7f4a7ff700 1 -- 172.21.15.37:0/88305190 >> 172.21.15.37:0/88305190 conn(0x7f7f4406c0f0 msgr2=0x7f7f4406c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:19.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.443+0000 7f7f4a7ff700 1 -- 172.21.15.37:0/88305190 shutdown_connections 2023-07-14T15:58:19.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.443+0000 7f7f4a7ff700 1 -- 172.21.15.37:0/88305190 wait complete. 2023-07-14T15:58:19.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.444+0000 7f7f4a7ff700 1 Processor -- start 2023-07-14T15:58:19.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.445+0000 7f7f4a7ff700 1 -- start start 2023-07-14T15:58:19.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.445+0000 7f7f4a7ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f440b24e0 0x7f7f440cc400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:19.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.445+0000 7f7f4a7ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f440b8650 0x7f7f440c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:19.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.446+0000 7f7f4a7ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7f440cfda0 0x7f7f440c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:19.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.446+0000 7f7f4a7ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f440c9360 con 0x7f7f440b24e0 2023-07-14T15:58:19.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.446+0000 7f7f4a7ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4414a1b0 con 0x7f7f440b8650 2023-07-14T15:58:19.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.446+0000 7f7f4a7ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4415d560 con 0x7f7f440cfda0 2023-07-14T15:58:19.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.446+0000 7f7f43fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f440b24e0 0x7f7f440cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:19.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.446+0000 7f7f43fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f440b24e0 0x7f7f440cc400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49636/0 (socket says 172.21.15.37:49636) 2023-07-14T15:58:19.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.446+0000 7f7f43fff700 1 -- 172.21.15.37:0/709854102 learned_addr learned my addr 172.21.15.37:0/709854102 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:19.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.446+0000 7f7f437fe700 1 --2- 172.21.15.37:0/709854102 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f440b8650 0x7f7f440c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:19.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.446+0000 7f7f48d9c700 1 --2- 172.21.15.37:0/709854102 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7f440cfda0 0x7f7f440c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:19.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.446+0000 7f7f43fff700 1 -- 172.21.15.37:0/709854102 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7f440cfda0 msgr2=0x7f7f440c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:19.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.446+0000 7f7f43fff700 1 --2- 172.21.15.37:0/709854102 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7f440cfda0 0x7f7f440c8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:19.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.446+0000 7f7f43fff700 1 -- 172.21.15.37:0/709854102 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f440b8650 msgr2=0x7f7f440c88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:19.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.446+0000 7f7f43fff700 1 --2- 172.21.15.37:0/709854102 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f440b8650 0x7f7f440c88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:19.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.446+0000 7f7f43fff700 1 -- 172.21.15.37:0/709854102 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f3c009a70 con 0x7f7f440b24e0 2023-07-14T15:58:19.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.447+0000 7f7f43fff700 1 --2- 172.21.15.37:0/709854102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f440b24e0 0x7f7f440cc400 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f7f3400e9e0 tx=0x7f7f3400ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:19.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.447+0000 7f7f40ff9700 1 -- 172.21.15.37:0/709854102 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f34009710 con 0x7f7f440b24e0 2023-07-14T15:58:19.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.447+0000 7f7f40ff9700 1 -- 172.21.15.37:0/709854102 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f3400ee80 con 0x7f7f440b24e0 2023-07-14T15:58:19.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.447+0000 7f7f40ff9700 1 -- 172.21.15.37:0/709854102 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f3400ca50 con 0x7f7f440b24e0 2023-07-14T15:58:19.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.447+0000 7f7f4a7ff700 1 -- 172.21.15.37:0/709854102 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f4414d020 con 0x7f7f440b24e0 2023-07-14T15:58:19.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.447+0000 7f7f4a7ff700 1 -- 172.21.15.37:0/709854102 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f4414a6e0 con 0x7f7f440b24e0 2023-07-14T15:58:19.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.448+0000 7f7f4a7ff700 1 -- 172.21.15.37:0/709854102 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f44067840 con 0x7f7f440b24e0 2023-07-14T15:58:19.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.449+0000 7f7f40ff9700 1 -- 172.21.15.37:0/709854102 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f7f3400cbb0 con 0x7f7f440b24e0 2023-07-14T15:58:19.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.450+0000 7f7f40ff9700 1 --2- 172.21.15.37:0/709854102 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f7f3006ad70 0x7f7f3006d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:19.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.450+0000 7f7f40ff9700 1 -- 172.21.15.37:0/709854102 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7f34089500 con 0x7f7f440b24e0 2023-07-14T15:58:19.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.450+0000 7f7f437fe700 1 --2- 172.21.15.37:0/709854102 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f7f3006ad70 0x7f7f3006d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:19.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.451+0000 7f7f437fe700 1 --2- 172.21.15.37:0/709854102 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f7f3006ad70 0x7f7f3006d220 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7f440d1be0 tx=0x7f7f38007dc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:19.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.454+0000 7f7f40ff9700 1 -- 172.21.15.37:0/709854102 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7f34057fc0 con 0x7f7f440b24e0 2023-07-14T15:58:19.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.704+0000 7f7f4a7ff700 1 -- 172.21.15.37:0/709854102 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7f4414ad30 con 0x7f7f440b24e0 2023-07-14T15:58:19.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.704+0000 7f7f40ff9700 1 -- 172.21.15.37:0/709854102 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4709 (secure 0 0 0) 0x7f7f34057b50 con 0x7f7f440b24e0 2023-07-14T15:58:19.690 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:58:19.690 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5132,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/1552421235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":1552421235},{"type":"v1","addr":"172.21.15.98:6837","nonce":1552421235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5135,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/4269801846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4269801846},{"type":"v1","addr":"172.21.15.37:6833","nonce":4269801846}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5470,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/3115632546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":3115632546},{"type":"v1","addr":"172.21.15.98:6835","nonce":3115632546}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T15:58:08.228046+0000","modified":"2023-07-14T15:58:11.751169+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5652":{"gid":5652,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/4236968434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":4236968434},{"type":"v1","addr":"172.21.15.37:6835","nonce":4236968434}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-14T15:58:19.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.706+0000 7f7f4a7ff700 1 -- 172.21.15.37:0/709854102 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f7f3006ad70 msgr2=0x7f7f3006d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:19.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.706+0000 7f7f4a7ff700 1 --2- 172.21.15.37:0/709854102 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f7f3006ad70 0x7f7f3006d220 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7f440d1be0 tx=0x7f7f38007dc0 comp rx=0 tx=0).stop 2023-07-14T15:58:19.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.706+0000 7f7f4a7ff700 1 -- 172.21.15.37:0/709854102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f440b24e0 msgr2=0x7f7f440cc400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:19.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.706+0000 7f7f4a7ff700 1 --2- 172.21.15.37:0/709854102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f440b24e0 0x7f7f440cc400 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f7f3400e9e0 tx=0x7f7f3400ecf0 comp rx=0 tx=0).stop 2023-07-14T15:58:19.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.707+0000 7f7f4a7ff700 1 -- 172.21.15.37:0/709854102 shutdown_connections 2023-07-14T15:58:19.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.707+0000 7f7f4a7ff700 1 --2- 172.21.15.37:0/709854102 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f7f3006ad70 0x7f7f3006d220 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:19.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.707+0000 7f7f4a7ff700 1 --2- 172.21.15.37:0/709854102 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7f440cfda0 0x7f7f440c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:19.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.707+0000 7f7f4a7ff700 1 --2- 172.21.15.37:0/709854102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f440b24e0 0x7f7f440cc400 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:19.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.707+0000 7f7f4a7ff700 1 --2- 172.21.15.37:0/709854102 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f440b8650 0x7f7f440c88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:19.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.707+0000 7f7f4a7ff700 1 -- 172.21.15.37:0/709854102 >> 172.21.15.37:0/709854102 conn(0x7f7f4406c0f0 msgr2=0x7f7f440d2130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:19.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.707+0000 7f7f4a7ff700 1 -- 172.21.15.37:0/709854102 shutdown_connections 2023-07-14T15:58:19.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:19.707+0000 7f7f4a7ff700 1 -- 172.21.15.37:0/709854102 wait complete. 2023-07-14T15:58:19.696 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 25 2023-07-14T15:58:20.113 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-14T15:58:08.228046+0000', 'modified': '2023-07-14T15:58:11.751169+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5652}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5652': {'gid': 5652, 'name': 'c', 'rank': 0, 'incarnation': 22, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.37:6835/4236968434', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6834', 'nonce': 4236968434}, {'type': 'v1', 'addr': '172.21.15.37:6835', 'nonce': 4236968434}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-14T15:58:20.113 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-14T15:58:20.114 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-14T15:58:20.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.335+0000 7f7b4e7ff700 1 Processor -- start 2023-07-14T15:58:20.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.336+0000 7f7b4e7ff700 1 -- start start 2023-07-14T15:58:20.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.337+0000 7f7b4e7ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7b480adfe0 0x7f7b480c9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:20.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.337+0000 7f7b4e7ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7b480cbbf0 0x7f7b480c9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:20.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.337+0000 7f7b4e7ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b481598c0 con 0x7f7b480cda10 2023-07-14T15:58:20.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.337+0000 7f7b4e7ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b4815dec0 con 0x7f7b480cbbf0 2023-07-14T15:58:20.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.337+0000 7f7b4e7ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b480ccc50 con 0x7f7b480adfe0 2023-07-14T15:58:20.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.337+0000 7f7b4cd9c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7b480cbbf0 0x7f7b480c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:20.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.337+0000 7f7b477fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7b480cda10 0x7f7b480cb4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58426/0 (socket says 172.21.15.37:58426) 2023-07-14T15:58:20.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.337+0000 7f7b477fe700 1 -- 172.21.15.37:0/3070598814 learned_addr learned my addr 172.21.15.37:0/3070598814 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:58:20.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.338+0000 7f7b47fff700 1 --2- 172.21.15.37:0/3070598814 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7b480adfe0 0x7f7b480c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:20.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.338+0000 7f7b4cd9c700 1 -- 172.21.15.37:0/3070598814 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7b480adfe0 msgr2=0x7f7b480c9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:20.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.338+0000 7f7b4cd9c700 1 --2- 172.21.15.37:0/3070598814 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7b480adfe0 0x7f7b480c9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:20.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.338+0000 7f7b4cd9c700 1 -- 172.21.15.37:0/3070598814 >> v1:172.21.15.37:6789/0 conn(0x7f7b480cda10 legacy=0x7f7b480cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:20.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.338+0000 7f7b4cd9c700 1 -- 172.21.15.37:0/3070598814 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b480ccf30 con 0x7f7b480cbbf0 2023-07-14T15:58:20.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.338+0000 7f7b46ffd700 1 -- 172.21.15.37:0/3070598814 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 487736750 0 0) 0x7f7b3c001110 con 0x7f7b480cda10 2023-07-14T15:58:20.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.338+0000 7f7b4cd9c700 1 --2- 172.21.15.37:0/3070598814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b480cbbf0 0x7f7b480c9660 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f7b4000bfa0 tx=0x7f7b4000d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17788a2b778c8ccd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:20.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.338+0000 7f7b46ffd700 1 -- 172.21.15.37:0/3070598814 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b40010070 con 0x7f7b480cbbf0 2023-07-14T15:58:20.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.338+0000 7f7b46ffd700 1 -- 172.21.15.37:0/3070598814 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b4000b2e0 con 0x7f7b480cbbf0 2023-07-14T15:58:20.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.338+0000 7f7b46ffd700 1 -- 172.21.15.37:0/3070598814 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4000dcf0 con 0x7f7b480cbbf0 2023-07-14T15:58:20.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.339+0000 7f7b4e7ff700 1 -- 172.21.15.37:0/3070598814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b480cbbf0 msgr2=0x7f7b480c9660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:20.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.339+0000 7f7b4e7ff700 1 --2- 172.21.15.37:0/3070598814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b480cbbf0 0x7f7b480c9660 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f7b4000bfa0 tx=0x7f7b4000d330 comp rx=0 tx=0).stop 2023-07-14T15:58:20.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.339+0000 7f7b4e7ff700 1 -- 172.21.15.37:0/3070598814 shutdown_connections 2023-07-14T15:58:20.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.339+0000 7f7b4e7ff700 1 --2- 172.21.15.37:0/3070598814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b480cbbf0 0x7f7b480c9660 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:20.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.339+0000 7f7b4e7ff700 1 --2- 172.21.15.37:0/3070598814 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7b480adfe0 0x7f7b480c9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:20.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.339+0000 7f7b4e7ff700 1 -- 172.21.15.37:0/3070598814 >> 172.21.15.37:0/3070598814 conn(0x7f7b480b0620 msgr2=0x7f7b480b0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:20.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.339+0000 7f7b4e7ff700 1 -- 172.21.15.37:0/3070598814 shutdown_connections 2023-07-14T15:58:20.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.339+0000 7f7b4e7ff700 1 -- 172.21.15.37:0/3070598814 wait complete. 2023-07-14T15:58:20.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.341+0000 7f7b4e7ff700 1 Processor -- start 2023-07-14T15:58:20.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.341+0000 7f7b4e7ff700 1 -- start start 2023-07-14T15:58:20.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.342+0000 7f7b4e7ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b480adfe0 0x7f7b48152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:20.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.342+0000 7f7b4e7ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7b480cbbf0 0x7f7b480b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:20.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.342+0000 7f7b4e7ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b480cda10 0x7f7b480ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:20.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.342+0000 7f7b4e7ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b48152770 con 0x7f7b480adfe0 2023-07-14T15:58:20.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.342+0000 7f7b4e7ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b480c7260 con 0x7f7b480cda10 2023-07-14T15:58:20.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.342+0000 7f7b4e7ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b480c7540 con 0x7f7b480cbbf0 2023-07-14T15:58:20.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.342+0000 7f7b47fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b480adfe0 0x7f7b48152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:20.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.342+0000 7f7b47fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b480adfe0 0x7f7b48152230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45438/0 (socket says 172.21.15.37:45438) 2023-07-14T15:58:20.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.342+0000 7f7b47fff700 1 -- 172.21.15.37:0/2446658892 learned_addr learned my addr 172.21.15.37:0/2446658892 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:20.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.342+0000 7f7b477fe700 1 --2- 172.21.15.37:0/2446658892 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7b480cbbf0 0x7f7b480b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:20.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.342+0000 7f7b4cd9c700 1 --2- 172.21.15.37:0/2446658892 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b480cda10 0x7f7b480ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:20.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.342+0000 7f7b47fff700 1 -- 172.21.15.37:0/2446658892 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7b480cbbf0 msgr2=0x7f7b480b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:20.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.343+0000 7f7b47fff700 1 --2- 172.21.15.37:0/2446658892 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7b480cbbf0 0x7f7b480b38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:20.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.343+0000 7f7b47fff700 1 -- 172.21.15.37:0/2446658892 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b480cda10 msgr2=0x7f7b480ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:20.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.343+0000 7f7b47fff700 1 --2- 172.21.15.37:0/2446658892 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b480cda10 0x7f7b480ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:20.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.343+0000 7f7b47fff700 1 -- 172.21.15.37:0/2446658892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b4000bc80 con 0x7f7b480adfe0 2023-07-14T15:58:20.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.343+0000 7f7b4cd9c700 1 --2- 172.21.15.37:0/2446658892 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b480cda10 0x7f7b480ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:58:20.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.343+0000 7f7b47fff700 1 --2- 172.21.15.37:0/2446658892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b480adfe0 0x7f7b48152230 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f7b3800d800 tx=0x7f7b3800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:20.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.343+0000 7f7b44ff9700 1 -- 172.21.15.37:0/2446658892 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b380125f0 con 0x7f7b480adfe0 2023-07-14T15:58:20.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.343+0000 7f7b44ff9700 1 -- 172.21.15.37:0/2446658892 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b38012750 con 0x7f7b480adfe0 2023-07-14T15:58:20.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.343+0000 7f7b4e7ff700 1 -- 172.21.15.37:0/2446658892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b480c7820 con 0x7f7b480adfe0 2023-07-14T15:58:20.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.343+0000 7f7b44ff9700 1 -- 172.21.15.37:0/2446658892 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b38012b00 con 0x7f7b480adfe0 2023-07-14T15:58:20.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.343+0000 7f7b4e7ff700 1 -- 172.21.15.37:0/2446658892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b480c7de0 con 0x7f7b480adfe0 2023-07-14T15:58:20.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.346+0000 7f7b44ff9700 1 -- 172.21.15.37:0/2446658892 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f7b38012c60 con 0x7f7b480adfe0 2023-07-14T15:58:20.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.347+0000 7f7b44ff9700 1 --2- 172.21.15.37:0/2446658892 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f7b3406ad70 0x7f7b3406d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:20.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.347+0000 7f7b44ff9700 1 -- 172.21.15.37:0/2446658892 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7b380899d0 con 0x7f7b480adfe0 2023-07-14T15:58:20.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.348+0000 7f7b477fe700 1 --2- 172.21.15.37:0/2446658892 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f7b3406ad70 0x7f7b3406d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:20.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.348+0000 7f7b477fe700 1 --2- 172.21.15.37:0/2446658892 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f7b3406ad70 0x7f7b3406d220 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7b480aea10 tx=0x7f7b3c007a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:20.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.349+0000 7f7b6206bb80 1 Processor -- start 2023-07-14T15:58:20.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.349+0000 7f7b6206bb80 1 -- start start 2023-07-14T15:58:20.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.350+0000 7f7b6206bb80 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x55b521c33f00 0x55b521c346f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:20.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.350+0000 7f7b6206bb80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b521c342d0 0x55b521c38960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:20.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.350+0000 7f7b6206bb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b521c38ea0 0x55b521c530d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:20.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.350+0000 7f7b6206bb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b521b12c60 con 0x55b521c38ea0 2023-07-14T15:58:20.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.350+0000 7f7b6206bb80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b521b659f0 con 0x55b521c342d0 2023-07-14T15:58:20.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.350+0000 7f7b6206bb80 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b521b5ee80 con 0x55b521c33f00 2023-07-14T15:58:20.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.350+0000 7f7b4cd9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b521c38ea0 0x55b521c530d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:20.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.350+0000 7f7b4cd9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b521c38ea0 0x55b521c530d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45448/0 (socket says 172.21.15.37:45448) 2023-07-14T15:58:20.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.350+0000 7f7b4cd9c700 1 -- 172.21.15.37:0/3625762299 learned_addr learned my addr 172.21.15.37:0/3625762299 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:20.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.350+0000 7f7b47fff700 1 --2- 172.21.15.37:0/3625762299 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x55b521c33f00 0x55b521c346f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:20.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.350+0000 7f7b477fe700 1 --2- 172.21.15.37:0/3625762299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b521c342d0 0x55b521c38960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:20.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.350+0000 7f7b4cd9c700 1 -- 172.21.15.37:0/3625762299 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x55b521c33f00 msgr2=0x55b521c346f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:20.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.351+0000 7f7b4cd9c700 1 --2- 172.21.15.37:0/3625762299 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x55b521c33f00 0x55b521c346f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:20.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.351+0000 7f7b4cd9c700 1 -- 172.21.15.37:0/3625762299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b521c342d0 msgr2=0x55b521c38960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:20.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.351+0000 7f7b4cd9c700 1 --2- 172.21.15.37:0/3625762299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b521c342d0 0x55b521c38960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:20.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.351+0000 7f7b4cd9c700 1 -- 172.21.15.37:0/3625762299 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b52198cd90 con 0x55b521c38ea0 2023-07-14T15:58:20.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.351+0000 7f7b4cd9c700 1 --2- 172.21.15.37:0/3625762299 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b521c38ea0 0x55b521c530d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f7b40014000 tx=0x7f7b40012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e010a5d949b278b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:20.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.351+0000 7f7b2dffb700 1 -- 172.21.15.37:0/3625762299 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4000dea0 con 0x55b521c38ea0 2023-07-14T15:58:20.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.351+0000 7f7b2dffb700 1 -- 172.21.15.37:0/3625762299 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b4000dcb0 con 0x55b521c38ea0 2023-07-14T15:58:20.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.351+0000 7f7b2dffb700 1 -- 172.21.15.37:0/3625762299 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b40003c20 con 0x55b521c38ea0 2023-07-14T15:58:20.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.352+0000 7f7b6206bb80 1 -- 172.21.15.37:0/3625762299 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b521c38ea0 msgr2=0x55b521c530d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:20.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.352+0000 7f7b6206bb80 1 --2- 172.21.15.37:0/3625762299 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b521c38ea0 0x55b521c530d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f7b40014000 tx=0x7f7b40012000 comp rx=0 tx=0).stop 2023-07-14T15:58:20.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.352+0000 7f7b6206bb80 1 -- 172.21.15.37:0/3625762299 shutdown_connections 2023-07-14T15:58:20.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.352+0000 7f7b6206bb80 1 --2- 172.21.15.37:0/3625762299 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b521c38ea0 0x55b521c530d0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:20.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.352+0000 7f7b6206bb80 1 --2- 172.21.15.37:0/3625762299 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x55b521c33f00 0x55b521c346f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:20.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.352+0000 7f7b6206bb80 1 --2- 172.21.15.37:0/3625762299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b521c342d0 0x55b521c38960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:20.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.352+0000 7f7b6206bb80 1 -- 172.21.15.37:0/3625762299 >> 172.21.15.37:0/3625762299 conn(0x55b521c02b90 msgr2=0x55b521c08130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:20.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.352+0000 7f7b6206bb80 1 -- 172.21.15.37:0/3625762299 shutdown_connections 2023-07-14T15:58:20.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.352+0000 7f7b6206bb80 1 -- 172.21.15.37:0/3625762299 wait complete. 2023-07-14T15:58:20.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.353+0000 7f7b6206bb80 1 -- start start 2023-07-14T15:58:20.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.353+0000 7f7b6206bb80 1 Processor -- start 2023-07-14T15:58:20.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.354+0000 7f7b6206bb80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b521c33f00 0x55b521c30a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:20.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.354+0000 7f7b6206bb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b521c342d0 0x55b521c37670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:20.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.354+0000 7f7b6206bb80 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x55b521c38ea0 0x55b521c34950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:20.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.354+0000 7f7b6206bb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b521afea70 con 0x55b521c342d0 2023-07-14T15:58:20.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.354+0000 7f7b6206bb80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b521afe770 con 0x55b521c33f00 2023-07-14T15:58:20.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.354+0000 7f7b6206bb80 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b5219e28d0 con 0x55b521c38ea0 2023-07-14T15:58:20.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.354+0000 7f7b6206bb80 10 client.0 _ll_register_callbacks cb 0x55b521afc710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T15:58:20.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.354+0000 7f7b477fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b521c342d0 0x55b521c37670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:20.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.354+0000 7f7b477fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b521c342d0 0x55b521c37670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45456/0 (socket says 172.21.15.37:45456) 2023-07-14T15:58:20.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.354+0000 7f7b477fe700 1 -- 172.21.15.37:0/1202644301 learned_addr learned my addr 172.21.15.37:0/1202644301 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:20.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.354+0000 7f7b47fff700 1 --2- 172.21.15.37:0/1202644301 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b521c33f00 0x55b521c30a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:20.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.354+0000 7f7b4cd9c700 1 --2- 172.21.15.37:0/1202644301 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x55b521c38ea0 0x55b521c34950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:20.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.355+0000 7f7b477fe700 1 -- 172.21.15.37:0/1202644301 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x55b521c38ea0 msgr2=0x55b521c34950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:20.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.355+0000 7f7b477fe700 1 --2- 172.21.15.37:0/1202644301 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x55b521c38ea0 0x55b521c34950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:20.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.355+0000 7f7b477fe700 1 -- 172.21.15.37:0/1202644301 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b521c33f00 msgr2=0x55b521c30a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:20.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.355+0000 7f7b477fe700 1 --2- 172.21.15.37:0/1202644301 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b521c33f00 0x55b521c30a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:20.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.355+0000 7f7b477fe700 1 -- 172.21.15.37:0/1202644301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b480ccf30 con 0x55b521c342d0 2023-07-14T15:58:20.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.355+0000 7f7b4cd9c700 1 --2- 172.21.15.37:0/1202644301 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x55b521c38ea0 0x55b521c34950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:58:20.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.355+0000 7f7b477fe700 1 --2- 172.21.15.37:0/1202644301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b521c342d0 0x55b521c37670 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f7b48156490 tx=0x7f7b3c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfa9c666679d32a1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:20.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.355+0000 7f7b26ffd700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-07-14T15:58:20.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.355+0000 7f7b26ffd700 1 -- 172.21.15.37:0/1202644301 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c0158a0 con 0x55b521c342d0 2023-07-14T15:58:20.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.355+0000 7f7b6206bb80 1 -- 172.21.15.37:0/1202644301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b521c001a0 con 0x55b521c342d0 2023-07-14T15:58:20.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.355+0000 7f7b26ffd700 1 -- 172.21.15.37:0/1202644301 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(49..49 src has 1..49) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7b3c022bf0 con 0x55b521c342d0 2023-07-14T15:58:20.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.355+0000 7f7b26ffd700 1 -- 172.21.15.37:0/1202644301 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b3c022db0 con 0x55b521c342d0 2023-07-14T15:58:20.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.355+0000 7f7b6206bb80 10 client.5817 fetch_fsmap learned FSMap version 25 2023-07-14T15:58:20.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.355+0000 7f7b6206bb80 1 -- 172.21.15.37:0/1202644301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x55b521975c10 con 0x55b521c342d0 2023-07-14T15:58:20.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.356+0000 7f7b26ffd700 1 -- 172.21.15.37:0/1202644301 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b521c001a0 con 0x55b521c342d0 2023-07-14T15:58:20.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.356+0000 7f7b26ffd700 1 -- 172.21.15.37:0/1202644301 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f7b3c015a00 con 0x55b521c342d0 2023-07-14T15:58:20.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.356+0000 7f7b6206bb80 10 client.5817 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T15:58:20.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.356+0000 7f7b6206bb80 10 client.5817 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-14T15:58:20.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.356+0000 7f7b6206bb80 20 client.5817 populate_metadata read hostname 'smithi037' 2023-07-14T15:58:20.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.356+0000 7f7b6206bb80 1 --2- 172.21.15.37:0/1202644301 >> [v2:172.21.15.37:6834/4236968434,v1:172.21.15.37:6835/4236968434] conn(0x55b521c37bb0 0x55b521c54df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:20.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.356+0000 7f7b6206bb80 4 client.5817 mds_command: new command op to 5652 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T15:58:20.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.356+0000 7f7b6206bb80 1 -- 172.21.15.37:0/1202644301 --> [v2:172.21.15.37:6834/4236968434,v1:172.21.15.37:6835/4236968434] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b521b57e60 con 0x55b521c37bb0 2023-07-14T15:58:20.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.356+0000 7f7b47fff700 1 --2- 172.21.15.37:0/1202644301 >> [v2:172.21.15.37:6834/4236968434,v1:172.21.15.37:6835/4236968434] conn(0x55b521c37bb0 0x55b521c54df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:20.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.356+0000 7f7b47fff700 1 --2- 172.21.15.37:0/1202644301 >> [v2:172.21.15.37:6834/4236968434,v1:172.21.15.37:6835/4236968434] conn(0x55b521c37bb0 0x55b521c54df0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=309d72ee9f53f99b server_cookie=9286ee9de71e3584 in_seq=0 out_seq=0 2023-07-14T15:58:20.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.356+0000 7f7b26ffd700 10 client.5817 ms_handle_connect on v2:172.21.15.37:6834/4236968434 2023-07-14T15:58:20.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.357+0000 7f7b26ffd700 1 -- 172.21.15.37:0/1202644301 <== mds.0 v2:172.21.15.37:6834/4236968434 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55b521b57e60 con 0x55b521c37bb0 2023-07-14T15:58:20.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.357+0000 7f7b26ffd700 10 client.5817 handle_command_reply: tid=0 2023-07-14T15:58:20.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.357+0000 7f7b6206bb80 1 client.5817 shutdown 2023-07-14T15:58:20.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.357+0000 7f7b6206bb80 1 -- 172.21.15.37:0/1202644301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b521c342d0 msgr2=0x55b521c37670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:20.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.357+0000 7f7b6206bb80 1 --2- 172.21.15.37:0/1202644301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b521c342d0 0x55b521c37670 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f7b48156490 tx=0x7f7b3c011000 comp rx=0 tx=0).stop 2023-07-14T15:58:20.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.358+0000 7f7b6206bb80 1 -- 172.21.15.37:0/1202644301 shutdown_connections 2023-07-14T15:58:20.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.358+0000 7f7b6206bb80 1 --2- 172.21.15.37:0/1202644301 >> [v2:172.21.15.37:6834/4236968434,v1:172.21.15.37:6835/4236968434] conn(0x55b521c37bb0 0x55b521c54df0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:20.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.358+0000 7f7b6206bb80 1 --2- 172.21.15.37:0/1202644301 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b521c33f00 0x55b521c30a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:20.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.358+0000 7f7b6206bb80 1 --2- 172.21.15.37:0/1202644301 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x55b521c38ea0 0x55b521c34950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:20.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.358+0000 7f7b26ffd700 0 client.5817 ms_handle_reset on v2:172.21.15.37:6834/4236968434 2023-07-14T15:58:20.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.358+0000 7f7b6206bb80 1 --2- 172.21.15.37:0/1202644301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b521c342d0 0x55b521c37670 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:20.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.358+0000 7f7b6206bb80 1 -- 172.21.15.37:0/1202644301 >> 172.21.15.37:0/1202644301 conn(0x55b521c02b90 msgr2=0x55b521c08630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:20.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.358+0000 7f7b6206bb80 1 -- 172.21.15.37:0/1202644301 shutdown_connections 2023-07-14T15:58:20.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.358+0000 7f7b6206bb80 1 -- 172.21.15.37:0/1202644301 wait complete. 2023-07-14T15:58:20.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.358+0000 7f7b6206bb80 20 client.5817 trim_cache size 0 max 16384 2023-07-14T15:58:20.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.376+0000 7f7b6206bb80 1 Processor -- start 2023-07-14T15:58:20.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.376+0000 7f7b6206bb80 1 -- start start 2023-07-14T15:58:20.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.377+0000 7f7b6206bb80 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x55b521c33f00 0x55b521c52f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:20.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.377+0000 7f7b6206bb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b521c342d0 0x55b521c346a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:20.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.377+0000 7f7b6206bb80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b521c38ea0 0x55b521c36970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:20.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.377+0000 7f7b6206bb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b521c096d0 con 0x55b521c342d0 2023-07-14T15:58:20.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.377+0000 7f7b6206bb80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b521c74e20 con 0x55b521c38ea0 2023-07-14T15:58:20.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.377+0000 7f7b6206bb80 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b521c39870 con 0x55b521c33f00 2023-07-14T15:58:20.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.377+0000 7f7b477fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b521c342d0 0x55b521c346a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:20.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.377+0000 7f7b477fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b521c342d0 0x55b521c346a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45460/0 (socket says 172.21.15.37:45460) 2023-07-14T15:58:20.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.378+0000 7f7b477fe700 1 -- 172.21.15.37:0/1594888053 learned_addr learned my addr 172.21.15.37:0/1594888053 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:20.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.378+0000 7f7b477fe700 1 -- 172.21.15.37:0/1594888053 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x55b521c33f00 msgr2=0x55b521c52f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:20.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.378+0000 7f7b477fe700 1 --2- 172.21.15.37:0/1594888053 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x55b521c33f00 0x55b521c52f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:20.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.378+0000 7f7b477fe700 1 -- 172.21.15.37:0/1594888053 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b521c38ea0 msgr2=0x55b521c36970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:20.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.378+0000 7f7b4cd9c700 1 --2- 172.21.15.37:0/1594888053 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b521c38ea0 0x55b521c36970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:20.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.378+0000 7f7b477fe700 1 --2- 172.21.15.37:0/1594888053 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b521c38ea0 0x55b521c36970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:20.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.378+0000 7f7b477fe700 1 -- 172.21.15.37:0/1594888053 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b5219b3200 con 0x55b521c342d0 2023-07-14T15:58:20.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.378+0000 7f7b4cd9c700 1 --2- 172.21.15.37:0/1594888053 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b521c38ea0 0x55b521c36970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:58:20.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.378+0000 7f7b477fe700 1 --2- 172.21.15.37:0/1594888053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b521c342d0 0x55b521c346a0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c000f80 tx=0x7f7b3c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2597d1498dfbc59b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:20.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.378+0000 7f7b2e7fc700 1 -- 172.21.15.37:0/1594888053 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c007c90 con 0x55b521c342d0 2023-07-14T15:58:20.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.378+0000 7f7b2e7fc700 1 -- 172.21.15.37:0/1594888053 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3c00b070 con 0x55b521c342d0 2023-07-14T15:58:20.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.378+0000 7f7b2e7fc700 1 -- 172.21.15.37:0/1594888053 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c015720 con 0x55b521c342d0 2023-07-14T15:58:20.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.379+0000 7f7b6206bb80 1 -- 172.21.15.37:0/1594888053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b521c342d0 msgr2=0x55b521c346a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:20.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.379+0000 7f7b6206bb80 1 --2- 172.21.15.37:0/1594888053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b521c342d0 0x55b521c346a0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c000f80 tx=0x7f7b3c013000 comp rx=0 tx=0).stop 2023-07-14T15:58:20.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.379+0000 7f7b6206bb80 1 -- 172.21.15.37:0/1594888053 shutdown_connections 2023-07-14T15:58:20.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.379+0000 7f7b6206bb80 1 --2- 172.21.15.37:0/1594888053 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b521c38ea0 0x55b521c36970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:20.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.379+0000 7f7b6206bb80 1 --2- 172.21.15.37:0/1594888053 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x55b521c33f00 0x55b521c52f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:20.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.379+0000 7f7b6206bb80 1 --2- 172.21.15.37:0/1594888053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b521c342d0 0x55b521c346a0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:20.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.379+0000 7f7b6206bb80 1 -- 172.21.15.37:0/1594888053 >> 172.21.15.37:0/1594888053 conn(0x55b521c02b90 msgr2=0x55b521c54dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:20.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.379+0000 7f7b6206bb80 1 -- 172.21.15.37:0/1594888053 shutdown_connections 2023-07-14T15:58:20.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.379+0000 7f7b6206bb80 1 -- 172.21.15.37:0/1594888053 wait complete. 2023-07-14T15:58:20.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.380+0000 7f7b6206bb80 1 -- start start 2023-07-14T15:58:20.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.380+0000 7f7b6206bb80 1 Processor -- start 2023-07-14T15:58:20.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.381+0000 7f7b6206bb80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b521c33f00 0x55b521c96560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:20.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.381+0000 7f7b6206bb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b521c342d0 0x55b521ca8980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:20.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.381+0000 7f7b6206bb80 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x55b521c38ea0 0x55b521c96e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:20.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.381+0000 7f7b6206bb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b521c96aa0 con 0x55b521c342d0 2023-07-14T15:58:20.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.381+0000 7f7b6206bb80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b521c979d0 con 0x55b521c33f00 2023-07-14T15:58:20.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.381+0000 7f7b6206bb80 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b521ca7690 con 0x55b521c38ea0 2023-07-14T15:58:20.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.381+0000 7f7b6206bb80 10 client.0 _ll_register_callbacks cb 0x7f7b3c001440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T15:58:20.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.381+0000 7f7b477fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b521c342d0 0x55b521ca8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:20.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.381+0000 7f7b477fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b521c342d0 0x55b521ca8980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45466/0 (socket says 172.21.15.37:45466) 2023-07-14T15:58:20.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.381+0000 7f7b477fe700 1 -- 172.21.15.37:0/1328094733 learned_addr learned my addr 172.21.15.37:0/1328094733 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:20.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.381+0000 7f7b47fff700 1 --2- 172.21.15.37:0/1328094733 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b521c33f00 0x55b521c96560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:20.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.381+0000 7f7b4cd9c700 1 --2- 172.21.15.37:0/1328094733 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x55b521c38ea0 0x55b521c96e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:20.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.382+0000 7f7b477fe700 1 -- 172.21.15.37:0/1328094733 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x55b521c38ea0 msgr2=0x55b521c96e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:20.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.382+0000 7f7b477fe700 1 --2- 172.21.15.37:0/1328094733 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x55b521c38ea0 0x55b521c96e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:20.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.382+0000 7f7b477fe700 1 -- 172.21.15.37:0/1328094733 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b521c33f00 msgr2=0x55b521c96560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:20.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.382+0000 7f7b477fe700 1 --2- 172.21.15.37:0/1328094733 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b521c33f00 0x55b521c96560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:20.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.382+0000 7f7b477fe700 1 -- 172.21.15.37:0/1328094733 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b521975c10 con 0x55b521c342d0 2023-07-14T15:58:20.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.382+0000 7f7b4cd9c700 1 --2- 172.21.15.37:0/1328094733 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x55b521c38ea0 0x55b521c96e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:58:20.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.382+0000 7f7b477fe700 1 --2- 172.21.15.37:0/1328094733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b521c342d0 0x55b521ca8980 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c025040 tx=0x7f7b3c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ccf2c599795a1b1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:20.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.382+0000 7f7b26ffd700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-07-14T15:58:20.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.382+0000 7f7b26ffd700 1 -- 172.21.15.37:0/1328094733 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c0159f0 con 0x55b521c342d0 2023-07-14T15:58:20.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.382+0000 7f7b26ffd700 1 -- 172.21.15.37:0/1328094733 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(49..49 src has 1..49) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7b3c02f840 con 0x55b521c342d0 2023-07-14T15:58:20.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.382+0000 7f7b6206bb80 1 -- 172.21.15.37:0/1328094733 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7b4000dcb0 con 0x55b521c342d0 2023-07-14T15:58:20.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.382+0000 7f7b26ffd700 1 -- 172.21.15.37:0/1328094733 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b3c015b50 con 0x55b521c342d0 2023-07-14T15:58:20.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.382+0000 7f7b6206bb80 10 client.5823 fetch_fsmap learned FSMap version 25 2023-07-14T15:58:20.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.382+0000 7f7b6206bb80 1 -- 172.21.15.37:0/1328094733 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x55b52198b260 con 0x55b521c342d0 2023-07-14T15:58:20.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.382+0000 7f7b26ffd700 1 -- 172.21.15.37:0/1328094733 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3c044070 con 0x55b521c342d0 2023-07-14T15:58:20.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.383+0000 7f7b26ffd700 1 -- 172.21.15.37:0/1328094733 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f7b3c03e060 con 0x55b521c342d0 2023-07-14T15:58:20.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.383+0000 7f7b6206bb80 10 client.5823 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T15:58:20.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.383+0000 7f7b6206bb80 10 client.5823 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-14T15:58:20.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.383+0000 7f7b6206bb80 20 client.5823 populate_metadata read hostname 'smithi037' 2023-07-14T15:58:20.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.383+0000 7f7b6206bb80 1 --2- 172.21.15.37:0/1328094733 >> [v2:172.21.15.37:6834/4236968434,v1:172.21.15.37:6835/4236968434] conn(0x55b521c32870 0x55b521c0d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:20.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.383+0000 7f7b6206bb80 4 client.5823 mds_command: new command op to 5652 tid=0[{"prefix": "status"}] 2023-07-14T15:58:20.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.383+0000 7f7b6206bb80 1 -- 172.21.15.37:0/1328094733 --> [v2:172.21.15.37:6834/4236968434,v1:172.21.15.37:6835/4236968434] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b521b1a000 con 0x55b521c32870 2023-07-14T15:58:20.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.383+0000 7f7b47fff700 1 --2- 172.21.15.37:0/1328094733 >> [v2:172.21.15.37:6834/4236968434,v1:172.21.15.37:6835/4236968434] conn(0x55b521c32870 0x55b521c0d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:20.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.383+0000 7f7b26ffd700 10 client.5823 ms_handle_connect on v2:172.21.15.37:6834/4236968434 2023-07-14T15:58:20.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.383+0000 7f7b47fff700 1 --2- 172.21.15.37:0/1328094733 >> [v2:172.21.15.37:6834/4236968434,v1:172.21.15.37:6835/4236968434] conn(0x55b521c32870 0x55b521c0d3e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7885fc3e66d0a970 server_cookie=f0debe9f1bf2402b in_seq=0 out_seq=0 2023-07-14T15:58:20.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.383+0000 7f7b26ffd700 1 -- 172.21.15.37:0/1328094733 <== mds.0 v2:172.21.15.37:6834/4236968434 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55b521b1a000 con 0x55b521c32870 2023-07-14T15:58:20.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.384+0000 7f7b26ffd700 10 client.5823 handle_command_reply: tid=0 2023-07-14T15:58:20.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.384+0000 7f7b6206bb80 1 client.5823 shutdown 2023-07-14T15:58:20.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.384+0000 7f7b6206bb80 1 -- 172.21.15.37:0/1328094733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b521c342d0 msgr2=0x55b521ca8980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:20.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.384+0000 7f7b6206bb80 1 --2- 172.21.15.37:0/1328094733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b521c342d0 0x55b521ca8980 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c025040 tx=0x7f7b3c000ed0 comp rx=0 tx=0).stop 2023-07-14T15:58:20.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.384+0000 7f7b6206bb80 1 -- 172.21.15.37:0/1328094733 shutdown_connections 2023-07-14T15:58:20.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.384+0000 7f7b6206bb80 1 --2- 172.21.15.37:0/1328094733 >> [v2:172.21.15.37:6834/4236968434,v1:172.21.15.37:6835/4236968434] conn(0x55b521c32870 0x55b521c0d3e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:20.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.384+0000 7f7b6206bb80 1 --2- 172.21.15.37:0/1328094733 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b521c33f00 0x55b521c96560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:20.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.384+0000 7f7b6206bb80 1 --2- 172.21.15.37:0/1328094733 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x55b521c38ea0 0x55b521c96e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:20.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.384+0000 7f7b26ffd700 0 client.5823 ms_handle_reset on v2:172.21.15.37:6834/4236968434 2023-07-14T15:58:20.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.384+0000 7f7b6206bb80 1 --2- 172.21.15.37:0/1328094733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b521c342d0 0x55b521ca8980 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:20.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.384+0000 7f7b6206bb80 1 -- 172.21.15.37:0/1328094733 >> 172.21.15.37:0/1328094733 conn(0x55b521c02b90 msgr2=0x55b521c346a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:20.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.384+0000 7f7b6206bb80 1 -- 172.21.15.37:0/1328094733 shutdown_connections 2023-07-14T15:58:20.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.384+0000 7f7b6206bb80 1 -- 172.21.15.37:0/1328094733 wait complete. 2023-07-14T15:58:20.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.384+0000 7f7b6206bb80 20 client.5823 trim_cache size 0 max 16384 2023-07-14T15:58:20.378 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-14T15:58:20.378 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "9da30401-a779-4e46-aba6-00c2494c6c67", 2023-07-14T15:58:20.378 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2023-07-14T15:58:20.378 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 5652, 2023-07-14T15:58:20.378 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2023-07-14T15:58:20.379 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2023-07-14T15:58:20.379 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2023-07-14T15:58:20.379 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 11.672003183999999, 2023-07-14T15:58:20.379 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 25, 2023-07-14T15:58:20.379 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 49, 2023-07-14T15:58:20.379 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 49, 2023-07-14T15:58:20.379 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 17.715339427 2023-07-14T15:58:20.379 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-14T15:58:20.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.385+0000 7f7b4e7ff700 1 -- 172.21.15.37:0/2446658892 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f7b3406ad70 msgr2=0x7f7b3406d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:20.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.385+0000 7f7b4e7ff700 1 --2- 172.21.15.37:0/2446658892 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f7b3406ad70 0x7f7b3406d220 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7b480aea10 tx=0x7f7b3c007a40 comp rx=0 tx=0).stop 2023-07-14T15:58:20.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.385+0000 7f7b4e7ff700 1 -- 172.21.15.37:0/2446658892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b480adfe0 msgr2=0x7f7b48152230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:20.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.385+0000 7f7b4e7ff700 1 --2- 172.21.15.37:0/2446658892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b480adfe0 0x7f7b48152230 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f7b3800d800 tx=0x7f7b3800dbc0 comp rx=0 tx=0).stop 2023-07-14T15:58:20.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.385+0000 7f7b4e7ff700 1 -- 172.21.15.37:0/2446658892 shutdown_connections 2023-07-14T15:58:20.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.385+0000 7f7b4e7ff700 1 --2- 172.21.15.37:0/2446658892 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b480cda10 0x7f7b480ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:20.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.385+0000 7f7b4e7ff700 1 --2- 172.21.15.37:0/2446658892 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f7b3406ad70 0x7f7b3406d220 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:20.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.385+0000 7f7b4e7ff700 1 --2- 172.21.15.37:0/2446658892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b480adfe0 0x7f7b48152230 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:20.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.385+0000 7f7b4e7ff700 1 --2- 172.21.15.37:0/2446658892 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f7b480cbbf0 0x7f7b480b38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:20.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.385+0000 7f7b4e7ff700 1 -- 172.21.15.37:0/2446658892 >> 172.21.15.37:0/2446658892 conn(0x7f7b480b0620 msgr2=0x7f7b480b09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:20.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.385+0000 7f7b4e7ff700 1 -- 172.21.15.37:0/2446658892 shutdown_connections 2023-07-14T15:58:20.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.385+0000 7f7b4e7ff700 1 -- 172.21.15.37:0/2446658892 wait complete. 2023-07-14T15:58:20.387 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-14T15:58:20.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.604+0000 7f060abff700 1 Processor -- start 2023-07-14T15:58:20.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.605+0000 7f060abff700 1 -- start start 2023-07-14T15:58:20.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.606+0000 7f060abff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f06040cffc0 0x7f06040b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:20.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.606+0000 7f060abff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06040d0de0 con 0x7f06040b8b80 2023-07-14T15:58:20.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.606+0000 7f060abff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06041610f0 con 0x7f0604160c50 2023-07-14T15:58:20.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.606+0000 7f060abff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06040cd590 con 0x7f06040cffc0 2023-07-14T15:58:20.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.606+0000 7f060899b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f06040b8b80 0x7f06040cf8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58432/0 (socket says 172.21.15.37:58432) 2023-07-14T15:58:20.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.606+0000 7f060899b700 1 -- 172.21.15.37:0/2610954858 learned_addr learned my addr 172.21.15.37:0/2610954858 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:58:20.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.606+0000 7f0603fff700 1 --2- 172.21.15.37:0/2610954858 >> v2:172.21.15.98:3300/0 conn(0x7f06040cffc0 0x7f06040b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:20.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.606+0000 7f06037fe700 1 -- 172.21.15.37:0/2610954858 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1181228100 0 0) 0x7f06040d0de0 con 0x7f06040b8b80 2023-07-14T15:58:20.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.606+0000 7f06037fe700 1 -- 172.21.15.37:0/2610954858 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05f40035b0 con 0x7f06040b8b80 2023-07-14T15:58:20.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.607+0000 7f06037fe700 1 -- 172.21.15.37:0/2610954858 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 585455050 0 0) 0x7f06041610f0 con 0x7f0604160c50 2023-07-14T15:58:20.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.607+0000 7f06037fe700 1 -- 172.21.15.37:0/2610954858 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06040d0de0 con 0x7f0604160c50 2023-07-14T15:58:20.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.607+0000 7f0603fff700 1 -- 172.21.15.37:0/2610954858 >> v1:172.21.15.98:6789/0 conn(0x7f0604160c50 legacy=0x7f06040d1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:20.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.607+0000 7f0603fff700 1 -- 172.21.15.37:0/2610954858 >> v1:172.21.15.37:6789/0 conn(0x7f06040b8b80 legacy=0x7f06040cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:20.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.607+0000 7f0603fff700 1 -- 172.21.15.37:0/2610954858 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06040cd870 con 0x7f06040cffc0 2023-07-14T15:58:20.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.607+0000 7f0603fff700 1 --2- 172.21.15.37:0/2610954858 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06040cffc0 0x7f06040b5cf0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f05f0009840 tx=0x7f05f0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e03f08a313a7a046 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:20.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.607+0000 7f06037fe700 1 -- 172.21.15.37:0/2610954858 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f0011830 con 0x7f06040cffc0 2023-07-14T15:58:20.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.607+0000 7f06037fe700 1 -- 172.21.15.37:0/2610954858 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f0011990 con 0x7f06040cffc0 2023-07-14T15:58:20.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.607+0000 7f06037fe700 1 -- 172.21.15.37:0/2610954858 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f0011d20 con 0x7f06040cffc0 2023-07-14T15:58:20.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.608+0000 7f060abff700 1 -- 172.21.15.37:0/2610954858 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06040cffc0 msgr2=0x7f06040b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:20.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.608+0000 7f060abff700 1 --2- 172.21.15.37:0/2610954858 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06040cffc0 0x7f06040b5cf0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f05f0009840 tx=0x7f05f0009b50 comp rx=0 tx=0).stop 2023-07-14T15:58:20.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.608+0000 7f060abff700 1 -- 172.21.15.37:0/2610954858 shutdown_connections 2023-07-14T15:58:20.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.608+0000 7f060abff700 1 --2- 172.21.15.37:0/2610954858 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06040cffc0 0x7f06040b5cf0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:20.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.608+0000 7f060abff700 1 -- 172.21.15.37:0/2610954858 >> 172.21.15.37:0/2610954858 conn(0x7f060406b150 msgr2=0x7f060406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:20.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.608+0000 7f060abff700 1 -- 172.21.15.37:0/2610954858 shutdown_connections 2023-07-14T15:58:20.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.608+0000 7f060abff700 1 -- 172.21.15.37:0/2610954858 wait complete. 2023-07-14T15:58:20.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.610+0000 7f060abff700 1 Processor -- start 2023-07-14T15:58:20.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.610+0000 7f060abff700 1 -- start start 2023-07-14T15:58:20.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.611+0000 7f060abff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f06040b8b80 0x7f060415b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:20.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.611+0000 7f060abff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06040cffc0 0x7f06040cbb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:20.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.611+0000 7f060abff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0604160c50 0x7f06040c9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:20.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.611+0000 7f060abff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060415b740 con 0x7f06040cffc0 2023-07-14T15:58:20.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.611+0000 7f060abff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06040c8a10 con 0x7f0604160c50 2023-07-14T15:58:20.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.611+0000 7f060abff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06040caac0 con 0x7f06040b8b80 2023-07-14T15:58:20.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.611+0000 7f0603fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06040cffc0 0x7f06040cbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:20.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.611+0000 7f0603fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06040cffc0 0x7f06040cbb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45474/0 (socket says 172.21.15.37:45474) 2023-07-14T15:58:20.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.611+0000 7f0603fff700 1 -- 172.21.15.37:0/2967172573 learned_addr learned my addr 172.21.15.37:0/2967172573 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:20.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.611+0000 7f0603fff700 1 -- 172.21.15.37:0/2967172573 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f06040b8b80 msgr2=0x7f060415b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:20.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.611+0000 7f0603fff700 1 --2- 172.21.15.37:0/2967172573 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f06040b8b80 0x7f060415b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:20.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.611+0000 7f0603fff700 1 -- 172.21.15.37:0/2967172573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0604160c50 msgr2=0x7f06040c9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:20.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.611+0000 7f0603fff700 1 --2- 172.21.15.37:0/2967172573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0604160c50 0x7f06040c9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:20.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.611+0000 7f0603fff700 1 -- 172.21.15.37:0/2967172573 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f00094a0 con 0x7f06040cffc0 2023-07-14T15:58:20.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.612+0000 7f0603fff700 1 --2- 172.21.15.37:0/2967172573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06040cffc0 0x7f06040cbb60 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f05f0009b90 tx=0x7f05f0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:20.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.612+0000 7f06017fa700 1 -- 172.21.15.37:0/2967172573 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f001a860 con 0x7f06040cffc0 2023-07-14T15:58:20.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.612+0000 7f06017fa700 1 -- 172.21.15.37:0/2967172573 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f001a9c0 con 0x7f06040cffc0 2023-07-14T15:58:20.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.612+0000 7f06017fa700 1 -- 172.21.15.37:0/2967172573 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f001ad30 con 0x7f06040cffc0 2023-07-14T15:58:20.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.612+0000 7f060abff700 1 -- 172.21.15.37:0/2967172573 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06040cada0 con 0x7f06040cffc0 2023-07-14T15:58:20.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.612+0000 7f060abff700 1 -- 172.21.15.37:0/2967172573 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06040cb360 con 0x7f06040cffc0 2023-07-14T15:58:20.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.613+0000 7f060abff700 1 -- 172.21.15.37:0/2967172573 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0604067840 con 0x7f06040cffc0 2023-07-14T15:58:20.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.614+0000 7f06017fa700 1 -- 172.21.15.37:0/2967172573 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f05f0022070 con 0x7f06040cffc0 2023-07-14T15:58:20.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.615+0000 7f06017fa700 1 --2- 172.21.15.37:0/2967172573 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f05e806ad70 0x7f05e806d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:20.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.615+0000 7f06017fa700 1 -- 172.21.15.37:0/2967172573 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f05f008a230 con 0x7f06040cffc0 2023-07-14T15:58:20.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.616+0000 7f060899b700 1 --2- 172.21.15.37:0/2967172573 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f05e806ad70 0x7f05e806d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:20.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.616+0000 7f060899b700 1 --2- 172.21.15.37:0/2967172573 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f05e806ad70 0x7f05e806d220 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f05f8005910 tx=0x7f05f80079e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:20.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.619+0000 7f06017fa700 1 -- 172.21.15.37:0/2967172573 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f05f0055330 con 0x7f06040cffc0 2023-07-14T15:58:20.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.873+0000 7f060abff700 1 -- 172.21.15.37:0/2967172573 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f060406c9b0 con 0x7f06040cffc0 2023-07-14T15:58:20.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.873+0000 7f06017fa700 1 -- 172.21.15.37:0/2967172573 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) v1 ==== 53+0+73 (secure 0 0 0) 0x7f05f0058950 con 0x7f06040cffc0 2023-07-14T15:58:20.858 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-14T15:58:20.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.876+0000 7f060abff700 1 -- 172.21.15.37:0/2967172573 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f05e806ad70 msgr2=0x7f05e806d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:20.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.876+0000 7f060abff700 1 --2- 172.21.15.37:0/2967172573 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f05e806ad70 0x7f05e806d220 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f05f8005910 tx=0x7f05f80079e0 comp rx=0 tx=0).stop 2023-07-14T15:58:20.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.876+0000 7f060abff700 1 -- 172.21.15.37:0/2967172573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06040cffc0 msgr2=0x7f06040cbb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:20.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.876+0000 7f060abff700 1 --2- 172.21.15.37:0/2967172573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06040cffc0 0x7f06040cbb60 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f05f0009b90 tx=0x7f05f0004750 comp rx=0 tx=0).stop 2023-07-14T15:58:20.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.876+0000 7f060abff700 1 -- 172.21.15.37:0/2967172573 shutdown_connections 2023-07-14T15:58:20.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.876+0000 7f060abff700 1 --2- 172.21.15.37:0/2967172573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0604160c50 0x7f06040c9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:20.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.876+0000 7f060abff700 1 --2- 172.21.15.37:0/2967172573 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f05e806ad70 0x7f05e806d220 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:20.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.876+0000 7f060abff700 1 --2- 172.21.15.37:0/2967172573 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f06040b8b80 0x7f060415b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:20.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.876+0000 7f060abff700 1 --2- 172.21.15.37:0/2967172573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06040cffc0 0x7f06040cbb60 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:20.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.876+0000 7f060abff700 1 -- 172.21.15.37:0/2967172573 >> 172.21.15.37:0/2967172573 conn(0x7f060406b150 msgr2=0x7f060415cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:20.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.876+0000 7f060abff700 1 -- 172.21.15.37:0/2967172573 shutdown_connections 2023-07-14T15:58:20.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:20.876+0000 7f060abff700 1 -- 172.21.15.37:0/2967172573 wait complete. 2023-07-14T15:58:20.878 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-14T15:58:20.878 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-14T15:58:20.879 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2023-07-14T15:58:20.879 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-14T15:58:20.879 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-14T15:58:20.879 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-14T15:58:20.880 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-14T15:58:20.880 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-14T15:58:20.880 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-14T15:58:20.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:58:20.881 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2023-07-14T15:58:20.926 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T15:58:20.926 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T15:58:20.926 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T15:58:20.927 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:58:20.927 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-07-14T15:58:20.927 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:58:20.927 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T15:58:20.928 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2023-07-14T15:58:20.928 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2023-07-14T15:58:20.928 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T15:58:20.929 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2023-07-14T15:58:20.929 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2023-07-14T15:58:20.929 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-14T15:58:20.929 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2023-07-14T15:58:20.930 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2023-07-14T15:58:20.930 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-07-14T15:58:20.930 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 41937sec preferred_lft 41937sec 2023-07-14T15:58:20.930 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2023-07-14T15:58:20.931 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:58:20.931 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T15:58:20.931 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2023-07-14T15:58:20.931 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2023-07-14T15:58:20.932 INFO:teuthology.orchestra.run.smithi037.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-14T15:58:20.932 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 96:4b:9b:4c:a1:a6 brd ff:ff:ff:ff:ff:ff 2023-07-14T15:58:20.932 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-14T15:58:20.932 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:58:20.933 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::bcee:35ff:fe0f:4eb1/64 scope link 2023-07-14T15:58:20.933 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:58:20.933 INFO:teuthology.orchestra.run.smithi037.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T15:58:20.933 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 96:4b:9b:4c:a1:a6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-14T15:58:20.934 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::944b:9bff:fe4c:a1a6/64 scope link 2023-07-14T15:58:20.935 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:58:20.935 INFO:teuthology.orchestra.run.smithi037.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T15:58:20.935 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether f6:22:24:13:98:79 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-14T15:58:20.935 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::f422:24ff:fe13:9879/64 scope link 2023-07-14T15:58:20.936 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:58:20.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:58:20.937 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-14T15:58:21.035 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-07-14T15:58:21.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:58:21.037 DEBUG:teuthology.orchestra.run.smithi037:> route 2023-07-14T15:58:21.083 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2023-07-14T15:58:21.083 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-14T15:58:21.083 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-07-14T15:58:21.084 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-07-14T15:58:21.084 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-14T15:58:21.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:58:21.085 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-07-14T15:58:21.086 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-07-14T15:58:21.086 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-14T15:58:21.086 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-14T15:58:21.087 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-14T15:58:21.087 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-07-14T15:58:21.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:58:21.299 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-07-14T15:58:21.344 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-14T15:58:21.345 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-14T15:58:21.345 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-14T15:58:21.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:58:21.346 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2023-07-14T15:58:21.453 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T15:58:21.454 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-14T15:58:21.497 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-14T15:58:21.498 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T15:58:21.498 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-14T15:58:21.580 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-07-14T15:58:21.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:58:21.581 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T15:58:21.726 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T15:58:21.726 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-14T15:58:21.757 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T15:58:21.757 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-14T15:58:21.757 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.98:3300,172.21.15.98:3301" 2023-07-14T15:58:21.758 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with new device syntax: 0@9da30401-a779-4e46-aba6-00c2494c6c67.cephfs=/ 2023-07-14T15:58:21.758 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.37:3300/172.21.15.98:3300/172.21.15.98:3301" will pass to kernel 2023-07-14T15:58:21.763 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-14T15:58:21.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:58:21.764 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-14T15:58:21.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:58:21.835 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T15:58:21.935 INFO:teuthology.orchestra.run.smithi037.stdout:client5647 2023-07-14T15:58:21.935 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-14T15:58:21.936 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T15:58:21.979 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-14T15:58:22.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.236+0000 7f1f347ff700 1 Processor -- start 2023-07-14T15:58:22.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.236+0000 7f1f347ff700 1 -- start start 2023-07-14T15:58:22.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.237+0000 7f1f347ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f1f2c0b01a0 0x7f1f2c0cb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:22.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.237+0000 7f1f347ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1f2c1603d0 0x7f1f2c0cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:22.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.237+0000 7f1f347ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f2c0cb800 con 0x7f1f2c0cfc90 2023-07-14T15:58:22.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.237+0000 7f1f347ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f2c0b0570 con 0x7f1f2c1603d0 2023-07-14T15:58:22.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.237+0000 7f1f347ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2c15cca0 con 0x7f1f2c0b01a0 2023-07-14T15:58:22.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.238+0000 7f1f31d9a700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1f2c1603d0 0x7f1f2c0cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:22.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.238+0000 7f1f32d9c700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f1f2c0cfc90 0x7f1f2c0d00b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.37:60820/0 (socket says 172.21.15.37:60820) 2023-07-14T15:58:22.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.238+0000 7f1f3259b700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f1f2c0b01a0 0x7f1f2c0cb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:22.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.238+0000 7f1f32d9c700 1 -- 172.21.15.37:0/2048311354 learned_addr learned my addr 172.21.15.37:0/2048311354 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:58:22.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.238+0000 7f1f31599700 1 -- 172.21.15.37:0/2048311354 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4076024167 0 0) 0x7f1f2c0cb800 con 0x7f1f2c0cfc90 2023-07-14T15:58:22.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.238+0000 7f1f31599700 1 -- 172.21.15.37:0/2048311354 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f180035b0 con 0x7f1f2c0cfc90 2023-07-14T15:58:22.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.239+0000 7f1f3259b700 1 -- 172.21.15.37:0/2048311354 >> v2:172.21.15.98:3300/0 conn(0x7f1f2c1603d0 msgr2=0x7f1f2c0cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:22.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.239+0000 7f1f3259b700 1 --2- 172.21.15.37:0/2048311354 >> v2:172.21.15.98:3300/0 conn(0x7f1f2c1603d0 0x7f1f2c0cf530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:22.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.239+0000 7f1f3259b700 1 -- 172.21.15.37:0/2048311354 >> v1:172.21.15.98:6789/0 conn(0x7f1f2c0cfc90 legacy=0x7f1f2c0d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:22.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.239+0000 7f1f3259b700 1 -- 172.21.15.37:0/2048311354 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f2c0b29d0 con 0x7f1f2c0b01a0 2023-07-14T15:58:22.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.239+0000 7f1f31d9a700 1 --2- 172.21.15.37:0/2048311354 >> v2:172.21.15.98:3300/0 conn(0x7f1f2c1603d0 0x7f1f2c0cf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:58:22.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.239+0000 7f1f3259b700 1 --2- 172.21.15.37:0/2048311354 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f1f2c0b01a0 0x7f1f2c0cb2c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1f28009840 tx=0x7f1f28009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad2424b08b3bab4f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:22.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.239+0000 7f1f31599700 1 -- 172.21.15.37:0/2048311354 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f28011830 con 0x7f1f2c0b01a0 2023-07-14T15:58:22.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.239+0000 7f1f31599700 1 -- 172.21.15.37:0/2048311354 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f28011990 con 0x7f1f2c0b01a0 2023-07-14T15:58:22.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.239+0000 7f1f31599700 1 -- 172.21.15.37:0/2048311354 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f28011d20 con 0x7f1f2c0b01a0 2023-07-14T15:58:22.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.240+0000 7f1f347ff700 1 -- 172.21.15.37:0/2048311354 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f1f2c0b01a0 msgr2=0x7f1f2c0cb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:22.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.240+0000 7f1f347ff700 1 --2- 172.21.15.37:0/2048311354 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f1f2c0b01a0 0x7f1f2c0cb2c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1f28009840 tx=0x7f1f28009b50 comp rx=0 tx=0).stop 2023-07-14T15:58:22.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.240+0000 7f1f347ff700 1 -- 172.21.15.37:0/2048311354 shutdown_connections 2023-07-14T15:58:22.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.240+0000 7f1f347ff700 1 --2- 172.21.15.37:0/2048311354 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f1f2c0b01a0 0x7f1f2c0cb2c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:22.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.240+0000 7f1f347ff700 1 --2- 172.21.15.37:0/2048311354 >> v2:172.21.15.98:3300/0 conn(0x7f1f2c1603d0 0x7f1f2c0cf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:22.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.240+0000 7f1f347ff700 1 -- 172.21.15.37:0/2048311354 >> 172.21.15.37:0/2048311354 conn(0x7f1f2c065bd0 msgr2=0x7f1f2c065fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:22.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.240+0000 7f1f347ff700 1 -- 172.21.15.37:0/2048311354 shutdown_connections 2023-07-14T15:58:22.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.240+0000 7f1f347ff700 1 -- 172.21.15.37:0/2048311354 wait complete. 2023-07-14T15:58:22.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.242+0000 7f1f347ff700 1 Processor -- start 2023-07-14T15:58:22.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.242+0000 7f1f347ff700 1 -- start start 2023-07-14T15:58:22.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.243+0000 7f1f347ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f2c0b01a0 0x7f1f2c1f2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:22.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.243+0000 7f1f347ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f2c0cfc90 0x7f1f2c1f51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:22.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.243+0000 7f1f347ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f1f2c1603d0 0x7f1f2c0b5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:22.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.243+0000 7f1f347ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2c0b6180 con 0x7f1f2c0cfc90 2023-07-14T15:58:22.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.243+0000 7f1f347ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2c15cfa0 con 0x7f1f2c0b01a0 2023-07-14T15:58:22.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.243+0000 7f1f347ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2c15d280 con 0x7f1f2c1603d0 2023-07-14T15:58:22.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.243+0000 7f1f31d9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f2c0cfc90 0x7f1f2c1f51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:22.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.243+0000 7f1f31d9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f2c0cfc90 0x7f1f2c1f51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45490/0 (socket says 172.21.15.37:45490) 2023-07-14T15:58:22.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.243+0000 7f1f31d9a700 1 -- 172.21.15.37:0/1224323778 learned_addr learned my addr 172.21.15.37:0/1224323778 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:22.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.243+0000 7f1f32d9c700 1 --2- 172.21.15.37:0/1224323778 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f1f2c1603d0 0x7f1f2c0b5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:22.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.243+0000 7f1f3259b700 1 --2- 172.21.15.37:0/1224323778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f2c0b01a0 0x7f1f2c1f2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:22.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.244+0000 7f1f31d9a700 1 -- 172.21.15.37:0/1224323778 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f1f2c1603d0 msgr2=0x7f1f2c0b5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:22.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.244+0000 7f1f31d9a700 1 --2- 172.21.15.37:0/1224323778 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f1f2c1603d0 0x7f1f2c0b5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:22.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.244+0000 7f1f31d9a700 1 -- 172.21.15.37:0/1224323778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f2c0b01a0 msgr2=0x7f1f2c1f2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:22.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.244+0000 7f1f31d9a700 1 --2- 172.21.15.37:0/1224323778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f2c0b01a0 0x7f1f2c1f2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:22.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.244+0000 7f1f31d9a700 1 -- 172.21.15.37:0/1224323778 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f1c0094a0 con 0x7f1f2c0cfc90 2023-07-14T15:58:22.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.244+0000 7f1f31d9a700 1 --2- 172.21.15.37:0/1224323778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f2c0cfc90 0x7f1f2c1f51d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c00ebe0 tx=0x7f1f1c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:22.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.244+0000 7f1f22ffd700 1 -- 172.21.15.37:0/1224323778 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c009760 con 0x7f1f2c0cfc90 2023-07-14T15:58:22.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.244+0000 7f1f22ffd700 1 -- 172.21.15.37:0/1224323778 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f1c00c850 con 0x7f1f2c0cfc90 2023-07-14T15:58:22.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.244+0000 7f1f22ffd700 1 -- 172.21.15.37:0/1224323778 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c00cbe0 con 0x7f1f2c0cfc90 2023-07-14T15:58:22.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.244+0000 7f1f347ff700 1 -- 172.21.15.37:0/1224323778 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f280094a0 con 0x7f1f2c0cfc90 2023-07-14T15:58:22.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.244+0000 7f1f347ff700 1 -- 172.21.15.37:0/1224323778 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f2c15d840 con 0x7f1f2c0cfc90 2023-07-14T15:58:22.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.246+0000 7f1f347ff700 1 -- 172.21.15.37:0/1224323778 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f2c06d8c0 con 0x7f1f2c0cfc90 2023-07-14T15:58:22.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.247+0000 7f1f22ffd700 1 -- 172.21.15.37:0/1224323778 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f1f1c00cd40 con 0x7f1f2c0cfc90 2023-07-14T15:58:22.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.248+0000 7f1f22ffd700 1 --2- 172.21.15.37:0/1224323778 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f1f1006ad70 0x7f1f1006d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:22.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.248+0000 7f1f22ffd700 1 -- 172.21.15.37:0/1224323778 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1f1c0894d0 con 0x7f1f2c0cfc90 2023-07-14T15:58:22.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.248+0000 7f1f3259b700 1 --2- 172.21.15.37:0/1224323778 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f1f1006ad70 0x7f1f1006d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:22.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.249+0000 7f1f3259b700 1 --2- 172.21.15.37:0/1224323778 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f1f1006ad70 0x7f1f1006d220 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1f28000c00 tx=0x7f1f28008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:22.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.252+0000 7f1f22ffd700 1 -- 172.21.15.37:0/1224323778 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1f1c054520 con 0x7f1f2c0cfc90 2023-07-14T15:58:22.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.508+0000 7f1f347ff700 1 -- 172.21.15.37:0/1224323778 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1f2c067840 con 0x7f1f2c0cfc90 2023-07-14T15:58:22.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.509+0000 7f1f22ffd700 1 -- 172.21.15.37:0/1224323778 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1f1c057b40 con 0x7f1f2c0cfc90 2023-07-14T15:58:22.496 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-14T15:58:22.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.511+0000 7f1f347ff700 1 -- 172.21.15.37:0/1224323778 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f1f1006ad70 msgr2=0x7f1f1006d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:22.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.511+0000 7f1f347ff700 1 --2- 172.21.15.37:0/1224323778 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f1f1006ad70 0x7f1f1006d220 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1f28000c00 tx=0x7f1f28008030 comp rx=0 tx=0).stop 2023-07-14T15:58:22.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.511+0000 7f1f347ff700 1 -- 172.21.15.37:0/1224323778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f2c0cfc90 msgr2=0x7f1f2c1f51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:22.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.511+0000 7f1f347ff700 1 --2- 172.21.15.37:0/1224323778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f2c0cfc90 0x7f1f2c1f51d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c00ebe0 tx=0x7f1f1c00eef0 comp rx=0 tx=0).stop 2023-07-14T15:58:22.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.511+0000 7f1f347ff700 1 -- 172.21.15.37:0/1224323778 shutdown_connections 2023-07-14T15:58:22.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.511+0000 7f1f347ff700 1 --2- 172.21.15.37:0/1224323778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f2c0b01a0 0x7f1f2c1f2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:22.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.511+0000 7f1f347ff700 1 --2- 172.21.15.37:0/1224323778 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f1f1006ad70 0x7f1f1006d220 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:22.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.511+0000 7f1f347ff700 1 --2- 172.21.15.37:0/1224323778 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f1f2c1603d0 0x7f1f2c0b5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:22.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.511+0000 7f1f347ff700 1 --2- 172.21.15.37:0/1224323778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f2c0cfc90 0x7f1f2c1f51d0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:22.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.511+0000 7f1f347ff700 1 -- 172.21.15.37:0/1224323778 >> 172.21.15.37:0/1224323778 conn(0x7f1f2c065bd0 msgr2=0x7f1f2c06c530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:22.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.511+0000 7f1f347ff700 1 -- 172.21.15.37:0/1224323778 shutdown_connections 2023-07-14T15:58:22.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:22.511+0000 7f1f347ff700 1 -- 172.21.15.37:0/1224323778 wait complete. 2023-07-14T15:58:22.514 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-14T15:58:22.515 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-14T15:58:22.515 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi098.front.sepia.ceph.com 2023-07-14T15:58:22.515 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-14T15:58:22.516 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-14T15:58:22.516 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-14T15:58:22.516 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-14T15:58:22.517 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-14T15:58:22.517 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-14T15:58:22.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:58:22.518 DEBUG:teuthology.orchestra.run.smithi098:> ip addr 2023-07-14T15:58:22.567 INFO:teuthology.orchestra.run.smithi098.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T15:58:22.567 INFO:teuthology.orchestra.run.smithi098.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T15:58:22.568 INFO:teuthology.orchestra.run.smithi098.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T15:58:22.568 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:58:22.568 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 ::1/128 scope host 2023-07-14T15:58:22.568 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:58:22.568 INFO:teuthology.orchestra.run.smithi098.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T15:58:22.568 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b8 brd ff:ff:ff:ff:ff:ff 2023-07-14T15:58:22.571 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f0 2023-07-14T15:58:22.572 INFO:teuthology.orchestra.run.smithi098.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T15:58:22.572 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b9 brd ff:ff:ff:ff:ff:ff 2023-07-14T15:58:22.572 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f1 2023-07-14T15:58:22.572 INFO:teuthology.orchestra.run.smithi098.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T15:58:22.572 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6a brd ff:ff:ff:ff:ff:ff 2023-07-14T15:58:22.572 INFO:teuthology.orchestra.run.smithi098.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-14T15:58:22.572 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6b brd ff:ff:ff:ff:ff:ff 2023-07-14T15:58:22.573 INFO:teuthology.orchestra.run.smithi098.stdout: inet 172.21.15.98/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-14T15:58:22.573 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft 41951sec preferred_lft 41951sec 2023-07-14T15:58:22.573 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::9888:7b88:1642:cf3d/64 scope link noprefixroute 2023-07-14T15:58:22.573 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:58:22.573 INFO:teuthology.orchestra.run.smithi098.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-14T15:58:22.573 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 4a:c5:e7:d2:66:a2 brd ff:ff:ff:ff:ff:ff 2023-07-14T15:58:22.573 INFO:teuthology.orchestra.run.smithi098.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-14T15:58:22.574 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:58:22.574 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::80a1:17ff:febf:8ddc/64 scope link 2023-07-14T15:58:22.574 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:58:22.574 INFO:teuthology.orchestra.run.smithi098.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T15:58:22.574 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether f6:48:a1:0d:45:34 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-14T15:58:22.574 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::f448:a1ff:fe0d:4534/64 scope link 2023-07-14T15:58:22.574 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:58:22.574 INFO:teuthology.orchestra.run.smithi098.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T15:58:22.575 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 4a:c5:e7:d2:66:a2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-14T15:58:22.575 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::48c5:e7ff:fed2:66a2/64 scope link 2023-07-14T15:58:22.575 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2023-07-14T15:58:22.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:58:22.576 DEBUG:teuthology.orchestra.run.smithi098:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-14T15:58:22.644 INFO:teuthology.orchestra.run.smithi098.stdout:1 2023-07-14T15:58:22.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:58:22.648 DEBUG:teuthology.orchestra.run.smithi098:> route 2023-07-14T15:58:22.694 INFO:teuthology.orchestra.run.smithi098.stdout:Kernel IP routing table 2023-07-14T15:58:22.694 INFO:teuthology.orchestra.run.smithi098.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-14T15:58:22.695 INFO:teuthology.orchestra.run.smithi098.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-14T15:58:22.695 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-14T15:58:22.695 INFO:teuthology.orchestra.run.smithi098.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-14T15:58:22.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:58:22.696 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec bash -c ' 2023-07-14T15:58:22.696 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2023-07-14T15:58:22.697 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-14T15:58:22.697 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-14T15:58:22.697 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-14T15:58:22.698 DEBUG:teuthology.orchestra.run.smithi098:> ') 2023-07-14T15:58:22.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:58:22.866 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2023-07-14T15:58:22.910 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-07-14T15:58:22.911 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-14T15:58:22.911 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-14T15:58:22.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:58:22.912 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set brx.0 up 2023-07-14T15:58:23.021 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T15:58:23.021 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-14T15:58:23.065 INFO:teuthology.orchestra.run.smithi098.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-14T15:58:23.066 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T15:58:23.066 DEBUG:teuthology.orchestra.run.smithi098:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-14T15:58:23.147 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-07-14T15:58:23.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:58:23.148 DEBUG:teuthology.orchestra.run.smithi098:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T15:58:23.290 INFO:teuthology.orchestra.run.smithi098.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T15:58:23.290 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-14T15:58:23.320 INFO:teuthology.orchestra.run.smithi098.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-14T15:58:23.320 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-14T15:58:23.321 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.98:3300,172.21.15.98:3301" 2023-07-14T15:58:23.321 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: trying mount with new device syntax: 1@9da30401-a779-4e46-aba6-00c2494c6c67.cephfs=/ 2023-07-14T15:58:23.321 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.37:3300/172.21.15.98:3300/172.21.15.98:3301" will pass to kernel 2023-07-14T15:58:23.326 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-14T15:58:23.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:58:23.327 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-14T15:58:23.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:58:23.395 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T15:58:23.480 INFO:teuthology.orchestra.run.smithi098.stdout:client5659 2023-07-14T15:58:23.480 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-14T15:58:23.481 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T15:58:23.523 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-07-14T15:58:23.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.758+0000 7fa25dfff700 1 Processor -- start 2023-07-14T15:58:23.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.758+0000 7fa25dfff700 1 -- start start 2023-07-14T15:58:23.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.759+0000 7fa25dfff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa2580ca650 0x7fa2580c9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:23.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.759+0000 7fa25dfff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2580ce0f0 con 0x7fa25806e290 2023-07-14T15:58:23.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.759+0000 7fa25dfff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2580ce390 con 0x7fa258071f10 2023-07-14T15:58:23.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.759+0000 7fa25dfff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2580cef10 con 0x7fa2580ca650 2023-07-14T15:58:23.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.759+0000 7fa257fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa25806e290 0x7fa25806a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58448/0 (socket says 172.21.15.37:58448) 2023-07-14T15:58:23.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.759+0000 7fa257fff700 1 -- 172.21.15.37:0/1634879635 learned_addr learned my addr 172.21.15.37:0/1634879635 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:58:23.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.759+0000 7fa256ffd700 1 --2- 172.21.15.37:0/1634879635 >> v2:172.21.15.98:3300/0 conn(0x7fa2580ca650 0x7fa2580c9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:23.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.760+0000 7fa2567fc700 1 -- 172.21.15.37:0/1634879635 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2606324214 0 0) 0x7fa2580ce0f0 con 0x7fa25806e290 2023-07-14T15:58:23.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.760+0000 7fa2567fc700 1 -- 172.21.15.37:0/1634879635 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2400035b0 con 0x7fa25806e290 2023-07-14T15:58:23.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.760+0000 7fa2567fc700 1 -- 172.21.15.37:0/1634879635 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 825355954 0 0) 0x7fa2580ce390 con 0x7fa258071f10 2023-07-14T15:58:23.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.760+0000 7fa256ffd700 1 -- 172.21.15.37:0/1634879635 >> v1:172.21.15.98:6789/0 conn(0x7fa258071f10 legacy=0x7fa2580c9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:23.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.760+0000 7fa256ffd700 1 -- 172.21.15.37:0/1634879635 >> v1:172.21.15.37:6789/0 conn(0x7fa25806e290 legacy=0x7fa25806a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:23.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.760+0000 7fa256ffd700 1 -- 172.21.15.37:0/1634879635 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2580ce670 con 0x7fa2580ca650 2023-07-14T15:58:23.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.760+0000 7fa256ffd700 1 --2- 172.21.15.37:0/1634879635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2580ca650 0x7fa2580c9860 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa24c009840 tx=0x7fa24c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=621bacb0856279f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:23.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.760+0000 7fa2567fc700 1 -- 172.21.15.37:0/1634879635 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24c011830 con 0x7fa2580ca650 2023-07-14T15:58:23.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.760+0000 7fa2567fc700 1 -- 172.21.15.37:0/1634879635 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa24c011990 con 0x7fa2580ca650 2023-07-14T15:58:23.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.760+0000 7fa2567fc700 1 -- 172.21.15.37:0/1634879635 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24c011d20 con 0x7fa2580ca650 2023-07-14T15:58:23.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.761+0000 7fa25dfff700 1 -- 172.21.15.37:0/1634879635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2580ca650 msgr2=0x7fa2580c9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:23.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.761+0000 7fa25dfff700 1 --2- 172.21.15.37:0/1634879635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2580ca650 0x7fa2580c9860 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa24c009840 tx=0x7fa24c009b50 comp rx=0 tx=0).stop 2023-07-14T15:58:23.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.761+0000 7fa25dfff700 1 -- 172.21.15.37:0/1634879635 shutdown_connections 2023-07-14T15:58:23.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.761+0000 7fa25dfff700 1 --2- 172.21.15.37:0/1634879635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2580ca650 0x7fa2580c9860 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:23.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.761+0000 7fa25dfff700 1 -- 172.21.15.37:0/1634879635 >> 172.21.15.37:0/1634879635 conn(0x7fa2580cf210 msgr2=0x7fa2580cf610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:23.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.761+0000 7fa25dfff700 1 -- 172.21.15.37:0/1634879635 shutdown_connections 2023-07-14T15:58:23.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.761+0000 7fa25dfff700 1 -- 172.21.15.37:0/1634879635 wait complete. 2023-07-14T15:58:23.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.763+0000 7fa25dfff700 1 Processor -- start 2023-07-14T15:58:23.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.763+0000 7fa25dfff700 1 -- start start 2023-07-14T15:58:23.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.764+0000 7fa25dfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa25806e290 0x7fa258159fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:23.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.764+0000 7fa25dfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa258071f10 0x7fa25815e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:23.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.764+0000 7fa25dfff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa2580ca650 0x7fa25815e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:23.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.764+0000 7fa25dfff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25809f410 con 0x7fa25806e290 2023-07-14T15:58:23.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.764+0000 7fa25dfff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25809f6f0 con 0x7fa258071f10 2023-07-14T15:58:23.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.764+0000 7fa25dfff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa25809f9d0 con 0x7fa2580ca650 2023-07-14T15:58:23.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.764+0000 7fa2577fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa25806e290 0x7fa258159fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:23.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.764+0000 7fa2577fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa25806e290 0x7fa258159fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45502/0 (socket says 172.21.15.37:45502) 2023-07-14T15:58:23.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.764+0000 7fa2577fe700 1 -- 172.21.15.37:0/3909797624 learned_addr learned my addr 172.21.15.37:0/3909797624 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:23.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.764+0000 7fa257fff700 1 --2- 172.21.15.37:0/3909797624 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa2580ca650 0x7fa25815e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:23.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.764+0000 7fa256ffd700 1 --2- 172.21.15.37:0/3909797624 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa258071f10 0x7fa25815e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:23.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.764+0000 7fa2577fe700 1 -- 172.21.15.37:0/3909797624 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa2580ca650 msgr2=0x7fa25815e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:23.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.764+0000 7fa2577fe700 1 --2- 172.21.15.37:0/3909797624 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa2580ca650 0x7fa25815e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:23.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.764+0000 7fa2577fe700 1 -- 172.21.15.37:0/3909797624 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa258071f10 msgr2=0x7fa25815e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:23.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.764+0000 7fa2577fe700 1 --2- 172.21.15.37:0/3909797624 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa258071f10 0x7fa25815e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:23.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.764+0000 7fa2577fe700 1 -- 172.21.15.37:0/3909797624 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa24c0094a0 con 0x7fa25806e290 2023-07-14T15:58:23.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.764+0000 7fa257fff700 1 --2- 172.21.15.37:0/3909797624 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa2580ca650 0x7fa25815e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:58:23.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.764+0000 7fa256ffd700 1 --2- 172.21.15.37:0/3909797624 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa258071f10 0x7fa25815e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:58:23.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.765+0000 7fa2577fe700 1 --2- 172.21.15.37:0/3909797624 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa25806e290 0x7fa258159fb0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa2480011e0 tx=0x7fa24800cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:23.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.765+0000 7fa23ffff700 1 -- 172.21.15.37:0/3909797624 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2480054e0 con 0x7fa25806e290 2023-07-14T15:58:23.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.765+0000 7fa23ffff700 1 -- 172.21.15.37:0/3909797624 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa248003680 con 0x7fa25806e290 2023-07-14T15:58:23.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.765+0000 7fa25dfff700 1 -- 172.21.15.37:0/3909797624 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa25809fcb0 con 0x7fa25806e290 2023-07-14T15:58:23.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.765+0000 7fa23ffff700 1 -- 172.21.15.37:0/3909797624 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa248003a30 con 0x7fa25806e290 2023-07-14T15:58:23.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.765+0000 7fa25dfff700 1 -- 172.21.15.37:0/3909797624 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa25815a4f0 con 0x7fa25806e290 2023-07-14T15:58:23.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.766+0000 7fa25dfff700 1 -- 172.21.15.37:0/3909797624 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa258067840 con 0x7fa25806e290 2023-07-14T15:58:23.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.767+0000 7fa23ffff700 1 -- 172.21.15.37:0/3909797624 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7fa248003b90 con 0x7fa25806e290 2023-07-14T15:58:23.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.769+0000 7fa23ffff700 1 --2- 172.21.15.37:0/3909797624 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa24406ad70 0x7fa24406d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:23.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.769+0000 7fa23ffff700 1 -- 172.21.15.37:0/3909797624 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa248088a50 con 0x7fa25806e290 2023-07-14T15:58:23.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.769+0000 7fa256ffd700 1 --2- 172.21.15.37:0/3909797624 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa24406ad70 0x7fa24406d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:23.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.770+0000 7fa256ffd700 1 --2- 172.21.15.37:0/3909797624 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa24406ad70 0x7fa24406d220 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa2580caa40 tx=0x7fa24c01c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:23.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:23.773+0000 7fa23ffff700 1 -- 172.21.15.37:0/3909797624 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa248053aa0 con 0x7fa25806e290 2023-07-14T15:58:24.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:24.030+0000 7fa25dfff700 1 -- 172.21.15.37:0/3909797624 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa2580b49a0 con 0x7fa25806e290 2023-07-14T15:58:24.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:24.970+0000 7fa23ffff700 1 -- 172.21.15.37:0/3909797624 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v26) v1 ==== 136+0+0 (secure 0 0 0) 0x7fa2480570c0 con 0x7fa25806e290 2023-07-14T15:58:24.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:24.973+0000 7fa25dfff700 1 -- 172.21.15.37:0/3909797624 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa24406ad70 msgr2=0x7fa24406d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:24.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:24.973+0000 7fa25dfff700 1 --2- 172.21.15.37:0/3909797624 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa24406ad70 0x7fa24406d220 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa2580caa40 tx=0x7fa24c01c040 comp rx=0 tx=0).stop 2023-07-14T15:58:24.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:24.973+0000 7fa25dfff700 1 -- 172.21.15.37:0/3909797624 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa25806e290 msgr2=0x7fa258159fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:24.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:24.973+0000 7fa25dfff700 1 --2- 172.21.15.37:0/3909797624 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa25806e290 0x7fa258159fb0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa2480011e0 tx=0x7fa24800cae0 comp rx=0 tx=0).stop 2023-07-14T15:58:24.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:24.973+0000 7fa25dfff700 1 -- 172.21.15.37:0/3909797624 shutdown_connections 2023-07-14T15:58:24.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:24.973+0000 7fa25dfff700 1 --2- 172.21.15.37:0/3909797624 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa24406ad70 0x7fa24406d220 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:24.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:24.973+0000 7fa25dfff700 1 --2- 172.21.15.37:0/3909797624 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa2580ca650 0x7fa25815e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:24.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:24.973+0000 7fa25dfff700 1 --2- 172.21.15.37:0/3909797624 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa25806e290 0x7fa258159fb0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:24.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:24.973+0000 7fa25dfff700 1 --2- 172.21.15.37:0/3909797624 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa258071f10 0x7fa25815e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:24.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:24.973+0000 7fa25dfff700 1 -- 172.21.15.37:0/3909797624 >> 172.21.15.37:0/3909797624 conn(0x7fa2580cf210 msgr2=0x7fa25815ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:24.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:24.973+0000 7fa25dfff700 1 -- 172.21.15.37:0/3909797624 shutdown_connections 2023-07-14T15:58:24.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:24.973+0000 7fa25dfff700 1 -- 172.21.15.37:0/3909797624 wait complete. 2023-07-14T15:58:24.981 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-14T15:58:25.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.206+0000 7f64aa7ff700 1 Processor -- start 2023-07-14T15:58:25.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.207+0000 7f64aa7ff700 1 -- start start 2023-07-14T15:58:25.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.208+0000 7f64aa7ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f64a40b8900 0x7f64a40cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:25.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.208+0000 7f64aa7ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f64a40d15c0 0x7f64a40cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:25.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.208+0000 7f64aa7ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64a40b6270 con 0x7f64a40b5e00 2023-07-14T15:58:25.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.208+0000 7f64aa7ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64a415d030 con 0x7f64a40b8900 2023-07-14T15:58:25.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.208+0000 7f64aa7ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64a40cdb50 con 0x7f64a40d15c0 2023-07-14T15:58:25.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.208+0000 7f64a3fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f64a40b8900 0x7f64a40cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:25.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.208+0000 7f64a3fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f64a40b8900 0x7f64a40cd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45516/0 (socket says 172.21.15.37:45516) 2023-07-14T15:58:25.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.208+0000 7f64a3fff700 1 -- 172.21.15.37:0/1051971067 learned_addr learned my addr 172.21.15.37:0/1051971067 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:25.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.208+0000 7f64a8d9c700 1 --2- 172.21.15.37:0/1051971067 >> v2:172.21.15.98:3300/0 conn(0x7f64a40d15c0 0x7f64a40cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:25.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.208+0000 7f64a3fff700 1 -- 172.21.15.37:0/1051971067 >> v2:172.21.15.98:3300/0 conn(0x7f64a40d15c0 msgr2=0x7f64a40cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:25.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.208+0000 7f64a3fff700 1 --2- 172.21.15.37:0/1051971067 >> v2:172.21.15.98:3300/0 conn(0x7f64a40d15c0 0x7f64a40cebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:25.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.208+0000 7f64a3fff700 1 -- 172.21.15.37:0/1051971067 >> v1:172.21.15.98:6789/0 conn(0x7f64a40b5e00 legacy=0x7f64a40d0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:25.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.209+0000 7f64a3fff700 1 -- 172.21.15.37:0/1051971067 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a40cde30 con 0x7f64a40b8900 2023-07-14T15:58:25.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.209+0000 7f64a3fff700 1 --2- 172.21.15.37:0/1051971067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64a40b8900 0x7f64a40cd570 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f64a408be50 tx=0x7f6494009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a7a0af91ae7429f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:25.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.209+0000 7f64a2ffd700 1 -- 172.21.15.37:0/1051971067 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6494005e30 con 0x7f64a40b8900 2023-07-14T15:58:25.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.209+0000 7f64a2ffd700 1 -- 172.21.15.37:0/1051971067 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6494004030 con 0x7f64a40b8900 2023-07-14T15:58:25.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.209+0000 7f64a2ffd700 1 -- 172.21.15.37:0/1051971067 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64940043e0 con 0x7f64a40b8900 2023-07-14T15:58:25.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.209+0000 7f64aa7ff700 1 -- 172.21.15.37:0/1051971067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64a40b8900 msgr2=0x7f64a40cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:25.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.209+0000 7f64aa7ff700 1 --2- 172.21.15.37:0/1051971067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64a40b8900 0x7f64a40cd570 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f64a408be50 tx=0x7f6494009bd0 comp rx=0 tx=0).stop 2023-07-14T15:58:25.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.210+0000 7f64aa7ff700 1 -- 172.21.15.37:0/1051971067 shutdown_connections 2023-07-14T15:58:25.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.210+0000 7f64aa7ff700 1 --2- 172.21.15.37:0/1051971067 >> v2:172.21.15.98:3300/0 conn(0x7f64a40d15c0 0x7f64a40cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:25.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.210+0000 7f64aa7ff700 1 --2- 172.21.15.37:0/1051971067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64a40b8900 0x7f64a40cd570 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:25.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.210+0000 7f64aa7ff700 1 -- 172.21.15.37:0/1051971067 >> 172.21.15.37:0/1051971067 conn(0x7f64a409c1e0 msgr2=0x7f64a40d2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:25.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.210+0000 7f64aa7ff700 1 -- 172.21.15.37:0/1051971067 shutdown_connections 2023-07-14T15:58:25.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.210+0000 7f64aa7ff700 1 -- 172.21.15.37:0/1051971067 wait complete. 2023-07-14T15:58:25.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.211+0000 7f64aa7ff700 1 Processor -- start 2023-07-14T15:58:25.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.212+0000 7f64aa7ff700 1 -- start start 2023-07-14T15:58:25.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.212+0000 7f64aa7ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64a40b5e00 0x7f64a415e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:25.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.212+0000 7f64aa7ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f64a40b8900 0x7f64a41570b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:25.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.212+0000 7f64aa7ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f64a40d15c0 0x7f64a41575f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:25.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.213+0000 7f64aa7ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a40b3190 con 0x7f64a40b5e00 2023-07-14T15:58:25.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.213+0000 7f64aa7ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a415ece0 con 0x7f64a40d15c0 2023-07-14T15:58:25.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.213+0000 7f64aa7ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64a415efc0 con 0x7f64a40b8900 2023-07-14T15:58:25.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.213+0000 7f64a3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64a40b5e00 0x7f64a415e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:25.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.213+0000 7f64a3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64a40b5e00 0x7f64a415e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45532/0 (socket says 172.21.15.37:45532) 2023-07-14T15:58:25.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.213+0000 7f64a3fff700 1 -- 172.21.15.37:0/424168183 learned_addr learned my addr 172.21.15.37:0/424168183 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:25.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.213+0000 7f64a37fe700 1 --2- 172.21.15.37:0/424168183 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f64a40b8900 0x7f64a41570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:25.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.213+0000 7f64a8d9c700 1 --2- 172.21.15.37:0/424168183 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f64a40d15c0 0x7f64a41575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:25.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.213+0000 7f64a3fff700 1 -- 172.21.15.37:0/424168183 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f64a40b8900 msgr2=0x7f64a41570b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:25.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.213+0000 7f64a3fff700 1 --2- 172.21.15.37:0/424168183 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f64a40b8900 0x7f64a41570b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:25.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.213+0000 7f64a3fff700 1 -- 172.21.15.37:0/424168183 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f64a40d15c0 msgr2=0x7f64a41575f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:25.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.213+0000 7f64a3fff700 1 --2- 172.21.15.37:0/424168183 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f64a40d15c0 0x7f64a41575f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:25.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.213+0000 7f64a3fff700 1 -- 172.21.15.37:0/424168183 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6494009500 con 0x7f64a40b5e00 2023-07-14T15:58:25.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.213+0000 7f64a37fe700 1 --2- 172.21.15.37:0/424168183 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f64a40b8900 0x7f64a41570b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:58:25.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.213+0000 7f64a3fff700 1 --2- 172.21.15.37:0/424168183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64a40b5e00 0x7f64a415e5e0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f6494009c10 tx=0x7f6494004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:25.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.214+0000 7f64a0ff9700 1 -- 172.21.15.37:0/424168183 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6494003dd0 con 0x7f64a40b5e00 2023-07-14T15:58:25.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.214+0000 7f64a0ff9700 1 -- 172.21.15.37:0/424168183 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6494011420 con 0x7f64a40b5e00 2023-07-14T15:58:25.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.214+0000 7f64a0ff9700 1 -- 172.21.15.37:0/424168183 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64940117b0 con 0x7f64a40b5e00 2023-07-14T15:58:25.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.214+0000 7f64aa7ff700 1 -- 172.21.15.37:0/424168183 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64a415f2a0 con 0x7f64a40b5e00 2023-07-14T15:58:25.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.214+0000 7f64aa7ff700 1 -- 172.21.15.37:0/424168183 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64a415f860 con 0x7f64a40b5e00 2023-07-14T15:58:25.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.215+0000 7f64aa7ff700 1 -- 172.21.15.37:0/424168183 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64a415fa80 con 0x7f64a40b5e00 2023-07-14T15:58:25.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.216+0000 7f64a0ff9700 1 -- 172.21.15.37:0/424168183 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f6494011910 con 0x7f64a40b5e00 2023-07-14T15:58:25.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.217+0000 7f64a0ff9700 1 --2- 172.21.15.37:0/424168183 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f649006ad70 0x7f649006d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:25.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.217+0000 7f64a0ff9700 1 -- 172.21.15.37:0/424168183 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f649408a7b0 con 0x7f64a40b5e00 2023-07-14T15:58:25.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.217+0000 7f64a37fe700 1 --2- 172.21.15.37:0/424168183 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f649006ad70 0x7f649006d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:25.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.218+0000 7f64a37fe700 1 --2- 172.21.15.37:0/424168183 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f649006ad70 0x7f649006d220 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6498000f60 tx=0x7f6498009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:25.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.221+0000 7f64a0ff9700 1 -- 172.21.15.37:0/424168183 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6494055800 con 0x7f64a40b5e00 2023-07-14T15:58:25.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.457+0000 7f64aa7ff700 1 -- 172.21.15.37:0/424168183 --> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f64a415f130 con 0x7f649006ad70 2023-07-14T15:58:25.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.460+0000 7f64a0ff9700 1 -- 172.21.15.37:0/424168183 <== mgr.4100 v2:172.21.15.98:6832/3163748069 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f64a415f130 con 0x7f649006ad70 2023-07-14T15:58:25.445 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-07-14T15:58:25.445 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-14T15:58:25.445 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephfs" 2023-07-14T15:58:25.446 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-14T15:58:25.446 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-07-14T15:58:25.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.462+0000 7f64aa7ff700 1 -- 172.21.15.37:0/424168183 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f649006ad70 msgr2=0x7f649006d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:25.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.462+0000 7f64aa7ff700 1 --2- 172.21.15.37:0/424168183 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f649006ad70 0x7f649006d220 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6498000f60 tx=0x7f6498009040 comp rx=0 tx=0).stop 2023-07-14T15:58:25.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.462+0000 7f64aa7ff700 1 -- 172.21.15.37:0/424168183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64a40b5e00 msgr2=0x7f64a415e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:25.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.462+0000 7f64aa7ff700 1 --2- 172.21.15.37:0/424168183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64a40b5e00 0x7f64a415e5e0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f6494009c10 tx=0x7f6494004750 comp rx=0 tx=0).stop 2023-07-14T15:58:25.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.462+0000 7f64aa7ff700 1 -- 172.21.15.37:0/424168183 shutdown_connections 2023-07-14T15:58:25.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.462+0000 7f64aa7ff700 1 --2- 172.21.15.37:0/424168183 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f64a40d15c0 0x7f64a41575f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:25.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.462+0000 7f64aa7ff700 1 --2- 172.21.15.37:0/424168183 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f649006ad70 0x7f649006d220 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:25.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.462+0000 7f64aa7ff700 1 --2- 172.21.15.37:0/424168183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64a40b5e00 0x7f64a415e5e0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:25.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.462+0000 7f64aa7ff700 1 --2- 172.21.15.37:0/424168183 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f64a40b8900 0x7f64a41570b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:25.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.462+0000 7f64aa7ff700 1 -- 172.21.15.37:0/424168183 >> 172.21.15.37:0/424168183 conn(0x7f64a409c1e0 msgr2=0x7f64a406bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:25.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.462+0000 7f64aa7ff700 1 -- 172.21.15.37:0/424168183 shutdown_connections 2023-07-14T15:58:25.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.462+0000 7f64aa7ff700 1 -- 172.21.15.37:0/424168183 wait complete. 2023-07-14T15:58:25.464 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-14T15:58:25.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.684+0000 7f18e77ff700 1 Processor -- start 2023-07-14T15:58:25.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.684+0000 7f18e77ff700 1 -- start start 2023-07-14T15:58:25.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.685+0000 7f18e77ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f18e00cfd50 0x7f18e00d2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:25.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.685+0000 7f18e77ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e00b1840 con 0x7f18e00b0ac0 2023-07-14T15:58:25.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.685+0000 7f18e77ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e00b2550 con 0x7f18e00b1e80 2023-07-14T15:58:25.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.685+0000 7f18e77ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18e015ccf0 con 0x7f18e00cfd50 2023-07-14T15:58:25.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.685+0000 7f18e559b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f18e00cfd50 0x7f18e00d2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.685+0000 7f18e559b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f18e00cfd50 0x7f18e00d2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45540/0 (socket says 172.21.15.37:45540) 2023-07-14T15:58:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.685+0000 7f18e559b700 1 -- 172.21.15.37:0/3084601421 learned_addr learned my addr 172.21.15.37:0/3084601421 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:25.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.686+0000 7f18e559b700 1 -- 172.21.15.37:0/3084601421 >> v1:172.21.15.98:6789/0 conn(0x7f18e00b1e80 legacy=0x7f18e00b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:25.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.686+0000 7f18e559b700 1 -- 172.21.15.37:0/3084601421 >> v1:172.21.15.37:6789/0 conn(0x7f18e00b0ac0 legacy=0x7f18e00b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:25.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.686+0000 7f18d7fff700 1 -- 172.21.15.37:0/3084601421 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3559957410 0 0) 0x7f18e00b1840 con 0x7f18e00b0ac0 2023-07-14T15:58:25.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.686+0000 7f18e559b700 1 -- 172.21.15.37:0/3084601421 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e00b2830 con 0x7f18e00cfd50 2023-07-14T15:58:25.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.686+0000 7f18e559b700 1 --2- 172.21.15.37:0/3084601421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18e00cfd50 0x7f18e00d2880 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f18dc0098f0 tx=0x7f18dc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=969d1c486ee5ac7e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:25.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.686+0000 7f18d7fff700 1 -- 172.21.15.37:0/3084601421 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18dc00b8a0 con 0x7f18e00cfd50 2023-07-14T15:58:25.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.686+0000 7f18d7fff700 1 -- 172.21.15.37:0/3084601421 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18dc00ba00 con 0x7f18e00cfd50 2023-07-14T15:58:25.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.686+0000 7f18d7fff700 1 -- 172.21.15.37:0/3084601421 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18dc00bd90 con 0x7f18e00cfd50 2023-07-14T15:58:25.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.687+0000 7f18e77ff700 1 -- 172.21.15.37:0/3084601421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18e00cfd50 msgr2=0x7f18e00d2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:25.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.687+0000 7f18e77ff700 1 --2- 172.21.15.37:0/3084601421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18e00cfd50 0x7f18e00d2880 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f18dc0098f0 tx=0x7f18dc009c00 comp rx=0 tx=0).stop 2023-07-14T15:58:25.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.687+0000 7f18e77ff700 1 -- 172.21.15.37:0/3084601421 shutdown_connections 2023-07-14T15:58:25.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.687+0000 7f18e77ff700 1 --2- 172.21.15.37:0/3084601421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18e00cfd50 0x7f18e00d2880 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:25.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.687+0000 7f18e77ff700 1 -- 172.21.15.37:0/3084601421 >> 172.21.15.37:0/3084601421 conn(0x7f18e009c1c0 msgr2=0x7f18e00d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:25.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.687+0000 7f18e77ff700 1 -- 172.21.15.37:0/3084601421 shutdown_connections 2023-07-14T15:58:25.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.687+0000 7f18e77ff700 1 -- 172.21.15.37:0/3084601421 wait complete. 2023-07-14T15:58:25.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.689+0000 7f18e77ff700 1 Processor -- start 2023-07-14T15:58:25.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.689+0000 7f18e77ff700 1 -- start start 2023-07-14T15:58:25.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.690+0000 7f18e77ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f18e00b0ac0 0x7f18e0151020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:25.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.690+0000 7f18e77ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18e00b1e80 0x7f18e01ef310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:25.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.690+0000 7f18e77ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18e00cfd50 0x7f18e01f5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:25.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.690+0000 7f18e77ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e00ca4f0 con 0x7f18e00cfd50 2023-07-14T15:58:25.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.690+0000 7f18e77ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e01ef850 con 0x7f18e00b1e80 2023-07-14T15:58:25.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.690+0000 7f18e77ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e01f62d0 con 0x7f18e00b0ac0 2023-07-14T15:58:25.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.690+0000 7f18e5d9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18e00cfd50 0x7f18e01f5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:25.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.690+0000 7f18e5d9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18e00cfd50 0x7f18e01f5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45550/0 (socket says 172.21.15.37:45550) 2023-07-14T15:58:25.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.690+0000 7f18e5d9c700 1 -- 172.21.15.37:0/3700934516 learned_addr learned my addr 172.21.15.37:0/3700934516 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:25.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.690+0000 7f18e4d9a700 1 --2- 172.21.15.37:0/3700934516 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18e00b1e80 0x7f18e01ef310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:25.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.690+0000 7f18e559b700 1 --2- 172.21.15.37:0/3700934516 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f18e00b0ac0 0x7f18e0151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:25.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.691+0000 7f18e5d9c700 1 -- 172.21.15.37:0/3700934516 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f18e00b0ac0 msgr2=0x7f18e0151020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:25.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.691+0000 7f18e5d9c700 1 --2- 172.21.15.37:0/3700934516 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f18e00b0ac0 0x7f18e0151020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:25.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.691+0000 7f18e5d9c700 1 -- 172.21.15.37:0/3700934516 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18e00b1e80 msgr2=0x7f18e01ef310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:25.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.691+0000 7f18e5d9c700 1 --2- 172.21.15.37:0/3700934516 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18e00b1e80 0x7f18e01ef310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:25.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.691+0000 7f18e5d9c700 1 -- 172.21.15.37:0/3700934516 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18dc009550 con 0x7f18e00cfd50 2023-07-14T15:58:25.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.691+0000 7f18e4d9a700 1 --2- 172.21.15.37:0/3700934516 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18e00b1e80 0x7f18e01ef310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:58:25.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.691+0000 7f18e5d9c700 1 --2- 172.21.15.37:0/3700934516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18e00cfd50 0x7f18e01f5d90 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f18d8001560 tx=0x7f18d800cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:25.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.691+0000 7f18d5ffb700 1 -- 172.21.15.37:0/3700934516 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d8003e30 con 0x7f18e00cfd50 2023-07-14T15:58:25.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.691+0000 7f18d5ffb700 1 -- 172.21.15.37:0/3700934516 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d8005070 con 0x7f18e00cfd50 2023-07-14T15:58:25.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.691+0000 7f18d5ffb700 1 -- 172.21.15.37:0/3700934516 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d8005420 con 0x7f18e00cfd50 2023-07-14T15:58:25.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.691+0000 7f18e77ff700 1 -- 172.21.15.37:0/3700934516 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e00d02a0 con 0x7f18e00cfd50 2023-07-14T15:58:25.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.691+0000 7f18e77ff700 1 -- 172.21.15.37:0/3700934516 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e01f1ea0 con 0x7f18e00cfd50 2023-07-14T15:58:25.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.692+0000 7f18e77ff700 1 -- 172.21.15.37:0/3700934516 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18e0067840 con 0x7f18e00cfd50 2023-07-14T15:58:25.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.693+0000 7f18d5ffb700 1 -- 172.21.15.37:0/3700934516 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f18d8005580 con 0x7f18e00cfd50 2023-07-14T15:58:25.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.695+0000 7f18d5ffb700 1 --2- 172.21.15.37:0/3700934516 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f18c406ada0 0x7f18c406d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:25.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.695+0000 7f18d5ffb700 1 -- 172.21.15.37:0/3700934516 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f18d8088c00 con 0x7f18e00cfd50 2023-07-14T15:58:25.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.695+0000 7f18e559b700 1 --2- 172.21.15.37:0/3700934516 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f18c406ada0 0x7f18c406d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:25.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.696+0000 7f18e559b700 1 --2- 172.21.15.37:0/3700934516 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f18c406ada0 0x7f18c406d250 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f18dc014040 tx=0x7f18dc01c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:25.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.699+0000 7f18d5ffb700 1 -- 172.21.15.37:0/3700934516 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f18d8053bc0 con 0x7f18e00cfd50 2023-07-14T15:58:25.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.905+0000 7f18e77ff700 1 -- 172.21.15.37:0/3700934516 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f18e00d1600 con 0x7f18e00cfd50 2023-07-14T15:58:25.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.905+0000 7f18d5ffb700 1 -- 172.21.15.37:0/3700934516 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f18d8017020 con 0x7f18e00cfd50 2023-07-14T15:58:25.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.907+0000 7f18e77ff700 1 -- 172.21.15.37:0/3700934516 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f18c406ada0 msgr2=0x7f18c406d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:25.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.907+0000 7f18e77ff700 1 --2- 172.21.15.37:0/3700934516 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f18c406ada0 0x7f18c406d250 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f18dc014040 tx=0x7f18dc01c040 comp rx=0 tx=0).stop 2023-07-14T15:58:25.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.907+0000 7f18e77ff700 1 -- 172.21.15.37:0/3700934516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18e00cfd50 msgr2=0x7f18e01f5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:25.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.907+0000 7f18e77ff700 1 --2- 172.21.15.37:0/3700934516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18e00cfd50 0x7f18e01f5d90 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f18d8001560 tx=0x7f18d800cb50 comp rx=0 tx=0).stop 2023-07-14T15:58:25.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.908+0000 7f18e77ff700 1 -- 172.21.15.37:0/3700934516 shutdown_connections 2023-07-14T15:58:25.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.908+0000 7f18e77ff700 1 --2- 172.21.15.37:0/3700934516 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f18c406ada0 0x7f18c406d250 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:25.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.908+0000 7f18e77ff700 1 --2- 172.21.15.37:0/3700934516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18e00cfd50 0x7f18e01f5d90 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:25.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.908+0000 7f18e77ff700 1 --2- 172.21.15.37:0/3700934516 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f18e00b0ac0 0x7f18e0151020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:25.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.908+0000 7f18e77ff700 1 --2- 172.21.15.37:0/3700934516 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18e00b1e80 0x7f18e01ef310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:25.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.908+0000 7f18e77ff700 1 -- 172.21.15.37:0/3700934516 >> 172.21.15.37:0/3700934516 conn(0x7f18e009c1c0 msgr2=0x7f18e00d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:25.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.908+0000 7f18e77ff700 1 -- 172.21.15.37:0/3700934516 shutdown_connections 2023-07-14T15:58:25.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:25.908+0000 7f18e77ff700 1 -- 172.21.15.37:0/3700934516 wait complete. 2023-07-14T15:58:25.912 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs group_0000000000254728 2023-07-14T15:58:26.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.134+0000 7f11b35ff700 1 Processor -- start 2023-07-14T15:58:26.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.134+0000 7f11b35ff700 1 -- start start 2023-07-14T15:58:26.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.135+0000 7f11b35ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f11ac06c0d0 0x7f11ac06f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:26.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.135+0000 7f11b35ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f11ac0ae000 0x7f11ac0cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:26.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.135+0000 7f11b35ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11ac159870 con 0x7f11ac071730 2023-07-14T15:58:26.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.135+0000 7f11b35ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11ac0ae400 con 0x7f11ac0ae000 2023-07-14T15:58:26.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.135+0000 7f11b35ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11ac0ca790 con 0x7f11ac06c0d0 2023-07-14T15:58:26.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.135+0000 7f11b1b9c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f11ac0ae000 0x7f11ac0cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:26.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.135+0000 7f11b1b9c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f11ac0ae000 0x7f11ac0cd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45558/0 (socket says 172.21.15.37:45558) 2023-07-14T15:58:26.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.135+0000 7f11b1b9c700 1 -- 172.21.15.37:0/3351986441 learned_addr learned my addr 172.21.15.37:0/3351986441 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:26.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.135+0000 7f11b0b9a700 1 --2- 172.21.15.37:0/3351986441 >> v2:172.21.15.98:3300/0 conn(0x7f11ac06c0d0 0x7f11ac06f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:26.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.136+0000 7f11b1b9c700 1 -- 172.21.15.37:0/3351986441 >> v2:172.21.15.98:3300/0 conn(0x7f11ac06c0d0 msgr2=0x7f11ac06f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:26.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.136+0000 7f11b1b9c700 1 --2- 172.21.15.37:0/3351986441 >> v2:172.21.15.98:3300/0 conn(0x7f11ac06c0d0 0x7f11ac06f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:26.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.136+0000 7f11b1b9c700 1 -- 172.21.15.37:0/3351986441 >> v1:172.21.15.98:6789/0 conn(0x7f11ac071730 legacy=0x7f11ac06b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:26.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.136+0000 7f11b1b9c700 1 -- 172.21.15.37:0/3351986441 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11ac0cc780 con 0x7f11ac0ae000 2023-07-14T15:58:26.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.136+0000 7f11b1b9c700 1 --2- 172.21.15.37:0/3351986441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11ac0ae000 0x7f11ac0cd220 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f11ac0cfb00 tx=0x7f11a400d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7870af1cfa30392b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:26.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.136+0000 7f11a3fff700 1 -- 172.21.15.37:0/3351986441 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a4010070 con 0x7f11ac0ae000 2023-07-14T15:58:26.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.136+0000 7f11a3fff700 1 -- 172.21.15.37:0/3351986441 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a400dce0 con 0x7f11ac0ae000 2023-07-14T15:58:26.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.136+0000 7f11a3fff700 1 -- 172.21.15.37:0/3351986441 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a400b310 con 0x7f11ac0ae000 2023-07-14T15:58:26.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.137+0000 7f11b35ff700 1 -- 172.21.15.37:0/3351986441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11ac0ae000 msgr2=0x7f11ac0cd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:26.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.137+0000 7f11b35ff700 1 --2- 172.21.15.37:0/3351986441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11ac0ae000 0x7f11ac0cd220 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f11ac0cfb00 tx=0x7f11a400d430 comp rx=0 tx=0).stop 2023-07-14T15:58:26.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.137+0000 7f11b35ff700 1 -- 172.21.15.37:0/3351986441 shutdown_connections 2023-07-14T15:58:26.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.137+0000 7f11b35ff700 1 --2- 172.21.15.37:0/3351986441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11ac0ae000 0x7f11ac0cd220 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:26.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.137+0000 7f11b35ff700 1 --2- 172.21.15.37:0/3351986441 >> v2:172.21.15.98:3300/0 conn(0x7f11ac06c0d0 0x7f11ac06f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:26.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.137+0000 7f11b35ff700 1 -- 172.21.15.37:0/3351986441 >> 172.21.15.37:0/3351986441 conn(0x7f11ac06aac0 msgr2=0x7f11ac0b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:26.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.137+0000 7f11b35ff700 1 -- 172.21.15.37:0/3351986441 shutdown_connections 2023-07-14T15:58:26.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.137+0000 7f11b35ff700 1 -- 172.21.15.37:0/3351986441 wait complete. 2023-07-14T15:58:26.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.139+0000 7f11b35ff700 1 Processor -- start 2023-07-14T15:58:26.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.139+0000 7f11b35ff700 1 -- start start 2023-07-14T15:58:26.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.140+0000 7f11b35ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11ac06c0d0 0x7f11ac158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:26.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.140+0000 7f11b35ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f11ac071730 0x7f11ac0ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:26.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.140+0000 7f11b35ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11ac0ae000 0x7f11ac0acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:26.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.140+0000 7f11b35ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11ac0c2e60 con 0x7f11ac0ae000 2023-07-14T15:58:26.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.140+0000 7f11b35ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11ac0c2290 con 0x7f11ac06c0d0 2023-07-14T15:58:26.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.140+0000 7f11b35ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11ac0c2530 con 0x7f11ac071730 2023-07-14T15:58:26.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.140+0000 7f11b1b9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11ac0ae000 0x7f11ac0acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:26.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.140+0000 7f11b1b9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11ac0ae000 0x7f11ac0acdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45568/0 (socket says 172.21.15.37:45568) 2023-07-14T15:58:26.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.140+0000 7f11b1b9c700 1 -- 172.21.15.37:0/2505497573 learned_addr learned my addr 172.21.15.37:0/2505497573 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:26.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.140+0000 7f11b139b700 1 --2- 172.21.15.37:0/2505497573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11ac06c0d0 0x7f11ac158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:26.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.141+0000 7f11b0b9a700 1 --2- 172.21.15.37:0/2505497573 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f11ac071730 0x7f11ac0ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:26.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.141+0000 7f11b1b9c700 1 -- 172.21.15.37:0/2505497573 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f11ac071730 msgr2=0x7f11ac0ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:26.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.141+0000 7f11b1b9c700 1 --2- 172.21.15.37:0/2505497573 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f11ac071730 0x7f11ac0ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:26.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.141+0000 7f11b1b9c700 1 -- 172.21.15.37:0/2505497573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11ac06c0d0 msgr2=0x7f11ac158120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:26.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.141+0000 7f11b1b9c700 1 --2- 172.21.15.37:0/2505497573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11ac06c0d0 0x7f11ac158120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:26.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.141+0000 7f11b1b9c700 1 -- 172.21.15.37:0/2505497573 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a400bd40 con 0x7f11ac0ae000 2023-07-14T15:58:26.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.141+0000 7f11b1b9c700 1 --2- 172.21.15.37:0/2505497573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11ac0ae000 0x7f11ac0acdf0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f11a400d470 tx=0x7f11a4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:26.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.141+0000 7f11a1ffb700 1 -- 172.21.15.37:0/2505497573 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a4009a10 con 0x7f11ac0ae000 2023-07-14T15:58:26.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.141+0000 7f11a1ffb700 1 -- 172.21.15.37:0/2505497573 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a4009b70 con 0x7f11ac0ae000 2023-07-14T15:58:26.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.141+0000 7f11a1ffb700 1 -- 172.21.15.37:0/2505497573 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a400b4c0 con 0x7f11ac0ae000 2023-07-14T15:58:26.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.141+0000 7f11b35ff700 1 -- 172.21.15.37:0/2505497573 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11ac0c2810 con 0x7f11ac0ae000 2023-07-14T15:58:26.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.142+0000 7f11b35ff700 1 -- 172.21.15.37:0/2505497573 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11ac1f1dc0 con 0x7f11ac0ae000 2023-07-14T15:58:26.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.143+0000 7f11b35ff700 1 -- 172.21.15.37:0/2505497573 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11ac0cb300 con 0x7f11ac0ae000 2023-07-14T15:58:26.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.143+0000 7f11a1ffb700 1 -- 172.21.15.37:0/2505497573 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7f11a4004040 con 0x7f11ac0ae000 2023-07-14T15:58:26.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.144+0000 7f11a1ffb700 1 --2- 172.21.15.37:0/2505497573 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f119006ad70 0x7f119006d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:26.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.144+0000 7f11a1ffb700 1 -- 172.21.15.37:0/2505497573 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f11a408aca0 con 0x7f11ac0ae000 2023-07-14T15:58:26.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.145+0000 7f11b139b700 1 --2- 172.21.15.37:0/2505497573 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f119006ad70 0x7f119006d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:26.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.146+0000 7f11b139b700 1 --2- 172.21.15.37:0/2505497573 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f119006ad70 0x7f119006d220 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f11ac0cacf0 tx=0x7f11a8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:26.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.148+0000 7f11a1ffb700 1 -- 172.21.15.37:0/2505497573 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f11a4055be0 con 0x7f11ac0ae000 2023-07-14T15:58:26.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.387+0000 7f11b35ff700 1 -- 172.21.15.37:0/2505497573 --> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "group_0000000000254728", "target": ["mon-mgr", ""]}) v1 -- 0x7f11ac0c26a0 con 0x7f119006ad70 2023-07-14T15:58:26.380 INFO:tasks.ceph.mgr.x.smithi098.stderr:2023-07-14T15:58:26.396+0000 7fa3c0dbe700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T15:58:26.380 INFO:tasks.ceph.mgr.x.smithi098.stderr:2023-07-14T15:58:26.396+0000 7fa3c0dbe700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T15:58:26.381 INFO:tasks.ceph.mgr.x.smithi098.stderr:2023-07-14T15:58:26.396+0000 7fa3c0dbe700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T15:58:26.381 INFO:tasks.ceph.mgr.x.smithi098.stderr:2023-07-14T15:58:26.396+0000 7fa3c0dbe700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T15:58:26.381 INFO:tasks.ceph.mgr.x.smithi098.stderr:2023-07-14T15:58:26.396+0000 7fa3c0dbe700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T15:58:26.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.416+0000 7f11a1ffb700 1 -- 172.21.15.37:0/2505497573 <== mgr.4100 v2:172.21.15.98:6832/3163748069 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f11ac0c26a0 con 0x7f119006ad70 2023-07-14T15:58:26.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.418+0000 7f11b35ff700 1 -- 172.21.15.37:0/2505497573 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f119006ad70 msgr2=0x7f119006d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:26.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.418+0000 7f11b35ff700 1 --2- 172.21.15.37:0/2505497573 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f119006ad70 0x7f119006d220 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f11ac0cacf0 tx=0x7f11a8009040 comp rx=0 tx=0).stop 2023-07-14T15:58:26.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.418+0000 7f11b35ff700 1 -- 172.21.15.37:0/2505497573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11ac0ae000 msgr2=0x7f11ac0acdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:26.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.418+0000 7f11b35ff700 1 --2- 172.21.15.37:0/2505497573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11ac0ae000 0x7f11ac0acdf0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f11a400d470 tx=0x7f11a4004ad0 comp rx=0 tx=0).stop 2023-07-14T15:58:26.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.418+0000 7f11b35ff700 1 -- 172.21.15.37:0/2505497573 shutdown_connections 2023-07-14T15:58:26.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.418+0000 7f11b35ff700 1 --2- 172.21.15.37:0/2505497573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11ac06c0d0 0x7f11ac158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:26.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.418+0000 7f11b35ff700 1 --2- 172.21.15.37:0/2505497573 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f119006ad70 0x7f119006d220 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:26.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.418+0000 7f11b35ff700 1 --2- 172.21.15.37:0/2505497573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11ac0ae000 0x7f11ac0acdf0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:26.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.418+0000 7f11b35ff700 1 --2- 172.21.15.37:0/2505497573 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f11ac071730 0x7f11ac0ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:26.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.418+0000 7f11b35ff700 1 -- 172.21.15.37:0/2505497573 >> 172.21.15.37:0/2505497573 conn(0x7f11ac06aac0 msgr2=0x7f11ac158b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:26.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.419+0000 7f11b35ff700 1 -- 172.21.15.37:0/2505497573 shutdown_connections 2023-07-14T15:58:26.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.419+0000 7f11b35ff700 1 -- 172.21.15.37:0/2505497573 wait complete. 2023-07-14T15:58:26.422 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvolume_0000000000096394 group_0000000000254728 2023-07-14T15:58:26.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.643+0000 7fe5ef3ff700 1 Processor -- start 2023-07-14T15:58:26.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.643+0000 7fe5ef3ff700 1 -- start start 2023-07-14T15:58:26.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.644+0000 7fe5ef3ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe5e80cd890 0x7fe5e80d09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:26.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.644+0000 7fe5ef3ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fe5e80cf780 0x7fe5e80cfba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:26.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.644+0000 7fe5ef3ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5e80d1270 con 0x7fe5e81462d0 2023-07-14T15:58:26.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.644+0000 7fe5ef3ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5e80cdd00 con 0x7fe5e80cd890 2023-07-14T15:58:26.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.644+0000 7fe5ef3ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5e80d1550 con 0x7fe5e80cf780 2023-07-14T15:58:26.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.644+0000 7fe5ec99a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe5e80cd890 0x7fe5e80d09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:26.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.644+0000 7fe5ec99a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe5e80cd890 0x7fe5e80d09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45574/0 (socket says 172.21.15.37:45574) 2023-07-14T15:58:26.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.644+0000 7fe5ec99a700 1 -- 172.21.15.37:0/1825284028 learned_addr learned my addr 172.21.15.37:0/1825284028 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:26.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.644+0000 7fe5ed99c700 1 --2- 172.21.15.37:0/1825284028 >> v2:172.21.15.98:3300/0 conn(0x7fe5e80cf780 0x7fe5e80cfba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:26.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.645+0000 7fe5ec99a700 1 -- 172.21.15.37:0/1825284028 >> v2:172.21.15.98:3300/0 conn(0x7fe5e80cf780 msgr2=0x7fe5e80cfba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:26.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.645+0000 7fe5ec99a700 1 --2- 172.21.15.37:0/1825284028 >> v2:172.21.15.98:3300/0 conn(0x7fe5e80cf780 0x7fe5e80cfba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:26.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.645+0000 7fe5ec99a700 1 -- 172.21.15.37:0/1825284028 >> v1:172.21.15.98:6789/0 conn(0x7fe5e81462d0 legacy=0x7fe5e80d2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:26.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.645+0000 7fe5ec99a700 1 -- 172.21.15.37:0/1825284028 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e80d1830 con 0x7fe5e80cd890 2023-07-14T15:58:26.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.645+0000 7fe5ec99a700 1 --2- 172.21.15.37:0/1825284028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5e80cd890 0x7fe5e80d09d0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fe5e80cd3e0 tx=0x7fe5d8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=733128c4f4145659 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:26.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.645+0000 7fe5dffff700 1 -- 172.21.15.37:0/1825284028 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d8011830 con 0x7fe5e80cd890 2023-07-14T15:58:26.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.645+0000 7fe5dffff700 1 -- 172.21.15.37:0/1825284028 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5d8011990 con 0x7fe5e80cd890 2023-07-14T15:58:26.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.645+0000 7fe5dffff700 1 -- 172.21.15.37:0/1825284028 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d8011d20 con 0x7fe5e80cd890 2023-07-14T15:58:26.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.646+0000 7fe5ef3ff700 1 -- 172.21.15.37:0/1825284028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5e80cd890 msgr2=0x7fe5e80d09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:26.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.646+0000 7fe5ef3ff700 1 --2- 172.21.15.37:0/1825284028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5e80cd890 0x7fe5e80d09d0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fe5e80cd3e0 tx=0x7fe5d8009bd0 comp rx=0 tx=0).stop 2023-07-14T15:58:26.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.646+0000 7fe5ef3ff700 1 -- 172.21.15.37:0/1825284028 shutdown_connections 2023-07-14T15:58:26.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.646+0000 7fe5ef3ff700 1 --2- 172.21.15.37:0/1825284028 >> v2:172.21.15.98:3300/0 conn(0x7fe5e80cf780 0x7fe5e80cfba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:26.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.646+0000 7fe5ef3ff700 1 --2- 172.21.15.37:0/1825284028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5e80cd890 0x7fe5e80d09d0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:26.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.646+0000 7fe5ef3ff700 1 -- 172.21.15.37:0/1825284028 >> 172.21.15.37:0/1825284028 conn(0x7fe5e806a4d0 msgr2=0x7fe5e806a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:26.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.646+0000 7fe5ef3ff700 1 -- 172.21.15.37:0/1825284028 shutdown_connections 2023-07-14T15:58:26.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.646+0000 7fe5ef3ff700 1 -- 172.21.15.37:0/1825284028 wait complete. 2023-07-14T15:58:26.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.648+0000 7fe5ef3ff700 1 Processor -- start 2023-07-14T15:58:26.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.648+0000 7fe5ef3ff700 1 -- start start 2023-07-14T15:58:26.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.649+0000 7fe5ef3ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe5e80cd890 0x7fe5e815aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:26.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.649+0000 7fe5ef3ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5e80cf780 0x7fe5e80b3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:26.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.649+0000 7fe5ef3ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5e81462d0 0x7fe5e80c6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:26.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.649+0000 7fe5ef3ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e80b3270 con 0x7fe5e80cf780 2023-07-14T15:58:26.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.649+0000 7fe5ef3ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e80b5240 con 0x7fe5e81462d0 2023-07-14T15:58:26.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.649+0000 7fe5ef3ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e80b5520 con 0x7fe5e80cd890 2023-07-14T15:58:26.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.649+0000 7fe5ec99a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5e80cf780 0x7fe5e80b3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:26.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.649+0000 7fe5ec99a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5e80cf780 0x7fe5e80b3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45578/0 (socket says 172.21.15.37:45578) 2023-07-14T15:58:26.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.649+0000 7fe5ec99a700 1 -- 172.21.15.37:0/3881731502 learned_addr learned my addr 172.21.15.37:0/3881731502 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:26.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.649+0000 7fe5ed99c700 1 --2- 172.21.15.37:0/3881731502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5e81462d0 0x7fe5e80c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:26.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.649+0000 7fe5ed19b700 1 --2- 172.21.15.37:0/3881731502 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe5e80cd890 0x7fe5e815aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:26.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.649+0000 7fe5ec99a700 1 -- 172.21.15.37:0/3881731502 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe5e80cd890 msgr2=0x7fe5e815aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:26.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.649+0000 7fe5ec99a700 1 --2- 172.21.15.37:0/3881731502 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe5e80cd890 0x7fe5e815aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:26.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.649+0000 7fe5ec99a700 1 -- 172.21.15.37:0/3881731502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5e81462d0 msgr2=0x7fe5e80c6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:26.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.649+0000 7fe5ec99a700 1 --2- 172.21.15.37:0/3881731502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5e81462d0 0x7fe5e80c6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:26.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.649+0000 7fe5ec99a700 1 -- 172.21.15.37:0/3881731502 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d8009550 con 0x7fe5e80cf780 2023-07-14T15:58:26.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.650+0000 7fe5ed99c700 1 --2- 172.21.15.37:0/3881731502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5e81462d0 0x7fe5e80c6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:58:26.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.650+0000 7fe5ec99a700 1 --2- 172.21.15.37:0/3881731502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5e80cf780 0x7fe5e80b3c50 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe5d8000c00 tx=0x7fe5d8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:26.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.650+0000 7fe5ddffb700 1 -- 172.21.15.37:0/3881731502 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d8004380 con 0x7fe5e80cf780 2023-07-14T15:58:26.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.650+0000 7fe5ddffb700 1 -- 172.21.15.37:0/3881731502 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5d801f070 con 0x7fe5e80cf780 2023-07-14T15:58:26.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.650+0000 7fe5ef3ff700 1 -- 172.21.15.37:0/3881731502 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5e80b3450 con 0x7fe5e80cf780 2023-07-14T15:58:26.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.650+0000 7fe5ddffb700 1 -- 172.21.15.37:0/3881731502 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d80036a0 con 0x7fe5e80cf780 2023-07-14T15:58:26.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.650+0000 7fe5ef3ff700 1 -- 172.21.15.37:0/3881731502 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5e815af90 con 0x7fe5e80cf780 2023-07-14T15:58:26.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.651+0000 7fe5ef3ff700 1 -- 172.21.15.37:0/3881731502 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5e80b5740 con 0x7fe5e80cf780 2023-07-14T15:58:26.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.652+0000 7fe5ddffb700 1 -- 172.21.15.37:0/3881731502 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 89088+0+0 (secure 0 0 0) 0x7fe5d8021030 con 0x7fe5e80cf780 2023-07-14T15:58:26.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.653+0000 7fe5ddffb700 1 --2- 172.21.15.37:0/3881731502 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe5cc06ad70 0x7fe5cc06d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:26.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.653+0000 7fe5ddffb700 1 -- 172.21.15.37:0/3881731502 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe5d808a8d0 con 0x7fe5e80cf780 2023-07-14T15:58:26.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.654+0000 7fe5ed19b700 1 --2- 172.21.15.37:0/3881731502 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe5cc06ad70 0x7fe5cc06d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:26.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.654+0000 7fe5ed19b700 1 --2- 172.21.15.37:0/3881731502 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe5cc06ad70 0x7fe5cc06d220 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe5e4007fd0 tx=0x7fe5e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:26.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.657+0000 7fe5ddffb700 1 -- 172.21.15.37:0/3881731502 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe5d8055920 con 0x7fe5e80cf780 2023-07-14T15:58:26.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.897+0000 7fe5ef3ff700 1 -- 172.21.15.37:0/3881731502 --> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_0000000000096394", "group_name": "group_0000000000254728", "target": ["mon-mgr", ""]}) v1 -- 0x7fe5e80d1df0 con 0x7fe5cc06ad70 2023-07-14T15:58:26.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.924+0000 7fe5ddffb700 1 -- 172.21.15.37:0/3881731502 <== mgr.4100 v2:172.21.15.98:6832/3163748069 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe5e40014c0 con 0x7fe5cc06ad70 2023-07-14T15:58:26.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.927+0000 7fe5ef3ff700 1 -- 172.21.15.37:0/3881731502 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe5cc06ad70 msgr2=0x7fe5cc06d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:26.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.927+0000 7fe5ef3ff700 1 --2- 172.21.15.37:0/3881731502 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe5cc06ad70 0x7fe5cc06d220 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe5e4007fd0 tx=0x7fe5e4009040 comp rx=0 tx=0).stop 2023-07-14T15:58:26.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.927+0000 7fe5ef3ff700 1 -- 172.21.15.37:0/3881731502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5e80cf780 msgr2=0x7fe5e80b3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:26.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.927+0000 7fe5ef3ff700 1 --2- 172.21.15.37:0/3881731502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5e80cf780 0x7fe5e80b3c50 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe5d8000c00 tx=0x7fe5d8004750 comp rx=0 tx=0).stop 2023-07-14T15:58:26.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.927+0000 7fe5ef3ff700 1 -- 172.21.15.37:0/3881731502 shutdown_connections 2023-07-14T15:58:26.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.927+0000 7fe5ef3ff700 1 --2- 172.21.15.37:0/3881731502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5e81462d0 0x7fe5e80c6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:26.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.927+0000 7fe5ef3ff700 1 --2- 172.21.15.37:0/3881731502 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe5cc06ad70 0x7fe5cc06d220 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:26.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.927+0000 7fe5ef3ff700 1 --2- 172.21.15.37:0/3881731502 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe5e80cd890 0x7fe5e815aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:26.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.927+0000 7fe5ef3ff700 1 --2- 172.21.15.37:0/3881731502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5e80cf780 0x7fe5e80b3c50 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:26.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.927+0000 7fe5ef3ff700 1 -- 172.21.15.37:0/3881731502 >> 172.21.15.37:0/3881731502 conn(0x7fe5e806a4d0 msgr2=0x7fe5e80d2c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:26.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.927+0000 7fe5ef3ff700 1 -- 172.21.15.37:0/3881731502 shutdown_connections 2023-07-14T15:58:26.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:26.927+0000 7fe5ef3ff700 1 -- 172.21.15.37:0/3881731502 wait complete. 2023-07-14T15:58:26.930 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs subvolume_0000000000096394 snapshot_0000000000804182 group_0000000000254728 2023-07-14T15:58:27.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.154+0000 7f10d19ff700 1 Processor -- start 2023-07-14T15:58:27.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.154+0000 7f10d19ff700 1 -- start start 2023-07-14T15:58:27.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.156+0000 7f10d19ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f10cc0af190 0x7f10cc0cf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:27.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.156+0000 7f10d19ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f10cc0b16f0 0x7f10cc0b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:27.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.156+0000 7f10d19ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10cc15cc60 con 0x7f10cc06d6b0 2023-07-14T15:58:27.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.156+0000 7f10d19ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10cc071530 con 0x7f10cc0b16f0 2023-07-14T15:58:27.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.156+0000 7f10d19ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc0af560 con 0x7f10cc0af190 2023-07-14T15:58:27.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.156+0000 7f10cb7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f10cc0b16f0 0x7f10cc0b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:27.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.156+0000 7f10cb7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f10cc0b16f0 0x7f10cc0b1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45580/0 (socket says 172.21.15.37:45580) 2023-07-14T15:58:27.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.156+0000 7f10cb7fe700 1 -- 172.21.15.37:0/3051956781 learned_addr learned my addr 172.21.15.37:0/3051956781 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:27.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.156+0000 7f10caffd700 1 --2- 172.21.15.37:0/3051956781 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f10cc0af190 0x7f10cc0cf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:27.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.157+0000 7f10cb7fe700 1 -- 172.21.15.37:0/3051956781 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f10cc0af190 msgr2=0x7f10cc0cf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:27.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.157+0000 7f10cb7fe700 1 --2- 172.21.15.37:0/3051956781 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f10cc0af190 0x7f10cc0cf5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:27.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.157+0000 7f10cb7fe700 1 -- 172.21.15.37:0/3051956781 >> v1:172.21.15.37:6789/0 conn(0x7f10cc06d6b0 legacy=0x7f10cc070e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:27.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.157+0000 7f10cb7fe700 1 -- 172.21.15.37:0/3051956781 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10cc071720 con 0x7f10cc0b16f0 2023-07-14T15:58:27.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.157+0000 7f10c9ffb700 1 -- 172.21.15.37:0/3051956781 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4026270890 0 0) 0x7f10cc15cc60 con 0x7f10cc06d6b0 2023-07-14T15:58:27.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.157+0000 7f10cb7fe700 1 --2- 172.21.15.37:0/3051956781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10cc0b16f0 0x7f10cc0b1b70 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f10c4009e50 tx=0x7f10c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1278da792eeff89 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:27.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.157+0000 7f10c9ffb700 1 -- 172.21.15.37:0/3051956781 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c400e070 con 0x7f10cc0b16f0 2023-07-14T15:58:27.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.157+0000 7f10c9ffb700 1 -- 172.21.15.37:0/3051956781 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c400b910 con 0x7f10cc0b16f0 2023-07-14T15:58:27.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.157+0000 7f10c9ffb700 1 -- 172.21.15.37:0/3051956781 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c400bcc0 con 0x7f10cc0b16f0 2023-07-14T15:58:27.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.158+0000 7f10d19ff700 1 -- 172.21.15.37:0/3051956781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10cc0b16f0 msgr2=0x7f10cc0b1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:27.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.158+0000 7f10d19ff700 1 --2- 172.21.15.37:0/3051956781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10cc0b16f0 0x7f10cc0b1b70 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f10c4009e50 tx=0x7f10c400b330 comp rx=0 tx=0).stop 2023-07-14T15:58:27.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.158+0000 7f10d19ff700 1 -- 172.21.15.37:0/3051956781 shutdown_connections 2023-07-14T15:58:27.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.158+0000 7f10d19ff700 1 --2- 172.21.15.37:0/3051956781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10cc0b16f0 0x7f10cc0b1b70 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:27.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.158+0000 7f10d19ff700 1 --2- 172.21.15.37:0/3051956781 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f10cc0af190 0x7f10cc0cf5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:27.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.158+0000 7f10d19ff700 1 -- 172.21.15.37:0/3051956781 >> 172.21.15.37:0/3051956781 conn(0x7f10cc0cc610 msgr2=0x7f10cc0cc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:27.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.158+0000 7f10d19ff700 1 -- 172.21.15.37:0/3051956781 shutdown_connections 2023-07-14T15:58:27.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.158+0000 7f10d19ff700 1 -- 172.21.15.37:0/3051956781 wait complete. 2023-07-14T15:58:27.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.160+0000 7f10d19ff700 1 Processor -- start 2023-07-14T15:58:27.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.160+0000 7f10d19ff700 1 -- start start 2023-07-14T15:58:27.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.161+0000 7f10d19ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f10cc06d6b0 0x7f10cc159600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:27.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.161+0000 7f10d19ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10cc0af190 0x7f10cc1529c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:27.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.161+0000 7f10d19ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10cc0b16f0 0x7f10cc156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:27.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.161+0000 7f10d19ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc0b46b0 con 0x7f10cc0b16f0 2023-07-14T15:58:27.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.161+0000 7f10d19ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc159ce0 con 0x7f10cc0af190 2023-07-14T15:58:27.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.161+0000 7f10d19ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc0b4900 con 0x7f10cc06d6b0 2023-07-14T15:58:27.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.161+0000 7f10cb7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10cc0b16f0 0x7f10cc156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:27.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.161+0000 7f10cb7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10cc0b16f0 0x7f10cc156b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45586/0 (socket says 172.21.15.37:45586) 2023-07-14T15:58:27.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.161+0000 7f10cb7fe700 1 -- 172.21.15.37:0/3218523144 learned_addr learned my addr 172.21.15.37:0/3218523144 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:27.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.161+0000 7f10ca7fc700 1 --2- 172.21.15.37:0/3218523144 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10cc0af190 0x7f10cc1529c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:27.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.161+0000 7f10caffd700 1 --2- 172.21.15.37:0/3218523144 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f10cc06d6b0 0x7f10cc159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:27.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.162+0000 7f10cb7fe700 1 -- 172.21.15.37:0/3218523144 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f10cc06d6b0 msgr2=0x7f10cc159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:27.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.162+0000 7f10cb7fe700 1 --2- 172.21.15.37:0/3218523144 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f10cc06d6b0 0x7f10cc159600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:27.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.162+0000 7f10cb7fe700 1 -- 172.21.15.37:0/3218523144 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10cc0af190 msgr2=0x7f10cc1529c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:27.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.162+0000 7f10cb7fe700 1 --2- 172.21.15.37:0/3218523144 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10cc0af190 0x7f10cc1529c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:27.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.162+0000 7f10cb7fe700 1 -- 172.21.15.37:0/3218523144 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c4009b30 con 0x7f10cc0b16f0 2023-07-14T15:58:27.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.162+0000 7f10ca7fc700 1 --2- 172.21.15.37:0/3218523144 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10cc0af190 0x7f10cc1529c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:58:27.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.162+0000 7f10cb7fe700 1 --2- 172.21.15.37:0/3218523144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10cc0b16f0 0x7f10cc156b50 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f10c400b680 tx=0x7f10c4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:27.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.162+0000 7f10b3fff700 1 -- 172.21.15.37:0/3218523144 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c40099b0 con 0x7f10cc0b16f0 2023-07-14T15:58:27.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.162+0000 7f10b3fff700 1 -- 172.21.15.37:0/3218523144 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c40092e0 con 0x7f10cc0b16f0 2023-07-14T15:58:27.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.162+0000 7f10b3fff700 1 -- 172.21.15.37:0/3218523144 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c401c660 con 0x7f10cc0b16f0 2023-07-14T15:58:27.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.162+0000 7f10d19ff700 1 -- 172.21.15.37:0/3218523144 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10cc0b4be0 con 0x7f10cc0b16f0 2023-07-14T15:58:27.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.162+0000 7f10d19ff700 1 -- 172.21.15.37:0/3218523144 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10cc0b4ec0 con 0x7f10cc0b16f0 2023-07-14T15:58:27.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.163+0000 7f10d19ff700 1 -- 172.21.15.37:0/3218523144 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10cc15e180 con 0x7f10cc0b16f0 2023-07-14T15:58:27.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.164+0000 7f10b3fff700 1 -- 172.21.15.37:0/3218523144 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f10c401c7c0 con 0x7f10cc0b16f0 2023-07-14T15:58:27.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.165+0000 7f10b3fff700 1 --2- 172.21.15.37:0/3218523144 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f10b806ae00 0x7f10b806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:27.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.165+0000 7f10b3fff700 1 -- 172.21.15.37:0/3218523144 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f10c408ad70 con 0x7f10cc0b16f0 2023-07-14T15:58:27.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.166+0000 7f10caffd700 1 --2- 172.21.15.37:0/3218523144 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f10b806ae00 0x7f10b806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:27.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.166+0000 7f10caffd700 1 --2- 172.21.15.37:0/3218523144 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f10b806ae00 0x7f10b806d2b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f10cc0af9f0 tx=0x7f10bc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:27.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.170+0000 7f10b3fff700 1 -- 172.21.15.37:0/3218523144 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f10cc15e180 con 0x7f10cc0b16f0 2023-07-14T15:58:27.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.414+0000 7f10d19ff700 1 -- 172.21.15.37:0/3218523144 --> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "subvolume_0000000000096394", "snap_name": "snapshot_0000000000804182", "group_name": "group_0000000000254728", "target": ["mon-mgr", ""]}) v1 -- 0x7f10cc0cedd0 con 0x7f10b806ae00 2023-07-14T15:58:27.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.434+0000 7f10b3fff700 1 -- 172.21.15.37:0/3218523144 <== mgr.4100 v2:172.21.15.98:6832/3163748069 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f10bc004020 con 0x7f10b806ae00 2023-07-14T15:58:27.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.436+0000 7f10d19ff700 1 -- 172.21.15.37:0/3218523144 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f10b806ae00 msgr2=0x7f10b806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:27.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.436+0000 7f10d19ff700 1 --2- 172.21.15.37:0/3218523144 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f10b806ae00 0x7f10b806d2b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f10cc0af9f0 tx=0x7f10bc008040 comp rx=0 tx=0).stop 2023-07-14T15:58:27.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.436+0000 7f10d19ff700 1 -- 172.21.15.37:0/3218523144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10cc0b16f0 msgr2=0x7f10cc156b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:27.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.436+0000 7f10d19ff700 1 --2- 172.21.15.37:0/3218523144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10cc0b16f0 0x7f10cc156b50 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f10c400b680 tx=0x7f10c4004ad0 comp rx=0 tx=0).stop 2023-07-14T15:58:27.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.436+0000 7f10d19ff700 1 -- 172.21.15.37:0/3218523144 shutdown_connections 2023-07-14T15:58:27.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.436+0000 7f10d19ff700 1 --2- 172.21.15.37:0/3218523144 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f10b806ae00 0x7f10b806d2b0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:27.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.436+0000 7f10d19ff700 1 --2- 172.21.15.37:0/3218523144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10cc0b16f0 0x7f10cc156b50 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:27.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.436+0000 7f10d19ff700 1 --2- 172.21.15.37:0/3218523144 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f10cc06d6b0 0x7f10cc159600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:27.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.436+0000 7f10d19ff700 1 --2- 172.21.15.37:0/3218523144 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10cc0af190 0x7f10cc1529c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:27.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.436+0000 7f10d19ff700 1 -- 172.21.15.37:0/3218523144 >> 172.21.15.37:0/3218523144 conn(0x7f10cc0cc610 msgr2=0x7f10cc06ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:27.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.436+0000 7f10d19ff700 1 -- 172.21.15.37:0/3218523144 shutdown_connections 2023-07-14T15:58:27.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.436+0000 7f10d19ff700 1 -- 172.21.15.37:0/3218523144 wait complete. 2023-07-14T15:58:27.439 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot metadata set cephfs subvolume_0000000000096394 snapshot_0000000000804182 key value group_0000000000254728 2023-07-14T15:58:27.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.665+0000 7f8d56dff700 1 Processor -- start 2023-07-14T15:58:27.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.665+0000 7f8d56dff700 1 -- start start 2023-07-14T15:58:27.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.667+0000 7f8d56dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f8d500ae3b0 0x7f8d500cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:27.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.667+0000 7f8d56dff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d500c4180 con 0x7f8d500cca30 2023-07-14T15:58:27.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.667+0000 7f8d56dff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d50159790 con 0x7f8d501593c0 2023-07-14T15:58:27.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.667+0000 7f8d56dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d500cb240 con 0x7f8d500ae3b0 2023-07-14T15:58:27.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.667+0000 7f8d5539c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8d500cca30 0x7f8d500c4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58470/0 (socket says 172.21.15.37:58470) 2023-07-14T15:58:27.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.667+0000 7f8d5539c700 1 -- 172.21.15.37:0/399956440 learned_addr learned my addr 172.21.15.37:0/399956440 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:58:27.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.667+0000 7f8d4ffff700 1 --2- 172.21.15.37:0/399956440 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f8d500ae3b0 0x7f8d500cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:27.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.668+0000 7f8d4f7fe700 1 -- 172.21.15.37:0/399956440 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1575869903 0 0) 0x7f8d500c4180 con 0x7f8d500cca30 2023-07-14T15:58:27.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.668+0000 7f8d4f7fe700 1 -- 172.21.15.37:0/399956440 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d400035b0 con 0x7f8d500cca30 2023-07-14T15:58:27.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.668+0000 7f8d4f7fe700 1 -- 172.21.15.37:0/399956440 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4025738940 0 0) 0x7f8d50159790 con 0x7f8d501593c0 2023-07-14T15:58:27.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.668+0000 7f8d4f7fe700 1 -- 172.21.15.37:0/399956440 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d500c4180 con 0x7f8d501593c0 2023-07-14T15:58:27.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.668+0000 7f8d4ffff700 1 -- 172.21.15.37:0/399956440 >> v1:172.21.15.98:6789/0 conn(0x7f8d501593c0 legacy=0x7f8d500cab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:27.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.668+0000 7f8d4ffff700 1 -- 172.21.15.37:0/399956440 >> v1:172.21.15.37:6789/0 conn(0x7f8d500cca30 legacy=0x7f8d500c4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:27.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.668+0000 7f8d4ffff700 1 -- 172.21.15.37:0/399956440 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d500c3e50 con 0x7f8d500ae3b0 2023-07-14T15:58:27.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.668+0000 7f8d4ffff700 1 --2- 172.21.15.37:0/399956440 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f8d500ae3b0 0x7f8d500cc4f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c009870 tx=0x7f8d3c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=caf78abe5790f740 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:27.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.668+0000 7f8d4f7fe700 1 -- 172.21.15.37:0/399956440 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c011830 con 0x7f8d500ae3b0 2023-07-14T15:58:27.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.668+0000 7f8d4f7fe700 1 -- 172.21.15.37:0/399956440 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d3c011990 con 0x7f8d500ae3b0 2023-07-14T15:58:27.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.668+0000 7f8d4f7fe700 1 -- 172.21.15.37:0/399956440 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c011d00 con 0x7f8d500ae3b0 2023-07-14T15:58:27.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.669+0000 7f8d56dff700 1 -- 172.21.15.37:0/399956440 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f8d500ae3b0 msgr2=0x7f8d500cc4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:27.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.669+0000 7f8d56dff700 1 --2- 172.21.15.37:0/399956440 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f8d500ae3b0 0x7f8d500cc4f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c009870 tx=0x7f8d3c009b80 comp rx=0 tx=0).stop 2023-07-14T15:58:27.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.669+0000 7f8d56dff700 1 -- 172.21.15.37:0/399956440 shutdown_connections 2023-07-14T15:58:27.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.669+0000 7f8d56dff700 1 --2- 172.21.15.37:0/399956440 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f8d500ae3b0 0x7f8d500cc4f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:27.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.669+0000 7f8d56dff700 1 -- 172.21.15.37:0/399956440 >> 172.21.15.37:0/399956440 conn(0x7f8d500b11e0 msgr2=0x7f8d500ce920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:27.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.669+0000 7f8d56dff700 1 -- 172.21.15.37:0/399956440 shutdown_connections 2023-07-14T15:58:27.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.669+0000 7f8d56dff700 1 -- 172.21.15.37:0/399956440 wait complete. 2023-07-14T15:58:27.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.671+0000 7f8d56dff700 1 Processor -- start 2023-07-14T15:58:27.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.671+0000 7f8d56dff700 1 -- start start 2023-07-14T15:58:27.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.672+0000 7f8d56dff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d500ae3b0 0x7f8d5015a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:27.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.672+0000 7f8d56dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f8d500cca30 0x7f8d500ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:27.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.672+0000 7f8d56dff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d501593c0 0x7f8d500adc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:27.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.672+0000 7f8d56dff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d500c8980 con 0x7f8d501593c0 2023-07-14T15:58:27.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.672+0000 7f8d56dff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d500c86a0 con 0x7f8d500ae3b0 2023-07-14T15:58:27.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.672+0000 7f8d56dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d50159930 con 0x7f8d500cca30 2023-07-14T15:58:27.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.672+0000 7f8d5539c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d501593c0 0x7f8d500adc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:27.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.672+0000 7f8d4ffff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f8d500cca30 0x7f8d500ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:27.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.673+0000 7f8d54b9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d500ae3b0 0x7f8d5015a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:27.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.673+0000 7f8d4ffff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f8d500cca30 0x7f8d500ad6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3301/0 says I am v2:172.21.15.37:58628/0 (socket says 172.21.15.37:58628) 2023-07-14T15:58:27.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.673+0000 7f8d4ffff700 1 -- 172.21.15.37:0/2018730094 learned_addr learned my addr 172.21.15.37:0/2018730094 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:27.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.673+0000 7f8d5539c700 1 -- 172.21.15.37:0/2018730094 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f8d500cca30 msgr2=0x7f8d500ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:27.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.673+0000 7f8d5539c700 1 --2- 172.21.15.37:0/2018730094 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f8d500cca30 0x7f8d500ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:27.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.673+0000 7f8d5539c700 1 -- 172.21.15.37:0/2018730094 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d500ae3b0 msgr2=0x7f8d5015a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:27.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.673+0000 7f8d5539c700 1 --2- 172.21.15.37:0/2018730094 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d500ae3b0 0x7f8d5015a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:27.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.673+0000 7f8d5539c700 1 -- 172.21.15.37:0/2018730094 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d3c0094a0 con 0x7f8d501593c0 2023-07-14T15:58:27.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.673+0000 7f8d5539c700 1 --2- 172.21.15.37:0/2018730094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d501593c0 0x7f8d500adc30 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f8d500b02c0 tx=0x7f8d4800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:27.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.674+0000 7f8d4d7fa700 1 -- 172.21.15.37:0/2018730094 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4800a9e0 con 0x7f8d501593c0 2023-07-14T15:58:27.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.674+0000 7f8d4d7fa700 1 -- 172.21.15.37:0/2018730094 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d4800ab40 con 0x7f8d501593c0 2023-07-14T15:58:27.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.674+0000 7f8d4d7fa700 1 -- 172.21.15.37:0/2018730094 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d48012400 con 0x7f8d501593c0 2023-07-14T15:58:27.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.674+0000 7f8d56dff700 1 -- 172.21.15.37:0/2018730094 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d50159c10 con 0x7f8d501593c0 2023-07-14T15:58:27.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.674+0000 7f8d56dff700 1 -- 172.21.15.37:0/2018730094 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d5014f770 con 0x7f8d501593c0 2023-07-14T15:58:27.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.675+0000 7f8d56dff700 1 -- 172.21.15.37:0/2018730094 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d50159790 con 0x7f8d501593c0 2023-07-14T15:58:27.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.676+0000 7f8d4d7fa700 1 -- 172.21.15.37:0/2018730094 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f8d4801b3b0 con 0x7f8d501593c0 2023-07-14T15:58:27.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.677+0000 7f8d4d7fa700 1 --2- 172.21.15.37:0/2018730094 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f8d3406ae50 0x7f8d3406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:27.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.677+0000 7f8d4d7fa700 1 -- 172.21.15.37:0/2018730094 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8d48089240 con 0x7f8d501593c0 2023-07-14T15:58:27.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.678+0000 7f8d54b9b700 1 --2- 172.21.15.37:0/2018730094 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f8d3406ae50 0x7f8d3406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:27.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.678+0000 7f8d54b9b700 1 --2- 172.21.15.37:0/2018730094 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f8d3406ae50 0x7f8d3406d300 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8d44001790 tx=0x7f8d44009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:27.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.681+0000 7f8d4d7fa700 1 -- 172.21.15.37:0/2018730094 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8d50159790 con 0x7f8d501593c0 2023-07-14T15:58:27.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.929+0000 7f8d56dff700 1 -- 172.21.15.37:0/2018730094 --> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot metadata set", "vol_name": "cephfs", "sub_name": "subvolume_0000000000096394", "snap_name": "snapshot_0000000000804182", "key_name": "key", "value": "value", "group_name": "group_0000000000254728", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d50159aa0 con 0x7f8d3406ae50 2023-07-14T15:58:27.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.949+0000 7f8d4d7fa700 1 -- 172.21.15.37:0/2018730094 <== mgr.4100 v2:172.21.15.98:6832/3163748069 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f8d44001430 con 0x7f8d3406ae50 2023-07-14T15:58:27.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.952+0000 7f8d56dff700 1 -- 172.21.15.37:0/2018730094 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f8d3406ae50 msgr2=0x7f8d3406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:27.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.952+0000 7f8d56dff700 1 --2- 172.21.15.37:0/2018730094 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f8d3406ae50 0x7f8d3406d300 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8d44001790 tx=0x7f8d44009040 comp rx=0 tx=0).stop 2023-07-14T15:58:27.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.952+0000 7f8d56dff700 1 -- 172.21.15.37:0/2018730094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d501593c0 msgr2=0x7f8d500adc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:27.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.952+0000 7f8d56dff700 1 --2- 172.21.15.37:0/2018730094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d501593c0 0x7f8d500adc30 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f8d500b02c0 tx=0x7f8d4800cd50 comp rx=0 tx=0).stop 2023-07-14T15:58:27.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.952+0000 7f8d56dff700 1 -- 172.21.15.37:0/2018730094 shutdown_connections 2023-07-14T15:58:27.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.952+0000 7f8d56dff700 1 --2- 172.21.15.37:0/2018730094 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8d500ae3b0 0x7f8d5015a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:27.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.952+0000 7f8d56dff700 1 --2- 172.21.15.37:0/2018730094 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f8d3406ae50 0x7f8d3406d300 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:27.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.952+0000 7f8d56dff700 1 --2- 172.21.15.37:0/2018730094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d501593c0 0x7f8d500adc30 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:27.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.952+0000 7f8d56dff700 1 --2- 172.21.15.37:0/2018730094 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f8d500cca30 0x7f8d500ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:27.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.952+0000 7f8d56dff700 1 -- 172.21.15.37:0/2018730094 >> 172.21.15.37:0/2018730094 conn(0x7f8d500b11e0 msgr2=0x7f8d5006f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:27.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.952+0000 7f8d56dff700 1 -- 172.21.15.37:0/2018730094 shutdown_connections 2023-07-14T15:58:27.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:27.952+0000 7f8d56dff700 1 -- 172.21.15.37:0/2018730094 wait complete. 2023-07-14T15:58:27.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:58:27.955 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cp -p ./volumes/group_0000000000254728/subvolume_0000000000096394/.meta ./volumes/group_0000000000254728/subvolume_0000000000096394/.meta.stale_snap_section) 2023-07-14T15:58:28.833 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T15:58:28.838 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T15:58:32.676 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvolume_0000000000096394 snapshot_0000000000804182 group_0000000000254728 2023-07-14T15:58:32.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.910+0000 7fc1de3ff700 1 Processor -- start 2023-07-14T15:58:32.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.910+0000 7fc1de3ff700 1 -- start start 2023-07-14T15:58:32.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.911+0000 7fc1de3ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc1d80b1e80 0x7fc1d80d2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:32.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.911+0000 7fc1de3ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fc1d80b0ac0 0x7fc1d80b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:32.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.911+0000 7fc1de3ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1d80b1840 con 0x7fc1d80cfd50 2023-07-14T15:58:32.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.911+0000 7fc1de3ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1d815ccf0 con 0x7fc1d80b1e80 2023-07-14T15:58:32.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.911+0000 7fc1de3ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1d80b2550 con 0x7fc1d80b0ac0 2023-07-14T15:58:32.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.911+0000 7fc1d77fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc1d80b1e80 0x7fc1d80d2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:32.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.911+0000 7fc1d7fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc1d80cfd50 0x7fc1d80b2d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52470/0 (socket says 172.21.15.37:52470) 2023-07-14T15:58:32.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.911+0000 7fc1d7fff700 1 -- 172.21.15.37:0/3373255120 learned_addr learned my addr 172.21.15.37:0/3373255120 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:58:32.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.912+0000 7fc1d77fe700 1 -- 172.21.15.37:0/3373255120 >> v2:172.21.15.98:3300/0 conn(0x7fc1d80b0ac0 msgr2=0x7fc1d80b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:32.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.912+0000 7fc1dc99c700 1 --2- 172.21.15.37:0/3373255120 >> v2:172.21.15.98:3300/0 conn(0x7fc1d80b0ac0 0x7fc1d80b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:32.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.912+0000 7fc1d77fe700 1 --2- 172.21.15.37:0/3373255120 >> v2:172.21.15.98:3300/0 conn(0x7fc1d80b0ac0 0x7fc1d80b0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:32.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.912+0000 7fc1d77fe700 1 -- 172.21.15.37:0/3373255120 >> v1:172.21.15.37:6789/0 conn(0x7fc1d80cfd50 legacy=0x7fc1d80b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:32.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.912+0000 7fc1d77fe700 1 -- 172.21.15.37:0/3373255120 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d80b2830 con 0x7fc1d80b1e80 2023-07-14T15:58:32.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.912+0000 7fc1dc99c700 1 --2- 172.21.15.37:0/3373255120 >> v2:172.21.15.98:3300/0 conn(0x7fc1d80b0ac0 0x7fc1d80b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:58:32.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.912+0000 7fc1d6ffd700 1 -- 172.21.15.37:0/3373255120 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1221941611 0 0) 0x7fc1d80b1840 con 0x7fc1d80cfd50 2023-07-14T15:58:32.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.912+0000 7fc1d77fe700 1 --2- 172.21.15.37:0/3373255120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1d80b1e80 0x7fc1d80d2880 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fc1d80d23f0 tx=0x7fc1cc009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6ff3be62173efa server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:32.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.912+0000 7fc1d6ffd700 1 -- 172.21.15.37:0/3373255120 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc011830 con 0x7fc1d80b1e80 2023-07-14T15:58:32.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.912+0000 7fc1d6ffd700 1 -- 172.21.15.37:0/3373255120 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1cc011990 con 0x7fc1d80b1e80 2023-07-14T15:58:32.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.912+0000 7fc1d6ffd700 1 -- 172.21.15.37:0/3373255120 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc011d20 con 0x7fc1d80b1e80 2023-07-14T15:58:32.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.913+0000 7fc1de3ff700 1 -- 172.21.15.37:0/3373255120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1d80b1e80 msgr2=0x7fc1d80d2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:32.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.913+0000 7fc1de3ff700 1 --2- 172.21.15.37:0/3373255120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1d80b1e80 0x7fc1d80d2880 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fc1d80d23f0 tx=0x7fc1cc009b20 comp rx=0 tx=0).stop 2023-07-14T15:58:32.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.913+0000 7fc1de3ff700 1 -- 172.21.15.37:0/3373255120 shutdown_connections 2023-07-14T15:58:32.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.913+0000 7fc1de3ff700 1 --2- 172.21.15.37:0/3373255120 >> v2:172.21.15.98:3300/0 conn(0x7fc1d80b0ac0 0x7fc1d80b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:32.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.913+0000 7fc1de3ff700 1 --2- 172.21.15.37:0/3373255120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1d80b1e80 0x7fc1d80d2880 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:32.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.913+0000 7fc1de3ff700 1 -- 172.21.15.37:0/3373255120 >> 172.21.15.37:0/3373255120 conn(0x7fc1d809c1c0 msgr2=0x7fc1d80d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:32.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.913+0000 7fc1de3ff700 1 -- 172.21.15.37:0/3373255120 shutdown_connections 2023-07-14T15:58:32.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.913+0000 7fc1de3ff700 1 -- 172.21.15.37:0/3373255120 wait complete. 2023-07-14T15:58:32.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.915+0000 7fc1de3ff700 1 Processor -- start 2023-07-14T15:58:32.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.915+0000 7fc1de3ff700 1 -- start start 2023-07-14T15:58:32.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.916+0000 7fc1de3ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1d80b0ac0 0x7fc1d81502f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:32.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.916+0000 7fc1de3ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1d80b1e80 0x7fc1d81f1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:32.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.916+0000 7fc1de3ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc1d80cfd50 0x7fc1d81e5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:32.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.916+0000 7fc1de3ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d81e5060 con 0x7fc1d80b1e80 2023-07-14T15:58:32.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.916+0000 7fc1de3ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d8150830 con 0x7fc1d80b0ac0 2023-07-14T15:58:32.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.916+0000 7fc1de3ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d80c9590 con 0x7fc1d80cfd50 2023-07-14T15:58:32.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.916+0000 7fc1d77fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1d80b1e80 0x7fc1d81f1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:32.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.916+0000 7fc1d77fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1d80b1e80 0x7fc1d81f1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40422/0 (socket says 172.21.15.37:40422) 2023-07-14T15:58:32.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.916+0000 7fc1d77fe700 1 -- 172.21.15.37:0/510642463 learned_addr learned my addr 172.21.15.37:0/510642463 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:32.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.916+0000 7fc1d7fff700 1 --2- 172.21.15.37:0/510642463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1d80b0ac0 0x7fc1d81502f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:32.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.916+0000 7fc1d77fe700 1 -- 172.21.15.37:0/510642463 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc1d80cfd50 msgr2=0x7fc1d81e5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:32.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.916+0000 7fc1d77fe700 1 --2- 172.21.15.37:0/510642463 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc1d80cfd50 0x7fc1d81e5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:32.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.916+0000 7fc1d77fe700 1 -- 172.21.15.37:0/510642463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1d80b0ac0 msgr2=0x7fc1d81502f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:32.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.916+0000 7fc1d77fe700 1 --2- 172.21.15.37:0/510642463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1d80b0ac0 0x7fc1d81502f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:32.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.916+0000 7fc1d77fe700 1 -- 172.21.15.37:0/510642463 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1cc0094a0 con 0x7fc1d80b1e80 2023-07-14T15:58:32.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.916+0000 7fc1d7fff700 1 --2- 172.21.15.37:0/510642463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1d80b0ac0 0x7fc1d81502f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:58:32.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.917+0000 7fc1d77fe700 1 --2- 172.21.15.37:0/510642463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1d80b1e80 0x7fc1d81f1de0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc000c00 tx=0x7fc1cc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:32.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.917+0000 7fc1d4ff9700 1 -- 172.21.15.37:0/510642463 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc0038a0 con 0x7fc1d80b1e80 2023-07-14T15:58:32.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.917+0000 7fc1d4ff9700 1 -- 172.21.15.37:0/510642463 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1cc01f070 con 0x7fc1d80b1e80 2023-07-14T15:58:32.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.917+0000 7fc1d4ff9700 1 -- 172.21.15.37:0/510642463 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc003c40 con 0x7fc1d80b1e80 2023-07-14T15:58:32.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.917+0000 7fc1de3ff700 1 -- 172.21.15.37:0/510642463 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1d80c6960 con 0x7fc1d80b1e80 2023-07-14T15:58:32.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.917+0000 7fc1de3ff700 1 -- 172.21.15.37:0/510642463 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1d80c6f20 con 0x7fc1d80b1e80 2023-07-14T15:58:32.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.918+0000 7fc1de3ff700 1 -- 172.21.15.37:0/510642463 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1d80c97b0 con 0x7fc1d80b1e80 2023-07-14T15:58:32.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.919+0000 7fc1d4ff9700 1 -- 172.21.15.37:0/510642463 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fc1cc026480 con 0x7fc1d80b1e80 2023-07-14T15:58:32.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.920+0000 7fc1d4ff9700 1 --2- 172.21.15.37:0/510642463 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc1c406ae00 0x7fc1c406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:32.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.920+0000 7fc1d4ff9700 1 -- 172.21.15.37:0/510642463 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc1cc021070 con 0x7fc1d80b1e80 2023-07-14T15:58:32.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.920+0000 7fc1d7fff700 1 --2- 172.21.15.37:0/510642463 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc1c406ae00 0x7fc1c406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:32.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.921+0000 7fc1d7fff700 1 --2- 172.21.15.37:0/510642463 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc1c406ae00 0x7fc1c406d2b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8007fd0 tx=0x7fc1c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:32.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:32.924+0000 7fc1d4ff9700 1 -- 172.21.15.37:0/510642463 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc1cc056090 con 0x7fc1d80b1e80 2023-07-14T15:58:33.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.175+0000 7fc1de3ff700 1 -- 172.21.15.37:0/510642463 --> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvolume_0000000000096394", "snap_name": "snapshot_0000000000804182", "group_name": "group_0000000000254728", "target": ["mon-mgr", ""]}) v1 -- 0x7fc1d80d0120 con 0x7fc1c406ae00 2023-07-14T15:58:33.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.219+0000 7fc1d4ff9700 1 -- 172.21.15.37:0/510642463 <== mgr.4100 v2:172.21.15.98:6832/3163748069 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fc1c80070d0 con 0x7fc1c406ae00 2023-07-14T15:58:33.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.221+0000 7fc1de3ff700 1 -- 172.21.15.37:0/510642463 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc1c406ae00 msgr2=0x7fc1c406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:33.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.221+0000 7fc1de3ff700 1 --2- 172.21.15.37:0/510642463 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc1c406ae00 0x7fc1c406d2b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8007fd0 tx=0x7fc1c8009040 comp rx=0 tx=0).stop 2023-07-14T15:58:33.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.221+0000 7fc1de3ff700 1 -- 172.21.15.37:0/510642463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1d80b1e80 msgr2=0x7fc1d81f1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:33.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.221+0000 7fc1de3ff700 1 --2- 172.21.15.37:0/510642463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1d80b1e80 0x7fc1d81f1de0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc000c00 tx=0x7fc1cc004750 comp rx=0 tx=0).stop 2023-07-14T15:58:33.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.221+0000 7fc1de3ff700 1 -- 172.21.15.37:0/510642463 shutdown_connections 2023-07-14T15:58:33.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.221+0000 7fc1de3ff700 1 --2- 172.21.15.37:0/510642463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc1d80b0ac0 0x7fc1d81502f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:33.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.221+0000 7fc1de3ff700 1 --2- 172.21.15.37:0/510642463 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc1c406ae00 0x7fc1c406d2b0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:33.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.221+0000 7fc1de3ff700 1 --2- 172.21.15.37:0/510642463 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc1d80cfd50 0x7fc1d81e5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:33.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.221+0000 7fc1de3ff700 1 --2- 172.21.15.37:0/510642463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1d80b1e80 0x7fc1d81f1de0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:33.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.221+0000 7fc1de3ff700 1 -- 172.21.15.37:0/510642463 >> 172.21.15.37:0/510642463 conn(0x7fc1d809c1c0 msgr2=0x7fc1d80b4540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:33.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.221+0000 7fc1de3ff700 1 -- 172.21.15.37:0/510642463 shutdown_connections 2023-07-14T15:58:33.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.221+0000 7fc1de3ff700 1 -- 172.21.15.37:0/510642463 wait complete. 2023-07-14T15:58:33.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:58:33.224 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cp -p ./volumes/group_0000000000254728/subvolume_0000000000096394/.meta.stale_snap_section ./volumes/group_0000000000254728/subvolume_0000000000096394/.meta) 2023-07-14T15:58:33.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:58:33.320 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo grep SNAP_METADATA_snapshot_0000000000804182 ./volumes/group_0000000000254728/subvolume_0000000000096394/.meta) 2023-07-14T15:58:33.432 INFO:teuthology.orchestra.run.smithi037.stdout:[SNAP_METADATA_snapshot_0000000000804182] 2023-07-14T15:58:33.435 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume info cephfs subvolume_0000000000096394 group_0000000000254728 2023-07-14T15:58:33.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.664+0000 7f12c63ff700 1 Processor -- start 2023-07-14T15:58:33.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.665+0000 7f12c63ff700 1 -- start start 2023-07-14T15:58:33.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.666+0000 7f12c63ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f12c00cd3f0 0x7f12c0160be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:33.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.666+0000 7f12c63ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12c00d0970 con 0x7f12c00b21e0 2023-07-14T15:58:33.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.666+0000 7f12c63ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12c00cd890 con 0x7f12c00d16a0 2023-07-14T15:58:33.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.666+0000 7f12c63ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12c00d1280 con 0x7f12c00cd3f0 2023-07-14T15:58:33.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.666+0000 7f12bf7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f12c00cd3f0 0x7f12c0160be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:33.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.666+0000 7f12bffff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f12c00b21e0 0x7f12c00b5bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52478/0 (socket says 172.21.15.37:52478) 2023-07-14T15:58:33.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.666+0000 7f12bffff700 1 -- 172.21.15.37:0/352379712 learned_addr learned my addr 172.21.15.37:0/352379712 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:58:33.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.666+0000 7f12bf7fe700 1 -- 172.21.15.37:0/352379712 >> v1:172.21.15.98:6789/0 conn(0x7f12c00d16a0 legacy=0x7f12c00cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:33.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.666+0000 7f12bf7fe700 1 -- 172.21.15.37:0/352379712 >> v1:172.21.15.37:6789/0 conn(0x7f12c00b21e0 legacy=0x7f12c00b5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:33.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.667+0000 7f12bf7fe700 1 -- 172.21.15.37:0/352379712 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c00cdaf0 con 0x7f12c00cd3f0 2023-07-14T15:58:33.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.667+0000 7f12bf7fe700 1 --2- 172.21.15.37:0/352379712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12c00cd3f0 0x7f12c0160be0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f12b4009840 tx=0x7f12b4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1b1419771d0f449 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:33.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.667+0000 7f12beffd700 1 -- 172.21.15.37:0/352379712 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b4011830 con 0x7f12c00cd3f0 2023-07-14T15:58:33.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.667+0000 7f12beffd700 1 -- 172.21.15.37:0/352379712 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b4011990 con 0x7f12c00cd3f0 2023-07-14T15:58:33.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.667+0000 7f12beffd700 1 -- 172.21.15.37:0/352379712 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b4011d20 con 0x7f12c00cd3f0 2023-07-14T15:58:33.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.667+0000 7f12c63ff700 1 -- 172.21.15.37:0/352379712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12c00cd3f0 msgr2=0x7f12c0160be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:33.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.667+0000 7f12c63ff700 1 --2- 172.21.15.37:0/352379712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12c00cd3f0 0x7f12c0160be0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f12b4009840 tx=0x7f12b4009b50 comp rx=0 tx=0).stop 2023-07-14T15:58:33.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.668+0000 7f12c63ff700 1 -- 172.21.15.37:0/352379712 shutdown_connections 2023-07-14T15:58:33.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.668+0000 7f12c63ff700 1 --2- 172.21.15.37:0/352379712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12c00cd3f0 0x7f12c0160be0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:33.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.668+0000 7f12c63ff700 1 -- 172.21.15.37:0/352379712 >> 172.21.15.37:0/352379712 conn(0x7f12c00715a0 msgr2=0x7f12c0071970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:33.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.668+0000 7f12c63ff700 1 -- 172.21.15.37:0/352379712 shutdown_connections 2023-07-14T15:58:33.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.668+0000 7f12c63ff700 1 -- 172.21.15.37:0/352379712 wait complete. 2023-07-14T15:58:33.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.669+0000 7f12c63ff700 1 Processor -- start 2023-07-14T15:58:33.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.670+0000 7f12c63ff700 1 -- start start 2023-07-14T15:58:33.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.671+0000 7f12c63ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12c00b21e0 0x7f12c01ef8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:33.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.671+0000 7f12c63ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12c00cd3f0 0x7f12c015ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:33.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.671+0000 7f12c63ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f12c00d16a0 0x7f12c00b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:33.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.671+0000 7f12c63ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c01f23c0 con 0x7f12c00b21e0 2023-07-14T15:58:33.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.671+0000 7f12c63ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c01f2660 con 0x7f12c00cd3f0 2023-07-14T15:58:33.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.671+0000 7f12c63ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c01f2940 con 0x7f12c00d16a0 2023-07-14T15:58:33.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.671+0000 7f12bffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12c00b21e0 0x7f12c01ef8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:33.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.671+0000 7f12bffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12c00b21e0 0x7f12c01ef8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40436/0 (socket says 172.21.15.37:40436) 2023-07-14T15:58:33.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.671+0000 7f12bffff700 1 -- 172.21.15.37:0/2191088559 learned_addr learned my addr 172.21.15.37:0/2191088559 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:33.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.671+0000 7f12bf7fe700 1 --2- 172.21.15.37:0/2191088559 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12c00cd3f0 0x7f12c015ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:33.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.671+0000 7f12bffff700 1 -- 172.21.15.37:0/2191088559 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f12c00d16a0 msgr2=0x7f12c00b4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:33.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.671+0000 7f12c499c700 1 --2- 172.21.15.37:0/2191088559 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f12c00d16a0 0x7f12c00b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:33.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.671+0000 7f12bffff700 1 --2- 172.21.15.37:0/2191088559 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f12c00d16a0 0x7f12c00b4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:33.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.671+0000 7f12bffff700 1 -- 172.21.15.37:0/2191088559 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12c00cd3f0 msgr2=0x7f12c015ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:33.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.671+0000 7f12bffff700 1 --2- 172.21.15.37:0/2191088559 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12c00cd3f0 0x7f12c015ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:33.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.671+0000 7f12bffff700 1 -- 172.21.15.37:0/2191088559 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b40094a0 con 0x7f12c00b21e0 2023-07-14T15:58:33.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.671+0000 7f12bf7fe700 1 --2- 172.21.15.37:0/2191088559 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12c00cd3f0 0x7f12c015ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:58:33.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.671+0000 7f12c499c700 1 --2- 172.21.15.37:0/2191088559 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f12c00d16a0 0x7f12c00b4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:58:33.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.672+0000 7f12bffff700 1 --2- 172.21.15.37:0/2191088559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12c00b21e0 0x7f12c01ef8a0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f12b000c520 tx=0x7f12b000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:33.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.672+0000 7f12bcff9700 1 -- 172.21.15.37:0/2191088559 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b0005d70 con 0x7f12c00b21e0 2023-07-14T15:58:33.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.672+0000 7f12bcff9700 1 -- 172.21.15.37:0/2191088559 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b00070d0 con 0x7f12c00b21e0 2023-07-14T15:58:33.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.672+0000 7f12bcff9700 1 -- 172.21.15.37:0/2191088559 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b0007440 con 0x7f12c00b21e0 2023-07-14T15:58:33.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.672+0000 7f12c63ff700 1 -- 172.21.15.37:0/2191088559 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12c01f2c20 con 0x7f12c00b21e0 2023-07-14T15:58:33.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.672+0000 7f12c63ff700 1 -- 172.21.15.37:0/2191088559 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12c01f6670 con 0x7f12c00b21e0 2023-07-14T15:58:33.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.673+0000 7f12c63ff700 1 -- 172.21.15.37:0/2191088559 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12c01f3140 con 0x7f12c00b21e0 2023-07-14T15:58:33.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.674+0000 7f12bcff9700 1 -- 172.21.15.37:0/2191088559 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f12b00075a0 con 0x7f12c00b21e0 2023-07-14T15:58:33.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.675+0000 7f12bcff9700 1 --2- 172.21.15.37:0/2191088559 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f12ac06ae00 0x7f12ac06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:33.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.675+0000 7f12bcff9700 1 -- 172.21.15.37:0/2191088559 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f12b0088a20 con 0x7f12c00b21e0 2023-07-14T15:58:33.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.675+0000 7f12bf7fe700 1 --2- 172.21.15.37:0/2191088559 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f12ac06ae00 0x7f12ac06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:33.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.676+0000 7f12bf7fe700 1 --2- 172.21.15.37:0/2191088559 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f12ac06ae00 0x7f12ac06d2b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f12c00c8bf0 tx=0x7f12b4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:33.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.679+0000 7f12bcff9700 1 -- 172.21.15.37:0/2191088559 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f12b0053a60 con 0x7f12c00b21e0 2023-07-14T15:58:33.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.922+0000 7f12c63ff700 1 -- 172.21.15.37:0/2191088559 --> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] -- mgr_command(tid 0: {"prefix": "fs subvolume info", "vol_name": "cephfs", "sub_name": "subvolume_0000000000096394", "group_name": "group_0000000000254728", "target": ["mon-mgr", ""]}) v1 -- 0x7f12c00d0bc0 con 0x7f12ac06ae00 2023-07-14T15:58:33.940 INFO:tasks.ceph.mgr.x.smithi098.stderr:2023-07-14T15:58:33.956+0000 7fa3c0dbe700 -1 mgr.server reply reply (61) No data available error in getxattr 2023-07-14T15:58:33.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:33.956+0000 7f12bcff9700 1 -- 172.21.15.37:0/2191088559 <== mgr.4100 v2:172.21.15.98:6832/3163748069 1 ==== mgr_command_reply(tid 0: -61 error in getxattr) v1 ==== 25+0+0 (secure 0 0 0) 0x7f12b4011630 con 0x7f12ac06ae00 2023-07-14T15:58:33.942 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENODATA: error in getxattr 2023-07-14T15:58:33.951 DEBUG:teuthology.orchestra.run:got remote process result: 61 2023-07-14T15:58:33.952 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-14T15:58:33.952 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T15:58:34.051 DEBUG:teuthology.orchestra.run.smithi098:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T15:58:34.153 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-14T15:58:34.154 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-14T15:58:34.154 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T15:58:34.202 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-14T15:58:34.203 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T15:58:34.290 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T15:58:34.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.551+0000 7fc5607ff700 1 Processor -- start 2023-07-14T15:58:34.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.552+0000 7fc5607ff700 1 -- start start 2023-07-14T15:58:34.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.553+0000 7fc5607ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc5580cffc0 0x7fc5580b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:34.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.553+0000 7fc5607ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fc558160c50 0x7fc5580cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:34.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.553+0000 7fc5607ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5580cf6f0 con 0x7fc5580b8b80 2023-07-14T15:58:34.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.553+0000 7fc5607ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5580d0de0 con 0x7fc5580cffc0 2023-07-14T15:58:34.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.553+0000 7fc5607ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5581610f0 con 0x7fc558160c50 2023-07-14T15:58:34.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.553+0000 7fc55dd9a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc5580cffc0 0x7fc5580b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:34.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.553+0000 7fc55dd9a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc5580cffc0 0x7fc5580b5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40448/0 (socket says 172.21.15.37:40448) 2023-07-14T15:58:34.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.553+0000 7fc55dd9a700 1 -- 172.21.15.37:0/1990299204 learned_addr learned my addr 172.21.15.37:0/1990299204 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:34.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.553+0000 7fc55ed9c700 1 --2- 172.21.15.37:0/1990299204 >> v2:172.21.15.98:3300/0 conn(0x7fc558160c50 0x7fc5580cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:34.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.553+0000 7fc55dd9a700 1 -- 172.21.15.37:0/1990299204 >> v2:172.21.15.98:3300/0 conn(0x7fc558160c50 msgr2=0x7fc5580cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:34.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.553+0000 7fc55dd9a700 1 --2- 172.21.15.37:0/1990299204 >> v2:172.21.15.98:3300/0 conn(0x7fc558160c50 0x7fc5580cf1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:34.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.553+0000 7fc55dd9a700 1 -- 172.21.15.37:0/1990299204 >> v1:172.21.15.98:6789/0 conn(0x7fc5580b8b80 legacy=0x7fc5580cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:34.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.553+0000 7fc55dd9a700 1 -- 172.21.15.37:0/1990299204 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5580cd590 con 0x7fc5580cffc0 2023-07-14T15:58:34.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.553+0000 7fc55ed9c700 1 --2- 172.21.15.37:0/1990299204 >> v2:172.21.15.98:3300/0 conn(0x7fc558160c50 0x7fc5580cf1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:58:34.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.554+0000 7fc55dd9a700 1 --2- 172.21.15.37:0/1990299204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5580cffc0 0x7fc5580b5cf0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fc5580ceeb0 tx=0x7fc548009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7120239225b9f0b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:34.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.554+0000 7fc55d599700 1 -- 172.21.15.37:0/1990299204 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54800b870 con 0x7fc5580cffc0 2023-07-14T15:58:34.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.554+0000 7fc55d599700 1 -- 172.21.15.37:0/1990299204 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc54800b9d0 con 0x7fc5580cffc0 2023-07-14T15:58:34.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.554+0000 7fc55d599700 1 -- 172.21.15.37:0/1990299204 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54800bd60 con 0x7fc5580cffc0 2023-07-14T15:58:34.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.554+0000 7fc5607ff700 1 -- 172.21.15.37:0/1990299204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5580cffc0 msgr2=0x7fc5580b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:34.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.554+0000 7fc5607ff700 1 --2- 172.21.15.37:0/1990299204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5580cffc0 0x7fc5580b5cf0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fc5580ceeb0 tx=0x7fc548009bd0 comp rx=0 tx=0).stop 2023-07-14T15:58:34.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.555+0000 7fc5607ff700 1 -- 172.21.15.37:0/1990299204 shutdown_connections 2023-07-14T15:58:34.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.555+0000 7fc5607ff700 1 --2- 172.21.15.37:0/1990299204 >> v2:172.21.15.98:3300/0 conn(0x7fc558160c50 0x7fc5580cf1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:34.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.555+0000 7fc5607ff700 1 --2- 172.21.15.37:0/1990299204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5580cffc0 0x7fc5580b5cf0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:34.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.555+0000 7fc5607ff700 1 -- 172.21.15.37:0/1990299204 >> 172.21.15.37:0/1990299204 conn(0x7fc55806b150 msgr2=0x7fc55806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:34.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.555+0000 7fc5607ff700 1 -- 172.21.15.37:0/1990299204 shutdown_connections 2023-07-14T15:58:34.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.555+0000 7fc5607ff700 1 -- 172.21.15.37:0/1990299204 wait complete. 2023-07-14T15:58:34.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.556+0000 7fc5607ff700 1 Processor -- start 2023-07-14T15:58:34.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.557+0000 7fc5607ff700 1 -- start start 2023-07-14T15:58:34.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.557+0000 7fc5607ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc5580b8b80 0x7fc5581f4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:34.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.557+0000 7fc5607ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5580cffc0 0x7fc5580b6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:34.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.557+0000 7fc5607ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc558160c50 0x7fc5580b6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:34.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.557+0000 7fc5607ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5580b3540 con 0x7fc558160c50 2023-07-14T15:58:34.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.557+0000 7fc5607ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5580c9f70 con 0x7fc5580cffc0 2023-07-14T15:58:34.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.557+0000 7fc5607ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5580ca250 con 0x7fc5580b8b80 2023-07-14T15:58:34.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.558+0000 7fc55ed9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc558160c50 0x7fc5580b6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:34.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.558+0000 7fc55ed9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc558160c50 0x7fc5580b6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40452/0 (socket says 172.21.15.37:40452) 2023-07-14T15:58:34.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.558+0000 7fc55ed9c700 1 -- 172.21.15.37:0/1555773860 learned_addr learned my addr 172.21.15.37:0/1555773860 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:34.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.558+0000 7fc55dd9a700 1 --2- 172.21.15.37:0/1555773860 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5580cffc0 0x7fc5580b6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:34.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.558+0000 7fc55e59b700 1 --2- 172.21.15.37:0/1555773860 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc5580b8b80 0x7fc5581f4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:34.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.558+0000 7fc55ed9c700 1 -- 172.21.15.37:0/1555773860 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc5580b8b80 msgr2=0x7fc5581f4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:34.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.558+0000 7fc55ed9c700 1 --2- 172.21.15.37:0/1555773860 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc5580b8b80 0x7fc5581f4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:34.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.558+0000 7fc55ed9c700 1 -- 172.21.15.37:0/1555773860 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5580cffc0 msgr2=0x7fc5580b6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:34.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.558+0000 7fc55ed9c700 1 --2- 172.21.15.37:0/1555773860 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5580cffc0 0x7fc5580b6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:34.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.558+0000 7fc55ed9c700 1 -- 172.21.15.37:0/1555773860 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc548009550 con 0x7fc558160c50 2023-07-14T15:58:34.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.558+0000 7fc55e59b700 1 --2- 172.21.15.37:0/1555773860 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc5580b8b80 0x7fc5581f4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:58:34.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.558+0000 7fc55ed9c700 1 --2- 172.21.15.37:0/1555773860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc558160c50 0x7fc5580b6a50 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fc550009fa0 tx=0x7fc55000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:34.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.559+0000 7fc54effd700 1 -- 172.21.15.37:0/1555773860 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55000de60 con 0x7fc558160c50 2023-07-14T15:58:34.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.559+0000 7fc54effd700 1 -- 172.21.15.37:0/1555773860 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc55000f040 con 0x7fc558160c50 2023-07-14T15:58:34.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.559+0000 7fc54effd700 1 -- 172.21.15.37:0/1555773860 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc550003c80 con 0x7fc558160c50 2023-07-14T15:58:34.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.559+0000 7fc5607ff700 1 -- 172.21.15.37:0/1555773860 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5580ca530 con 0x7fc558160c50 2023-07-14T15:58:34.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.559+0000 7fc5607ff700 1 -- 172.21.15.37:0/1555773860 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5581f51e0 con 0x7fc558160c50 2023-07-14T15:58:34.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.560+0000 7fc5607ff700 1 -- 172.21.15.37:0/1555773860 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc558067840 con 0x7fc558160c50 2023-07-14T15:58:34.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.561+0000 7fc54effd700 1 -- 172.21.15.37:0/1555773860 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fc550004030 con 0x7fc558160c50 2023-07-14T15:58:34.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.562+0000 7fc54effd700 1 --2- 172.21.15.37:0/1555773860 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc53c06ae00 0x7fc53c06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:34.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.562+0000 7fc54effd700 1 -- 172.21.15.37:0/1555773860 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc5500898f0 con 0x7fc558160c50 2023-07-14T15:58:34.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.563+0000 7fc55e59b700 1 --2- 172.21.15.37:0/1555773860 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc53c06ae00 0x7fc53c06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:34.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.563+0000 7fc55e59b700 1 --2- 172.21.15.37:0/1555773860 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc53c06ae00 0x7fc53c06d2b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc554000f60 tx=0x7fc554009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:34.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.567+0000 7fc54effd700 1 -- 172.21.15.37:0/1555773860 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc5500546e0 con 0x7fc558160c50 2023-07-14T15:58:34.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.781+0000 7fc5607ff700 1 -- 172.21.15.37:0/1555773860 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc55806c9b0 con 0x7fc558160c50 2023-07-14T15:58:34.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.782+0000 7fc54effd700 1 -- 172.21.15.37:0/1555773860 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+18281 (secure 0 0 0) 0x7fc550057d00 con 0x7fc558160c50 2023-07-14T15:58:34.767 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:58:34.767 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":49,"fsid":"9da30401-a779-4e46-aba6-00c2494c6c67","created":"2023-07-14T15:55:39.898867+0000","modified":"2023-07-14T15:58:09.712394+0000","last_up_change":"2023-07-14T15:55:53.025696+0000","last_in_change":"2023-07-14T15:55:43.388192+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T15:55:52.907261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T15:55:59.992839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-14T15:58:05.947379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-14T15:58:07.213413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d049535-7b87-4276-8fe5-0f74ba422d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6801","nonce":2783032392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6803","nonce":2783032392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6807","nonce":2783032392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6805","nonce":2783032392}]},"public_addr":"172.21.15.37:6801/2783032392","cluster_addr":"172.21.15.37:6803/2783032392","heartbeat_back_addr":"172.21.15.37:6807/2783032392","heartbeat_front_addr":"172.21.15.37:6805/2783032392","state":["exists","up"]},{"osd":1,"uuid":"79ec948d-ead2-4c2d-923a-dd6eeaac9dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6823","nonce":1190059746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6826","nonce":1190059746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6831","nonce":1190059746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6829","nonce":1190059746}]},"public_addr":"172.21.15.37:6823/1190059746","cluster_addr":"172.21.15.37:6826/1190059746","heartbeat_back_addr":"172.21.15.37:6831/1190059746","heartbeat_front_addr":"172.21.15.37:6829/1190059746","state":["exists","up"]},{"osd":2,"uuid":"a1db6690-c160-4366-9c82-2cca17e4bba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6809","nonce":2266223499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6813","nonce":2266223499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6820","nonce":2266223499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6816","nonce":2266223499}]},"public_addr":"172.21.15.37:6809/2266223499","cluster_addr":"172.21.15.37:6813/2266223499","heartbeat_back_addr":"172.21.15.37:6820/2266223499","heartbeat_front_addr":"172.21.15.37:6816/2266223499","state":["exists","up"]},{"osd":3,"uuid":"767b8220-e79a-4a86-a162-6b3b73198379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6812","nonce":4166694594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6817","nonce":4166694594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6828","nonce":4166694594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6822","nonce":4166694594}]},"public_addr":"172.21.15.37:6812/4166694594","cluster_addr":"172.21.15.37:6817/4166694594","heartbeat_back_addr":"172.21.15.37:6828/4166694594","heartbeat_front_addr":"172.21.15.37:6822/4166694594","state":["exists","up"]},{"osd":4,"uuid":"717bd773-ae7e-4236-ac79-900cf99a37c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6801","nonce":3529020407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6803","nonce":3529020407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6807","nonce":3529020407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6805","nonce":3529020407}]},"public_addr":"172.21.15.98:6801/3529020407","cluster_addr":"172.21.15.98:6803/3529020407","heartbeat_back_addr":"172.21.15.98:6807/3529020407","heartbeat_front_addr":"172.21.15.98:6805/3529020407","state":["exists","up"]},{"osd":5,"uuid":"a941d358-0f03-4136-a9b2-3a1c2e9358cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6817","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6819","nonce":2311501838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6821","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6823","nonce":2311501838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6829","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6831","nonce":2311501838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6825","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6827","nonce":2311501838}]},"public_addr":"172.21.15.98:6819/2311501838","cluster_addr":"172.21.15.98:6823/2311501838","heartbeat_back_addr":"172.21.15.98:6831/2311501838","heartbeat_front_addr":"172.21.15.98:6827/2311501838","state":["exists","up"]},{"osd":6,"uuid":"27153772-6d4b-479d-9953-0582e7b96743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6809","nonce":1144224691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6811","nonce":1144224691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6815","nonce":1144224691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6813","nonce":1144224691}]},"public_addr":"172.21.15.98:6809/1144224691","cluster_addr":"172.21.15.98:6811/1144224691","heartbeat_back_addr":"172.21.15.98:6815/1144224691","heartbeat_front_addr":"172.21.15.98:6813/1144224691","state":["exists","up"]},{"osd":7,"uuid":"d21ffc8e-40bb-47eb-af2c-e3e730d3fb76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6818","nonce":1144470927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6822","nonce":1144470927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6830","nonce":1144470927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6826","nonce":1144470927}]},"public_addr":"172.21.15.98:6818/1144470927","cluster_addr":"172.21.15.98:6822/1144470927","heartbeat_back_addr":"172.21.15.98:6830/1144470927","heartbeat_front_addr":"172.21.15.98:6826/1144470927","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.921114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.739210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.024016+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.002527+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.698127+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.813416+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.709351+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.815457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T15:58:34.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.785+0000 7fc5607ff700 1 -- 172.21.15.37:0/1555773860 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc53c06ae00 msgr2=0x7fc53c06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:34.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.785+0000 7fc5607ff700 1 --2- 172.21.15.37:0/1555773860 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc53c06ae00 0x7fc53c06d2b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc554000f60 tx=0x7fc554009040 comp rx=0 tx=0).stop 2023-07-14T15:58:34.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.785+0000 7fc5607ff700 1 -- 172.21.15.37:0/1555773860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc558160c50 msgr2=0x7fc5580b6a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:34.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.785+0000 7fc5607ff700 1 --2- 172.21.15.37:0/1555773860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc558160c50 0x7fc5580b6a50 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fc550009fa0 tx=0x7fc55000d3b0 comp rx=0 tx=0).stop 2023-07-14T15:58:34.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.785+0000 7fc5607ff700 1 -- 172.21.15.37:0/1555773860 shutdown_connections 2023-07-14T15:58:34.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.785+0000 7fc5607ff700 1 --2- 172.21.15.37:0/1555773860 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc53c06ae00 0x7fc53c06d2b0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:34.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.785+0000 7fc5607ff700 1 --2- 172.21.15.37:0/1555773860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc558160c50 0x7fc5580b6a50 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:34.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.785+0000 7fc5607ff700 1 --2- 172.21.15.37:0/1555773860 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc5580b8b80 0x7fc5581f4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:34.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.785+0000 7fc5607ff700 1 --2- 172.21.15.37:0/1555773860 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5580cffc0 0x7fc5580b6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:34.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.785+0000 7fc5607ff700 1 -- 172.21.15.37:0/1555773860 >> 172.21.15.37:0/1555773860 conn(0x7fc55806b150 msgr2=0x7fc5580b7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:34.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.785+0000 7fc5607ff700 1 -- 172.21.15.37:0/1555773860 shutdown_connections 2023-07-14T15:58:34.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:34.785+0000 7fc5607ff700 1 -- 172.21.15.37:0/1555773860 wait complete. 2023-07-14T15:58:34.788 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T15:55:52.907261+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T15:55:59.992839+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T15:58:05.947379+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T15:58:07.213413+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T15:58:34.789 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T15:58:34.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.011+0000 7fe46e5ff700 1 Processor -- start 2023-07-14T15:58:34.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.011+0000 7fe46e5ff700 1 -- start start 2023-07-14T15:58:34.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.012+0000 7fe46e5ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe46815fee0 0x7fe46815ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:34.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.013+0000 7fe46e5ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe4680d1140 0x7fe4680b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:34.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.013+0000 7fe46e5ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe46815dc50 con 0x7fe4681603b0 2023-07-14T15:58:34.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.013+0000 7fe46e5ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4680b2940 con 0x7fe4680d1140 2023-07-14T15:58:34.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.013+0000 7fe46e5ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4680b2c20 con 0x7fe46815fee0 2023-07-14T15:58:34.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.013+0000 7fe46cb9c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe4680d1140 0x7fe4680b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:34.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.013+0000 7fe46cb9c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe4680d1140 0x7fe4680b39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40462/0 (socket says 172.21.15.37:40462) 2023-07-14T15:58:34.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.013+0000 7fe46cb9c700 1 -- 172.21.15.37:0/3599873578 learned_addr learned my addr 172.21.15.37:0/3599873578 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:34.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.013+0000 7fe4677fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe4681603b0 0x7fe4680d0a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52492/0 (socket says 172.21.15.37:52492) 2023-07-14T15:58:34.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.013+0000 7fe467fff700 1 --2- 172.21.15.37:0/3599873578 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe46815fee0 0x7fe46815ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:34.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.013+0000 7fe46cb9c700 1 -- 172.21.15.37:0/3599873578 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe46815fee0 msgr2=0x7fe46815ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:34.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.013+0000 7fe46cb9c700 1 --2- 172.21.15.37:0/3599873578 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe46815fee0 0x7fe46815ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:34.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.013+0000 7fe46cb9c700 1 -- 172.21.15.37:0/3599873578 >> v1:172.21.15.37:6789/0 conn(0x7fe4681603b0 legacy=0x7fe4680d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:34.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.013+0000 7fe46cb9c700 1 -- 172.21.15.37:0/3599873578 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4680b2f00 con 0x7fe4680d1140 2023-07-14T15:58:35.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.013+0000 7fe466ffd700 1 -- 172.21.15.37:0/3599873578 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1406320709 0 0) 0x7fe46815dc50 con 0x7fe4681603b0 2023-07-14T15:58:35.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.014+0000 7fe46cb9c700 1 --2- 172.21.15.37:0/3599873578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4680d1140 0x7fe4680b39e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fe460009e50 tx=0x7fe46000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caedc6f4558e00d2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:35.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.014+0000 7fe466ffd700 1 -- 172.21.15.37:0/3599873578 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46000e070 con 0x7fe4680d1140 2023-07-14T15:58:35.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.014+0000 7fe466ffd700 1 -- 172.21.15.37:0/3599873578 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46000b9c0 con 0x7fe4680d1140 2023-07-14T15:58:35.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.014+0000 7fe466ffd700 1 -- 172.21.15.37:0/3599873578 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46000bd70 con 0x7fe4680d1140 2023-07-14T15:58:35.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.014+0000 7fe46e5ff700 1 -- 172.21.15.37:0/3599873578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4680d1140 msgr2=0x7fe4680b39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:35.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.014+0000 7fe46e5ff700 1 --2- 172.21.15.37:0/3599873578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4680d1140 0x7fe4680b39e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fe460009e50 tx=0x7fe46000b330 comp rx=0 tx=0).stop 2023-07-14T15:58:35.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.014+0000 7fe46e5ff700 1 -- 172.21.15.37:0/3599873578 shutdown_connections 2023-07-14T15:58:35.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.014+0000 7fe46e5ff700 1 --2- 172.21.15.37:0/3599873578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4680d1140 0x7fe4680b39e0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:35.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.014+0000 7fe46e5ff700 1 --2- 172.21.15.37:0/3599873578 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe46815fee0 0x7fe46815ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:35.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.015+0000 7fe46e5ff700 1 -- 172.21.15.37:0/3599873578 >> 172.21.15.37:0/3599873578 conn(0x7fe46809c1b0 msgr2=0x7fe4680d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:35.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.015+0000 7fe46e5ff700 1 -- 172.21.15.37:0/3599873578 shutdown_connections 2023-07-14T15:58:35.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.015+0000 7fe46e5ff700 1 -- 172.21.15.37:0/3599873578 wait complete. 2023-07-14T15:58:35.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.016+0000 7fe46e5ff700 1 Processor -- start 2023-07-14T15:58:35.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.016+0000 7fe46e5ff700 1 -- start start 2023-07-14T15:58:35.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.017+0000 7fe46e5ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe4680d1140 0x7fe4681541c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:35.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.017+0000 7fe46e5ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe46815fee0 0x7fe4680b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:35.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.017+0000 7fe46e5ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4681603b0 0x7fe4680b8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:35.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.017+0000 7fe46e5ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4680afb90 con 0x7fe46815fee0 2023-07-14T15:58:35.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.017+0000 7fe46e5ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4680afe70 con 0x7fe4681603b0 2023-07-14T15:58:35.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.017+0000 7fe46e5ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4680b0150 con 0x7fe4680d1140 2023-07-14T15:58:35.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.018+0000 7fe4677fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe46815fee0 0x7fe4680b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:35.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.018+0000 7fe4677fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe46815fee0 0x7fe4680b0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40472/0 (socket says 172.21.15.37:40472) 2023-07-14T15:58:35.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.018+0000 7fe4677fe700 1 -- 172.21.15.37:0/3648173601 learned_addr learned my addr 172.21.15.37:0/3648173601 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:35.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.018+0000 7fe467fff700 1 --2- 172.21.15.37:0/3648173601 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe4680d1140 0x7fe4681541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:35.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.018+0000 7fe46cb9c700 1 --2- 172.21.15.37:0/3648173601 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4681603b0 0x7fe4680b8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:35.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.018+0000 7fe4677fe700 1 -- 172.21.15.37:0/3648173601 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe4680d1140 msgr2=0x7fe4681541c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:35.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.018+0000 7fe4677fe700 1 --2- 172.21.15.37:0/3648173601 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe4680d1140 0x7fe4681541c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:35.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.018+0000 7fe4677fe700 1 -- 172.21.15.37:0/3648173601 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4681603b0 msgr2=0x7fe4680b8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:35.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.018+0000 7fe4677fe700 1 --2- 172.21.15.37:0/3648173601 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4681603b0 0x7fe4680b8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:35.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.018+0000 7fe4677fe700 1 -- 172.21.15.37:0/3648173601 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe460009b30 con 0x7fe46815fee0 2023-07-14T15:58:35.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.018+0000 7fe46cb9c700 1 --2- 172.21.15.37:0/3648173601 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4681603b0 0x7fe4680b8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:58:35.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.018+0000 7fe467fff700 1 --2- 172.21.15.37:0/3648173601 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe4680d1140 0x7fe4681541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:58:35.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.018+0000 7fe4677fe700 1 --2- 172.21.15.37:0/3648173601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe46815fee0 0x7fe4680b0c30 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fe45c00c550 tx=0x7fe45c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:35.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.019+0000 7fe464ff9700 1 -- 172.21.15.37:0/3648173601 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45c004c80 con 0x7fe46815fee0 2023-07-14T15:58:35.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.019+0000 7fe464ff9700 1 -- 172.21.15.37:0/3648173601 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe45c004e00 con 0x7fe46815fee0 2023-07-14T15:58:35.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.019+0000 7fe464ff9700 1 -- 172.21.15.37:0/3648173601 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45c007310 con 0x7fe46815fee0 2023-07-14T15:58:35.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.019+0000 7fe46e5ff700 1 -- 172.21.15.37:0/3648173601 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4680b0430 con 0x7fe46815fee0 2023-07-14T15:58:35.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.019+0000 7fe46e5ff700 1 -- 172.21.15.37:0/3648173601 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe468154700 con 0x7fe46815fee0 2023-07-14T15:58:35.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.020+0000 7fe46e5ff700 1 -- 172.21.15.37:0/3648173601 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4680b0950 con 0x7fe46815fee0 2023-07-14T15:58:35.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.021+0000 7fe464ff9700 1 -- 172.21.15.37:0/3648173601 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fe45c007470 con 0x7fe46815fee0 2023-07-14T15:58:35.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.022+0000 7fe464ff9700 1 --2- 172.21.15.37:0/3648173601 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe45406ae00 0x7fe45406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:35.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.022+0000 7fe464ff9700 1 -- 172.21.15.37:0/3648173601 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe45c089380 con 0x7fe46815fee0 2023-07-14T15:58:35.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.022+0000 7fe467fff700 1 --2- 172.21.15.37:0/3648173601 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe45406ae00 0x7fe45406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:35.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.023+0000 7fe467fff700 1 --2- 172.21.15.37:0/3648173601 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe45406ae00 0x7fe45406d2b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe4580099f0 tx=0x7fe458008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:35.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.026+0000 7fe464ff9700 1 -- 172.21.15.37:0/3648173601 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe4680b0950 con 0x7fe46815fee0 2023-07-14T15:58:35.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.235+0000 7fe46e5ff700 1 -- 172.21.15.37:0/3648173601 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe4680b0950 con 0x7fe46815fee0 2023-07-14T15:58:35.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.235+0000 7fe464ff9700 1 -- 172.21.15.37:0/3648173601 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe4680b0950 con 0x7fe46815fee0 2023-07-14T15:58:35.220 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-14T15:58:35.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.237+0000 7fe46e5ff700 1 -- 172.21.15.37:0/3648173601 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe45406ae00 msgr2=0x7fe45406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:35.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.237+0000 7fe46e5ff700 1 --2- 172.21.15.37:0/3648173601 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe45406ae00 0x7fe45406d2b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe4580099f0 tx=0x7fe458008040 comp rx=0 tx=0).stop 2023-07-14T15:58:35.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.237+0000 7fe46e5ff700 1 -- 172.21.15.37:0/3648173601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe46815fee0 msgr2=0x7fe4680b0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:35.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.237+0000 7fe46e5ff700 1 --2- 172.21.15.37:0/3648173601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe46815fee0 0x7fe4680b0c30 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fe45c00c550 tx=0x7fe45c00c910 comp rx=0 tx=0).stop 2023-07-14T15:58:35.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.237+0000 7fe46e5ff700 1 -- 172.21.15.37:0/3648173601 shutdown_connections 2023-07-14T15:58:35.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.237+0000 7fe46e5ff700 1 --2- 172.21.15.37:0/3648173601 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4681603b0 0x7fe4680b8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:35.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.237+0000 7fe46e5ff700 1 --2- 172.21.15.37:0/3648173601 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fe45406ae00 0x7fe45406d2b0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:35.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.237+0000 7fe46e5ff700 1 --2- 172.21.15.37:0/3648173601 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe4680d1140 0x7fe4681541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:35.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.237+0000 7fe46e5ff700 1 --2- 172.21.15.37:0/3648173601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe46815fee0 0x7fe4680b0c30 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:35.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.237+0000 7fe46e5ff700 1 -- 172.21.15.37:0/3648173601 >> 172.21.15.37:0/3648173601 conn(0x7fe46809c1b0 msgr2=0x7fe468160820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:35.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.238+0000 7fe46e5ff700 1 -- 172.21.15.37:0/3648173601 shutdown_connections 2023-07-14T15:58:35.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.238+0000 7fe46e5ff700 1 -- 172.21.15.37:0/3648173601 wait complete. 2023-07-14T15:58:35.241 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T15:58:35.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.462+0000 7fbbb57ff700 1 Processor -- start 2023-07-14T15:58:35.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.463+0000 7fbbb57ff700 1 -- start start 2023-07-14T15:58:35.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.464+0000 7fbbb57ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbbb00b1e80 0x7fbbb00d2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:35.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.464+0000 7fbbb57ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbbb00b0ac0 0x7fbbb00b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:35.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.464+0000 7fbbb57ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbb00b1840 con 0x7fbbb00cfd50 2023-07-14T15:58:35.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.464+0000 7fbbb57ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbb015ccf0 con 0x7fbbb00b1e80 2023-07-14T15:58:35.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.464+0000 7fbbb57ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb00b2550 con 0x7fbbb00b0ac0 2023-07-14T15:58:35.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.464+0000 7fbbae7fc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbbb00b1e80 0x7fbbb00d2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:35.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.464+0000 7fbbae7fc700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbbb00b1e80 0x7fbbb00d2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40478/0 (socket says 172.21.15.37:40478) 2023-07-14T15:58:35.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.464+0000 7fbbaeffd700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fbbb00cfd50 0x7fbbb00b2d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52508/0 (socket says 172.21.15.37:52508) 2023-07-14T15:58:35.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.464+0000 7fbbae7fc700 1 -- 172.21.15.37:0/3659489228 learned_addr learned my addr 172.21.15.37:0/3659489228 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:35.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.465+0000 7fbbaf7fe700 1 --2- 172.21.15.37:0/3659489228 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbbb00b0ac0 0x7fbbb00b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:35.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.465+0000 7fbbae7fc700 1 -- 172.21.15.37:0/3659489228 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbbb00b0ac0 msgr2=0x7fbbb00b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:35.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.465+0000 7fbbae7fc700 1 --2- 172.21.15.37:0/3659489228 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbbb00b0ac0 0x7fbbb00b0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:35.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.465+0000 7fbbae7fc700 1 -- 172.21.15.37:0/3659489228 >> v1:172.21.15.37:6789/0 conn(0x7fbbb00cfd50 legacy=0x7fbbb00b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:35.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.465+0000 7fbbae7fc700 1 -- 172.21.15.37:0/3659489228 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb00b2830 con 0x7fbbb00b1e80 2023-07-14T15:58:35.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.465+0000 7fbbaf7fe700 1 --2- 172.21.15.37:0/3659489228 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbbb00b0ac0 0x7fbbb00b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:58:35.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.465+0000 7fbbae7fc700 1 --2- 172.21.15.37:0/3659489228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbb00b1e80 0x7fbbb00d2880 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fbba40098f0 tx=0x7fbba4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8468c89e64f52b08 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:35.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.465+0000 7fbbadffb700 1 -- 172.21.15.37:0/3659489228 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba400b8a0 con 0x7fbbb00b1e80 2023-07-14T15:58:35.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.465+0000 7fbbadffb700 1 -- 172.21.15.37:0/3659489228 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba400ba00 con 0x7fbbb00b1e80 2023-07-14T15:58:35.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.465+0000 7fbbadffb700 1 -- 172.21.15.37:0/3659489228 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba400bd90 con 0x7fbbb00b1e80 2023-07-14T15:58:35.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.466+0000 7fbbb57ff700 1 -- 172.21.15.37:0/3659489228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbb00b1e80 msgr2=0x7fbbb00d2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:35.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.466+0000 7fbbb57ff700 1 --2- 172.21.15.37:0/3659489228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbb00b1e80 0x7fbbb00d2880 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fbba40098f0 tx=0x7fbba4009c00 comp rx=0 tx=0).stop 2023-07-14T15:58:35.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.466+0000 7fbbb57ff700 1 -- 172.21.15.37:0/3659489228 shutdown_connections 2023-07-14T15:58:35.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.466+0000 7fbbb57ff700 1 --2- 172.21.15.37:0/3659489228 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbbb00b0ac0 0x7fbbb00b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:35.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.466+0000 7fbbb57ff700 1 --2- 172.21.15.37:0/3659489228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbb00b1e80 0x7fbbb00d2880 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:35.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.466+0000 7fbbb57ff700 1 -- 172.21.15.37:0/3659489228 >> 172.21.15.37:0/3659489228 conn(0x7fbbb009c1c0 msgr2=0x7fbbb00d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:35.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.466+0000 7fbbb57ff700 1 -- 172.21.15.37:0/3659489228 shutdown_connections 2023-07-14T15:58:35.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.466+0000 7fbbb57ff700 1 -- 172.21.15.37:0/3659489228 wait complete. 2023-07-14T15:58:35.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.468+0000 7fbbb57ff700 1 Processor -- start 2023-07-14T15:58:35.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.468+0000 7fbbb57ff700 1 -- start start 2023-07-14T15:58:35.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.469+0000 7fbbb57ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbbb00b0ac0 0x7fbbb0155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:35.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.469+0000 7fbbb57ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbbb00b1e80 0x7fbbb00b85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:35.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.469+0000 7fbbb57ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbb00cfd50 0x7fbbb01e7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:35.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.469+0000 7fbbb57ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb01f2230 con 0x7fbbb00cfd50 2023-07-14T15:58:35.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.469+0000 7fbbb57ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb0158040 con 0x7fbbb00b0ac0 2023-07-14T15:58:35.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.469+0000 7fbbb57ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb0158320 con 0x7fbbb00b1e80 2023-07-14T15:58:35.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.469+0000 7fbbaf7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbb00cfd50 0x7fbbb01e7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:35.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.469+0000 7fbbaf7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbb00cfd50 0x7fbbb01e7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40480/0 (socket says 172.21.15.37:40480) 2023-07-14T15:58:35.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.469+0000 7fbbaf7fe700 1 -- 172.21.15.37:0/3742742201 learned_addr learned my addr 172.21.15.37:0/3742742201 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:35.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.469+0000 7fbbaeffd700 1 --2- 172.21.15.37:0/3742742201 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbbb00b0ac0 0x7fbbb0155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:35.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.469+0000 7fbbae7fc700 1 --2- 172.21.15.37:0/3742742201 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbbb00b1e80 0x7fbbb00b85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:35.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.469+0000 7fbbaf7fe700 1 -- 172.21.15.37:0/3742742201 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbbb00b1e80 msgr2=0x7fbbb00b85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:35.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.469+0000 7fbbaf7fe700 1 --2- 172.21.15.37:0/3742742201 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbbb00b1e80 0x7fbbb00b85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:35.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.469+0000 7fbbaf7fe700 1 -- 172.21.15.37:0/3742742201 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbbb00b0ac0 msgr2=0x7fbbb0155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:35.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.469+0000 7fbbaf7fe700 1 --2- 172.21.15.37:0/3742742201 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbbb00b0ac0 0x7fbbb0155de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:35.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.469+0000 7fbbaf7fe700 1 -- 172.21.15.37:0/3742742201 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba4009550 con 0x7fbbb00cfd50 2023-07-14T15:58:35.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.470+0000 7fbbaf7fe700 1 --2- 172.21.15.37:0/3742742201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbb00cfd50 0x7fbbb01e7b90 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fbba800cef0 tx=0x7fbba800cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:35.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.470+0000 7fbb977fe700 1 -- 172.21.15.37:0/3742742201 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba800ad00 con 0x7fbbb00cfd50 2023-07-14T15:58:35.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.470+0000 7fbb977fe700 1 -- 172.21.15.37:0/3742742201 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba800ae60 con 0x7fbbb00cfd50 2023-07-14T15:58:35.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.470+0000 7fbbb57ff700 1 -- 172.21.15.37:0/3742742201 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbb0158600 con 0x7fbbb00cfd50 2023-07-14T15:58:35.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.470+0000 7fbb977fe700 1 -- 172.21.15.37:0/3742742201 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba8015680 con 0x7fbbb00cfd50 2023-07-14T15:58:35.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.470+0000 7fbbb57ff700 1 -- 172.21.15.37:0/3742742201 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbb0158bc0 con 0x7fbbb00cfd50 2023-07-14T15:58:35.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.471+0000 7fbbb57ff700 1 -- 172.21.15.37:0/3742742201 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbb0158db0 con 0x7fbbb00cfd50 2023-07-14T15:58:35.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.472+0000 7fbb977fe700 1 -- 172.21.15.37:0/3742742201 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fbba800d430 con 0x7fbbb00cfd50 2023-07-14T15:58:35.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.473+0000 7fbb977fe700 1 --2- 172.21.15.37:0/3742742201 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbb9c06ae00 0x7fbb9c06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:35.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.473+0000 7fbb977fe700 1 -- 172.21.15.37:0/3742742201 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbba8089b50 con 0x7fbbb00cfd50 2023-07-14T15:58:35.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.474+0000 7fbbaeffd700 1 --2- 172.21.15.37:0/3742742201 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbb9c06ae00 0x7fbb9c06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:35.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.474+0000 7fbbaeffd700 1 --2- 172.21.15.37:0/3742742201 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbb9c06ae00 0x7fbb9c06d2b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fbba0000f60 tx=0x7fbba0007ed0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:35.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.477+0000 7fbb977fe700 1 -- 172.21.15.37:0/3742742201 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fbba8054a50 con 0x7fbbb00cfd50 2023-07-14T15:58:35.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.689+0000 7fbbb57ff700 1 -- 172.21.15.37:0/3742742201 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbbb0067840 con 0x7fbbb00cfd50 2023-07-14T15:58:35.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.690+0000 7fbb977fe700 1 -- 172.21.15.37:0/3742742201 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v49) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbba801a0a0 con 0x7fbbb00cfd50 2023-07-14T15:58:35.675 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-14T15:58:35.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.692+0000 7fbbb57ff700 1 -- 172.21.15.37:0/3742742201 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbb9c06ae00 msgr2=0x7fbb9c06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:35.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.692+0000 7fbbb57ff700 1 --2- 172.21.15.37:0/3742742201 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbb9c06ae00 0x7fbb9c06d2b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fbba0000f60 tx=0x7fbba0007ed0 comp rx=0 tx=0).stop 2023-07-14T15:58:35.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.692+0000 7fbbb57ff700 1 -- 172.21.15.37:0/3742742201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbb00cfd50 msgr2=0x7fbbb01e7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:35.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.692+0000 7fbbb57ff700 1 --2- 172.21.15.37:0/3742742201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbb00cfd50 0x7fbbb01e7b90 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fbba800cef0 tx=0x7fbba800cf20 comp rx=0 tx=0).stop 2023-07-14T15:58:35.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.692+0000 7fbbb57ff700 1 -- 172.21.15.37:0/3742742201 shutdown_connections 2023-07-14T15:58:35.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.692+0000 7fbbb57ff700 1 --2- 172.21.15.37:0/3742742201 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbbb00b0ac0 0x7fbbb0155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:35.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.692+0000 7fbbb57ff700 1 --2- 172.21.15.37:0/3742742201 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbb9c06ae00 0x7fbb9c06d2b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:35.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.692+0000 7fbbb57ff700 1 --2- 172.21.15.37:0/3742742201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbb00cfd50 0x7fbbb01e7b90 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:35.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.692+0000 7fbbb57ff700 1 --2- 172.21.15.37:0/3742742201 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbbb00b1e80 0x7fbbb00b85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:35.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.692+0000 7fbbb57ff700 1 -- 172.21.15.37:0/3742742201 >> 172.21.15.37:0/3742742201 conn(0x7fbbb009c1c0 msgr2=0x7fbbb006b180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:35.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.692+0000 7fbbb57ff700 1 -- 172.21.15.37:0/3742742201 shutdown_connections 2023-07-14T15:58:35.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.692+0000 7fbbb57ff700 1 -- 172.21.15.37:0/3742742201 wait complete. 2023-07-14T15:58:35.695 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T15:58:35.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.920+0000 7fa81a7ff700 1 Processor -- start 2023-07-14T15:58:35.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.920+0000 7fa81a7ff700 1 -- start start 2023-07-14T15:58:35.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.922+0000 7fa81a7ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa8140cb430 0x7fa8140cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:35.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.922+0000 7fa81a7ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa81406d290 0x7fa8140c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:35.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.922+0000 7fa81a7ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8140707f0 con 0x7fa814071820 2023-07-14T15:58:35.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.922+0000 7fa81a7ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8140cbd40 con 0x7fa8140cb430 2023-07-14T15:58:35.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.922+0000 7fa81a7ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa81406d6f0 con 0x7fa81406d290 2023-07-14T15:58:35.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.922+0000 7fa813fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa8140cb430 0x7fa8140cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:35.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.922+0000 7fa813fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa8140cb430 0x7fa8140cb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40494/0 (socket says 172.21.15.37:40494) 2023-07-14T15:58:35.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.922+0000 7fa813fff700 1 -- 172.21.15.37:0/2858124449 learned_addr learned my addr 172.21.15.37:0/2858124449 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:35.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.922+0000 7fa818d9c700 1 --2- 172.21.15.37:0/2858124449 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa81406d290 0x7fa8140c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:35.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.922+0000 7fa813fff700 1 -- 172.21.15.37:0/2858124449 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa81406d290 msgr2=0x7fa8140c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:35.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.922+0000 7fa813fff700 1 --2- 172.21.15.37:0/2858124449 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa81406d290 0x7fa8140c90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:35.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.922+0000 7fa813fff700 1 -- 172.21.15.37:0/2858124449 >> v1:172.21.15.98:6789/0 conn(0x7fa814071820 legacy=0x7fa81406cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:35.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.922+0000 7fa813fff700 1 -- 172.21.15.37:0/2858124449 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa814070a60 con 0x7fa8140cb430 2023-07-14T15:58:35.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.923+0000 7fa813fff700 1 --2- 172.21.15.37:0/2858124449 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8140cb430 0x7fa8140cb800 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fa8040098f0 tx=0x7fa804009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bde7d20d85827063 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:35.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.923+0000 7fa812ffd700 1 -- 172.21.15.37:0/2858124449 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80400b8a0 con 0x7fa8140cb430 2023-07-14T15:58:35.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.923+0000 7fa812ffd700 1 -- 172.21.15.37:0/2858124449 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa80400ba00 con 0x7fa8140cb430 2023-07-14T15:58:35.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.923+0000 7fa812ffd700 1 -- 172.21.15.37:0/2858124449 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80400bd90 con 0x7fa8140cb430 2023-07-14T15:58:35.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.923+0000 7fa81a7ff700 1 -- 172.21.15.37:0/2858124449 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8140cb430 msgr2=0x7fa8140cb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:35.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.923+0000 7fa81a7ff700 1 --2- 172.21.15.37:0/2858124449 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8140cb430 0x7fa8140cb800 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fa8040098f0 tx=0x7fa804009c00 comp rx=0 tx=0).stop 2023-07-14T15:58:35.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.924+0000 7fa81a7ff700 1 -- 172.21.15.37:0/2858124449 shutdown_connections 2023-07-14T15:58:35.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.924+0000 7fa81a7ff700 1 --2- 172.21.15.37:0/2858124449 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa81406d290 0x7fa8140c90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:35.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.924+0000 7fa81a7ff700 1 --2- 172.21.15.37:0/2858124449 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8140cb430 0x7fa8140cb800 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:35.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.924+0000 7fa81a7ff700 1 -- 172.21.15.37:0/2858124449 >> 172.21.15.37:0/2858124449 conn(0x7fa81406aac0 msgr2=0x7fa8140b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:35.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.924+0000 7fa81a7ff700 1 -- 172.21.15.37:0/2858124449 shutdown_connections 2023-07-14T15:58:35.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.924+0000 7fa81a7ff700 1 -- 172.21.15.37:0/2858124449 wait complete. 2023-07-14T15:58:35.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.925+0000 7fa81a7ff700 1 Processor -- start 2023-07-14T15:58:35.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.926+0000 7fa81a7ff700 1 -- start start 2023-07-14T15:58:35.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.927+0000 7fa81a7ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa81406d290 0x7fa81414b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:35.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.927+0000 7fa81a7ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa814071820 0x7fa8140c7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:35.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.927+0000 7fa81a7ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa8140cb430 0x7fa81415cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:35.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.927+0000 7fa81a7ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81414b740 con 0x7fa814071820 2023-07-14T15:58:35.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.927+0000 7fa81a7ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8140c7d50 con 0x7fa81406d290 2023-07-14T15:58:35.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.927+0000 7fa81a7ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8140b1aa0 con 0x7fa8140cb430 2023-07-14T15:58:35.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.927+0000 7fa8137fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa814071820 0x7fa8140c7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:35.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.927+0000 7fa8137fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa814071820 0x7fa8140c7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40504/0 (socket says 172.21.15.37:40504) 2023-07-14T15:58:35.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.927+0000 7fa8137fe700 1 -- 172.21.15.37:0/3396615407 learned_addr learned my addr 172.21.15.37:0/3396615407 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:35.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.927+0000 7fa818d9c700 1 --2- 172.21.15.37:0/3396615407 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa8140cb430 0x7fa81415cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:35.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.927+0000 7fa813fff700 1 --2- 172.21.15.37:0/3396615407 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa81406d290 0x7fa81414b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:35.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.927+0000 7fa8137fe700 1 -- 172.21.15.37:0/3396615407 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa8140cb430 msgr2=0x7fa81415cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:35.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.927+0000 7fa8137fe700 1 --2- 172.21.15.37:0/3396615407 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa8140cb430 0x7fa81415cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:35.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.927+0000 7fa8137fe700 1 -- 172.21.15.37:0/3396615407 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa81406d290 msgr2=0x7fa81414b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:35.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.927+0000 7fa8137fe700 1 --2- 172.21.15.37:0/3396615407 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa81406d290 0x7fa81414b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:35.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.927+0000 7fa8137fe700 1 -- 172.21.15.37:0/3396615407 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa804009550 con 0x7fa814071820 2023-07-14T15:58:35.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.927+0000 7fa813fff700 1 --2- 172.21.15.37:0/3396615407 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa81406d290 0x7fa81414b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:58:35.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.928+0000 7fa8137fe700 1 --2- 172.21.15.37:0/3396615407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa814071820 0x7fa8140c7450 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fa80800c4e0 tx=0x7fa80800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:35.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.928+0000 7fa810ff9700 1 -- 172.21.15.37:0/3396615407 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8080052d0 con 0x7fa814071820 2023-07-14T15:58:35.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.928+0000 7fa810ff9700 1 -- 172.21.15.37:0/3396615407 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa808005430 con 0x7fa814071820 2023-07-14T15:58:35.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.928+0000 7fa810ff9700 1 -- 172.21.15.37:0/3396615407 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8080038c0 con 0x7fa814071820 2023-07-14T15:58:35.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.928+0000 7fa81a7ff700 1 -- 172.21.15.37:0/3396615407 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8140b1d80 con 0x7fa814071820 2023-07-14T15:58:35.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.928+0000 7fa81a7ff700 1 -- 172.21.15.37:0/3396615407 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8140b2340 con 0x7fa814071820 2023-07-14T15:58:35.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.929+0000 7fa81a7ff700 1 -- 172.21.15.37:0/3396615407 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8140ca640 con 0x7fa814071820 2023-07-14T15:58:35.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.930+0000 7fa810ff9700 1 -- 172.21.15.37:0/3396615407 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fa808003a20 con 0x7fa814071820 2023-07-14T15:58:35.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.931+0000 7fa810ff9700 1 --2- 172.21.15.37:0/3396615407 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa80006ae00 0x7fa80006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:35.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.931+0000 7fa810ff9700 1 -- 172.21.15.37:0/3396615407 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa808088ab0 con 0x7fa814071820 2023-07-14T15:58:35.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.932+0000 7fa813fff700 1 --2- 172.21.15.37:0/3396615407 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa80006ae00 0x7fa80006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:35.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.932+0000 7fa813fff700 1 --2- 172.21.15.37:0/3396615407 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa80006ae00 0x7fa80006d2b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa804014040 tx=0x7fa804008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:35.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:35.935+0000 7fa810ff9700 1 -- 172.21.15.37:0/3396615407 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa808053a40 con 0x7fa814071820 2023-07-14T15:58:36.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.144+0000 7fa81a7ff700 1 -- 172.21.15.37:0/3396615407 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa814067840 con 0x7fa814071820 2023-07-14T15:58:36.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.145+0000 7fa810ff9700 1 -- 172.21.15.37:0/3396615407 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v49) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa808057060 con 0x7fa814071820 2023-07-14T15:58:36.130 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-14T15:58:36.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.147+0000 7fa81a7ff700 1 -- 172.21.15.37:0/3396615407 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa80006ae00 msgr2=0x7fa80006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:36.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.147+0000 7fa81a7ff700 1 --2- 172.21.15.37:0/3396615407 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa80006ae00 0x7fa80006d2b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa804014040 tx=0x7fa804008030 comp rx=0 tx=0).stop 2023-07-14T15:58:36.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.147+0000 7fa81a7ff700 1 -- 172.21.15.37:0/3396615407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa814071820 msgr2=0x7fa8140c7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:36.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.147+0000 7fa81a7ff700 1 --2- 172.21.15.37:0/3396615407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa814071820 0x7fa8140c7450 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fa80800c4e0 tx=0x7fa80800c7f0 comp rx=0 tx=0).stop 2023-07-14T15:58:36.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.147+0000 7fa81a7ff700 1 -- 172.21.15.37:0/3396615407 shutdown_connections 2023-07-14T15:58:36.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.147+0000 7fa81a7ff700 1 --2- 172.21.15.37:0/3396615407 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa81406d290 0x7fa81414b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:36.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.147+0000 7fa81a7ff700 1 --2- 172.21.15.37:0/3396615407 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa80006ae00 0x7fa80006d2b0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:36.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.147+0000 7fa81a7ff700 1 --2- 172.21.15.37:0/3396615407 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa8140cb430 0x7fa81415cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:36.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.147+0000 7fa81a7ff700 1 --2- 172.21.15.37:0/3396615407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa814071820 0x7fa8140c7450 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:36.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.147+0000 7fa81a7ff700 1 -- 172.21.15.37:0/3396615407 >> 172.21.15.37:0/3396615407 conn(0x7fa81406aac0 msgr2=0x7fa81406cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:36.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.147+0000 7fa81a7ff700 1 -- 172.21.15.37:0/3396615407 shutdown_connections 2023-07-14T15:58:36.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.147+0000 7fa81a7ff700 1 -- 172.21.15.37:0/3396615407 wait complete. 2023-07-14T15:58:36.150 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T15:58:36.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.371+0000 7fdb135ff700 1 Processor -- start 2023-07-14T15:58:36.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.371+0000 7fdb135ff700 1 -- start start 2023-07-14T15:58:36.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.372+0000 7fdb135ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdb0c06c0d0 0x7fdb0c06f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:36.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.372+0000 7fdb135ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb0c159870 con 0x7fdb0c0ae000 2023-07-14T15:58:36.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.372+0000 7fdb135ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb0c0ae400 con 0x7fdb0c071730 2023-07-14T15:58:36.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.372+0000 7fdb135ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb0c0ca790 con 0x7fdb0c06c0d0 2023-07-14T15:58:36.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.372+0000 7fdb10b9a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdb0c06c0d0 0x7fdb0c06f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:36.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.372+0000 7fdb11b9c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fdb0c0ae000 0x7fdb0c0cd220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52524/0 (socket says 172.21.15.37:52524) 2023-07-14T15:58:36.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.372+0000 7fdb11b9c700 1 -- 172.21.15.37:0/2464329872 learned_addr learned my addr 172.21.15.37:0/2464329872 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:58:36.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.373+0000 7fdb10b9a700 1 -- 172.21.15.37:0/2464329872 >> v1:172.21.15.98:6789/0 conn(0x7fdb0c071730 legacy=0x7fdb0c06b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:36.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.373+0000 7fdb10b9a700 1 -- 172.21.15.37:0/2464329872 >> v1:172.21.15.37:6789/0 conn(0x7fdb0c0ae000 legacy=0x7fdb0c0cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:36.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.373+0000 7fdb10b9a700 1 -- 172.21.15.37:0/2464329872 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb0c0cc780 con 0x7fdb0c06c0d0 2023-07-14T15:58:36.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.373+0000 7fdb10b9a700 1 --2- 172.21.15.37:0/2464329872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb0c06c0d0 0x7fdb0c06f740 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fdafc00bae0 tx=0x7fdafc00bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb4f16d39d8ee933 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:36.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.373+0000 7fdb03fff700 1 -- 172.21.15.37:0/2464329872 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdafc00dd30 con 0x7fdb0c06c0d0 2023-07-14T15:58:36.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.373+0000 7fdb03fff700 1 -- 172.21.15.37:0/2464329872 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdafc00de90 con 0x7fdb0c06c0d0 2023-07-14T15:58:36.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.373+0000 7fdb03fff700 1 -- 172.21.15.37:0/2464329872 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdafc010690 con 0x7fdb0c06c0d0 2023-07-14T15:58:36.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.374+0000 7fdb135ff700 1 -- 172.21.15.37:0/2464329872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb0c06c0d0 msgr2=0x7fdb0c06f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:36.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.374+0000 7fdb135ff700 1 --2- 172.21.15.37:0/2464329872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb0c06c0d0 0x7fdb0c06f740 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fdafc00bae0 tx=0x7fdafc00bdf0 comp rx=0 tx=0).stop 2023-07-14T15:58:36.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.374+0000 7fdb135ff700 1 -- 172.21.15.37:0/2464329872 shutdown_connections 2023-07-14T15:58:36.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.374+0000 7fdb135ff700 1 --2- 172.21.15.37:0/2464329872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb0c06c0d0 0x7fdb0c06f740 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:36.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.374+0000 7fdb135ff700 1 -- 172.21.15.37:0/2464329872 >> 172.21.15.37:0/2464329872 conn(0x7fdb0c06aac0 msgr2=0x7fdb0c0b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:36.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.374+0000 7fdb135ff700 1 -- 172.21.15.37:0/2464329872 shutdown_connections 2023-07-14T15:58:36.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.374+0000 7fdb135ff700 1 -- 172.21.15.37:0/2464329872 wait complete. 2023-07-14T15:58:36.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.376+0000 7fdb135ff700 1 Processor -- start 2023-07-14T15:58:36.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.376+0000 7fdb135ff700 1 -- start start 2023-07-14T15:58:36.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.377+0000 7fdb135ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdb0c06c0d0 0x7fdb0c1f61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:36.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.377+0000 7fdb135ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdb0c071730 0x7fdb0c145c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:36.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.377+0000 7fdb135ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb0c0ae000 0x7fdb0c0c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:36.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.377+0000 7fdb135ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c1f6720 con 0x7fdb0c0ae000 2023-07-14T15:58:36.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.377+0000 7fdb135ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c0c6ba0 con 0x7fdb0c06c0d0 2023-07-14T15:58:36.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.377+0000 7fdb135ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c0c6dd0 con 0x7fdb0c071730 2023-07-14T15:58:36.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.377+0000 7fdb11b9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb0c0ae000 0x7fdb0c0c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:36.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.377+0000 7fdb11b9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb0c0ae000 0x7fdb0c0c7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40516/0 (socket says 172.21.15.37:40516) 2023-07-14T15:58:36.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.377+0000 7fdb11b9c700 1 -- 172.21.15.37:0/814804428 learned_addr learned my addr 172.21.15.37:0/814804428 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:36.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.378+0000 7fdb10b9a700 1 --2- 172.21.15.37:0/814804428 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdb0c071730 0x7fdb0c145c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:36.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.378+0000 7fdb1139b700 1 --2- 172.21.15.37:0/814804428 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdb0c06c0d0 0x7fdb0c1f61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:36.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.378+0000 7fdb11b9c700 1 -- 172.21.15.37:0/814804428 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdb0c071730 msgr2=0x7fdb0c145c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:36.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.378+0000 7fdb11b9c700 1 --2- 172.21.15.37:0/814804428 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdb0c071730 0x7fdb0c145c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:36.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.378+0000 7fdb11b9c700 1 -- 172.21.15.37:0/814804428 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdb0c06c0d0 msgr2=0x7fdb0c1f61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:36.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.378+0000 7fdb11b9c700 1 --2- 172.21.15.37:0/814804428 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdb0c06c0d0 0x7fdb0c1f61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:36.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.378+0000 7fdb11b9c700 1 -- 172.21.15.37:0/814804428 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdafc00b740 con 0x7fdb0c0ae000 2023-07-14T15:58:36.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.378+0000 7fdb11b9c700 1 --2- 172.21.15.37:0/814804428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb0c0ae000 0x7fdb0c0c7b90 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fdb0400cbf0 tx=0x7fdb0400cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:36.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.378+0000 7fdb01ffb700 1 -- 172.21.15.37:0/814804428 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0400aa60 con 0x7fdb0c0ae000 2023-07-14T15:58:36.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.378+0000 7fdb01ffb700 1 -- 172.21.15.37:0/814804428 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0400abc0 con 0x7fdb0c0ae000 2023-07-14T15:58:36.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.378+0000 7fdb01ffb700 1 -- 172.21.15.37:0/814804428 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb04012400 con 0x7fdb0c0ae000 2023-07-14T15:58:36.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.378+0000 7fdb135ff700 1 -- 172.21.15.37:0/814804428 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb0c0c70b0 con 0x7fdb0c0ae000 2023-07-14T15:58:36.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.379+0000 7fdb135ff700 1 -- 172.21.15.37:0/814804428 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb0c0c7670 con 0x7fdb0c0ae000 2023-07-14T15:58:36.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.380+0000 7fdb135ff700 1 -- 172.21.15.37:0/814804428 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb0c0cb300 con 0x7fdb0c0ae000 2023-07-14T15:58:36.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.381+0000 7fdb01ffb700 1 -- 172.21.15.37:0/814804428 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fdb0401b3b0 con 0x7fdb0c0ae000 2023-07-14T15:58:36.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.381+0000 7fdb01ffb700 1 --2- 172.21.15.37:0/814804428 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fdaf006ae00 0x7fdaf006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:36.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.382+0000 7fdb01ffb700 1 -- 172.21.15.37:0/814804428 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdb04089130 con 0x7fdb0c0ae000 2023-07-14T15:58:36.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.382+0000 7fdb1139b700 1 --2- 172.21.15.37:0/814804428 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fdaf006ae00 0x7fdaf006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:36.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.383+0000 7fdb1139b700 1 --2- 172.21.15.37:0/814804428 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fdaf006ae00 0x7fdaf006d2b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fdb08007fd0 tx=0x7fdb08009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:36.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.386+0000 7fdb01ffb700 1 -- 172.21.15.37:0/814804428 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fdb040540e0 con 0x7fdb0c0ae000 2023-07-14T15:58:36.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.593+0000 7fdb135ff700 1 -- 172.21.15.37:0/814804428 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdb0c0c7860 con 0x7fdb0c0ae000 2023-07-14T15:58:36.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.593+0000 7fdb01ffb700 1 -- 172.21.15.37:0/814804428 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v49) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdb04057700 con 0x7fdb0c0ae000 2023-07-14T15:58:36.578 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-14T15:58:36.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.596+0000 7fdb135ff700 1 -- 172.21.15.37:0/814804428 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fdaf006ae00 msgr2=0x7fdaf006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:36.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.596+0000 7fdb135ff700 1 --2- 172.21.15.37:0/814804428 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fdaf006ae00 0x7fdaf006d2b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fdb08007fd0 tx=0x7fdb08009040 comp rx=0 tx=0).stop 2023-07-14T15:58:36.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.596+0000 7fdb135ff700 1 -- 172.21.15.37:0/814804428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb0c0ae000 msgr2=0x7fdb0c0c7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:36.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.596+0000 7fdb135ff700 1 --2- 172.21.15.37:0/814804428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb0c0ae000 0x7fdb0c0c7b90 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fdb0400cbf0 tx=0x7fdb0400cf00 comp rx=0 tx=0).stop 2023-07-14T15:58:36.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.596+0000 7fdb135ff700 1 -- 172.21.15.37:0/814804428 shutdown_connections 2023-07-14T15:58:36.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.596+0000 7fdb135ff700 1 --2- 172.21.15.37:0/814804428 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdb0c06c0d0 0x7fdb0c1f61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:36.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.596+0000 7fdb135ff700 1 --2- 172.21.15.37:0/814804428 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fdaf006ae00 0x7fdaf006d2b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:36.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.596+0000 7fdb135ff700 1 --2- 172.21.15.37:0/814804428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb0c0ae000 0x7fdb0c0c7b90 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:36.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.596+0000 7fdb135ff700 1 --2- 172.21.15.37:0/814804428 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdb0c071730 0x7fdb0c145c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:36.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.596+0000 7fdb135ff700 1 -- 172.21.15.37:0/814804428 >> 172.21.15.37:0/814804428 conn(0x7fdb0c06aac0 msgr2=0x7fdb0c0cea10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:36.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.596+0000 7fdb135ff700 1 -- 172.21.15.37:0/814804428 shutdown_connections 2023-07-14T15:58:36.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.596+0000 7fdb135ff700 1 -- 172.21.15.37:0/814804428 wait complete. 2023-07-14T15:58:36.599 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-14T15:58:36.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.817+0000 7fa3cb7ff700 1 Processor -- start 2023-07-14T15:58:36.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.818+0000 7fa3cb7ff700 1 -- start start 2023-07-14T15:58:36.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.819+0000 7fa3cb7ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa3c40cf690 0x7fa3c40ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:36.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.819+0000 7fa3cb7ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa3c4069e70 0x7fa3c406a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:36.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.819+0000 7fa3cb7ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3c40cec40 con 0x7fa3c4071090 2023-07-14T15:58:36.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.819+0000 7fa3cb7ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3c4071bc0 con 0x7fa3c4069e70 2023-07-14T15:58:36.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.819+0000 7fa3cb7ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3c406a800 con 0x7fa3c40cf690 2023-07-14T15:58:36.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.819+0000 7fa3c8d9a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa3c4069e70 0x7fa3c406a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:36.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.819+0000 7fa3c9d9c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa3c4071090 0x7fa3c40714b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52534/0 (socket says 172.21.15.37:52534) 2023-07-14T15:58:36.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.819+0000 7fa3c9d9c700 1 -- 172.21.15.37:0/3918102209 learned_addr learned my addr 172.21.15.37:0/3918102209 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:58:36.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.819+0000 7fa3c959b700 1 --2- 172.21.15.37:0/3918102209 >> v2:172.21.15.98:3300/0 conn(0x7fa3c40cf690 0x7fa3c40ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:36.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.820+0000 7fa3bbfff700 1 -- 172.21.15.37:0/3918102209 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2762882809 0 0) 0x7fa3c40cec40 con 0x7fa3c4071090 2023-07-14T15:58:36.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.820+0000 7fa3c8d9a700 1 -- 172.21.15.37:0/3918102209 >> v2:172.21.15.98:3300/0 conn(0x7fa3c40cf690 msgr2=0x7fa3c40ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:36.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.820+0000 7fa3c8d9a700 1 --2- 172.21.15.37:0/3918102209 >> v2:172.21.15.98:3300/0 conn(0x7fa3c40cf690 0x7fa3c40ce700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:36.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.820+0000 7fa3c8d9a700 1 -- 172.21.15.37:0/3918102209 >> v1:172.21.15.37:6789/0 conn(0x7fa3c4071090 legacy=0x7fa3c40714b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:36.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.820+0000 7fa3c8d9a700 1 -- 172.21.15.37:0/3918102209 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c415cbd0 con 0x7fa3c4069e70 2023-07-14T15:58:36.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.820+0000 7fa3c8d9a700 1 --2- 172.21.15.37:0/3918102209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3c4069e70 0x7fa3c406a2c0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fa3c40cd470 tx=0x7fa3b4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e70af492645568fa server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:36.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.820+0000 7fa3bbfff700 1 -- 172.21.15.37:0/3918102209 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b4011830 con 0x7fa3c4069e70 2023-07-14T15:58:36.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.820+0000 7fa3bbfff700 1 -- 172.21.15.37:0/3918102209 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b4011990 con 0x7fa3c4069e70 2023-07-14T15:58:36.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.820+0000 7fa3bbfff700 1 -- 172.21.15.37:0/3918102209 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b4011d20 con 0x7fa3c4069e70 2023-07-14T15:58:36.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.821+0000 7fa3cb7ff700 1 -- 172.21.15.37:0/3918102209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3c4069e70 msgr2=0x7fa3c406a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:36.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.821+0000 7fa3cb7ff700 1 --2- 172.21.15.37:0/3918102209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3c4069e70 0x7fa3c406a2c0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fa3c40cd470 tx=0x7fa3b4009b20 comp rx=0 tx=0).stop 2023-07-14T15:58:36.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.821+0000 7fa3cb7ff700 1 -- 172.21.15.37:0/3918102209 shutdown_connections 2023-07-14T15:58:36.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.821+0000 7fa3cb7ff700 1 --2- 172.21.15.37:0/3918102209 >> v2:172.21.15.98:3300/0 conn(0x7fa3c40cf690 0x7fa3c40ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:36.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.821+0000 7fa3cb7ff700 1 --2- 172.21.15.37:0/3918102209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3c4069e70 0x7fa3c406a2c0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:36.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.821+0000 7fa3cb7ff700 1 -- 172.21.15.37:0/3918102209 >> 172.21.15.37:0/3918102209 conn(0x7fa3c406bbd0 msgr2=0x7fa3c40cc610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:36.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.821+0000 7fa3cb7ff700 1 -- 172.21.15.37:0/3918102209 shutdown_connections 2023-07-14T15:58:36.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.821+0000 7fa3cb7ff700 1 -- 172.21.15.37:0/3918102209 wait complete. 2023-07-14T15:58:36.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.823+0000 7fa3cb7ff700 1 Processor -- start 2023-07-14T15:58:36.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.823+0000 7fa3cb7ff700 1 -- start start 2023-07-14T15:58:36.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.824+0000 7fa3cb7ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3c4069e70 0x7fa3c415e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:36.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.824+0000 7fa3cb7ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa3c4071090 0x7fa3c41f1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:36.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.824+0000 7fa3cb7ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3c40cf690 0x7fa3c415a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:36.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.824+0000 7fa3cb7ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c40c7570 con 0x7fa3c40cf690 2023-07-14T15:58:36.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.824+0000 7fa3cb7ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c40c6c60 con 0x7fa3c4069e70 2023-07-14T15:58:36.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.824+0000 7fa3cb7ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c415fc40 con 0x7fa3c4071090 2023-07-14T15:58:36.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.824+0000 7fa3c9d9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3c40cf690 0x7fa3c415a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:36.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.824+0000 7fa3c9d9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3c40cf690 0x7fa3c415a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40522/0 (socket says 172.21.15.37:40522) 2023-07-14T15:58:36.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.824+0000 7fa3c9d9c700 1 -- 172.21.15.37:0/3557046224 learned_addr learned my addr 172.21.15.37:0/3557046224 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:36.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.824+0000 7fa3c959b700 1 --2- 172.21.15.37:0/3557046224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3c4069e70 0x7fa3c415e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:36.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.824+0000 7fa3c9d9c700 1 -- 172.21.15.37:0/3557046224 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa3c4071090 msgr2=0x7fa3c41f1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:36.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.824+0000 7fa3c8d9a700 1 --2- 172.21.15.37:0/3557046224 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa3c4071090 0x7fa3c41f1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:36.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.824+0000 7fa3c9d9c700 1 --2- 172.21.15.37:0/3557046224 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa3c4071090 0x7fa3c41f1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:36.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.824+0000 7fa3c9d9c700 1 -- 172.21.15.37:0/3557046224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3c4069e70 msgr2=0x7fa3c415e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:36.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.824+0000 7fa3c9d9c700 1 --2- 172.21.15.37:0/3557046224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3c4069e70 0x7fa3c415e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:36.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.824+0000 7fa3c9d9c700 1 -- 172.21.15.37:0/3557046224 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b40094a0 con 0x7fa3c40cf690 2023-07-14T15:58:36.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.824+0000 7fa3c959b700 1 --2- 172.21.15.37:0/3557046224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3c4069e70 0x7fa3c415e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:58:36.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.824+0000 7fa3c8d9a700 1 --2- 172.21.15.37:0/3557046224 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa3c4071090 0x7fa3c41f1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:58:36.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.825+0000 7fa3c9d9c700 1 --2- 172.21.15.37:0/3557046224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3c40cf690 0x7fa3c415a9f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc00cc70 tx=0x7fa3bc00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:36.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.825+0000 7fa3b9ffb700 1 -- 172.21.15.37:0/3557046224 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc00ada0 con 0x7fa3c40cf690 2023-07-14T15:58:36.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.825+0000 7fa3b9ffb700 1 -- 172.21.15.37:0/3557046224 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3bc00ce70 con 0x7fa3c40cf690 2023-07-14T15:58:36.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.825+0000 7fa3b9ffb700 1 -- 172.21.15.37:0/3557046224 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc0072f0 con 0x7fa3c40cf690 2023-07-14T15:58:36.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.825+0000 7fa3cb7ff700 1 -- 172.21.15.37:0/3557046224 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3c415ed10 con 0x7fa3c40cf690 2023-07-14T15:58:36.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.825+0000 7fa3cb7ff700 1 -- 172.21.15.37:0/3557046224 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3c40c7190 con 0x7fa3c40cf690 2023-07-14T15:58:36.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.826+0000 7fa3cb7ff700 1 -- 172.21.15.37:0/3557046224 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3c40c76b0 con 0x7fa3c40cf690 2023-07-14T15:58:36.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.827+0000 7fa3b9ffb700 1 -- 172.21.15.37:0/3557046224 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fa3bc007450 con 0x7fa3c40cf690 2023-07-14T15:58:36.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.828+0000 7fa3b9ffb700 1 --2- 172.21.15.37:0/3557046224 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa3a806ae00 0x7fa3a806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:36.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.828+0000 7fa3b9ffb700 1 -- 172.21.15.37:0/3557046224 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa3bc0891b0 con 0x7fa3c40cf690 2023-07-14T15:58:36.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.829+0000 7fa3c959b700 1 --2- 172.21.15.37:0/3557046224 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa3a806ae00 0x7fa3a806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:36.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.830+0000 7fa3c959b700 1 --2- 172.21.15.37:0/3557046224 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa3a806ae00 0x7fa3a806d2b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0009b60 tx=0x7fa3c0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:36.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:36.833+0000 7fa3b9ffb700 1 -- 172.21.15.37:0/3557046224 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa3c40c76b0 con 0x7fa3c40cf690 2023-07-14T15:58:37.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.058+0000 7fa3cb7ff700 1 -- 172.21.15.37:0/3557046224 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa3c40c76b0 con 0x7fa3c40cf690 2023-07-14T15:58:37.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.058+0000 7fa3b9ffb700 1 -- 172.21.15.37:0/3557046224 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v49) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa3c40c76b0 con 0x7fa3c40cf690 2023-07-14T15:58:37.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.061+0000 7fa3cb7ff700 1 -- 172.21.15.37:0/3557046224 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa3a806ae00 msgr2=0x7fa3a806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:37.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.061+0000 7fa3cb7ff700 1 --2- 172.21.15.37:0/3557046224 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa3a806ae00 0x7fa3a806d2b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0009b60 tx=0x7fa3c0008040 comp rx=0 tx=0).stop 2023-07-14T15:58:37.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.061+0000 7fa3cb7ff700 1 -- 172.21.15.37:0/3557046224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3c40cf690 msgr2=0x7fa3c415a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:37.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.061+0000 7fa3cb7ff700 1 --2- 172.21.15.37:0/3557046224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3c40cf690 0x7fa3c415a9f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc00cc70 tx=0x7fa3bc00a340 comp rx=0 tx=0).stop 2023-07-14T15:58:37.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.061+0000 7fa3cb7ff700 1 -- 172.21.15.37:0/3557046224 shutdown_connections 2023-07-14T15:58:37.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.061+0000 7fa3cb7ff700 1 --2- 172.21.15.37:0/3557046224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3c4069e70 0x7fa3c415e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:37.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.061+0000 7fa3cb7ff700 1 --2- 172.21.15.37:0/3557046224 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa3a806ae00 0x7fa3a806d2b0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:37.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.061+0000 7fa3cb7ff700 1 --2- 172.21.15.37:0/3557046224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3c40cf690 0x7fa3c415a9f0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:37.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.061+0000 7fa3cb7ff700 1 --2- 172.21.15.37:0/3557046224 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa3c4071090 0x7fa3c41f1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:37.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.061+0000 7fa3cb7ff700 1 -- 172.21.15.37:0/3557046224 >> 172.21.15.37:0/3557046224 conn(0x7fa3c406bbd0 msgr2=0x7fa3c406c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:37.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.061+0000 7fa3cb7ff700 1 -- 172.21.15.37:0/3557046224 shutdown_connections 2023-07-14T15:58:37.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.061+0000 7fa3cb7ff700 1 -- 172.21.15.37:0/3557046224 wait complete. 2023-07-14T15:58:37.047 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2023-07-14T15:58:37.064 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-14T15:58:37.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:58:37.065 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-14T15:58:37.156 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-07-14T15:58:37.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:58:37.157 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-14T15:58:37.201 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-14T15:58:37.201 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T15:58:37.249 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-14T15:58:37.250 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T15:58:37.335 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T15:58:37.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.552+0000 7f7875dff700 1 Processor -- start 2023-07-14T15:58:37.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.552+0000 7f7875dff700 1 -- start start 2023-07-14T15:58:37.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.554+0000 7f7875dff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f787015a440 0x7f78700cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:37.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.554+0000 7f7875dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f787015a810 0x7f78700ce230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:37.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.554+0000 7f7875dff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78700b0650 con 0x7f78700afae0 2023-07-14T15:58:37.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.554+0000 7f7875dff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78700cb5e0 con 0x7f787015a440 2023-07-14T15:58:37.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.554+0000 7f7875dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78700cb880 con 0x7f787015a810 2023-07-14T15:58:37.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.554+0000 7f786f7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f787015a440 0x7f78700cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:37.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.554+0000 7f786f7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f787015a440 0x7f78700cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40528/0 (socket says 172.21.15.37:40528) 2023-07-14T15:58:37.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.554+0000 7f786f7fe700 1 -- 172.21.15.37:0/238580861 learned_addr learned my addr 172.21.15.37:0/238580861 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:37.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.554+0000 7f786effd700 1 --2- 172.21.15.37:0/238580861 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f787015a810 0x7f78700ce230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:37.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.555+0000 7f786f7fe700 1 -- 172.21.15.37:0/238580861 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f787015a810 msgr2=0x7f78700ce230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:37.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.555+0000 7f786f7fe700 1 --2- 172.21.15.37:0/238580861 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f787015a810 0x7f78700ce230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:37.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.555+0000 7f786f7fe700 1 -- 172.21.15.37:0/238580861 >> v1:172.21.15.98:6789/0 conn(0x7f78700afae0 legacy=0x7f78700aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:37.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.555+0000 7f786f7fe700 1 -- 172.21.15.37:0/238580861 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78700cbb60 con 0x7f787015a440 2023-07-14T15:58:37.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.555+0000 7f786f7fe700 1 --2- 172.21.15.37:0/238580861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f787015a440 0x7f78700cdcf0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f78600098f0 tx=0x7f7860009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bba8c0b71968693a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:37.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.555+0000 7f786e7fc700 1 -- 172.21.15.37:0/238580861 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7860011830 con 0x7f787015a440 2023-07-14T15:58:37.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.555+0000 7f786e7fc700 1 -- 172.21.15.37:0/238580861 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7860011990 con 0x7f787015a440 2023-07-14T15:58:37.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.555+0000 7f786e7fc700 1 -- 172.21.15.37:0/238580861 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7860011d20 con 0x7f787015a440 2023-07-14T15:58:37.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.556+0000 7f7875dff700 1 -- 172.21.15.37:0/238580861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f787015a440 msgr2=0x7f78700cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:37.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.556+0000 7f7875dff700 1 --2- 172.21.15.37:0/238580861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f787015a440 0x7f78700cdcf0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f78600098f0 tx=0x7f7860009c00 comp rx=0 tx=0).stop 2023-07-14T15:58:37.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.556+0000 7f7875dff700 1 -- 172.21.15.37:0/238580861 shutdown_connections 2023-07-14T15:58:37.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.556+0000 7f7875dff700 1 --2- 172.21.15.37:0/238580861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f787015a440 0x7f78700cdcf0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:37.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.556+0000 7f7875dff700 1 --2- 172.21.15.37:0/238580861 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f787015a810 0x7f78700ce230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:37.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.556+0000 7f7875dff700 1 -- 172.21.15.37:0/238580861 >> 172.21.15.37:0/238580861 conn(0x7f78700b08c0 msgr2=0x7f78700b0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:37.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.556+0000 7f7875dff700 1 -- 172.21.15.37:0/238580861 shutdown_connections 2023-07-14T15:58:37.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.556+0000 7f7875dff700 1 -- 172.21.15.37:0/238580861 wait complete. 2023-07-14T15:58:37.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.558+0000 7f7875dff700 1 Processor -- start 2023-07-14T15:58:37.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.558+0000 7f7875dff700 1 -- start start 2023-07-14T15:58:37.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.559+0000 7f7875dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f78700afae0 0x7f787014bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:37.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.559+0000 7f7875dff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f787015a440 0x7f787014b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:37.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.559+0000 7f7875dff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f787015a810 0x7f787015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:37.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.559+0000 7f7875dff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78700b2f00 con 0x7f787015a440 2023-07-14T15:58:37.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.559+0000 7f7875dff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787014c4d0 con 0x7f787015a810 2023-07-14T15:58:37.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.559+0000 7f7875dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78700b22f0 con 0x7f78700afae0 2023-07-14T15:58:37.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.559+0000 7f786effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f787015a440 0x7f787014b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:37.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.559+0000 7f786effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f787015a440 0x7f787014b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40532/0 (socket says 172.21.15.37:40532) 2023-07-14T15:58:37.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.559+0000 7f786effd700 1 -- 172.21.15.37:0/3890900008 learned_addr learned my addr 172.21.15.37:0/3890900008 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:37.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.559+0000 7f786f7fe700 1 --2- 172.21.15.37:0/3890900008 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f78700afae0 0x7f787014bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:37.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.559+0000 7f786ffff700 1 --2- 172.21.15.37:0/3890900008 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f787015a810 0x7f787015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:37.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.559+0000 7f786effd700 1 -- 172.21.15.37:0/3890900008 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f78700afae0 msgr2=0x7f787014bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:37.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.559+0000 7f786effd700 1 --2- 172.21.15.37:0/3890900008 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f78700afae0 0x7f787014bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:37.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.559+0000 7f786effd700 1 -- 172.21.15.37:0/3890900008 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f787015a810 msgr2=0x7f787015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:37.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.559+0000 7f786effd700 1 --2- 172.21.15.37:0/3890900008 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f787015a810 0x7f787015b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:37.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.559+0000 7f786effd700 1 -- 172.21.15.37:0/3890900008 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7860009550 con 0x7f787015a440 2023-07-14T15:58:37.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.560+0000 7f786effd700 1 --2- 172.21.15.37:0/3890900008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f787015a440 0x7f787014b7a0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f786400e8a0 tx=0x7f786400ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:37.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.560+0000 7f7857fff700 1 -- 172.21.15.37:0/3890900008 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7864009590 con 0x7f787015a440 2023-07-14T15:58:37.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.560+0000 7f7857fff700 1 -- 172.21.15.37:0/3890900008 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7864013680 con 0x7f787015a440 2023-07-14T15:58:37.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.560+0000 7f7857fff700 1 -- 172.21.15.37:0/3890900008 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78640139f0 con 0x7f787015a440 2023-07-14T15:58:37.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.560+0000 7f7875dff700 1 -- 172.21.15.37:0/3890900008 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78700b25d0 con 0x7f787015a440 2023-07-14T15:58:37.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.560+0000 7f7875dff700 1 -- 172.21.15.37:0/3890900008 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78700b2b90 con 0x7f787015a440 2023-07-14T15:58:37.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.561+0000 7f7875dff700 1 -- 172.21.15.37:0/3890900008 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7870067840 con 0x7f787015a440 2023-07-14T15:58:37.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.562+0000 7f7857fff700 1 -- 172.21.15.37:0/3890900008 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f7864013b50 con 0x7f787015a440 2023-07-14T15:58:37.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.564+0000 7f7857fff700 1 --2- 172.21.15.37:0/3890900008 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f785c06ae00 0x7f785c06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:37.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.564+0000 7f7857fff700 1 -- 172.21.15.37:0/3890900008 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7864089680 con 0x7f787015a440 2023-07-14T15:58:37.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.564+0000 7f786f7fe700 1 --2- 172.21.15.37:0/3890900008 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f785c06ae00 0x7f785c06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:37.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.565+0000 7f786f7fe700 1 --2- 172.21.15.37:0/3890900008 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f785c06ae00 0x7f785c06d2b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7860009c40 tx=0x7f7860008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:37.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.568+0000 7f7857fff700 1 -- 172.21.15.37:0/3890900008 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f78640544f0 con 0x7f787015a440 2023-07-14T15:58:37.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.780+0000 7f7875dff700 1 -- 172.21.15.37:0/3890900008 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7870071630 con 0x7f787015a440 2023-07-14T15:58:37.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.781+0000 7f7857fff700 1 -- 172.21.15.37:0/3890900008 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+18281 (secure 0 0 0) 0x7f7864057b10 con 0x7f787015a440 2023-07-14T15:58:37.766 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:58:37.766 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":49,"fsid":"9da30401-a779-4e46-aba6-00c2494c6c67","created":"2023-07-14T15:55:39.898867+0000","modified":"2023-07-14T15:58:09.712394+0000","last_up_change":"2023-07-14T15:55:53.025696+0000","last_in_change":"2023-07-14T15:55:43.388192+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T15:55:52.907261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T15:55:59.992839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-14T15:58:05.947379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-14T15:58:07.213413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d049535-7b87-4276-8fe5-0f74ba422d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6801","nonce":2783032392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6803","nonce":2783032392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6807","nonce":2783032392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6805","nonce":2783032392}]},"public_addr":"172.21.15.37:6801/2783032392","cluster_addr":"172.21.15.37:6803/2783032392","heartbeat_back_addr":"172.21.15.37:6807/2783032392","heartbeat_front_addr":"172.21.15.37:6805/2783032392","state":["exists","up"]},{"osd":1,"uuid":"79ec948d-ead2-4c2d-923a-dd6eeaac9dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6823","nonce":1190059746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6826","nonce":1190059746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6831","nonce":1190059746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6829","nonce":1190059746}]},"public_addr":"172.21.15.37:6823/1190059746","cluster_addr":"172.21.15.37:6826/1190059746","heartbeat_back_addr":"172.21.15.37:6831/1190059746","heartbeat_front_addr":"172.21.15.37:6829/1190059746","state":["exists","up"]},{"osd":2,"uuid":"a1db6690-c160-4366-9c82-2cca17e4bba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6809","nonce":2266223499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6813","nonce":2266223499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6820","nonce":2266223499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6816","nonce":2266223499}]},"public_addr":"172.21.15.37:6809/2266223499","cluster_addr":"172.21.15.37:6813/2266223499","heartbeat_back_addr":"172.21.15.37:6820/2266223499","heartbeat_front_addr":"172.21.15.37:6816/2266223499","state":["exists","up"]},{"osd":3,"uuid":"767b8220-e79a-4a86-a162-6b3b73198379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6812","nonce":4166694594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6817","nonce":4166694594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6828","nonce":4166694594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6822","nonce":4166694594}]},"public_addr":"172.21.15.37:6812/4166694594","cluster_addr":"172.21.15.37:6817/4166694594","heartbeat_back_addr":"172.21.15.37:6828/4166694594","heartbeat_front_addr":"172.21.15.37:6822/4166694594","state":["exists","up"]},{"osd":4,"uuid":"717bd773-ae7e-4236-ac79-900cf99a37c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6801","nonce":3529020407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6803","nonce":3529020407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6807","nonce":3529020407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6805","nonce":3529020407}]},"public_addr":"172.21.15.98:6801/3529020407","cluster_addr":"172.21.15.98:6803/3529020407","heartbeat_back_addr":"172.21.15.98:6807/3529020407","heartbeat_front_addr":"172.21.15.98:6805/3529020407","state":["exists","up"]},{"osd":5,"uuid":"a941d358-0f03-4136-a9b2-3a1c2e9358cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6817","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6819","nonce":2311501838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6821","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6823","nonce":2311501838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6829","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6831","nonce":2311501838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6825","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6827","nonce":2311501838}]},"public_addr":"172.21.15.98:6819/2311501838","cluster_addr":"172.21.15.98:6823/2311501838","heartbeat_back_addr":"172.21.15.98:6831/2311501838","heartbeat_front_addr":"172.21.15.98:6827/2311501838","state":["exists","up"]},{"osd":6,"uuid":"27153772-6d4b-479d-9953-0582e7b96743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6809","nonce":1144224691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6811","nonce":1144224691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6815","nonce":1144224691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6813","nonce":1144224691}]},"public_addr":"172.21.15.98:6809/1144224691","cluster_addr":"172.21.15.98:6811/1144224691","heartbeat_back_addr":"172.21.15.98:6815/1144224691","heartbeat_front_addr":"172.21.15.98:6813/1144224691","state":["exists","up"]},{"osd":7,"uuid":"d21ffc8e-40bb-47eb-af2c-e3e730d3fb76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6818","nonce":1144470927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6822","nonce":1144470927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6830","nonce":1144470927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6826","nonce":1144470927}]},"public_addr":"172.21.15.98:6818/1144470927","cluster_addr":"172.21.15.98:6822/1144470927","heartbeat_back_addr":"172.21.15.98:6830/1144470927","heartbeat_front_addr":"172.21.15.98:6826/1144470927","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.921114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.739210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.024016+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.002527+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.698127+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.813416+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.709351+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.815457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T15:58:37.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.784+0000 7f7875dff700 1 -- 172.21.15.37:0/3890900008 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f785c06ae00 msgr2=0x7f785c06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:37.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.784+0000 7f7875dff700 1 --2- 172.21.15.37:0/3890900008 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f785c06ae00 0x7f785c06d2b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7860009c40 tx=0x7f7860008030 comp rx=0 tx=0).stop 2023-07-14T15:58:37.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.784+0000 7f7875dff700 1 -- 172.21.15.37:0/3890900008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f787015a440 msgr2=0x7f787014b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:37.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.784+0000 7f7875dff700 1 --2- 172.21.15.37:0/3890900008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f787015a440 0x7f787014b7a0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f786400e8a0 tx=0x7f786400ebb0 comp rx=0 tx=0).stop 2023-07-14T15:58:37.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.784+0000 7f7875dff700 1 -- 172.21.15.37:0/3890900008 shutdown_connections 2023-07-14T15:58:37.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.784+0000 7f7875dff700 1 --2- 172.21.15.37:0/3890900008 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f787015a810 0x7f787015b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:37.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.784+0000 7f7875dff700 1 --2- 172.21.15.37:0/3890900008 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f785c06ae00 0x7f785c06d2b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:37.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.784+0000 7f7875dff700 1 --2- 172.21.15.37:0/3890900008 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f78700afae0 0x7f787014bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:37.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.784+0000 7f7875dff700 1 --2- 172.21.15.37:0/3890900008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f787015a440 0x7f787014b7a0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:37.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.784+0000 7f7875dff700 1 -- 172.21.15.37:0/3890900008 >> 172.21.15.37:0/3890900008 conn(0x7f78700b08c0 msgr2=0x7f78700cdb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:37.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.784+0000 7f7875dff700 1 -- 172.21.15.37:0/3890900008 shutdown_connections 2023-07-14T15:58:37.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:37.784+0000 7f7875dff700 1 -- 172.21.15.37:0/3890900008 wait complete. 2023-07-14T15:58:37.787 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T15:55:52.907261+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T15:55:59.992839+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T15:58:05.947379+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T15:58:07.213413+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T15:58:37.788 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T15:58:38.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.018+0000 7f26c9fff700 1 Processor -- start 2023-07-14T15:58:38.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.018+0000 7f26c9fff700 1 -- start start 2023-07-14T15:58:38.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.019+0000 7f26c9fff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f26c40af190 0x7f26c40cf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:38.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.019+0000 7f26c9fff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26c415cc60 con 0x7f26c40b16f0 2023-07-14T15:58:38.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.019+0000 7f26c9fff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26c4071720 con 0x7f26c406d6b0 2023-07-14T15:58:38.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.019+0000 7f26c9fff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26c4071530 con 0x7f26c40af190 2023-07-14T15:58:38.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.020+0000 7f26c3fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f26c40b16f0 0x7f26c40ca150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52536/0 (socket says 172.21.15.37:52536) 2023-07-14T15:58:38.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.020+0000 7f26c3fff700 1 -- 172.21.15.37:0/2343097254 learned_addr learned my addr 172.21.15.37:0/2343097254 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:58:38.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.020+0000 7f26c37fe700 1 --2- 172.21.15.37:0/2343097254 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f26c40af190 0x7f26c40cf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:38.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.020+0000 7f26c27fc700 1 -- 172.21.15.37:0/2343097254 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 60576837 0 0) 0x7f26c415cc60 con 0x7f26c40b16f0 2023-07-14T15:58:38.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.020+0000 7f26c27fc700 1 -- 172.21.15.37:0/2343097254 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26ac0035b0 con 0x7f26c40b16f0 2023-07-14T15:58:38.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.020+0000 7f26c27fc700 1 -- 172.21.15.37:0/2343097254 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3507190606 0 0) 0x7f26c4071720 con 0x7f26c406d6b0 2023-07-14T15:58:38.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.020+0000 7f26c27fc700 1 -- 172.21.15.37:0/2343097254 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26c415cc60 con 0x7f26c406d6b0 2023-07-14T15:58:38.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.020+0000 7f26c37fe700 1 -- 172.21.15.37:0/2343097254 >> v1:172.21.15.98:6789/0 conn(0x7f26c406d6b0 legacy=0x7f26c4070e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:38.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.020+0000 7f26c37fe700 1 -- 172.21.15.37:0/2343097254 >> v1:172.21.15.37:6789/0 conn(0x7f26c40b16f0 legacy=0x7f26c40ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:38.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.020+0000 7f26c37fe700 1 -- 172.21.15.37:0/2343097254 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c40ceaf0 con 0x7f26c40af190 2023-07-14T15:58:38.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.021+0000 7f26c37fe700 1 --2- 172.21.15.37:0/2343097254 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f26c40af190 0x7f26c40cf5d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f26b4009870 tx=0x7f26b4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29e4ab461fbf0281 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:38.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.021+0000 7f26c27fc700 1 -- 172.21.15.37:0/2343097254 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b4011830 con 0x7f26c40af190 2023-07-14T15:58:38.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.021+0000 7f26c27fc700 1 -- 172.21.15.37:0/2343097254 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b4011990 con 0x7f26c40af190 2023-07-14T15:58:38.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.021+0000 7f26c27fc700 1 -- 172.21.15.37:0/2343097254 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b4011d20 con 0x7f26c40af190 2023-07-14T15:58:38.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.021+0000 7f26c9fff700 1 -- 172.21.15.37:0/2343097254 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f26c40af190 msgr2=0x7f26c40cf5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:38.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.021+0000 7f26c9fff700 1 --2- 172.21.15.37:0/2343097254 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f26c40af190 0x7f26c40cf5d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f26b4009870 tx=0x7f26b4009b80 comp rx=0 tx=0).stop 2023-07-14T15:58:38.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.022+0000 7f26c9fff700 1 -- 172.21.15.37:0/2343097254 shutdown_connections 2023-07-14T15:58:38.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.022+0000 7f26c9fff700 1 --2- 172.21.15.37:0/2343097254 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f26c40af190 0x7f26c40cf5d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:38.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.022+0000 7f26c9fff700 1 -- 172.21.15.37:0/2343097254 >> 172.21.15.37:0/2343097254 conn(0x7f26c40cc610 msgr2=0x7f26c40cc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:38.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.022+0000 7f26c9fff700 1 -- 172.21.15.37:0/2343097254 shutdown_connections 2023-07-14T15:58:38.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.022+0000 7f26c9fff700 1 -- 172.21.15.37:0/2343097254 wait complete. 2023-07-14T15:58:38.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.023+0000 7f26c9fff700 1 Processor -- start 2023-07-14T15:58:38.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.023+0000 7f26c9fff700 1 -- start start 2023-07-14T15:58:38.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.024+0000 7f26c9fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26c406d6b0 0x7f26c415af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:38.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.024+0000 7f26c9fff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f26c40af190 0x7f26c415f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:38.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.024+0000 7f26c9fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26c40b16f0 0x7f26c40c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:38.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.024+0000 7f26c9fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c415b4d0 con 0x7f26c40b16f0 2023-07-14T15:58:38.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.024+0000 7f26c9fff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c40c77e0 con 0x7f26c406d6b0 2023-07-14T15:58:38.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.024+0000 7f26c9fff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26c415e040 con 0x7f26c40af190 2023-07-14T15:58:38.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.025+0000 7f26c3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26c40b16f0 0x7f26c40c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:38.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.025+0000 7f26c3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26c40b16f0 0x7f26c40c83f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40548/0 (socket says 172.21.15.37:40548) 2023-07-14T15:58:38.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.025+0000 7f26c3fff700 1 -- 172.21.15.37:0/1869493658 learned_addr learned my addr 172.21.15.37:0/1869493658 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:38.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.025+0000 7f26c37fe700 1 --2- 172.21.15.37:0/1869493658 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26c406d6b0 0x7f26c415af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:38.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.025+0000 7f26c2ffd700 1 --2- 172.21.15.37:0/1869493658 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f26c40af190 0x7f26c415f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:38.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.025+0000 7f26c3fff700 1 -- 172.21.15.37:0/1869493658 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f26c40af190 msgr2=0x7f26c415f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:38.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.025+0000 7f26c3fff700 1 --2- 172.21.15.37:0/1869493658 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f26c40af190 0x7f26c415f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:38.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.025+0000 7f26c3fff700 1 -- 172.21.15.37:0/1869493658 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26c406d6b0 msgr2=0x7f26c415af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:38.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.025+0000 7f26c3fff700 1 --2- 172.21.15.37:0/1869493658 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26c406d6b0 0x7f26c415af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:38.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.025+0000 7f26c3fff700 1 -- 172.21.15.37:0/1869493658 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b40094a0 con 0x7f26c40b16f0 2023-07-14T15:58:38.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.025+0000 7f26c3fff700 1 --2- 172.21.15.37:0/1869493658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26c40b16f0 0x7f26c40c83f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f26bc00caf0 tx=0x7f26bc00ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:38.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.026+0000 7f26abfff700 1 -- 172.21.15.37:0/1869493658 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26bc00aaa0 con 0x7f26c40b16f0 2023-07-14T15:58:38.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.026+0000 7f26abfff700 1 -- 172.21.15.37:0/1869493658 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26bc00ac00 con 0x7f26c40b16f0 2023-07-14T15:58:38.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.026+0000 7f26abfff700 1 -- 172.21.15.37:0/1869493658 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26bc012400 con 0x7f26c40b16f0 2023-07-14T15:58:38.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.026+0000 7f26c9fff700 1 -- 172.21.15.37:0/1869493658 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26c415e320 con 0x7f26c40b16f0 2023-07-14T15:58:38.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.026+0000 7f26c9fff700 1 -- 172.21.15.37:0/1869493658 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26c415e8e0 con 0x7f26c40b16f0 2023-07-14T15:58:38.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.027+0000 7f26c9fff700 1 -- 172.21.15.37:0/1869493658 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26c4067840 con 0x7f26c40b16f0 2023-07-14T15:58:38.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.028+0000 7f26abfff700 1 -- 172.21.15.37:0/1869493658 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f26bc01b3b0 con 0x7f26c40b16f0 2023-07-14T15:58:38.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.029+0000 7f26abfff700 1 --2- 172.21.15.37:0/1869493658 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f26b006ae00 0x7f26b006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:38.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.029+0000 7f26abfff700 1 -- 172.21.15.37:0/1869493658 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f26bc089340 con 0x7f26c40b16f0 2023-07-14T15:58:38.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.029+0000 7f26c37fe700 1 --2- 172.21.15.37:0/1869493658 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f26b006ae00 0x7f26b006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:38.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.030+0000 7f26c37fe700 1 --2- 172.21.15.37:0/1869493658 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f26b006ae00 0x7f26b006d2b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f26b40097c0 tx=0x7f26b401c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:38.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.034+0000 7f26abfff700 1 -- 172.21.15.37:0/1869493658 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f26bc0542a0 con 0x7f26c40b16f0 2023-07-14T15:58:38.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.241+0000 7f26c9fff700 1 -- 172.21.15.37:0/1869493658 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f26c406cfa0 con 0x7f26c40b16f0 2023-07-14T15:58:38.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.241+0000 7f26abfff700 1 -- 172.21.15.37:0/1869493658 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) v1 ==== 93+0+10 (secure 0 0 0) 0x7f26bc0578c0 con 0x7f26c40b16f0 2023-07-14T15:58:38.226 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-14T15:58:38.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.244+0000 7f26c9fff700 1 -- 172.21.15.37:0/1869493658 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f26b006ae00 msgr2=0x7f26b006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:38.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.244+0000 7f26c9fff700 1 --2- 172.21.15.37:0/1869493658 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f26b006ae00 0x7f26b006d2b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f26b40097c0 tx=0x7f26b401c040 comp rx=0 tx=0).stop 2023-07-14T15:58:38.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.244+0000 7f26c9fff700 1 -- 172.21.15.37:0/1869493658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26c40b16f0 msgr2=0x7f26c40c83f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:38.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.244+0000 7f26c9fff700 1 --2- 172.21.15.37:0/1869493658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26c40b16f0 0x7f26c40c83f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f26bc00caf0 tx=0x7f26bc00ce00 comp rx=0 tx=0).stop 2023-07-14T15:58:38.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.244+0000 7f26c9fff700 1 -- 172.21.15.37:0/1869493658 shutdown_connections 2023-07-14T15:58:38.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.244+0000 7f26c9fff700 1 --2- 172.21.15.37:0/1869493658 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26c406d6b0 0x7f26c415af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:38.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.244+0000 7f26c9fff700 1 --2- 172.21.15.37:0/1869493658 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f26b006ae00 0x7f26b006d2b0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:38.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.244+0000 7f26c9fff700 1 --2- 172.21.15.37:0/1869493658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26c40b16f0 0x7f26c40c83f0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:38.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.244+0000 7f26c9fff700 1 --2- 172.21.15.37:0/1869493658 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f26c40af190 0x7f26c415f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:38.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.244+0000 7f26c9fff700 1 -- 172.21.15.37:0/1869493658 >> 172.21.15.37:0/1869493658 conn(0x7f26c40cc610 msgr2=0x7f26c40cb2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:38.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.244+0000 7f26c9fff700 1 -- 172.21.15.37:0/1869493658 shutdown_connections 2023-07-14T15:58:38.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.244+0000 7f26c9fff700 1 -- 172.21.15.37:0/1869493658 wait complete. 2023-07-14T15:58:38.247 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T15:58:38.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.467+0000 7f0b0fbff700 1 Processor -- start 2023-07-14T15:58:38.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.467+0000 7f0b0fbff700 1 -- start start 2023-07-14T15:58:38.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.468+0000 7f0b0fbff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0b08071730 0x7f0b0806f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:38.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.468+0000 7f0b0fbff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0b080ae000 0x7f0b0806b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:38.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.468+0000 7f0b0fbff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b08159870 con 0x7f0b0806bf00 2023-07-14T15:58:38.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.468+0000 7f0b0fbff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b080ae470 con 0x7f0b080ae000 2023-07-14T15:58:38.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.468+0000 7f0b0fbff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b0806c340 con 0x7f0b08071730 2023-07-14T15:58:38.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.469+0000 7f0b0d19a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0b080ae000 0x7f0b0806b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:38.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.469+0000 7f0b0e19c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0b0806bf00 0x7f0b080cd220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52552/0 (socket says 172.21.15.37:52552) 2023-07-14T15:58:38.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.469+0000 7f0b0e19c700 1 -- 172.21.15.37:0/1314300175 learned_addr learned my addr 172.21.15.37:0/1314300175 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:58:38.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.469+0000 7f0b0d99b700 1 --2- 172.21.15.37:0/1314300175 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0b08071730 0x7f0b0806f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:38.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.469+0000 7f0b0d19a700 1 -- 172.21.15.37:0/1314300175 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0b08071730 msgr2=0x7f0b0806f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:38.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.469+0000 7f0b0d19a700 1 --2- 172.21.15.37:0/1314300175 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0b08071730 0x7f0b0806f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:38.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.469+0000 7f0b0d19a700 1 -- 172.21.15.37:0/1314300175 >> v1:172.21.15.37:6789/0 conn(0x7f0b0806bf00 legacy=0x7f0b080cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:38.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.469+0000 7f0b0d19a700 1 -- 172.21.15.37:0/1314300175 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b080ca790 con 0x7f0b080ae000 2023-07-14T15:58:38.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.469+0000 7f0b0c999700 1 -- 172.21.15.37:0/1314300175 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1047824456 0 0) 0x7f0b08159870 con 0x7f0b0806bf00 2023-07-14T15:58:38.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.469+0000 7f0b0d19a700 1 --2- 172.21.15.37:0/1314300175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b080ae000 0x7f0b0806b9c0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f0af800bae0 tx=0x7f0af800bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a459eb1b855520e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:38.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.470+0000 7f0b0c999700 1 -- 172.21.15.37:0/1314300175 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af800dc70 con 0x7f0b080ae000 2023-07-14T15:58:38.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.470+0000 7f0b0c999700 1 -- 172.21.15.37:0/1314300175 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af800ddd0 con 0x7f0b080ae000 2023-07-14T15:58:38.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.470+0000 7f0b0c999700 1 -- 172.21.15.37:0/1314300175 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af8010690 con 0x7f0b080ae000 2023-07-14T15:58:38.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.470+0000 7f0b0fbff700 1 -- 172.21.15.37:0/1314300175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b080ae000 msgr2=0x7f0b0806b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:38.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.470+0000 7f0b0fbff700 1 --2- 172.21.15.37:0/1314300175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b080ae000 0x7f0b0806b9c0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f0af800bae0 tx=0x7f0af800bdf0 comp rx=0 tx=0).stop 2023-07-14T15:58:38.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.470+0000 7f0b0fbff700 1 -- 172.21.15.37:0/1314300175 shutdown_connections 2023-07-14T15:58:38.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.470+0000 7f0b0fbff700 1 --2- 172.21.15.37:0/1314300175 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0b08071730 0x7f0b0806f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:38.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.470+0000 7f0b0fbff700 1 --2- 172.21.15.37:0/1314300175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b080ae000 0x7f0b0806b9c0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:38.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.470+0000 7f0b0fbff700 1 -- 172.21.15.37:0/1314300175 >> 172.21.15.37:0/1314300175 conn(0x7f0b0806aac0 msgr2=0x7f0b080b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:38.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.470+0000 7f0b0fbff700 1 -- 172.21.15.37:0/1314300175 shutdown_connections 2023-07-14T15:58:38.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.470+0000 7f0b0fbff700 1 -- 172.21.15.37:0/1314300175 wait complete. 2023-07-14T15:58:38.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.472+0000 7f0b0fbff700 1 Processor -- start 2023-07-14T15:58:38.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.472+0000 7f0b0fbff700 1 -- start start 2023-07-14T15:58:38.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.473+0000 7f0b0fbff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b0806bf00 0x7f0b08155230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:38.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.473+0000 7f0b0fbff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b08071730 0x7f0b080c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:38.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.473+0000 7f0b0fbff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0b080ae000 0x7f0b081545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:38.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.473+0000 7f0b0fbff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b08155090 con 0x7f0b0806bf00 2023-07-14T15:58:38.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.473+0000 7f0b0fbff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b08154b20 con 0x7f0b08071730 2023-07-14T15:58:38.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.473+0000 7f0b0fbff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b081e45f0 con 0x7f0b080ae000 2023-07-14T15:58:38.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.473+0000 7f0b0d99b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b0806bf00 0x7f0b08155230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:38.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.473+0000 7f0b0d99b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b0806bf00 0x7f0b08155230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40570/0 (socket says 172.21.15.37:40570) 2023-07-14T15:58:38.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.474+0000 7f0b0d99b700 1 -- 172.21.15.37:0/3512660260 learned_addr learned my addr 172.21.15.37:0/3512660260 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:38.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.474+0000 7f0b0d19a700 1 --2- 172.21.15.37:0/3512660260 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b08071730 0x7f0b080c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:38.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.474+0000 7f0b0e19c700 1 --2- 172.21.15.37:0/3512660260 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0b080ae000 0x7f0b081545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:38.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.474+0000 7f0b0d99b700 1 -- 172.21.15.37:0/3512660260 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0b080ae000 msgr2=0x7f0b081545e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:38.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.474+0000 7f0b0d99b700 1 --2- 172.21.15.37:0/3512660260 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0b080ae000 0x7f0b081545e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:38.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.474+0000 7f0b0d99b700 1 -- 172.21.15.37:0/3512660260 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b08071730 msgr2=0x7f0b080c7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:38.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.474+0000 7f0b0d99b700 1 --2- 172.21.15.37:0/3512660260 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b08071730 0x7f0b080c7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:38.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.474+0000 7f0b0d99b700 1 -- 172.21.15.37:0/3512660260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af800b740 con 0x7f0b0806bf00 2023-07-14T15:58:38.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.474+0000 7f0b0e19c700 1 --2- 172.21.15.37:0/3512660260 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0b080ae000 0x7f0b081545e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:58:38.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.474+0000 7f0b0d99b700 1 --2- 172.21.15.37:0/3512660260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b0806bf00 0x7f0b08155230 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f0b0400e9b0 tx=0x7f0b0400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:38.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.474+0000 7f0afe7fc700 1 -- 172.21.15.37:0/3512660260 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b04009710 con 0x7f0b0806bf00 2023-07-14T15:58:38.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.474+0000 7f0afe7fc700 1 -- 172.21.15.37:0/3512660260 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0400c850 con 0x7f0b0806bf00 2023-07-14T15:58:38.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.474+0000 7f0afe7fc700 1 -- 172.21.15.37:0/3512660260 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0400cbc0 con 0x7f0b0806bf00 2023-07-14T15:58:38.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.474+0000 7f0b0fbff700 1 -- 172.21.15.37:0/3512660260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b080c81f0 con 0x7f0b0806bf00 2023-07-14T15:58:38.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.475+0000 7f0b0fbff700 1 -- 172.21.15.37:0/3512660260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b081e4280 con 0x7f0b0806bf00 2023-07-14T15:58:38.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.476+0000 7f0b0fbff700 1 -- 172.21.15.37:0/3512660260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b081e48d0 con 0x7f0b0806bf00 2023-07-14T15:58:38.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.477+0000 7f0afe7fc700 1 -- 172.21.15.37:0/3512660260 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f0b0400cd20 con 0x7f0b0806bf00 2023-07-14T15:58:38.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.478+0000 7f0afe7fc700 1 --2- 172.21.15.37:0/3512660260 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0aec06ae00 0x7f0aec06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:38.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.478+0000 7f0afe7fc700 1 -- 172.21.15.37:0/3512660260 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f0b04089790 con 0x7f0b0806bf00 2023-07-14T15:58:38.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.478+0000 7f0b0d19a700 1 --2- 172.21.15.37:0/3512660260 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0aec06ae00 0x7f0aec06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:38.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.479+0000 7f0b0d19a700 1 --2- 172.21.15.37:0/3512660260 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0aec06ae00 0x7f0aec06d2b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0af800b2c0 tx=0x7f0af801c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:38.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.482+0000 7f0afe7fc700 1 -- 172.21.15.37:0/3512660260 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0b04054650 con 0x7f0b0806bf00 2023-07-14T15:58:38.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.687+0000 7f0b0fbff700 1 -- 172.21.15.37:0/3512660260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0b080ce880 con 0x7f0b0806bf00 2023-07-14T15:58:38.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.688+0000 7f0afe7fc700 1 -- 172.21.15.37:0/3512660260 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v50) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0b04057c70 con 0x7f0b0806bf00 2023-07-14T15:58:38.673 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-14T15:58:38.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.690+0000 7f0b0fbff700 1 -- 172.21.15.37:0/3512660260 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0aec06ae00 msgr2=0x7f0aec06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:38.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.690+0000 7f0b0fbff700 1 --2- 172.21.15.37:0/3512660260 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0aec06ae00 0x7f0aec06d2b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0af800b2c0 tx=0x7f0af801c040 comp rx=0 tx=0).stop 2023-07-14T15:58:38.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.690+0000 7f0b0fbff700 1 -- 172.21.15.37:0/3512660260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b0806bf00 msgr2=0x7f0b08155230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:38.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.690+0000 7f0b0fbff700 1 --2- 172.21.15.37:0/3512660260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b0806bf00 0x7f0b08155230 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f0b0400e9b0 tx=0x7f0b0400ecc0 comp rx=0 tx=0).stop 2023-07-14T15:58:38.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.690+0000 7f0b0fbff700 1 -- 172.21.15.37:0/3512660260 shutdown_connections 2023-07-14T15:58:38.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.690+0000 7f0b0fbff700 1 --2- 172.21.15.37:0/3512660260 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0aec06ae00 0x7f0aec06d2b0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:38.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.690+0000 7f0b0fbff700 1 --2- 172.21.15.37:0/3512660260 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0b080ae000 0x7f0b081545e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:38.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.690+0000 7f0b0fbff700 1 --2- 172.21.15.37:0/3512660260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b0806bf00 0x7f0b08155230 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:38.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.690+0000 7f0b0fbff700 1 --2- 172.21.15.37:0/3512660260 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b08071730 0x7f0b080c7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:38.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.690+0000 7f0b0fbff700 1 -- 172.21.15.37:0/3512660260 >> 172.21.15.37:0/3512660260 conn(0x7f0b0806aac0 msgr2=0x7f0b080cd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:38.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.690+0000 7f0b0fbff700 1 -- 172.21.15.37:0/3512660260 shutdown_connections 2023-07-14T15:58:38.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.690+0000 7f0b0fbff700 1 -- 172.21.15.37:0/3512660260 wait complete. 2023-07-14T15:58:38.693 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T15:58:38.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.913+0000 7f86299ff700 1 Processor -- start 2023-07-14T15:58:38.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.913+0000 7f86299ff700 1 -- start start 2023-07-14T15:58:38.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.914+0000 7f86299ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f86240cfd50 0x7f86240d2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:38.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.914+0000 7f86299ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f86240b1e80 0x7f86240b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:38.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.915+0000 7f86299ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86240b1840 con 0x7f86240b3290 2023-07-14T15:58:38.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.915+0000 7f86299ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f862415ccf0 con 0x7f86240b1e80 2023-07-14T15:58:38.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.915+0000 7f86299ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86240b2550 con 0x7f86240cfd50 2023-07-14T15:58:38.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.915+0000 7f861bfff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f86240b1e80 0x7f86240b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:38.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.915+0000 7f86237fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f86240b3290 0x7f86240b3730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52554/0 (socket says 172.21.15.37:52554) 2023-07-14T15:58:38.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.915+0000 7f86237fe700 1 -- 172.21.15.37:0/2128384693 learned_addr learned my addr 172.21.15.37:0/2128384693 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:58:38.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.915+0000 7f8622ffd700 1 --2- 172.21.15.37:0/2128384693 >> v2:172.21.15.98:3300/0 conn(0x7f86240cfd50 0x7f86240d2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:38.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.915+0000 7f861bfff700 1 -- 172.21.15.37:0/2128384693 >> v2:172.21.15.98:3300/0 conn(0x7f86240cfd50 msgr2=0x7f86240d2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:38.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.915+0000 7f861bfff700 1 --2- 172.21.15.37:0/2128384693 >> v2:172.21.15.98:3300/0 conn(0x7f86240cfd50 0x7f86240d2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:38.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.915+0000 7f861bfff700 1 -- 172.21.15.37:0/2128384693 >> v1:172.21.15.37:6789/0 conn(0x7f86240b3290 legacy=0x7f86240b3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:38.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.915+0000 7f861bfff700 1 -- 172.21.15.37:0/2128384693 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86240b2830 con 0x7f86240b1e80 2023-07-14T15:58:38.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.915+0000 7f8622ffd700 1 --2- 172.21.15.37:0/2128384693 >> v2:172.21.15.98:3300/0 conn(0x7f86240cfd50 0x7f86240d2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:58:38.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.915+0000 7f86227fc700 1 -- 172.21.15.37:0/2128384693 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 441882573 0 0) 0x7f86240b1840 con 0x7f86240b3290 2023-07-14T15:58:38.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.916+0000 7f861bfff700 1 --2- 172.21.15.37:0/2128384693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86240b1e80 0x7f86240b2d50 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f862408b170 tx=0x7f860c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcbbf441bc552fdd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:38.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.916+0000 7f86227fc700 1 -- 172.21.15.37:0/2128384693 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860c011830 con 0x7f86240b1e80 2023-07-14T15:58:38.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.916+0000 7f86227fc700 1 -- 172.21.15.37:0/2128384693 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f860c011990 con 0x7f86240b1e80 2023-07-14T15:58:38.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.916+0000 7f86227fc700 1 -- 172.21.15.37:0/2128384693 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860c011d20 con 0x7f86240b1e80 2023-07-14T15:58:38.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.916+0000 7f86299ff700 1 -- 172.21.15.37:0/2128384693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86240b1e80 msgr2=0x7f86240b2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:38.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.916+0000 7f86299ff700 1 --2- 172.21.15.37:0/2128384693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86240b1e80 0x7f86240b2d50 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f862408b170 tx=0x7f860c009b20 comp rx=0 tx=0).stop 2023-07-14T15:58:38.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.916+0000 7f86299ff700 1 -- 172.21.15.37:0/2128384693 shutdown_connections 2023-07-14T15:58:38.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.916+0000 7f86299ff700 1 --2- 172.21.15.37:0/2128384693 >> v2:172.21.15.98:3300/0 conn(0x7f86240cfd50 0x7f86240d2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:38.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.916+0000 7f86299ff700 1 --2- 172.21.15.37:0/2128384693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86240b1e80 0x7f86240b2d50 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:38.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.916+0000 7f86299ff700 1 -- 172.21.15.37:0/2128384693 >> 172.21.15.37:0/2128384693 conn(0x7f862409c1c0 msgr2=0x7f86240d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:38.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.917+0000 7f86299ff700 1 -- 172.21.15.37:0/2128384693 shutdown_connections 2023-07-14T15:58:38.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.917+0000 7f86299ff700 1 -- 172.21.15.37:0/2128384693 wait complete. 2023-07-14T15:58:38.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.918+0000 7f86299ff700 1 Processor -- start 2023-07-14T15:58:38.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.919+0000 7f86299ff700 1 -- start start 2023-07-14T15:58:38.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.920+0000 7f86299ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86240b1e80 0x7f86240a0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:38.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.920+0000 7f86299ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f86240b3290 0x7f86240a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:38.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.920+0000 7f86299ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86240cfd50 0x7f862409d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:38.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.920+0000 7f86299ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f862409f200 con 0x7f86240b1e80 2023-07-14T15:58:38.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.920+0000 7f86299ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f862415bce0 con 0x7f86240cfd50 2023-07-14T15:58:38.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.920+0000 7f86299ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f862409e580 con 0x7f86240b3290 2023-07-14T15:58:38.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.920+0000 7f8622ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86240b1e80 0x7f86240a0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:38.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.920+0000 7f8622ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86240b1e80 0x7f86240a0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40592/0 (socket says 172.21.15.37:40592) 2023-07-14T15:58:38.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.920+0000 7f8622ffd700 1 -- 172.21.15.37:0/2953138022 learned_addr learned my addr 172.21.15.37:0/2953138022 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:38.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.920+0000 7f86237fe700 1 --2- 172.21.15.37:0/2953138022 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86240cfd50 0x7f862409d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:38.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.920+0000 7f861bfff700 1 --2- 172.21.15.37:0/2953138022 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f86240b3290 0x7f86240a06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:38.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.920+0000 7f8622ffd700 1 -- 172.21.15.37:0/2953138022 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f86240b3290 msgr2=0x7f86240a06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:38.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.920+0000 7f8622ffd700 1 --2- 172.21.15.37:0/2953138022 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f86240b3290 0x7f86240a06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:38.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.920+0000 7f8622ffd700 1 -- 172.21.15.37:0/2953138022 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86240cfd50 msgr2=0x7f862409d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:38.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.920+0000 7f8622ffd700 1 --2- 172.21.15.37:0/2953138022 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86240cfd50 0x7f862409d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:38.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.920+0000 7f8622ffd700 1 -- 172.21.15.37:0/2953138022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f860c0094a0 con 0x7f86240b1e80 2023-07-14T15:58:38.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.920+0000 7f861bfff700 1 --2- 172.21.15.37:0/2953138022 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f86240b3290 0x7f86240a06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:58:38.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.921+0000 7f8622ffd700 1 --2- 172.21.15.37:0/2953138022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86240b1e80 0x7f86240a0190 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f861400e810 tx=0x7f861400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:38.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.921+0000 7f8620ff9700 1 -- 172.21.15.37:0/2953138022 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861400c020 con 0x7f86240b1e80 2023-07-14T15:58:38.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.921+0000 7f8620ff9700 1 -- 172.21.15.37:0/2953138022 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8614004250 con 0x7f86240b1e80 2023-07-14T15:58:38.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.921+0000 7f8620ff9700 1 -- 172.21.15.37:0/2953138022 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86140036a0 con 0x7f86240b1e80 2023-07-14T15:58:38.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.921+0000 7f86299ff700 1 -- 172.21.15.37:0/2953138022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86240d02a0 con 0x7f86240b1e80 2023-07-14T15:58:38.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.921+0000 7f86299ff700 1 -- 172.21.15.37:0/2953138022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f862409eb40 con 0x7f86240b1e80 2023-07-14T15:58:38.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.922+0000 7f86299ff700 1 -- 172.21.15.37:0/2953138022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86241f1c00 con 0x7f86240b1e80 2023-07-14T15:58:38.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.923+0000 7f8620ff9700 1 -- 172.21.15.37:0/2953138022 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f8614003800 con 0x7f86240b1e80 2023-07-14T15:58:38.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.924+0000 7f8620ff9700 1 --2- 172.21.15.37:0/2953138022 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f860406ae00 0x7f860406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:38.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.924+0000 7f8620ff9700 1 -- 172.21.15.37:0/2953138022 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f8614089200 con 0x7f86240b1e80 2023-07-14T15:58:38.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.925+0000 7f861bfff700 1 --2- 172.21.15.37:0/2953138022 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f860406ae00 0x7f860406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:38.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.925+0000 7f861bfff700 1 --2- 172.21.15.37:0/2953138022 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f860406ae00 0x7f860406d2b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f862409c8f0 tx=0x7f860c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:38.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:38.928+0000 7f8620ff9700 1 -- 172.21.15.37:0/2953138022 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8614054040 con 0x7f86240b1e80 2023-07-14T15:58:39.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.139+0000 7f86299ff700 1 -- 172.21.15.37:0/2953138022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8624067840 con 0x7f86240b1e80 2023-07-14T15:58:39.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.139+0000 7f8620ff9700 1 -- 172.21.15.37:0/2953138022 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v50) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8614057660 con 0x7f86240b1e80 2023-07-14T15:58:39.124 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-14T15:58:39.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.142+0000 7f86299ff700 1 -- 172.21.15.37:0/2953138022 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f860406ae00 msgr2=0x7f860406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:39.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.142+0000 7f86299ff700 1 --2- 172.21.15.37:0/2953138022 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f860406ae00 0x7f860406d2b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f862409c8f0 tx=0x7f860c008030 comp rx=0 tx=0).stop 2023-07-14T15:58:39.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.142+0000 7f86299ff700 1 -- 172.21.15.37:0/2953138022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86240b1e80 msgr2=0x7f86240a0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:39.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.142+0000 7f86299ff700 1 --2- 172.21.15.37:0/2953138022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86240b1e80 0x7f86240a0190 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f861400e810 tx=0x7f861400ebd0 comp rx=0 tx=0).stop 2023-07-14T15:58:39.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.142+0000 7f86299ff700 1 -- 172.21.15.37:0/2953138022 shutdown_connections 2023-07-14T15:58:39.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.142+0000 7f86299ff700 1 --2- 172.21.15.37:0/2953138022 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86240cfd50 0x7f862409d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:39.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.142+0000 7f86299ff700 1 --2- 172.21.15.37:0/2953138022 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f860406ae00 0x7f860406d2b0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:39.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.142+0000 7f86299ff700 1 --2- 172.21.15.37:0/2953138022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86240b1e80 0x7f86240a0190 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:39.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.142+0000 7f86299ff700 1 --2- 172.21.15.37:0/2953138022 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f86240b3290 0x7f86240a06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:39.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.142+0000 7f86299ff700 1 -- 172.21.15.37:0/2953138022 >> 172.21.15.37:0/2953138022 conn(0x7f862409c1c0 msgr2=0x7f862406bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:39.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.142+0000 7f86299ff700 1 -- 172.21.15.37:0/2953138022 shutdown_connections 2023-07-14T15:58:39.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.142+0000 7f86299ff700 1 -- 172.21.15.37:0/2953138022 wait complete. 2023-07-14T15:58:39.144 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T15:58:39.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.364+0000 7f4f37fff700 1 Processor -- start 2023-07-14T15:58:39.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.364+0000 7f4f37fff700 1 -- start start 2023-07-14T15:58:39.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.365+0000 7f4f37fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4f300d1140 0x7f4f3015ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:39.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.365+0000 7f4f37fff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f3015dc50 con 0x7f4f301603b0 2023-07-14T15:58:39.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.365+0000 7f4f37fff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f300b2940 con 0x7f4f3015fee0 2023-07-14T15:58:39.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.365+0000 7f4f37fff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f300b2c20 con 0x7f4f300d1140 2023-07-14T15:58:39.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.365+0000 7f4f3559a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4f300d1140 0x7f4f3015ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:39.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.365+0000 7f4f3659c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4f301603b0 0x7f4f300b39e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52568/0 (socket says 172.21.15.37:52568) 2023-07-14T15:58:39.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.365+0000 7f4f3659c700 1 -- 172.21.15.37:0/2811450993 learned_addr learned my addr 172.21.15.37:0/2811450993 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:58:39.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.366+0000 7f4f3559a700 1 -- 172.21.15.37:0/2811450993 >> v1:172.21.15.98:6789/0 conn(0x7f4f3015fee0 legacy=0x7f4f300d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:39.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.366+0000 7f4f3559a700 1 -- 172.21.15.37:0/2811450993 >> v1:172.21.15.37:6789/0 conn(0x7f4f301603b0 legacy=0x7f4f300b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:39.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.366+0000 7f4f3559a700 1 -- 172.21.15.37:0/2811450993 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f300b2f00 con 0x7f4f300d1140 2023-07-14T15:58:39.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.366+0000 7f4f3559a700 1 --2- 172.21.15.37:0/2811450993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f300d1140 0x7f4f3015ded0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f4f20009840 tx=0x7f4f20009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=582d32b79e05f096 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:39.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.366+0000 7f4f34d99700 1 -- 172.21.15.37:0/2811450993 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f20004230 con 0x7f4f300d1140 2023-07-14T15:58:39.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.366+0000 7f4f34d99700 1 -- 172.21.15.37:0/2811450993 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f20004390 con 0x7f4f300d1140 2023-07-14T15:58:39.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.366+0000 7f4f34d99700 1 -- 172.21.15.37:0/2811450993 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f200036a0 con 0x7f4f300d1140 2023-07-14T15:58:39.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.367+0000 7f4f37fff700 1 -- 172.21.15.37:0/2811450993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f300d1140 msgr2=0x7f4f3015ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:39.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.367+0000 7f4f37fff700 1 --2- 172.21.15.37:0/2811450993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f300d1140 0x7f4f3015ded0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f4f20009840 tx=0x7f4f20009b50 comp rx=0 tx=0).stop 2023-07-14T15:58:39.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.367+0000 7f4f37fff700 1 -- 172.21.15.37:0/2811450993 shutdown_connections 2023-07-14T15:58:39.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.367+0000 7f4f37fff700 1 --2- 172.21.15.37:0/2811450993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f300d1140 0x7f4f3015ded0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:39.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.367+0000 7f4f37fff700 1 -- 172.21.15.37:0/2811450993 >> 172.21.15.37:0/2811450993 conn(0x7f4f3009c1b0 msgr2=0x7f4f300d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:39.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.367+0000 7f4f37fff700 1 -- 172.21.15.37:0/2811450993 shutdown_connections 2023-07-14T15:58:39.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.367+0000 7f4f37fff700 1 -- 172.21.15.37:0/2811450993 wait complete. 2023-07-14T15:58:39.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.369+0000 7f4f37fff700 1 Processor -- start 2023-07-14T15:58:39.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.369+0000 7f4f37fff700 1 -- start start 2023-07-14T15:58:39.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.370+0000 7f4f37fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f300d1140 0x7f4f3015b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:39.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.370+0000 7f4f37fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f3015fee0 0x7f4f300c7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:39.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.370+0000 7f4f37fff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4f301603b0 0x7f4f300c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:39.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.370+0000 7f4f37fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3009f6e0 con 0x7f4f3015fee0 2023-07-14T15:58:39.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.370+0000 7f4f37fff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3009f910 con 0x7f4f300d1140 2023-07-14T15:58:39.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.370+0000 7f4f37fff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3009fbf0 con 0x7f4f301603b0 2023-07-14T15:58:39.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.370+0000 7f4f3559a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f3015fee0 0x7f4f300c7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:39.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.370+0000 7f4f3559a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f3015fee0 0x7f4f300c7a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40612/0 (socket says 172.21.15.37:40612) 2023-07-14T15:58:39.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.370+0000 7f4f3559a700 1 -- 172.21.15.37:0/1863326845 learned_addr learned my addr 172.21.15.37:0/1863326845 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:39.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.370+0000 7f4f35d9b700 1 --2- 172.21.15.37:0/1863326845 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f300d1140 0x7f4f3015b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:39.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.370+0000 7f4f3659c700 1 --2- 172.21.15.37:0/1863326845 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4f301603b0 0x7f4f300c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:39.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.370+0000 7f4f3559a700 1 -- 172.21.15.37:0/1863326845 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4f301603b0 msgr2=0x7f4f300c7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:39.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.370+0000 7f4f3559a700 1 --2- 172.21.15.37:0/1863326845 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4f301603b0 0x7f4f300c7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:39.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.370+0000 7f4f3559a700 1 -- 172.21.15.37:0/1863326845 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f300d1140 msgr2=0x7f4f3015b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:39.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.370+0000 7f4f3559a700 1 --2- 172.21.15.37:0/1863326845 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f300d1140 0x7f4f3015b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:39.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.370+0000 7f4f3559a700 1 -- 172.21.15.37:0/1863326845 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f200094a0 con 0x7f4f3015fee0 2023-07-14T15:58:39.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.370+0000 7f4f3659c700 1 --2- 172.21.15.37:0/1863326845 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4f301603b0 0x7f4f300c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:58:39.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.371+0000 7f4f3559a700 1 --2- 172.21.15.37:0/1863326845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f3015fee0 0x7f4f300c7a00 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f4f200090b0 tx=0x7f4f20004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:39.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.371+0000 7f4f267fc700 1 -- 172.21.15.37:0/1863326845 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f20011630 con 0x7f4f3015fee0 2023-07-14T15:58:39.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.371+0000 7f4f267fc700 1 -- 172.21.15.37:0/1863326845 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2001e070 con 0x7f4f3015fee0 2023-07-14T15:58:39.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.371+0000 7f4f37fff700 1 -- 172.21.15.37:0/1863326845 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f3009fed0 con 0x7f4f3015fee0 2023-07-14T15:58:39.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.371+0000 7f4f267fc700 1 -- 172.21.15.37:0/1863326845 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f200119f0 con 0x7f4f3015fee0 2023-07-14T15:58:39.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.371+0000 7f4f37fff700 1 -- 172.21.15.37:0/1863326845 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f300a0490 con 0x7f4f3015fee0 2023-07-14T15:58:39.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.372+0000 7f4f37fff700 1 -- 172.21.15.37:0/1863326845 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f3008c580 con 0x7f4f3015fee0 2023-07-14T15:58:39.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.373+0000 7f4f267fc700 1 -- 172.21.15.37:0/1863326845 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f4f20011b50 con 0x7f4f3015fee0 2023-07-14T15:58:39.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.374+0000 7f4f267fc700 1 --2- 172.21.15.37:0/1863326845 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4f1406ae30 0x7f4f1406d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:39.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.374+0000 7f4f267fc700 1 -- 172.21.15.37:0/1863326845 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f4f2008a890 con 0x7f4f3015fee0 2023-07-14T15:58:39.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.375+0000 7f4f35d9b700 1 --2- 172.21.15.37:0/1863326845 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4f1406ae30 0x7f4f1406d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:39.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.375+0000 7f4f35d9b700 1 --2- 172.21.15.37:0/1863326845 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4f1406ae30 0x7f4f1406d2e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c007fd0 tx=0x7f4f2c007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:39.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.378+0000 7f4f267fc700 1 -- 172.21.15.37:0/1863326845 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4f200557e0 con 0x7f4f3015fee0 2023-07-14T15:58:39.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.583+0000 7f4f37fff700 1 -- 172.21.15.37:0/1863326845 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4f300a0680 con 0x7f4f3015fee0 2023-07-14T15:58:39.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.584+0000 7f4f267fc700 1 -- 172.21.15.37:0/1863326845 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v50) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4f20058e00 con 0x7f4f3015fee0 2023-07-14T15:58:39.568 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-14T15:58:39.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.586+0000 7f4f37fff700 1 -- 172.21.15.37:0/1863326845 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4f1406ae30 msgr2=0x7f4f1406d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:39.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.586+0000 7f4f37fff700 1 --2- 172.21.15.37:0/1863326845 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4f1406ae30 0x7f4f1406d2e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c007fd0 tx=0x7f4f2c007ec0 comp rx=0 tx=0).stop 2023-07-14T15:58:39.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.586+0000 7f4f37fff700 1 -- 172.21.15.37:0/1863326845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f3015fee0 msgr2=0x7f4f300c7a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:39.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.586+0000 7f4f37fff700 1 --2- 172.21.15.37:0/1863326845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f3015fee0 0x7f4f300c7a00 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f4f200090b0 tx=0x7f4f20004750 comp rx=0 tx=0).stop 2023-07-14T15:58:39.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.586+0000 7f4f37fff700 1 -- 172.21.15.37:0/1863326845 shutdown_connections 2023-07-14T15:58:39.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.587+0000 7f4f37fff700 1 --2- 172.21.15.37:0/1863326845 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f300d1140 0x7f4f3015b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:39.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.587+0000 7f4f37fff700 1 --2- 172.21.15.37:0/1863326845 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f4f1406ae30 0x7f4f1406d2e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:39.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.587+0000 7f4f37fff700 1 --2- 172.21.15.37:0/1863326845 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4f301603b0 0x7f4f300c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:39.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.587+0000 7f4f37fff700 1 --2- 172.21.15.37:0/1863326845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f3015fee0 0x7f4f300c7a00 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:39.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.587+0000 7f4f37fff700 1 -- 172.21.15.37:0/1863326845 >> 172.21.15.37:0/1863326845 conn(0x7f4f3009c1b0 msgr2=0x7f4f30160780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:39.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.587+0000 7f4f37fff700 1 -- 172.21.15.37:0/1863326845 shutdown_connections 2023-07-14T15:58:39.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.587+0000 7f4f37fff700 1 -- 172.21.15.37:0/1863326845 wait complete. 2023-07-14T15:58:39.589 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-14T15:58:39.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.810+0000 7fe0105ff700 1 Processor -- start 2023-07-14T15:58:39.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.810+0000 7fe0105ff700 1 -- start start 2023-07-14T15:58:39.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.811+0000 7fe0105ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe0080b0ae0 0x7fe0080cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:39.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.811+0000 7fe0105ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0080cdb50 con 0x7fe0080d15c0 2023-07-14T15:58:39.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.811+0000 7fe0105ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0080cde30 con 0x7fe0080b8900 2023-07-14T15:58:39.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.811+0000 7fe0105ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe00815d030 con 0x7fe0080b0ae0 2023-07-14T15:58:39.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.811+0000 7fe00eb9c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe0080b0ae0 0x7fe0080cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:39.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.811+0000 7fe00db9a700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe0080d15c0 0x7fe0080cebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52582/0 (socket says 172.21.15.37:52582) 2023-07-14T15:58:39.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.811+0000 7fe00db9a700 1 -- 172.21.15.37:0/942704892 learned_addr learned my addr 172.21.15.37:0/942704892 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:58:39.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.812+0000 7fe00d399700 1 -- 172.21.15.37:0/942704892 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2221334412 0 0) 0x7fe0080cdb50 con 0x7fe0080d15c0 2023-07-14T15:58:39.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.812+0000 7fe00eb9c700 1 -- 172.21.15.37:0/942704892 >> v1:172.21.15.98:6789/0 conn(0x7fe0080b8900 legacy=0x7fe0080d0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:39.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.812+0000 7fe00eb9c700 1 -- 172.21.15.37:0/942704892 >> v1:172.21.15.37:6789/0 conn(0x7fe0080d15c0 legacy=0x7fe0080cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:39.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.812+0000 7fe00eb9c700 1 -- 172.21.15.37:0/942704892 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0080ce110 con 0x7fe0080b0ae0 2023-07-14T15:58:39.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.812+0000 7fe00eb9c700 1 --2- 172.21.15.37:0/942704892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0080b0ae0 0x7fe0080cd570 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fe000009d90 tx=0x7fe00000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd37df5b4975323b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:39.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.812+0000 7fe00d399700 1 -- 172.21.15.37:0/942704892 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00000e070 con 0x7fe0080b0ae0 2023-07-14T15:58:39.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.812+0000 7fe00d399700 1 -- 172.21.15.37:0/942704892 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00000bbd0 con 0x7fe0080b0ae0 2023-07-14T15:58:39.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.812+0000 7fe00d399700 1 -- 172.21.15.37:0/942704892 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe000012430 con 0x7fe0080b0ae0 2023-07-14T15:58:39.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.813+0000 7fe0105ff700 1 -- 172.21.15.37:0/942704892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0080b0ae0 msgr2=0x7fe0080cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:39.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.813+0000 7fe0105ff700 1 --2- 172.21.15.37:0/942704892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0080b0ae0 0x7fe0080cd570 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fe000009d90 tx=0x7fe00000b330 comp rx=0 tx=0).stop 2023-07-14T15:58:39.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.813+0000 7fe0105ff700 1 -- 172.21.15.37:0/942704892 shutdown_connections 2023-07-14T15:58:39.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.813+0000 7fe0105ff700 1 --2- 172.21.15.37:0/942704892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0080b0ae0 0x7fe0080cd570 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:39.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.813+0000 7fe0105ff700 1 -- 172.21.15.37:0/942704892 >> 172.21.15.37:0/942704892 conn(0x7fe00809c1e0 msgr2=0x7fe0080d2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:39.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.813+0000 7fe0105ff700 1 -- 172.21.15.37:0/942704892 shutdown_connections 2023-07-14T15:58:39.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.813+0000 7fe0105ff700 1 -- 172.21.15.37:0/942704892 wait complete. 2023-07-14T15:58:39.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.815+0000 7fe0105ff700 1 Processor -- start 2023-07-14T15:58:39.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.815+0000 7fe0105ff700 1 -- start start 2023-07-14T15:58:39.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.816+0000 7fe0105ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe0080b0ae0 0x7fe0080caf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:39.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.816+0000 7fe0105ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0080b8900 0x7fe0080b3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:39.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.816+0000 7fe0105ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0080d15c0 0x7fe0080b4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:39.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.816+0000 7fe0105ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0080b4870 con 0x7fe0080b8900 2023-07-14T15:58:39.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.816+0000 7fe0105ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0080b4640 con 0x7fe0080d15c0 2023-07-14T15:58:39.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.816+0000 7fe0105ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0080caac0 con 0x7fe0080b0ae0 2023-07-14T15:58:39.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.817+0000 7fe00db9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0080b8900 0x7fe0080b3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:39.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.817+0000 7fe00db9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0080b8900 0x7fe0080b3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40632/0 (socket says 172.21.15.37:40632) 2023-07-14T15:58:39.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.817+0000 7fe00db9a700 1 -- 172.21.15.37:0/211399965 learned_addr learned my addr 172.21.15.37:0/211399965 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:39.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.817+0000 7fe00eb9c700 1 --2- 172.21.15.37:0/211399965 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0080d15c0 0x7fe0080b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:39.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.817+0000 7fe00e39b700 1 --2- 172.21.15.37:0/211399965 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe0080b0ae0 0x7fe0080caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:39.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.817+0000 7fe00db9a700 1 -- 172.21.15.37:0/211399965 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe0080b0ae0 msgr2=0x7fe0080caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:39.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.817+0000 7fe00db9a700 1 --2- 172.21.15.37:0/211399965 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe0080b0ae0 0x7fe0080caf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:39.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.817+0000 7fe00db9a700 1 -- 172.21.15.37:0/211399965 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0080d15c0 msgr2=0x7fe0080b4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:39.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.817+0000 7fe00db9a700 1 --2- 172.21.15.37:0/211399965 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0080d15c0 0x7fe0080b4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:39.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.817+0000 7fe00db9a700 1 -- 172.21.15.37:0/211399965 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe000009a70 con 0x7fe0080b8900 2023-07-14T15:58:39.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.817+0000 7fe00e39b700 1 --2- 172.21.15.37:0/211399965 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe0080b0ae0 0x7fe0080caf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:58:39.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.817+0000 7fe00db9a700 1 --2- 172.21.15.37:0/211399965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0080b8900 0x7fe0080b3660 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fdff800c450 tx=0x7fdff800c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:39.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.818+0000 7fdffeffd700 1 -- 172.21.15.37:0/211399965 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff8004c80 con 0x7fe0080b8900 2023-07-14T15:58:39.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.818+0000 7fdffeffd700 1 -- 172.21.15.37:0/211399965 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff8004e00 con 0x7fe0080b8900 2023-07-14T15:58:39.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.818+0000 7fdffeffd700 1 -- 172.21.15.37:0/211399965 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff8007310 con 0x7fe0080b8900 2023-07-14T15:58:39.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.818+0000 7fe0105ff700 1 -- 172.21.15.37:0/211399965 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0080ca190 con 0x7fe0080b8900 2023-07-14T15:58:39.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.818+0000 7fe0105ff700 1 -- 172.21.15.37:0/211399965 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0080ca750 con 0x7fe0080b8900 2023-07-14T15:58:39.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.819+0000 7fe0105ff700 1 -- 172.21.15.37:0/211399965 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0080cac70 con 0x7fe0080b8900 2023-07-14T15:58:39.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.820+0000 7fdffeffd700 1 -- 172.21.15.37:0/211399965 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fdff8007470 con 0x7fe0080b8900 2023-07-14T15:58:39.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.821+0000 7fdffeffd700 1 --2- 172.21.15.37:0/211399965 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fdfec06ae00 0x7fdfec06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:39.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.821+0000 7fdffeffd700 1 -- 172.21.15.37:0/211399965 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6118+0+0 (secure 0 0 0) 0x7fdff8089280 con 0x7fe0080b8900 2023-07-14T15:58:39.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.821+0000 7fe00e39b700 1 --2- 172.21.15.37:0/211399965 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fdfec06ae00 0x7fdfec06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:39.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.822+0000 7fe00e39b700 1 --2- 172.21.15.37:0/211399965 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fdfec06ae00 0x7fdfec06d2b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe004000fb0 tx=0x7fe004009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:39.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:39.825+0000 7fdffeffd700 1 -- 172.21.15.37:0/211399965 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe0080cac70 con 0x7fe0080b8900 2023-07-14T15:58:40.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.052+0000 7fe0105ff700 1 -- 172.21.15.37:0/211399965 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe0080cac30 con 0x7fe0080b8900 2023-07-14T15:58:40.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.052+0000 7fdffeffd700 1 -- 172.21.15.37:0/211399965 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v50) v1 ==== 80+0+0 (secure 0 0 0) 0x7fdff8054140 con 0x7fe0080b8900 2023-07-14T15:58:40.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.055+0000 7fe0105ff700 1 -- 172.21.15.37:0/211399965 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fdfec06ae00 msgr2=0x7fdfec06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:40.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.055+0000 7fe0105ff700 1 --2- 172.21.15.37:0/211399965 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fdfec06ae00 0x7fdfec06d2b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe004000fb0 tx=0x7fe004009040 comp rx=0 tx=0).stop 2023-07-14T15:58:40.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.055+0000 7fe0105ff700 1 -- 172.21.15.37:0/211399965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0080b8900 msgr2=0x7fe0080b3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:40.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.055+0000 7fe0105ff700 1 --2- 172.21.15.37:0/211399965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0080b8900 0x7fe0080b3660 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fdff800c450 tx=0x7fdff800c760 comp rx=0 tx=0).stop 2023-07-14T15:58:40.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.055+0000 7fe0105ff700 1 -- 172.21.15.37:0/211399965 shutdown_connections 2023-07-14T15:58:40.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.055+0000 7fe0105ff700 1 --2- 172.21.15.37:0/211399965 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0080d15c0 0x7fe0080b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:40.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.055+0000 7fe0105ff700 1 --2- 172.21.15.37:0/211399965 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fdfec06ae00 0x7fdfec06d2b0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:40.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.055+0000 7fe0105ff700 1 --2- 172.21.15.37:0/211399965 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fe0080b0ae0 0x7fe0080caf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:40.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.055+0000 7fe0105ff700 1 --2- 172.21.15.37:0/211399965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0080b8900 0x7fe0080b3660 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:40.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.055+0000 7fe0105ff700 1 -- 172.21.15.37:0/211399965 >> 172.21.15.37:0/211399965 conn(0x7fe00809c1e0 msgr2=0x7fe0080d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:40.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.055+0000 7fe0105ff700 1 -- 172.21.15.37:0/211399965 shutdown_connections 2023-07-14T15:58:40.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.055+0000 7fe0105ff700 1 -- 172.21.15.37:0/211399965 wait complete. 2023-07-14T15:58:40.043 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2023-07-14T15:58:40.057 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-14T15:58:40.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:58:40.058 DEBUG:teuthology.orchestra.run.smithi098:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-07-14T15:58:40.155 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi098.front.sepia.ceph.com 2023-07-14T15:58:40.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:58:40.157 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-14T15:58:40.203 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-14T15:58:40.203 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T15:58:40.247 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348708k,nr_inodes=4087177,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=34,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275628k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-07-14T15:58:40.248 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-14T15:58:40.248 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T15:58:40.294 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345608k,nr_inodes=4086402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275008k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-07-14T15:58:40.295 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T15:58:40.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.512+0000 7ff7fbbff700 1 Processor -- start 2023-07-14T15:58:40.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.512+0000 7ff7fbbff700 1 -- start start 2023-07-14T15:58:40.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.514+0000 7ff7fbbff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff7f40b85f0 0x7ff7f415d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:40.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.514+0000 7ff7fbbff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7f40cf6b0 con 0x7ff7f40b4910 2023-07-14T15:58:40.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.514+0000 7ff7fbbff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7f40cdc40 con 0x7ff7f40b54b0 2023-07-14T15:58:40.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.514+0000 7ff7fbbff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f415dba0 con 0x7ff7f40b85f0 2023-07-14T15:58:40.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.514+0000 7ff7fa19c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff7f40b4910 0x7ff7f415dda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:49866/0 (socket says 172.21.15.37:49866) 2023-07-14T15:58:40.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.514+0000 7ff7fa19c700 1 -- 172.21.15.37:0/36075285 learned_addr learned my addr 172.21.15.37:0/36075285 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:58:40.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.514+0000 7ff7f999b700 1 --2- 172.21.15.37:0/36075285 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff7f40b85f0 0x7ff7f415d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:40.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.514+0000 7ff7f8999700 1 -- 172.21.15.37:0/36075285 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1606670567 0 0) 0x7ff7f40cf6b0 con 0x7ff7f40b4910 2023-07-14T15:58:40.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.514+0000 7ff7f8999700 1 -- 172.21.15.37:0/36075285 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7e00035b0 con 0x7ff7f40b4910 2023-07-14T15:58:40.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.515+0000 7ff7f8999700 1 -- 172.21.15.37:0/36075285 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2421481385 0 0) 0x7ff7f40cdc40 con 0x7ff7f40b54b0 2023-07-14T15:58:40.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.515+0000 7ff7f999b700 1 -- 172.21.15.37:0/36075285 >> v1:172.21.15.98:6789/0 conn(0x7ff7f40b54b0 legacy=0x7ff7f40cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:40.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.515+0000 7ff7f999b700 1 -- 172.21.15.37:0/36075285 >> v1:172.21.15.37:6789/0 conn(0x7ff7f40b4910 legacy=0x7ff7f415dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:40.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.515+0000 7ff7f999b700 1 -- 172.21.15.37:0/36075285 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f40d0250 con 0x7ff7f40b85f0 2023-07-14T15:58:40.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.515+0000 7ff7f999b700 1 --2- 172.21.15.37:0/36075285 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff7f40b85f0 0x7ff7f415d660 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0009870 tx=0x7ff7f0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1aa20f9ca0fe7a3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:40.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.515+0000 7ff7f8999700 1 -- 172.21.15.37:0/36075285 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f0011830 con 0x7ff7f40b85f0 2023-07-14T15:58:40.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.515+0000 7ff7f8999700 1 -- 172.21.15.37:0/36075285 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f0011990 con 0x7ff7f40b85f0 2023-07-14T15:58:40.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.515+0000 7ff7f8999700 1 -- 172.21.15.37:0/36075285 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f0011d20 con 0x7ff7f40b85f0 2023-07-14T15:58:40.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.516+0000 7ff7fbbff700 1 -- 172.21.15.37:0/36075285 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff7f40b85f0 msgr2=0x7ff7f415d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:40.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.516+0000 7ff7fbbff700 1 --2- 172.21.15.37:0/36075285 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff7f40b85f0 0x7ff7f415d660 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0009870 tx=0x7ff7f0009b80 comp rx=0 tx=0).stop 2023-07-14T15:58:40.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.516+0000 7ff7fbbff700 1 -- 172.21.15.37:0/36075285 shutdown_connections 2023-07-14T15:58:40.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.516+0000 7ff7fbbff700 1 --2- 172.21.15.37:0/36075285 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff7f40b85f0 0x7ff7f415d660 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:40.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.516+0000 7ff7fbbff700 1 -- 172.21.15.37:0/36075285 >> 172.21.15.37:0/36075285 conn(0x7ff7f406a580 msgr2=0x7ff7f406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:40.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.516+0000 7ff7fbbff700 1 -- 172.21.15.37:0/36075285 shutdown_connections 2023-07-14T15:58:40.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.516+0000 7ff7fbbff700 1 -- 172.21.15.37:0/36075285 wait complete. 2023-07-14T15:58:40.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.518+0000 7ff7fbbff700 1 Processor -- start 2023-07-14T15:58:40.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.518+0000 7ff7fbbff700 1 -- start start 2023-07-14T15:58:40.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.519+0000 7ff7fbbff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7f40b4910 0x7ff7f41552c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:40.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.519+0000 7ff7fbbff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff7f40b54b0 0x7ff7f4157920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:40.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.519+0000 7ff7fbbff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7f40b85f0 0x7ff7f40cbb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:40.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.519+0000 7ff7fbbff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f4157e60 con 0x7ff7f40b85f0 2023-07-14T15:58:40.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.519+0000 7ff7fbbff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f4156880 con 0x7ff7f40b4910 2023-07-14T15:58:40.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.519+0000 7ff7fbbff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f4156b60 con 0x7ff7f40b54b0 2023-07-14T15:58:40.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.519+0000 7ff7fa19c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7f40b85f0 0x7ff7f40cbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:40.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.519+0000 7ff7fa19c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7f40b85f0 0x7ff7f40cbb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41368/0 (socket says 172.21.15.37:41368) 2023-07-14T15:58:40.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.519+0000 7ff7fa19c700 1 -- 172.21.15.37:0/1743908593 learned_addr learned my addr 172.21.15.37:0/1743908593 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:40.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.519+0000 7ff7f999b700 1 --2- 172.21.15.37:0/1743908593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7f40b4910 0x7ff7f41552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:40.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.519+0000 7ff7f919a700 1 --2- 172.21.15.37:0/1743908593 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff7f40b54b0 0x7ff7f4157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:40.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.519+0000 7ff7fa19c700 1 -- 172.21.15.37:0/1743908593 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff7f40b54b0 msgr2=0x7ff7f4157920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:40.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.519+0000 7ff7fa19c700 1 --2- 172.21.15.37:0/1743908593 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff7f40b54b0 0x7ff7f4157920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:40.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.519+0000 7ff7fa19c700 1 -- 172.21.15.37:0/1743908593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7f40b4910 msgr2=0x7ff7f41552c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:40.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.519+0000 7ff7fa19c700 1 --2- 172.21.15.37:0/1743908593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7f40b4910 0x7ff7f41552c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:40.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.519+0000 7ff7fa19c700 1 -- 172.21.15.37:0/1743908593 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f00094a0 con 0x7ff7f40b85f0 2023-07-14T15:58:40.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.520+0000 7ff7fa19c700 1 --2- 172.21.15.37:0/1743908593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7f40b85f0 0x7ff7f40cbb40 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec00cb40 tx=0x7ff7ec00ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:40.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.520+0000 7ff7ea7fc700 1 -- 172.21.15.37:0/1743908593 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ec00aaa0 con 0x7ff7f40b85f0 2023-07-14T15:58:40.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.520+0000 7ff7ea7fc700 1 -- 172.21.15.37:0/1743908593 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7ec00ac00 con 0x7ff7f40b85f0 2023-07-14T15:58:40.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.520+0000 7ff7ea7fc700 1 -- 172.21.15.37:0/1743908593 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ec012400 con 0x7ff7f40b85f0 2023-07-14T15:58:40.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.520+0000 7ff7fbbff700 1 -- 172.21.15.37:0/1743908593 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7f4156e40 con 0x7ff7f40b85f0 2023-07-14T15:58:40.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.520+0000 7ff7fbbff700 1 -- 172.21.15.37:0/1743908593 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7f4157400 con 0x7ff7f40b85f0 2023-07-14T15:58:40.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.521+0000 7ff7fbbff700 1 -- 172.21.15.37:0/1743908593 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7f4157620 con 0x7ff7f40b85f0 2023-07-14T15:58:40.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.522+0000 7ff7ea7fc700 1 -- 172.21.15.37:0/1743908593 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7ff7ec01b3b0 con 0x7ff7f40b85f0 2023-07-14T15:58:40.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.523+0000 7ff7ea7fc700 1 --2- 172.21.15.37:0/1743908593 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff7d806ae00 0x7ff7d806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:40.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.523+0000 7ff7ea7fc700 1 -- 172.21.15.37:0/1743908593 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6118+0+0 (secure 0 0 0) 0x7ff7ec089420 con 0x7ff7f40b85f0 2023-07-14T15:58:40.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.523+0000 7ff7f999b700 1 --2- 172.21.15.37:0/1743908593 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff7d806ae00 0x7ff7d806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:40.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.524+0000 7ff7f999b700 1 --2- 172.21.15.37:0/1743908593 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff7d806ae00 0x7ff7d806d2b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff7f00097c0 tx=0x7ff7f001c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:40.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.527+0000 7ff7ea7fc700 1 -- 172.21.15.37:0/1743908593 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff7ec0542e0 con 0x7ff7f40b85f0 2023-07-14T15:58:40.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.780+0000 7ff7fbbff700 1 -- 172.21.15.37:0/1743908593 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff7f4067840 con 0x7ff7f40b85f0 2023-07-14T15:58:40.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.781+0000 7ff7ea7fc700 1 -- 172.21.15.37:0/1743908593 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4709 (secure 0 0 0) 0x7ff7ec057900 con 0x7ff7f40b85f0 2023-07-14T15:58:40.765 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:58:40.766 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5132,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/1552421235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":1552421235},{"type":"v1","addr":"172.21.15.98:6837","nonce":1552421235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5135,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/4269801846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4269801846},{"type":"v1","addr":"172.21.15.37:6833","nonce":4269801846}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5470,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/3115632546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":3115632546},{"type":"v1","addr":"172.21.15.98:6835","nonce":3115632546}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T15:58:08.228046+0000","modified":"2023-07-14T15:58:11.751169+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5652":{"gid":5652,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/4236968434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":4236968434},{"type":"v1","addr":"172.21.15.37:6835","nonce":4236968434}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-14T15:58:40.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.783+0000 7ff7fbbff700 1 -- 172.21.15.37:0/1743908593 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff7d806ae00 msgr2=0x7ff7d806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:40.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.783+0000 7ff7fbbff700 1 --2- 172.21.15.37:0/1743908593 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff7d806ae00 0x7ff7d806d2b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff7f00097c0 tx=0x7ff7f001c040 comp rx=0 tx=0).stop 2023-07-14T15:58:40.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.783+0000 7ff7fbbff700 1 -- 172.21.15.37:0/1743908593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7f40b85f0 msgr2=0x7ff7f40cbb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:40.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.783+0000 7ff7fbbff700 1 --2- 172.21.15.37:0/1743908593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7f40b85f0 0x7ff7f40cbb40 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec00cb40 tx=0x7ff7ec00ce50 comp rx=0 tx=0).stop 2023-07-14T15:58:40.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.783+0000 7ff7fbbff700 1 -- 172.21.15.37:0/1743908593 shutdown_connections 2023-07-14T15:58:40.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.783+0000 7ff7fbbff700 1 --2- 172.21.15.37:0/1743908593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7f40b4910 0x7ff7f41552c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:40.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.783+0000 7ff7fbbff700 1 --2- 172.21.15.37:0/1743908593 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7ff7d806ae00 0x7ff7d806d2b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:40.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.783+0000 7ff7fbbff700 1 --2- 172.21.15.37:0/1743908593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7f40b85f0 0x7ff7f40cbb40 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:40.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.783+0000 7ff7fbbff700 1 --2- 172.21.15.37:0/1743908593 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7ff7f40b54b0 0x7ff7f4157920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:40.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.783+0000 7ff7fbbff700 1 -- 172.21.15.37:0/1743908593 >> 172.21.15.37:0/1743908593 conn(0x7ff7f406a580 msgr2=0x7ff7f40b6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:40.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.783+0000 7ff7fbbff700 1 -- 172.21.15.37:0/1743908593 shutdown_connections 2023-07-14T15:58:40.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:40.784+0000 7ff7fbbff700 1 -- 172.21.15.37:0/1743908593 wait complete. 2023-07-14T15:58:40.770 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 26 2023-07-14T15:58:40.786 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T15:58:40.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.005+0000 7f0f6f9ff700 1 Processor -- start 2023-07-14T15:58:40.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.006+0000 7f0f6f9ff700 1 -- start start 2023-07-14T15:58:40.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.007+0000 7f0f6f9ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0f680b85f0 0x7f0f6815d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:40.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.007+0000 7f0f6f9ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0f680b54b0 0x7f0f680cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:40.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.007+0000 7f0f6f9ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f0f680b4910 0x7f0f680b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:40.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.007+0000 7f0f6f9ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f680b52d0 con 0x7f0f680b85f0 2023-07-14T15:58:40.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.007+0000 7f0f6f9ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f680cf6b0 con 0x7f0f680b4910 2023-07-14T15:58:40.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.007+0000 7f0f6f9ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f680cdc40 con 0x7f0f680b54b0 2023-07-14T15:58:40.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.007+0000 7f0f6d79b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0f680b85f0 0x7f0f6815d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:40.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.007+0000 7f0f6d79b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0f680b85f0 0x7f0f6815d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41370/0 (socket says 172.21.15.37:41370) 2023-07-14T15:58:40.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.007+0000 7f0f6d79b700 1 -- 172.21.15.37:0/1209213731 learned_addr learned my addr 172.21.15.37:0/1209213731 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:40.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.007+0000 7f0f6df9c700 1 --2- 172.21.15.37:0/1209213731 >> v2:172.21.15.98:3300/0 conn(0x7f0f680b4910 0x7f0f680b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:40.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.007+0000 7f0f6cf9a700 1 --2- 172.21.15.37:0/1209213731 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0f680b54b0 0x7f0f680cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:40.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.007+0000 7f0f6d79b700 1 -- 172.21.15.37:0/1209213731 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0f680b54b0 msgr2=0x7f0f680cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:40.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.007+0000 7f0f6d79b700 1 --2- 172.21.15.37:0/1209213731 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0f680b54b0 0x7f0f680cfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:40.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.007+0000 7f0f6d79b700 1 -- 172.21.15.37:0/1209213731 >> v2:172.21.15.98:3300/0 conn(0x7f0f680b4910 msgr2=0x7f0f680b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:40.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.007+0000 7f0f6d79b700 1 --2- 172.21.15.37:0/1209213731 >> v2:172.21.15.98:3300/0 conn(0x7f0f680b4910 0x7f0f680b4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:40.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.007+0000 7f0f6d79b700 1 -- 172.21.15.37:0/1209213731 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f6815dba0 con 0x7f0f680b85f0 2023-07-14T15:58:40.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.008+0000 7f0f6d79b700 1 --2- 172.21.15.37:0/1209213731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f680b85f0 0x7f0f6815d660 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f0f680cd470 tx=0x7f0f64009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7827089934b0cc5d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:40.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.008+0000 7f0f5ffff700 1 -- 172.21.15.37:0/1209213731 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6400b870 con 0x7f0f680b85f0 2023-07-14T15:58:40.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.008+0000 7f0f5ffff700 1 -- 172.21.15.37:0/1209213731 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f6400b9d0 con 0x7f0f680b85f0 2023-07-14T15:58:40.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.008+0000 7f0f5ffff700 1 -- 172.21.15.37:0/1209213731 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6400bd60 con 0x7f0f680b85f0 2023-07-14T15:58:40.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.008+0000 7f0f6f9ff700 1 -- 172.21.15.37:0/1209213731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f680b85f0 msgr2=0x7f0f6815d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:40.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.008+0000 7f0f6f9ff700 1 --2- 172.21.15.37:0/1209213731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f680b85f0 0x7f0f6815d660 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f0f680cd470 tx=0x7f0f64009bd0 comp rx=0 tx=0).stop 2023-07-14T15:58:40.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.009+0000 7f0f6f9ff700 1 -- 172.21.15.37:0/1209213731 shutdown_connections 2023-07-14T15:58:40.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.009+0000 7f0f6f9ff700 1 --2- 172.21.15.37:0/1209213731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f680b85f0 0x7f0f6815d660 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:40.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.009+0000 7f0f6f9ff700 1 --2- 172.21.15.37:0/1209213731 >> v2:172.21.15.98:3300/0 conn(0x7f0f680b4910 0x7f0f680b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:40.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.009+0000 7f0f6f9ff700 1 --2- 172.21.15.37:0/1209213731 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0f680b54b0 0x7f0f680cfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:40.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.009+0000 7f0f6f9ff700 1 -- 172.21.15.37:0/1209213731 >> 172.21.15.37:0/1209213731 conn(0x7f0f6806a580 msgr2=0x7f0f6806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:40.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.009+0000 7f0f6f9ff700 1 -- 172.21.15.37:0/1209213731 shutdown_connections 2023-07-14T15:58:41.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.009+0000 7f0f6f9ff700 1 -- 172.21.15.37:0/1209213731 wait complete. 2023-07-14T15:58:41.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.010+0000 7f0f6f9ff700 1 Processor -- start 2023-07-14T15:58:41.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.011+0000 7f0f6f9ff700 1 -- start start 2023-07-14T15:58:41.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.012+0000 7f0f6f9ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f680b4910 0x7f0f680cbef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:41.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.012+0000 7f0f6f9ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f680b54b0 0x7f0f6814acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:41.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.012+0000 7f0f6f9ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0f680b85f0 0x7f0f68160450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:41.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.012+0000 7f0f6f9ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f680c8840 con 0x7f0f680b4910 2023-07-14T15:58:41.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.012+0000 7f0f6f9ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f680c7c30 con 0x7f0f680b54b0 2023-07-14T15:58:41.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.012+0000 7f0f6f9ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f680c7f10 con 0x7f0f680b85f0 2023-07-14T15:58:41.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.012+0000 7f0f6d79b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f680b4910 0x7f0f680cbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:41.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.012+0000 7f0f6d79b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f680b4910 0x7f0f680cbef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41376/0 (socket says 172.21.15.37:41376) 2023-07-14T15:58:41.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.012+0000 7f0f6d79b700 1 -- 172.21.15.37:0/2703381306 learned_addr learned my addr 172.21.15.37:0/2703381306 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:41.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.012+0000 7f0f6cf9a700 1 --2- 172.21.15.37:0/2703381306 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f680b54b0 0x7f0f6814acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:41.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.012+0000 7f0f6df9c700 1 --2- 172.21.15.37:0/2703381306 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0f680b85f0 0x7f0f68160450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:41.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.012+0000 7f0f6d79b700 1 -- 172.21.15.37:0/2703381306 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0f680b85f0 msgr2=0x7f0f68160450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:41.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.012+0000 7f0f6d79b700 1 --2- 172.21.15.37:0/2703381306 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0f680b85f0 0x7f0f68160450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:41.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.012+0000 7f0f6d79b700 1 -- 172.21.15.37:0/2703381306 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f680b54b0 msgr2=0x7f0f6814acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:41.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.012+0000 7f0f6d79b700 1 --2- 172.21.15.37:0/2703381306 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f680b54b0 0x7f0f6814acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:41.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.012+0000 7f0f6d79b700 1 -- 172.21.15.37:0/2703381306 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f64009550 con 0x7f0f680b4910 2023-07-14T15:58:41.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.012+0000 7f0f6df9c700 1 --2- 172.21.15.37:0/2703381306 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0f680b85f0 0x7f0f68160450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:58:41.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.012+0000 7f0f6cf9a700 1 --2- 172.21.15.37:0/2703381306 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f680b54b0 0x7f0f6814acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:58:41.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.012+0000 7f0f6d79b700 1 --2- 172.21.15.37:0/2703381306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f680b4910 0x7f0f680cbef0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f0f64000c00 tx=0x7f0f64004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:41.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.013+0000 7f0f5dffb700 1 -- 172.21.15.37:0/2703381306 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f64004540 con 0x7f0f680b4910 2023-07-14T15:58:41.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.013+0000 7f0f5dffb700 1 -- 172.21.15.37:0/2703381306 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f640036a0 con 0x7f0f680b4910 2023-07-14T15:58:41.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.013+0000 7f0f5dffb700 1 -- 172.21.15.37:0/2703381306 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f64003a50 con 0x7f0f680b4910 2023-07-14T15:58:41.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.013+0000 7f0f6f9ff700 1 -- 172.21.15.37:0/2703381306 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f680c81f0 con 0x7f0f680b4910 2023-07-14T15:58:41.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.013+0000 7f0f6f9ff700 1 -- 172.21.15.37:0/2703381306 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f6815e000 con 0x7f0f680b4910 2023-07-14T15:58:41.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.014+0000 7f0f6f9ff700 1 -- 172.21.15.37:0/2703381306 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f68067840 con 0x7f0f680b4910 2023-07-14T15:58:41.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.015+0000 7f0f5dffb700 1 -- 172.21.15.37:0/2703381306 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f0f64021070 con 0x7f0f680b4910 2023-07-14T15:58:41.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.016+0000 7f0f5dffb700 1 --2- 172.21.15.37:0/2703381306 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0f4c06ae00 0x7f0f4c06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:41.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.016+0000 7f0f5dffb700 1 -- 172.21.15.37:0/2703381306 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f0f6408ad60 con 0x7f0f680b4910 2023-07-14T15:58:41.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.016+0000 7f0f6cf9a700 1 --2- 172.21.15.37:0/2703381306 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0f4c06ae00 0x7f0f4c06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:41.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.017+0000 7f0f6cf9a700 1 --2- 172.21.15.37:0/2703381306 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0f4c06ae00 0x7f0f4c06d2b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0f6815a400 tx=0x7f0f58008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:41.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.020+0000 7f0f5dffb700 1 -- 172.21.15.37:0/2703381306 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0f64055cb0 con 0x7f0f680b4910 2023-07-14T15:58:41.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.228+0000 7f0f6f9ff700 1 -- 172.21.15.37:0/2703381306 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0f680b46f0 con 0x7f0f680b4910 2023-07-14T15:58:41.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.230+0000 7f0f5dffb700 1 -- 172.21.15.37:0/2703381306 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+18389 (secure 0 0 0) 0x7f0f64015090 con 0x7f0f680b4910 2023-07-14T15:58:41.215 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:58:41.215 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":50,"fsid":"9da30401-a779-4e46-aba6-00c2494c6c67","created":"2023-07-14T15:55:39.898867+0000","modified":"2023-07-14T15:58:37.955658+0000","last_up_change":"2023-07-14T15:55:53.025696+0000","last_in_change":"2023-07-14T15:55:43.388192+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T15:55:52.907261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T15:55:59.992839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-14T15:58:05.947379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-14T15:58:07.213413+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":50,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d049535-7b87-4276-8fe5-0f74ba422d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6801","nonce":2783032392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6803","nonce":2783032392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6807","nonce":2783032392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6805","nonce":2783032392}]},"public_addr":"172.21.15.37:6801/2783032392","cluster_addr":"172.21.15.37:6803/2783032392","heartbeat_back_addr":"172.21.15.37:6807/2783032392","heartbeat_front_addr":"172.21.15.37:6805/2783032392","state":["exists","up"]},{"osd":1,"uuid":"79ec948d-ead2-4c2d-923a-dd6eeaac9dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6823","nonce":1190059746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6826","nonce":1190059746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6831","nonce":1190059746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6829","nonce":1190059746}]},"public_addr":"172.21.15.37:6823/1190059746","cluster_addr":"172.21.15.37:6826/1190059746","heartbeat_back_addr":"172.21.15.37:6831/1190059746","heartbeat_front_addr":"172.21.15.37:6829/1190059746","state":["exists","up"]},{"osd":2,"uuid":"a1db6690-c160-4366-9c82-2cca17e4bba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6809","nonce":2266223499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6813","nonce":2266223499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6820","nonce":2266223499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6816","nonce":2266223499}]},"public_addr":"172.21.15.37:6809/2266223499","cluster_addr":"172.21.15.37:6813/2266223499","heartbeat_back_addr":"172.21.15.37:6820/2266223499","heartbeat_front_addr":"172.21.15.37:6816/2266223499","state":["exists","up"]},{"osd":3,"uuid":"767b8220-e79a-4a86-a162-6b3b73198379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6812","nonce":4166694594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6817","nonce":4166694594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6828","nonce":4166694594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6822","nonce":4166694594}]},"public_addr":"172.21.15.37:6812/4166694594","cluster_addr":"172.21.15.37:6817/4166694594","heartbeat_back_addr":"172.21.15.37:6828/4166694594","heartbeat_front_addr":"172.21.15.37:6822/4166694594","state":["exists","up"]},{"osd":4,"uuid":"717bd773-ae7e-4236-ac79-900cf99a37c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6801","nonce":3529020407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6803","nonce":3529020407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6807","nonce":3529020407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6805","nonce":3529020407}]},"public_addr":"172.21.15.98:6801/3529020407","cluster_addr":"172.21.15.98:6803/3529020407","heartbeat_back_addr":"172.21.15.98:6807/3529020407","heartbeat_front_addr":"172.21.15.98:6805/3529020407","state":["exists","up"]},{"osd":5,"uuid":"a941d358-0f03-4136-a9b2-3a1c2e9358cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6817","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6819","nonce":2311501838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6821","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6823","nonce":2311501838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6829","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6831","nonce":2311501838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6825","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6827","nonce":2311501838}]},"public_addr":"172.21.15.98:6819/2311501838","cluster_addr":"172.21.15.98:6823/2311501838","heartbeat_back_addr":"172.21.15.98:6831/2311501838","heartbeat_front_addr":"172.21.15.98:6827/2311501838","state":["exists","up"]},{"osd":6,"uuid":"27153772-6d4b-479d-9953-0582e7b96743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6809","nonce":1144224691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6811","nonce":1144224691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6815","nonce":1144224691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6813","nonce":1144224691}]},"public_addr":"172.21.15.98:6809/1144224691","cluster_addr":"172.21.15.98:6811/1144224691","heartbeat_back_addr":"172.21.15.98:6815/1144224691","heartbeat_front_addr":"172.21.15.98:6813/1144224691","state":["exists","up"]},{"osd":7,"uuid":"d21ffc8e-40bb-47eb-af2c-e3e730d3fb76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6818","nonce":1144470927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6822","nonce":1144470927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6830","nonce":1144470927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6826","nonce":1144470927}]},"public_addr":"172.21.15.98:6818/1144470927","cluster_addr":"172.21.15.98:6822/1144470927","heartbeat_back_addr":"172.21.15.98:6830/1144470927","heartbeat_front_addr":"172.21.15.98:6826/1144470927","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.921114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.739210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.024016+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.002527+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.698127+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.813416+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.709351+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.815457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":8,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T15:58:41.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.232+0000 7f0f6f9ff700 1 -- 172.21.15.37:0/2703381306 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0f4c06ae00 msgr2=0x7f0f4c06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:41.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.232+0000 7f0f6f9ff700 1 --2- 172.21.15.37:0/2703381306 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0f4c06ae00 0x7f0f4c06d2b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0f6815a400 tx=0x7f0f58008040 comp rx=0 tx=0).stop 2023-07-14T15:58:41.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.232+0000 7f0f6f9ff700 1 -- 172.21.15.37:0/2703381306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f680b4910 msgr2=0x7f0f680cbef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:41.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.232+0000 7f0f6f9ff700 1 --2- 172.21.15.37:0/2703381306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f680b4910 0x7f0f680cbef0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f0f64000c00 tx=0x7f0f64004750 comp rx=0 tx=0).stop 2023-07-14T15:58:41.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.232+0000 7f0f6f9ff700 1 -- 172.21.15.37:0/2703381306 shutdown_connections 2023-07-14T15:58:41.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.232+0000 7f0f6f9ff700 1 --2- 172.21.15.37:0/2703381306 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f0f4c06ae00 0x7f0f4c06d2b0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:41.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.232+0000 7f0f6f9ff700 1 --2- 172.21.15.37:0/2703381306 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f0f680b85f0 0x7f0f68160450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:41.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.232+0000 7f0f6f9ff700 1 --2- 172.21.15.37:0/2703381306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f680b4910 0x7f0f680cbef0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:41.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.232+0000 7f0f6f9ff700 1 --2- 172.21.15.37:0/2703381306 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f680b54b0 0x7f0f6814acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:41.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.232+0000 7f0f6f9ff700 1 -- 172.21.15.37:0/2703381306 >> 172.21.15.37:0/2703381306 conn(0x7f0f6806a580 msgr2=0x7f0f6815d250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:41.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.232+0000 7f0f6f9ff700 1 -- 172.21.15.37:0/2703381306 shutdown_connections 2023-07-14T15:58:41.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.232+0000 7f0f6f9ff700 1 -- 172.21.15.37:0/2703381306 wait complete. 2023-07-14T15:58:41.235 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T15:55:52.907261+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T15:55:59.992839+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T15:58:05.947379+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T15:58:07.213413+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 50, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T15:58:41.237 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T15:58:41.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.457+0000 7fd55b1ff700 1 Processor -- start 2023-07-14T15:58:41.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.458+0000 7fd55b1ff700 1 -- start start 2023-07-14T15:58:41.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.459+0000 7fd55b1ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd5540b11d0 0x7fd5540d2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:41.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.459+0000 7fd55b1ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5540b1840 con 0x7fd5540b1e80 2023-07-14T15:58:41.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.459+0000 7fd55b1ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5540b2550 con 0x7fd5540cfd50 2023-07-14T15:58:41.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.459+0000 7fd55b1ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd55415ccf0 con 0x7fd5540b11d0 2023-07-14T15:58:41.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.459+0000 7fd553fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd5540b1e80 0x7fd5540b0ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:49872/0 (socket says 172.21.15.37:49872) 2023-07-14T15:58:41.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.459+0000 7fd553fff700 1 -- 172.21.15.37:0/3877202722 learned_addr learned my addr 172.21.15.37:0/3877202722 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:58:41.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.459+0000 7fd55979c700 1 --2- 172.21.15.37:0/3877202722 >> v2:172.21.15.37:3300/0 conn(0x7fd5540b11d0 0x7fd5540d2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:41.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.460+0000 7fd55979c700 1 -- 172.21.15.37:0/3877202722 >> v1:172.21.15.98:6789/0 conn(0x7fd5540cfd50 legacy=0x7fd5540b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:41.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.460+0000 7fd55979c700 1 -- 172.21.15.37:0/3877202722 >> v1:172.21.15.37:6789/0 conn(0x7fd5540b1e80 legacy=0x7fd5540b0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:41.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.460+0000 7fd55979c700 1 -- 172.21.15.37:0/3877202722 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5540b2830 con 0x7fd5540b11d0 2023-07-14T15:58:41.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.460+0000 7fd55979c700 1 --2- 172.21.15.37:0/3877202722 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5540b11d0 0x7fd5540d2880 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fd54c009d90 tx=0x7fd54c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf0a86681bd524dc server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:41.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.460+0000 7fd5537fe700 1 -- 172.21.15.37:0/3877202722 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c00e070 con 0x7fd5540b11d0 2023-07-14T15:58:41.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.460+0000 7fd5537fe700 1 -- 172.21.15.37:0/3877202722 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54c00bbd0 con 0x7fd5540b11d0 2023-07-14T15:58:41.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.460+0000 7fd5537fe700 1 -- 172.21.15.37:0/3877202722 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c012430 con 0x7fd5540b11d0 2023-07-14T15:58:41.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.461+0000 7fd55b1ff700 1 -- 172.21.15.37:0/3877202722 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5540b11d0 msgr2=0x7fd5540d2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:41.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.461+0000 7fd55b1ff700 1 --2- 172.21.15.37:0/3877202722 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5540b11d0 0x7fd5540d2880 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fd54c009d90 tx=0x7fd54c00b330 comp rx=0 tx=0).stop 2023-07-14T15:58:41.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.461+0000 7fd55b1ff700 1 -- 172.21.15.37:0/3877202722 shutdown_connections 2023-07-14T15:58:41.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.461+0000 7fd55b1ff700 1 --2- 172.21.15.37:0/3877202722 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5540b11d0 0x7fd5540d2880 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:41.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.461+0000 7fd55b1ff700 1 -- 172.21.15.37:0/3877202722 >> 172.21.15.37:0/3877202722 conn(0x7fd55409c1c0 msgr2=0x7fd5540d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:41.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.461+0000 7fd55b1ff700 1 -- 172.21.15.37:0/3877202722 shutdown_connections 2023-07-14T15:58:41.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.461+0000 7fd55b1ff700 1 -- 172.21.15.37:0/3877202722 wait complete. 2023-07-14T15:58:41.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.463+0000 7fd55b1ff700 1 Processor -- start 2023-07-14T15:58:41.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.463+0000 7fd55b1ff700 1 -- start start 2023-07-14T15:58:41.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.465+0000 7fd55b1ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5540b11d0 0x7fd5541f1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:41.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.465+0000 7fd55b1ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd5540b1e80 0x7fd5540c6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:41.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.465+0000 7fd55b1ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5540cfd50 0x7fd554158950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:41.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.465+0000 7fd55b1ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5541f2380 con 0x7fd5540b11d0 2023-07-14T15:58:41.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.465+0000 7fd55b1ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5540c7260 con 0x7fd5540cfd50 2023-07-14T15:58:41.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.465+0000 7fd55b1ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5540c7540 con 0x7fd5540b1e80 2023-07-14T15:58:41.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.465+0000 7fd558f9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5540b11d0 0x7fd5541f1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:41.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.465+0000 7fd558f9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5540b11d0 0x7fd5541f1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41388/0 (socket says 172.21.15.37:41388) 2023-07-14T15:58:41.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.465+0000 7fd558f9b700 1 -- 172.21.15.37:0/1991634897 learned_addr learned my addr 172.21.15.37:0/1991634897 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:41.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.465+0000 7fd55979c700 1 --2- 172.21.15.37:0/1991634897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5540cfd50 0x7fd554158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:41.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.465+0000 7fd553fff700 1 --2- 172.21.15.37:0/1991634897 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd5540b1e80 0x7fd5540c6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:41.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.465+0000 7fd558f9b700 1 -- 172.21.15.37:0/1991634897 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd5540b1e80 msgr2=0x7fd5540c6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:41.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.465+0000 7fd558f9b700 1 --2- 172.21.15.37:0/1991634897 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd5540b1e80 0x7fd5540c6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:41.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.465+0000 7fd558f9b700 1 -- 172.21.15.37:0/1991634897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5540cfd50 msgr2=0x7fd554158950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:41.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.465+0000 7fd558f9b700 1 --2- 172.21.15.37:0/1991634897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5540cfd50 0x7fd554158950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:41.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.465+0000 7fd558f9b700 1 -- 172.21.15.37:0/1991634897 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd54c009a70 con 0x7fd5540b11d0 2023-07-14T15:58:41.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.466+0000 7fd558f9b700 1 --2- 172.21.15.37:0/1991634897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5540b11d0 0x7fd5541f1e40 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd54800c450 tx=0x7fd54800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:41.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.466+0000 7fd5517fa700 1 -- 172.21.15.37:0/1991634897 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5480052d0 con 0x7fd5540b11d0 2023-07-14T15:58:41.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.466+0000 7fd5517fa700 1 -- 172.21.15.37:0/1991634897 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd548005430 con 0x7fd5540b11d0 2023-07-14T15:58:41.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.466+0000 7fd5517fa700 1 -- 172.21.15.37:0/1991634897 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5480038c0 con 0x7fd5540b11d0 2023-07-14T15:58:41.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.466+0000 7fd55b1ff700 1 -- 172.21.15.37:0/1991634897 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5540d02a0 con 0x7fd5540b11d0 2023-07-14T15:58:41.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.466+0000 7fd55b1ff700 1 -- 172.21.15.37:0/1991634897 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5540c7b00 con 0x7fd5540b11d0 2023-07-14T15:58:41.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.467+0000 7fd55b1ff700 1 -- 172.21.15.37:0/1991634897 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd554067840 con 0x7fd5540b11d0 2023-07-14T15:58:41.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.468+0000 7fd5517fa700 1 -- 172.21.15.37:0/1991634897 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fd548003a20 con 0x7fd5540b11d0 2023-07-14T15:58:41.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.469+0000 7fd5517fa700 1 --2- 172.21.15.37:0/1991634897 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd53806ae00 0x7fd53806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:41.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.469+0000 7fd5517fa700 1 -- 172.21.15.37:0/1991634897 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6118+0+0 (secure 0 0 0) 0x7fd548088a80 con 0x7fd5540b11d0 2023-07-14T15:58:41.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.470+0000 7fd553fff700 1 --2- 172.21.15.37:0/1991634897 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd53806ae00 0x7fd53806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:41.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.470+0000 7fd553fff700 1 --2- 172.21.15.37:0/1991634897 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd53806ae00 0x7fd53806d2b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd540005910 tx=0x7fd540009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:41.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.473+0000 7fd5517fa700 1 -- 172.21.15.37:0/1991634897 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd548053940 con 0x7fd5540b11d0 2023-07-14T15:58:41.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.679+0000 7fd55b1ff700 1 -- 172.21.15.37:0/1991634897 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd5540d1bc0 con 0x7fd5540b11d0 2023-07-14T15:58:41.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.679+0000 7fd5517fa700 1 -- 172.21.15.37:0/1991634897 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd548056f60 con 0x7fd5540b11d0 2023-07-14T15:58:41.664 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-14T15:58:41.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.682+0000 7fd55b1ff700 1 -- 172.21.15.37:0/1991634897 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd53806ae00 msgr2=0x7fd53806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:41.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.682+0000 7fd55b1ff700 1 --2- 172.21.15.37:0/1991634897 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd53806ae00 0x7fd53806d2b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd540005910 tx=0x7fd540009040 comp rx=0 tx=0).stop 2023-07-14T15:58:41.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.682+0000 7fd55b1ff700 1 -- 172.21.15.37:0/1991634897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5540b11d0 msgr2=0x7fd5541f1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:41.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.682+0000 7fd55b1ff700 1 --2- 172.21.15.37:0/1991634897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5540b11d0 0x7fd5541f1e40 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd54800c450 tx=0x7fd54800c810 comp rx=0 tx=0).stop 2023-07-14T15:58:41.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.682+0000 7fd55b1ff700 1 -- 172.21.15.37:0/1991634897 shutdown_connections 2023-07-14T15:58:41.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.682+0000 7fd55b1ff700 1 --2- 172.21.15.37:0/1991634897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5540cfd50 0x7fd554158950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:41.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.682+0000 7fd55b1ff700 1 --2- 172.21.15.37:0/1991634897 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd53806ae00 0x7fd53806d2b0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:41.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.682+0000 7fd55b1ff700 1 --2- 172.21.15.37:0/1991634897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5540b11d0 0x7fd5541f1e40 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:41.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.682+0000 7fd55b1ff700 1 --2- 172.21.15.37:0/1991634897 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd5540b1e80 0x7fd5540c6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:41.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.682+0000 7fd55b1ff700 1 -- 172.21.15.37:0/1991634897 >> 172.21.15.37:0/1991634897 conn(0x7fd55409c1c0 msgr2=0x7fd55406b100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:41.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.682+0000 7fd55b1ff700 1 -- 172.21.15.37:0/1991634897 shutdown_connections 2023-07-14T15:58:41.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.682+0000 7fd55b1ff700 1 -- 172.21.15.37:0/1991634897 wait complete. 2023-07-14T15:58:41.684 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T15:58:41.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.904+0000 7f1f1ddff700 1 Processor -- start 2023-07-14T15:58:41.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.905+0000 7f1f1ddff700 1 -- start start 2023-07-14T15:58:41.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.906+0000 7f1f1ddff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1f180cfd50 0x7f1f180d2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:41.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.906+0000 7f1f1ddff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f1f180b1e80 0x7f1f180b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:41.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.906+0000 7f1f1ddff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1f180b3290 0x7f1f180b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:41.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.906+0000 7f1f1ddff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f1815ccf0 con 0x7f1f180cfd50 2023-07-14T15:58:41.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.906+0000 7f1f1ddff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f180b1840 con 0x7f1f180b3290 2023-07-14T15:58:41.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.906+0000 7f1f1ddff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f180b2550 con 0x7f1f180b1e80 2023-07-14T15:58:41.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.906+0000 7f1f177fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1f180cfd50 0x7f1f180d2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:41.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.906+0000 7f1f177fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1f180cfd50 0x7f1f180d2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41404/0 (socket says 172.21.15.37:41404) 2023-07-14T15:58:41.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.906+0000 7f1f177fe700 1 -- 172.21.15.37:0/3849758031 learned_addr learned my addr 172.21.15.37:0/3849758031 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:41.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.906+0000 7f1f16ffd700 1 --2- 172.21.15.37:0/3849758031 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f1f180b1e80 0x7f1f180b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:41.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.906+0000 7f1f17fff700 1 --2- 172.21.15.37:0/3849758031 >> v2:172.21.15.98:3300/0 conn(0x7f1f180b3290 0x7f1f180b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:41.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.907+0000 7f1f177fe700 1 -- 172.21.15.37:0/3849758031 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f1f180b1e80 msgr2=0x7f1f180b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:41.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.907+0000 7f1f177fe700 1 --2- 172.21.15.37:0/3849758031 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f1f180b1e80 0x7f1f180b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:41.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.907+0000 7f1f177fe700 1 -- 172.21.15.37:0/3849758031 >> v2:172.21.15.98:3300/0 conn(0x7f1f180b3290 msgr2=0x7f1f180b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:41.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.907+0000 7f1f177fe700 1 --2- 172.21.15.37:0/3849758031 >> v2:172.21.15.98:3300/0 conn(0x7f1f180b3290 0x7f1f180b36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:41.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.907+0000 7f1f177fe700 1 -- 172.21.15.37:0/3849758031 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f180b2830 con 0x7f1f180cfd50 2023-07-14T15:58:41.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.907+0000 7f1f16ffd700 1 --2- 172.21.15.37:0/3849758031 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f1f180b1e80 0x7f1f180b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:58:41.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.907+0000 7f1f177fe700 1 --2- 172.21.15.37:0/3849758031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f180cfd50 0x7f1f180d2880 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f1f18066b40 tx=0x7f1f08009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55eb408db80ab1c7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:41.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.907+0000 7f1f167fc700 1 -- 172.21.15.37:0/3849758031 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0800b870 con 0x7f1f180cfd50 2023-07-14T15:58:41.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.907+0000 7f1f167fc700 1 -- 172.21.15.37:0/3849758031 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f0800b9d0 con 0x7f1f180cfd50 2023-07-14T15:58:41.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.907+0000 7f1f167fc700 1 -- 172.21.15.37:0/3849758031 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0800bd60 con 0x7f1f180cfd50 2023-07-14T15:58:41.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.908+0000 7f1f1ddff700 1 -- 172.21.15.37:0/3849758031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f180cfd50 msgr2=0x7f1f180d2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:41.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.908+0000 7f1f1ddff700 1 --2- 172.21.15.37:0/3849758031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f180cfd50 0x7f1f180d2880 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f1f18066b40 tx=0x7f1f08009bd0 comp rx=0 tx=0).stop 2023-07-14T15:58:41.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.908+0000 7f1f1ddff700 1 -- 172.21.15.37:0/3849758031 shutdown_connections 2023-07-14T15:58:41.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.908+0000 7f1f1ddff700 1 --2- 172.21.15.37:0/3849758031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f180cfd50 0x7f1f180d2880 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:41.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.908+0000 7f1f1ddff700 1 --2- 172.21.15.37:0/3849758031 >> v2:172.21.15.98:3300/0 conn(0x7f1f180b3290 0x7f1f180b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:41.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.908+0000 7f1f1ddff700 1 --2- 172.21.15.37:0/3849758031 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f1f180b1e80 0x7f1f180b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:41.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.908+0000 7f1f1ddff700 1 -- 172.21.15.37:0/3849758031 >> 172.21.15.37:0/3849758031 conn(0x7f1f1809c1c0 msgr2=0x7f1f180d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:41.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.908+0000 7f1f1ddff700 1 -- 172.21.15.37:0/3849758031 shutdown_connections 2023-07-14T15:58:41.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.908+0000 7f1f1ddff700 1 -- 172.21.15.37:0/3849758031 wait complete. 2023-07-14T15:58:41.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.910+0000 7f1f1ddff700 1 Processor -- start 2023-07-14T15:58:41.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.910+0000 7f1f1ddff700 1 -- start start 2023-07-14T15:58:41.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.911+0000 7f1f1ddff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f180b1e80 0x7f1f181553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:41.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.911+0000 7f1f1ddff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f180b3290 0x7f1f180b7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:41.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.911+0000 7f1f1ddff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f1f180cfd50 0x7f1f180b7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:41.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.911+0000 7f1f1ddff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f180c6960 con 0x7f1f180b1e80 2023-07-14T15:58:41.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.911+0000 7f1f1ddff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f180b69a0 con 0x7f1f180b3290 2023-07-14T15:58:41.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.911+0000 7f1f1ddff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f180b6c80 con 0x7f1f180cfd50 2023-07-14T15:58:41.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.911+0000 7f1f177fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f180b1e80 0x7f1f181553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:41.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.911+0000 7f1f177fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f180b1e80 0x7f1f181553b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41420/0 (socket says 172.21.15.37:41420) 2023-07-14T15:58:41.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.911+0000 7f1f177fe700 1 -- 172.21.15.37:0/209238918 learned_addr learned my addr 172.21.15.37:0/209238918 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:41.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.911+0000 7f1f177fe700 1 -- 172.21.15.37:0/209238918 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f1f180cfd50 msgr2=0x7f1f180b7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:41.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.911+0000 7f1f177fe700 1 --2- 172.21.15.37:0/209238918 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f1f180cfd50 0x7f1f180b7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:41.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.911+0000 7f1f177fe700 1 -- 172.21.15.37:0/209238918 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f180b3290 msgr2=0x7f1f180b7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:41.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.911+0000 7f1f177fe700 1 --2- 172.21.15.37:0/209238918 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f180b3290 0x7f1f180b7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:41.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.911+0000 7f1f177fe700 1 -- 172.21.15.37:0/209238918 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f08009550 con 0x7f1f180b1e80 2023-07-14T15:58:41.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.912+0000 7f1f177fe700 1 --2- 172.21.15.37:0/209238918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f180b1e80 0x7f1f181553b0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f1f08000c00 tx=0x7f1f08004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:41.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.912+0000 7f1efffff700 1 -- 172.21.15.37:0/209238918 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f08004520 con 0x7f1f180b1e80 2023-07-14T15:58:41.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.912+0000 7f1efffff700 1 -- 172.21.15.37:0/209238918 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f0801e070 con 0x7f1f180b1e80 2023-07-14T15:58:41.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.912+0000 7f1efffff700 1 -- 172.21.15.37:0/209238918 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f080038c0 con 0x7f1f180b1e80 2023-07-14T15:58:41.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.912+0000 7f1f1ddff700 1 -- 172.21.15.37:0/209238918 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f180d02a0 con 0x7f1f180b1e80 2023-07-14T15:58:41.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.912+0000 7f1f1ddff700 1 -- 172.21.15.37:0/209238918 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f180c6f00 con 0x7f1f180b1e80 2023-07-14T15:58:41.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.913+0000 7f1f1ddff700 1 -- 172.21.15.37:0/209238918 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f18067840 con 0x7f1f180b1e80 2023-07-14T15:58:41.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.914+0000 7f1efffff700 1 -- 172.21.15.37:0/209238918 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f1f08003a20 con 0x7f1f180b1e80 2023-07-14T15:58:41.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.915+0000 7f1efffff700 1 --2- 172.21.15.37:0/209238918 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f1f0406ae00 0x7f1f0406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:41.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.915+0000 7f1efffff700 1 -- 172.21.15.37:0/209238918 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f1f08020070 con 0x7f1f180b1e80 2023-07-14T15:58:41.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.916+0000 7f1f16ffd700 1 --2- 172.21.15.37:0/209238918 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f1f0406ae00 0x7f1f0406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:41.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.916+0000 7f1f16ffd700 1 --2- 172.21.15.37:0/209238918 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f1f0406ae00 0x7f1f0406d2b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c006fd0 tx=0x7f1f0c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:41.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:41.919+0000 7f1efffff700 1 -- 172.21.15.37:0/209238918 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1f08055b40 con 0x7f1f180b1e80 2023-07-14T15:58:42.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.127+0000 7f1f1ddff700 1 -- 172.21.15.37:0/209238918 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1f1815c940 con 0x7f1f180b1e80 2023-07-14T15:58:42.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.128+0000 7f1efffff700 1 -- 172.21.15.37:0/209238918 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v50) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1f0802a020 con 0x7f1f180b1e80 2023-07-14T15:58:42.112 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-14T15:58:42.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.130+0000 7f1f1ddff700 1 -- 172.21.15.37:0/209238918 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f1f0406ae00 msgr2=0x7f1f0406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:42.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.130+0000 7f1f1ddff700 1 --2- 172.21.15.37:0/209238918 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f1f0406ae00 0x7f1f0406d2b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c006fd0 tx=0x7f1f0c008040 comp rx=0 tx=0).stop 2023-07-14T15:58:42.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.130+0000 7f1f1ddff700 1 -- 172.21.15.37:0/209238918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f180b1e80 msgr2=0x7f1f181553b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:42.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.130+0000 7f1f1ddff700 1 --2- 172.21.15.37:0/209238918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f180b1e80 0x7f1f181553b0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f1f08000c00 tx=0x7f1f08004750 comp rx=0 tx=0).stop 2023-07-14T15:58:42.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.130+0000 7f1f1ddff700 1 -- 172.21.15.37:0/209238918 shutdown_connections 2023-07-14T15:58:42.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.130+0000 7f1f1ddff700 1 --2- 172.21.15.37:0/209238918 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f1f0406ae00 0x7f1f0406d2b0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:42.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.130+0000 7f1f1ddff700 1 --2- 172.21.15.37:0/209238918 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f1f180cfd50 0x7f1f180b7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:42.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.130+0000 7f1f1ddff700 1 --2- 172.21.15.37:0/209238918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f180b1e80 0x7f1f181553b0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:42.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.130+0000 7f1f1ddff700 1 --2- 172.21.15.37:0/209238918 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f180b3290 0x7f1f180b7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:42.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.130+0000 7f1f1ddff700 1 -- 172.21.15.37:0/209238918 >> 172.21.15.37:0/209238918 conn(0x7f1f1809c1c0 msgr2=0x7f1f180d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:42.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.130+0000 7f1f1ddff700 1 -- 172.21.15.37:0/209238918 shutdown_connections 2023-07-14T15:58:42.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.130+0000 7f1f1ddff700 1 -- 172.21.15.37:0/209238918 wait complete. 2023-07-14T15:58:42.133 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T15:58:42.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.353+0000 7f450d5ff700 1 Processor -- start 2023-07-14T15:58:42.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.354+0000 7f450d5ff700 1 -- start start 2023-07-14T15:58:42.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.355+0000 7f450d5ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f45080b8750 0x7f45080cd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:42.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.355+0000 7f450d5ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4508160190 0x7f4508160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:42.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.355+0000 7f450d5ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45080d0b30 con 0x7f4508160b70 2023-07-14T15:58:42.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.355+0000 7f450d5ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45080cdd00 con 0x7f45080b8750 2023-07-14T15:58:42.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.355+0000 7f450d5ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4508160ff0 con 0x7f4508160190 2023-07-14T15:58:42.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.355+0000 7f4506ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f45080b8750 0x7f45080cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:42.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.355+0000 7f4506ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f45080b8750 0x7f45080cd520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41428/0 (socket says 172.21.15.37:41428) 2023-07-14T15:58:42.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.355+0000 7f4506ffd700 1 -- 172.21.15.37:0/4045694434 learned_addr learned my addr 172.21.15.37:0/4045694434 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:42.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.355+0000 7f44fffff700 1 --2- 172.21.15.37:0/4045694434 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4508160190 0x7f4508160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:42.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.356+0000 7f4506ffd700 1 -- 172.21.15.37:0/4045694434 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4508160190 msgr2=0x7f4508160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:42.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.356+0000 7f4506ffd700 1 --2- 172.21.15.37:0/4045694434 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4508160190 0x7f4508160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:42.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.356+0000 7f4506ffd700 1 -- 172.21.15.37:0/4045694434 >> v1:172.21.15.98:6789/0 conn(0x7f4508160b70 legacy=0x7f45080cf300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:42.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.356+0000 7f4506ffd700 1 -- 172.21.15.37:0/4045694434 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45080b8b20 con 0x7f45080b8750 2023-07-14T15:58:42.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.356+0000 7f4506ffd700 1 --2- 172.21.15.37:0/4045694434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45080b8750 0x7f45080cd520 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f44f80098f0 tx=0x7f44f8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73d5dbadeb3d495c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:42.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.356+0000 7f45067fc700 1 -- 172.21.15.37:0/4045694434 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f8011830 con 0x7f45080b8750 2023-07-14T15:58:42.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.356+0000 7f45067fc700 1 -- 172.21.15.37:0/4045694434 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f8011990 con 0x7f45080b8750 2023-07-14T15:58:42.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.356+0000 7f45067fc700 1 -- 172.21.15.37:0/4045694434 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f8011d20 con 0x7f45080b8750 2023-07-14T15:58:42.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.357+0000 7f450d5ff700 1 -- 172.21.15.37:0/4045694434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45080b8750 msgr2=0x7f45080cd520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:42.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.357+0000 7f450d5ff700 1 --2- 172.21.15.37:0/4045694434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45080b8750 0x7f45080cd520 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f44f80098f0 tx=0x7f44f8009c00 comp rx=0 tx=0).stop 2023-07-14T15:58:42.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.357+0000 7f450d5ff700 1 -- 172.21.15.37:0/4045694434 shutdown_connections 2023-07-14T15:58:42.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.357+0000 7f450d5ff700 1 --2- 172.21.15.37:0/4045694434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45080b8750 0x7f45080cd520 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:42.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.357+0000 7f450d5ff700 1 --2- 172.21.15.37:0/4045694434 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4508160190 0x7f4508160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:42.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.357+0000 7f450d5ff700 1 -- 172.21.15.37:0/4045694434 >> 172.21.15.37:0/4045694434 conn(0x7f450806c0b0 msgr2=0x7f450806c480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:42.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.357+0000 7f450d5ff700 1 -- 172.21.15.37:0/4045694434 shutdown_connections 2023-07-14T15:58:42.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.357+0000 7f450d5ff700 1 -- 172.21.15.37:0/4045694434 wait complete. 2023-07-14T15:58:42.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.359+0000 7f450d5ff700 1 Processor -- start 2023-07-14T15:58:42.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.359+0000 7f450d5ff700 1 -- start start 2023-07-14T15:58:42.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.360+0000 7f450d5ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45080b8750 0x7f450814ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:42.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.360+0000 7f450d5ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4508160190 0x7f45080aec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:42.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.360+0000 7f450d5ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4508160b70 0x7f45080af180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:42.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.360+0000 7f450d5ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45081f2cc0 con 0x7f45080b8750 2023-07-14T15:58:42.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.360+0000 7f450d5ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45081f6760 con 0x7f4508160b70 2023-07-14T15:58:42.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.360+0000 7f450d5ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45081f2390 con 0x7f4508160190 2023-07-14T15:58:42.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.360+0000 7f4506ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45080b8750 0x7f450814ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:42.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.360+0000 7f4506ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45080b8750 0x7f450814ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41436/0 (socket says 172.21.15.37:41436) 2023-07-14T15:58:42.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.360+0000 7f4506ffd700 1 -- 172.21.15.37:0/333998064 learned_addr learned my addr 172.21.15.37:0/333998064 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:42.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.360+0000 7f44fffff700 1 --2- 172.21.15.37:0/333998064 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4508160190 0x7f45080aec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:42.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.360+0000 7f45077fe700 1 --2- 172.21.15.37:0/333998064 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4508160b70 0x7f45080af180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:42.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.360+0000 7f4506ffd700 1 -- 172.21.15.37:0/333998064 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4508160190 msgr2=0x7f45080aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:42.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.360+0000 7f4506ffd700 1 --2- 172.21.15.37:0/333998064 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4508160190 0x7f45080aec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:42.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.360+0000 7f4506ffd700 1 -- 172.21.15.37:0/333998064 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4508160b70 msgr2=0x7f45080af180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:42.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.360+0000 7f4506ffd700 1 --2- 172.21.15.37:0/333998064 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4508160b70 0x7f45080af180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:42.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.360+0000 7f4506ffd700 1 -- 172.21.15.37:0/333998064 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f8009550 con 0x7f45080b8750 2023-07-14T15:58:42.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.360+0000 7f45077fe700 1 --2- 172.21.15.37:0/333998064 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4508160b70 0x7f45080af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:58:42.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.361+0000 7f4506ffd700 1 --2- 172.21.15.37:0/333998064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45080b8750 0x7f450814ecb0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f44f8000c00 tx=0x7f44f8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:42.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.361+0000 7f44ff7fe700 1 -- 172.21.15.37:0/333998064 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f8004570 con 0x7f45080b8750 2023-07-14T15:58:42.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.361+0000 7f44ff7fe700 1 -- 172.21.15.37:0/333998064 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f801f070 con 0x7f45080b8750 2023-07-14T15:58:42.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.361+0000 7f44ff7fe700 1 -- 172.21.15.37:0/333998064 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f80038c0 con 0x7f45080b8750 2023-07-14T15:58:42.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.361+0000 7f450d5ff700 1 -- 172.21.15.37:0/333998064 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45081f2670 con 0x7f45080b8750 2023-07-14T15:58:42.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.361+0000 7f450d5ff700 1 -- 172.21.15.37:0/333998064 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45081f3150 con 0x7f45080b8750 2023-07-14T15:58:42.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.362+0000 7f450d5ff700 1 -- 172.21.15.37:0/333998064 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45081f2fa0 con 0x7f45080b8750 2023-07-14T15:58:42.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.363+0000 7f44ff7fe700 1 -- 172.21.15.37:0/333998064 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f44f8021030 con 0x7f45080b8750 2023-07-14T15:58:42.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.364+0000 7f44ff7fe700 1 --2- 172.21.15.37:0/333998064 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f44e806ae30 0x7f44e806d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:42.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.364+0000 7f44ff7fe700 1 -- 172.21.15.37:0/333998064 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f44f808aa60 con 0x7f45080b8750 2023-07-14T15:58:42.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.364+0000 7f44fffff700 1 --2- 172.21.15.37:0/333998064 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f44e806ae30 0x7f44e806d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:42.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.365+0000 7f44fffff700 1 --2- 172.21.15.37:0/333998064 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f44e806ae30 0x7f44e806d2e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f44f0009b70 tx=0x7f44f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:42.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.368+0000 7f44ff7fe700 1 -- 172.21.15.37:0/333998064 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f44f80559b0 con 0x7f45080b8750 2023-07-14T15:58:42.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.575+0000 7f450d5ff700 1 -- 172.21.15.37:0/333998064 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4508067840 con 0x7f45080b8750 2023-07-14T15:58:42.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.576+0000 7f44ff7fe700 1 -- 172.21.15.37:0/333998064 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v50) v1 ==== 104+0+11 (secure 0 0 0) 0x7f44f8015020 con 0x7f45080b8750 2023-07-14T15:58:42.560 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-14T15:58:42.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.578+0000 7f450d5ff700 1 -- 172.21.15.37:0/333998064 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f44e806ae30 msgr2=0x7f44e806d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:42.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.578+0000 7f450d5ff700 1 --2- 172.21.15.37:0/333998064 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f44e806ae30 0x7f44e806d2e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f44f0009b70 tx=0x7f44f0008040 comp rx=0 tx=0).stop 2023-07-14T15:58:42.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.578+0000 7f450d5ff700 1 -- 172.21.15.37:0/333998064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45080b8750 msgr2=0x7f450814ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:42.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.578+0000 7f450d5ff700 1 --2- 172.21.15.37:0/333998064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45080b8750 0x7f450814ecb0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f44f8000c00 tx=0x7f44f8004750 comp rx=0 tx=0).stop 2023-07-14T15:58:42.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.578+0000 7f450d5ff700 1 -- 172.21.15.37:0/333998064 shutdown_connections 2023-07-14T15:58:42.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.578+0000 7f450d5ff700 1 --2- 172.21.15.37:0/333998064 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4508160b70 0x7f45080af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:42.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.578+0000 7f450d5ff700 1 --2- 172.21.15.37:0/333998064 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f44e806ae30 0x7f44e806d2e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:42.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.578+0000 7f450d5ff700 1 --2- 172.21.15.37:0/333998064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45080b8750 0x7f450814ecb0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:42.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.578+0000 7f450d5ff700 1 --2- 172.21.15.37:0/333998064 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f4508160190 0x7f45080aec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:42.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.578+0000 7f450d5ff700 1 -- 172.21.15.37:0/333998064 >> 172.21.15.37:0/333998064 conn(0x7f450806c0b0 msgr2=0x7f45080d2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:42.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.578+0000 7f450d5ff700 1 -- 172.21.15.37:0/333998064 shutdown_connections 2023-07-14T15:58:42.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.578+0000 7f450d5ff700 1 -- 172.21.15.37:0/333998064 wait complete. 2023-07-14T15:58:42.581 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T15:58:42.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.802+0000 7fb8a1fff700 1 Processor -- start 2023-07-14T15:58:42.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.803+0000 7fb8a1fff700 1 -- start start 2023-07-14T15:58:42.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.804+0000 7fb8a1fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb89c0cfd50 0x7fb89c0d2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:42.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.804+0000 7fb8a1fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb89c0b0ac0 0x7fb89c0b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:42.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.804+0000 7fb8a1fff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb89c0b1840 con 0x7fb89c0b1e80 2023-07-14T15:58:42.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.804+0000 7fb8a1fff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb89c15ccf0 con 0x7fb89c0b0ac0 2023-07-14T15:58:42.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.804+0000 7fb8a1fff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb89c0b2550 con 0x7fb89c0cfd50 2023-07-14T15:58:42.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.804+0000 7fb893fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb89c0b1e80 0x7fb89c0b2d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:49874/0 (socket says 172.21.15.37:49874) 2023-07-14T15:58:42.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.804+0000 7fb89bfff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb89c0b0ac0 0x7fb89c0b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:42.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.804+0000 7fb893fff700 1 -- 172.21.15.37:0/3912754445 learned_addr learned my addr 172.21.15.37:0/3912754445 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:58:42.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.804+0000 7fb89b7fe700 1 --2- 172.21.15.37:0/3912754445 >> v2:172.21.15.98:3300/0 conn(0x7fb89c0cfd50 0x7fb89c0d2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:42.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.804+0000 7fb89bfff700 1 -- 172.21.15.37:0/3912754445 >> v2:172.21.15.98:3300/0 conn(0x7fb89c0cfd50 msgr2=0x7fb89c0d2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:42.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.804+0000 7fb89bfff700 1 --2- 172.21.15.37:0/3912754445 >> v2:172.21.15.98:3300/0 conn(0x7fb89c0cfd50 0x7fb89c0d2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:42.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.805+0000 7fb89bfff700 1 -- 172.21.15.37:0/3912754445 >> v1:172.21.15.37:6789/0 conn(0x7fb89c0b1e80 legacy=0x7fb89c0b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:42.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.805+0000 7fb89bfff700 1 -- 172.21.15.37:0/3912754445 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb89c0b2830 con 0x7fb89c0b0ac0 2023-07-14T15:58:42.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.805+0000 7fb89affd700 1 -- 172.21.15.37:0/3912754445 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 563142733 0 0) 0x7fb89c0b1840 con 0x7fb89c0b1e80 2023-07-14T15:58:42.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.805+0000 7fb89bfff700 1 --2- 172.21.15.37:0/3912754445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb89c0b0ac0 0x7fb89c0b0f60 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fb89c08b170 tx=0x7fb89400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ebdc35b9dd2fe31 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:42.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.805+0000 7fb89affd700 1 -- 172.21.15.37:0/3912754445 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89400e070 con 0x7fb89c0b0ac0 2023-07-14T15:58:42.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.805+0000 7fb89affd700 1 -- 172.21.15.37:0/3912754445 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb89400bbd0 con 0x7fb89c0b0ac0 2023-07-14T15:58:42.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.805+0000 7fb89affd700 1 -- 172.21.15.37:0/3912754445 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb894012430 con 0x7fb89c0b0ac0 2023-07-14T15:58:42.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.805+0000 7fb8a1fff700 1 -- 172.21.15.37:0/3912754445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb89c0b0ac0 msgr2=0x7fb89c0b0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:42.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.806+0000 7fb8a1fff700 1 --2- 172.21.15.37:0/3912754445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb89c0b0ac0 0x7fb89c0b0f60 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fb89c08b170 tx=0x7fb89400b330 comp rx=0 tx=0).stop 2023-07-14T15:58:42.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.806+0000 7fb8a1fff700 1 -- 172.21.15.37:0/3912754445 shutdown_connections 2023-07-14T15:58:42.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.806+0000 7fb8a1fff700 1 --2- 172.21.15.37:0/3912754445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb89c0b0ac0 0x7fb89c0b0f60 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:42.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.806+0000 7fb8a1fff700 1 --2- 172.21.15.37:0/3912754445 >> v2:172.21.15.98:3300/0 conn(0x7fb89c0cfd50 0x7fb89c0d2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:42.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.806+0000 7fb8a1fff700 1 -- 172.21.15.37:0/3912754445 >> 172.21.15.37:0/3912754445 conn(0x7fb89c09c1c0 msgr2=0x7fb89c0d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:42.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.806+0000 7fb8a1fff700 1 -- 172.21.15.37:0/3912754445 shutdown_connections 2023-07-14T15:58:42.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.806+0000 7fb8a1fff700 1 -- 172.21.15.37:0/3912754445 wait complete. 2023-07-14T15:58:42.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.808+0000 7fb8a1fff700 1 Processor -- start 2023-07-14T15:58:42.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.808+0000 7fb8a1fff700 1 -- start start 2023-07-14T15:58:42.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.810+0000 7fb8a1fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb89c0b0ac0 0x7fb89c0b2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:42.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.810+0000 7fb8a1fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb89c0b1e80 0x7fb89c1e5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:42.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.810+0000 7fb8a1fff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb89c0cfd50 0x7fb89c0c9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:42.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.810+0000 7fb8a1fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb89c0c8e70 con 0x7fb89c0b1e80 2023-07-14T15:58:42.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.810+0000 7fb8a1fff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb89c0c88a0 con 0x7fb89c0b0ac0 2023-07-14T15:58:42.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.810+0000 7fb8a1fff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb89c0c8b20 con 0x7fb89c0cfd50 2023-07-14T15:58:42.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.810+0000 7fb893fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb89c0b1e80 0x7fb89c1e5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:42.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.810+0000 7fb893fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb89c0b1e80 0x7fb89c1e5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41454/0 (socket says 172.21.15.37:41454) 2023-07-14T15:58:42.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.810+0000 7fb893fff700 1 -- 172.21.15.37:0/2135862042 learned_addr learned my addr 172.21.15.37:0/2135862042 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:42.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.810+0000 7fb89b7fe700 1 --2- 172.21.15.37:0/2135862042 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb89c0b0ac0 0x7fb89c0b2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:42.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.810+0000 7fb89bfff700 1 --2- 172.21.15.37:0/2135862042 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb89c0cfd50 0x7fb89c0c9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:42.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.810+0000 7fb893fff700 1 -- 172.21.15.37:0/2135862042 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb89c0cfd50 msgr2=0x7fb89c0c9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:42.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.810+0000 7fb893fff700 1 --2- 172.21.15.37:0/2135862042 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb89c0cfd50 0x7fb89c0c9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:42.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.810+0000 7fb893fff700 1 -- 172.21.15.37:0/2135862042 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb89c0b0ac0 msgr2=0x7fb89c0b2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:42.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.810+0000 7fb893fff700 1 --2- 172.21.15.37:0/2135862042 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb89c0b0ac0 0x7fb89c0b2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:42.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.810+0000 7fb893fff700 1 -- 172.21.15.37:0/2135862042 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb894009a70 con 0x7fb89c0b1e80 2023-07-14T15:58:42.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.810+0000 7fb89bfff700 1 --2- 172.21.15.37:0/2135862042 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb89c0cfd50 0x7fb89c0c9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:58:42.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.811+0000 7fb893fff700 1 --2- 172.21.15.37:0/2135862042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb89c0b1e80 0x7fb89c1e5210 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fb88400c550 tx=0x7fb88400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:42.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.811+0000 7fb898ff9700 1 -- 172.21.15.37:0/2135862042 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb884004c80 con 0x7fb89c0b1e80 2023-07-14T15:58:42.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.811+0000 7fb898ff9700 1 -- 172.21.15.37:0/2135862042 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb884004e00 con 0x7fb89c0b1e80 2023-07-14T15:58:42.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.811+0000 7fb898ff9700 1 -- 172.21.15.37:0/2135862042 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb884007310 con 0x7fb89c0b1e80 2023-07-14T15:58:42.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.811+0000 7fb8a1fff700 1 -- 172.21.15.37:0/2135862042 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb89c1e4b10 con 0x7fb89c0b1e80 2023-07-14T15:58:42.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.811+0000 7fb8a1fff700 1 -- 172.21.15.37:0/2135862042 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb89c0b3400 con 0x7fb89c0b1e80 2023-07-14T15:58:42.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.812+0000 7fb8a1fff700 1 -- 172.21.15.37:0/2135862042 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb89c1e5030 con 0x7fb89c0b1e80 2023-07-14T15:58:42.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.813+0000 7fb898ff9700 1 -- 172.21.15.37:0/2135862042 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fb884007470 con 0x7fb89c0b1e80 2023-07-14T15:58:42.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.814+0000 7fb898ff9700 1 --2- 172.21.15.37:0/2135862042 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb87c06ae00 0x7fb87c06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:42.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.814+0000 7fb898ff9700 1 -- 172.21.15.37:0/2135862042 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6118+0+0 (secure 0 0 0) 0x7fb884089400 con 0x7fb89c0b1e80 2023-07-14T15:58:42.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.814+0000 7fb89b7fe700 1 --2- 172.21.15.37:0/2135862042 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb87c06ae00 0x7fb87c06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:42.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.815+0000 7fb89b7fe700 1 --2- 172.21.15.37:0/2135862042 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb87c06ae00 0x7fb87c06d2b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb88c006b20 tx=0x7fb88c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:42.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:42.819+0000 7fb898ff9700 1 -- 172.21.15.37:0/2135862042 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb8840542c0 con 0x7fb89c0b1e80 2023-07-14T15:58:43.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.028+0000 7fb8a1fff700 1 -- 172.21.15.37:0/2135862042 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb89c0c8c90 con 0x7fb89c0b1e80 2023-07-14T15:58:43.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.028+0000 7fb898ff9700 1 -- 172.21.15.37:0/2135862042 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v50) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb8840578e0 con 0x7fb89c0b1e80 2023-07-14T15:58:43.013 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-14T15:58:43.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.030+0000 7fb8a1fff700 1 -- 172.21.15.37:0/2135862042 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb87c06ae00 msgr2=0x7fb87c06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:43.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.030+0000 7fb8a1fff700 1 --2- 172.21.15.37:0/2135862042 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb87c06ae00 0x7fb87c06d2b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb88c006b20 tx=0x7fb88c008040 comp rx=0 tx=0).stop 2023-07-14T15:58:43.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.030+0000 7fb8a1fff700 1 -- 172.21.15.37:0/2135862042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb89c0b1e80 msgr2=0x7fb89c1e5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:43.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.030+0000 7fb8a1fff700 1 --2- 172.21.15.37:0/2135862042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb89c0b1e80 0x7fb89c1e5210 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fb88400c550 tx=0x7fb88400c860 comp rx=0 tx=0).stop 2023-07-14T15:58:43.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.031+0000 7fb8a1fff700 1 -- 172.21.15.37:0/2135862042 shutdown_connections 2023-07-14T15:58:43.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.031+0000 7fb8a1fff700 1 --2- 172.21.15.37:0/2135862042 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb89c0b0ac0 0x7fb89c0b2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:43.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.031+0000 7fb8a1fff700 1 --2- 172.21.15.37:0/2135862042 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb87c06ae00 0x7fb87c06d2b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:43.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.031+0000 7fb8a1fff700 1 --2- 172.21.15.37:0/2135862042 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb89c0cfd50 0x7fb89c0c9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:43.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.031+0000 7fb8a1fff700 1 --2- 172.21.15.37:0/2135862042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb89c0b1e80 0x7fb89c1e5210 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:43.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.031+0000 7fb8a1fff700 1 -- 172.21.15.37:0/2135862042 >> 172.21.15.37:0/2135862042 conn(0x7fb89c09c1c0 msgr2=0x7fb89c15c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:43.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.031+0000 7fb8a1fff700 1 -- 172.21.15.37:0/2135862042 shutdown_connections 2023-07-14T15:58:43.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.031+0000 7fb8a1fff700 1 -- 172.21.15.37:0/2135862042 wait complete. 2023-07-14T15:58:43.033 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T15:58:43.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.249+0000 7faeecdff700 1 Processor -- start 2023-07-14T15:58:43.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.250+0000 7faeecdff700 1 -- start start 2023-07-14T15:58:43.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.251+0000 7faeecdff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7faee80b5cf0 0x7faee8160c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:43.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.251+0000 7faeecdff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faee80d0de0 con 0x7faee80cffc0 2023-07-14T15:58:43.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.251+0000 7faeecdff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faee80cd590 con 0x7faee80b8b80 2023-07-14T15:58:43.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.251+0000 7faeecdff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee8161190 con 0x7faee80b5cf0 2023-07-14T15:58:43.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.251+0000 7faedffff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7faee80cffc0 0x7faee80d1270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:49884/0 (socket says 172.21.15.37:49884) 2023-07-14T15:58:43.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.251+0000 7faedffff700 1 -- 172.21.15.37:0/2365212264 learned_addr learned my addr 172.21.15.37:0/2365212264 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:58:43.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.251+0000 7faee6d9d700 1 --2- 172.21.15.37:0/2365212264 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7faee80b5cf0 0x7faee8160c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:43.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.252+0000 7faee5d9b700 1 -- 172.21.15.37:0/2365212264 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 368591465 0 0) 0x7faee80d0de0 con 0x7faee80cffc0 2023-07-14T15:58:43.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.252+0000 7faee5d9b700 1 -- 172.21.15.37:0/2365212264 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faed40035b0 con 0x7faee80cffc0 2023-07-14T15:58:43.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.252+0000 7faee5d9b700 1 -- 172.21.15.37:0/2365212264 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2046845034 0 0) 0x7faee80cd590 con 0x7faee80b8b80 2023-07-14T15:58:43.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.252+0000 7faee5d9b700 1 -- 172.21.15.37:0/2365212264 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faee80d0de0 con 0x7faee80b8b80 2023-07-14T15:58:43.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.252+0000 7faee5d9b700 1 -- 172.21.15.37:0/2365212264 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2571467259 0 0) 0x7faed40035b0 con 0x7faee80cffc0 2023-07-14T15:58:43.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.252+0000 7faee5d9b700 1 -- 172.21.15.37:0/2365212264 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7faee80b5cf0 msgr2=0x7faee8160c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:43.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.252+0000 7faee5d9b700 1 --2- 172.21.15.37:0/2365212264 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7faee80b5cf0 0x7faee8160c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:43.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.252+0000 7faee5d9b700 1 -- 172.21.15.37:0/2365212264 >> v1:172.21.15.98:6789/0 conn(0x7faee80b8b80 legacy=0x7faee80cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:43.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.252+0000 7faee5d9b700 1 -- 172.21.15.37:0/2365212264 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee80cd870 con 0x7faee80cffc0 2023-07-14T15:58:43.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.252+0000 7faee5d9b700 1 -- 172.21.15.37:0/2365212264 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48633207 0 0) 0x7faed0001670 con 0x7faee80cffc0 2023-07-14T15:58:43.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.252+0000 7faee5d9b700 1 -- 172.21.15.37:0/2365212264 >> v1:172.21.15.37:6789/0 conn(0x7faee80cffc0 legacy=0x7faee80d1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:43.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.252+0000 7faee5d9b700 1 --2- 172.21.15.37:0/2365212264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faed4003bc0 0x7faed4003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:43.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.252+0000 7faee5d9b700 1 --2- 172.21.15.37:0/2365212264 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7faee80b5cf0 0x7faed4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:43.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.252+0000 7faee5d9b700 1 --2- 172.21.15.37:0/2365212264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faed4004d90 0x7faed4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:43.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.252+0000 7faee5d9b700 1 -- 172.21.15.37:0/2365212264 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee8161190 con 0x7faed4003bc0 2023-07-14T15:58:43.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.252+0000 7faee5d9b700 1 -- 172.21.15.37:0/2365212264 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed400bac0 con 0x7faed4004d90 2023-07-14T15:58:43.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.252+0000 7faee5d9b700 1 -- 172.21.15.37:0/2365212264 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed400bc30 con 0x7faee80b5cf0 2023-07-14T15:58:43.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.252+0000 7faee659c700 1 --2- 172.21.15.37:0/2365212264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faed4003bc0 0x7faed4003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:43.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.253+0000 7faedffff700 1 --2- 172.21.15.37:0/2365212264 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7faee80b5cf0 0x7faed4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:43.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.253+0000 7faee6d9d700 1 --2- 172.21.15.37:0/2365212264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faed4004d90 0x7faed4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:43.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.253+0000 7faee659c700 1 -- 172.21.15.37:0/2365212264 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7faee80b5cf0 msgr2=0x7faed4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:43.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.253+0000 7faee659c700 1 --2- 172.21.15.37:0/2365212264 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7faee80b5cf0 0x7faed4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:43.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.253+0000 7faee659c700 1 -- 172.21.15.37:0/2365212264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faed4004d90 msgr2=0x7faed4005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:43.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.253+0000 7faee659c700 1 --2- 172.21.15.37:0/2365212264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faed4004d90 0x7faed4005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:43.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.253+0000 7faee659c700 1 -- 172.21.15.37:0/2365212264 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed40035b0 con 0x7faed4003bc0 2023-07-14T15:58:43.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.253+0000 7faee659c700 1 --2- 172.21.15.37:0/2365212264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faed4003bc0 0x7faed4003fb0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7faed8001980 tx=0x7faed4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27e400c0b44b655c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:43.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.253+0000 7faee5d9b700 1 -- 172.21.15.37:0/2365212264 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed8001470 con 0x7faed4003bc0 2023-07-14T15:58:43.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.253+0000 7faee5d9b700 1 -- 172.21.15.37:0/2365212264 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed80052d0 con 0x7faed4003bc0 2023-07-14T15:58:43.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.253+0000 7faee5d9b700 1 -- 172.21.15.37:0/2365212264 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed8003680 con 0x7faed4003bc0 2023-07-14T15:58:43.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.254+0000 7faeecdff700 1 -- 172.21.15.37:0/2365212264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faed4003bc0 msgr2=0x7faed4003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:43.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.254+0000 7faeecdff700 1 --2- 172.21.15.37:0/2365212264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faed4003bc0 0x7faed4003fb0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7faed8001980 tx=0x7faed4005880 comp rx=0 tx=0).stop 2023-07-14T15:58:43.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.254+0000 7faee6d9d700 1 -- 172.21.15.37:0/2365212264 reap_dead start 2023-07-14T15:58:43.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.254+0000 7faeecdff700 1 -- 172.21.15.37:0/2365212264 shutdown_connections 2023-07-14T15:58:43.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.254+0000 7faeecdff700 1 -- 172.21.15.37:0/2365212264 >> 172.21.15.37:0/2365212264 conn(0x7faee806b150 msgr2=0x7faee806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:43.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.254+0000 7faeecdff700 1 -- 172.21.15.37:0/2365212264 shutdown_connections 2023-07-14T15:58:43.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.254+0000 7faeecdff700 1 -- 172.21.15.37:0/2365212264 wait complete. 2023-07-14T15:58:43.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.256+0000 7faeecdff700 1 Processor -- start 2023-07-14T15:58:43.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.256+0000 7faeecdff700 1 -- start start 2023-07-14T15:58:43.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.257+0000 7faeecdff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faed4003bc0 0x7faee80cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:43.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.257+0000 7faeecdff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7faee80b4f90 0x7faee815b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:43.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.257+0000 7faeecdff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faee81f2180 0x7faee80cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:43.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.257+0000 7faeecdff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee80b57e0 con 0x7faee81f2180 2023-07-14T15:58:43.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.257+0000 7faeecdff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee80b2610 con 0x7faed4003bc0 2023-07-14T15:58:43.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.257+0000 7faeecdff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee80b28f0 con 0x7faee80b4f90 2023-07-14T15:58:43.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.257+0000 7faee6d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faee81f2180 0x7faee80cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:43.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.257+0000 7faee6d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faee81f2180 0x7faee80cbc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41482/0 (socket says 172.21.15.37:41482) 2023-07-14T15:58:43.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.257+0000 7faee6d9d700 1 -- 172.21.15.37:0/522505898 learned_addr learned my addr 172.21.15.37:0/522505898 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:43.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.257+0000 7faee659c700 1 --2- 172.21.15.37:0/522505898 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faed4003bc0 0x7faee80cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:43.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.257+0000 7faedffff700 1 --2- 172.21.15.37:0/522505898 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7faee80b4f90 0x7faee815b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:43.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.258+0000 7faee6d9d700 1 -- 172.21.15.37:0/522505898 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7faee80b4f90 msgr2=0x7faee815b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:43.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.258+0000 7faee6d9d700 1 --2- 172.21.15.37:0/522505898 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7faee80b4f90 0x7faee815b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:43.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.258+0000 7faee6d9d700 1 -- 172.21.15.37:0/522505898 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faed4003bc0 msgr2=0x7faee80cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:43.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.258+0000 7faee6d9d700 1 --2- 172.21.15.37:0/522505898 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faed4003bc0 0x7faee80cacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:43.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.258+0000 7faee6d9d700 1 -- 172.21.15.37:0/522505898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee80b2bd0 con 0x7faee81f2180 2023-07-14T15:58:43.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.258+0000 7faedffff700 1 --2- 172.21.15.37:0/522505898 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7faee80b4f90 0x7faee815b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:58:43.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.258+0000 7faee6d9d700 1 --2- 172.21.15.37:0/522505898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faee81f2180 0x7faee80cbc30 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7faee8066a40 tx=0x7faee0011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:43.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.258+0000 7faedeffd700 1 -- 172.21.15.37:0/522505898 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee000e040 con 0x7faee81f2180 2023-07-14T15:58:43.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.258+0000 7faedeffd700 1 -- 172.21.15.37:0/522505898 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee000f040 con 0x7faee81f2180 2023-07-14T15:58:43.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.258+0000 7faeecdff700 1 -- 172.21.15.37:0/522505898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faee80b2eb0 con 0x7faee81f2180 2023-07-14T15:58:43.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.258+0000 7faedeffd700 1 -- 172.21.15.37:0/522505898 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee000fd00 con 0x7faee81f2180 2023-07-14T15:58:43.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.258+0000 7faeecdff700 1 -- 172.21.15.37:0/522505898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee815b800 con 0x7faee81f2180 2023-07-14T15:58:43.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.259+0000 7faeecdff700 1 -- 172.21.15.37:0/522505898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faee80b2750 con 0x7faee81f2180 2023-07-14T15:58:43.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.260+0000 7faedeffd700 1 -- 172.21.15.37:0/522505898 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7faee0022460 con 0x7faee81f2180 2023-07-14T15:58:43.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.261+0000 7faedeffd700 1 --2- 172.21.15.37:0/522505898 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7faec806ae00 0x7faec806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:43.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.261+0000 7faedeffd700 1 -- 172.21.15.37:0/522505898 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6118+0+0 (secure 0 0 0) 0x7faee0089cf0 con 0x7faee81f2180 2023-07-14T15:58:43.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.262+0000 7faee659c700 1 --2- 172.21.15.37:0/522505898 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7faec806ae00 0x7faec806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:43.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.263+0000 7faee659c700 1 --2- 172.21.15.37:0/522505898 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7faec806ae00 0x7faec806d2b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7faed8015040 tx=0x7faed800a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:43.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.266+0000 7faedeffd700 1 -- 172.21.15.37:0/522505898 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7faee80b2750 con 0x7faee81f2180 2023-07-14T15:58:43.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.520+0000 7faeecdff700 1 -- 172.21.15.37:0/522505898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faee80b2750 con 0x7faee81f2180 2023-07-14T15:58:43.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.520+0000 7faedeffd700 1 -- 172.21.15.37:0/522505898 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4709 (secure 0 0 0) 0x7faee80b2750 con 0x7faee81f2180 2023-07-14T15:58:43.505 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:58:43.505 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5132,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/1552421235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":1552421235},{"type":"v1","addr":"172.21.15.98:6837","nonce":1552421235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5135,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/4269801846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4269801846},{"type":"v1","addr":"172.21.15.37:6833","nonce":4269801846}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5470,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/3115632546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":3115632546},{"type":"v1","addr":"172.21.15.98:6835","nonce":3115632546}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T15:58:08.228046+0000","modified":"2023-07-14T15:58:11.751169+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5652":{"gid":5652,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/4236968434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":4236968434},{"type":"v1","addr":"172.21.15.37:6835","nonce":4236968434}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-14T15:58:43.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.523+0000 7faeecdff700 1 -- 172.21.15.37:0/522505898 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7faec806ae00 msgr2=0x7faec806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:43.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.523+0000 7faeecdff700 1 --2- 172.21.15.37:0/522505898 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7faec806ae00 0x7faec806d2b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7faed8015040 tx=0x7faed800a000 comp rx=0 tx=0).stop 2023-07-14T15:58:43.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.523+0000 7faeecdff700 1 -- 172.21.15.37:0/522505898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faee81f2180 msgr2=0x7faee80cbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:43.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.523+0000 7faeecdff700 1 --2- 172.21.15.37:0/522505898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faee81f2180 0x7faee80cbc30 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7faee8066a40 tx=0x7faee0011ed0 comp rx=0 tx=0).stop 2023-07-14T15:58:43.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.523+0000 7faeecdff700 1 -- 172.21.15.37:0/522505898 shutdown_connections 2023-07-14T15:58:43.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.523+0000 7faeecdff700 1 --2- 172.21.15.37:0/522505898 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faed4003bc0 0x7faee80cacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:43.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.523+0000 7faeecdff700 1 --2- 172.21.15.37:0/522505898 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7faec806ae00 0x7faec806d2b0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:43.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.523+0000 7faeecdff700 1 --2- 172.21.15.37:0/522505898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faee81f2180 0x7faee80cbc30 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:43.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.523+0000 7faeecdff700 1 --2- 172.21.15.37:0/522505898 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7faee80b4f90 0x7faee815b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:43.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.523+0000 7faeecdff700 1 -- 172.21.15.37:0/522505898 >> 172.21.15.37:0/522505898 conn(0x7faee806b150 msgr2=0x7faee80b7780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:43.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.523+0000 7faeecdff700 1 -- 172.21.15.37:0/522505898 shutdown_connections 2023-07-14T15:58:43.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.523+0000 7faeecdff700 1 -- 172.21.15.37:0/522505898 wait complete. 2023-07-14T15:58:43.509 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 26 2023-07-14T15:58:43.526 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T15:58:43.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.742+0000 7fc8a3fff700 1 Processor -- start 2023-07-14T15:58:43.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.743+0000 7fc8a3fff700 1 -- start start 2023-07-14T15:58:43.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.744+0000 7fc8a3fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fc89c15cc40 0x7fc89c160eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:43.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.744+0000 7fc8a3fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc89c069e70 0x7fc89c06a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:43.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.744+0000 7fc8a3fff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc89c0cbb40 con 0x7fc89c0ca170 2023-07-14T15:58:43.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.744+0000 7fc8a3fff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc89c071830 con 0x7fc89c069e70 2023-07-14T15:58:43.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.744+0000 7fc8a3fff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc89c06a830 con 0x7fc89c15cc40 2023-07-14T15:58:43.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.744+0000 7fc8a259c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc89c069e70 0x7fc89c06a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:43.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.744+0000 7fc8a159a700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc89c0ca170 0x7fc89c071120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:49896/0 (socket says 172.21.15.37:49896) 2023-07-14T15:58:43.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.744+0000 7fc8a159a700 1 -- 172.21.15.37:0/4150169135 learned_addr learned my addr 172.21.15.37:0/4150169135 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:58:43.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.744+0000 7fc8a259c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc89c069e70 0x7fc89c06a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41484/0 (socket says 172.21.15.37:41484) 2023-07-14T15:58:43.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.744+0000 7fc8a1d9b700 1 --2- 172.21.15.37:0/4150169135 >> v2:172.21.15.98:3300/0 conn(0x7fc89c15cc40 0x7fc89c160eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:43.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.744+0000 7fc8a259c700 1 -- 172.21.15.37:0/4150169135 >> v2:172.21.15.98:3300/0 conn(0x7fc89c15cc40 msgr2=0x7fc89c160eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:43.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.744+0000 7fc8a259c700 1 --2- 172.21.15.37:0/4150169135 >> v2:172.21.15.98:3300/0 conn(0x7fc89c15cc40 0x7fc89c160eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:43.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.745+0000 7fc8a259c700 1 -- 172.21.15.37:0/4150169135 >> v1:172.21.15.37:6789/0 conn(0x7fc89c0ca170 legacy=0x7fc89c071120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:43.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.745+0000 7fc8a259c700 1 -- 172.21.15.37:0/4150169135 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc89c070c90 con 0x7fc89c069e70 2023-07-14T15:58:43.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.745+0000 7fc8a259c700 1 --2- 172.21.15.37:0/4150169135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc89c069e70 0x7fc89c06a2f0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fc894009d90 tx=0x7fc89400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8639e1766b1d24fb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:43.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.745+0000 7fc8a0d99700 1 -- 172.21.15.37:0/4150169135 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89400e070 con 0x7fc89c069e70 2023-07-14T15:58:43.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.745+0000 7fc8a0d99700 1 -- 172.21.15.37:0/4150169135 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc89400bae0 con 0x7fc89c069e70 2023-07-14T15:58:43.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.745+0000 7fc8a0d99700 1 -- 172.21.15.37:0/4150169135 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89400be90 con 0x7fc89c069e70 2023-07-14T15:58:43.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.745+0000 7fc8a3fff700 1 -- 172.21.15.37:0/4150169135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc89c069e70 msgr2=0x7fc89c06a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:43.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.746+0000 7fc8a3fff700 1 --2- 172.21.15.37:0/4150169135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc89c069e70 0x7fc89c06a2f0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fc894009d90 tx=0x7fc89400b330 comp rx=0 tx=0).stop 2023-07-14T15:58:43.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.746+0000 7fc8a3fff700 1 -- 172.21.15.37:0/4150169135 shutdown_connections 2023-07-14T15:58:43.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.746+0000 7fc8a3fff700 1 --2- 172.21.15.37:0/4150169135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc89c069e70 0x7fc89c06a2f0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:43.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.746+0000 7fc8a3fff700 1 --2- 172.21.15.37:0/4150169135 >> v2:172.21.15.98:3300/0 conn(0x7fc89c15cc40 0x7fc89c160eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:43.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.746+0000 7fc8a3fff700 1 -- 172.21.15.37:0/4150169135 >> 172.21.15.37:0/4150169135 conn(0x7fc89c0cd230 msgr2=0x7fc89c0cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:43.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.746+0000 7fc8a3fff700 1 -- 172.21.15.37:0/4150169135 shutdown_connections 2023-07-14T15:58:43.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.746+0000 7fc8a3fff700 1 -- 172.21.15.37:0/4150169135 wait complete. 2023-07-14T15:58:43.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.747+0000 7fc8a3fff700 1 Processor -- start 2023-07-14T15:58:43.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.748+0000 7fc8a3fff700 1 -- start start 2023-07-14T15:58:43.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.748+0000 7fc8a3fff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc89c069e70 0x7fc89c15fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:43.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.748+0000 7fc8a3fff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc89c0ca170 0x7fc89c0c9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:43.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.749+0000 7fc8a3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc89c15cc40 0x7fc89c0c95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:43.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.749+0000 7fc8a3fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc89c0c87d0 con 0x7fc89c15cc40 2023-07-14T15:58:43.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.749+0000 7fc8a3fff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc89c0c7b50 con 0x7fc89c0ca170 2023-07-14T15:58:43.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.749+0000 7fc8a3fff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc89c0c7e30 con 0x7fc89c069e70 2023-07-14T15:58:43.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.749+0000 7fc8a259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc89c15cc40 0x7fc89c0c95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:43.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.749+0000 7fc8a259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc89c15cc40 0x7fc89c0c95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41500/0 (socket says 172.21.15.37:41500) 2023-07-14T15:58:43.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.749+0000 7fc8a259c700 1 -- 172.21.15.37:0/2895438219 learned_addr learned my addr 172.21.15.37:0/2895438219 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:43.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.749+0000 7fc8a1d9b700 1 --2- 172.21.15.37:0/2895438219 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc89c069e70 0x7fc89c15fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:43.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.749+0000 7fc8a159a700 1 --2- 172.21.15.37:0/2895438219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc89c0ca170 0x7fc89c0c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:43.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.749+0000 7fc8a259c700 1 -- 172.21.15.37:0/2895438219 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc89c069e70 msgr2=0x7fc89c15fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:43.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.749+0000 7fc8a259c700 1 --2- 172.21.15.37:0/2895438219 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc89c069e70 0x7fc89c15fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:43.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.749+0000 7fc8a259c700 1 -- 172.21.15.37:0/2895438219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc89c0ca170 msgr2=0x7fc89c0c9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:43.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.749+0000 7fc8a259c700 1 --2- 172.21.15.37:0/2895438219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc89c0ca170 0x7fc89c0c9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:43.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.749+0000 7fc8a259c700 1 -- 172.21.15.37:0/2895438219 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc894009a70 con 0x7fc89c15cc40 2023-07-14T15:58:43.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.749+0000 7fc8a159a700 1 --2- 172.21.15.37:0/2895438219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc89c0ca170 0x7fc89c0c9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:58:43.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.749+0000 7fc8a259c700 1 --2- 172.21.15.37:0/2895438219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc89c15cc40 0x7fc89c0c95b0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fc894009f00 tx=0x7fc894004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:43.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.750+0000 7fc8927fc700 1 -- 172.21.15.37:0/2895438219 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc894004600 con 0x7fc89c15cc40 2023-07-14T15:58:43.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.750+0000 7fc8927fc700 1 -- 172.21.15.37:0/2895438219 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc894020070 con 0x7fc89c15cc40 2023-07-14T15:58:43.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.750+0000 7fc8a3fff700 1 -- 172.21.15.37:0/2895438219 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc89c0c8110 con 0x7fc89c15cc40 2023-07-14T15:58:43.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.750+0000 7fc8927fc700 1 -- 172.21.15.37:0/2895438219 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc894027480 con 0x7fc89c15cc40 2023-07-14T15:58:43.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.750+0000 7fc8a3fff700 1 -- 172.21.15.37:0/2895438219 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc89c0c6de0 con 0x7fc89c15cc40 2023-07-14T15:58:43.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.751+0000 7fc8a3fff700 1 -- 172.21.15.37:0/2895438219 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc89c067840 con 0x7fc89c15cc40 2023-07-14T15:58:43.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.752+0000 7fc8927fc700 1 -- 172.21.15.37:0/2895438219 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fc8940275e0 con 0x7fc89c15cc40 2023-07-14T15:58:43.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.753+0000 7fc8927fc700 1 --2- 172.21.15.37:0/2895438219 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc88006ae00 0x7fc88006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:43.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.753+0000 7fc8927fc700 1 -- 172.21.15.37:0/2895438219 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6118+0+0 (secure 0 0 0) 0x7fc894022070 con 0x7fc89c15cc40 2023-07-14T15:58:43.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.753+0000 7fc8a1d9b700 1 --2- 172.21.15.37:0/2895438219 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc88006ae00 0x7fc88006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:43.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.754+0000 7fc8a1d9b700 1 --2- 172.21.15.37:0/2895438219 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc88006ae00 0x7fc88006d2b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc898009b40 tx=0x7fc898009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:43.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.757+0000 7fc8927fc700 1 -- 172.21.15.37:0/2895438219 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc894056660 con 0x7fc89c15cc40 2023-07-14T15:58:43.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.969+0000 7fc8a3fff700 1 -- 172.21.15.37:0/2895438219 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc89c160aa0 con 0x7fc89c15cc40 2023-07-14T15:58:43.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.970+0000 7fc8927fc700 1 -- 172.21.15.37:0/2895438219 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+18389 (secure 0 0 0) 0x7fc894059c80 con 0x7fc89c15cc40 2023-07-14T15:58:43.955 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:58:43.955 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":50,"fsid":"9da30401-a779-4e46-aba6-00c2494c6c67","created":"2023-07-14T15:55:39.898867+0000","modified":"2023-07-14T15:58:37.955658+0000","last_up_change":"2023-07-14T15:55:53.025696+0000","last_in_change":"2023-07-14T15:55:43.388192+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T15:55:52.907261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T15:55:59.992839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-14T15:58:05.947379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-14T15:58:07.213413+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":50,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d049535-7b87-4276-8fe5-0f74ba422d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6801","nonce":2783032392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6803","nonce":2783032392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6807","nonce":2783032392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6805","nonce":2783032392}]},"public_addr":"172.21.15.37:6801/2783032392","cluster_addr":"172.21.15.37:6803/2783032392","heartbeat_back_addr":"172.21.15.37:6807/2783032392","heartbeat_front_addr":"172.21.15.37:6805/2783032392","state":["exists","up"]},{"osd":1,"uuid":"79ec948d-ead2-4c2d-923a-dd6eeaac9dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6823","nonce":1190059746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6826","nonce":1190059746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6831","nonce":1190059746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6829","nonce":1190059746}]},"public_addr":"172.21.15.37:6823/1190059746","cluster_addr":"172.21.15.37:6826/1190059746","heartbeat_back_addr":"172.21.15.37:6831/1190059746","heartbeat_front_addr":"172.21.15.37:6829/1190059746","state":["exists","up"]},{"osd":2,"uuid":"a1db6690-c160-4366-9c82-2cca17e4bba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6809","nonce":2266223499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6813","nonce":2266223499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6820","nonce":2266223499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6816","nonce":2266223499}]},"public_addr":"172.21.15.37:6809/2266223499","cluster_addr":"172.21.15.37:6813/2266223499","heartbeat_back_addr":"172.21.15.37:6820/2266223499","heartbeat_front_addr":"172.21.15.37:6816/2266223499","state":["exists","up"]},{"osd":3,"uuid":"767b8220-e79a-4a86-a162-6b3b73198379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6812","nonce":4166694594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6817","nonce":4166694594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6828","nonce":4166694594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6822","nonce":4166694594}]},"public_addr":"172.21.15.37:6812/4166694594","cluster_addr":"172.21.15.37:6817/4166694594","heartbeat_back_addr":"172.21.15.37:6828/4166694594","heartbeat_front_addr":"172.21.15.37:6822/4166694594","state":["exists","up"]},{"osd":4,"uuid":"717bd773-ae7e-4236-ac79-900cf99a37c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6801","nonce":3529020407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6803","nonce":3529020407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6807","nonce":3529020407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6805","nonce":3529020407}]},"public_addr":"172.21.15.98:6801/3529020407","cluster_addr":"172.21.15.98:6803/3529020407","heartbeat_back_addr":"172.21.15.98:6807/3529020407","heartbeat_front_addr":"172.21.15.98:6805/3529020407","state":["exists","up"]},{"osd":5,"uuid":"a941d358-0f03-4136-a9b2-3a1c2e9358cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6817","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6819","nonce":2311501838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6821","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6823","nonce":2311501838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6829","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6831","nonce":2311501838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6825","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6827","nonce":2311501838}]},"public_addr":"172.21.15.98:6819/2311501838","cluster_addr":"172.21.15.98:6823/2311501838","heartbeat_back_addr":"172.21.15.98:6831/2311501838","heartbeat_front_addr":"172.21.15.98:6827/2311501838","state":["exists","up"]},{"osd":6,"uuid":"27153772-6d4b-479d-9953-0582e7b96743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6809","nonce":1144224691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6811","nonce":1144224691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6815","nonce":1144224691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6813","nonce":1144224691}]},"public_addr":"172.21.15.98:6809/1144224691","cluster_addr":"172.21.15.98:6811/1144224691","heartbeat_back_addr":"172.21.15.98:6815/1144224691","heartbeat_front_addr":"172.21.15.98:6813/1144224691","state":["exists","up"]},{"osd":7,"uuid":"d21ffc8e-40bb-47eb-af2c-e3e730d3fb76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6818","nonce":1144470927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6822","nonce":1144470927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6830","nonce":1144470927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6826","nonce":1144470927}]},"public_addr":"172.21.15.98:6818/1144470927","cluster_addr":"172.21.15.98:6822/1144470927","heartbeat_back_addr":"172.21.15.98:6830/1144470927","heartbeat_front_addr":"172.21.15.98:6826/1144470927","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.921114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.739210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.024016+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.002527+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.698127+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.813416+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.709351+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.815457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":8,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T15:58:43.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.972+0000 7fc8a3fff700 1 -- 172.21.15.37:0/2895438219 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc88006ae00 msgr2=0x7fc88006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:43.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.972+0000 7fc8a3fff700 1 --2- 172.21.15.37:0/2895438219 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc88006ae00 0x7fc88006d2b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc898009b40 tx=0x7fc898009210 comp rx=0 tx=0).stop 2023-07-14T15:58:43.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.972+0000 7fc8a3fff700 1 -- 172.21.15.37:0/2895438219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc89c15cc40 msgr2=0x7fc89c0c95b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:43.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.972+0000 7fc8a3fff700 1 --2- 172.21.15.37:0/2895438219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc89c15cc40 0x7fc89c0c95b0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fc894009f00 tx=0x7fc894004ad0 comp rx=0 tx=0).stop 2023-07-14T15:58:43.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.972+0000 7fc8a3fff700 1 -- 172.21.15.37:0/2895438219 shutdown_connections 2023-07-14T15:58:43.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.972+0000 7fc8a3fff700 1 --2- 172.21.15.37:0/2895438219 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fc88006ae00 0x7fc88006d2b0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:43.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.972+0000 7fc8a3fff700 1 --2- 172.21.15.37:0/2895438219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc89c15cc40 0x7fc89c0c95b0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:43.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.972+0000 7fc8a3fff700 1 --2- 172.21.15.37:0/2895438219 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fc89c069e70 0x7fc89c15fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:43.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.972+0000 7fc8a3fff700 1 --2- 172.21.15.37:0/2895438219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc89c0ca170 0x7fc89c0c9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:43.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.972+0000 7fc8a3fff700 1 -- 172.21.15.37:0/2895438219 >> 172.21.15.37:0/2895438219 conn(0x7fc89c0cd230 msgr2=0x7fc89c0cdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:43.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.973+0000 7fc8a3fff700 1 -- 172.21.15.37:0/2895438219 shutdown_connections 2023-07-14T15:58:43.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:43.973+0000 7fc8a3fff700 1 -- 172.21.15.37:0/2895438219 wait complete. 2023-07-14T15:58:43.975 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-14T15:58:43.976 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T15:58:44.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.193+0000 7fd1bb3ff700 1 Processor -- start 2023-07-14T15:58:44.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.193+0000 7fd1bb3ff700 1 -- start start 2023-07-14T15:58:44.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.195+0000 7fd1bb3ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd1b40b24e0 0x7fd1b40cf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:44.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.195+0000 7fd1bb3ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd1b40cfbd0 0x7fd1b415cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:44.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.195+0000 7fd1bb3ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1b40cd540 con 0x7fd1b40b8650 2023-07-14T15:58:44.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.195+0000 7fd1bb3ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1b4160f70 con 0x7fd1b40cfbd0 2023-07-14T15:58:44.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.195+0000 7fd1bb3ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1b40cd790 con 0x7fd1b40b24e0 2023-07-14T15:58:44.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.195+0000 7fd1b999c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd1b40cfbd0 0x7fd1b415cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:44.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.195+0000 7fd1b999c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd1b40cfbd0 0x7fd1b415cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41512/0 (socket says 172.21.15.37:41512) 2023-07-14T15:58:44.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.195+0000 7fd1b999c700 1 -- 172.21.15.37:0/3450152886 learned_addr learned my addr 172.21.15.37:0/3450152886 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:44.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.195+0000 7fd1b899a700 1 --2- 172.21.15.37:0/3450152886 >> v2:172.21.15.98:3300/0 conn(0x7fd1b40b24e0 0x7fd1b40cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:44.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.195+0000 7fd1b999c700 1 -- 172.21.15.37:0/3450152886 >> v2:172.21.15.98:3300/0 conn(0x7fd1b40b24e0 msgr2=0x7fd1b40cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:44.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.195+0000 7fd1b999c700 1 --2- 172.21.15.37:0/3450152886 >> v2:172.21.15.98:3300/0 conn(0x7fd1b40b24e0 0x7fd1b40cf690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:44.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.195+0000 7fd1b999c700 1 -- 172.21.15.37:0/3450152886 >> v1:172.21.15.98:6789/0 conn(0x7fd1b40b8650 legacy=0x7fd1b40d0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:44.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.196+0000 7fd1b999c700 1 -- 172.21.15.37:0/3450152886 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b40cda70 con 0x7fd1b40cfbd0 2023-07-14T15:58:44.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.196+0000 7fd1b999c700 1 --2- 172.21.15.37:0/3450152886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1b40cfbd0 0x7fd1b415cc20 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fd1b40d0470 tx=0x7fd1ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e681ef0c1ee5fc0c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:44.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.196+0000 7fd1abfff700 1 -- 172.21.15.37:0/3450152886 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac00e070 con 0x7fd1b40cfbd0 2023-07-14T15:58:44.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.196+0000 7fd1abfff700 1 -- 172.21.15.37:0/3450152886 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1ac003a20 con 0x7fd1b40cfbd0 2023-07-14T15:58:44.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.196+0000 7fd1abfff700 1 -- 172.21.15.37:0/3450152886 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac003dd0 con 0x7fd1b40cfbd0 2023-07-14T15:58:44.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.197+0000 7fd1bb3ff700 1 -- 172.21.15.37:0/3450152886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1b40cfbd0 msgr2=0x7fd1b415cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:44.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.197+0000 7fd1bb3ff700 1 --2- 172.21.15.37:0/3450152886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1b40cfbd0 0x7fd1b415cc20 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fd1b40d0470 tx=0x7fd1ac00b330 comp rx=0 tx=0).stop 2023-07-14T15:58:44.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.197+0000 7fd1bb3ff700 1 -- 172.21.15.37:0/3450152886 shutdown_connections 2023-07-14T15:58:44.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.197+0000 7fd1bb3ff700 1 --2- 172.21.15.37:0/3450152886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1b40cfbd0 0x7fd1b415cc20 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:44.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.197+0000 7fd1bb3ff700 1 --2- 172.21.15.37:0/3450152886 >> v2:172.21.15.98:3300/0 conn(0x7fd1b40b24e0 0x7fd1b40cf690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:44.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.197+0000 7fd1bb3ff700 1 -- 172.21.15.37:0/3450152886 >> 172.21.15.37:0/3450152886 conn(0x7fd1b406c0f0 msgr2=0x7fd1b406c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:44.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.197+0000 7fd1bb3ff700 1 -- 172.21.15.37:0/3450152886 shutdown_connections 2023-07-14T15:58:44.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.197+0000 7fd1bb3ff700 1 -- 172.21.15.37:0/3450152886 wait complete. 2023-07-14T15:58:44.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.198+0000 7fd1bb3ff700 1 Processor -- start 2023-07-14T15:58:44.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.199+0000 7fd1bb3ff700 1 -- start start 2023-07-14T15:58:44.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.199+0000 7fd1bb3ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd1b40b24e0 0x7fd1b40d1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:44.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.200+0000 7fd1bb3ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1b40b8650 0x7fd1b415a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:44.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.200+0000 7fd1bb3ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1b40cfbd0 0x7fd1b415a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:44.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.200+0000 7fd1bb3ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b40b1760 con 0x7fd1b40b8650 2023-07-14T15:58:44.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.200+0000 7fd1bb3ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b415fcb0 con 0x7fd1b40cfbd0 2023-07-14T15:58:44.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.200+0000 7fd1bb3ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b41f2db0 con 0x7fd1b40b24e0 2023-07-14T15:58:44.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.200+0000 7fd1b899a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1b40b8650 0x7fd1b415a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:44.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.200+0000 7fd1b899a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1b40b8650 0x7fd1b415a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41516/0 (socket says 172.21.15.37:41516) 2023-07-14T15:58:44.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.200+0000 7fd1b899a700 1 -- 172.21.15.37:0/1104927189 learned_addr learned my addr 172.21.15.37:0/1104927189 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:44.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.200+0000 7fd1b999c700 1 --2- 172.21.15.37:0/1104927189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1b40cfbd0 0x7fd1b415a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:44.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.200+0000 7fd1b919b700 1 --2- 172.21.15.37:0/1104927189 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd1b40b24e0 0x7fd1b40d1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:44.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.200+0000 7fd1b899a700 1 -- 172.21.15.37:0/1104927189 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd1b40b24e0 msgr2=0x7fd1b40d1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:44.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.200+0000 7fd1b899a700 1 --2- 172.21.15.37:0/1104927189 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd1b40b24e0 0x7fd1b40d1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:44.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.200+0000 7fd1b899a700 1 -- 172.21.15.37:0/1104927189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1b40cfbd0 msgr2=0x7fd1b415a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:44.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.200+0000 7fd1b899a700 1 --2- 172.21.15.37:0/1104927189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1b40cfbd0 0x7fd1b415a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:44.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.200+0000 7fd1b899a700 1 -- 172.21.15.37:0/1104927189 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ac009b30 con 0x7fd1b40b8650 2023-07-14T15:58:44.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.200+0000 7fd1b919b700 1 --2- 172.21.15.37:0/1104927189 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd1b40b24e0 0x7fd1b40d1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:58:44.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.200+0000 7fd1b899a700 1 --2- 172.21.15.37:0/1104927189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1b40b8650 0x7fd1b415a040 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fd1a400e810 tx=0x7fd1a400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:44.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.201+0000 7fd1a9ffb700 1 -- 172.21.15.37:0/1104927189 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a4013610 con 0x7fd1b40b8650 2023-07-14T15:58:44.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.201+0000 7fd1a9ffb700 1 -- 172.21.15.37:0/1104927189 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a4013770 con 0x7fd1b40b8650 2023-07-14T15:58:44.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.201+0000 7fd1a9ffb700 1 -- 172.21.15.37:0/1104927189 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a4013b20 con 0x7fd1b40b8650 2023-07-14T15:58:44.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.201+0000 7fd1bb3ff700 1 -- 172.21.15.37:0/1104927189 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1b41f1ff0 con 0x7fd1b40b8650 2023-07-14T15:58:44.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.201+0000 7fd1bb3ff700 1 -- 172.21.15.37:0/1104927189 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1b41f25b0 con 0x7fd1b40b8650 2023-07-14T15:58:44.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.202+0000 7fd1bb3ff700 1 -- 172.21.15.37:0/1104927189 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1b4067840 con 0x7fd1b40b8650 2023-07-14T15:58:44.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.203+0000 7fd1a9ffb700 1 -- 172.21.15.37:0/1104927189 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fd1a4013c80 con 0x7fd1b40b8650 2023-07-14T15:58:44.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.204+0000 7fd1a9ffb700 1 --2- 172.21.15.37:0/1104927189 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd19806ae00 0x7fd19806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:44.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.204+0000 7fd1a9ffb700 1 -- 172.21.15.37:0/1104927189 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6118+0+0 (secure 0 0 0) 0x7fd1a4089520 con 0x7fd1b40b8650 2023-07-14T15:58:44.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.205+0000 7fd1b919b700 1 --2- 172.21.15.37:0/1104927189 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd19806ae00 0x7fd19806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:44.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.206+0000 7fd1b919b700 1 --2- 172.21.15.37:0/1104927189 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd19806ae00 0x7fd19806d2b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd1b0003f40 tx=0x7fd1b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:44.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.209+0000 7fd1a9ffb700 1 -- 172.21.15.37:0/1104927189 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd1a40542e0 con 0x7fd1b40b8650 2023-07-14T15:58:44.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.465+0000 7fd1bb3ff700 1 -- 172.21.15.37:0/1104927189 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd1b40d1920 con 0x7fd1b40b8650 2023-07-14T15:58:44.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.466+0000 7fd1a9ffb700 1 -- 172.21.15.37:0/1104927189 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4709 (secure 0 0 0) 0x7fd1a4057900 con 0x7fd1b40b8650 2023-07-14T15:58:44.450 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:58:44.450 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5132,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/1552421235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":1552421235},{"type":"v1","addr":"172.21.15.98:6837","nonce":1552421235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5135,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/4269801846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4269801846},{"type":"v1","addr":"172.21.15.37:6833","nonce":4269801846}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5470,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/3115632546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":3115632546},{"type":"v1","addr":"172.21.15.98:6835","nonce":3115632546}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T15:58:08.228046+0000","modified":"2023-07-14T15:58:11.751169+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5652":{"gid":5652,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/4236968434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":4236968434},{"type":"v1","addr":"172.21.15.37:6835","nonce":4236968434}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-14T15:58:44.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.468+0000 7fd1bb3ff700 1 -- 172.21.15.37:0/1104927189 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd19806ae00 msgr2=0x7fd19806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:44.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.468+0000 7fd1bb3ff700 1 --2- 172.21.15.37:0/1104927189 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd19806ae00 0x7fd19806d2b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd1b0003f40 tx=0x7fd1b0009040 comp rx=0 tx=0).stop 2023-07-14T15:58:44.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.468+0000 7fd1bb3ff700 1 -- 172.21.15.37:0/1104927189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1b40b8650 msgr2=0x7fd1b415a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:44.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.468+0000 7fd1bb3ff700 1 --2- 172.21.15.37:0/1104927189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1b40b8650 0x7fd1b415a040 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fd1a400e810 tx=0x7fd1a400ebd0 comp rx=0 tx=0).stop 2023-07-14T15:58:44.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.469+0000 7fd1bb3ff700 1 -- 172.21.15.37:0/1104927189 shutdown_connections 2023-07-14T15:58:44.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.469+0000 7fd1bb3ff700 1 --2- 172.21.15.37:0/1104927189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1b40cfbd0 0x7fd1b415a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:44.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.469+0000 7fd1bb3ff700 1 --2- 172.21.15.37:0/1104927189 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd19806ae00 0x7fd19806d2b0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:44.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.469+0000 7fd1bb3ff700 1 --2- 172.21.15.37:0/1104927189 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd1b40b24e0 0x7fd1b40d1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:44.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.469+0000 7fd1bb3ff700 1 --2- 172.21.15.37:0/1104927189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1b40b8650 0x7fd1b415a040 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:44.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.469+0000 7fd1bb3ff700 1 -- 172.21.15.37:0/1104927189 >> 172.21.15.37:0/1104927189 conn(0x7fd1b406c0f0 msgr2=0x7fd1b40b7a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:44.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.469+0000 7fd1bb3ff700 1 -- 172.21.15.37:0/1104927189 shutdown_connections 2023-07-14T15:58:44.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.469+0000 7fd1bb3ff700 1 -- 172.21.15.37:0/1104927189 wait complete. 2023-07-14T15:58:44.456 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 26 2023-07-14T15:58:44.471 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T15:58:44.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.688+0000 7f1a565ff700 1 Processor -- start 2023-07-14T15:58:44.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.688+0000 7f1a565ff700 1 -- start start 2023-07-14T15:58:44.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.689+0000 7f1a565ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f1a500b8650 0x7f1a500d0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:44.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.689+0000 7f1a565ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1a500cfda0 0x7f1a5015cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:44.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.689+0000 7f1a565ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a500cd540 con 0x7f1a500b24e0 2023-07-14T15:58:44.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.689+0000 7f1a565ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a500d1000 con 0x7f1a500cfda0 2023-07-14T15:58:44.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.689+0000 7f1a565ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a500d0220 con 0x7f1a500b8650 2023-07-14T15:58:44.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.690+0000 7f1a4f7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1a500b24e0 0x7f1a500cf690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:49910/0 (socket says 172.21.15.37:49910) 2023-07-14T15:58:44.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.690+0000 7f1a4f7fe700 1 -- 172.21.15.37:0/466475101 learned_addr learned my addr 172.21.15.37:0/466475101 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:58:44.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.690+0000 7f1a54b9c700 1 --2- 172.21.15.37:0/466475101 >> v2:172.21.15.37:3300/0 conn(0x7f1a500cfda0 0x7f1a5015cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:44.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.690+0000 7f1a4ffff700 1 --2- 172.21.15.37:0/466475101 >> v2:172.21.15.98:3300/0 conn(0x7f1a500b8650 0x7f1a500d0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:44.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.690+0000 7f1a4effd700 1 -- 172.21.15.37:0/466475101 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3744073275 0 0) 0x7f1a500cd540 con 0x7f1a500b24e0 2023-07-14T15:58:44.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.690+0000 7f1a54b9c700 1 -- 172.21.15.37:0/466475101 >> v2:172.21.15.98:3300/0 conn(0x7f1a500b8650 msgr2=0x7f1a500d0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:44.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.690+0000 7f1a54b9c700 1 --2- 172.21.15.37:0/466475101 >> v2:172.21.15.98:3300/0 conn(0x7f1a500b8650 0x7f1a500d0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:44.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.690+0000 7f1a54b9c700 1 -- 172.21.15.37:0/466475101 >> v1:172.21.15.37:6789/0 conn(0x7f1a500b24e0 legacy=0x7f1a500cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:44.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.690+0000 7f1a54b9c700 1 -- 172.21.15.37:0/466475101 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a50160f70 con 0x7f1a500cfda0 2023-07-14T15:58:44.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.690+0000 7f1a54b9c700 1 --2- 172.21.15.37:0/466475101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a500cfda0 0x7f1a5015cc20 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f1a5006cec0 tx=0x7f1a4800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc15944a29226f47 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:44.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.691+0000 7f1a4effd700 1 -- 172.21.15.37:0/466475101 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4800e070 con 0x7f1a500cfda0 2023-07-14T15:58:44.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.691+0000 7f1a4effd700 1 -- 172.21.15.37:0/466475101 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4800bb20 con 0x7f1a500cfda0 2023-07-14T15:58:44.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.691+0000 7f1a4effd700 1 -- 172.21.15.37:0/466475101 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a48012430 con 0x7f1a500cfda0 2023-07-14T15:58:44.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.691+0000 7f1a565ff700 1 -- 172.21.15.37:0/466475101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a500cfda0 msgr2=0x7f1a5015cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:44.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.691+0000 7f1a565ff700 1 --2- 172.21.15.37:0/466475101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a500cfda0 0x7f1a5015cc20 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f1a5006cec0 tx=0x7f1a4800b330 comp rx=0 tx=0).stop 2023-07-14T15:58:44.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.691+0000 7f1a565ff700 1 -- 172.21.15.37:0/466475101 shutdown_connections 2023-07-14T15:58:44.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.691+0000 7f1a565ff700 1 --2- 172.21.15.37:0/466475101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a500cfda0 0x7f1a5015cc20 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:44.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.691+0000 7f1a565ff700 1 --2- 172.21.15.37:0/466475101 >> v2:172.21.15.98:3300/0 conn(0x7f1a500b8650 0x7f1a500d0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:44.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.691+0000 7f1a565ff700 1 -- 172.21.15.37:0/466475101 >> 172.21.15.37:0/466475101 conn(0x7f1a5006c0f0 msgr2=0x7f1a5006c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:44.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.691+0000 7f1a565ff700 1 -- 172.21.15.37:0/466475101 shutdown_connections 2023-07-14T15:58:44.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.691+0000 7f1a565ff700 1 -- 172.21.15.37:0/466475101 wait complete. 2023-07-14T15:58:44.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.693+0000 7f1a565ff700 1 Processor -- start 2023-07-14T15:58:44.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.693+0000 7f1a565ff700 1 -- start start 2023-07-14T15:58:44.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.694+0000 7f1a565ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f1a500b24e0 0x7f1a501599d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:44.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.694+0000 7f1a565ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a500b8650 0x7f1a501e87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:44.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.694+0000 7f1a565ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a500cfda0 0x7f1a501f26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:44.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.694+0000 7f1a565ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5015a4e0 con 0x7f1a500cfda0 2023-07-14T15:58:44.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.694+0000 7f1a565ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5015d640 con 0x7f1a500b8650 2023-07-14T15:58:44.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.694+0000 7f1a565ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5015d920 con 0x7f1a500b24e0 2023-07-14T15:58:44.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.694+0000 7f1a54b9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a500cfda0 0x7f1a501f26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:44.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.694+0000 7f1a54b9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a500cfda0 0x7f1a501f26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41546/0 (socket says 172.21.15.37:41546) 2023-07-14T15:58:44.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.694+0000 7f1a54b9c700 1 -- 172.21.15.37:0/3336459964 learned_addr learned my addr 172.21.15.37:0/3336459964 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:44.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.695+0000 7f1a4ffff700 1 --2- 172.21.15.37:0/3336459964 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f1a500b24e0 0x7f1a501599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:44.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.695+0000 7f1a4f7fe700 1 --2- 172.21.15.37:0/3336459964 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a500b8650 0x7f1a501e87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:44.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.695+0000 7f1a54b9c700 1 -- 172.21.15.37:0/3336459964 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f1a500b24e0 msgr2=0x7f1a501599d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:44.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.695+0000 7f1a54b9c700 1 --2- 172.21.15.37:0/3336459964 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f1a500b24e0 0x7f1a501599d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:44.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.695+0000 7f1a54b9c700 1 -- 172.21.15.37:0/3336459964 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a500b8650 msgr2=0x7f1a501e87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:44.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.695+0000 7f1a54b9c700 1 --2- 172.21.15.37:0/3336459964 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a500b8650 0x7f1a501e87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:44.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.695+0000 7f1a54b9c700 1 -- 172.21.15.37:0/3336459964 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a48009a70 con 0x7f1a500cfda0 2023-07-14T15:58:44.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.695+0000 7f1a4f7fe700 1 --2- 172.21.15.37:0/3336459964 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a500b8650 0x7f1a501e87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:58:44.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.695+0000 7f1a54b9c700 1 --2- 172.21.15.37:0/3336459964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a500cfda0 0x7f1a501f26b0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f1a5006d030 tx=0x7f1a48004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:44.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.695+0000 7f1a4cff9700 1 -- 172.21.15.37:0/3336459964 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a48012430 con 0x7f1a500cfda0 2023-07-14T15:58:44.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.695+0000 7f1a4cff9700 1 -- 172.21.15.37:0/3336459964 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a48020070 con 0x7f1a500cfda0 2023-07-14T15:58:44.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.695+0000 7f1a565ff700 1 -- 172.21.15.37:0/3336459964 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a5015dc00 con 0x7f1a500cfda0 2023-07-14T15:58:44.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.695+0000 7f1a4cff9700 1 -- 172.21.15.37:0/3336459964 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a48004280 con 0x7f1a500cfda0 2023-07-14T15:58:44.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.695+0000 7f1a565ff700 1 -- 172.21.15.37:0/3336459964 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a5015e1c0 con 0x7f1a500cfda0 2023-07-14T15:58:44.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.696+0000 7f1a565ff700 1 -- 172.21.15.37:0/3336459964 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a5015e3e0 con 0x7f1a500cfda0 2023-07-14T15:58:44.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.697+0000 7f1a4cff9700 1 -- 172.21.15.37:0/3336459964 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f1a480043e0 con 0x7f1a500cfda0 2023-07-14T15:58:44.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.698+0000 7f1a4cff9700 1 --2- 172.21.15.37:0/3336459964 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f1a3c06ae00 0x7f1a3c06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:44.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.698+0000 7f1a4cff9700 1 -- 172.21.15.37:0/3336459964 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f1a48022070 con 0x7f1a500cfda0 2023-07-14T15:58:44.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.699+0000 7f1a4ffff700 1 --2- 172.21.15.37:0/3336459964 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f1a3c06ae00 0x7f1a3c06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:44.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.699+0000 7f1a4ffff700 1 --2- 172.21.15.37:0/3336459964 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f1a3c06ae00 0x7f1a3c06d2b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1a40009b70 tx=0x7f1a40008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:44.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.702+0000 7f1a4cff9700 1 -- 172.21.15.37:0/3336459964 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1a48056360 con 0x7f1a500cfda0 2023-07-14T15:58:44.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.960+0000 7f1a565ff700 1 -- 172.21.15.37:0/3336459964 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a50067840 con 0x7f1a500cfda0 2023-07-14T15:58:44.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.960+0000 7f1a4cff9700 1 -- 172.21.15.37:0/3336459964 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4709 (secure 0 0 0) 0x7f1a48059980 con 0x7f1a500cfda0 2023-07-14T15:58:44.944 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:58:44.945 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5132,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/1552421235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":1552421235},{"type":"v1","addr":"172.21.15.98:6837","nonce":1552421235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5135,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/4269801846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4269801846},{"type":"v1","addr":"172.21.15.37:6833","nonce":4269801846}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5470,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/3115632546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":3115632546},{"type":"v1","addr":"172.21.15.98:6835","nonce":3115632546}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T15:58:08.228046+0000","modified":"2023-07-14T15:58:11.751169+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5652":{"gid":5652,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/4236968434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":4236968434},{"type":"v1","addr":"172.21.15.37:6835","nonce":4236968434}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-14T15:58:44.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.962+0000 7f1a565ff700 1 -- 172.21.15.37:0/3336459964 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f1a3c06ae00 msgr2=0x7f1a3c06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:44.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.962+0000 7f1a565ff700 1 --2- 172.21.15.37:0/3336459964 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f1a3c06ae00 0x7f1a3c06d2b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1a40009b70 tx=0x7f1a40008040 comp rx=0 tx=0).stop 2023-07-14T15:58:44.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.962+0000 7f1a565ff700 1 -- 172.21.15.37:0/3336459964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a500cfda0 msgr2=0x7f1a501f26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:44.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.962+0000 7f1a565ff700 1 --2- 172.21.15.37:0/3336459964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a500cfda0 0x7f1a501f26b0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f1a5006d030 tx=0x7f1a48004ad0 comp rx=0 tx=0).stop 2023-07-14T15:58:44.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.962+0000 7f1a565ff700 1 -- 172.21.15.37:0/3336459964 shutdown_connections 2023-07-14T15:58:44.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.962+0000 7f1a565ff700 1 --2- 172.21.15.37:0/3336459964 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f1a3c06ae00 0x7f1a3c06d2b0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:44.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.962+0000 7f1a565ff700 1 --2- 172.21.15.37:0/3336459964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a500cfda0 0x7f1a501f26b0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:44.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.962+0000 7f1a565ff700 1 --2- 172.21.15.37:0/3336459964 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f1a500b24e0 0x7f1a501599d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:44.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.962+0000 7f1a565ff700 1 --2- 172.21.15.37:0/3336459964 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a500b8650 0x7f1a501e87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:44.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.962+0000 7f1a565ff700 1 -- 172.21.15.37:0/3336459964 >> 172.21.15.37:0/3336459964 conn(0x7f1a5006c0f0 msgr2=0x7f1a50160180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:44.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.962+0000 7f1a565ff700 1 -- 172.21.15.37:0/3336459964 shutdown_connections 2023-07-14T15:58:44.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:44.962+0000 7f1a565ff700 1 -- 172.21.15.37:0/3336459964 wait complete. 2023-07-14T15:58:44.948 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 26 2023-07-14T15:58:44.965 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T15:58:45.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.183+0000 7f01513ff700 1 Processor -- start 2023-07-14T15:58:45.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.183+0000 7f01513ff700 1 -- start start 2023-07-14T15:58:45.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.184+0000 7f01513ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f014c0b20d0 0x7f014c1608a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:45.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.184+0000 7f01513ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f014c0d2680 0x7f014c0d2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:45.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.184+0000 7f01513ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f014c0cd760 con 0x7f014c0b8720 2023-07-14T15:58:45.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.184+0000 7f01513ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f014c0cd4f0 con 0x7f014c0b20d0 2023-07-14T15:58:45.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.184+0000 7f01513ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f014c0b8af0 con 0x7f014c0d2680 2023-07-14T15:58:45.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.184+0000 7f014affd700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f014c0b8720 0x7f014c160190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:49918/0 (socket says 172.21.15.37:49918) 2023-07-14T15:58:45.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.184+0000 7f014affd700 1 -- 172.21.15.37:0/86155782 learned_addr learned my addr 172.21.15.37:0/86155782 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:58:45.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.185+0000 7f0143fff700 1 --2- 172.21.15.37:0/86155782 >> v2:172.21.15.98:3300/0 conn(0x7f014c0b20d0 0x7f014c1608a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:45.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.185+0000 7f014b7fe700 1 --2- 172.21.15.37:0/86155782 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f014c0d2680 0x7f014c0d2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:45.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.185+0000 7f014a7fc700 1 -- 172.21.15.37:0/86155782 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2174409982 0 0) 0x7f014c0cd760 con 0x7f014c0b8720 2023-07-14T15:58:45.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.185+0000 7f014a7fc700 1 -- 172.21.15.37:0/86155782 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01380035b0 con 0x7f014c0b8720 2023-07-14T15:58:45.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.185+0000 7f0143fff700 1 -- 172.21.15.37:0/86155782 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f014c0d2680 msgr2=0x7f014c0d2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:45.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.185+0000 7f0143fff700 1 --2- 172.21.15.37:0/86155782 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f014c0d2680 0x7f014c0d2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:45.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.185+0000 7f0143fff700 1 -- 172.21.15.37:0/86155782 >> v1:172.21.15.37:6789/0 conn(0x7f014c0b8720 legacy=0x7f014c160190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:45.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.185+0000 7f0143fff700 1 -- 172.21.15.37:0/86155782 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f014c0d18a0 con 0x7f014c0b20d0 2023-07-14T15:58:45.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.185+0000 7f0143fff700 1 --2- 172.21.15.37:0/86155782 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f014c0b20d0 0x7f014c1608a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0134009840 tx=0x7f0134009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13f5ce848dbd5fe server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:45.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.186+0000 7f014a7fc700 1 -- 172.21.15.37:0/86155782 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0134011830 con 0x7f014c0b20d0 2023-07-14T15:58:45.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.186+0000 7f014a7fc700 1 -- 172.21.15.37:0/86155782 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0134011990 con 0x7f014c0b20d0 2023-07-14T15:58:45.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.186+0000 7f014a7fc700 1 -- 172.21.15.37:0/86155782 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0134011d20 con 0x7f014c0b20d0 2023-07-14T15:58:45.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.186+0000 7f01513ff700 1 -- 172.21.15.37:0/86155782 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f014c0b20d0 msgr2=0x7f014c1608a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:45.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.186+0000 7f01513ff700 1 --2- 172.21.15.37:0/86155782 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f014c0b20d0 0x7f014c1608a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0134009840 tx=0x7f0134009b50 comp rx=0 tx=0).stop 2023-07-14T15:58:45.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.186+0000 7f01513ff700 1 -- 172.21.15.37:0/86155782 shutdown_connections 2023-07-14T15:58:45.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.186+0000 7f01513ff700 1 --2- 172.21.15.37:0/86155782 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f014c0d2680 0x7f014c0d2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:45.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.186+0000 7f01513ff700 1 --2- 172.21.15.37:0/86155782 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f014c0b20d0 0x7f014c1608a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:45.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.186+0000 7f01513ff700 1 -- 172.21.15.37:0/86155782 >> 172.21.15.37:0/86155782 conn(0x7f014c06a510 msgr2=0x7f014c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:45.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.187+0000 7f01513ff700 1 -- 172.21.15.37:0/86155782 shutdown_connections 2023-07-14T15:58:45.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.187+0000 7f01513ff700 1 -- 172.21.15.37:0/86155782 wait complete. 2023-07-14T15:58:45.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.188+0000 7f01513ff700 1 Processor -- start 2023-07-14T15:58:45.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.188+0000 7f01513ff700 1 -- start start 2023-07-14T15:58:45.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.189+0000 7f01513ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f014c0b20d0 0x7f014c0c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:45.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.189+0000 7f01513ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f014c0b8720 0x7f014c0b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:45.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.189+0000 7f01513ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f014c0d2680 0x7f014c14ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:45.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.189+0000 7f01513ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014c0c7a60 con 0x7f014c0b8720 2023-07-14T15:58:45.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.189+0000 7f01513ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014c0c6ee0 con 0x7f014c0b20d0 2023-07-14T15:58:45.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.189+0000 7f01513ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f014c0c71c0 con 0x7f014c0d2680 2023-07-14T15:58:45.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.190+0000 7f0143fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f014c0b8720 0x7f014c0b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:45.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.190+0000 7f0143fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f014c0b8720 0x7f014c0b32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41560/0 (socket says 172.21.15.37:41560) 2023-07-14T15:58:45.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.190+0000 7f0143fff700 1 -- 172.21.15.37:0/3519829710 learned_addr learned my addr 172.21.15.37:0/3519829710 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:45.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.190+0000 7f014affd700 1 --2- 172.21.15.37:0/3519829710 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f014c0b20d0 0x7f014c0c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:45.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.190+0000 7f014b7fe700 1 --2- 172.21.15.37:0/3519829710 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f014c0d2680 0x7f014c14ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:45.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.190+0000 7f0143fff700 1 -- 172.21.15.37:0/3519829710 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f014c0d2680 msgr2=0x7f014c14ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:45.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.190+0000 7f0143fff700 1 --2- 172.21.15.37:0/3519829710 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f014c0d2680 0x7f014c14ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:45.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.190+0000 7f0143fff700 1 -- 172.21.15.37:0/3519829710 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f014c0b20d0 msgr2=0x7f014c0c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:45.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.190+0000 7f0143fff700 1 --2- 172.21.15.37:0/3519829710 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f014c0b20d0 0x7f014c0c8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:45.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.190+0000 7f0143fff700 1 -- 172.21.15.37:0/3519829710 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01340094a0 con 0x7f014c0b8720 2023-07-14T15:58:45.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.190+0000 7f014affd700 1 --2- 172.21.15.37:0/3519829710 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f014c0b20d0 0x7f014c0c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:58:45.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.190+0000 7f0143fff700 1 --2- 172.21.15.37:0/3519829710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f014c0b8720 0x7f014c0b32d0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f01340090b0 tx=0x7f0134004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:45.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.191+0000 7f01437fe700 1 -- 172.21.15.37:0/3519829710 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0134004590 con 0x7f014c0b8720 2023-07-14T15:58:45.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.191+0000 7f01437fe700 1 -- 172.21.15.37:0/3519829710 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013401f070 con 0x7f014c0b8720 2023-07-14T15:58:45.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.191+0000 7f01437fe700 1 -- 172.21.15.37:0/3519829710 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01340038e0 con 0x7f014c0b8720 2023-07-14T15:58:45.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.191+0000 7f01513ff700 1 -- 172.21.15.37:0/3519829710 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f014c0c74a0 con 0x7f014c0b8720 2023-07-14T15:58:45.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.191+0000 7f01513ff700 1 -- 172.21.15.37:0/3519829710 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f014c0cc380 con 0x7f014c0b8720 2023-07-14T15:58:45.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.192+0000 7f01513ff700 1 -- 172.21.15.37:0/3519829710 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f014c067840 con 0x7f014c0b8720 2023-07-14T15:58:45.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.193+0000 7f01437fe700 1 -- 172.21.15.37:0/3519829710 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f0134003a40 con 0x7f014c0b8720 2023-07-14T15:58:45.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.194+0000 7f01437fe700 1 --2- 172.21.15.37:0/3519829710 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f012c06ae00 0x7f012c06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:45.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.194+0000 7f01437fe700 1 -- 172.21.15.37:0/3519829710 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f0134021070 con 0x7f014c0b8720 2023-07-14T15:58:45.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.194+0000 7f014affd700 1 --2- 172.21.15.37:0/3519829710 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f012c06ae00 0x7f012c06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:45.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.195+0000 7f014affd700 1 --2- 172.21.15.37:0/3519829710 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f012c06ae00 0x7f012c06d2b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f013c007fd0 tx=0x7f013c007dc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:45.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.199+0000 7f01437fe700 1 -- 172.21.15.37:0/3519829710 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0134055d90 con 0x7f014c0b8720 2023-07-14T15:58:45.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.406+0000 7f01513ff700 1 -- 172.21.15.37:0/3519829710 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f014c0b5370 con 0x7f014c0b8720 2023-07-14T15:58:45.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.407+0000 7f01437fe700 1 -- 172.21.15.37:0/3519829710 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+18389 (secure 0 0 0) 0x7f01340593b0 con 0x7f014c0b8720 2023-07-14T15:58:45.392 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:58:45.392 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":50,"fsid":"9da30401-a779-4e46-aba6-00c2494c6c67","created":"2023-07-14T15:55:39.898867+0000","modified":"2023-07-14T15:58:37.955658+0000","last_up_change":"2023-07-14T15:55:53.025696+0000","last_in_change":"2023-07-14T15:55:43.388192+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T15:55:52.907261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T15:55:59.992839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-14T15:58:05.947379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-14T15:58:07.213413+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":50,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d049535-7b87-4276-8fe5-0f74ba422d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6801","nonce":2783032392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6803","nonce":2783032392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6807","nonce":2783032392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6805","nonce":2783032392}]},"public_addr":"172.21.15.37:6801/2783032392","cluster_addr":"172.21.15.37:6803/2783032392","heartbeat_back_addr":"172.21.15.37:6807/2783032392","heartbeat_front_addr":"172.21.15.37:6805/2783032392","state":["exists","up"]},{"osd":1,"uuid":"79ec948d-ead2-4c2d-923a-dd6eeaac9dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6823","nonce":1190059746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6826","nonce":1190059746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6831","nonce":1190059746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6829","nonce":1190059746}]},"public_addr":"172.21.15.37:6823/1190059746","cluster_addr":"172.21.15.37:6826/1190059746","heartbeat_back_addr":"172.21.15.37:6831/1190059746","heartbeat_front_addr":"172.21.15.37:6829/1190059746","state":["exists","up"]},{"osd":2,"uuid":"a1db6690-c160-4366-9c82-2cca17e4bba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6809","nonce":2266223499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6813","nonce":2266223499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6820","nonce":2266223499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6816","nonce":2266223499}]},"public_addr":"172.21.15.37:6809/2266223499","cluster_addr":"172.21.15.37:6813/2266223499","heartbeat_back_addr":"172.21.15.37:6820/2266223499","heartbeat_front_addr":"172.21.15.37:6816/2266223499","state":["exists","up"]},{"osd":3,"uuid":"767b8220-e79a-4a86-a162-6b3b73198379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6812","nonce":4166694594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6817","nonce":4166694594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6828","nonce":4166694594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6822","nonce":4166694594}]},"public_addr":"172.21.15.37:6812/4166694594","cluster_addr":"172.21.15.37:6817/4166694594","heartbeat_back_addr":"172.21.15.37:6828/4166694594","heartbeat_front_addr":"172.21.15.37:6822/4166694594","state":["exists","up"]},{"osd":4,"uuid":"717bd773-ae7e-4236-ac79-900cf99a37c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6801","nonce":3529020407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6803","nonce":3529020407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6807","nonce":3529020407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6805","nonce":3529020407}]},"public_addr":"172.21.15.98:6801/3529020407","cluster_addr":"172.21.15.98:6803/3529020407","heartbeat_back_addr":"172.21.15.98:6807/3529020407","heartbeat_front_addr":"172.21.15.98:6805/3529020407","state":["exists","up"]},{"osd":5,"uuid":"a941d358-0f03-4136-a9b2-3a1c2e9358cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6817","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6819","nonce":2311501838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6821","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6823","nonce":2311501838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6829","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6831","nonce":2311501838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6825","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6827","nonce":2311501838}]},"public_addr":"172.21.15.98:6819/2311501838","cluster_addr":"172.21.15.98:6823/2311501838","heartbeat_back_addr":"172.21.15.98:6831/2311501838","heartbeat_front_addr":"172.21.15.98:6827/2311501838","state":["exists","up"]},{"osd":6,"uuid":"27153772-6d4b-479d-9953-0582e7b96743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6809","nonce":1144224691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6811","nonce":1144224691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6815","nonce":1144224691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6813","nonce":1144224691}]},"public_addr":"172.21.15.98:6809/1144224691","cluster_addr":"172.21.15.98:6811/1144224691","heartbeat_back_addr":"172.21.15.98:6815/1144224691","heartbeat_front_addr":"172.21.15.98:6813/1144224691","state":["exists","up"]},{"osd":7,"uuid":"d21ffc8e-40bb-47eb-af2c-e3e730d3fb76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6818","nonce":1144470927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6822","nonce":1144470927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6830","nonce":1144470927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6826","nonce":1144470927}]},"public_addr":"172.21.15.98:6818/1144470927","cluster_addr":"172.21.15.98:6822/1144470927","heartbeat_back_addr":"172.21.15.98:6830/1144470927","heartbeat_front_addr":"172.21.15.98:6826/1144470927","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.921114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.739210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.024016+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.002527+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.698127+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.813416+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.709351+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.815457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":8,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T15:58:45.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.409+0000 7f01513ff700 1 -- 172.21.15.37:0/3519829710 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f012c06ae00 msgr2=0x7f012c06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:45.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.409+0000 7f01513ff700 1 --2- 172.21.15.37:0/3519829710 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f012c06ae00 0x7f012c06d2b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f013c007fd0 tx=0x7f013c007dc0 comp rx=0 tx=0).stop 2023-07-14T15:58:45.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.410+0000 7f01513ff700 1 -- 172.21.15.37:0/3519829710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f014c0b8720 msgr2=0x7f014c0b32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:45.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.410+0000 7f01513ff700 1 --2- 172.21.15.37:0/3519829710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f014c0b8720 0x7f014c0b32d0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f01340090b0 tx=0x7f0134004750 comp rx=0 tx=0).stop 2023-07-14T15:58:45.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.410+0000 7f01513ff700 1 -- 172.21.15.37:0/3519829710 shutdown_connections 2023-07-14T15:58:45.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.410+0000 7f01513ff700 1 --2- 172.21.15.37:0/3519829710 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f014c0b20d0 0x7f014c0c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:45.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.410+0000 7f01513ff700 1 --2- 172.21.15.37:0/3519829710 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f012c06ae00 0x7f012c06d2b0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:45.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.410+0000 7f01513ff700 1 --2- 172.21.15.37:0/3519829710 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f014c0d2680 0x7f014c14ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:45.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.410+0000 7f01513ff700 1 --2- 172.21.15.37:0/3519829710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f014c0b8720 0x7f014c0b32d0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:45.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.410+0000 7f01513ff700 1 -- 172.21.15.37:0/3519829710 >> 172.21.15.37:0/3519829710 conn(0x7f014c06a510 msgr2=0x7f014c15ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:45.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.410+0000 7f01513ff700 1 -- 172.21.15.37:0/3519829710 shutdown_connections 2023-07-14T15:58:45.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.410+0000 7f01513ff700 1 -- 172.21.15.37:0/3519829710 wait complete. 2023-07-14T15:58:45.412 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-14T15:58:45.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.630+0000 7fb8c9bff700 1 Processor -- start 2023-07-14T15:58:45.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.631+0000 7fb8c9bff700 1 -- start start 2023-07-14T15:58:45.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.632+0000 7fb8c9bff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb8c40b4c60 0x7fb8c40b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:45.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.632+0000 7fb8c9bff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb8c40d0b90 0x7fb8c40d0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:45.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.632+0000 7fb8c9bff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8c40cfb70 con 0x7fb8c40b4890 2023-07-14T15:58:45.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.632+0000 7fb8c9bff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8c40cfdc0 con 0x7fb8c40b4c60 2023-07-14T15:58:45.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.632+0000 7fb8c9bff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c40d00a0 con 0x7fb8c40d0b90 2023-07-14T15:58:45.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.632+0000 7fb8c2ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb8c40b4c60 0x7fb8c40b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:45.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.632+0000 7fb8c2ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb8c40b4c60 0x7fb8c40b50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41566/0 (socket says 172.21.15.37:41566) 2023-07-14T15:58:45.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.632+0000 7fb8c2ffd700 1 -- 172.21.15.37:0/4028589478 learned_addr learned my addr 172.21.15.37:0/4028589478 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:45.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.633+0000 7fb8c3fff700 1 --2- 172.21.15.37:0/4028589478 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb8c40d0b90 0x7fb8c40d0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:45.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.633+0000 7fb8c2ffd700 1 -- 172.21.15.37:0/4028589478 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb8c40d0b90 msgr2=0x7fb8c40d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:45.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.633+0000 7fb8c2ffd700 1 --2- 172.21.15.37:0/4028589478 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb8c40d0b90 0x7fb8c40d0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:45.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.633+0000 7fb8c2ffd700 1 -- 172.21.15.37:0/4028589478 >> v1:172.21.15.98:6789/0 conn(0x7fb8c40b4890 legacy=0x7fb8c40cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:45.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.633+0000 7fb8c2ffd700 1 -- 172.21.15.37:0/4028589478 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c40d0380 con 0x7fb8c40b4c60 2023-07-14T15:58:45.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.633+0000 7fb8c3fff700 1 --2- 172.21.15.37:0/4028589478 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb8c40d0b90 0x7fb8c40d0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:58:45.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.633+0000 7fb8c2ffd700 1 --2- 172.21.15.37:0/4028589478 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8c40b4c60 0x7fb8c40b50d0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fb8b80098f0 tx=0x7fb8b8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad48dd4c608d1ff server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:45.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.633+0000 7fb8c27fc700 1 -- 172.21.15.37:0/4028589478 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b8004230 con 0x7fb8c40b4c60 2023-07-14T15:58:45.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.633+0000 7fb8c27fc700 1 -- 172.21.15.37:0/4028589478 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b8004390 con 0x7fb8c40b4c60 2023-07-14T15:58:45.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.633+0000 7fb8c27fc700 1 -- 172.21.15.37:0/4028589478 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b80036a0 con 0x7fb8c40b4c60 2023-07-14T15:58:45.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.634+0000 7fb8c9bff700 1 -- 172.21.15.37:0/4028589478 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8c40b4c60 msgr2=0x7fb8c40b50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:45.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.634+0000 7fb8c9bff700 1 --2- 172.21.15.37:0/4028589478 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8c40b4c60 0x7fb8c40b50d0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fb8b80098f0 tx=0x7fb8b8009c00 comp rx=0 tx=0).stop 2023-07-14T15:58:45.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.634+0000 7fb8c9bff700 1 -- 172.21.15.37:0/4028589478 shutdown_connections 2023-07-14T15:58:45.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.634+0000 7fb8c9bff700 1 --2- 172.21.15.37:0/4028589478 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb8c40d0b90 0x7fb8c40d0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:45.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.634+0000 7fb8c9bff700 1 --2- 172.21.15.37:0/4028589478 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8c40b4c60 0x7fb8c40b50d0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:45.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.634+0000 7fb8c9bff700 1 -- 172.21.15.37:0/4028589478 >> 172.21.15.37:0/4028589478 conn(0x7fb8c406a540 msgr2=0x7fb8c406a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:45.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.634+0000 7fb8c9bff700 1 -- 172.21.15.37:0/4028589478 shutdown_connections 2023-07-14T15:58:45.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.634+0000 7fb8c9bff700 1 -- 172.21.15.37:0/4028589478 wait complete. 2023-07-14T15:58:45.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.636+0000 7fb8c9bff700 1 Processor -- start 2023-07-14T15:58:45.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.636+0000 7fb8c9bff700 1 -- start start 2023-07-14T15:58:45.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.637+0000 7fb8c9bff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8c40b4890 0x7fb8c40b3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:45.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.637+0000 7fb8c9bff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8c40b4c60 0x7fb8c40b4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:45.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.637+0000 7fb8c9bff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb8c40d0b90 0x7fb8c4148ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:45.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.637+0000 7fb8c9bff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c40c86c0 con 0x7fb8c40b4c60 2023-07-14T15:58:45.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.637+0000 7fb8c9bff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c40c8910 con 0x7fb8c40b4890 2023-07-14T15:58:45.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.637+0000 7fb8c9bff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c40c8bf0 con 0x7fb8c40d0b90 2023-07-14T15:58:45.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.637+0000 7fb8c2ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8c40b4c60 0x7fb8c40b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:45.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.637+0000 7fb8c2ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8c40b4c60 0x7fb8c40b4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41578/0 (socket says 172.21.15.37:41578) 2023-07-14T15:58:45.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.637+0000 7fb8c2ffd700 1 -- 172.21.15.37:0/1059331004 learned_addr learned my addr 172.21.15.37:0/1059331004 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:45.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.637+0000 7fb8c37fe700 1 --2- 172.21.15.37:0/1059331004 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8c40b4890 0x7fb8c40b3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:45.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.637+0000 7fb8c3fff700 1 --2- 172.21.15.37:0/1059331004 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb8c40d0b90 0x7fb8c4148ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:45.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.637+0000 7fb8c2ffd700 1 -- 172.21.15.37:0/1059331004 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb8c40d0b90 msgr2=0x7fb8c4148ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:45.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.637+0000 7fb8c2ffd700 1 --2- 172.21.15.37:0/1059331004 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb8c40d0b90 0x7fb8c4148ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:45.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.637+0000 7fb8c2ffd700 1 -- 172.21.15.37:0/1059331004 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8c40b4890 msgr2=0x7fb8c40b3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:45.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.637+0000 7fb8c2ffd700 1 --2- 172.21.15.37:0/1059331004 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8c40b4890 0x7fb8c40b3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:45.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.637+0000 7fb8c2ffd700 1 -- 172.21.15.37:0/1059331004 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b8009550 con 0x7fb8c40b4c60 2023-07-14T15:58:45.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.637+0000 7fb8c3fff700 1 --2- 172.21.15.37:0/1059331004 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb8c40d0b90 0x7fb8c4148ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:58:45.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.638+0000 7fb8c2ffd700 1 --2- 172.21.15.37:0/1059331004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8c40b4c60 0x7fb8c40b4270 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8009130 tx=0x7fb8b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:45.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.638+0000 7fb8abfff700 1 -- 172.21.15.37:0/1059331004 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b8003d80 con 0x7fb8c40b4c60 2023-07-14T15:58:45.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.638+0000 7fb8abfff700 1 -- 172.21.15.37:0/1059331004 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b801f070 con 0x7fb8c40b4c60 2023-07-14T15:58:45.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.638+0000 7fb8c9bff700 1 -- 172.21.15.37:0/1059331004 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8c40c8ed0 con 0x7fb8c40b4c60 2023-07-14T15:58:45.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.638+0000 7fb8abfff700 1 -- 172.21.15.37:0/1059331004 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b800b8a0 con 0x7fb8c40b4c60 2023-07-14T15:58:45.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.638+0000 7fb8c9bff700 1 -- 172.21.15.37:0/1059331004 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8c40c9490 con 0x7fb8c40b4c60 2023-07-14T15:58:45.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.639+0000 7fb8c9bff700 1 -- 172.21.15.37:0/1059331004 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8c40c9620 con 0x7fb8c40b4c60 2023-07-14T15:58:45.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.640+0000 7fb8abfff700 1 -- 172.21.15.37:0/1059331004 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fb8b8021030 con 0x7fb8c40b4c60 2023-07-14T15:58:45.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.641+0000 7fb8abfff700 1 --2- 172.21.15.37:0/1059331004 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb8b006ae00 0x7fb8b006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:45.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.641+0000 7fb8abfff700 1 -- 172.21.15.37:0/1059331004 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6118+0+0 (secure 0 0 0) 0x7fb8b808ac80 con 0x7fb8c40b4c60 2023-07-14T15:58:45.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.641+0000 7fb8c37fe700 1 --2- 172.21.15.37:0/1059331004 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb8b006ae00 0x7fb8b006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:45.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.642+0000 7fb8c37fe700 1 --2- 172.21.15.37:0/1059331004 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb8b006ae00 0x7fb8b006d2b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4009960 tx=0x7fb8b40090e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:45.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.645+0000 7fb8abfff700 1 -- 172.21.15.37:0/1059331004 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb8b8055cf0 con 0x7fb8c40b4c60 2023-07-14T15:58:45.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.896+0000 7fb8c9bff700 1 -- 172.21.15.37:0/1059331004 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb8c40c9620 con 0x7fb8c40b4c60 2023-07-14T15:58:45.881 INFO:tasks.ceph.mon.a.smithi037.stderr:2023-07-14T15:58:45.896+0000 7f853c3f4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-14T15:58:45.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.901+0000 7fb8abfff700 1 -- 172.21.15.37:0/1059331004 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v27) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb8b8059310 con 0x7fb8c40b4c60 2023-07-14T15:58:45.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.905+0000 7fb8c9bff700 1 -- 172.21.15.37:0/1059331004 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb8b006ae00 msgr2=0x7fb8b006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:45.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.905+0000 7fb8c9bff700 1 --2- 172.21.15.37:0/1059331004 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb8b006ae00 0x7fb8b006d2b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4009960 tx=0x7fb8b40090e0 comp rx=0 tx=0).stop 2023-07-14T15:58:45.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.905+0000 7fb8c9bff700 1 -- 172.21.15.37:0/1059331004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8c40b4c60 msgr2=0x7fb8c40b4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:45.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.905+0000 7fb8c9bff700 1 --2- 172.21.15.37:0/1059331004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8c40b4c60 0x7fb8c40b4270 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8009130 tx=0x7fb8b8004750 comp rx=0 tx=0).stop 2023-07-14T15:58:45.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.905+0000 7fb8c9bff700 1 -- 172.21.15.37:0/1059331004 shutdown_connections 2023-07-14T15:58:45.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.905+0000 7fb8c9bff700 1 --2- 172.21.15.37:0/1059331004 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8c40b4890 0x7fb8c40b3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:45.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.905+0000 7fb8c9bff700 1 --2- 172.21.15.37:0/1059331004 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb8b006ae00 0x7fb8b006d2b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:45.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.905+0000 7fb8c9bff700 1 --2- 172.21.15.37:0/1059331004 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb8c40d0b90 0x7fb8c4148ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:45.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.905+0000 7fb8c9bff700 1 --2- 172.21.15.37:0/1059331004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8c40b4c60 0x7fb8c40b4270 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:45.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.905+0000 7fb8c9bff700 1 -- 172.21.15.37:0/1059331004 >> 172.21.15.37:0/1059331004 conn(0x7fb8c406a540 msgr2=0x7fb8c415de90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:45.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.905+0000 7fb8c9bff700 1 -- 172.21.15.37:0/1059331004 shutdown_connections 2023-07-14T15:58:45.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:45.905+0000 7fb8c9bff700 1 -- 172.21.15.37:0/1059331004 wait complete. 2023-07-14T15:58:45.891 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-14T15:58:45.909 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-14T15:58:45.957 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-07-14T15:58:46.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.133+0000 7fd0fdfff700 1 Processor -- start 2023-07-14T15:58:46.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.133+0000 7fd0fdfff700 1 -- start start 2023-07-14T15:58:46.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.134+0000 7fd0fdfff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd0f815c990 0x7fd0f80ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:46.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.134+0000 7fd0fdfff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0f806b310 con 0x7fd0f80cc440 2023-07-14T15:58:46.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.134+0000 7fd0fdfff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0f80ccab0 con 0x7fd0f815cd60 2023-07-14T15:58:46.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.134+0000 7fd0fdfff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0f80cc8a0 con 0x7fd0f815c990 2023-07-14T15:58:46.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.134+0000 7fd0f77fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd0f815c990 0x7fd0f80ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:46.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.134+0000 7fd0f77fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd0f815c990 0x7fd0f80ceb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41602/0 (socket says 172.21.15.37:41602) 2023-07-14T15:58:46.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.134+0000 7fd0f77fe700 1 -- 172.21.15.37:0/943779713 learned_addr learned my addr 172.21.15.37:0/943779713 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:46.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.135+0000 7fd0f77fe700 1 -- 172.21.15.37:0/943779713 >> v1:172.21.15.98:6789/0 conn(0x7fd0f815cd60 legacy=0x7fd0f80cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:46.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.135+0000 7fd0f77fe700 1 -- 172.21.15.37:0/943779713 >> v1:172.21.15.37:6789/0 conn(0x7fd0f80cc440 legacy=0x7fd0f806b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:46.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.135+0000 7fd0f77fe700 1 -- 172.21.15.37:0/943779713 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f80ccd90 con 0x7fd0f815c990 2023-07-14T15:58:46.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.135+0000 7fd0f67fc700 1 -- 172.21.15.37:0/943779713 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3334302337 0 0) 0x7fd0f806b310 con 0x7fd0f80cc440 2023-07-14T15:58:46.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.135+0000 7fd0f77fe700 1 --2- 172.21.15.37:0/943779713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0f815c990 0x7fd0f80ceb00 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fd0e80098f0 tx=0x7fd0e8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ad1525ebda97e28 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:46.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.135+0000 7fd0f67fc700 1 -- 172.21.15.37:0/943779713 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e800b8a0 con 0x7fd0f815c990 2023-07-14T15:58:46.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.135+0000 7fd0f67fc700 1 -- 172.21.15.37:0/943779713 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e800ba00 con 0x7fd0f815c990 2023-07-14T15:58:46.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.135+0000 7fd0f67fc700 1 -- 172.21.15.37:0/943779713 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e800bd90 con 0x7fd0f815c990 2023-07-14T15:58:46.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.136+0000 7fd0fdfff700 1 -- 172.21.15.37:0/943779713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0f815c990 msgr2=0x7fd0f80ceb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:46.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.136+0000 7fd0fdfff700 1 --2- 172.21.15.37:0/943779713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0f815c990 0x7fd0f80ceb00 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fd0e80098f0 tx=0x7fd0e8009c00 comp rx=0 tx=0).stop 2023-07-14T15:58:46.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.136+0000 7fd0fdfff700 1 -- 172.21.15.37:0/943779713 shutdown_connections 2023-07-14T15:58:46.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.136+0000 7fd0fdfff700 1 --2- 172.21.15.37:0/943779713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0f815c990 0x7fd0f80ceb00 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:46.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.136+0000 7fd0fdfff700 1 -- 172.21.15.37:0/943779713 >> 172.21.15.37:0/943779713 conn(0x7fd0f8099ff0 msgr2=0x7fd0f80d0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:46.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.136+0000 7fd0fdfff700 1 -- 172.21.15.37:0/943779713 shutdown_connections 2023-07-14T15:58:46.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.136+0000 7fd0fdfff700 1 -- 172.21.15.37:0/943779713 wait complete. 2023-07-14T15:58:46.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.138+0000 7fd0fdfff700 1 Processor -- start 2023-07-14T15:58:46.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.138+0000 7fd0fdfff700 1 -- start start 2023-07-14T15:58:46.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.139+0000 7fd0fdfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0f80cc440 0x7fd0f815f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:46.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.139+0000 7fd0fdfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0f815c990 0x7fd0f80c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:46.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.139+0000 7fd0fdfff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd0f815cd60 0x7fd0f80cb350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:46.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.139+0000 7fd0fdfff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f80c8bd0 con 0x7fd0f815c990 2023-07-14T15:58:46.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.139+0000 7fd0fdfff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f815fea0 con 0x7fd0f80cc440 2023-07-14T15:58:46.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.139+0000 7fd0fdfff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f81f5620 con 0x7fd0f815cd60 2023-07-14T15:58:46.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.139+0000 7fd0f6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0f815c990 0x7fd0f80c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:46.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.139+0000 7fd0f6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0f815c990 0x7fd0f80c7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41612/0 (socket says 172.21.15.37:41612) 2023-07-14T15:58:46.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.139+0000 7fd0f6ffd700 1 -- 172.21.15.37:0/2935386098 learned_addr learned my addr 172.21.15.37:0/2935386098 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:46.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.139+0000 7fd0f77fe700 1 --2- 172.21.15.37:0/2935386098 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0f80cc440 0x7fd0f815f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:46.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.139+0000 7fd0f6ffd700 1 -- 172.21.15.37:0/2935386098 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd0f815cd60 msgr2=0x7fd0f80cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:46.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.139+0000 7fd0f6ffd700 1 --2- 172.21.15.37:0/2935386098 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd0f815cd60 0x7fd0f80cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:46.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.139+0000 7fd0f6ffd700 1 -- 172.21.15.37:0/2935386098 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0f80cc440 msgr2=0x7fd0f815f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:46.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.139+0000 7fd0f6ffd700 1 --2- 172.21.15.37:0/2935386098 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0f80cc440 0x7fd0f815f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:46.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.139+0000 7fd0f6ffd700 1 -- 172.21.15.37:0/2935386098 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e8009550 con 0x7fd0f815c990 2023-07-14T15:58:46.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.140+0000 7fd0f77fe700 1 --2- 172.21.15.37:0/2935386098 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0f80cc440 0x7fd0f815f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:58:46.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.140+0000 7fd0f6ffd700 1 --2- 172.21.15.37:0/2935386098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0f815c990 0x7fd0f80c7df0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec00c450 tx=0x7fd0ec00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:46.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.140+0000 7fd0dffff700 1 -- 172.21.15.37:0/2935386098 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ec0052d0 con 0x7fd0f815c990 2023-07-14T15:58:46.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.140+0000 7fd0dffff700 1 -- 172.21.15.37:0/2935386098 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0ec005430 con 0x7fd0f815c990 2023-07-14T15:58:46.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.140+0000 7fd0fdfff700 1 -- 172.21.15.37:0/2935386098 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0f81f5e80 con 0x7fd0f815c990 2023-07-14T15:58:46.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.140+0000 7fd0dffff700 1 -- 172.21.15.37:0/2935386098 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ec0038c0 con 0x7fd0f815c990 2023-07-14T15:58:46.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.140+0000 7fd0fdfff700 1 -- 172.21.15.37:0/2935386098 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0f81f5830 con 0x7fd0f815c990 2023-07-14T15:58:46.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.141+0000 7fd0fdfff700 1 -- 172.21.15.37:0/2935386098 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0f81f6010 con 0x7fd0f815c990 2023-07-14T15:58:46.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.142+0000 7fd0dffff700 1 -- 172.21.15.37:0/2935386098 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fd0ec003a20 con 0x7fd0f815c990 2023-07-14T15:58:46.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.143+0000 7fd0dffff700 1 --2- 172.21.15.37:0/2935386098 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd0e406ae00 0x7fd0e406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:46.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.143+0000 7fd0dffff700 1 -- 172.21.15.37:0/2935386098 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6176+0+0 (secure 0 0 0) 0x7fd0ec088b50 con 0x7fd0f815c990 2023-07-14T15:58:46.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.144+0000 7fd0f77fe700 1 --2- 172.21.15.37:0/2935386098 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd0e406ae00 0x7fd0e406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:46.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.144+0000 7fd0f77fe700 1 --2- 172.21.15.37:0/2935386098 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd0e406ae00 0x7fd0e406d2b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd0f81f5580 tx=0x7fd0e8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:46.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.147+0000 7fd0dffff700 1 -- 172.21.15.37:0/2935386098 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd0ec053a00 con 0x7fd0f815c990 2023-07-14T15:58:46.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.403+0000 7fd0fdfff700 1 -- 172.21.15.37:0/2935386098 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd0f8067840 con 0x7fd0f815c990 2023-07-14T15:58:46.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.902+0000 7fd0dffff700 1 -- 172.21.15.37:0/2935386098 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v28) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd0ec057020 con 0x7fd0f815c990 2023-07-14T15:58:46.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.905+0000 7fd0fdfff700 1 -- 172.21.15.37:0/2935386098 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd0e406ae00 msgr2=0x7fd0e406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:46.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.905+0000 7fd0fdfff700 1 --2- 172.21.15.37:0/2935386098 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd0e406ae00 0x7fd0e406d2b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd0f81f5580 tx=0x7fd0e8008030 comp rx=0 tx=0).stop 2023-07-14T15:58:46.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.905+0000 7fd0fdfff700 1 -- 172.21.15.37:0/2935386098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0f815c990 msgr2=0x7fd0f80c7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:46.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.905+0000 7fd0fdfff700 1 --2- 172.21.15.37:0/2935386098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0f815c990 0x7fd0f80c7df0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec00c450 tx=0x7fd0ec00c810 comp rx=0 tx=0).stop 2023-07-14T15:58:46.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.905+0000 7fd0fdfff700 1 -- 172.21.15.37:0/2935386098 shutdown_connections 2023-07-14T15:58:46.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.905+0000 7fd0fdfff700 1 --2- 172.21.15.37:0/2935386098 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0f80cc440 0x7fd0f815f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:46.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.905+0000 7fd0fdfff700 1 --2- 172.21.15.37:0/2935386098 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd0e406ae00 0x7fd0e406d2b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:46.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.905+0000 7fd0fdfff700 1 --2- 172.21.15.37:0/2935386098 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd0f815cd60 0x7fd0f80cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:46.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.905+0000 7fd0fdfff700 1 --2- 172.21.15.37:0/2935386098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0f815c990 0x7fd0f80c7df0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:46.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.905+0000 7fd0fdfff700 1 -- 172.21.15.37:0/2935386098 >> 172.21.15.37:0/2935386098 conn(0x7fd0f8099ff0 msgr2=0x7fd0f80cfec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:46.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.906+0000 7fd0fdfff700 1 -- 172.21.15.37:0/2935386098 shutdown_connections 2023-07-14T15:58:46.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:46.906+0000 7fd0fdfff700 1 -- 172.21.15.37:0/2935386098 wait complete. 2023-07-14T15:58:46.911 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-14T15:58:47.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.135+0000 7fda819ff700 1 Processor -- start 2023-07-14T15:58:47.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.135+0000 7fda819ff700 1 -- start start 2023-07-14T15:58:47.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.136+0000 7fda819ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fda7c1462d0 0x7fda7c0cd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:47.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.136+0000 7fda819ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fda7c0d2310 0x7fda7c0d09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:47.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.136+0000 7fda819ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda7c0d1270 con 0x7fda7c0cf780 2023-07-14T15:58:47.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.136+0000 7fda819ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda7c0d1550 con 0x7fda7c1462d0 2023-07-14T15:58:47.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.136+0000 7fda819ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c0d1830 con 0x7fda7c0d2310 2023-07-14T15:58:47.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.137+0000 7fda7affd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fda7c1462d0 0x7fda7c0cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:47.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.137+0000 7fda7affd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fda7c1462d0 0x7fda7c0cd890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41614/0 (socket says 172.21.15.37:41614) 2023-07-14T15:58:47.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.137+0000 7fda7affd700 1 -- 172.21.15.37:0/4207981255 learned_addr learned my addr 172.21.15.37:0/4207981255 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:47.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.137+0000 7fda7b7fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fda7c0cf780 0x7fda7c0cfc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:49940/0 (socket says 172.21.15.37:49940) 2023-07-14T15:58:47.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.137+0000 7fda7a7fc700 1 --2- 172.21.15.37:0/4207981255 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fda7c0d2310 0x7fda7c0d09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:47.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.137+0000 7fda7affd700 1 -- 172.21.15.37:0/4207981255 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fda7c0d2310 msgr2=0x7fda7c0d09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:47.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.137+0000 7fda7affd700 1 --2- 172.21.15.37:0/4207981255 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fda7c0d2310 0x7fda7c0d09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:47.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.137+0000 7fda79ffb700 1 -- 172.21.15.37:0/4207981255 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 890216358 0 0) 0x7fda7c0d1270 con 0x7fda7c0cf780 2023-07-14T15:58:47.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.137+0000 7fda7affd700 1 -- 172.21.15.37:0/4207981255 >> v1:172.21.15.37:6789/0 conn(0x7fda7c0cf780 legacy=0x7fda7c0cfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:47.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.137+0000 7fda7affd700 1 -- 172.21.15.37:0/4207981255 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda7c0d1b10 con 0x7fda7c1462d0 2023-07-14T15:58:47.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.137+0000 7fda7a7fc700 1 --2- 172.21.15.37:0/4207981255 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fda7c0d2310 0x7fda7c0d09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:58:47.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.137+0000 7fda7affd700 1 --2- 172.21.15.37:0/4207981255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda7c1462d0 0x7fda7c0cd890 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fda6c0098f0 tx=0x7fda6c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0096ab1945563c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:47.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.138+0000 7fda79ffb700 1 -- 172.21.15.37:0/4207981255 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6c00b8a0 con 0x7fda7c1462d0 2023-07-14T15:58:47.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.138+0000 7fda79ffb700 1 -- 172.21.15.37:0/4207981255 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda6c00ba00 con 0x7fda7c1462d0 2023-07-14T15:58:47.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.138+0000 7fda79ffb700 1 -- 172.21.15.37:0/4207981255 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6c00bd90 con 0x7fda7c1462d0 2023-07-14T15:58:47.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.138+0000 7fda819ff700 1 -- 172.21.15.37:0/4207981255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda7c1462d0 msgr2=0x7fda7c0cd890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:47.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.138+0000 7fda819ff700 1 --2- 172.21.15.37:0/4207981255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda7c1462d0 0x7fda7c0cd890 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fda6c0098f0 tx=0x7fda6c009c00 comp rx=0 tx=0).stop 2023-07-14T15:58:47.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.138+0000 7fda819ff700 1 -- 172.21.15.37:0/4207981255 shutdown_connections 2023-07-14T15:58:47.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.138+0000 7fda819ff700 1 --2- 172.21.15.37:0/4207981255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda7c1462d0 0x7fda7c0cd890 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:47.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.138+0000 7fda819ff700 1 --2- 172.21.15.37:0/4207981255 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fda7c0d2310 0x7fda7c0d09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:47.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.138+0000 7fda819ff700 1 -- 172.21.15.37:0/4207981255 >> 172.21.15.37:0/4207981255 conn(0x7fda7c06a4d0 msgr2=0x7fda7c06a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:47.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.138+0000 7fda819ff700 1 -- 172.21.15.37:0/4207981255 shutdown_connections 2023-07-14T15:58:47.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.138+0000 7fda819ff700 1 -- 172.21.15.37:0/4207981255 wait complete. 2023-07-14T15:58:47.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.140+0000 7fda819ff700 1 Processor -- start 2023-07-14T15:58:47.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.140+0000 7fda819ff700 1 -- start start 2023-07-14T15:58:47.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.141+0000 7fda819ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda7c0cf780 0x7fda7c0b3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:47.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.141+0000 7fda819ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fda7c0d2310 0x7fda7c0b7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:47.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.141+0000 7fda819ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda7c1462d0 0x7fda7c0b81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:47.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.141+0000 7fda819ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c0b37b0 con 0x7fda7c0cf780 2023-07-14T15:58:47.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.141+0000 7fda819ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c0b3a80 con 0x7fda7c1462d0 2023-07-14T15:58:47.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.141+0000 7fda819ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c1430e0 con 0x7fda7c0d2310 2023-07-14T15:58:47.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.141+0000 7fda7affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda7c0cf780 0x7fda7c0b3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:47.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.142+0000 7fda7affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda7c0cf780 0x7fda7c0b3270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41630/0 (socket says 172.21.15.37:41630) 2023-07-14T15:58:47.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.142+0000 7fda7affd700 1 -- 172.21.15.37:0/1949209507 learned_addr learned my addr 172.21.15.37:0/1949209507 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:47.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.142+0000 7fda7b7fe700 1 --2- 172.21.15.37:0/1949209507 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda7c1462d0 0x7fda7c0b81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:47.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.142+0000 7fda7a7fc700 1 --2- 172.21.15.37:0/1949209507 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fda7c0d2310 0x7fda7c0b7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:47.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.142+0000 7fda7affd700 1 -- 172.21.15.37:0/1949209507 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fda7c0d2310 msgr2=0x7fda7c0b7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:47.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.142+0000 7fda7affd700 1 --2- 172.21.15.37:0/1949209507 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fda7c0d2310 0x7fda7c0b7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:47.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.142+0000 7fda7affd700 1 -- 172.21.15.37:0/1949209507 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda7c1462d0 msgr2=0x7fda7c0b81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:47.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.142+0000 7fda7affd700 1 --2- 172.21.15.37:0/1949209507 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda7c1462d0 0x7fda7c0b81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:47.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.142+0000 7fda7affd700 1 -- 172.21.15.37:0/1949209507 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda6c009550 con 0x7fda7c0cf780 2023-07-14T15:58:47.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.142+0000 7fda7a7fc700 1 --2- 172.21.15.37:0/1949209507 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fda7c0d2310 0x7fda7c0b7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:58:47.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.142+0000 7fda7affd700 1 --2- 172.21.15.37:0/1949209507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda7c0cf780 0x7fda7c0b3270 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fda6c000c00 tx=0x7fda6c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:47.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.142+0000 7fda63fff700 1 -- 172.21.15.37:0/1949209507 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6c0036a0 con 0x7fda7c0cf780 2023-07-14T15:58:47.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.142+0000 7fda63fff700 1 -- 172.21.15.37:0/1949209507 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda6c01e070 con 0x7fda7c0cf780 2023-07-14T15:58:47.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.142+0000 7fda63fff700 1 -- 172.21.15.37:0/1949209507 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6c003a20 con 0x7fda7c0cf780 2023-07-14T15:58:47.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.142+0000 7fda819ff700 1 -- 172.21.15.37:0/1949209507 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda7c1433c0 con 0x7fda7c0cf780 2023-07-14T15:58:47.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.143+0000 7fda819ff700 1 -- 172.21.15.37:0/1949209507 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda7c143980 con 0x7fda7c0cf780 2023-07-14T15:58:47.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.144+0000 7fda819ff700 1 -- 172.21.15.37:0/1949209507 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda7c067840 con 0x7fda7c0cf780 2023-07-14T15:58:47.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.145+0000 7fda63fff700 1 -- 172.21.15.37:0/1949209507 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fda6c003b80 con 0x7fda7c0cf780 2023-07-14T15:58:47.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.146+0000 7fda63fff700 1 --2- 172.21.15.37:0/1949209507 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fda6806ae00 0x7fda6806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:47.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.146+0000 7fda63fff700 1 -- 172.21.15.37:0/1949209507 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6176+0+0 (secure 0 0 0) 0x7fda6c020070 con 0x7fda7c0cf780 2023-07-14T15:58:47.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.146+0000 7fda7a7fc700 1 --2- 172.21.15.37:0/1949209507 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fda6806ae00 0x7fda6806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:47.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.147+0000 7fda7a7fc700 1 --2- 172.21.15.37:0/1949209507 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fda6806ae00 0x7fda6806d2b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fda7c15eea0 tx=0x7fda70008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:47.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.150+0000 7fda63fff700 1 -- 172.21.15.37:0/1949209507 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fda6c055b80 con 0x7fda7c0cf780 2023-07-14T15:58:47.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:47.356+0000 7fda819ff700 1 -- 172.21.15.37:0/1949209507 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fda7c15af80 con 0x7fda7c0cf780 2023-07-14T15:58:47.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.010+0000 7fda63fff700 1 -- 172.21.15.37:0/1949209507 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v52) v1 ==== 181+0+0 (secure 0 0 0) 0x7fda6c0150d0 con 0x7fda7c0cf780 2023-07-14T15:58:48.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.016+0000 7fda819ff700 1 -- 172.21.15.37:0/1949209507 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fda6806ae00 msgr2=0x7fda6806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:48.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.016+0000 7fda819ff700 1 --2- 172.21.15.37:0/1949209507 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fda6806ae00 0x7fda6806d2b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fda7c15eea0 tx=0x7fda70008040 comp rx=0 tx=0).stop 2023-07-14T15:58:48.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.016+0000 7fda819ff700 1 -- 172.21.15.37:0/1949209507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda7c0cf780 msgr2=0x7fda7c0b3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:48.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.016+0000 7fda819ff700 1 --2- 172.21.15.37:0/1949209507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda7c0cf780 0x7fda7c0b3270 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fda6c000c00 tx=0x7fda6c004750 comp rx=0 tx=0).stop 2023-07-14T15:58:48.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.016+0000 7fda819ff700 1 -- 172.21.15.37:0/1949209507 shutdown_connections 2023-07-14T15:58:48.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.016+0000 7fda819ff700 1 --2- 172.21.15.37:0/1949209507 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda7c1462d0 0x7fda7c0b81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:48.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.016+0000 7fda819ff700 1 --2- 172.21.15.37:0/1949209507 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fda6806ae00 0x7fda6806d2b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:48.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.016+0000 7fda819ff700 1 --2- 172.21.15.37:0/1949209507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda7c0cf780 0x7fda7c0b3270 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:48.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.016+0000 7fda819ff700 1 --2- 172.21.15.37:0/1949209507 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fda7c0d2310 0x7fda7c0b7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:48.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.016+0000 7fda819ff700 1 -- 172.21.15.37:0/1949209507 >> 172.21.15.37:0/1949209507 conn(0x7fda7c06a4d0 msgr2=0x7fda7c0b5c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:48.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.018+0000 7fda819ff700 1 -- 172.21.15.37:0/1949209507 shutdown_connections 2023-07-14T15:58:48.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.019+0000 7fda819ff700 1 -- 172.21.15.37:0/1949209507 wait complete. 2023-07-14T15:58:48.006 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2023-07-14T15:58:48.026 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-14T15:58:48.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.254+0000 7f7423bff700 1 Processor -- start 2023-07-14T15:58:48.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.254+0000 7f7423bff700 1 -- start start 2023-07-14T15:58:48.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.255+0000 7f7423bff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f741c0cd890 0x7f741c0d09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:48.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.255+0000 7f7423bff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f741c0cf780 0x7f741c0cfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:48.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.255+0000 7f7423bff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f741c0d0140 con 0x7f741c1462d0 2023-07-14T15:58:48.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.255+0000 7f7423bff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f741c0cdd00 con 0x7f741c0cf780 2023-07-14T15:58:48.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.255+0000 7f7423bff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f741c0d1270 con 0x7f741c0cd890 2023-07-14T15:58:48.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.255+0000 7f742219c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f741c0cf780 0x7f741c0cfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:48.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.255+0000 7f742219c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f741c0cf780 0x7f741c0cfc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41638/0 (socket says 172.21.15.37:41638) 2023-07-14T15:58:48.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.255+0000 7f742219c700 1 -- 172.21.15.37:0/1910002949 learned_addr learned my addr 172.21.15.37:0/1910002949 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:48.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.255+0000 7f742119a700 1 --2- 172.21.15.37:0/1910002949 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f741c0cd890 0x7f741c0d09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:48.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.256+0000 7f742219c700 1 -- 172.21.15.37:0/1910002949 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f741c0cd890 msgr2=0x7f741c0d09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:48.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.256+0000 7f742219c700 1 --2- 172.21.15.37:0/1910002949 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f741c0cd890 0x7f741c0d09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:48.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.256+0000 7f742219c700 1 -- 172.21.15.37:0/1910002949 >> v1:172.21.15.98:6789/0 conn(0x7f741c1462d0 legacy=0x7f741c0d2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:48.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.256+0000 7f742219c700 1 -- 172.21.15.37:0/1910002949 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f741c0d1550 con 0x7f741c0cf780 2023-07-14T15:58:48.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.256+0000 7f742119a700 1 --2- 172.21.15.37:0/1910002949 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f741c0cd890 0x7f741c0d09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:58:48.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.256+0000 7f742219c700 1 --2- 172.21.15.37:0/1910002949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f741c0cf780 0x7f741c0cfc00 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f7414009e50 tx=0x7f741400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91a1658dafa12453 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:48.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.256+0000 7f7420999700 1 -- 172.21.15.37:0/1910002949 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741400e070 con 0x7f741c0cf780 2023-07-14T15:58:48.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.256+0000 7f7420999700 1 -- 172.21.15.37:0/1910002949 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f741400b9c0 con 0x7f741c0cf780 2023-07-14T15:58:48.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.256+0000 7f7420999700 1 -- 172.21.15.37:0/1910002949 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741400bd70 con 0x7f741c0cf780 2023-07-14T15:58:48.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.257+0000 7f7423bff700 1 -- 172.21.15.37:0/1910002949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f741c0cf780 msgr2=0x7f741c0cfc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:48.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.257+0000 7f7423bff700 1 --2- 172.21.15.37:0/1910002949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f741c0cf780 0x7f741c0cfc00 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f7414009e50 tx=0x7f741400b330 comp rx=0 tx=0).stop 2023-07-14T15:58:48.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.257+0000 7f7423bff700 1 -- 172.21.15.37:0/1910002949 shutdown_connections 2023-07-14T15:58:48.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.257+0000 7f7423bff700 1 --2- 172.21.15.37:0/1910002949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f741c0cf780 0x7f741c0cfc00 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:48.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.257+0000 7f7423bff700 1 --2- 172.21.15.37:0/1910002949 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f741c0cd890 0x7f741c0d09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:48.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.257+0000 7f7423bff700 1 -- 172.21.15.37:0/1910002949 >> 172.21.15.37:0/1910002949 conn(0x7f741c06a4d0 msgr2=0x7f741c06a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:48.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.257+0000 7f7423bff700 1 -- 172.21.15.37:0/1910002949 shutdown_connections 2023-07-14T15:58:48.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.257+0000 7f7423bff700 1 -- 172.21.15.37:0/1910002949 wait complete. 2023-07-14T15:58:48.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.259+0000 7f7423bff700 1 Processor -- start 2023-07-14T15:58:48.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.259+0000 7f7423bff700 1 -- start start 2023-07-14T15:58:48.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.260+0000 7f7423bff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f741c0cd890 0x7f741c0cc200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:48.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.260+0000 7f7423bff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f741c0cf780 0x7f741c0ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:48.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.260+0000 7f7423bff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f741c1462d0 0x7f741c15aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:48.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.260+0000 7f7423bff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741c0cc8c0 con 0x7f741c1462d0 2023-07-14T15:58:48.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.260+0000 7f7423bff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741c0c7800 con 0x7f741c0cd890 2023-07-14T15:58:48.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.260+0000 7f7423bff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f741c0c6a40 con 0x7f741c0cf780 2023-07-14T15:58:48.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.260+0000 7f742219c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f741c1462d0 0x7f741c15aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:48.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.260+0000 7f742219c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f741c1462d0 0x7f741c15aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41652/0 (socket says 172.21.15.37:41652) 2023-07-14T15:58:48.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.260+0000 7f742219c700 1 -- 172.21.15.37:0/2922618038 learned_addr learned my addr 172.21.15.37:0/2922618038 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:48.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.260+0000 7f742199b700 1 --2- 172.21.15.37:0/2922618038 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f741c0cd890 0x7f741c0cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:48.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.260+0000 7f742119a700 1 --2- 172.21.15.37:0/2922618038 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f741c0cf780 0x7f741c0ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:48.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.260+0000 7f742219c700 1 -- 172.21.15.37:0/2922618038 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f741c0cf780 msgr2=0x7f741c0ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:48.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.260+0000 7f742219c700 1 --2- 172.21.15.37:0/2922618038 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f741c0cf780 0x7f741c0ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:48.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.260+0000 7f742219c700 1 -- 172.21.15.37:0/2922618038 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f741c0cd890 msgr2=0x7f741c0cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:48.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.260+0000 7f742219c700 1 --2- 172.21.15.37:0/2922618038 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f741c0cd890 0x7f741c0cc200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:48.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.260+0000 7f742219c700 1 -- 172.21.15.37:0/2922618038 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7414009b30 con 0x7f741c1462d0 2023-07-14T15:58:48.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.260+0000 7f742119a700 1 --2- 172.21.15.37:0/2922618038 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f741c0cf780 0x7f741c0ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:58:48.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.260+0000 7f742199b700 1 --2- 172.21.15.37:0/2922618038 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f741c0cd890 0x7f741c0cc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:58:48.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.261+0000 7f742219c700 1 --2- 172.21.15.37:0/2922618038 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f741c1462d0 0x7f741c15aa60 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f741c0b59f0 tx=0x7f7414004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:48.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.261+0000 7f74127fc700 1 -- 172.21.15.37:0/2922618038 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7414004960 con 0x7f741c1462d0 2023-07-14T15:58:48.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.261+0000 7f74127fc700 1 -- 172.21.15.37:0/2922618038 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74140099b0 con 0x7f741c1462d0 2023-07-14T15:58:48.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.261+0000 7f74127fc700 1 -- 172.21.15.37:0/2922618038 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741401c680 con 0x7f741c1462d0 2023-07-14T15:58:48.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.261+0000 7f7423bff700 1 -- 172.21.15.37:0/2922618038 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f741c0c6d20 con 0x7f741c1462d0 2023-07-14T15:58:48.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.261+0000 7f7423bff700 1 -- 172.21.15.37:0/2922618038 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f741c0c72e0 con 0x7f741c1462d0 2023-07-14T15:58:48.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.262+0000 7f7423bff700 1 -- 172.21.15.37:0/2922618038 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f741c067840 con 0x7f741c1462d0 2023-07-14T15:58:48.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.263+0000 7f74127fc700 1 -- 172.21.15.37:0/2922618038 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f741401c7e0 con 0x7f741c1462d0 2023-07-14T15:58:48.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.264+0000 7f74127fc700 1 --2- 172.21.15.37:0/2922618038 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f740006ae00 0x7f740006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:48.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.264+0000 7f74127fc700 1 -- 172.21.15.37:0/2922618038 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f741408b3c0 con 0x7f741c1462d0 2023-07-14T15:58:48.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.265+0000 7f742199b700 1 --2- 172.21.15.37:0/2922618038 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f740006ae00 0x7f740006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:48.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.265+0000 7f742199b700 1 --2- 172.21.15.37:0/2922618038 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f740006ae00 0x7f740006d2b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f741c15f9d0 tx=0x7f7418009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:48.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.268+0000 7f74127fc700 1 -- 172.21.15.37:0/2922618038 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7414056360 con 0x7f741c1462d0 2023-07-14T15:58:48.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:48.481+0000 7f7423bff700 1 -- 172.21.15.37:0/2922618038 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f741c15cb20 con 0x7f741c1462d0 2023-07-14T15:58:49.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.016+0000 7f74127fc700 1 -- 172.21.15.37:0/2922618038 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v53) v1 ==== 169+0+0 (secure 0 0 0) 0x7f7414059980 con 0x7f741c1462d0 2023-07-14T15:58:49.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.020+0000 7f7423bff700 1 -- 172.21.15.37:0/2922618038 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f740006ae00 msgr2=0x7f740006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:49.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.020+0000 7f7423bff700 1 --2- 172.21.15.37:0/2922618038 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f740006ae00 0x7f740006d2b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f741c15f9d0 tx=0x7f7418009040 comp rx=0 tx=0).stop 2023-07-14T15:58:49.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.020+0000 7f7423bff700 1 -- 172.21.15.37:0/2922618038 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f741c1462d0 msgr2=0x7f741c15aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:49.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.020+0000 7f7423bff700 1 --2- 172.21.15.37:0/2922618038 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f741c1462d0 0x7f741c15aa60 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f741c0b59f0 tx=0x7f7414004ad0 comp rx=0 tx=0).stop 2023-07-14T15:58:49.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.021+0000 7f7423bff700 1 -- 172.21.15.37:0/2922618038 shutdown_connections 2023-07-14T15:58:49.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.021+0000 7f7423bff700 1 --2- 172.21.15.37:0/2922618038 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f741c0cd890 0x7f741c0cc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:49.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.021+0000 7f7423bff700 1 --2- 172.21.15.37:0/2922618038 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f740006ae00 0x7f740006d2b0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:49.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.021+0000 7f7423bff700 1 --2- 172.21.15.37:0/2922618038 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f741c1462d0 0x7f741c15aa60 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:49.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.021+0000 7f7423bff700 1 --2- 172.21.15.37:0/2922618038 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f741c0cf780 0x7f741c0ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:49.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.021+0000 7f7423bff700 1 -- 172.21.15.37:0/2922618038 >> 172.21.15.37:0/2922618038 conn(0x7f741c06a4d0 msgr2=0x7f741c0b81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:49.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.022+0000 7f7423bff700 1 -- 172.21.15.37:0/2922618038 shutdown_connections 2023-07-14T15:58:49.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.022+0000 7f7423bff700 1 -- 172.21.15.37:0/2922618038 wait complete. 2023-07-14T15:58:49.009 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2023-07-14T15:58:49.029 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-14T15:58:49.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.251+0000 7f5b749ff700 1 Processor -- start 2023-07-14T15:58:49.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.252+0000 7f5b749ff700 1 -- start start 2023-07-14T15:58:49.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.253+0000 7f5b749ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5b700cfd50 0x7f5b700d2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:49.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.253+0000 7f5b749ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f5b700b1e80 0x7f5b700b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:49.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.253+0000 7f5b749ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b700b1840 con 0x7f5b700b3290 2023-07-14T15:58:49.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.253+0000 7f5b749ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b7015ccf0 con 0x7f5b700b1e80 2023-07-14T15:58:49.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.253+0000 7f5b749ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b700b2550 con 0x7f5b700cfd50 2023-07-14T15:58:49.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.253+0000 7f5b6ed9d700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5b700b3290 0x7f5b700b36d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:49948/0 (socket says 172.21.15.37:49948) 2023-07-14T15:58:49.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.253+0000 7f5b6ed9d700 1 -- 172.21.15.37:0/1543251209 learned_addr learned my addr 172.21.15.37:0/1543251209 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:58:49.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.253+0000 7f5b6e59c700 1 --2- 172.21.15.37:0/1543251209 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5b700cfd50 0x7f5b700d2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:49.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.253+0000 7f5b67fff700 1 --2- 172.21.15.37:0/1543251209 >> v2:172.21.15.98:3300/0 conn(0x7f5b700b1e80 0x7f5b700b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:49.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.253+0000 7f5b6dd9b700 1 -- 172.21.15.37:0/1543251209 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 323132164 0 0) 0x7f5b700b1840 con 0x7f5b700b3290 2023-07-14T15:58:49.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.253+0000 7f5b6dd9b700 1 -- 172.21.15.37:0/1543251209 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b5c0035b0 con 0x7f5b700b3290 2023-07-14T15:58:49.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.254+0000 7f5b6dd9b700 1 -- 172.21.15.37:0/1543251209 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2813889458 0 0) 0x7f5b5c0035b0 con 0x7f5b700b3290 2023-07-14T15:58:49.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.254+0000 7f5b6dd9b700 1 -- 172.21.15.37:0/1543251209 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5b700cfd50 msgr2=0x7f5b700d2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:49.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.254+0000 7f5b6dd9b700 1 --2- 172.21.15.37:0/1543251209 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5b700cfd50 0x7f5b700d2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:49.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.254+0000 7f5b6dd9b700 1 -- 172.21.15.37:0/1543251209 >> v2:172.21.15.98:3300/0 conn(0x7f5b700b1e80 msgr2=0x7f5b700b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:49.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.254+0000 7f5b6dd9b700 1 --2- 172.21.15.37:0/1543251209 >> v2:172.21.15.98:3300/0 conn(0x7f5b700b1e80 0x7f5b700b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:49.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.254+0000 7f5b6dd9b700 1 -- 172.21.15.37:0/1543251209 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b700b2830 con 0x7f5b700b3290 2023-07-14T15:58:49.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.254+0000 7f5b6dd9b700 1 -- 172.21.15.37:0/1543251209 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48633207 0 0) 0x7f5b680019f0 con 0x7f5b700b3290 2023-07-14T15:58:49.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.254+0000 7f5b6dd9b700 1 -- 172.21.15.37:0/1543251209 >> v1:172.21.15.37:6789/0 conn(0x7f5b700b3290 legacy=0x7f5b700b36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:49.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.254+0000 7f5b6dd9b700 1 --2- 172.21.15.37:0/1543251209 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5b700cfd50 0x7f5b5c003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:49.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.254+0000 7f5b6dd9b700 1 --2- 172.21.15.37:0/1543251209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b5c003fd0 0x7f5b5c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:49.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.254+0000 7f5b6dd9b700 1 --2- 172.21.15.37:0/1543251209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b5c004d90 0x7f5b5c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:49.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.254+0000 7f5b6dd9b700 1 -- 172.21.15.37:0/1543251209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7015ccf0 con 0x7f5b5c004d90 2023-07-14T15:58:49.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.254+0000 7f5b6dd9b700 1 -- 172.21.15.37:0/1543251209 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b700b2550 con 0x7f5b5c003fd0 2023-07-14T15:58:49.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.254+0000 7f5b6dd9b700 1 -- 172.21.15.37:0/1543251209 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c00ba90 con 0x7f5b700cfd50 2023-07-14T15:58:49.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.254+0000 7f5b6ed9d700 1 --2- 172.21.15.37:0/1543251209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b5c004d90 0x7f5b5c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:49.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.254+0000 7f5b67fff700 1 --2- 172.21.15.37:0/1543251209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b5c003fd0 0x7f5b5c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:49.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.254+0000 7f5b6e59c700 1 --2- 172.21.15.37:0/1543251209 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5b700cfd50 0x7f5b5c003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:49.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.254+0000 7f5b6ed9d700 1 -- 172.21.15.37:0/1543251209 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5b700cfd50 msgr2=0x7f5b5c003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:49.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.255+0000 7f5b6ed9d700 1 --2- 172.21.15.37:0/1543251209 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5b700cfd50 0x7f5b5c003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:49.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.255+0000 7f5b6ed9d700 1 -- 172.21.15.37:0/1543251209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b5c003fd0 msgr2=0x7f5b5c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:49.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.255+0000 7f5b6ed9d700 1 --2- 172.21.15.37:0/1543251209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b5c003fd0 0x7f5b5c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:49.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.255+0000 7f5b6ed9d700 1 -- 172.21.15.37:0/1543251209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b5c0035b0 con 0x7f5b5c004d90 2023-07-14T15:58:49.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.255+0000 7f5b6e59c700 1 --2- 172.21.15.37:0/1543251209 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5b700cfd50 0x7f5b5c003a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:58:49.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.255+0000 7f5b6ed9d700 1 --2- 172.21.15.37:0/1543251209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b5c004d90 0x7f5b5c005200 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f5b6800a760 tx=0x7f5b5c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87ae032bc3ee83ca server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:49.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.255+0000 7f5b6dd9b700 1 -- 172.21.15.37:0/1543251209 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6800a250 con 0x7f5b5c004d90 2023-07-14T15:58:49.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.255+0000 7f5b6dd9b700 1 -- 172.21.15.37:0/1543251209 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b680072d0 con 0x7f5b5c004d90 2023-07-14T15:58:49.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.255+0000 7f5b6dd9b700 1 -- 172.21.15.37:0/1543251209 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b68007680 con 0x7f5b5c004d90 2023-07-14T15:58:49.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.255+0000 7f5b749ff700 1 -- 172.21.15.37:0/1543251209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b5c004d90 msgr2=0x7f5b5c005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:49.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.255+0000 7f5b749ff700 1 --2- 172.21.15.37:0/1543251209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b5c004d90 0x7f5b5c005200 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f5b6800a760 tx=0x7f5b5c005880 comp rx=0 tx=0).stop 2023-07-14T15:58:49.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.255+0000 7f5b6ed9d700 1 -- 172.21.15.37:0/1543251209 reap_dead start 2023-07-14T15:58:49.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.256+0000 7f5b749ff700 1 -- 172.21.15.37:0/1543251209 shutdown_connections 2023-07-14T15:58:49.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.256+0000 7f5b749ff700 1 -- 172.21.15.37:0/1543251209 >> 172.21.15.37:0/1543251209 conn(0x7f5b7009c1c0 msgr2=0x7f5b700d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:49.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.256+0000 7f5b749ff700 1 -- 172.21.15.37:0/1543251209 shutdown_connections 2023-07-14T15:58:49.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.256+0000 7f5b749ff700 1 -- 172.21.15.37:0/1543251209 wait complete. 2023-07-14T15:58:49.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.257+0000 7f5b749ff700 1 Processor -- start 2023-07-14T15:58:49.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.258+0000 7f5b749ff700 1 -- start start 2023-07-14T15:58:49.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.258+0000 7f5b749ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b5c004d90 0x7f5b70149410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:49.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.259+0000 7f5b749ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b70155300 0x7f5b701f5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:49.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.259+0000 7f5b749ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5b700b7640 0x7f5b700b44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:49.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.259+0000 7f5b749ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b701f4e30 con 0x7f5b5c004d90 2023-07-14T15:58:49.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.259+0000 7f5b749ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b701f53f0 con 0x7f5b70155300 2023-07-14T15:58:49.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.259+0000 7f5b749ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b700b7f90 con 0x7f5b700b7640 2023-07-14T15:58:49.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.259+0000 7f5b6e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b5c004d90 0x7f5b70149410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:49.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.259+0000 7f5b6e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b5c004d90 0x7f5b70149410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41672/0 (socket says 172.21.15.37:41672) 2023-07-14T15:58:49.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.259+0000 7f5b6e59c700 1 -- 172.21.15.37:0/1058943346 learned_addr learned my addr 172.21.15.37:0/1058943346 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:49.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.259+0000 7f5b6e59c700 1 -- 172.21.15.37:0/1058943346 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5b700b7640 msgr2=0x7f5b700b44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:49.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.259+0000 7f5b6e59c700 1 --2- 172.21.15.37:0/1058943346 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5b700b7640 0x7f5b700b44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:49.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.259+0000 7f5b6e59c700 1 -- 172.21.15.37:0/1058943346 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b70155300 msgr2=0x7f5b701f5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:49.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.259+0000 7f5b6e59c700 1 --2- 172.21.15.37:0/1058943346 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b70155300 0x7f5b701f5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:49.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.259+0000 7f5b6e59c700 1 -- 172.21.15.37:0/1058943346 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b700d02a0 con 0x7f5b5c004d90 2023-07-14T15:58:49.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.259+0000 7f5b6e59c700 1 --2- 172.21.15.37:0/1058943346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b5c004d90 0x7f5b70149410 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f5b60011900 tx=0x7f5b60011cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:49.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.260+0000 7f5b66ffd700 1 -- 172.21.15.37:0/1058943346 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b60004220 con 0x7f5b5c004d90 2023-07-14T15:58:49.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.260+0000 7f5b66ffd700 1 -- 172.21.15.37:0/1058943346 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b60004380 con 0x7f5b5c004d90 2023-07-14T15:58:49.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.260+0000 7f5b66ffd700 1 -- 172.21.15.37:0/1058943346 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b600036a0 con 0x7f5b5c004d90 2023-07-14T15:58:49.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.260+0000 7f5b749ff700 1 -- 172.21.15.37:0/1058943346 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b700b8270 con 0x7f5b5c004d90 2023-07-14T15:58:49.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.260+0000 7f5b749ff700 1 -- 172.21.15.37:0/1058943346 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b700b7ab0 con 0x7f5b5c004d90 2023-07-14T15:58:49.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.261+0000 7f5b749ff700 1 -- 172.21.15.37:0/1058943346 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b70067840 con 0x7f5b5c004d90 2023-07-14T15:58:49.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.262+0000 7f5b66ffd700 1 -- 172.21.15.37:0/1058943346 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f5b60003820 con 0x7f5b5c004d90 2023-07-14T15:58:49.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.263+0000 7f5b66ffd700 1 --2- 172.21.15.37:0/1058943346 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f5b5006ae00 0x7f5b5006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:49.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.263+0000 7f5b66ffd700 1 -- 172.21.15.37:0/1058943346 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5324+0+0 (secure 0 0 0) 0x7f5b60089700 con 0x7f5b5c004d90 2023-07-14T15:58:49.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.263+0000 7f5b67fff700 1 --2- 172.21.15.37:0/1058943346 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f5b5006ae00 0x7f5b5006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:49.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.264+0000 7f5b67fff700 1 --2- 172.21.15.37:0/1058943346 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f5b5006ae00 0x7f5b5006d2b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5b700b0ee0 tx=0x7f5b58009400 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:49.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.267+0000 7f5b66ffd700 1 -- 172.21.15.37:0/1058943346 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5b60054970 con 0x7f5b5c004d90 2023-07-14T15:58:49.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.474+0000 7f5b749ff700 1 -- 172.21.15.37:0/1058943346 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f5b700b7cd0 con 0x7f5b5c004d90 2023-07-14T15:58:49.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.478+0000 7f5b66ffd700 1 -- 172.21.15.37:0/1058943346 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5b60057f90 con 0x7f5b5c004d90 2023-07-14T15:58:49.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.481+0000 7f5b749ff700 1 -- 172.21.15.37:0/1058943346 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f5b5006ae00 msgr2=0x7f5b5006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:49.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.481+0000 7f5b749ff700 1 --2- 172.21.15.37:0/1058943346 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f5b5006ae00 0x7f5b5006d2b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5b700b0ee0 tx=0x7f5b58009400 comp rx=0 tx=0).stop 2023-07-14T15:58:49.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.481+0000 7f5b749ff700 1 -- 172.21.15.37:0/1058943346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b5c004d90 msgr2=0x7f5b70149410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:49.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.481+0000 7f5b749ff700 1 --2- 172.21.15.37:0/1058943346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b5c004d90 0x7f5b70149410 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f5b60011900 tx=0x7f5b60011cc0 comp rx=0 tx=0).stop 2023-07-14T15:58:49.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.481+0000 7f5b749ff700 1 -- 172.21.15.37:0/1058943346 shutdown_connections 2023-07-14T15:58:49.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.481+0000 7f5b749ff700 1 --2- 172.21.15.37:0/1058943346 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f5b5006ae00 0x7f5b5006d2b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:49.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.481+0000 7f5b749ff700 1 --2- 172.21.15.37:0/1058943346 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5b700b7640 0x7f5b700b44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:49.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.481+0000 7f5b749ff700 1 --2- 172.21.15.37:0/1058943346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b5c004d90 0x7f5b70149410 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:49.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.481+0000 7f5b749ff700 1 --2- 172.21.15.37:0/1058943346 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b70155300 0x7f5b701f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:49.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.481+0000 7f5b749ff700 1 -- 172.21.15.37:0/1058943346 >> 172.21.15.37:0/1058943346 conn(0x7f5b7009c1c0 msgr2=0x7f5b700b3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:49.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.481+0000 7f5b749ff700 1 -- 172.21.15.37:0/1058943346 shutdown_connections 2023-07-14T15:58:49.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.481+0000 7f5b749ff700 1 -- 172.21.15.37:0/1058943346 wait complete. 2023-07-14T15:58:49.483 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshots.test_clean_stale_subvolume_snapshot_metadata' 2023-07-14T15:58:49.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.708+0000 7f1582bff700 1 Processor -- start 2023-07-14T15:58:49.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.708+0000 7f1582bff700 1 -- start start 2023-07-14T15:58:49.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.709+0000 7f1582bff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f157c1593c0 0x7f157c0ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:49.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.709+0000 7f1582bff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f157c159790 0x7f157c0af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:49.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.709+0000 7f1582bff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f157c0c9540 con 0x7f157c0c9b30 2023-07-14T15:58:49.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.709+0000 7f1582bff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f157c0c9ff0 con 0x7f157c1593c0 2023-07-14T15:58:49.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.709+0000 7f1582bff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f157c0ce3d0 con 0x7f157c159790 2023-07-14T15:58:49.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.709+0000 7f158099b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f157c1593c0 0x7f157c0ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:49.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.709+0000 7f157bfff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f157c0c9b30 0x7f157c15db60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:49958/0 (socket says 172.21.15.37:49958) 2023-07-14T15:58:49.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.709+0000 7f157bfff700 1 -- 172.21.15.37:0/1397817189 learned_addr learned my addr 172.21.15.37:0/1397817189 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:58:49.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.710+0000 7f158119c700 1 --2- 172.21.15.37:0/1397817189 >> v2:172.21.15.98:3300/0 conn(0x7f157c159790 0x7f157c0af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:49.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.710+0000 7f158099b700 1 -- 172.21.15.37:0/1397817189 >> v2:172.21.15.98:3300/0 conn(0x7f157c159790 msgr2=0x7f157c0af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:49.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.710+0000 7f158099b700 1 --2- 172.21.15.37:0/1397817189 >> v2:172.21.15.98:3300/0 conn(0x7f157c159790 0x7f157c0af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:49.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.710+0000 7f158099b700 1 -- 172.21.15.37:0/1397817189 >> v1:172.21.15.37:6789/0 conn(0x7f157c0c9b30 legacy=0x7f157c15db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:49.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.710+0000 7f158099b700 1 -- 172.21.15.37:0/1397817189 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f157c0ce6b0 con 0x7f157c1593c0 2023-07-14T15:58:49.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.710+0000 7f157b7fe700 1 -- 172.21.15.37:0/1397817189 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3864873119 0 0) 0x7f157c0c9540 con 0x7f157c0c9b30 2023-07-14T15:58:49.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.710+0000 7f158099b700 1 --2- 172.21.15.37:0/1397817189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f157c1593c0 0x7f157c0ccce0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f157c071310 tx=0x7f1570009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0dd4a4cbcff51cf server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:49.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.710+0000 7f157b7fe700 1 -- 172.21.15.37:0/1397817189 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1570011830 con 0x7f157c1593c0 2023-07-14T15:58:49.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.710+0000 7f157b7fe700 1 -- 172.21.15.37:0/1397817189 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1570011990 con 0x7f157c1593c0 2023-07-14T15:58:49.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.710+0000 7f157b7fe700 1 -- 172.21.15.37:0/1397817189 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1570011d20 con 0x7f157c1593c0 2023-07-14T15:58:49.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.711+0000 7f1582bff700 1 -- 172.21.15.37:0/1397817189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f157c1593c0 msgr2=0x7f157c0ccce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:49.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.711+0000 7f1582bff700 1 --2- 172.21.15.37:0/1397817189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f157c1593c0 0x7f157c0ccce0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f157c071310 tx=0x7f1570009b20 comp rx=0 tx=0).stop 2023-07-14T15:58:49.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.711+0000 7f1582bff700 1 -- 172.21.15.37:0/1397817189 shutdown_connections 2023-07-14T15:58:49.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.711+0000 7f1582bff700 1 --2- 172.21.15.37:0/1397817189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f157c1593c0 0x7f157c0ccce0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:49.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.711+0000 7f1582bff700 1 --2- 172.21.15.37:0/1397817189 >> v2:172.21.15.98:3300/0 conn(0x7f157c159790 0x7f157c0af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:49.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.711+0000 7f1582bff700 1 -- 172.21.15.37:0/1397817189 >> 172.21.15.37:0/1397817189 conn(0x7f157c0b08c0 msgr2=0x7f157c0b0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:49.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.711+0000 7f1582bff700 1 -- 172.21.15.37:0/1397817189 shutdown_connections 2023-07-14T15:58:49.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.711+0000 7f1582bff700 1 -- 172.21.15.37:0/1397817189 wait complete. 2023-07-14T15:58:49.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.713+0000 7f1582bff700 1 Processor -- start 2023-07-14T15:58:49.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.713+0000 7f1582bff700 1 -- start start 2023-07-14T15:58:49.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.714+0000 7f1582bff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f157c0c9b30 0x7f157c1efbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:49.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.714+0000 7f1582bff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f157c1593c0 0x7f157c14e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:49.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.714+0000 7f1582bff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f157c159790 0x7f157c148a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:49.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.714+0000 7f1582bff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f157c1e20c0 con 0x7f157c0c9b30 2023-07-14T15:58:49.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.714+0000 7f1582bff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f157c1f0120 con 0x7f157c159790 2023-07-14T15:58:49.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.714+0000 7f1582bff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f157c142de0 con 0x7f157c1593c0 2023-07-14T15:58:49.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.714+0000 7f158099b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f157c0c9b30 0x7f157c1efbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:49.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.714+0000 7f158099b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f157c0c9b30 0x7f157c1efbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41684/0 (socket says 172.21.15.37:41684) 2023-07-14T15:58:49.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.714+0000 7f158099b700 1 -- 172.21.15.37:0/2474850594 learned_addr learned my addr 172.21.15.37:0/2474850594 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:49.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.715+0000 7f158119c700 1 --2- 172.21.15.37:0/2474850594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f157c159790 0x7f157c148a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:49.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.715+0000 7f157bfff700 1 --2- 172.21.15.37:0/2474850594 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f157c1593c0 0x7f157c14e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:49.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.715+0000 7f158099b700 1 -- 172.21.15.37:0/2474850594 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f157c1593c0 msgr2=0x7f157c14e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:49.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.715+0000 7f158099b700 1 --2- 172.21.15.37:0/2474850594 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f157c1593c0 0x7f157c14e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:49.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.715+0000 7f158099b700 1 -- 172.21.15.37:0/2474850594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f157c159790 msgr2=0x7f157c148a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:49.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.715+0000 7f158099b700 1 --2- 172.21.15.37:0/2474850594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f157c159790 0x7f157c148a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:49.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.715+0000 7f158099b700 1 -- 172.21.15.37:0/2474850594 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15700094a0 con 0x7f157c0c9b30 2023-07-14T15:58:49.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.715+0000 7f157bfff700 1 --2- 172.21.15.37:0/2474850594 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f157c1593c0 0x7f157c14e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:58:49.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.715+0000 7f158099b700 1 --2- 172.21.15.37:0/2474850594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f157c0c9b30 0x7f157c1efbe0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f15700090b0 tx=0x7f1570004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:49.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.715+0000 7f15797fa700 1 -- 172.21.15.37:0/2474850594 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15700038a0 con 0x7f157c0c9b30 2023-07-14T15:58:49.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.715+0000 7f15797fa700 1 -- 172.21.15.37:0/2474850594 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f157001f070 con 0x7f157c0c9b30 2023-07-14T15:58:49.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.715+0000 7f15797fa700 1 -- 172.21.15.37:0/2474850594 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1570003c20 con 0x7f157c0c9b30 2023-07-14T15:58:49.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.715+0000 7f1582bff700 1 -- 172.21.15.37:0/2474850594 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f157c1430c0 con 0x7f157c0c9b30 2023-07-14T15:58:49.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.716+0000 7f1582bff700 1 -- 172.21.15.37:0/2474850594 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f157c143680 con 0x7f157c0c9b30 2023-07-14T15:58:49.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.717+0000 7f1582bff700 1 -- 172.21.15.37:0/2474850594 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f157c0743a0 con 0x7f157c0c9b30 2023-07-14T15:58:49.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.717+0000 7f15797fa700 1 -- 172.21.15.37:0/2474850594 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f157001a430 con 0x7f157c0c9b30 2023-07-14T15:58:49.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.719+0000 7f15797fa700 1 --2- 172.21.15.37:0/2474850594 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f156006ae00 0x7f156006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:49.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.719+0000 7f15797fa700 1 -- 172.21.15.37:0/2474850594 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5324+0+0 (secure 0 0 0) 0x7f1570021070 con 0x7f157c0c9b30 2023-07-14T15:58:49.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.719+0000 7f157bfff700 1 --2- 172.21.15.37:0/2474850594 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f156006ae00 0x7f156006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:49.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.720+0000 7f157bfff700 1 --2- 172.21.15.37:0/2474850594 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f156006ae00 0x7f156006d2b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f157c149c30 tx=0x7f1568009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:49.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:49.723+0000 7f15797fa700 1 -- 172.21.15.37:0/2474850594 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1570055f20 con 0x7f157c0c9b30 2023-07-14T15:58:49.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:50.015+0000 7f1582bff700 1 -- 172.21.15.37:0/2474850594 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshots.test_clean_stale_subvolume_snapshot_metadata"]} v 0) v1 -- 0x7f157c067840 con 0x7f157c0c9b30 2023-07-14T15:58:51.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:51.024+0000 7f15797fa700 1 -- 172.21.15.37:0/2474850594 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshots.test_clean_stale_subvolume_snapshot_metadata"]}]=0 v175) v1 ==== 172+0+0 (secure 0 0 0) 0x7f15700150f0 con 0x7f157c0c9b30 2023-07-14T15:58:51.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:51.027+0000 7f1582bff700 1 -- 172.21.15.37:0/2474850594 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f156006ae00 msgr2=0x7f156006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:51.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:51.027+0000 7f1582bff700 1 --2- 172.21.15.37:0/2474850594 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f156006ae00 0x7f156006d2b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f157c149c30 tx=0x7f1568009040 comp rx=0 tx=0).stop 2023-07-14T15:58:51.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:51.027+0000 7f1582bff700 1 -- 172.21.15.37:0/2474850594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f157c0c9b30 msgr2=0x7f157c1efbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:51.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:51.027+0000 7f1582bff700 1 --2- 172.21.15.37:0/2474850594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f157c0c9b30 0x7f157c1efbe0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f15700090b0 tx=0x7f1570004750 comp rx=0 tx=0).stop 2023-07-14T15:58:51.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:51.027+0000 7f1582bff700 1 -- 172.21.15.37:0/2474850594 shutdown_connections 2023-07-14T15:58:51.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:51.027+0000 7f1582bff700 1 --2- 172.21.15.37:0/2474850594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f157c159790 0x7f157c148a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:51.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:51.027+0000 7f1582bff700 1 --2- 172.21.15.37:0/2474850594 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f156006ae00 0x7f156006d2b0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:51.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:51.027+0000 7f1582bff700 1 --2- 172.21.15.37:0/2474850594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f157c0c9b30 0x7f157c1efbe0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:51.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:51.027+0000 7f1582bff700 1 --2- 172.21.15.37:0/2474850594 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f157c1593c0 0x7f157c14e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:51.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:51.027+0000 7f1582bff700 1 -- 172.21.15.37:0/2474850594 >> 172.21.15.37:0/2474850594 conn(0x7f157c0b08c0 msgr2=0x7f157c0b1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:51.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:51.027+0000 7f1582bff700 1 -- 172.21.15.37:0/2474850594 shutdown_connections 2023-07-14T15:58:51.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:51.027+0000 7f1582bff700 1 -- 172.21.15.37:0/2474850594 wait complete. 2023-07-14T15:58:51.033 INFO:tasks.cephfs_test_runner:test_clean_stale_subvolume_snapshot_metadata (tasks.cephfs.test_volumes.TestSubvolumeSnapshots) ... ERROR 2023-07-14T15:58:51.033 INFO:tasks.cephfs_test_runner: 2023-07-14T15:58:51.034 INFO:tasks.cephfs_test_runner:====================================================================== 2023-07-14T15:58:51.034 INFO:tasks.cephfs_test_runner:ERROR: test_clean_stale_subvolume_snapshot_metadata (tasks.cephfs.test_volumes.TestSubvolumeSnapshots) 2023-07-14T15:58:51.034 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-07-14T15:58:51.034 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-07-14T15:58:51.034 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_3fc0089cc1082313a98853d48b892acdc1385b8b/qa/tasks/cephfs/test_volumes.py", line 5576, in test_clean_stale_subvolume_snapshot_metadata 2023-07-14T15:58:51.035 INFO:tasks.cephfs_test_runner: _ = json.loads(self._get_subvolume_info(self.volname, subvolname, group)) 2023-07-14T15:58:51.035 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_3fc0089cc1082313a98853d48b892acdc1385b8b/qa/tasks/cephfs/test_volumes.py", line 245, in _get_subvolume_info 2023-07-14T15:58:51.035 INFO:tasks.cephfs_test_runner: subvol_md = self._fs_cmd(*args) 2023-07-14T15:58:51.035 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_3fc0089cc1082313a98853d48b892acdc1385b8b/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2023-07-14T15:58:51.035 INFO:tasks.cephfs_test_runner: return self.mgr_cluster.mon_manager.raw_cluster_cmd("fs", *args) 2023-07-14T15:58:51.036 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_3fc0089cc1082313a98853d48b892acdc1385b8b/qa/tasks/ceph_manager.py", line 1597, in raw_cluster_cmd 2023-07-14T15:58:51.036 INFO:tasks.cephfs_test_runner: return self.run_cluster_cmd(**kwargs).stdout.getvalue() 2023-07-14T15:58:51.036 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_3fc0089cc1082313a98853d48b892acdc1385b8b/qa/tasks/ceph_manager.py", line 1588, in run_cluster_cmd 2023-07-14T15:58:51.036 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-07-14T15:58:51.036 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/orchestra/remote.py", line 522, in run 2023-07-14T15:58:51.037 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-07-14T15:58:51.037 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/orchestra/run.py", line 455, in run 2023-07-14T15:58:51.037 INFO:tasks.cephfs_test_runner: r.wait() 2023-07-14T15:58:51.037 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/orchestra/run.py", line 161, in wait 2023-07-14T15:58:51.037 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-07-14T15:58:51.038 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-07-14T15:58:51.038 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-07-14T15:58:51.038 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi037 with status 61: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume info cephfs subvolume_0000000000096394 group_0000000000254728' 2023-07-14T15:58:51.038 INFO:tasks.cephfs_test_runner: 2023-07-14T15:58:51.039 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-07-14T15:58:51.039 INFO:tasks.cephfs_test_runner:Ran 7 tests in 117.360s 2023-07-14T15:58:51.039 INFO:tasks.cephfs_test_runner: 2023-07-14T15:58:51.039 INFO:tasks.cephfs_test_runner:FAILED (errors=1, skipped=5) 2023-07-14T15:58:51.039 INFO:tasks.cephfs_test_runner: 2023-07-14T15:58:51.040 INFO:tasks.cephfs_test_runner:====================================================================== 2023-07-14T15:58:51.040 INFO:tasks.cephfs_test_runner:ERROR: test_clean_stale_subvolume_snapshot_metadata (tasks.cephfs.test_volumes.TestSubvolumeSnapshots) 2023-07-14T15:58:51.040 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-07-14T15:58:51.041 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-07-14T15:58:51.041 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_3fc0089cc1082313a98853d48b892acdc1385b8b/qa/tasks/cephfs/test_volumes.py", line 5576, in test_clean_stale_subvolume_snapshot_metadata 2023-07-14T15:58:51.041 INFO:tasks.cephfs_test_runner: _ = json.loads(self._get_subvolume_info(self.volname, subvolname, group)) 2023-07-14T15:58:51.041 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_3fc0089cc1082313a98853d48b892acdc1385b8b/qa/tasks/cephfs/test_volumes.py", line 245, in _get_subvolume_info 2023-07-14T15:58:51.041 INFO:tasks.cephfs_test_runner: subvol_md = self._fs_cmd(*args) 2023-07-14T15:58:51.042 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_3fc0089cc1082313a98853d48b892acdc1385b8b/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2023-07-14T15:58:51.042 INFO:tasks.cephfs_test_runner: return self.mgr_cluster.mon_manager.raw_cluster_cmd("fs", *args) 2023-07-14T15:58:51.042 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_3fc0089cc1082313a98853d48b892acdc1385b8b/qa/tasks/ceph_manager.py", line 1597, in raw_cluster_cmd 2023-07-14T15:58:51.042 INFO:tasks.cephfs_test_runner: return self.run_cluster_cmd(**kwargs).stdout.getvalue() 2023-07-14T15:58:51.042 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_3fc0089cc1082313a98853d48b892acdc1385b8b/qa/tasks/ceph_manager.py", line 1588, in run_cluster_cmd 2023-07-14T15:58:51.042 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-07-14T15:58:51.043 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/orchestra/remote.py", line 522, in run 2023-07-14T15:58:51.043 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-07-14T15:58:51.043 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/orchestra/run.py", line 455, in run 2023-07-14T15:58:51.043 INFO:tasks.cephfs_test_runner: r.wait() 2023-07-14T15:58:51.043 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/orchestra/run.py", line 161, in wait 2023-07-14T15:58:51.044 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-07-14T15:58:51.044 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-07-14T15:58:51.044 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-07-14T15:58:51.044 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi037 with status 61: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume info cephfs subvolume_0000000000096394 group_0000000000254728' 2023-07-14T15:58:51.044 INFO:tasks.cephfs_test_runner: 2023-07-14T15:58:51.045 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_3fc0089cc1082313a98853d48b892acdc1385b8b/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_clean_stale_subvolume_snapshot_metadata (tasks.cephfs.test_volumes.TestSubvolumeSnapshots) 2023-07-14T15:58:51.183 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=9ddd87be2c2c4d2b86d64f7e6f423287 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_3fc0089cc1082313a98853d48b892acdc1385b8b/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_clean_stale_subvolume_snapshot_metadata (tasks.cephfs.test_volumes.TestSubvolumeSnapshots) 2023-07-14T15:58:51.185 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-07-14T15:58:51.193 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-07-14T15:58:51.215 INFO:tasks.kclient:Unmounting kernel clients... 2023-07-14T15:58:51.215 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-14T15:58:51.216 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T15:58:51.267 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348708k,nr_inodes=4087177,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=34,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275628k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-07-14T15:58:51.267 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-14T15:58:51.268 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T15:58:51.353 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348708k,nr_inodes=4087177,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=34,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275628k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-07-14T15:58:51.354 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-14T15:58:51.354 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T15:58:51.402 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345608k,nr_inodes=4086402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275008k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-07-14T15:58:51.403 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2023-07-14T15:58:51.403 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T15:58:51.489 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345608k,nr_inodes=4086402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275008k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-07-14T15:58:51.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:58:51.490 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-07-14T15:58:51.536 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-14T15:58:51.537 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-14T15:58:51.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:58:51.538 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-14T15:58:51.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:58:51.651 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-14T15:58:51.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:58:51.726 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link delete ceph-brx 2023-07-14T15:58:51.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:58:51.851 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-07-14T15:58:51.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:58:51.899 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link delete ceph-brx 2023-07-14T15:58:51.974 INFO:teuthology.orchestra.run.smithi037.stderr:Cannot find device "ceph-brx" 2023-07-14T15:58:51.976 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T15:58:51.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:58:51.978 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2023-07-14T15:58:52.027 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-07-14T15:58:52.027 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-14T15:58:52.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:58:52.028 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-14T15:58:52.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:58:52.101 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-14T15:58:52.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:58:52.173 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link delete ceph-brx 2023-07-14T15:58:52.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:58:52.326 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2023-07-14T15:58:52.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T15:58:52.374 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link delete ceph-brx 2023-07-14T15:58:52.486 INFO:teuthology.orchestra.run.smithi098.stderr:Cannot find device "ceph-brx" 2023-07-14T15:58:52.489 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T15:58:52.489 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-07-14T15:58:52.502 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-14T15:58:52.502 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T15:58:52.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.724+0000 7fa6831ff700 1 Processor -- start 2023-07-14T15:58:52.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.724+0000 7fa6831ff700 1 -- start start 2023-07-14T15:58:52.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.725+0000 7fa6831ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa67c0b0050 0x7fa67c0ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:52.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.725+0000 7fa6831ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa67c0c9540 con 0x7fa67c1593c0 2023-07-14T15:58:52.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.726+0000 7fa6831ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa67c0c9ff0 con 0x7fa67c0c9b30 2023-07-14T15:58:52.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.726+0000 7fa6831ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa67c0ce3d0 con 0x7fa67c0b0050 2023-07-14T15:58:52.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.726+0000 7fa680f9b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa67c1593c0 0x7fa67c15db60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57336/0 (socket says 172.21.15.37:57336) 2023-07-14T15:58:52.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.726+0000 7fa680f9b700 1 -- 172.21.15.37:0/2794504176 learned_addr learned my addr 172.21.15.37:0/2794504176 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:58:52.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.726+0000 7fa68179c700 1 --2- 172.21.15.37:0/2794504176 >> v2:172.21.15.37:3300/0 conn(0x7fa67c0b0050 0x7fa67c0ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:52.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.726+0000 7fa67b7fe700 1 -- 172.21.15.37:0/2794504176 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2688321083 0 0) 0x7fa67c0c9540 con 0x7fa67c1593c0 2023-07-14T15:58:52.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.726+0000 7fa67b7fe700 1 -- 172.21.15.37:0/2794504176 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa66c0035b0 con 0x7fa67c1593c0 2023-07-14T15:58:52.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.726+0000 7fa68179c700 1 -- 172.21.15.37:0/2794504176 >> v1:172.21.15.98:6789/0 conn(0x7fa67c0c9b30 legacy=0x7fa67c0af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:52.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.726+0000 7fa67b7fe700 1 -- 172.21.15.37:0/2794504176 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1894050271 0 0) 0x7fa67c0c9ff0 con 0x7fa67c0c9b30 2023-07-14T15:58:52.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.726+0000 7fa68179c700 1 -- 172.21.15.37:0/2794504176 >> v1:172.21.15.37:6789/0 conn(0x7fa67c1593c0 legacy=0x7fa67c15db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:52.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.726+0000 7fa68179c700 1 -- 172.21.15.37:0/2794504176 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa67c0ce6b0 con 0x7fa67c0b0050 2023-07-14T15:58:52.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.727+0000 7fa68179c700 1 --2- 172.21.15.37:0/2794504176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa67c0b0050 0x7fa67c0ccce0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fa674009d90 tx=0x7fa67400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=785d3eda821fbe5e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:52.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.727+0000 7fa67b7fe700 1 -- 172.21.15.37:0/2794504176 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67400bd20 con 0x7fa67c0b0050 2023-07-14T15:58:52.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.727+0000 7fa67b7fe700 1 -- 172.21.15.37:0/2794504176 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa67400be80 con 0x7fa67c0b0050 2023-07-14T15:58:52.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.727+0000 7fa67b7fe700 1 -- 172.21.15.37:0/2794504176 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6740116a0 con 0x7fa67c0b0050 2023-07-14T15:58:52.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.727+0000 7fa6831ff700 1 -- 172.21.15.37:0/2794504176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa67c0b0050 msgr2=0x7fa67c0ccce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:52.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.727+0000 7fa6831ff700 1 --2- 172.21.15.37:0/2794504176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa67c0b0050 0x7fa67c0ccce0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fa674009d90 tx=0x7fa67400b330 comp rx=0 tx=0).stop 2023-07-14T15:58:52.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.728+0000 7fa6831ff700 1 -- 172.21.15.37:0/2794504176 shutdown_connections 2023-07-14T15:58:52.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.728+0000 7fa6831ff700 1 --2- 172.21.15.37:0/2794504176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa67c0b0050 0x7fa67c0ccce0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:52.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.728+0000 7fa6831ff700 1 -- 172.21.15.37:0/2794504176 >> 172.21.15.37:0/2794504176 conn(0x7fa67c0b08c0 msgr2=0x7fa67c0b0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:52.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.728+0000 7fa6831ff700 1 -- 172.21.15.37:0/2794504176 shutdown_connections 2023-07-14T15:58:52.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.728+0000 7fa6831ff700 1 -- 172.21.15.37:0/2794504176 wait complete. 2023-07-14T15:58:52.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.729+0000 7fa6831ff700 1 Processor -- start 2023-07-14T15:58:52.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.730+0000 7fa6831ff700 1 -- start start 2023-07-14T15:58:52.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.730+0000 7fa6831ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa67c0b0050 0x7fa67c146290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:52.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.730+0000 7fa6831ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa67c0c9b30 0x7fa67c1e59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:52.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.731+0000 7fa6831ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa67c1593c0 0x7fa67c1e5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:52.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.731+0000 7fa6831ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67c150260 con 0x7fa67c0b0050 2023-07-14T15:58:52.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.731+0000 7fa6831ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67c153780 con 0x7fa67c0c9b30 2023-07-14T15:58:52.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.731+0000 7fa6831ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa67c153a60 con 0x7fa67c1593c0 2023-07-14T15:58:52.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.731+0000 7fa680f9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa67c0b0050 0x7fa67c146290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:52.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.731+0000 7fa680f9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa67c0b0050 0x7fa67c146290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36206/0 (socket says 172.21.15.37:36206) 2023-07-14T15:58:52.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.731+0000 7fa680f9b700 1 -- 172.21.15.37:0/2179760068 learned_addr learned my addr 172.21.15.37:0/2179760068 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:52.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.731+0000 7fa68179c700 1 --2- 172.21.15.37:0/2179760068 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa67c1593c0 0x7fa67c1e5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:52.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.731+0000 7fa67bfff700 1 --2- 172.21.15.37:0/2179760068 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa67c0c9b30 0x7fa67c1e59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:52.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.731+0000 7fa680f9b700 1 -- 172.21.15.37:0/2179760068 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa67c1593c0 msgr2=0x7fa67c1e5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:52.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.731+0000 7fa680f9b700 1 --2- 172.21.15.37:0/2179760068 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa67c1593c0 0x7fa67c1e5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:52.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.731+0000 7fa680f9b700 1 -- 172.21.15.37:0/2179760068 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa67c0c9b30 msgr2=0x7fa67c1e59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:52.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.731+0000 7fa680f9b700 1 --2- 172.21.15.37:0/2179760068 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa67c0c9b30 0x7fa67c1e59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:52.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.731+0000 7fa680f9b700 1 -- 172.21.15.37:0/2179760068 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa674009a70 con 0x7fa67c0b0050 2023-07-14T15:58:52.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.731+0000 7fa67bfff700 1 --2- 172.21.15.37:0/2179760068 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa67c0c9b30 0x7fa67c1e59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:58:52.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.731+0000 7fa680f9b700 1 --2- 172.21.15.37:0/2179760068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa67c0b0050 0x7fa67c146290 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fa67000c420 tx=0x7fa67000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:52.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.732+0000 7fa6797fa700 1 -- 172.21.15.37:0/2179760068 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa670005d70 con 0x7fa67c0b0050 2023-07-14T15:58:52.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.732+0000 7fa6797fa700 1 -- 172.21.15.37:0/2179760068 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6700070d0 con 0x7fa67c0b0050 2023-07-14T15:58:52.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.732+0000 7fa6797fa700 1 -- 172.21.15.37:0/2179760068 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa670007440 con 0x7fa67c0b0050 2023-07-14T15:58:52.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.732+0000 7fa6831ff700 1 -- 172.21.15.37:0/2179760068 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa67c153d40 con 0x7fa67c0b0050 2023-07-14T15:58:52.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.732+0000 7fa6831ff700 1 -- 172.21.15.37:0/2179760068 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa67c154300 con 0x7fa67c0b0050 2023-07-14T15:58:52.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.733+0000 7fa6831ff700 1 -- 172.21.15.37:0/2179760068 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa67c067840 con 0x7fa67c0b0050 2023-07-14T15:58:52.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.734+0000 7fa6797fa700 1 -- 172.21.15.37:0/2179760068 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fa6700075a0 con 0x7fa67c0b0050 2023-07-14T15:58:52.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.735+0000 7fa6797fa700 1 --2- 172.21.15.37:0/2179760068 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa66006ae30 0x7fa66006d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:52.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.735+0000 7fa6797fa700 1 -- 172.21.15.37:0/2179760068 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5324+0+0 (secure 0 0 0) 0x7fa670088730 con 0x7fa67c0b0050 2023-07-14T15:58:52.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.735+0000 7fa67bfff700 1 --2- 172.21.15.37:0/2179760068 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa66006ae30 0x7fa66006d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:52.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.736+0000 7fa67bfff700 1 --2- 172.21.15.37:0/2179760068 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa66006ae30 0x7fa66006d2e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa67c152eb0 tx=0x7fa668009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:52.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.739+0000 7fa6797fa700 1 -- 172.21.15.37:0/2179760068 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa6700539c0 con 0x7fa67c0b0050 2023-07-14T15:58:52.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.943+0000 7fa6831ff700 1 -- 172.21.15.37:0/2179760068 --> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa67c06f9e0 con 0x7fa66006ae30 2023-07-14T15:58:52.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.947+0000 7fa6797fa700 1 -- 172.21.15.37:0/2179760068 <== mgr.4100 v2:172.21.15.98:6832/3163748069 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72797 (secure 0 0 0) 0x7fa668001450 con 0x7fa66006ae30 2023-07-14T15:58:52.932 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:58:52.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.949+0000 7fa6831ff700 1 -- 172.21.15.37:0/2179760068 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa66006ae30 msgr2=0x7fa66006d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:52.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.949+0000 7fa6831ff700 1 --2- 172.21.15.37:0/2179760068 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa66006ae30 0x7fa66006d2e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa67c152eb0 tx=0x7fa668009040 comp rx=0 tx=0).stop 2023-07-14T15:58:52.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.949+0000 7fa6831ff700 1 -- 172.21.15.37:0/2179760068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa67c0b0050 msgr2=0x7fa67c146290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:52.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.949+0000 7fa6831ff700 1 --2- 172.21.15.37:0/2179760068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa67c0b0050 0x7fa67c146290 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fa67000c420 tx=0x7fa67000c7e0 comp rx=0 tx=0).stop 2023-07-14T15:58:52.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.949+0000 7fa6831ff700 1 -- 172.21.15.37:0/2179760068 shutdown_connections 2023-07-14T15:58:52.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.949+0000 7fa6831ff700 1 --2- 172.21.15.37:0/2179760068 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa66006ae30 0x7fa66006d2e0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:52.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.949+0000 7fa6831ff700 1 --2- 172.21.15.37:0/2179760068 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa67c1593c0 0x7fa67c1e5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:52.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.949+0000 7fa6831ff700 1 --2- 172.21.15.37:0/2179760068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa67c0b0050 0x7fa67c146290 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:52.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.949+0000 7fa6831ff700 1 --2- 172.21.15.37:0/2179760068 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa67c0c9b30 0x7fa67c1e59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:52.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.949+0000 7fa6831ff700 1 -- 172.21.15.37:0/2179760068 >> 172.21.15.37:0/2179760068 conn(0x7fa67c0b08c0 msgr2=0x7fa67c0c8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:52.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.949+0000 7fa6831ff700 1 -- 172.21.15.37:0/2179760068 shutdown_connections 2023-07-14T15:58:52.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:52.950+0000 7fa6831ff700 1 -- 172.21.15.37:0/2179760068 wait complete. 2023-07-14T15:58:52.937 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-14T15:58:52.952 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2023-07-14T15:58:52.895200+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":176,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230032,"kb_used_data":6224,"kb_used_omap":0,"kb_used_meta":223744,"kb_avail":754744688,"statfs":{"total":773094113280,"available":772858560512,"internally_reserved":0,"allocated":6373376,"data_stored":3566128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":229113856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-155464,"num_objects":-26,"num_object_clones":0,"num_object_copies":-52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-26,"num_whiteouts":0,"num_read":-5,"num_read_kb":-3,"num_write":-118,"num_write_kb":-206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.992845"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":70,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-14T15:58:45.904960+0000","last_change":"2023-07-14T15:56:02.621850+0000","last_active":"2023-07-14T15:58:45.904960+0000","last_peered":"2023-07-14T15:58:45.904960+0000","last_clean":"2023-07-14T15:58:45.904960+0000","last_became_active":"2023-07-14T15:56:02.621471+0000","last_became_peered":"2023-07-14T15:56:02.621471+0000","last_unstale":"2023-07-14T15:58:45.904960+0000","last_undegraded":"2023-07-14T15:58:45.904960+0000","last_fullsized":"2023-07-14T15:58:45.904960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:39:41.710708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":74,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-14T15:58:48.013415+0000","last_change":"2023-07-14T15:56:02.621963+0000","last_active":"2023-07-14T15:58:48.013415+0000","last_peered":"2023-07-14T15:58:48.013415+0000","last_clean":"2023-07-14T15:58:48.013415+0000","last_became_active":"2023-07-14T15:56:02.621678+0000","last_became_peered":"2023-07-14T15:56:02.621678+0000","last_unstale":"2023-07-14T15:58:48.013415+0000","last_undegraded":"2023-07-14T15:58:48.013415+0000","last_fullsized":"2023-07-14T15:58:48.013415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:19:56.723709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":64,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-14T15:58:46.181131+0000","last_change":"2023-07-14T15:56:01.925110+0000","last_active":"2023-07-14T15:58:46.181131+0000","last_peered":"2023-07-14T15:58:46.181131+0000","last_clean":"2023-07-14T15:58:46.181131+0000","last_became_active":"2023-07-14T15:56:01.924723+0000","last_became_peered":"2023-07-14T15:56:01.924723+0000","last_unstale":"2023-07-14T15:58:46.181131+0000","last_undegraded":"2023-07-14T15:58:46.181131+0000","last_fullsized":"2023-07-14T15:58:46.181131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:37:09.789115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":74,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-14T15:58:48.012933+0000","last_change":"2023-07-14T15:56:01.923465+0000","last_active":"2023-07-14T15:58:48.012933+0000","last_peered":"2023-07-14T15:58:48.012933+0000","last_clean":"2023-07-14T15:58:48.012933+0000","last_became_active":"2023-07-14T15:56:01.923160+0000","last_became_peered":"2023-07-14T15:56:01.923160+0000","last_unstale":"2023-07-14T15:58:48.012933+0000","last_undegraded":"2023-07-14T15:58:48.012933+0000","last_fullsized":"2023-07-14T15:58:48.012933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:56:15.913004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":218,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-07-14T15:58:49.637926+0000","last_change":"2023-07-14T15:55:54.040065+0000","last_active":"2023-07-14T15:58:49.637926+0000","last_peered":"2023-07-14T15:58:49.637926+0000","last_clean":"2023-07-14T15:58:49.637926+0000","last_became_active":"2023-07-14T15:55:54.038885+0000","last_became_peered":"2023-07-14T15:55:54.038885+0000","last_unstale":"2023-07-14T15:58:49.637926+0000","last_undegraded":"2023-07-14T15:58:49.637926+0000","last_fullsized":"2023-07-14T15:58:49.637926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:55:53.025696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:55:53.025696+0000","last_clean_scrub_stamp":"2023-07-14T15:55:53.025696+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:18:19.914041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":74,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-14T15:58:48.013868+0000","last_change":"2023-07-14T15:56:01.920714+0000","last_active":"2023-07-14T15:58:48.013868+0000","last_peered":"2023-07-14T15:58:48.013868+0000","last_clean":"2023-07-14T15:58:48.013868+0000","last_became_active":"2023-07-14T15:56:01.920325+0000","last_became_peered":"2023-07-14T15:56:01.920325+0000","last_unstale":"2023-07-14T15:58:48.013868+0000","last_undegraded":"2023-07-14T15:58:48.013868+0000","last_fullsized":"2023-07-14T15:58:48.013868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:50:13.507177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":74,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-14T15:58:48.015424+0000","last_change":"2023-07-14T15:56:01.923631+0000","last_active":"2023-07-14T15:58:48.015424+0000","last_peered":"2023-07-14T15:58:48.015424+0000","last_clean":"2023-07-14T15:58:48.015424+0000","last_became_active":"2023-07-14T15:56:01.922783+0000","last_became_peered":"2023-07-14T15:56:01.922783+0000","last_unstale":"2023-07-14T15:58:48.015424+0000","last_undegraded":"2023-07-14T15:58:48.015424+0000","last_fullsized":"2023-07-14T15:58:48.015424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:56:48.333005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":64,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-14T15:58:46.182276+0000","last_change":"2023-07-14T15:56:01.965649+0000","last_active":"2023-07-14T15:58:46.182276+0000","last_peered":"2023-07-14T15:58:46.182276+0000","last_clean":"2023-07-14T15:58:46.182276+0000","last_became_active":"2023-07-14T15:56:01.965344+0000","last_became_peered":"2023-07-14T15:56:01.965344+0000","last_unstale":"2023-07-14T15:58:46.182276+0000","last_undegraded":"2023-07-14T15:58:46.182276+0000","last_fullsized":"2023-07-14T15:58:46.182276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:10:05.443365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":74,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-14T15:58:48.013924+0000","last_change":"2023-07-14T15:56:01.966578+0000","last_active":"2023-07-14T15:58:48.013924+0000","last_peered":"2023-07-14T15:58:48.013924+0000","last_clean":"2023-07-14T15:58:48.013924+0000","last_became_active":"2023-07-14T15:56:01.966216+0000","last_became_peered":"2023-07-14T15:56:01.966216+0000","last_unstale":"2023-07-14T15:58:48.013924+0000","last_undegraded":"2023-07-14T15:58:48.013924+0000","last_fullsized":"2023-07-14T15:58:48.013924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:58:38.326767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476775,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31636,"kb_used_data":588,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340204,"statfs":{"total":96636764160,"available":96604368896,"internally_reserved":0,"allocated":602112,"data_stored":256006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.44800000000000001,"15min":0.45000000000000001},"min":{"1min":0.29799999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.58999999999999997,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.46300000000000002,"15min":0.47299999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.57599999999999996,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.42599999999999999}]},{"osd":1,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.57799999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.52100000000000002,"15min":0.52300000000000002},"min":{"1min":0.38600000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.67500000000000004,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.48999999999999999}]},{"osd":2,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.504,"15min":0.505},"min":{"1min":0.40300000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.66700000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.74199999999999999,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.55100000000000005}]},{"osd":4,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.755,"15min":0.76500000000000001},"min":{"1min":0.503,"5min":0.441,"15min":0.441},"max":{"1min":1.0189999999999999,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.76600000000000001,"15min":0.77400000000000002},"min":{"1min":0.53900000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.88400000000000001,"5min":1.542,"15min":1.542},"last":0.59399999999999997}]},{"osd":5,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.84199999999999997,"15min":0.85599999999999998},"min":{"1min":0.625,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.95299999999999996,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.84599999999999997,"15min":0.85699999999999998},"min":{"1min":0.60899999999999999,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.94599999999999995,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.77100000000000002}]},{"osd":6,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.80800000000000005,"15min":0.81899999999999995},"min":{"1min":0.55900000000000005,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.98799999999999999,"5min":1.52,"15min":1.52},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.79900000000000004,"15min":0.81200000000000006},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.86099999999999999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.747}]},{"osd":7,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.77400000000000002,"15min":0.77700000000000002},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.96499999999999997,"5min":1.232,"15min":1.232},"last":0.621},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.84299999999999997,"15min":0.85699999999999998},"min":{"1min":0.55500000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.94899999999999995,"5min":1.478,"15min":1.478},"last":0.79000000000000004}]}]},{"osd":0,"up_from":16,"seq":68719476776,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":596,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":610304,"data_stored":262144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42299999999999999,"15min":0.42399999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.67500000000000004,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.48499999999999999,"15min":0.48899999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.61599999999999999,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.46200000000000002}]},{"osd":2,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.499,"15min":0.5},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.50800000000000001,"15min":0.505},"min":{"1min":0.41499999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.36299999999999999}]},{"osd":3,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47899999999999998,"15min":0.48099999999999998},"min":{"1min":0.38100000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.60699999999999998,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.308},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.57299999999999995,"15min":0.57699999999999996},"min":{"1min":0.42399999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76500000000000001,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.443}]},{"osd":4,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.99399999999999999,"5min":1.04,"15min":1.04},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.78000000000000003,"15min":0.78900000000000003},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.91000000000000003,"5min":1.331,"15min":1.331},"last":0.73599999999999999}]},{"osd":5,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.60999999999999999,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.119,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.56999999999999995,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0289999999999999,"5min":1.087,"15min":1.087},"last":0.77200000000000002}]},{"osd":6,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.77500000000000002,"15min":0.78100000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0029999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.80100000000000005,"15min":0.80500000000000005},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.056,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.70799999999999996}]},{"osd":7,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.80100000000000005,"15min":0.80800000000000005},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.99399999999999999,"5min":1.262,"15min":1.262},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.79700000000000004,"15min":0.80100000000000005},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.97799999999999998,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.72099999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542183,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":622592,"data_stored":267993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.621,"15min":0.61699999999999999},"min":{"1min":0.40999999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.82399999999999995,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64700000000000002,"15min":0.64600000000000002},"min":{"1min":0.496,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81599999999999995,"5min":1.266,"15min":1.266},"last":0.64400000000000002}]},{"osd":1,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.69799999999999995,"15min":0.70299999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88700000000000001,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.72199999999999998,"15min":0.71699999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.78400000000000003}]},{"osd":2,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.88500000000000001,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.68600000000000005,"15min":0.69099999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.72199999999999998}]},{"osd":3,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.78200000000000003,"15min":0.80400000000000005},"min":{"1min":0.48099999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.85999999999999999,"5min":3.141,"15min":3.141},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.752,"15min":0.753},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.94999999999999996,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.878}]},{"osd":4,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.63,"15min":0.63300000000000001},"min":{"1min":0.432,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.83499999999999996,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.70899999999999996,"15min":0.71199999999999997},"min":{"1min":0.47599999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.92300000000000004,"5min":1.024,"15min":1.024},"last":0.59899999999999998}]},{"osd":5,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.748,"15min":0.751},"min":{"1min":0.51700000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.96999999999999997,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73599999999999999,"15min":0.73999999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.012,"5min":1.091,"15min":1.091},"last":0.745}]},{"osd":7,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.72499999999999998,"15min":0.72899999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.92500000000000004,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.82399999999999995,"15min":0.82899999999999996},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":0.996,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.89600000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542182,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1216512,"data_stored":858361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.60699999999999998,"15min":0.64200000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.53100000000000003,"5min":4.5519999999999996,"15min":4.5519999999999996},"last":0.499},{"interface":"front","average":{"1min":0.46200000000000002,"5min":1.147,"15min":1.2609999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.70899999999999996,"5min":15.911,"15min":15.911},"last":0.314}]},{"osd":2,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.45700000000000002,"15min":0.46400000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.53300000000000003,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.624},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.67300000000000004,"15min":0.70599999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.57299999999999995,"5min":4.5140000000000002,"15min":4.5140000000000002},"last":0.65400000000000003}]},{"osd":3,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.70199999999999996,"15min":0.73599999999999999},"min":{"1min":0.378,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.65500000000000003,"5min":4.452,"15min":4.452},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.70299999999999996,"15min":0.73899999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.57999999999999996,"5min":4.2279999999999998,"15min":4.2279999999999998},"last":0.72799999999999998}]},{"osd":4,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.88400000000000001,"15min":0.92000000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.81899999999999995,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":0.75},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.92200000000000004,"15min":0.95999999999999996},"min":{"1min":0.52400000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.95699999999999996,"5min":4.9109999999999996,"15min":4.9109999999999996},"last":0.76500000000000001}]},{"osd":5,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.90000000000000002,"15min":0.93300000000000005},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.98999999999999999,"5min":4.1269999999999998,"15min":4.1269999999999998},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.93799999999999994,"15min":0.97399999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.93700000000000006,"5min":4.585,"15min":4.585},"last":0.70999999999999996}]},{"osd":6,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.93300000000000005,"15min":0.97099999999999997},"min":{"1min":0.56899999999999995,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0369999999999999,"5min":4.9880000000000004,"15min":4.9880000000000004},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.92900000000000005,"15min":0.96299999999999997},"min":{"1min":0.58499999999999996,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94599999999999995,"5min":4.1660000000000004,"15min":4.1660000000000004},"last":0.85599999999999998}]},{"osd":7,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.98199999999999998,"15min":1.0249999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.0429999999999999,"5min":4.9530000000000003,"15min":4.9530000000000003},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.94599999999999995,"15min":0.98099999999999998},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.048,"5min":4.1959999999999997,"15min":4.1959999999999997},"last":0.82199999999999995}]}]},{"osd":2,"up_from":15,"seq":64424509479,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":588,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":602112,"data_stored":256038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.42699999999999999,"15min":0.433},"min":{"1min":0.32200000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.51900000000000002,"5min":0.62,"15min":0.62},"last":0.498},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.47299999999999998,"15min":0.48299999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.57999999999999996,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.59399999999999997}]},{"osd":1,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.52400000000000002,"15min":0.53100000000000003},"min":{"1min":0.315,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76200000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.46899999999999997,"15min":0.47099999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.65100000000000002,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.55900000000000005}]},{"osd":3,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.58799999999999997,"15min":0.60199999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.63600000000000001,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.53200000000000003,"15min":0.53800000000000003},"min":{"1min":0.433,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.53700000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.61699999999999999}]},{"osd":4,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.72399999999999998,"15min":0.72799999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.169,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.74299999999999999,"15min":0.747},"min":{"1min":0.53300000000000003,"5min":0.437,"15min":0.437},"max":{"1min":0.90100000000000002,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.82099999999999995}]},{"osd":5,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.77300000000000002,"15min":0.78100000000000003},"min":{"1min":0.55700000000000005,"5min":0.505,"15min":0.505},"max":{"1min":1.002,"5min":1.391,"15min":1.391},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.75600000000000001,"15min":0.76200000000000001},"min":{"1min":0.50700000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.153,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.91300000000000003}]},{"osd":6,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.79000000000000004,"15min":0.80300000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0960000000000001,"5min":1.51,"15min":1.51},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.81599999999999995,"15min":0.82999999999999996},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1319999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.754}]},{"osd":7,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.78300000000000003,"15min":0.79400000000000004},"min":{"1min":0.54700000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.048,"5min":1.288,"15min":1.288},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.81799999999999995,"15min":0.82799999999999996},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.85999999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509478,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":765952,"data_stored":409792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.67700000000000005,"15min":0.68700000000000006},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.64700000000000002,"15min":0.65700000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88300000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.753}]},{"osd":1,"last update":"Fri Jul 14 15:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.67000000000000004,"15min":0.67600000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.81999999999999995,"5min":0.87,"15min":0.87},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.65100000000000002,"15min":0.66000000000000003},"min":{"1min":0.44400000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.82899999999999996,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.57499999999999996}]},{"osd":2,"last update":"Fri Jul 14 15:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64400000000000002,"15min":0.65000000000000002},"min":{"1min":0.441,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.71599999999999997,"15min":0.72899999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.80900000000000005,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.67800000000000005}]},{"osd":3,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.68400000000000005,"15min":0.68799999999999994},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.86699999999999999,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.72799999999999998,"15min":0.73499999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.94299999999999995,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.65800000000000003}]},{"osd":5,"last update":"Fri Jul 14 15:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65900000000000003,"15min":0.66400000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.83499999999999996,"5min":1.119,"15min":1.119},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.70699999999999996,"15min":0.71599999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.88200000000000001,"5min":1.157,"15min":1.157},"last":0.51200000000000001}]},{"osd":6,"last update":"Fri Jul 14 15:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.70199999999999996,"15min":0.71399999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.86199999999999999,"5min":1.04,"15min":1.04},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.89800000000000002,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.63900000000000001}]},{"osd":7,"last update":"Fri Jul 14 15:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.755,"15min":0.76700000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93799999999999994,"5min":1.202,"15min":1.202},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.77900000000000003,"15min":0.79100000000000004},"min":{"1min":0.53900000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.92100000000000004,"5min":1.137,"15min":1.137},"last":0.65000000000000002}]}]},{"osd":5,"up_from":15,"seq":64424509480,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28276,"kb_used_data":1324,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343564,"statfs":{"total":96636764160,"available":96607809536,"internally_reserved":0,"allocated":1355776,"data_stored":1000158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.66400000000000003,"15min":0.67200000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.86099999999999999,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.97799999999999998,"15min":1.038},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.80600000000000005,"5min":8.1500000000000004,"15min":8.1500000000000004},"last":0.57899999999999996}]},{"osd":1,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.67200000000000004,"15min":0.67600000000000005},"min":{"1min":0.51200000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.98799999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.66400000000000003,"15min":0.67000000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.76800000000000002,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.55700000000000005}]},{"osd":2,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.75800000000000001,"15min":0.77100000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.873,"5min":1.085,"15min":1.085},"last":0.626},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.72499999999999998,"15min":0.73699999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.86599999999999999,"5min":1.048,"15min":1.048},"last":0.77600000000000002}]},{"osd":3,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.69299999999999995,"15min":0.70099999999999996},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.82299999999999995,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.80000000000000004,"15min":0.81000000000000005},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":0.91700000000000004,"5min":1.083,"15min":1.083},"last":0.75900000000000001}]},{"osd":4,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68999999999999995,"15min":0.69199999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.65700000000000003,"15min":0.66300000000000003},"min":{"1min":0.441,"5min":0.438,"15min":0.438},"max":{"1min":0.82099999999999995,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.48699999999999999}]},{"osd":6,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.69899999999999995,"15min":0.71299999999999997},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.871,"5min":1.121,"15min":1.121},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.78700000000000003,"15min":0.80100000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.93799999999999994,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.81699999999999995}]},{"osd":7,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.74399999999999999,"15min":0.751},"min":{"1min":0.58199999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.875,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.81699999999999995,"15min":0.83099999999999996},"min":{"1min":0.53800000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.94699999999999995,"5min":1.605,"15min":1.605},"last":0.71299999999999997}]}]},{"osd":7,"up_from":15,"seq":64424509479,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":598016,"data_stored":255636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.61799999999999999,"15min":0.61499999999999999},"min":{"1min":0.39300000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0089999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.80400000000000005,"15min":0.82499999999999996},"min":{"1min":0.44400000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0820000000000001,"5min":4.5919999999999996,"15min":4.5919999999999996},"last":0.745}]},{"osd":1,"last update":"Fri Jul 14 15:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.66700000000000004,"15min":0.66900000000000004},"min":{"1min":0.442,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98299999999999998,"5min":1,"15min":1},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.86199999999999999,"15min":0.89600000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88100000000000001,"5min":4.665,"15min":4.665},"last":0.44500000000000001}]},{"osd":2,"last update":"Fri Jul 14 15:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.872,"15min":0.91200000000000003},"min":{"1min":0.50600000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.86699999999999999,"5min":5.4089999999999998,"15min":5.4089999999999998},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.76700000000000002,"15min":0.77500000000000002},"min":{"1min":0.497,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0389999999999999,"5min":2.165,"15min":2.165},"last":0.623}]},{"osd":3,"last update":"Fri Jul 14 15:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.753,"15min":0.76100000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.96199999999999997,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.80600000000000005,"15min":0.82399999999999995},"min":{"1min":0.49299999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.92500000000000004,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":0.65000000000000002}]},{"osd":4,"last update":"Fri Jul 14 15:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.63900000000000001,"15min":0.64100000000000001},"min":{"1min":0.41099999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89200000000000002,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.65400000000000003,"15min":0.65900000000000003},"min":{"1min":0.37,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.77800000000000002,"5min":1.111,"15min":1.111},"last":0.59999999999999998}]},{"osd":5,"last update":"Fri Jul 14 15:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.65100000000000002,"15min":0.65900000000000003},"min":{"1min":0.40400000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.80500000000000005,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.73799999999999999,"15min":0.747},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.89800000000000002,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.77400000000000002}]},{"osd":6,"last update":"Fri Jul 14 15:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69799999999999995,"15min":0.70499999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84799999999999998,"5min":1.042,"15min":1.042},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.76100000000000001,"15min":0.77700000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.83799999999999997,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.71499999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T15:58:52.955 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T15:58:53.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.173+0000 7f3412bff700 1 Processor -- start 2023-07-14T15:58:53.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.173+0000 7f3412bff700 1 -- start start 2023-07-14T15:58:53.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.174+0000 7f3412bff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f340c0b8650 0x7f340c0d0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:53.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.174+0000 7f3412bff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f340c0b24e0 0x7f340c0cf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:53.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.174+0000 7f3412bff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f340c0cfbd0 0x7f340c0b4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:53.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.174+0000 7f3412bff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f340c0cd540 con 0x7f340c0b8650 2023-07-14T15:58:53.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.174+0000 7f3412bff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f340c0d1000 con 0x7f340c0b24e0 2023-07-14T15:58:53.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.174+0000 7f3412bff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f340c160f70 con 0x7f340c0cfbd0 2023-07-14T15:58:53.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.175+0000 7f341099b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f340c0b8650 0x7f340c0d0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:53.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.175+0000 7f341099b700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f340c0b8650 0x7f340c0d0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36212/0 (socket says 172.21.15.37:36212) 2023-07-14T15:58:53.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.175+0000 7f341099b700 1 -- 172.21.15.37:0/3580094950 learned_addr learned my addr 172.21.15.37:0/3580094950 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:53.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.175+0000 7f341119c700 1 --2- 172.21.15.37:0/3580094950 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f340c0cfbd0 0x7f340c0b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:53.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.175+0000 7f340bfff700 1 --2- 172.21.15.37:0/3580094950 >> v2:172.21.15.98:3300/0 conn(0x7f340c0b24e0 0x7f340c0cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:53.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.175+0000 7f341099b700 1 -- 172.21.15.37:0/3580094950 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f340c0cfbd0 msgr2=0x7f340c0b4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:53.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.175+0000 7f341099b700 1 --2- 172.21.15.37:0/3580094950 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f340c0cfbd0 0x7f340c0b4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:53.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.175+0000 7f341099b700 1 -- 172.21.15.37:0/3580094950 >> v2:172.21.15.98:3300/0 conn(0x7f340c0b24e0 msgr2=0x7f340c0cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:53.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.175+0000 7f341099b700 1 --2- 172.21.15.37:0/3580094950 >> v2:172.21.15.98:3300/0 conn(0x7f340c0b24e0 0x7f340c0cf690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:53.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.175+0000 7f341099b700 1 -- 172.21.15.37:0/3580094950 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f340c0cd790 con 0x7f340c0b8650 2023-07-14T15:58:53.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.175+0000 7f341119c700 1 --2- 172.21.15.37:0/3580094950 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f340c0cfbd0 0x7f340c0b4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:58:53.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.175+0000 7f341099b700 1 --2- 172.21.15.37:0/3580094950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f340c0b8650 0x7f340c0d0ac0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f340c0d0470 tx=0x7f3400009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf39b40bcdd300cf server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:53.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.176+0000 7f340b7fe700 1 -- 172.21.15.37:0/3580094950 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340000b870 con 0x7f340c0b8650 2023-07-14T15:58:53.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.176+0000 7f340b7fe700 1 -- 172.21.15.37:0/3580094950 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f340000b9d0 con 0x7f340c0b8650 2023-07-14T15:58:53.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.176+0000 7f340b7fe700 1 -- 172.21.15.37:0/3580094950 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340000bd60 con 0x7f340c0b8650 2023-07-14T15:58:53.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.176+0000 7f3412bff700 1 -- 172.21.15.37:0/3580094950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f340c0b8650 msgr2=0x7f340c0d0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:53.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.176+0000 7f3412bff700 1 --2- 172.21.15.37:0/3580094950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f340c0b8650 0x7f340c0d0ac0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f340c0d0470 tx=0x7f3400009bd0 comp rx=0 tx=0).stop 2023-07-14T15:58:53.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.176+0000 7f3412bff700 1 -- 172.21.15.37:0/3580094950 shutdown_connections 2023-07-14T15:58:53.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.176+0000 7f3412bff700 1 --2- 172.21.15.37:0/3580094950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f340c0b8650 0x7f340c0d0ac0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:53.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.176+0000 7f3412bff700 1 --2- 172.21.15.37:0/3580094950 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f340c0cfbd0 0x7f340c0b4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:53.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.176+0000 7f3412bff700 1 --2- 172.21.15.37:0/3580094950 >> v2:172.21.15.98:3300/0 conn(0x7f340c0b24e0 0x7f340c0cf690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:53.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.176+0000 7f3412bff700 1 -- 172.21.15.37:0/3580094950 >> 172.21.15.37:0/3580094950 conn(0x7f340c06c0f0 msgr2=0x7f340c06c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:53.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.176+0000 7f3412bff700 1 -- 172.21.15.37:0/3580094950 shutdown_connections 2023-07-14T15:58:53.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.176+0000 7f3412bff700 1 -- 172.21.15.37:0/3580094950 wait complete. 2023-07-14T15:58:53.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.178+0000 7f3412bff700 1 Processor -- start 2023-07-14T15:58:53.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.178+0000 7f3412bff700 1 -- start start 2023-07-14T15:58:53.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.179+0000 7f3412bff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f340c0b24e0 0x7f340c1f2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:53.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.179+0000 7f3412bff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f340c0b8650 0x7f340c1e5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:53.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.179+0000 7f3412bff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f340c0cfbd0 0x7f340c15de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:53.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.179+0000 7f3412bff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f340c1f2ed0 con 0x7f340c0b24e0 2023-07-14T15:58:53.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.179+0000 7f3412bff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f340c1e8290 con 0x7f340c0b8650 2023-07-14T15:58:53.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.179+0000 7f3412bff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f340c1e8570 con 0x7f340c0cfbd0 2023-07-14T15:58:53.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.180+0000 7f341099b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f340c0b24e0 0x7f340c1f2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:53.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.180+0000 7f341099b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f340c0b24e0 0x7f340c1f2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36218/0 (socket says 172.21.15.37:36218) 2023-07-14T15:58:53.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.180+0000 7f341099b700 1 -- 172.21.15.37:0/3406889151 learned_addr learned my addr 172.21.15.37:0/3406889151 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:53.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.180+0000 7f340bfff700 1 --2- 172.21.15.37:0/3406889151 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f340c0b8650 0x7f340c1e5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:53.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.180+0000 7f341119c700 1 --2- 172.21.15.37:0/3406889151 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f340c0cfbd0 0x7f340c15de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:53.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.180+0000 7f341099b700 1 -- 172.21.15.37:0/3406889151 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f340c0cfbd0 msgr2=0x7f340c15de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:53.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.180+0000 7f341099b700 1 --2- 172.21.15.37:0/3406889151 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f340c0cfbd0 0x7f340c15de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:53.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.180+0000 7f341099b700 1 -- 172.21.15.37:0/3406889151 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f340c0b8650 msgr2=0x7f340c1e5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:53.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.180+0000 7f341099b700 1 --2- 172.21.15.37:0/3406889151 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f340c0b8650 0x7f340c1e5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:53.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.180+0000 7f341099b700 1 -- 172.21.15.37:0/3406889151 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3400009550 con 0x7f340c0b24e0 2023-07-14T15:58:53.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.180+0000 7f341099b700 1 --2- 172.21.15.37:0/3406889151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f340c0b24e0 0x7f340c1f2990 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f3400000c00 tx=0x7f3400004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:53.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.180+0000 7f34097fa700 1 -- 172.21.15.37:0/3406889151 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3400004540 con 0x7f340c0b24e0 2023-07-14T15:58:53.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.181+0000 7f34097fa700 1 -- 172.21.15.37:0/3406889151 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34000036a0 con 0x7f340c0b24e0 2023-07-14T15:58:53.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.181+0000 7f34097fa700 1 -- 172.21.15.37:0/3406889151 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3400003a50 con 0x7f340c0b24e0 2023-07-14T15:58:53.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.181+0000 7f3412bff700 1 -- 172.21.15.37:0/3406889151 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f340c15c470 con 0x7f340c0b24e0 2023-07-14T15:58:53.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.181+0000 7f3412bff700 1 -- 172.21.15.37:0/3406889151 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f340c15ca30 con 0x7f340c0b24e0 2023-07-14T15:58:53.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.182+0000 7f3412bff700 1 -- 172.21.15.37:0/3406889151 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f340c067840 con 0x7f340c0b24e0 2023-07-14T15:58:53.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.183+0000 7f34097fa700 1 -- 172.21.15.37:0/3406889151 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f3400021070 con 0x7f340c0b24e0 2023-07-14T15:58:53.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.184+0000 7f34097fa700 1 --2- 172.21.15.37:0/3406889151 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f33f006ae00 0x7f33f006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:53.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.184+0000 7f34097fa700 1 -- 172.21.15.37:0/3406889151 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5324+0+0 (secure 0 0 0) 0x7f340008a910 con 0x7f340c0b24e0 2023-07-14T15:58:53.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.184+0000 7f340bfff700 1 --2- 172.21.15.37:0/3406889151 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f33f006ae00 0x7f33f006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:53.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.185+0000 7f340bfff700 1 --2- 172.21.15.37:0/3406889151 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f33f006ae00 0x7f33f006d2b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f33f8009950 tx=0x7f33f8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:53.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.188+0000 7f34097fa700 1 -- 172.21.15.37:0/3406889151 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3400055d40 con 0x7f340c0b24e0 2023-07-14T15:58:53.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.391+0000 7f3412bff700 1 -- 172.21.15.37:0/3406889151 --> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f340c0b8a20 con 0x7f33f006ae00 2023-07-14T15:58:53.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.395+0000 7f34097fa700 1 -- 172.21.15.37:0/3406889151 <== mgr.4100 v2:172.21.15.98:6832/3163748069 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72797 (secure 0 0 0) 0x7f33f8009e70 con 0x7f33f006ae00 2023-07-14T15:58:53.381 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:58:53.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.397+0000 7f3412bff700 1 -- 172.21.15.37:0/3406889151 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f33f006ae00 msgr2=0x7f33f006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:53.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.397+0000 7f3412bff700 1 --2- 172.21.15.37:0/3406889151 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f33f006ae00 0x7f33f006d2b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f33f8009950 tx=0x7f33f8008040 comp rx=0 tx=0).stop 2023-07-14T15:58:53.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.397+0000 7f3412bff700 1 -- 172.21.15.37:0/3406889151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f340c0b24e0 msgr2=0x7f340c1f2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:53.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.397+0000 7f3412bff700 1 --2- 172.21.15.37:0/3406889151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f340c0b24e0 0x7f340c1f2990 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f3400000c00 tx=0x7f3400004750 comp rx=0 tx=0).stop 2023-07-14T15:58:53.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.397+0000 7f3412bff700 1 -- 172.21.15.37:0/3406889151 shutdown_connections 2023-07-14T15:58:53.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.397+0000 7f3412bff700 1 --2- 172.21.15.37:0/3406889151 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f33f006ae00 0x7f33f006d2b0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:53.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.397+0000 7f3412bff700 1 --2- 172.21.15.37:0/3406889151 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f340c0cfbd0 0x7f340c15de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:53.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.397+0000 7f3412bff700 1 --2- 172.21.15.37:0/3406889151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f340c0b24e0 0x7f340c1f2990 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:53.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.397+0000 7f3412bff700 1 --2- 172.21.15.37:0/3406889151 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f340c0b8650 0x7f340c1e5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:53.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.397+0000 7f3412bff700 1 -- 172.21.15.37:0/3406889151 >> 172.21.15.37:0/3406889151 conn(0x7f340c06c0f0 msgr2=0x7f340c0b7770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:53.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.398+0000 7f3412bff700 1 -- 172.21.15.37:0/3406889151 shutdown_connections 2023-07-14T15:58:53.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.398+0000 7f3412bff700 1 -- 172.21.15.37:0/3406889151 wait complete. 2023-07-14T15:58:53.388 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-14T15:58:53.399 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2023-07-14T15:58:52.895200+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":176,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230032,"kb_used_data":6224,"kb_used_omap":0,"kb_used_meta":223744,"kb_avail":754744688,"statfs":{"total":773094113280,"available":772858560512,"internally_reserved":0,"allocated":6373376,"data_stored":3566128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":229113856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-155464,"num_objects":-26,"num_object_clones":0,"num_object_copies":-52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-26,"num_whiteouts":0,"num_read":-5,"num_read_kb":-3,"num_write":-118,"num_write_kb":-206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.992845"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":70,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-14T15:58:45.904960+0000","last_change":"2023-07-14T15:56:02.621850+0000","last_active":"2023-07-14T15:58:45.904960+0000","last_peered":"2023-07-14T15:58:45.904960+0000","last_clean":"2023-07-14T15:58:45.904960+0000","last_became_active":"2023-07-14T15:56:02.621471+0000","last_became_peered":"2023-07-14T15:56:02.621471+0000","last_unstale":"2023-07-14T15:58:45.904960+0000","last_undegraded":"2023-07-14T15:58:45.904960+0000","last_fullsized":"2023-07-14T15:58:45.904960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:39:41.710708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":74,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-14T15:58:48.013415+0000","last_change":"2023-07-14T15:56:02.621963+0000","last_active":"2023-07-14T15:58:48.013415+0000","last_peered":"2023-07-14T15:58:48.013415+0000","last_clean":"2023-07-14T15:58:48.013415+0000","last_became_active":"2023-07-14T15:56:02.621678+0000","last_became_peered":"2023-07-14T15:56:02.621678+0000","last_unstale":"2023-07-14T15:58:48.013415+0000","last_undegraded":"2023-07-14T15:58:48.013415+0000","last_fullsized":"2023-07-14T15:58:48.013415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:19:56.723709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":64,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-14T15:58:46.181131+0000","last_change":"2023-07-14T15:56:01.925110+0000","last_active":"2023-07-14T15:58:46.181131+0000","last_peered":"2023-07-14T15:58:46.181131+0000","last_clean":"2023-07-14T15:58:46.181131+0000","last_became_active":"2023-07-14T15:56:01.924723+0000","last_became_peered":"2023-07-14T15:56:01.924723+0000","last_unstale":"2023-07-14T15:58:46.181131+0000","last_undegraded":"2023-07-14T15:58:46.181131+0000","last_fullsized":"2023-07-14T15:58:46.181131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:37:09.789115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":74,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-14T15:58:48.012933+0000","last_change":"2023-07-14T15:56:01.923465+0000","last_active":"2023-07-14T15:58:48.012933+0000","last_peered":"2023-07-14T15:58:48.012933+0000","last_clean":"2023-07-14T15:58:48.012933+0000","last_became_active":"2023-07-14T15:56:01.923160+0000","last_became_peered":"2023-07-14T15:56:01.923160+0000","last_unstale":"2023-07-14T15:58:48.012933+0000","last_undegraded":"2023-07-14T15:58:48.012933+0000","last_fullsized":"2023-07-14T15:58:48.012933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:56:15.913004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":218,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-07-14T15:58:49.637926+0000","last_change":"2023-07-14T15:55:54.040065+0000","last_active":"2023-07-14T15:58:49.637926+0000","last_peered":"2023-07-14T15:58:49.637926+0000","last_clean":"2023-07-14T15:58:49.637926+0000","last_became_active":"2023-07-14T15:55:54.038885+0000","last_became_peered":"2023-07-14T15:55:54.038885+0000","last_unstale":"2023-07-14T15:58:49.637926+0000","last_undegraded":"2023-07-14T15:58:49.637926+0000","last_fullsized":"2023-07-14T15:58:49.637926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:55:53.025696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:55:53.025696+0000","last_clean_scrub_stamp":"2023-07-14T15:55:53.025696+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:18:19.914041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":74,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-14T15:58:48.013868+0000","last_change":"2023-07-14T15:56:01.920714+0000","last_active":"2023-07-14T15:58:48.013868+0000","last_peered":"2023-07-14T15:58:48.013868+0000","last_clean":"2023-07-14T15:58:48.013868+0000","last_became_active":"2023-07-14T15:56:01.920325+0000","last_became_peered":"2023-07-14T15:56:01.920325+0000","last_unstale":"2023-07-14T15:58:48.013868+0000","last_undegraded":"2023-07-14T15:58:48.013868+0000","last_fullsized":"2023-07-14T15:58:48.013868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:50:13.507177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":74,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-14T15:58:48.015424+0000","last_change":"2023-07-14T15:56:01.923631+0000","last_active":"2023-07-14T15:58:48.015424+0000","last_peered":"2023-07-14T15:58:48.015424+0000","last_clean":"2023-07-14T15:58:48.015424+0000","last_became_active":"2023-07-14T15:56:01.922783+0000","last_became_peered":"2023-07-14T15:56:01.922783+0000","last_unstale":"2023-07-14T15:58:48.015424+0000","last_undegraded":"2023-07-14T15:58:48.015424+0000","last_fullsized":"2023-07-14T15:58:48.015424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:56:48.333005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":64,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-14T15:58:46.182276+0000","last_change":"2023-07-14T15:56:01.965649+0000","last_active":"2023-07-14T15:58:46.182276+0000","last_peered":"2023-07-14T15:58:46.182276+0000","last_clean":"2023-07-14T15:58:46.182276+0000","last_became_active":"2023-07-14T15:56:01.965344+0000","last_became_peered":"2023-07-14T15:56:01.965344+0000","last_unstale":"2023-07-14T15:58:46.182276+0000","last_undegraded":"2023-07-14T15:58:46.182276+0000","last_fullsized":"2023-07-14T15:58:46.182276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:10:05.443365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":74,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-14T15:58:48.013924+0000","last_change":"2023-07-14T15:56:01.966578+0000","last_active":"2023-07-14T15:58:48.013924+0000","last_peered":"2023-07-14T15:58:48.013924+0000","last_clean":"2023-07-14T15:58:48.013924+0000","last_became_active":"2023-07-14T15:56:01.966216+0000","last_became_peered":"2023-07-14T15:56:01.966216+0000","last_unstale":"2023-07-14T15:58:48.013924+0000","last_undegraded":"2023-07-14T15:58:48.013924+0000","last_fullsized":"2023-07-14T15:58:48.013924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:58:38.326767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476775,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31636,"kb_used_data":588,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340204,"statfs":{"total":96636764160,"available":96604368896,"internally_reserved":0,"allocated":602112,"data_stored":256006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.44800000000000001,"15min":0.45000000000000001},"min":{"1min":0.29799999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.58999999999999997,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.46300000000000002,"15min":0.47299999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.57599999999999996,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.42599999999999999}]},{"osd":1,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.57799999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.52100000000000002,"15min":0.52300000000000002},"min":{"1min":0.38600000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.67500000000000004,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.48999999999999999}]},{"osd":2,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.504,"15min":0.505},"min":{"1min":0.40300000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.66700000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.74199999999999999,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.55100000000000005}]},{"osd":4,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.755,"15min":0.76500000000000001},"min":{"1min":0.503,"5min":0.441,"15min":0.441},"max":{"1min":1.0189999999999999,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.76600000000000001,"15min":0.77400000000000002},"min":{"1min":0.53900000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.88400000000000001,"5min":1.542,"15min":1.542},"last":0.59399999999999997}]},{"osd":5,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.84199999999999997,"15min":0.85599999999999998},"min":{"1min":0.625,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.95299999999999996,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.84599999999999997,"15min":0.85699999999999998},"min":{"1min":0.60899999999999999,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.94599999999999995,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.77100000000000002}]},{"osd":6,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.80800000000000005,"15min":0.81899999999999995},"min":{"1min":0.55900000000000005,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.98799999999999999,"5min":1.52,"15min":1.52},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.79900000000000004,"15min":0.81200000000000006},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.86099999999999999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.747}]},{"osd":7,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.77400000000000002,"15min":0.77700000000000002},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.96499999999999997,"5min":1.232,"15min":1.232},"last":0.621},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.84299999999999997,"15min":0.85699999999999998},"min":{"1min":0.55500000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.94899999999999995,"5min":1.478,"15min":1.478},"last":0.79000000000000004}]}]},{"osd":0,"up_from":16,"seq":68719476776,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":596,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":610304,"data_stored":262144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42299999999999999,"15min":0.42399999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.67500000000000004,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.48499999999999999,"15min":0.48899999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.61599999999999999,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.46200000000000002}]},{"osd":2,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.499,"15min":0.5},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.50800000000000001,"15min":0.505},"min":{"1min":0.41499999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.36299999999999999}]},{"osd":3,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47899999999999998,"15min":0.48099999999999998},"min":{"1min":0.38100000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.60699999999999998,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.308},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.57299999999999995,"15min":0.57699999999999996},"min":{"1min":0.42399999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76500000000000001,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.443}]},{"osd":4,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.99399999999999999,"5min":1.04,"15min":1.04},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.78000000000000003,"15min":0.78900000000000003},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.91000000000000003,"5min":1.331,"15min":1.331},"last":0.73599999999999999}]},{"osd":5,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.60999999999999999,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.119,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.56999999999999995,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0289999999999999,"5min":1.087,"15min":1.087},"last":0.77200000000000002}]},{"osd":6,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.77500000000000002,"15min":0.78100000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0029999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.80100000000000005,"15min":0.80500000000000005},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.056,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.70799999999999996}]},{"osd":7,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.80100000000000005,"15min":0.80800000000000005},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.99399999999999999,"5min":1.262,"15min":1.262},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.79700000000000004,"15min":0.80100000000000005},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.97799999999999998,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.72099999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542183,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":622592,"data_stored":267993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.621,"15min":0.61699999999999999},"min":{"1min":0.40999999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.82399999999999995,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64700000000000002,"15min":0.64600000000000002},"min":{"1min":0.496,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81599999999999995,"5min":1.266,"15min":1.266},"last":0.64400000000000002}]},{"osd":1,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.69799999999999995,"15min":0.70299999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88700000000000001,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.72199999999999998,"15min":0.71699999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.78400000000000003}]},{"osd":2,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.88500000000000001,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.68600000000000005,"15min":0.69099999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.72199999999999998}]},{"osd":3,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.78200000000000003,"15min":0.80400000000000005},"min":{"1min":0.48099999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.85999999999999999,"5min":3.141,"15min":3.141},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.752,"15min":0.753},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.94999999999999996,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.878}]},{"osd":4,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.63,"15min":0.63300000000000001},"min":{"1min":0.432,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.83499999999999996,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.70899999999999996,"15min":0.71199999999999997},"min":{"1min":0.47599999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.92300000000000004,"5min":1.024,"15min":1.024},"last":0.59899999999999998}]},{"osd":5,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.748,"15min":0.751},"min":{"1min":0.51700000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.96999999999999997,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73599999999999999,"15min":0.73999999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.012,"5min":1.091,"15min":1.091},"last":0.745}]},{"osd":7,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.72499999999999998,"15min":0.72899999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.92500000000000004,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.82399999999999995,"15min":0.82899999999999996},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":0.996,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.89600000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542182,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1216512,"data_stored":858361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.60699999999999998,"15min":0.64200000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.53100000000000003,"5min":4.5519999999999996,"15min":4.5519999999999996},"last":0.499},{"interface":"front","average":{"1min":0.46200000000000002,"5min":1.147,"15min":1.2609999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.70899999999999996,"5min":15.911,"15min":15.911},"last":0.314}]},{"osd":2,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.45700000000000002,"15min":0.46400000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.53300000000000003,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.624},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.67300000000000004,"15min":0.70599999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.57299999999999995,"5min":4.5140000000000002,"15min":4.5140000000000002},"last":0.65400000000000003}]},{"osd":3,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.70199999999999996,"15min":0.73599999999999999},"min":{"1min":0.378,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.65500000000000003,"5min":4.452,"15min":4.452},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.70299999999999996,"15min":0.73899999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.57999999999999996,"5min":4.2279999999999998,"15min":4.2279999999999998},"last":0.72799999999999998}]},{"osd":4,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.88400000000000001,"15min":0.92000000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.81899999999999995,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":0.75},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.92200000000000004,"15min":0.95999999999999996},"min":{"1min":0.52400000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.95699999999999996,"5min":4.9109999999999996,"15min":4.9109999999999996},"last":0.76500000000000001}]},{"osd":5,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.90000000000000002,"15min":0.93300000000000005},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.98999999999999999,"5min":4.1269999999999998,"15min":4.1269999999999998},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.93799999999999994,"15min":0.97399999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.93700000000000006,"5min":4.585,"15min":4.585},"last":0.70999999999999996}]},{"osd":6,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.93300000000000005,"15min":0.97099999999999997},"min":{"1min":0.56899999999999995,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0369999999999999,"5min":4.9880000000000004,"15min":4.9880000000000004},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.92900000000000005,"15min":0.96299999999999997},"min":{"1min":0.58499999999999996,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94599999999999995,"5min":4.1660000000000004,"15min":4.1660000000000004},"last":0.85599999999999998}]},{"osd":7,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.98199999999999998,"15min":1.0249999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.0429999999999999,"5min":4.9530000000000003,"15min":4.9530000000000003},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.94599999999999995,"15min":0.98099999999999998},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.048,"5min":4.1959999999999997,"15min":4.1959999999999997},"last":0.82199999999999995}]}]},{"osd":2,"up_from":15,"seq":64424509479,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":588,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":602112,"data_stored":256038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.42699999999999999,"15min":0.433},"min":{"1min":0.32200000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.51900000000000002,"5min":0.62,"15min":0.62},"last":0.498},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.47299999999999998,"15min":0.48299999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.57999999999999996,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.59399999999999997}]},{"osd":1,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.52400000000000002,"15min":0.53100000000000003},"min":{"1min":0.315,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76200000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.46899999999999997,"15min":0.47099999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.65100000000000002,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.55900000000000005}]},{"osd":3,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.58799999999999997,"15min":0.60199999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.63600000000000001,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.53200000000000003,"15min":0.53800000000000003},"min":{"1min":0.433,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.53700000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.61699999999999999}]},{"osd":4,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.72399999999999998,"15min":0.72799999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.169,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.74299999999999999,"15min":0.747},"min":{"1min":0.53300000000000003,"5min":0.437,"15min":0.437},"max":{"1min":0.90100000000000002,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.82099999999999995}]},{"osd":5,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.77300000000000002,"15min":0.78100000000000003},"min":{"1min":0.55700000000000005,"5min":0.505,"15min":0.505},"max":{"1min":1.002,"5min":1.391,"15min":1.391},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.75600000000000001,"15min":0.76200000000000001},"min":{"1min":0.50700000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.153,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.91300000000000003}]},{"osd":6,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.79000000000000004,"15min":0.80300000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0960000000000001,"5min":1.51,"15min":1.51},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.81599999999999995,"15min":0.82999999999999996},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1319999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.754}]},{"osd":7,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.78300000000000003,"15min":0.79400000000000004},"min":{"1min":0.54700000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.048,"5min":1.288,"15min":1.288},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.81799999999999995,"15min":0.82799999999999996},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.85999999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509478,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":765952,"data_stored":409792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.67700000000000005,"15min":0.68700000000000006},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.64700000000000002,"15min":0.65700000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88300000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.753}]},{"osd":1,"last update":"Fri Jul 14 15:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.67000000000000004,"15min":0.67600000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.81999999999999995,"5min":0.87,"15min":0.87},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.65100000000000002,"15min":0.66000000000000003},"min":{"1min":0.44400000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.82899999999999996,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.57499999999999996}]},{"osd":2,"last update":"Fri Jul 14 15:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64400000000000002,"15min":0.65000000000000002},"min":{"1min":0.441,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.71599999999999997,"15min":0.72899999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.80900000000000005,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.67800000000000005}]},{"osd":3,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.68400000000000005,"15min":0.68799999999999994},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.86699999999999999,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.72799999999999998,"15min":0.73499999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.94299999999999995,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.65800000000000003}]},{"osd":5,"last update":"Fri Jul 14 15:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65900000000000003,"15min":0.66400000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.83499999999999996,"5min":1.119,"15min":1.119},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.70699999999999996,"15min":0.71599999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.88200000000000001,"5min":1.157,"15min":1.157},"last":0.51200000000000001}]},{"osd":6,"last update":"Fri Jul 14 15:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.70199999999999996,"15min":0.71399999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.86199999999999999,"5min":1.04,"15min":1.04},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.89800000000000002,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.63900000000000001}]},{"osd":7,"last update":"Fri Jul 14 15:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.755,"15min":0.76700000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93799999999999994,"5min":1.202,"15min":1.202},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.77900000000000003,"15min":0.79100000000000004},"min":{"1min":0.53900000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.92100000000000004,"5min":1.137,"15min":1.137},"last":0.65000000000000002}]}]},{"osd":5,"up_from":15,"seq":64424509480,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28276,"kb_used_data":1324,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343564,"statfs":{"total":96636764160,"available":96607809536,"internally_reserved":0,"allocated":1355776,"data_stored":1000158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.66400000000000003,"15min":0.67200000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.86099999999999999,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.97799999999999998,"15min":1.038},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.80600000000000005,"5min":8.1500000000000004,"15min":8.1500000000000004},"last":0.57899999999999996}]},{"osd":1,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.67200000000000004,"15min":0.67600000000000005},"min":{"1min":0.51200000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.98799999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.66400000000000003,"15min":0.67000000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.76800000000000002,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.55700000000000005}]},{"osd":2,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.75800000000000001,"15min":0.77100000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.873,"5min":1.085,"15min":1.085},"last":0.626},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.72499999999999998,"15min":0.73699999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.86599999999999999,"5min":1.048,"15min":1.048},"last":0.77600000000000002}]},{"osd":3,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.69299999999999995,"15min":0.70099999999999996},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.82299999999999995,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.80000000000000004,"15min":0.81000000000000005},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":0.91700000000000004,"5min":1.083,"15min":1.083},"last":0.75900000000000001}]},{"osd":4,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68999999999999995,"15min":0.69199999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.65700000000000003,"15min":0.66300000000000003},"min":{"1min":0.441,"5min":0.438,"15min":0.438},"max":{"1min":0.82099999999999995,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.48699999999999999}]},{"osd":6,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.69899999999999995,"15min":0.71299999999999997},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.871,"5min":1.121,"15min":1.121},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.78700000000000003,"15min":0.80100000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.93799999999999994,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.81699999999999995}]},{"osd":7,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.74399999999999999,"15min":0.751},"min":{"1min":0.58199999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.875,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.81699999999999995,"15min":0.83099999999999996},"min":{"1min":0.53800000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.94699999999999995,"5min":1.605,"15min":1.605},"last":0.71299999999999997}]}]},{"osd":7,"up_from":15,"seq":64424509479,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":598016,"data_stored":255636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.61799999999999999,"15min":0.61499999999999999},"min":{"1min":0.39300000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0089999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.80400000000000005,"15min":0.82499999999999996},"min":{"1min":0.44400000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0820000000000001,"5min":4.5919999999999996,"15min":4.5919999999999996},"last":0.745}]},{"osd":1,"last update":"Fri Jul 14 15:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.66700000000000004,"15min":0.66900000000000004},"min":{"1min":0.442,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98299999999999998,"5min":1,"15min":1},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.86199999999999999,"15min":0.89600000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88100000000000001,"5min":4.665,"15min":4.665},"last":0.44500000000000001}]},{"osd":2,"last update":"Fri Jul 14 15:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.872,"15min":0.91200000000000003},"min":{"1min":0.50600000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.86699999999999999,"5min":5.4089999999999998,"15min":5.4089999999999998},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.76700000000000002,"15min":0.77500000000000002},"min":{"1min":0.497,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0389999999999999,"5min":2.165,"15min":2.165},"last":0.623}]},{"osd":3,"last update":"Fri Jul 14 15:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.753,"15min":0.76100000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.96199999999999997,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.80600000000000005,"15min":0.82399999999999995},"min":{"1min":0.49299999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.92500000000000004,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":0.65000000000000002}]},{"osd":4,"last update":"Fri Jul 14 15:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.63900000000000001,"15min":0.64100000000000001},"min":{"1min":0.41099999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89200000000000002,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.65400000000000003,"15min":0.65900000000000003},"min":{"1min":0.37,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.77800000000000002,"5min":1.111,"15min":1.111},"last":0.59999999999999998}]},{"osd":5,"last update":"Fri Jul 14 15:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.65100000000000002,"15min":0.65900000000000003},"min":{"1min":0.40400000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.80500000000000005,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.73799999999999999,"15min":0.747},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.89800000000000002,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.77400000000000002}]},{"osd":6,"last update":"Fri Jul 14 15:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69799999999999995,"15min":0.70499999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84799999999999998,"5min":1.042,"15min":1.042},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.76100000000000001,"15min":0.77700000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.83799999999999997,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.71499999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T15:58:53.402 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-07-14T15:58:53.403 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T15:58:53.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.620+0000 7f46611ff700 1 Processor -- start 2023-07-14T15:58:53.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.620+0000 7f46611ff700 1 -- start start 2023-07-14T15:58:53.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.622+0000 7f46611ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f465c1593c0 0x7f465c0ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:53.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.622+0000 7f46611ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f465c159790 0x7f465c0af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:53.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.622+0000 7f46611ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f465c0c9540 con 0x7f465c0c9b30 2023-07-14T15:58:53.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.622+0000 7f46611ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f465c0c9ff0 con 0x7f465c1593c0 2023-07-14T15:58:53.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.622+0000 7f46611ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f465c0ce3d0 con 0x7f465c159790 2023-07-14T15:58:53.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.622+0000 7f465ad9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f465c1593c0 0x7f465c0ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:53.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.622+0000 7f465ad9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f465c1593c0 0x7f465c0ccce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36224/0 (socket says 172.21.15.37:36224) 2023-07-14T15:58:53.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.622+0000 7f465ad9d700 1 -- 172.21.15.37:0/1992240336 learned_addr learned my addr 172.21.15.37:0/1992240336 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:53.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.622+0000 7f465b59e700 1 --2- 172.21.15.37:0/1992240336 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f465c159790 0x7f465c0af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:53.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.622+0000 7f465ad9d700 1 -- 172.21.15.37:0/1992240336 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f465c159790 msgr2=0x7f465c0af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:53.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.622+0000 7f465ad9d700 1 --2- 172.21.15.37:0/1992240336 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f465c159790 0x7f465c0af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:53.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.622+0000 7f465ad9d700 1 -- 172.21.15.37:0/1992240336 >> v1:172.21.15.98:6789/0 conn(0x7f465c0c9b30 legacy=0x7f465c15db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:53.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.622+0000 7f465ad9d700 1 -- 172.21.15.37:0/1992240336 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f465c0ce6b0 con 0x7f465c1593c0 2023-07-14T15:58:53.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.623+0000 7f465ad9d700 1 --2- 172.21.15.37:0/1992240336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f465c1593c0 0x7f465c0ccce0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f464c00bb90 tx=0x7f464c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1f9fb3bfdd5aace server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:53.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.623+0000 7f465a59c700 1 -- 172.21.15.37:0/1992240336 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464c00dd30 con 0x7f465c1593c0 2023-07-14T15:58:53.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.623+0000 7f465a59c700 1 -- 172.21.15.37:0/1992240336 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464c00de90 con 0x7f465c1593c0 2023-07-14T15:58:53.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.623+0000 7f465a59c700 1 -- 172.21.15.37:0/1992240336 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464c010690 con 0x7f465c1593c0 2023-07-14T15:58:53.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.623+0000 7f46611ff700 1 -- 172.21.15.37:0/1992240336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f465c1593c0 msgr2=0x7f465c0ccce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:53.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.623+0000 7f46611ff700 1 --2- 172.21.15.37:0/1992240336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f465c1593c0 0x7f465c0ccce0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f464c00bb90 tx=0x7f464c00bea0 comp rx=0 tx=0).stop 2023-07-14T15:58:53.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.624+0000 7f46611ff700 1 -- 172.21.15.37:0/1992240336 shutdown_connections 2023-07-14T15:58:53.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.624+0000 7f46611ff700 1 --2- 172.21.15.37:0/1992240336 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f465c159790 0x7f465c0af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:53.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.624+0000 7f46611ff700 1 --2- 172.21.15.37:0/1992240336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f465c1593c0 0x7f465c0ccce0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:53.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.624+0000 7f46611ff700 1 -- 172.21.15.37:0/1992240336 >> 172.21.15.37:0/1992240336 conn(0x7f465c0b08c0 msgr2=0x7f465c0b0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:53.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.624+0000 7f46611ff700 1 -- 172.21.15.37:0/1992240336 shutdown_connections 2023-07-14T15:58:53.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.624+0000 7f46611ff700 1 -- 172.21.15.37:0/1992240336 wait complete. 2023-07-14T15:58:53.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.625+0000 7f46611ff700 1 Processor -- start 2023-07-14T15:58:53.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.626+0000 7f46611ff700 1 -- start start 2023-07-14T15:58:53.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.626+0000 7f46611ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f465c0c9b30 0x7f465c1568f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:53.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.627+0000 7f46611ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f465c1593c0 0x7f465c156e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:53.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.627+0000 7f46611ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f465c159790 0x7f465c149b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:53.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.627+0000 7f46611ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465c148ac0 con 0x7f465c0c9b30 2023-07-14T15:58:53.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.627+0000 7f46611ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465c148da0 con 0x7f465c159790 2023-07-14T15:58:53.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.627+0000 7f46611ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f465c149080 con 0x7f465c1593c0 2023-07-14T15:58:53.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.627+0000 7f465ad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f465c0c9b30 0x7f465c1568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:53.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.627+0000 7f465ad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f465c0c9b30 0x7f465c1568f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36228/0 (socket says 172.21.15.37:36228) 2023-07-14T15:58:53.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.627+0000 7f465ad9d700 1 -- 172.21.15.37:0/944010883 learned_addr learned my addr 172.21.15.37:0/944010883 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:53.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.627+0000 7f4653fff700 1 --2- 172.21.15.37:0/944010883 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f465c1593c0 0x7f465c156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:53.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.627+0000 7f465b59e700 1 --2- 172.21.15.37:0/944010883 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f465c159790 0x7f465c149b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:53.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.627+0000 7f465ad9d700 1 -- 172.21.15.37:0/944010883 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f465c1593c0 msgr2=0x7f465c156e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:53.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.627+0000 7f465ad9d700 1 --2- 172.21.15.37:0/944010883 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f465c1593c0 0x7f465c156e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:53.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.627+0000 7f465ad9d700 1 -- 172.21.15.37:0/944010883 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f465c159790 msgr2=0x7f465c149b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:53.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.627+0000 7f465ad9d700 1 --2- 172.21.15.37:0/944010883 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f465c159790 0x7f465c149b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:53.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.627+0000 7f465ad9d700 1 -- 172.21.15.37:0/944010883 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f464c00b7f0 con 0x7f465c0c9b30 2023-07-14T15:58:53.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.628+0000 7f465ad9d700 1 --2- 172.21.15.37:0/944010883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f465c0c9b30 0x7f465c1568f0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f464c000c00 tx=0x7f464c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:53.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.628+0000 7f46537fe700 1 -- 172.21.15.37:0/944010883 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464c01f070 con 0x7f465c0c9b30 2023-07-14T15:58:53.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.628+0000 7f46537fe700 1 -- 172.21.15.37:0/944010883 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464c003970 con 0x7f465c0c9b30 2023-07-14T15:58:53.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.628+0000 7f46537fe700 1 -- 172.21.15.37:0/944010883 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464c003d20 con 0x7f465c0c9b30 2023-07-14T15:58:53.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.628+0000 7f46611ff700 1 -- 172.21.15.37:0/944010883 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f465c149360 con 0x7f465c0c9b30 2023-07-14T15:58:53.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.628+0000 7f46611ff700 1 -- 172.21.15.37:0/944010883 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f465c14a0a0 con 0x7f465c0c9b30 2023-07-14T15:58:53.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.629+0000 7f46611ff700 1 -- 172.21.15.37:0/944010883 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f465c067840 con 0x7f465c0c9b30 2023-07-14T15:58:53.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.630+0000 7f46537fe700 1 -- 172.21.15.37:0/944010883 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f464c019400 con 0x7f465c0c9b30 2023-07-14T15:58:53.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.631+0000 7f46537fe700 1 --2- 172.21.15.37:0/944010883 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f463c06ae00 0x7f463c06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:53.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.631+0000 7f46537fe700 1 -- 172.21.15.37:0/944010883 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5324+0+0 (secure 0 0 0) 0x7f464c08c8c0 con 0x7f465c0c9b30 2023-07-14T15:58:53.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.631+0000 7f4653fff700 1 --2- 172.21.15.37:0/944010883 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f463c06ae00 0x7f463c06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:53.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.632+0000 7f4653fff700 1 --2- 172.21.15.37:0/944010883 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f463c06ae00 0x7f463c06d2b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f465c1564f0 tx=0x7f4644009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:53.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.635+0000 7f46537fe700 1 -- 172.21.15.37:0/944010883 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f464c057990 con 0x7f465c0c9b30 2023-07-14T15:58:53.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.837+0000 7f46611ff700 1 -- 172.21.15.37:0/944010883 --> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f465c06f9e0 con 0x7f463c06ae00 2023-07-14T15:58:53.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.841+0000 7f46537fe700 1 -- 172.21.15.37:0/944010883 <== mgr.4100 v2:172.21.15.98:6832/3163748069 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72797 (secure 0 0 0) 0x7f4644001560 con 0x7f463c06ae00 2023-07-14T15:58:53.825 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:58:53.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.843+0000 7f46611ff700 1 -- 172.21.15.37:0/944010883 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f463c06ae00 msgr2=0x7f463c06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:53.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.843+0000 7f46611ff700 1 --2- 172.21.15.37:0/944010883 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f463c06ae00 0x7f463c06d2b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f465c1564f0 tx=0x7f4644009040 comp rx=0 tx=0).stop 2023-07-14T15:58:53.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.843+0000 7f46611ff700 1 -- 172.21.15.37:0/944010883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f465c0c9b30 msgr2=0x7f465c1568f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:53.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.843+0000 7f46611ff700 1 --2- 172.21.15.37:0/944010883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f465c0c9b30 0x7f465c1568f0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f464c000c00 tx=0x7f464c004750 comp rx=0 tx=0).stop 2023-07-14T15:58:53.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.843+0000 7f46611ff700 1 -- 172.21.15.37:0/944010883 shutdown_connections 2023-07-14T15:58:53.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.843+0000 7f46611ff700 1 --2- 172.21.15.37:0/944010883 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f465c159790 0x7f465c149b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:53.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.843+0000 7f46611ff700 1 --2- 172.21.15.37:0/944010883 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f463c06ae00 0x7f463c06d2b0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:53.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.843+0000 7f46611ff700 1 --2- 172.21.15.37:0/944010883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f465c0c9b30 0x7f465c1568f0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:53.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.843+0000 7f46611ff700 1 --2- 172.21.15.37:0/944010883 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f465c1593c0 0x7f465c156e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:53.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.843+0000 7f46611ff700 1 -- 172.21.15.37:0/944010883 >> 172.21.15.37:0/944010883 conn(0x7f465c0b08c0 msgr2=0x7f465c0ae790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:53.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.843+0000 7f46611ff700 1 -- 172.21.15.37:0/944010883 shutdown_connections 2023-07-14T15:58:53.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:53.843+0000 7f46611ff700 1 -- 172.21.15.37:0/944010883 wait complete. 2023-07-14T15:58:53.830 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-14T15:58:53.845 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2023-07-14T15:58:52.895200+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":176,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230032,"kb_used_data":6224,"kb_used_omap":0,"kb_used_meta":223744,"kb_avail":754744688,"statfs":{"total":773094113280,"available":772858560512,"internally_reserved":0,"allocated":6373376,"data_stored":3566128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":229113856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-155464,"num_objects":-26,"num_object_clones":0,"num_object_copies":-52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-26,"num_whiteouts":0,"num_read":-5,"num_read_kb":-3,"num_write":-118,"num_write_kb":-206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.992845"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":70,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-14T15:58:45.904960+0000","last_change":"2023-07-14T15:56:02.621850+0000","last_active":"2023-07-14T15:58:45.904960+0000","last_peered":"2023-07-14T15:58:45.904960+0000","last_clean":"2023-07-14T15:58:45.904960+0000","last_became_active":"2023-07-14T15:56:02.621471+0000","last_became_peered":"2023-07-14T15:56:02.621471+0000","last_unstale":"2023-07-14T15:58:45.904960+0000","last_undegraded":"2023-07-14T15:58:45.904960+0000","last_fullsized":"2023-07-14T15:58:45.904960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:39:41.710708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":74,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-14T15:58:48.013415+0000","last_change":"2023-07-14T15:56:02.621963+0000","last_active":"2023-07-14T15:58:48.013415+0000","last_peered":"2023-07-14T15:58:48.013415+0000","last_clean":"2023-07-14T15:58:48.013415+0000","last_became_active":"2023-07-14T15:56:02.621678+0000","last_became_peered":"2023-07-14T15:56:02.621678+0000","last_unstale":"2023-07-14T15:58:48.013415+0000","last_undegraded":"2023-07-14T15:58:48.013415+0000","last_fullsized":"2023-07-14T15:58:48.013415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:19:56.723709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":64,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-14T15:58:46.181131+0000","last_change":"2023-07-14T15:56:01.925110+0000","last_active":"2023-07-14T15:58:46.181131+0000","last_peered":"2023-07-14T15:58:46.181131+0000","last_clean":"2023-07-14T15:58:46.181131+0000","last_became_active":"2023-07-14T15:56:01.924723+0000","last_became_peered":"2023-07-14T15:56:01.924723+0000","last_unstale":"2023-07-14T15:58:46.181131+0000","last_undegraded":"2023-07-14T15:58:46.181131+0000","last_fullsized":"2023-07-14T15:58:46.181131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:37:09.789115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":74,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-14T15:58:48.012933+0000","last_change":"2023-07-14T15:56:01.923465+0000","last_active":"2023-07-14T15:58:48.012933+0000","last_peered":"2023-07-14T15:58:48.012933+0000","last_clean":"2023-07-14T15:58:48.012933+0000","last_became_active":"2023-07-14T15:56:01.923160+0000","last_became_peered":"2023-07-14T15:56:01.923160+0000","last_unstale":"2023-07-14T15:58:48.012933+0000","last_undegraded":"2023-07-14T15:58:48.012933+0000","last_fullsized":"2023-07-14T15:58:48.012933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:56:15.913004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":218,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-07-14T15:58:49.637926+0000","last_change":"2023-07-14T15:55:54.040065+0000","last_active":"2023-07-14T15:58:49.637926+0000","last_peered":"2023-07-14T15:58:49.637926+0000","last_clean":"2023-07-14T15:58:49.637926+0000","last_became_active":"2023-07-14T15:55:54.038885+0000","last_became_peered":"2023-07-14T15:55:54.038885+0000","last_unstale":"2023-07-14T15:58:49.637926+0000","last_undegraded":"2023-07-14T15:58:49.637926+0000","last_fullsized":"2023-07-14T15:58:49.637926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:55:53.025696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:55:53.025696+0000","last_clean_scrub_stamp":"2023-07-14T15:55:53.025696+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:18:19.914041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":74,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-14T15:58:48.013868+0000","last_change":"2023-07-14T15:56:01.920714+0000","last_active":"2023-07-14T15:58:48.013868+0000","last_peered":"2023-07-14T15:58:48.013868+0000","last_clean":"2023-07-14T15:58:48.013868+0000","last_became_active":"2023-07-14T15:56:01.920325+0000","last_became_peered":"2023-07-14T15:56:01.920325+0000","last_unstale":"2023-07-14T15:58:48.013868+0000","last_undegraded":"2023-07-14T15:58:48.013868+0000","last_fullsized":"2023-07-14T15:58:48.013868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:50:13.507177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":74,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-14T15:58:48.015424+0000","last_change":"2023-07-14T15:56:01.923631+0000","last_active":"2023-07-14T15:58:48.015424+0000","last_peered":"2023-07-14T15:58:48.015424+0000","last_clean":"2023-07-14T15:58:48.015424+0000","last_became_active":"2023-07-14T15:56:01.922783+0000","last_became_peered":"2023-07-14T15:56:01.922783+0000","last_unstale":"2023-07-14T15:58:48.015424+0000","last_undegraded":"2023-07-14T15:58:48.015424+0000","last_fullsized":"2023-07-14T15:58:48.015424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:56:48.333005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":64,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-07-14T15:58:46.182276+0000","last_change":"2023-07-14T15:56:01.965649+0000","last_active":"2023-07-14T15:58:46.182276+0000","last_peered":"2023-07-14T15:58:46.182276+0000","last_clean":"2023-07-14T15:58:46.182276+0000","last_became_active":"2023-07-14T15:56:01.965344+0000","last_became_peered":"2023-07-14T15:56:01.965344+0000","last_unstale":"2023-07-14T15:58:46.182276+0000","last_undegraded":"2023-07-14T15:58:46.182276+0000","last_fullsized":"2023-07-14T15:58:46.182276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:10:05.443365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":74,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-07-14T15:58:48.013924+0000","last_change":"2023-07-14T15:56:01.966578+0000","last_active":"2023-07-14T15:58:48.013924+0000","last_peered":"2023-07-14T15:58:48.013924+0000","last_clean":"2023-07-14T15:58:48.013924+0000","last_became_active":"2023-07-14T15:56:01.966216+0000","last_became_peered":"2023-07-14T15:56:01.966216+0000","last_unstale":"2023-07-14T15:58:48.013924+0000","last_undegraded":"2023-07-14T15:58:48.013924+0000","last_fullsized":"2023-07-14T15:58:48.013924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:58:38.326767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476775,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31636,"kb_used_data":588,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340204,"statfs":{"total":96636764160,"available":96604368896,"internally_reserved":0,"allocated":602112,"data_stored":256006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.44800000000000001,"15min":0.45000000000000001},"min":{"1min":0.29799999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.58999999999999997,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.46300000000000002,"15min":0.47299999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.57599999999999996,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.42599999999999999}]},{"osd":1,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.57799999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.52100000000000002,"15min":0.52300000000000002},"min":{"1min":0.38600000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.67500000000000004,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.48999999999999999}]},{"osd":2,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.504,"15min":0.505},"min":{"1min":0.40300000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.66700000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.74199999999999999,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.55100000000000005}]},{"osd":4,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.755,"15min":0.76500000000000001},"min":{"1min":0.503,"5min":0.441,"15min":0.441},"max":{"1min":1.0189999999999999,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.76600000000000001,"15min":0.77400000000000002},"min":{"1min":0.53900000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.88400000000000001,"5min":1.542,"15min":1.542},"last":0.59399999999999997}]},{"osd":5,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.84199999999999997,"15min":0.85599999999999998},"min":{"1min":0.625,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.95299999999999996,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.84599999999999997,"15min":0.85699999999999998},"min":{"1min":0.60899999999999999,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.94599999999999995,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.77100000000000002}]},{"osd":6,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.80800000000000005,"15min":0.81899999999999995},"min":{"1min":0.55900000000000005,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.98799999999999999,"5min":1.52,"15min":1.52},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.79900000000000004,"15min":0.81200000000000006},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.86099999999999999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.747}]},{"osd":7,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.77400000000000002,"15min":0.77700000000000002},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.96499999999999997,"5min":1.232,"15min":1.232},"last":0.621},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.84299999999999997,"15min":0.85699999999999998},"min":{"1min":0.55500000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.94899999999999995,"5min":1.478,"15min":1.478},"last":0.79000000000000004}]}]},{"osd":0,"up_from":16,"seq":68719476776,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":596,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":610304,"data_stored":262144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42299999999999999,"15min":0.42399999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.67500000000000004,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.48499999999999999,"15min":0.48899999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.61599999999999999,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.46200000000000002}]},{"osd":2,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.499,"15min":0.5},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.50800000000000001,"15min":0.505},"min":{"1min":0.41499999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.36299999999999999}]},{"osd":3,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47899999999999998,"15min":0.48099999999999998},"min":{"1min":0.38100000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.60699999999999998,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.308},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.57299999999999995,"15min":0.57699999999999996},"min":{"1min":0.42399999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76500000000000001,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.443}]},{"osd":4,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.99399999999999999,"5min":1.04,"15min":1.04},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.78000000000000003,"15min":0.78900000000000003},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.91000000000000003,"5min":1.331,"15min":1.331},"last":0.73599999999999999}]},{"osd":5,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.60999999999999999,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.119,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.56999999999999995,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0289999999999999,"5min":1.087,"15min":1.087},"last":0.77200000000000002}]},{"osd":6,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.77500000000000002,"15min":0.78100000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0029999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.80100000000000005,"15min":0.80500000000000005},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.056,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.70799999999999996}]},{"osd":7,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.80100000000000005,"15min":0.80800000000000005},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.99399999999999999,"5min":1.262,"15min":1.262},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.79700000000000004,"15min":0.80100000000000005},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.97799999999999998,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.72099999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542183,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":622592,"data_stored":267993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.621,"15min":0.61699999999999999},"min":{"1min":0.40999999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.82399999999999995,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64700000000000002,"15min":0.64600000000000002},"min":{"1min":0.496,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81599999999999995,"5min":1.266,"15min":1.266},"last":0.64400000000000002}]},{"osd":1,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.69799999999999995,"15min":0.70299999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88700000000000001,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.72199999999999998,"15min":0.71699999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.78400000000000003}]},{"osd":2,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.88500000000000001,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.68600000000000005,"15min":0.69099999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.72199999999999998}]},{"osd":3,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.78200000000000003,"15min":0.80400000000000005},"min":{"1min":0.48099999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.85999999999999999,"5min":3.141,"15min":3.141},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.752,"15min":0.753},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.94999999999999996,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.878}]},{"osd":4,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.63,"15min":0.63300000000000001},"min":{"1min":0.432,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.83499999999999996,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.70899999999999996,"15min":0.71199999999999997},"min":{"1min":0.47599999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.92300000000000004,"5min":1.024,"15min":1.024},"last":0.59899999999999998}]},{"osd":5,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.748,"15min":0.751},"min":{"1min":0.51700000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.96999999999999997,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73599999999999999,"15min":0.73999999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.012,"5min":1.091,"15min":1.091},"last":0.745}]},{"osd":7,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.72499999999999998,"15min":0.72899999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.92500000000000004,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.82399999999999995,"15min":0.82899999999999996},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":0.996,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.89600000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542182,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1216512,"data_stored":858361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.60699999999999998,"15min":0.64200000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.53100000000000003,"5min":4.5519999999999996,"15min":4.5519999999999996},"last":0.499},{"interface":"front","average":{"1min":0.46200000000000002,"5min":1.147,"15min":1.2609999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.70899999999999996,"5min":15.911,"15min":15.911},"last":0.314}]},{"osd":2,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.45700000000000002,"15min":0.46400000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.53300000000000003,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.624},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.67300000000000004,"15min":0.70599999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.57299999999999995,"5min":4.5140000000000002,"15min":4.5140000000000002},"last":0.65400000000000003}]},{"osd":3,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.70199999999999996,"15min":0.73599999999999999},"min":{"1min":0.378,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.65500000000000003,"5min":4.452,"15min":4.452},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.70299999999999996,"15min":0.73899999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.57999999999999996,"5min":4.2279999999999998,"15min":4.2279999999999998},"last":0.72799999999999998}]},{"osd":4,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.88400000000000001,"15min":0.92000000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.81899999999999995,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":0.75},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.92200000000000004,"15min":0.95999999999999996},"min":{"1min":0.52400000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.95699999999999996,"5min":4.9109999999999996,"15min":4.9109999999999996},"last":0.76500000000000001}]},{"osd":5,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.90000000000000002,"15min":0.93300000000000005},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.98999999999999999,"5min":4.1269999999999998,"15min":4.1269999999999998},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.93799999999999994,"15min":0.97399999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.93700000000000006,"5min":4.585,"15min":4.585},"last":0.70999999999999996}]},{"osd":6,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.93300000000000005,"15min":0.97099999999999997},"min":{"1min":0.56899999999999995,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0369999999999999,"5min":4.9880000000000004,"15min":4.9880000000000004},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.92900000000000005,"15min":0.96299999999999997},"min":{"1min":0.58499999999999996,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94599999999999995,"5min":4.1660000000000004,"15min":4.1660000000000004},"last":0.85599999999999998}]},{"osd":7,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.98199999999999998,"15min":1.0249999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.0429999999999999,"5min":4.9530000000000003,"15min":4.9530000000000003},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.94599999999999995,"15min":0.98099999999999998},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.048,"5min":4.1959999999999997,"15min":4.1959999999999997},"last":0.82199999999999995}]}]},{"osd":2,"up_from":15,"seq":64424509479,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":588,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":602112,"data_stored":256038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.42699999999999999,"15min":0.433},"min":{"1min":0.32200000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.51900000000000002,"5min":0.62,"15min":0.62},"last":0.498},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.47299999999999998,"15min":0.48299999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.57999999999999996,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.59399999999999997}]},{"osd":1,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.52400000000000002,"15min":0.53100000000000003},"min":{"1min":0.315,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76200000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.46899999999999997,"15min":0.47099999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.65100000000000002,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.55900000000000005}]},{"osd":3,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.58799999999999997,"15min":0.60199999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.63600000000000001,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.53200000000000003,"15min":0.53800000000000003},"min":{"1min":0.433,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.53700000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.61699999999999999}]},{"osd":4,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.72399999999999998,"15min":0.72799999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.169,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.74299999999999999,"15min":0.747},"min":{"1min":0.53300000000000003,"5min":0.437,"15min":0.437},"max":{"1min":0.90100000000000002,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.82099999999999995}]},{"osd":5,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.77300000000000002,"15min":0.78100000000000003},"min":{"1min":0.55700000000000005,"5min":0.505,"15min":0.505},"max":{"1min":1.002,"5min":1.391,"15min":1.391},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.75600000000000001,"15min":0.76200000000000001},"min":{"1min":0.50700000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.153,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.91300000000000003}]},{"osd":6,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.79000000000000004,"15min":0.80300000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0960000000000001,"5min":1.51,"15min":1.51},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.81599999999999995,"15min":0.82999999999999996},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1319999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.754}]},{"osd":7,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.78300000000000003,"15min":0.79400000000000004},"min":{"1min":0.54700000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.048,"5min":1.288,"15min":1.288},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.81799999999999995,"15min":0.82799999999999996},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.85999999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509478,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":765952,"data_stored":409792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.67700000000000005,"15min":0.68700000000000006},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.64700000000000002,"15min":0.65700000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88300000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.753}]},{"osd":1,"last update":"Fri Jul 14 15:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.67000000000000004,"15min":0.67600000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.81999999999999995,"5min":0.87,"15min":0.87},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.65100000000000002,"15min":0.66000000000000003},"min":{"1min":0.44400000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.82899999999999996,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.57499999999999996}]},{"osd":2,"last update":"Fri Jul 14 15:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64400000000000002,"15min":0.65000000000000002},"min":{"1min":0.441,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.71599999999999997,"15min":0.72899999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.80900000000000005,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.67800000000000005}]},{"osd":3,"last update":"Fri Jul 14 15:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.68400000000000005,"15min":0.68799999999999994},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.86699999999999999,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.72799999999999998,"15min":0.73499999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.94299999999999995,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.65800000000000003}]},{"osd":5,"last update":"Fri Jul 14 15:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65900000000000003,"15min":0.66400000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.83499999999999996,"5min":1.119,"15min":1.119},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.70699999999999996,"15min":0.71599999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.88200000000000001,"5min":1.157,"15min":1.157},"last":0.51200000000000001}]},{"osd":6,"last update":"Fri Jul 14 15:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.70199999999999996,"15min":0.71399999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.86199999999999999,"5min":1.04,"15min":1.04},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.89800000000000002,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.63900000000000001}]},{"osd":7,"last update":"Fri Jul 14 15:57:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.755,"15min":0.76700000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93799999999999994,"5min":1.202,"15min":1.202},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.77900000000000003,"15min":0.79100000000000004},"min":{"1min":0.53900000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.92100000000000004,"5min":1.137,"15min":1.137},"last":0.65000000000000002}]}]},{"osd":5,"up_from":15,"seq":64424509480,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28276,"kb_used_data":1324,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343564,"statfs":{"total":96636764160,"available":96607809536,"internally_reserved":0,"allocated":1355776,"data_stored":1000158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.66400000000000003,"15min":0.67200000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.86099999999999999,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.97799999999999998,"15min":1.038},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.80600000000000005,"5min":8.1500000000000004,"15min":8.1500000000000004},"last":0.57899999999999996}]},{"osd":1,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.67200000000000004,"15min":0.67600000000000005},"min":{"1min":0.51200000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.98799999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.66400000000000003,"15min":0.67000000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.76800000000000002,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.55700000000000005}]},{"osd":2,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.75800000000000001,"15min":0.77100000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.873,"5min":1.085,"15min":1.085},"last":0.626},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.72499999999999998,"15min":0.73699999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.86599999999999999,"5min":1.048,"15min":1.048},"last":0.77600000000000002}]},{"osd":3,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.69299999999999995,"15min":0.70099999999999996},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.82299999999999995,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.80000000000000004,"15min":0.81000000000000005},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":0.91700000000000004,"5min":1.083,"15min":1.083},"last":0.75900000000000001}]},{"osd":4,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68999999999999995,"15min":0.69199999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.65700000000000003,"15min":0.66300000000000003},"min":{"1min":0.441,"5min":0.438,"15min":0.438},"max":{"1min":0.82099999999999995,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.48699999999999999}]},{"osd":6,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.69899999999999995,"15min":0.71299999999999997},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.871,"5min":1.121,"15min":1.121},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.78700000000000003,"15min":0.80100000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.93799999999999994,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.81699999999999995}]},{"osd":7,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.74399999999999999,"15min":0.751},"min":{"1min":0.58199999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.875,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.81699999999999995,"15min":0.83099999999999996},"min":{"1min":0.53800000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.94699999999999995,"5min":1.605,"15min":1.605},"last":0.71299999999999997}]}]},{"osd":7,"up_from":15,"seq":64424509479,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":598016,"data_stored":255636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.61799999999999999,"15min":0.61499999999999999},"min":{"1min":0.39300000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0089999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.80400000000000005,"15min":0.82499999999999996},"min":{"1min":0.44400000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0820000000000001,"5min":4.5919999999999996,"15min":4.5919999999999996},"last":0.745}]},{"osd":1,"last update":"Fri Jul 14 15:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.66700000000000004,"15min":0.66900000000000004},"min":{"1min":0.442,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98299999999999998,"5min":1,"15min":1},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.86199999999999999,"15min":0.89600000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88100000000000001,"5min":4.665,"15min":4.665},"last":0.44500000000000001}]},{"osd":2,"last update":"Fri Jul 14 15:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.872,"15min":0.91200000000000003},"min":{"1min":0.50600000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.86699999999999999,"5min":5.4089999999999998,"15min":5.4089999999999998},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.76700000000000002,"15min":0.77500000000000002},"min":{"1min":0.497,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0389999999999999,"5min":2.165,"15min":2.165},"last":0.623}]},{"osd":3,"last update":"Fri Jul 14 15:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.753,"15min":0.76100000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.96199999999999997,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.80600000000000005,"15min":0.82399999999999995},"min":{"1min":0.49299999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.92500000000000004,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":0.65000000000000002}]},{"osd":4,"last update":"Fri Jul 14 15:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.63900000000000001,"15min":0.64100000000000001},"min":{"1min":0.41099999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89200000000000002,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.65400000000000003,"15min":0.65900000000000003},"min":{"1min":0.37,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.77800000000000002,"5min":1.111,"15min":1.111},"last":0.59999999999999998}]},{"osd":5,"last update":"Fri Jul 14 15:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.65100000000000002,"15min":0.65900000000000003},"min":{"1min":0.40400000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.80500000000000005,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.73799999999999999,"15min":0.747},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.89800000000000002,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.77400000000000002}]},{"osd":6,"last update":"Fri Jul 14 15:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69799999999999995,"15min":0.70499999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84799999999999998,"5min":1.042,"15min":1.042},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.76100000000000001,"15min":0.77700000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.83799999999999997,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.71499999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T15:58:53.848 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T15:58:54.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.066+0000 7f03d85ff700 1 Processor -- start 2023-07-14T15:58:54.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.066+0000 7f03d85ff700 1 -- start start 2023-07-14T15:58:54.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.067+0000 7f03d85ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f03d00b54b0 0x7f03d00cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:54.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.067+0000 7f03d85ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03d00cf6b0 con 0x7f03d00b4910 2023-07-14T15:58:54.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.067+0000 7f03d85ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03d00cdc40 con 0x7f03d00b85f0 2023-07-14T15:58:54.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.067+0000 7f03d85ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03d00cf0a0 con 0x7f03d00b54b0 2023-07-14T15:58:54.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.067+0000 7f03d5b9a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f03d00b54b0 0x7f03d00cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:54.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.067+0000 7f03d6b9c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f03d00b4910 0x7f03d00b4d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57346/0 (socket says 172.21.15.37:57346) 2023-07-14T15:58:54.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.067+0000 7f03d6b9c700 1 -- 172.21.15.37:0/939196479 learned_addr learned my addr 172.21.15.37:0/939196479 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:58:54.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.067+0000 7f03d5b9a700 1 --2- 172.21.15.37:0/939196479 >> v2:172.21.15.37:3300/0 conn(0x7f03d00b54b0 0x7f03d00cfb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36236/0 (socket says 172.21.15.37:36236) 2023-07-14T15:58:54.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.068+0000 7f03d5b9a700 1 -- 172.21.15.37:0/939196479 >> v1:172.21.15.98:6789/0 conn(0x7f03d00b85f0 legacy=0x7f03d015d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:54.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.068+0000 7f03d5b9a700 1 -- 172.21.15.37:0/939196479 >> v1:172.21.15.37:6789/0 conn(0x7f03d00b4910 legacy=0x7f03d00b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:54.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.068+0000 7f03d5b9a700 1 -- 172.21.15.37:0/939196479 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d00b89c0 con 0x7f03d00b54b0 2023-07-14T15:58:54.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.068+0000 7f03d5399700 1 -- 172.21.15.37:0/939196479 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3351574526 0 0) 0x7f03d00cf6b0 con 0x7f03d00b4910 2023-07-14T15:58:54.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.068+0000 7f03d5b9a700 1 --2- 172.21.15.37:0/939196479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03d00b54b0 0x7f03d00cfb40 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f03c0009840 tx=0x7f03c0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d129842eb4cb907 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:54.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.068+0000 7f03d5399700 1 -- 172.21.15.37:0/939196479 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c0011830 con 0x7f03d00b54b0 2023-07-14T15:58:54.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.068+0000 7f03d5399700 1 -- 172.21.15.37:0/939196479 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c0011990 con 0x7f03d00b54b0 2023-07-14T15:58:54.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.068+0000 7f03d5399700 1 -- 172.21.15.37:0/939196479 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c0011d20 con 0x7f03d00b54b0 2023-07-14T15:58:54.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.069+0000 7f03d85ff700 1 -- 172.21.15.37:0/939196479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03d00b54b0 msgr2=0x7f03d00cfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:54.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.069+0000 7f03d85ff700 1 --2- 172.21.15.37:0/939196479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03d00b54b0 0x7f03d00cfb40 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f03c0009840 tx=0x7f03c0009b50 comp rx=0 tx=0).stop 2023-07-14T15:58:54.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.069+0000 7f03d85ff700 1 -- 172.21.15.37:0/939196479 shutdown_connections 2023-07-14T15:58:54.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.069+0000 7f03d85ff700 1 --2- 172.21.15.37:0/939196479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03d00b54b0 0x7f03d00cfb40 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:54.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.069+0000 7f03d85ff700 1 -- 172.21.15.37:0/939196479 >> 172.21.15.37:0/939196479 conn(0x7f03d006a580 msgr2=0x7f03d006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:54.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.069+0000 7f03d85ff700 1 -- 172.21.15.37:0/939196479 shutdown_connections 2023-07-14T15:58:54.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.069+0000 7f03d85ff700 1 -- 172.21.15.37:0/939196479 wait complete. 2023-07-14T15:58:54.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.071+0000 7f03d85ff700 1 Processor -- start 2023-07-14T15:58:54.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.071+0000 7f03d85ff700 1 -- start start 2023-07-14T15:58:54.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.072+0000 7f03d85ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f03d00b4910 0x7f03d0149660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:54.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.072+0000 7f03d85ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03d00b54b0 0x7f03d0148e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:54.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.072+0000 7f03d85ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03d00b85f0 0x7f03d01f56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:54.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.072+0000 7f03d85ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d014c670 con 0x7f03d00b54b0 2023-07-14T15:58:54.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.072+0000 7f03d85ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d0149380 con 0x7f03d00b85f0 2023-07-14T15:58:54.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.072+0000 7f03d85ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03d014c390 con 0x7f03d00b4910 2023-07-14T15:58:54.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.072+0000 7f03d5b9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03d00b54b0 0x7f03d0148e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:54.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.072+0000 7f03d5b9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03d00b54b0 0x7f03d0148e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36238/0 (socket says 172.21.15.37:36238) 2023-07-14T15:58:54.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.072+0000 7f03d5b9a700 1 -- 172.21.15.37:0/3308759587 learned_addr learned my addr 172.21.15.37:0/3308759587 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:54.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.072+0000 7f03d6b9c700 1 --2- 172.21.15.37:0/3308759587 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03d00b85f0 0x7f03d01f56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:54.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.072+0000 7f03d5b9a700 1 -- 172.21.15.37:0/3308759587 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f03d00b4910 msgr2=0x7f03d0149660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:54.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.072+0000 7f03d639b700 1 --2- 172.21.15.37:0/3308759587 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f03d00b4910 0x7f03d0149660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:54.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.072+0000 7f03d5b9a700 1 --2- 172.21.15.37:0/3308759587 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f03d00b4910 0x7f03d0149660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:54.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.072+0000 7f03d5b9a700 1 -- 172.21.15.37:0/3308759587 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03d00b85f0 msgr2=0x7f03d01f56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:54.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.072+0000 7f03d5b9a700 1 --2- 172.21.15.37:0/3308759587 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03d00b85f0 0x7f03d01f56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:54.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.072+0000 7f03d5b9a700 1 -- 172.21.15.37:0/3308759587 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c00094a0 con 0x7f03d00b54b0 2023-07-14T15:58:54.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.073+0000 7f03d6b9c700 1 --2- 172.21.15.37:0/3308759587 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03d00b85f0 0x7f03d01f56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:58:54.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.073+0000 7f03d639b700 1 --2- 172.21.15.37:0/3308759587 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f03d00b4910 0x7f03d0149660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:58:54.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.073+0000 7f03d5b9a700 1 --2- 172.21.15.37:0/3308759587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03d00b54b0 0x7f03d0148e40 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f03d00673c0 tx=0x7f03c0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:54.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.073+0000 7f03c6ffd700 1 -- 172.21.15.37:0/3308759587 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c00036a0 con 0x7f03d00b54b0 2023-07-14T15:58:54.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.073+0000 7f03c6ffd700 1 -- 172.21.15.37:0/3308759587 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c001f070 con 0x7f03d00b54b0 2023-07-14T15:58:54.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.073+0000 7f03d85ff700 1 -- 172.21.15.37:0/3308759587 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03d00ca090 con 0x7f03d00b54b0 2023-07-14T15:58:54.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.073+0000 7f03c6ffd700 1 -- 172.21.15.37:0/3308759587 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c0003a20 con 0x7f03d00b54b0 2023-07-14T15:58:54.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.073+0000 7f03d85ff700 1 -- 172.21.15.37:0/3308759587 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03d00ca650 con 0x7f03d00b54b0 2023-07-14T15:58:54.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.074+0000 7f03d85ff700 1 -- 172.21.15.37:0/3308759587 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03d00ca870 con 0x7f03d00b54b0 2023-07-14T15:58:54.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.075+0000 7f03c6ffd700 1 -- 172.21.15.37:0/3308759587 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f03c0003b80 con 0x7f03d00b54b0 2023-07-14T15:58:54.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.076+0000 7f03c6ffd700 1 --2- 172.21.15.37:0/3308759587 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f03b406ae00 0x7f03b406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:54.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.076+0000 7f03c6ffd700 1 -- 172.21.15.37:0/3308759587 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5324+0+0 (secure 0 0 0) 0x7f03c0021070 con 0x7f03d00b54b0 2023-07-14T15:58:54.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.077+0000 7f03d639b700 1 --2- 172.21.15.37:0/3308759587 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f03b406ae00 0x7f03b406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:54.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.077+0000 7f03d639b700 1 --2- 172.21.15.37:0/3308759587 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f03b406ae00 0x7f03b406d2b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f03cc000f60 tx=0x7f03cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:54.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.080+0000 7f03c6ffd700 1 -- 172.21.15.37:0/3308759587 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f03c00560b0 con 0x7f03d00b54b0 2023-07-14T15:58:54.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.291+0000 7f03d85ff700 1 -- 172.21.15.37:0/3308759587 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03d0067840 con 0x7f03d00b54b0 2023-07-14T15:58:54.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.292+0000 7f03c6ffd700 1 -- 172.21.15.37:0/3308759587 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+14801 (secure 0 0 0) 0x7f03c00596d0 con 0x7f03d00b54b0 2023-07-14T15:58:54.276 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:58:54.276 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":53,"fsid":"9da30401-a779-4e46-aba6-00c2494c6c67","created":"2023-07-14T15:55:39.898867+0000","modified":"2023-07-14T15:58:49.009605+0000","last_up_change":"2023-07-14T15:55:53.025696+0000","last_in_change":"2023-07-14T15:55:43.388192+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T15:55:52.907261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T15:55:59.992839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d049535-7b87-4276-8fe5-0f74ba422d5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6801","nonce":2783032392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6803","nonce":2783032392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6807","nonce":2783032392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2783032392},{"type":"v1","addr":"172.21.15.37:6805","nonce":2783032392}]},"public_addr":"172.21.15.37:6801/2783032392","cluster_addr":"172.21.15.37:6803/2783032392","heartbeat_back_addr":"172.21.15.37:6807/2783032392","heartbeat_front_addr":"172.21.15.37:6805/2783032392","state":["exists","up"]},{"osd":1,"uuid":"79ec948d-ead2-4c2d-923a-dd6eeaac9dbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6823","nonce":1190059746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6826","nonce":1190059746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6831","nonce":1190059746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6827","nonce":1190059746},{"type":"v1","addr":"172.21.15.37:6829","nonce":1190059746}]},"public_addr":"172.21.15.37:6823/1190059746","cluster_addr":"172.21.15.37:6826/1190059746","heartbeat_back_addr":"172.21.15.37:6831/1190059746","heartbeat_front_addr":"172.21.15.37:6829/1190059746","state":["exists","up"]},{"osd":2,"uuid":"a1db6690-c160-4366-9c82-2cca17e4bba9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6809","nonce":2266223499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6811","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6813","nonce":2266223499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6820","nonce":2266223499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":2266223499},{"type":"v1","addr":"172.21.15.37:6816","nonce":2266223499}]},"public_addr":"172.21.15.37:6809/2266223499","cluster_addr":"172.21.15.37:6813/2266223499","heartbeat_back_addr":"172.21.15.37:6820/2266223499","heartbeat_front_addr":"172.21.15.37:6816/2266223499","state":["exists","up"]},{"osd":3,"uuid":"767b8220-e79a-4a86-a162-6b3b73198379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6812","nonce":4166694594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6817","nonce":4166694594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6828","nonce":4166694594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":4166694594},{"type":"v1","addr":"172.21.15.37:6822","nonce":4166694594}]},"public_addr":"172.21.15.37:6812/4166694594","cluster_addr":"172.21.15.37:6817/4166694594","heartbeat_back_addr":"172.21.15.37:6828/4166694594","heartbeat_front_addr":"172.21.15.37:6822/4166694594","state":["exists","up"]},{"osd":4,"uuid":"717bd773-ae7e-4236-ac79-900cf99a37c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6801","nonce":3529020407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6803","nonce":3529020407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6807","nonce":3529020407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3529020407},{"type":"v1","addr":"172.21.15.98:6805","nonce":3529020407}]},"public_addr":"172.21.15.98:6801/3529020407","cluster_addr":"172.21.15.98:6803/3529020407","heartbeat_back_addr":"172.21.15.98:6807/3529020407","heartbeat_front_addr":"172.21.15.98:6805/3529020407","state":["exists","up"]},{"osd":5,"uuid":"a941d358-0f03-4136-a9b2-3a1c2e9358cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6817","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6819","nonce":2311501838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6821","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6823","nonce":2311501838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6829","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6831","nonce":2311501838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6825","nonce":2311501838},{"type":"v1","addr":"172.21.15.98:6827","nonce":2311501838}]},"public_addr":"172.21.15.98:6819/2311501838","cluster_addr":"172.21.15.98:6823/2311501838","heartbeat_back_addr":"172.21.15.98:6831/2311501838","heartbeat_front_addr":"172.21.15.98:6827/2311501838","state":["exists","up"]},{"osd":6,"uuid":"27153772-6d4b-479d-9953-0582e7b96743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6809","nonce":1144224691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6811","nonce":1144224691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6815","nonce":1144224691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":1144224691},{"type":"v1","addr":"172.21.15.98:6813","nonce":1144224691}]},"public_addr":"172.21.15.98:6809/1144224691","cluster_addr":"172.21.15.98:6811/1144224691","heartbeat_back_addr":"172.21.15.98:6815/1144224691","heartbeat_front_addr":"172.21.15.98:6813/1144224691","state":["exists","up"]},{"osd":7,"uuid":"d21ffc8e-40bb-47eb-af2c-e3e730d3fb76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6818","nonce":1144470927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6822","nonce":1144470927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6830","nonce":1144470927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1144470927},{"type":"v1","addr":"172.21.15.98:6826","nonce":1144470927}]},"public_addr":"172.21.15.98:6818/1144470927","cluster_addr":"172.21.15.98:6822/1144470927","heartbeat_back_addr":"172.21.15.98:6830/1144470927","heartbeat_front_addr":"172.21.15.98:6826/1144470927","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.921114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.739210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.024016+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:49.002527+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.698127+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.813416+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.709351+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T15:55:48.815457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6835/4236968434":"2023-07-15T15:58:45.897774+0000","172.21.15.37:6834/4236968434":"2023-07-15T15:58:45.897774+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T15:58:54.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.295+0000 7f03d85ff700 1 -- 172.21.15.37:0/3308759587 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f03b406ae00 msgr2=0x7f03b406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:54.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.295+0000 7f03d85ff700 1 --2- 172.21.15.37:0/3308759587 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f03b406ae00 0x7f03b406d2b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f03cc000f60 tx=0x7f03cc009040 comp rx=0 tx=0).stop 2023-07-14T15:58:54.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.295+0000 7f03d85ff700 1 -- 172.21.15.37:0/3308759587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03d00b54b0 msgr2=0x7f03d0148e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:54.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.295+0000 7f03d85ff700 1 --2- 172.21.15.37:0/3308759587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03d00b54b0 0x7f03d0148e40 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f03d00673c0 tx=0x7f03c0004750 comp rx=0 tx=0).stop 2023-07-14T15:58:54.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.295+0000 7f03d85ff700 1 -- 172.21.15.37:0/3308759587 shutdown_connections 2023-07-14T15:58:54.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.295+0000 7f03d85ff700 1 --2- 172.21.15.37:0/3308759587 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03d00b85f0 0x7f03d01f56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:54.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.295+0000 7f03d85ff700 1 --2- 172.21.15.37:0/3308759587 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f03b406ae00 0x7f03b406d2b0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:54.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.295+0000 7f03d85ff700 1 --2- 172.21.15.37:0/3308759587 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f03d00b4910 0x7f03d0149660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:54.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.295+0000 7f03d85ff700 1 --2- 172.21.15.37:0/3308759587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03d00b54b0 0x7f03d0148e40 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:54.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.295+0000 7f03d85ff700 1 -- 172.21.15.37:0/3308759587 >> 172.21.15.37:0/3308759587 conn(0x7f03d006a580 msgr2=0x7f03d00d23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:54.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.295+0000 7f03d85ff700 1 -- 172.21.15.37:0/3308759587 shutdown_connections 2023-07-14T15:58:54.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:54.295+0000 7f03d85ff700 1 -- 172.21.15.37:0/3308759587 wait complete. 2023-07-14T15:58:55.299 INFO:tasks.ceph:Scrubbing osd.0 2023-07-14T15:58:55.300 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-07-14T15:58:55.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.532+0000 7f6ae01ff700 1 Processor -- start 2023-07-14T15:58:55.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.532+0000 7f6ae01ff700 1 -- start start 2023-07-14T15:58:55.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.533+0000 7f6ae01ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f6ad815c8c0 0x7f6ad80cfc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:55.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.533+0000 7f6ae01ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6ad80d0180 0x7f6ad80d08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:55.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.533+0000 7f6ae01ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6ad80d0e20 0x7f6ad8160280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:55.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.533+0000 7f6ae01ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ad80d05f0 con 0x7f6ad80d0180 2023-07-14T15:58:55.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.533+0000 7f6ae01ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ad80ccb10 con 0x7f6ad815c8c0 2023-07-14T15:58:55.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.533+0000 7f6ae01ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad80d16e0 con 0x7f6ad80d0e20 2023-07-14T15:58:55.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.534+0000 7f6add79a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6ad80d0180 0x7f6ad80d08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:55.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.534+0000 7f6add79a700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6ad80d0180 0x7f6ad80d08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36242/0 (socket says 172.21.15.37:36242) 2023-07-14T15:58:55.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.534+0000 7f6add79a700 1 -- 172.21.15.37:0/923318682 learned_addr learned my addr 172.21.15.37:0/923318682 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:55.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.534+0000 7f6ade79c700 1 --2- 172.21.15.37:0/923318682 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6ad80d0e20 0x7f6ad8160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:55.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.534+0000 7f6addf9b700 1 --2- 172.21.15.37:0/923318682 >> v2:172.21.15.98:3300/0 conn(0x7f6ad815c8c0 0x7f6ad80cfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:55.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.534+0000 7f6add79a700 1 -- 172.21.15.37:0/923318682 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6ad80d0e20 msgr2=0x7f6ad8160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:55.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.534+0000 7f6add79a700 1 --2- 172.21.15.37:0/923318682 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6ad80d0e20 0x7f6ad8160280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:55.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.534+0000 7f6add79a700 1 -- 172.21.15.37:0/923318682 >> v2:172.21.15.98:3300/0 conn(0x7f6ad815c8c0 msgr2=0x7f6ad80cfc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:55.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.534+0000 7f6add79a700 1 --2- 172.21.15.37:0/923318682 >> v2:172.21.15.98:3300/0 conn(0x7f6ad815c8c0 0x7f6ad80cfc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:55.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.534+0000 7f6add79a700 1 -- 172.21.15.37:0/923318682 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad80cc4c0 con 0x7f6ad80d0180 2023-07-14T15:58:55.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.534+0000 7f6add79a700 1 --2- 172.21.15.37:0/923318682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ad80d0180 0x7f6ad80d08e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f6ad80c4700 tx=0x7f6ac8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae6f79177767596 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:55.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.535+0000 7f6adcf99700 1 -- 172.21.15.37:0/923318682 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac800b870 con 0x7f6ad80d0180 2023-07-14T15:58:55.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.535+0000 7f6adcf99700 1 -- 172.21.15.37:0/923318682 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ac800b9d0 con 0x7f6ad80d0180 2023-07-14T15:58:55.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.535+0000 7f6adcf99700 1 -- 172.21.15.37:0/923318682 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac800bd60 con 0x7f6ad80d0180 2023-07-14T15:58:55.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.535+0000 7f6ae01ff700 1 -- 172.21.15.37:0/923318682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ad80d0180 msgr2=0x7f6ad80d08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:55.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.535+0000 7f6ae01ff700 1 --2- 172.21.15.37:0/923318682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ad80d0180 0x7f6ad80d08e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f6ad80c4700 tx=0x7f6ac8009bd0 comp rx=0 tx=0).stop 2023-07-14T15:58:55.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.535+0000 7f6ae01ff700 1 -- 172.21.15.37:0/923318682 shutdown_connections 2023-07-14T15:58:55.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.535+0000 7f6ae01ff700 1 --2- 172.21.15.37:0/923318682 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6ad80d0e20 0x7f6ad8160280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:55.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.535+0000 7f6ae01ff700 1 --2- 172.21.15.37:0/923318682 >> v2:172.21.15.98:3300/0 conn(0x7f6ad815c8c0 0x7f6ad80cfc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:55.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.535+0000 7f6ae01ff700 1 --2- 172.21.15.37:0/923318682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ad80d0180 0x7f6ad80d08e0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:55.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.535+0000 7f6ae01ff700 1 -- 172.21.15.37:0/923318682 >> 172.21.15.37:0/923318682 conn(0x7f6ad8065bd0 msgr2=0x7f6ad8065fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:55.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.535+0000 7f6ae01ff700 1 -- 172.21.15.37:0/923318682 shutdown_connections 2023-07-14T15:58:55.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.535+0000 7f6ae01ff700 1 -- 172.21.15.37:0/923318682 wait complete. 2023-07-14T15:58:55.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.537+0000 7f6ae01ff700 1 Processor -- start 2023-07-14T15:58:55.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.537+0000 7f6ae01ff700 1 -- start start 2023-07-14T15:58:55.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.538+0000 7f6ae01ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6ad80d0180 0x7f6ad80b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:55.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.538+0000 7f6ae01ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ad80d0e20 0x7f6ad80b5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:55.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.538+0000 7f6ae01ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ad815c8c0 0x7f6ad8148b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:55.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.538+0000 7f6ae01ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad815fad0 con 0x7f6ad815c8c0 2023-07-14T15:58:55.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.538+0000 7f6ae01ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad80b5ff0 con 0x7f6ad80d0e20 2023-07-14T15:58:55.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.538+0000 7f6ae01ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad80b62d0 con 0x7f6ad80d0180 2023-07-14T15:58:55.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.538+0000 7f6ade79c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ad815c8c0 0x7f6ad8148b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:55.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.538+0000 7f6ade79c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ad815c8c0 0x7f6ad8148b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36250/0 (socket says 172.21.15.37:36250) 2023-07-14T15:58:55.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.538+0000 7f6ade79c700 1 -- 172.21.15.37:0/1433813628 learned_addr learned my addr 172.21.15.37:0/1433813628 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:55.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.539+0000 7f6add79a700 1 --2- 172.21.15.37:0/1433813628 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ad80d0e20 0x7f6ad80b5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:55.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.539+0000 7f6addf9b700 1 --2- 172.21.15.37:0/1433813628 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6ad80d0180 0x7f6ad80b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:55.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.539+0000 7f6ade79c700 1 -- 172.21.15.37:0/1433813628 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6ad80d0180 msgr2=0x7f6ad80b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:55.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.539+0000 7f6ade79c700 1 --2- 172.21.15.37:0/1433813628 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6ad80d0180 0x7f6ad80b3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:55.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.539+0000 7f6ade79c700 1 -- 172.21.15.37:0/1433813628 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ad80d0e20 msgr2=0x7f6ad80b5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:55.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.539+0000 7f6ade79c700 1 --2- 172.21.15.37:0/1433813628 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ad80d0e20 0x7f6ad80b5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:55.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.539+0000 7f6ade79c700 1 -- 172.21.15.37:0/1433813628 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac8009550 con 0x7f6ad815c8c0 2023-07-14T15:58:55.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.539+0000 7f6addf9b700 1 --2- 172.21.15.37:0/1433813628 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f6ad80d0180 0x7f6ad80b3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:58:55.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.539+0000 7f6ade79c700 1 --2- 172.21.15.37:0/1433813628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ad815c8c0 0x7f6ad8148b60 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0007d20 tx=0x7f6ad000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:55.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.539+0000 7f6ace7fc700 1 -- 172.21.15.37:0/1433813628 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad000ede0 con 0x7f6ad815c8c0 2023-07-14T15:58:55.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.539+0000 7f6ace7fc700 1 -- 172.21.15.37:0/1433813628 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad0007e70 con 0x7f6ad815c8c0 2023-07-14T15:58:55.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.539+0000 7f6ae01ff700 1 -- 172.21.15.37:0/1433813628 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ad80b65b0 con 0x7f6ad815c8c0 2023-07-14T15:58:55.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.539+0000 7f6ace7fc700 1 -- 172.21.15.37:0/1433813628 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad0014640 con 0x7f6ad815c8c0 2023-07-14T15:58:55.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.540+0000 7f6ae01ff700 1 -- 172.21.15.37:0/1433813628 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ad8159c30 con 0x7f6ad815c8c0 2023-07-14T15:58:55.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.540+0000 7f6ae01ff700 1 -- 172.21.15.37:0/1433813628 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6ad80d19c0 con 0x7f6ad815c8c0 2023-07-14T15:58:55.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.541+0000 7f6ace7fc700 1 -- 172.21.15.37:0/1433813628 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f6ad00147a0 con 0x7f6ad815c8c0 2023-07-14T15:58:55.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.542+0000 7f6ace7fc700 1 --2- 172.21.15.37:0/1433813628 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f6abc06ae00 0x7f6abc06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:55.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.542+0000 7f6ace7fc700 1 -- 172.21.15.37:0/1433813628 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5324+0+0 (secure 0 0 0) 0x7f6ad00899d0 con 0x7f6ad815c8c0 2023-07-14T15:58:55.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.543+0000 7f6ace7fc700 1 --2- 172.21.15.37:0/1433813628 >> [v2:172.21.15.37:6800/2783032392,v1:172.21.15.37:6801/2783032392] conn(0x7f6abc071270 0x7f6abc0736a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:55.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.543+0000 7f6ace7fc700 1 -- 172.21.15.37:0/1433813628 --> [v2:172.21.15.37:6800/2783032392,v1:172.21.15.37:6801/2783032392] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6abc073d70 con 0x7f6abc071270 2023-07-14T15:58:55.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.543+0000 7f6ace7fc700 1 -- 172.21.15.37:0/1433813628 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ad008e2a0 con 0x7f6ad815c8c0 2023-07-14T15:58:55.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.543+0000 7f6addf9b700 1 --2- 172.21.15.37:0/1433813628 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f6abc06ae00 0x7f6abc06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:55.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.543+0000 7f6add79a700 1 --2- 172.21.15.37:0/1433813628 >> [v2:172.21.15.37:6800/2783032392,v1:172.21.15.37:6801/2783032392] conn(0x7f6abc071270 0x7f6abc0736a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:55.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.543+0000 7f6add79a700 1 --2- 172.21.15.37:0/1433813628 >> [v2:172.21.15.37:6800/2783032392,v1:172.21.15.37:6801/2783032392] conn(0x7f6abc071270 0x7f6abc0736a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:55.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.544+0000 7f6addf9b700 1 --2- 172.21.15.37:0/1433813628 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f6abc06ae00 0x7f6abc06d2b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6ad40099f0 tx=0x7f6ad4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:55.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.544+0000 7f6ace7fc700 1 -- 172.21.15.37:0/1433813628 <== osd.0 v2:172.21.15.37:6800/2783032392 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f6abc073d70 con 0x7f6abc071270 2023-07-14T15:58:55.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.559+0000 7f6ae01ff700 1 -- 172.21.15.37:0/1433813628 --> [v2:172.21.15.37:6800/2783032392,v1:172.21.15.37:6801/2783032392] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6ad80cc7a0 con 0x7f6abc071270 2023-07-14T15:58:55.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.560+0000 7f6ace7fc700 1 -- 172.21.15.37:0/1433813628 <== osd.0 v2:172.21.15.37:6800/2783032392 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f6ac8021040 con 0x7f6abc071270 2023-07-14T15:58:55.544 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-14T15:58:55.545 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-14T15:58:55.545 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-14T15:58:55.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.560+0000 7f6ae01ff700 1 -- 172.21.15.37:0/1433813628 >> [v2:172.21.15.37:6800/2783032392,v1:172.21.15.37:6801/2783032392] conn(0x7f6abc071270 msgr2=0x7f6abc0736a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:55.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.560+0000 7f6ae01ff700 1 --2- 172.21.15.37:0/1433813628 >> [v2:172.21.15.37:6800/2783032392,v1:172.21.15.37:6801/2783032392] conn(0x7f6abc071270 0x7f6abc0736a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:55.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.560+0000 7f6ae01ff700 1 -- 172.21.15.37:0/1433813628 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f6abc06ae00 msgr2=0x7f6abc06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:55.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.560+0000 7f6ae01ff700 1 --2- 172.21.15.37:0/1433813628 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f6abc06ae00 0x7f6abc06d2b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6ad40099f0 tx=0x7f6ad4008040 comp rx=0 tx=0).stop 2023-07-14T15:58:55.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.560+0000 7f6ae01ff700 1 -- 172.21.15.37:0/1433813628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ad815c8c0 msgr2=0x7f6ad8148b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:55.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.560+0000 7f6ae01ff700 1 --2- 172.21.15.37:0/1433813628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ad815c8c0 0x7f6ad8148b60 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0007d20 tx=0x7f6ad000e3c0 comp rx=0 tx=0).stop 2023-07-14T15:58:55.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.560+0000 7f6ade79c700 1 -- 172.21.15.37:0/1433813628 reap_dead start 2023-07-14T15:58:55.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.560+0000 7f6ae01ff700 1 -- 172.21.15.37:0/1433813628 shutdown_connections 2023-07-14T15:58:55.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.560+0000 7f6ae01ff700 1 -- 172.21.15.37:0/1433813628 >> 172.21.15.37:0/1433813628 conn(0x7f6ad8065bd0 msgr2=0x7f6ad80c9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:55.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.560+0000 7f6ae01ff700 1 -- 172.21.15.37:0/1433813628 shutdown_connections 2023-07-14T15:58:55.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.560+0000 7f6ae01ff700 1 -- 172.21.15.37:0/1433813628 wait complete. 2023-07-14T15:58:55.561 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-07-14T15:58:55.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.779+0000 7fd464dff700 1 Processor -- start 2023-07-14T15:58:55.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.779+0000 7fd464dff700 1 -- start start 2023-07-14T15:58:55.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.780+0000 7fd464dff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fd4600b8900 0x7fd4600cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:55.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.780+0000 7fd464dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd4600b5e00 0x7fd4600d0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:55.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.780+0000 7fd464dff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd4600d13f0 0x7fd4600cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:55.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.780+0000 7fd464dff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4600d1870 con 0x7fd4600d13f0 2023-07-14T15:58:55.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.780+0000 7fd464dff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd46015d030 con 0x7fd4600b8900 2023-07-14T15:58:55.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.780+0000 7fd464dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4600b6270 con 0x7fd4600b5e00 2023-07-14T15:58:55.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.781+0000 7fd45ed9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd4600d13f0 0x7fd4600cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:55.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.781+0000 7fd45ed9d700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd4600d13f0 0x7fd4600cebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36254/0 (socket says 172.21.15.37:36254) 2023-07-14T15:58:55.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.781+0000 7fd45ed9d700 1 -- 172.21.15.37:0/2966090072 learned_addr learned my addr 172.21.15.37:0/2966090072 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:55.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.781+0000 7fd45e59c700 1 --2- 172.21.15.37:0/2966090072 >> v2:172.21.15.98:3300/0 conn(0x7fd4600b8900 0x7fd4600cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:55.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.781+0000 7fd457fff700 1 --2- 172.21.15.37:0/2966090072 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd4600b5e00 0x7fd4600d0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:55.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.781+0000 7fd45ed9d700 1 -- 172.21.15.37:0/2966090072 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd4600b5e00 msgr2=0x7fd4600d0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:55.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.781+0000 7fd45ed9d700 1 --2- 172.21.15.37:0/2966090072 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd4600b5e00 0x7fd4600d0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:55.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.781+0000 7fd45ed9d700 1 -- 172.21.15.37:0/2966090072 >> v2:172.21.15.98:3300/0 conn(0x7fd4600b8900 msgr2=0x7fd4600cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:55.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.781+0000 7fd45ed9d700 1 --2- 172.21.15.37:0/2966090072 >> v2:172.21.15.98:3300/0 conn(0x7fd4600b8900 0x7fd4600cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:55.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.781+0000 7fd45ed9d700 1 -- 172.21.15.37:0/2966090072 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4600cdb50 con 0x7fd4600d13f0 2023-07-14T15:58:55.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.781+0000 7fd45ed9d700 1 --2- 172.21.15.37:0/2966090072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4600d13f0 0x7fd4600cebf0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fd46008c180 tx=0x7fd45800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be22b6d4399a6726 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:55.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.781+0000 7fd45dd9b700 1 -- 172.21.15.37:0/2966090072 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45800e070 con 0x7fd4600d13f0 2023-07-14T15:58:55.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.782+0000 7fd45dd9b700 1 -- 172.21.15.37:0/2966090072 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd45800b9c0 con 0x7fd4600d13f0 2023-07-14T15:58:55.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.782+0000 7fd45dd9b700 1 -- 172.21.15.37:0/2966090072 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45800bd70 con 0x7fd4600d13f0 2023-07-14T15:58:55.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.782+0000 7fd464dff700 1 -- 172.21.15.37:0/2966090072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4600d13f0 msgr2=0x7fd4600cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:55.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.782+0000 7fd464dff700 1 --2- 172.21.15.37:0/2966090072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4600d13f0 0x7fd4600cebf0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fd46008c180 tx=0x7fd45800b330 comp rx=0 tx=0).stop 2023-07-14T15:58:55.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.782+0000 7fd464dff700 1 -- 172.21.15.37:0/2966090072 shutdown_connections 2023-07-14T15:58:55.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.782+0000 7fd464dff700 1 --2- 172.21.15.37:0/2966090072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4600d13f0 0x7fd4600cebf0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:55.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.782+0000 7fd464dff700 1 --2- 172.21.15.37:0/2966090072 >> v2:172.21.15.98:3300/0 conn(0x7fd4600b8900 0x7fd4600cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:55.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.782+0000 7fd464dff700 1 --2- 172.21.15.37:0/2966090072 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd4600b5e00 0x7fd4600d0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:55.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.782+0000 7fd464dff700 1 -- 172.21.15.37:0/2966090072 >> 172.21.15.37:0/2966090072 conn(0x7fd46009c1e0 msgr2=0x7fd4600d2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:55.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.782+0000 7fd464dff700 1 -- 172.21.15.37:0/2966090072 shutdown_connections 2023-07-14T15:58:55.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.782+0000 7fd464dff700 1 -- 172.21.15.37:0/2966090072 wait complete. 2023-07-14T15:58:55.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.784+0000 7fd464dff700 1 Processor -- start 2023-07-14T15:58:55.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.784+0000 7fd464dff700 1 -- start start 2023-07-14T15:58:55.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.785+0000 7fd464dff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4600b5e00 0x7fd46006b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:55.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.785+0000 7fd464dff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4600b8900 0x7fd4600cbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:55.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.785+0000 7fd464dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd4600d13f0 0x7fd4600cc510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:55.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.785+0000 7fd464dff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4600cd0e0 con 0x7fd4600b5e00 2023-07-14T15:58:55.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.785+0000 7fd464dff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46015ffc0 con 0x7fd4600b8900 2023-07-14T15:58:55.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.785+0000 7fd464dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4600ccb20 con 0x7fd4600d13f0 2023-07-14T15:58:55.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.785+0000 7fd45e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4600b5e00 0x7fd46006b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:55.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.785+0000 7fd45e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4600b5e00 0x7fd46006b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36262/0 (socket says 172.21.15.37:36262) 2023-07-14T15:58:55.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.785+0000 7fd45e59c700 1 -- 172.21.15.37:0/2579967015 learned_addr learned my addr 172.21.15.37:0/2579967015 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:55.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.786+0000 7fd457fff700 1 --2- 172.21.15.37:0/2579967015 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4600b8900 0x7fd4600cbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:55.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.786+0000 7fd45e59c700 1 -- 172.21.15.37:0/2579967015 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd4600d13f0 msgr2=0x7fd4600cc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:55.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.786+0000 7fd45e59c700 1 --2- 172.21.15.37:0/2579967015 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd4600d13f0 0x7fd4600cc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:55.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.786+0000 7fd45e59c700 1 -- 172.21.15.37:0/2579967015 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4600b8900 msgr2=0x7fd4600cbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:55.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.786+0000 7fd45e59c700 1 --2- 172.21.15.37:0/2579967015 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4600b8900 0x7fd4600cbfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:55.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.786+0000 7fd45e59c700 1 -- 172.21.15.37:0/2579967015 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd458009b30 con 0x7fd4600b5e00 2023-07-14T15:58:55.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.786+0000 7fd457fff700 1 --2- 172.21.15.37:0/2579967015 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4600b8900 0x7fd4600cbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:58:55.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.786+0000 7fd45e59c700 1 --2- 172.21.15.37:0/2579967015 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4600b5e00 0x7fd46006b2d0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fd45000e730 tx=0x7fd45000eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:55.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.786+0000 7fd456ffd700 1 -- 172.21.15.37:0/2579967015 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd450013610 con 0x7fd4600b5e00 2023-07-14T15:58:55.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.786+0000 7fd456ffd700 1 -- 172.21.15.37:0/2579967015 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd450013770 con 0x7fd4600b5e00 2023-07-14T15:58:55.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.786+0000 7fd456ffd700 1 -- 172.21.15.37:0/2579967015 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd450013b20 con 0x7fd4600b5e00 2023-07-14T15:58:55.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.786+0000 7fd464dff700 1 -- 172.21.15.37:0/2579967015 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4600cce00 con 0x7fd4600b5e00 2023-07-14T15:58:55.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.786+0000 7fd464dff700 1 -- 172.21.15.37:0/2579967015 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd46014d570 con 0x7fd4600b5e00 2023-07-14T15:58:55.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.787+0000 7fd464dff700 1 -- 172.21.15.37:0/2579967015 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd46004e210 con 0x7fd4600b5e00 2023-07-14T15:58:55.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.788+0000 7fd456ffd700 1 -- 172.21.15.37:0/2579967015 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fd450013c80 con 0x7fd4600b5e00 2023-07-14T15:58:55.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.789+0000 7fd456ffd700 1 --2- 172.21.15.37:0/2579967015 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd44006ae00 0x7fd44006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:55.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.789+0000 7fd456ffd700 1 -- 172.21.15.37:0/2579967015 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5324+0+0 (secure 0 0 0) 0x7fd450088e60 con 0x7fd4600b5e00 2023-07-14T15:58:55.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.790+0000 7fd457fff700 1 --2- 172.21.15.37:0/2579967015 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd44006ae00 0x7fd44006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:55.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.790+0000 7fd457fff700 1 --2- 172.21.15.37:0/2579967015 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd44006ae00 0x7fd44006d2b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd46015fc10 tx=0x7fd448008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:55.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.794+0000 7fd456ffd700 1 -- 172.21.15.37:0/2579967015 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd4500579c0 con 0x7fd4600b5e00 2023-07-14T15:58:55.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:55.999+0000 7fd464dff700 1 -- 172.21.15.37:0/2579967015 --> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fd4600ce110 con 0x7fd44006ae00 2023-07-14T15:58:55.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.000+0000 7fd456ffd700 1 -- 172.21.15.37:0/2579967015 <== mgr.4100 v2:172.21.15.98:6832/3163748069 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd448009e20 con 0x7fd44006ae00 2023-07-14T15:58:55.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.002+0000 7fd464dff700 1 -- 172.21.15.37:0/2579967015 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd44006ae00 msgr2=0x7fd44006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:55.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.002+0000 7fd464dff700 1 --2- 172.21.15.37:0/2579967015 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd44006ae00 0x7fd44006d2b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd46015fc10 tx=0x7fd448008040 comp rx=0 tx=0).stop 2023-07-14T15:58:55.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.002+0000 7fd464dff700 1 -- 172.21.15.37:0/2579967015 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4600b5e00 msgr2=0x7fd46006b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:55.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.002+0000 7fd464dff700 1 --2- 172.21.15.37:0/2579967015 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4600b5e00 0x7fd46006b2d0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fd45000e730 tx=0x7fd45000eaf0 comp rx=0 tx=0).stop 2023-07-14T15:58:55.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.002+0000 7fd464dff700 1 -- 172.21.15.37:0/2579967015 shutdown_connections 2023-07-14T15:58:55.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.002+0000 7fd464dff700 1 --2- 172.21.15.37:0/2579967015 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fd44006ae00 0x7fd44006d2b0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:55.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.002+0000 7fd464dff700 1 --2- 172.21.15.37:0/2579967015 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fd4600d13f0 0x7fd4600cc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:55.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.002+0000 7fd464dff700 1 --2- 172.21.15.37:0/2579967015 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4600b5e00 0x7fd46006b2d0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:55.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.002+0000 7fd464dff700 1 --2- 172.21.15.37:0/2579967015 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4600b8900 0x7fd4600cbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:55.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.002+0000 7fd464dff700 1 -- 172.21.15.37:0/2579967015 >> 172.21.15.37:0/2579967015 conn(0x7fd46009c1e0 msgr2=0x7fd4600b6440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:55.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.002+0000 7fd464dff700 1 -- 172.21.15.37:0/2579967015 shutdown_connections 2023-07-14T15:58:55.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.003+0000 7fd464dff700 1 -- 172.21.15.37:0/2579967015 wait complete. 2023-07-14T15:58:55.990 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 0 to deep-scrub 2023-07-14T15:58:56.005 INFO:tasks.ceph:Scrubbing osd.1 2023-07-14T15:58:56.005 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-07-14T15:58:56.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.226+0000 7fb5235ff700 1 Processor -- start 2023-07-14T15:58:56.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.227+0000 7fb5235ff700 1 -- start start 2023-07-14T15:58:56.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.228+0000 7fb5235ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fb51c1462d0 0x7fb51c0cd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:56.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.228+0000 7fb5235ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb51c0cf780 0x7fb51c0cfba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:56.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.228+0000 7fb5235ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb51c0d1270 con 0x7fb51c0d2310 2023-07-14T15:58:56.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.228+0000 7fb5235ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb51c0d1550 con 0x7fb51c0cf780 2023-07-14T15:58:56.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.228+0000 7fb5235ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb51c0d1830 con 0x7fb51c1462d0 2023-07-14T15:58:56.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.228+0000 7fb521b9c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb51c0cf780 0x7fb51c0cfba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:56.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.228+0000 7fb521b9c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb51c0cf780 0x7fb51c0cfba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36264/0 (socket says 172.21.15.37:36264) 2023-07-14T15:58:56.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.228+0000 7fb521b9c700 1 -- 172.21.15.37:0/2402765750 learned_addr learned my addr 172.21.15.37:0/2402765750 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:56.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.228+0000 7fb52139b700 1 --2- 172.21.15.37:0/2402765750 >> v2:172.21.15.98:3300/0 conn(0x7fb51c1462d0 0x7fb51c0cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:56.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.228+0000 7fb521b9c700 1 -- 172.21.15.37:0/2402765750 >> v2:172.21.15.98:3300/0 conn(0x7fb51c1462d0 msgr2=0x7fb51c0cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:56.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.228+0000 7fb521b9c700 1 --2- 172.21.15.37:0/2402765750 >> v2:172.21.15.98:3300/0 conn(0x7fb51c1462d0 0x7fb51c0cd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:56.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.228+0000 7fb521b9c700 1 -- 172.21.15.37:0/2402765750 >> v1:172.21.15.98:6789/0 conn(0x7fb51c0d2310 legacy=0x7fb51c0d09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:56.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.228+0000 7fb521b9c700 1 -- 172.21.15.37:0/2402765750 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb51c0d1b10 con 0x7fb51c0cf780 2023-07-14T15:58:56.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.229+0000 7fb521b9c700 1 --2- 172.21.15.37:0/2402765750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb51c0cf780 0x7fb51c0cfba0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fb51c0b5960 tx=0x7fb51400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fedc6a32f612a34d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:56.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.229+0000 7fb513fff700 1 -- 172.21.15.37:0/2402765750 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51400e070 con 0x7fb51c0cf780 2023-07-14T15:58:56.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.229+0000 7fb513fff700 1 -- 172.21.15.37:0/2402765750 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb51400b9c0 con 0x7fb51c0cf780 2023-07-14T15:58:56.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.229+0000 7fb513fff700 1 -- 172.21.15.37:0/2402765750 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51400bd70 con 0x7fb51c0cf780 2023-07-14T15:58:56.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.229+0000 7fb5235ff700 1 -- 172.21.15.37:0/2402765750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb51c0cf780 msgr2=0x7fb51c0cfba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:56.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.229+0000 7fb5235ff700 1 --2- 172.21.15.37:0/2402765750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb51c0cf780 0x7fb51c0cfba0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fb51c0b5960 tx=0x7fb51400b330 comp rx=0 tx=0).stop 2023-07-14T15:58:56.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.230+0000 7fb5235ff700 1 -- 172.21.15.37:0/2402765750 shutdown_connections 2023-07-14T15:58:56.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.230+0000 7fb5235ff700 1 --2- 172.21.15.37:0/2402765750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb51c0cf780 0x7fb51c0cfba0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:56.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.230+0000 7fb5235ff700 1 --2- 172.21.15.37:0/2402765750 >> v2:172.21.15.98:3300/0 conn(0x7fb51c1462d0 0x7fb51c0cd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:56.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.230+0000 7fb5235ff700 1 -- 172.21.15.37:0/2402765750 >> 172.21.15.37:0/2402765750 conn(0x7fb51c06a4d0 msgr2=0x7fb51c06a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:56.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.230+0000 7fb5235ff700 1 -- 172.21.15.37:0/2402765750 shutdown_connections 2023-07-14T15:58:56.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.230+0000 7fb5235ff700 1 -- 172.21.15.37:0/2402765750 wait complete. 2023-07-14T15:58:56.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.231+0000 7fb5235ff700 1 Processor -- start 2023-07-14T15:58:56.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.232+0000 7fb5235ff700 1 -- start start 2023-07-14T15:58:56.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.232+0000 7fb5235ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb51c0cf780 0x7fb51c1f1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:56.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.232+0000 7fb5235ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb51c0d2310 0x7fb51c0b3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:56.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.233+0000 7fb5235ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb51c1462d0 0x7fb51c0b4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:56.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.233+0000 7fb5235ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb51c0c9c90 con 0x7fb51c1462d0 2023-07-14T15:58:56.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.233+0000 7fb5235ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb51c0b5080 con 0x7fb51c0cf780 2023-07-14T15:58:56.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.233+0000 7fb5235ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb51c14ccf0 con 0x7fb51c0d2310 2023-07-14T15:58:56.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.233+0000 7fb521b9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb51c1462d0 0x7fb51c0b4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:56.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.233+0000 7fb521b9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb51c1462d0 0x7fb51c0b4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36270/0 (socket says 172.21.15.37:36270) 2023-07-14T15:58:56.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.233+0000 7fb521b9c700 1 -- 172.21.15.37:0/1468275426 learned_addr learned my addr 172.21.15.37:0/1468275426 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:56.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.233+0000 7fb52139b700 1 --2- 172.21.15.37:0/1468275426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb51c0cf780 0x7fb51c1f1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:56.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.233+0000 7fb520b9a700 1 --2- 172.21.15.37:0/1468275426 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb51c0d2310 0x7fb51c0b3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:56.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.233+0000 7fb521b9c700 1 -- 172.21.15.37:0/1468275426 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb51c0d2310 msgr2=0x7fb51c0b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:56.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.233+0000 7fb521b9c700 1 --2- 172.21.15.37:0/1468275426 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb51c0d2310 0x7fb51c0b3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:56.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.233+0000 7fb521b9c700 1 -- 172.21.15.37:0/1468275426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb51c0cf780 msgr2=0x7fb51c1f1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:56.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.233+0000 7fb521b9c700 1 --2- 172.21.15.37:0/1468275426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb51c0cf780 0x7fb51c1f1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:56.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.233+0000 7fb521b9c700 1 -- 172.21.15.37:0/1468275426 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb514009b30 con 0x7fb51c1462d0 2023-07-14T15:58:56.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.233+0000 7fb520b9a700 1 --2- 172.21.15.37:0/1468275426 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fb51c0d2310 0x7fb51c0b3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:58:56.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.233+0000 7fb521b9c700 1 --2- 172.21.15.37:0/1468275426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb51c1462d0 0x7fb51c0b4390 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fb51c0b59f0 tx=0x7fb514004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:56.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.234+0000 7fb511ffb700 1 -- 172.21.15.37:0/1468275426 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb514004930 con 0x7fb51c1462d0 2023-07-14T15:58:56.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.234+0000 7fb511ffb700 1 -- 172.21.15.37:0/1468275426 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5140099b0 con 0x7fb51c1462d0 2023-07-14T15:58:56.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.234+0000 7fb5235ff700 1 -- 172.21.15.37:0/1468275426 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb51c0c93f0 con 0x7fb51c1462d0 2023-07-14T15:58:56.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.234+0000 7fb511ffb700 1 -- 172.21.15.37:0/1468275426 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51401c680 con 0x7fb51c1462d0 2023-07-14T15:58:56.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.234+0000 7fb5235ff700 1 -- 172.21.15.37:0/1468275426 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb51c0c99b0 con 0x7fb51c1462d0 2023-07-14T15:58:56.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.235+0000 7fb5235ff700 1 -- 172.21.15.37:0/1468275426 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb51c0d00e0 con 0x7fb51c1462d0 2023-07-14T15:58:56.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.236+0000 7fb511ffb700 1 -- 172.21.15.37:0/1468275426 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fb51401c7e0 con 0x7fb51c1462d0 2023-07-14T15:58:56.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.237+0000 7fb511ffb700 1 --2- 172.21.15.37:0/1468275426 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb50006ae00 0x7fb50006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:56.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.237+0000 7fb511ffb700 1 -- 172.21.15.37:0/1468275426 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5324+0+0 (secure 0 0 0) 0x7fb51408b0e0 con 0x7fb51c1462d0 2023-07-14T15:58:56.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.237+0000 7fb511ffb700 1 --2- 172.21.15.37:0/1468275426 >> [v2:172.21.15.37:6821/1190059746,v1:172.21.15.37:6823/1190059746] conn(0x7fb500071270 0x7fb5000736a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:56.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.237+0000 7fb511ffb700 1 -- 172.21.15.37:0/1468275426 --> [v2:172.21.15.37:6821/1190059746,v1:172.21.15.37:6823/1190059746] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb500073d70 con 0x7fb500071270 2023-07-14T15:58:56.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.237+0000 7fb511ffb700 1 -- 172.21.15.37:0/1468275426 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb51408d6c0 con 0x7fb51c1462d0 2023-07-14T15:58:56.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.237+0000 7fb520b9a700 1 --2- 172.21.15.37:0/1468275426 >> [v2:172.21.15.37:6821/1190059746,v1:172.21.15.37:6823/1190059746] conn(0x7fb500071270 0x7fb5000736a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:56.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.237+0000 7fb52139b700 1 --2- 172.21.15.37:0/1468275426 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb50006ae00 0x7fb50006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:56.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.238+0000 7fb520b9a700 1 --2- 172.21.15.37:0/1468275426 >> [v2:172.21.15.37:6821/1190059746,v1:172.21.15.37:6823/1190059746] conn(0x7fb500071270 0x7fb5000736a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:56.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.238+0000 7fb52139b700 1 --2- 172.21.15.37:0/1468275426 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb50006ae00 0x7fb50006d2b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb518006b20 tx=0x7fb518008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:56.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.238+0000 7fb511ffb700 1 -- 172.21.15.37:0/1468275426 <== osd.1 v2:172.21.15.37:6821/1190059746 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb500073d70 con 0x7fb500071270 2023-07-14T15:58:56.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.253+0000 7fb5235ff700 1 -- 172.21.15.37:0/1468275426 --> [v2:172.21.15.37:6821/1190059746,v1:172.21.15.37:6823/1190059746] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb51c0d1df0 con 0x7fb500071270 2023-07-14T15:58:56.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.254+0000 7fb511ffb700 1 -- 172.21.15.37:0/1468275426 <== osd.1 v2:172.21.15.37:6821/1190059746 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb50c0050f0 con 0x7fb500071270 2023-07-14T15:58:56.238 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-14T15:58:56.238 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-14T15:58:56.239 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-14T15:58:56.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.254+0000 7fb5235ff700 1 -- 172.21.15.37:0/1468275426 >> [v2:172.21.15.37:6821/1190059746,v1:172.21.15.37:6823/1190059746] conn(0x7fb500071270 msgr2=0x7fb5000736a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:56.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.254+0000 7fb5235ff700 1 --2- 172.21.15.37:0/1468275426 >> [v2:172.21.15.37:6821/1190059746,v1:172.21.15.37:6823/1190059746] conn(0x7fb500071270 0x7fb5000736a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:56.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.254+0000 7fb5235ff700 1 -- 172.21.15.37:0/1468275426 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb50006ae00 msgr2=0x7fb50006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:56.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.254+0000 7fb5235ff700 1 --2- 172.21.15.37:0/1468275426 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fb50006ae00 0x7fb50006d2b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb518006b20 tx=0x7fb518008040 comp rx=0 tx=0).stop 2023-07-14T15:58:56.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.254+0000 7fb5235ff700 1 -- 172.21.15.37:0/1468275426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb51c1462d0 msgr2=0x7fb51c0b4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:56.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.254+0000 7fb5235ff700 1 --2- 172.21.15.37:0/1468275426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb51c1462d0 0x7fb51c0b4390 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fb51c0b59f0 tx=0x7fb514004ad0 comp rx=0 tx=0).stop 2023-07-14T15:58:56.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.254+0000 7fb521b9c700 1 -- 172.21.15.37:0/1468275426 reap_dead start 2023-07-14T15:58:56.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.254+0000 7fb5235ff700 1 -- 172.21.15.37:0/1468275426 shutdown_connections 2023-07-14T15:58:56.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.254+0000 7fb5235ff700 1 -- 172.21.15.37:0/1468275426 >> 172.21.15.37:0/1468275426 conn(0x7fb51c06a4d0 msgr2=0x7fb51c15f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:56.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.254+0000 7fb5235ff700 1 -- 172.21.15.37:0/1468275426 shutdown_connections 2023-07-14T15:58:56.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.254+0000 7fb5235ff700 1 -- 172.21.15.37:0/1468275426 wait complete. 2023-07-14T15:58:56.255 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-07-14T15:58:56.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.473+0000 7f332a1ff700 1 Processor -- start 2023-07-14T15:58:56.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.473+0000 7f332a1ff700 1 -- start start 2023-07-14T15:58:56.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.474+0000 7f332a1ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f332406d8b0 0x7f33240c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:56.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.474+0000 7f332a1ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33240718a0 con 0x7f33240cbbf0 2023-07-14T15:58:56.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.475+0000 7f332a1ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f332415a8d0 con 0x7f332415ec90 2023-07-14T15:58:56.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.475+0000 7f332a1ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3324070c90 con 0x7f332406d8b0 2023-07-14T15:58:56.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.475+0000 7f3323fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f33240cbbf0 0x7f33240c96f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57350/0 (socket says 172.21.15.37:57350) 2023-07-14T15:58:56.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.475+0000 7f3323fff700 1 -- 172.21.15.37:0/2121618069 learned_addr learned my addr 172.21.15.37:0/2121618069 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:58:56.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.475+0000 7f3322ffd700 1 --2- 172.21.15.37:0/2121618069 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f332406d8b0 0x7f33240c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:56.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.475+0000 7f33227fc700 1 -- 172.21.15.37:0/2121618069 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 259459754 0 0) 0x7f33240718a0 con 0x7f33240cbbf0 2023-07-14T15:58:56.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.475+0000 7f33227fc700 1 -- 172.21.15.37:0/2121618069 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f330c0035b0 con 0x7f33240cbbf0 2023-07-14T15:58:56.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.475+0000 7f33227fc700 1 -- 172.21.15.37:0/2121618069 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3039245717 0 0) 0x7f332415a8d0 con 0x7f332415ec90 2023-07-14T15:58:56.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.475+0000 7f33227fc700 1 -- 172.21.15.37:0/2121618069 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33240718a0 con 0x7f332415ec90 2023-07-14T15:58:56.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.475+0000 7f3322ffd700 1 -- 172.21.15.37:0/2121618069 >> v1:172.21.15.98:6789/0 conn(0x7f332415ec90 legacy=0x7f33240cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:56.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.475+0000 7f3322ffd700 1 -- 172.21.15.37:0/2121618069 >> v1:172.21.15.37:6789/0 conn(0x7f33240cbbf0 legacy=0x7f33240c96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:56.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.475+0000 7f3322ffd700 1 -- 172.21.15.37:0/2121618069 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3324070f70 con 0x7f332406d8b0 2023-07-14T15:58:56.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.476+0000 7f3322ffd700 1 --2- 172.21.15.37:0/2121618069 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f332406d8b0 0x7f33240c91b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3318009870 tx=0x7f3318009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9722a03a6834ea2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:56.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.476+0000 7f33227fc700 1 -- 172.21.15.37:0/2121618069 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3318011830 con 0x7f332406d8b0 2023-07-14T15:58:56.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.476+0000 7f33227fc700 1 -- 172.21.15.37:0/2121618069 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3318011990 con 0x7f332406d8b0 2023-07-14T15:58:56.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.476+0000 7f33227fc700 1 -- 172.21.15.37:0/2121618069 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3318011d20 con 0x7f332406d8b0 2023-07-14T15:58:56.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.476+0000 7f332a1ff700 1 -- 172.21.15.37:0/2121618069 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f332406d8b0 msgr2=0x7f33240c91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:56.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.476+0000 7f332a1ff700 1 --2- 172.21.15.37:0/2121618069 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f332406d8b0 0x7f33240c91b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3318009870 tx=0x7f3318009b80 comp rx=0 tx=0).stop 2023-07-14T15:58:56.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.477+0000 7f332a1ff700 1 -- 172.21.15.37:0/2121618069 shutdown_connections 2023-07-14T15:58:56.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.477+0000 7f332a1ff700 1 --2- 172.21.15.37:0/2121618069 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f332406d8b0 0x7f33240c91b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:56.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.477+0000 7f332a1ff700 1 -- 172.21.15.37:0/2121618069 >> 172.21.15.37:0/2121618069 conn(0x7f33240b0620 msgr2=0x7f33240b0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:56.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.477+0000 7f332a1ff700 1 -- 172.21.15.37:0/2121618069 shutdown_connections 2023-07-14T15:58:56.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.477+0000 7f332a1ff700 1 -- 172.21.15.37:0/2121618069 wait complete. 2023-07-14T15:58:56.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.478+0000 7f332a1ff700 1 Processor -- start 2023-07-14T15:58:56.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.479+0000 7f332a1ff700 1 -- start start 2023-07-14T15:58:56.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.480+0000 7f332a1ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33240cbbf0 0x7f332414cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:56.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.480+0000 7f332a1ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f332415ec90 0x7f33240c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:56.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.480+0000 7f332a1ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f33240c6270 0x7f332415cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:56.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.480+0000 7f332a1ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332414d520 con 0x7f332415ec90 2023-07-14T15:58:56.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.480+0000 7f332a1ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33240c7080 con 0x7f33240cbbf0 2023-07-14T15:58:56.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.480+0000 7f332a1ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33240c67e0 con 0x7f33240c6270 2023-07-14T15:58:56.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.480+0000 7f3322ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f332415ec90 0x7f33240c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:56.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.480+0000 7f3322ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f332415ec90 0x7f33240c84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36284/0 (socket says 172.21.15.37:36284) 2023-07-14T15:58:56.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.480+0000 7f3322ffd700 1 -- 172.21.15.37:0/2876292316 learned_addr learned my addr 172.21.15.37:0/2876292316 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:56.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.480+0000 7f33237fe700 1 --2- 172.21.15.37:0/2876292316 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33240cbbf0 0x7f332414cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:56.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.480+0000 7f3323fff700 1 --2- 172.21.15.37:0/2876292316 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f33240c6270 0x7f332415cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:56.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.480+0000 7f3322ffd700 1 -- 172.21.15.37:0/2876292316 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f33240c6270 msgr2=0x7f332415cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:56.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.480+0000 7f3322ffd700 1 --2- 172.21.15.37:0/2876292316 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f33240c6270 0x7f332415cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:56.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.480+0000 7f3322ffd700 1 -- 172.21.15.37:0/2876292316 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33240cbbf0 msgr2=0x7f332414cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:56.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.480+0000 7f3322ffd700 1 --2- 172.21.15.37:0/2876292316 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33240cbbf0 0x7f332414cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:56.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.480+0000 7f3322ffd700 1 -- 172.21.15.37:0/2876292316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33180094a0 con 0x7f332415ec90 2023-07-14T15:58:56.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.480+0000 7f33237fe700 1 --2- 172.21.15.37:0/2876292316 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33240cbbf0 0x7f332414cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:58:56.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.481+0000 7f3322ffd700 1 --2- 172.21.15.37:0/2876292316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f332415ec90 0x7f33240c84f0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f33180090b0 tx=0x7f3318004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:56.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.481+0000 7f330bfff700 1 -- 172.21.15.37:0/2876292316 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331801a860 con 0x7f332415ec90 2023-07-14T15:58:56.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.481+0000 7f330bfff700 1 -- 172.21.15.37:0/2876292316 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f331801a9c0 con 0x7f332415ec90 2023-07-14T15:58:56.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.481+0000 7f332a1ff700 1 -- 172.21.15.37:0/2876292316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33240c6ac0 con 0x7f332415ec90 2023-07-14T15:58:56.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.481+0000 7f330bfff700 1 -- 172.21.15.37:0/2876292316 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331801ad30 con 0x7f332415ec90 2023-07-14T15:58:56.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.481+0000 7f332a1ff700 1 -- 172.21.15.37:0/2876292316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33240cc840 con 0x7f332415ec90 2023-07-14T15:58:56.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.482+0000 7f332a1ff700 1 -- 172.21.15.37:0/2876292316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33240cc6a0 con 0x7f332415ec90 2023-07-14T15:58:56.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.483+0000 7f330bfff700 1 -- 172.21.15.37:0/2876292316 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f3318022070 con 0x7f332415ec90 2023-07-14T15:58:56.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.484+0000 7f330bfff700 1 --2- 172.21.15.37:0/2876292316 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f331006ae00 0x7f331006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:56.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.484+0000 7f330bfff700 1 -- 172.21.15.37:0/2876292316 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5324+0+0 (secure 0 0 0) 0x7f331808a4e0 con 0x7f332415ec90 2023-07-14T15:58:56.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.484+0000 7f33237fe700 1 --2- 172.21.15.37:0/2876292316 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f331006ae00 0x7f331006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:56.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.485+0000 7f33237fe700 1 --2- 172.21.15.37:0/2876292316 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f331006ae00 0x7f331006d2b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f33140011e0 tx=0x7f3314009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:56.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.488+0000 7f330bfff700 1 -- 172.21.15.37:0/2876292316 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f33240cc6a0 con 0x7f332415ec90 2023-07-14T15:58:56.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.697+0000 7f332a1ff700 1 -- 172.21.15.37:0/2876292316 --> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f3324071530 con 0x7f331006ae00 2023-07-14T15:58:56.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.699+0000 7f330bfff700 1 -- 172.21.15.37:0/2876292316 <== mgr.4100 v2:172.21.15.98:6832/3163748069 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3314001c50 con 0x7f331006ae00 2023-07-14T15:58:56.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.700+0000 7f332a1ff700 1 -- 172.21.15.37:0/2876292316 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f331006ae00 msgr2=0x7f331006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:56.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.700+0000 7f332a1ff700 1 --2- 172.21.15.37:0/2876292316 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f331006ae00 0x7f331006d2b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f33140011e0 tx=0x7f3314009040 comp rx=0 tx=0).stop 2023-07-14T15:58:56.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.700+0000 7f332a1ff700 1 -- 172.21.15.37:0/2876292316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f332415ec90 msgr2=0x7f33240c84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:56.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.700+0000 7f332a1ff700 1 --2- 172.21.15.37:0/2876292316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f332415ec90 0x7f33240c84f0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f33180090b0 tx=0x7f3318004750 comp rx=0 tx=0).stop 2023-07-14T15:58:56.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.701+0000 7f332a1ff700 1 -- 172.21.15.37:0/2876292316 shutdown_connections 2023-07-14T15:58:56.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.701+0000 7f332a1ff700 1 --2- 172.21.15.37:0/2876292316 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33240cbbf0 0x7f332414cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:56.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.701+0000 7f332a1ff700 1 --2- 172.21.15.37:0/2876292316 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f331006ae00 0x7f331006d2b0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:56.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.701+0000 7f332a1ff700 1 --2- 172.21.15.37:0/2876292316 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f33240c6270 0x7f332415cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:56.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.701+0000 7f332a1ff700 1 --2- 172.21.15.37:0/2876292316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f332415ec90 0x7f33240c84f0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:56.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.701+0000 7f332a1ff700 1 -- 172.21.15.37:0/2876292316 >> 172.21.15.37:0/2876292316 conn(0x7f33240b0620 msgr2=0x7f33240aed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:56.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.701+0000 7f332a1ff700 1 -- 172.21.15.37:0/2876292316 shutdown_connections 2023-07-14T15:58:56.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.701+0000 7f332a1ff700 1 -- 172.21.15.37:0/2876292316 wait complete. 2023-07-14T15:58:56.691 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 1 to deep-scrub 2023-07-14T15:58:56.703 INFO:tasks.ceph:Scrubbing osd.2 2023-07-14T15:58:56.703 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-07-14T15:58:56.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.926+0000 7f99021ff700 1 Processor -- start 2023-07-14T15:58:56.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.926+0000 7f99021ff700 1 -- start start 2023-07-14T15:58:56.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.927+0000 7f99021ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f98fc0b1f30 0x7f98fc069e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:56.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.927+0000 7f99021ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f98fc06a3b0 0x7f98fc15ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:56.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.927+0000 7f99021ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98fc06e4f0 con 0x7f98fc15d3f0 2023-07-14T15:58:56.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.927+0000 7f99021ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98fc06a850 con 0x7f98fc0b1f30 2023-07-14T15:58:56.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.927+0000 7f99021ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98fc15dbe0 con 0x7f98fc06a3b0 2023-07-14T15:58:56.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.927+0000 7f98fb7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f98fc0b1f30 0x7f98fc069e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:56.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.927+0000 7f98fb7fe700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f98fc0b1f30 0x7f98fc069e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36298/0 (socket says 172.21.15.37:36298) 2023-07-14T15:58:56.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.927+0000 7f98fb7fe700 1 -- 172.21.15.37:0/4144823106 learned_addr learned my addr 172.21.15.37:0/4144823106 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:56.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.928+0000 7f98faffd700 1 --2- 172.21.15.37:0/4144823106 >> v2:172.21.15.98:3300/0 conn(0x7f98fc06a3b0 0x7f98fc15ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:56.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.928+0000 7f98fb7fe700 1 -- 172.21.15.37:0/4144823106 >> v2:172.21.15.98:3300/0 conn(0x7f98fc06a3b0 msgr2=0x7f98fc15ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:56.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.928+0000 7f98fb7fe700 1 --2- 172.21.15.37:0/4144823106 >> v2:172.21.15.98:3300/0 conn(0x7f98fc06a3b0 0x7f98fc15ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:56.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.928+0000 7f98fb7fe700 1 -- 172.21.15.37:0/4144823106 >> v1:172.21.15.98:6789/0 conn(0x7f98fc15d3f0 legacy=0x7f98fc070880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:56.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.928+0000 7f98fb7fe700 1 -- 172.21.15.37:0/4144823106 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98fc1603a0 con 0x7f98fc0b1f30 2023-07-14T15:58:56.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.928+0000 7f98fb7fe700 1 --2- 172.21.15.37:0/4144823106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98fc0b1f30 0x7f98fc069e70 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f98fc073860 tx=0x7f98ec009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56904544d927b456 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:56.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.928+0000 7f98fa7fc700 1 -- 172.21.15.37:0/4144823106 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ec011830 con 0x7f98fc0b1f30 2023-07-14T15:58:56.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.929+0000 7f98fa7fc700 1 -- 172.21.15.37:0/4144823106 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98ec011990 con 0x7f98fc0b1f30 2023-07-14T15:58:56.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.929+0000 7f98fa7fc700 1 -- 172.21.15.37:0/4144823106 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ec011d20 con 0x7f98fc0b1f30 2023-07-14T15:58:56.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.929+0000 7f99021ff700 1 -- 172.21.15.37:0/4144823106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98fc0b1f30 msgr2=0x7f98fc069e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:56.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.929+0000 7f99021ff700 1 --2- 172.21.15.37:0/4144823106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98fc0b1f30 0x7f98fc069e70 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f98fc073860 tx=0x7f98ec009bd0 comp rx=0 tx=0).stop 2023-07-14T15:58:56.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.929+0000 7f99021ff700 1 -- 172.21.15.37:0/4144823106 shutdown_connections 2023-07-14T15:58:56.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.929+0000 7f99021ff700 1 --2- 172.21.15.37:0/4144823106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98fc0b1f30 0x7f98fc069e70 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:56.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.929+0000 7f99021ff700 1 --2- 172.21.15.37:0/4144823106 >> v2:172.21.15.98:3300/0 conn(0x7f98fc06a3b0 0x7f98fc15ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:56.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.929+0000 7f99021ff700 1 -- 172.21.15.37:0/4144823106 >> 172.21.15.37:0/4144823106 conn(0x7f98fc0cc580 msgr2=0x7f98fc0cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:56.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.929+0000 7f99021ff700 1 -- 172.21.15.37:0/4144823106 shutdown_connections 2023-07-14T15:58:56.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.929+0000 7f99021ff700 1 -- 172.21.15.37:0/4144823106 wait complete. 2023-07-14T15:58:56.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.931+0000 7f99021ff700 1 Processor -- start 2023-07-14T15:58:56.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.931+0000 7f99021ff700 1 -- start start 2023-07-14T15:58:56.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.932+0000 7f99021ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98fc06a3b0 0x7f98fc0c9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:56.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.932+0000 7f99021ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f98fc0b1f30 0x7f98fc159f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:56.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.932+0000 7f99021ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98fc15d3f0 0x7f98fc0c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:56.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.932+0000 7f99021ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc0b4580 con 0x7f98fc06a3b0 2023-07-14T15:58:56.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.932+0000 7f99021ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc0b3970 con 0x7f98fc15d3f0 2023-07-14T15:58:56.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.932+0000 7f99021ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc0b3c50 con 0x7f98fc0b1f30 2023-07-14T15:58:56.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.932+0000 7f98fb7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98fc06a3b0 0x7f98fc0c9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:56.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.933+0000 7f98fb7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98fc06a3b0 0x7f98fc0c9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36304/0 (socket says 172.21.15.37:36304) 2023-07-14T15:58:56.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.933+0000 7f98fb7fe700 1 -- 172.21.15.37:0/2397597915 learned_addr learned my addr 172.21.15.37:0/2397597915 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:56.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.933+0000 7f98faffd700 1 --2- 172.21.15.37:0/2397597915 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f98fc0b1f30 0x7f98fc159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:56.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.933+0000 7f98fbfff700 1 --2- 172.21.15.37:0/2397597915 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98fc15d3f0 0x7f98fc0c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:56.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.933+0000 7f98fb7fe700 1 -- 172.21.15.37:0/2397597915 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f98fc0b1f30 msgr2=0x7f98fc159f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:56.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.933+0000 7f98fb7fe700 1 --2- 172.21.15.37:0/2397597915 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f98fc0b1f30 0x7f98fc159f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:56.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.933+0000 7f98fb7fe700 1 -- 172.21.15.37:0/2397597915 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98fc15d3f0 msgr2=0x7f98fc0c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:56.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.933+0000 7f98fb7fe700 1 --2- 172.21.15.37:0/2397597915 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98fc15d3f0 0x7f98fc0c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:56.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.933+0000 7f98fb7fe700 1 -- 172.21.15.37:0/2397597915 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ec009550 con 0x7f98fc06a3b0 2023-07-14T15:58:56.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.933+0000 7f98fbfff700 1 --2- 172.21.15.37:0/2397597915 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98fc15d3f0 0x7f98fc0c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:58:56.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.933+0000 7f98fb7fe700 1 --2- 172.21.15.37:0/2397597915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98fc06a3b0 0x7f98fc0c9450 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f98ec000c00 tx=0x7f98ec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:56.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.934+0000 7f98e3fff700 1 -- 172.21.15.37:0/2397597915 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ec004480 con 0x7f98fc06a3b0 2023-07-14T15:58:56.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.934+0000 7f98e3fff700 1 -- 172.21.15.37:0/2397597915 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98ec01f070 con 0x7f98fc06a3b0 2023-07-14T15:58:56.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.934+0000 7f98e3fff700 1 -- 172.21.15.37:0/2397597915 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ec0038e0 con 0x7f98fc06a3b0 2023-07-14T15:58:56.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.934+0000 7f99021ff700 1 -- 172.21.15.37:0/2397597915 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98fc0b3f30 con 0x7f98fc06a3b0 2023-07-14T15:58:56.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.934+0000 7f99021ff700 1 -- 172.21.15.37:0/2397597915 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98fc15a480 con 0x7f98fc06a3b0 2023-07-14T15:58:56.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.935+0000 7f99021ff700 1 -- 172.21.15.37:0/2397597915 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f98fc160960 con 0x7f98fc06a3b0 2023-07-14T15:58:56.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.936+0000 7f98e3fff700 1 -- 172.21.15.37:0/2397597915 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f98ec021030 con 0x7f98fc06a3b0 2023-07-14T15:58:56.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.937+0000 7f98e3fff700 1 --2- 172.21.15.37:0/2397597915 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f98e806ae00 0x7f98e806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:56.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.937+0000 7f98e3fff700 1 -- 172.21.15.37:0/2397597915 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5324+0+0 (secure 0 0 0) 0x7f98ec08a8c0 con 0x7f98fc06a3b0 2023-07-14T15:58:56.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.937+0000 7f98e3fff700 1 --2- 172.21.15.37:0/2397597915 >> [v2:172.21.15.37:6808/2266223499,v1:172.21.15.37:6809/2266223499] conn(0x7f98e8071270 0x7f98e80736a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:56.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.937+0000 7f98e3fff700 1 -- 172.21.15.37:0/2397597915 --> [v2:172.21.15.37:6808/2266223499,v1:172.21.15.37:6809/2266223499] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f98e8073d70 con 0x7f98e8071270 2023-07-14T15:58:56.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.937+0000 7f98e3fff700 1 -- 172.21.15.37:0/2397597915 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98ec08f2a0 con 0x7f98fc06a3b0 2023-07-14T15:58:56.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.937+0000 7f98fbfff700 1 --2- 172.21.15.37:0/2397597915 >> [v2:172.21.15.37:6808/2266223499,v1:172.21.15.37:6809/2266223499] conn(0x7f98e8071270 0x7f98e80736a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:56.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.937+0000 7f98faffd700 1 --2- 172.21.15.37:0/2397597915 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f98e806ae00 0x7f98e806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:56.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.938+0000 7f98fbfff700 1 --2- 172.21.15.37:0/2397597915 >> [v2:172.21.15.37:6808/2266223499,v1:172.21.15.37:6809/2266223499] conn(0x7f98e8071270 0x7f98e80736a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:56.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.938+0000 7f98faffd700 1 --2- 172.21.15.37:0/2397597915 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f98e806ae00 0x7f98e806d2b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f98fc0b1670 tx=0x7f98f0009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:56.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.938+0000 7f98e3fff700 1 -- 172.21.15.37:0/2397597915 <== osd.2 v2:172.21.15.37:6808/2266223499 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f98e8073d70 con 0x7f98e8071270 2023-07-14T15:58:56.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.954+0000 7f99021ff700 1 -- 172.21.15.37:0/2397597915 --> [v2:172.21.15.37:6808/2266223499,v1:172.21.15.37:6809/2266223499] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f98fc160680 con 0x7f98e8071270 2023-07-14T15:58:56.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.954+0000 7f98e3fff700 1 -- 172.21.15.37:0/2397597915 <== osd.2 v2:172.21.15.37:6808/2266223499 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f98f4003a00 con 0x7f98e8071270 2023-07-14T15:58:56.939 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-14T15:58:56.939 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-14T15:58:56.939 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-14T15:58:56.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.955+0000 7f99021ff700 1 -- 172.21.15.37:0/2397597915 >> [v2:172.21.15.37:6808/2266223499,v1:172.21.15.37:6809/2266223499] conn(0x7f98e8071270 msgr2=0x7f98e80736a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:56.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.955+0000 7f99021ff700 1 --2- 172.21.15.37:0/2397597915 >> [v2:172.21.15.37:6808/2266223499,v1:172.21.15.37:6809/2266223499] conn(0x7f98e8071270 0x7f98e80736a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:56.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.955+0000 7f99021ff700 1 -- 172.21.15.37:0/2397597915 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f98e806ae00 msgr2=0x7f98e806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:56.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.955+0000 7f99021ff700 1 --2- 172.21.15.37:0/2397597915 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f98e806ae00 0x7f98e806d2b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f98fc0b1670 tx=0x7f98f0009210 comp rx=0 tx=0).stop 2023-07-14T15:58:56.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.955+0000 7f99021ff700 1 -- 172.21.15.37:0/2397597915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98fc06a3b0 msgr2=0x7f98fc0c9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:56.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.955+0000 7f99021ff700 1 --2- 172.21.15.37:0/2397597915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98fc06a3b0 0x7f98fc0c9450 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f98ec000c00 tx=0x7f98ec004750 comp rx=0 tx=0).stop 2023-07-14T15:58:56.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.955+0000 7f98fbfff700 1 -- 172.21.15.37:0/2397597915 reap_dead start 2023-07-14T15:58:56.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.955+0000 7f99021ff700 1 -- 172.21.15.37:0/2397597915 shutdown_connections 2023-07-14T15:58:56.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.955+0000 7f99021ff700 1 -- 172.21.15.37:0/2397597915 >> 172.21.15.37:0/2397597915 conn(0x7f98fc0cc580 msgr2=0x7f98fc06d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:56.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.955+0000 7f99021ff700 1 -- 172.21.15.37:0/2397597915 shutdown_connections 2023-07-14T15:58:56.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:56.955+0000 7f99021ff700 1 -- 172.21.15.37:0/2397597915 wait complete. 2023-07-14T15:58:56.956 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-07-14T15:58:57.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.174+0000 7fbdd4bff700 1 Processor -- start 2023-07-14T15:58:57.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.174+0000 7fbdd4bff700 1 -- start start 2023-07-14T15:58:57.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.176+0000 7fbdd4bff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbdd006d8b0 0x7fbdd00c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:57.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.176+0000 7fbdd4bff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fbdd00cbbf0 0x7fbdd00c96f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:57.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.176+0000 7fbdd4bff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdd00718a0 con 0x7fbdd015ec90 2023-07-14T15:58:57.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.176+0000 7fbdd4bff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd015a8d0 con 0x7fbdd00cbbf0 2023-07-14T15:58:57.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.176+0000 7fbdd4bff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd0070c90 con 0x7fbdd006d8b0 2023-07-14T15:58:57.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.176+0000 7fbdce59c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fbdd015ec90 0x7fbdd00cb4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57354/0 (socket says 172.21.15.37:57354) 2023-07-14T15:58:57.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.176+0000 7fbdce59c700 1 -- 172.21.15.37:0/2756284830 learned_addr learned my addr 172.21.15.37:0/2756284830 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:58:57.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.176+0000 7fbdc7fff700 1 --2- 172.21.15.37:0/2756284830 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbdd006d8b0 0x7fbdd00c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:57.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.176+0000 7fbdced9d700 1 --2- 172.21.15.37:0/2756284830 >> v2:172.21.15.98:3300/0 conn(0x7fbdd00cbbf0 0x7fbdd00c96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:57.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.176+0000 7fbdcdd9b700 1 -- 172.21.15.37:0/2756284830 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1342332236 0 0) 0x7fbdd00718a0 con 0x7fbdd015ec90 2023-07-14T15:58:57.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.176+0000 7fbdcdd9b700 1 -- 172.21.15.37:0/2756284830 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdbc0035b0 con 0x7fbdd015ec90 2023-07-14T15:58:57.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.177+0000 7fbdcdd9b700 1 -- 172.21.15.37:0/2756284830 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1752274227 0 0) 0x7fbdbc0035b0 con 0x7fbdd015ec90 2023-07-14T15:58:57.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.177+0000 7fbdcdd9b700 1 -- 172.21.15.37:0/2756284830 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbdd006d8b0 msgr2=0x7fbdd00c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:57.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.177+0000 7fbdcdd9b700 1 --2- 172.21.15.37:0/2756284830 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbdd006d8b0 0x7fbdd00c91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:57.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.177+0000 7fbdcdd9b700 1 -- 172.21.15.37:0/2756284830 >> v2:172.21.15.98:3300/0 conn(0x7fbdd00cbbf0 msgr2=0x7fbdd00c96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:57.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.177+0000 7fbdcdd9b700 1 --2- 172.21.15.37:0/2756284830 >> v2:172.21.15.98:3300/0 conn(0x7fbdd00cbbf0 0x7fbdd00c96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:57.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.177+0000 7fbdcdd9b700 1 -- 172.21.15.37:0/2756284830 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd0070f70 con 0x7fbdd015ec90 2023-07-14T15:58:57.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.177+0000 7fbdcdd9b700 1 -- 172.21.15.37:0/2756284830 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48633207 0 0) 0x7fbdc0001670 con 0x7fbdd015ec90 2023-07-14T15:58:57.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.177+0000 7fbdcdd9b700 1 -- 172.21.15.37:0/2756284830 >> v1:172.21.15.37:6789/0 conn(0x7fbdd015ec90 legacy=0x7fbdd00cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:57.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.177+0000 7fbdcdd9b700 1 --2- 172.21.15.37:0/2756284830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbdbc003a00 0x7fbdbc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:57.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.177+0000 7fbdcdd9b700 1 --2- 172.21.15.37:0/2756284830 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbdbc004430 0x7fbdbc0048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:57.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.177+0000 7fbdcdd9b700 1 --2- 172.21.15.37:0/2756284830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdbc004e80 0x7fbdbc0052f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:57.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.177+0000 7fbdcdd9b700 1 -- 172.21.15.37:0/2756284830 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd015a8d0 con 0x7fbdbc004e80 2023-07-14T15:58:57.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.177+0000 7fbdcdd9b700 1 -- 172.21.15.37:0/2756284830 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd0070c90 con 0x7fbdbc003a00 2023-07-14T15:58:57.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.177+0000 7fbdcdd9b700 1 -- 172.21.15.37:0/2756284830 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc00bd10 con 0x7fbdbc004430 2023-07-14T15:58:57.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.177+0000 7fbdced9d700 1 --2- 172.21.15.37:0/2756284830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdbc004e80 0x7fbdbc0052f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:57.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.177+0000 7fbdce59c700 1 --2- 172.21.15.37:0/2756284830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbdbc003a00 0x7fbdbc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:57.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.177+0000 7fbdc7fff700 1 --2- 172.21.15.37:0/2756284830 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbdbc004430 0x7fbdbc0048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:57.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.178+0000 7fbdce59c700 1 -- 172.21.15.37:0/2756284830 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbdbc004430 msgr2=0x7fbdbc0048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:57.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.178+0000 7fbdce59c700 1 --2- 172.21.15.37:0/2756284830 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbdbc004430 0x7fbdbc0048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:57.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.178+0000 7fbdce59c700 1 -- 172.21.15.37:0/2756284830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdbc004e80 msgr2=0x7fbdbc0052f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:57.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.178+0000 7fbdce59c700 1 --2- 172.21.15.37:0/2756284830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdbc004e80 0x7fbdbc0052f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:57.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.178+0000 7fbdce59c700 1 -- 172.21.15.37:0/2756284830 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdbc0035b0 con 0x7fbdbc003a00 2023-07-14T15:58:57.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.178+0000 7fbdce59c700 1 --2- 172.21.15.37:0/2756284830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbdbc003a00 0x7fbdbc003e10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fbdc000c370 tx=0x7fbdbc005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcc69762b0e3410a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:57.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.179+0000 7fbdcdd9b700 1 -- 172.21.15.37:0/2756284830 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc0007c60 con 0x7fbdbc003a00 2023-07-14T15:58:57.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.179+0000 7fbdcdd9b700 1 -- 172.21.15.37:0/2756284830 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc0005960 con 0x7fbdbc003a00 2023-07-14T15:58:57.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.179+0000 7fbdcdd9b700 1 -- 172.21.15.37:0/2756284830 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc0005d10 con 0x7fbdbc003a00 2023-07-14T15:58:57.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.179+0000 7fbdd4bff700 1 -- 172.21.15.37:0/2756284830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbdbc003a00 msgr2=0x7fbdbc003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:57.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.179+0000 7fbdd4bff700 1 --2- 172.21.15.37:0/2756284830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbdbc003a00 0x7fbdbc003e10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fbdc000c370 tx=0x7fbdbc005880 comp rx=0 tx=0).stop 2023-07-14T15:58:57.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.179+0000 7fbdced9d700 1 -- 172.21.15.37:0/2756284830 reap_dead start 2023-07-14T15:58:57.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.179+0000 7fbdd4bff700 1 -- 172.21.15.37:0/2756284830 shutdown_connections 2023-07-14T15:58:57.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.179+0000 7fbdd4bff700 1 -- 172.21.15.37:0/2756284830 >> 172.21.15.37:0/2756284830 conn(0x7fbdd00b0620 msgr2=0x7fbdd00b0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:57.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.179+0000 7fbdd4bff700 1 -- 172.21.15.37:0/2756284830 shutdown_connections 2023-07-14T15:58:57.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.179+0000 7fbdd4bff700 1 -- 172.21.15.37:0/2756284830 wait complete. 2023-07-14T15:58:57.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.181+0000 7fbdd4bff700 1 Processor -- start 2023-07-14T15:58:57.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.181+0000 7fbdd4bff700 1 -- start start 2023-07-14T15:58:57.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.182+0000 7fbdd4bff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbdbc003a00 0x7fbdd0156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:57.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.182+0000 7fbdd4bff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbdd01f01d0 0x7fbdd00c51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:57.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.182+0000 7fbdd4bff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdd01564a0 0x7fbdd00b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:57.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.182+0000 7fbdd4bff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd015be10 con 0x7fbdd01564a0 2023-07-14T15:58:57.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.182+0000 7fbdd4bff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd00c5800 con 0x7fbdd01f01d0 2023-07-14T15:58:57.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.182+0000 7fbdd4bff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd015c060 con 0x7fbdbc003a00 2023-07-14T15:58:57.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.183+0000 7fbdced9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdd01564a0 0x7fbdd00b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:57.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.183+0000 7fbdce59c700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbdbc003a00 0x7fbdd0156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:57.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.183+0000 7fbdced9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdd01564a0 0x7fbdd00b2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36332/0 (socket says 172.21.15.37:36332) 2023-07-14T15:58:57.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.183+0000 7fbdced9d700 1 -- 172.21.15.37:0/977014602 learned_addr learned my addr 172.21.15.37:0/977014602 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:57.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.183+0000 7fbdc7fff700 1 --2- 172.21.15.37:0/977014602 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbdd01f01d0 0x7fbdd00c51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:57.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.183+0000 7fbdced9d700 1 -- 172.21.15.37:0/977014602 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbdbc003a00 msgr2=0x7fbdd0156d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:57.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.183+0000 7fbdced9d700 1 --2- 172.21.15.37:0/977014602 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbdbc003a00 0x7fbdd0156d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:57.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.183+0000 7fbdced9d700 1 -- 172.21.15.37:0/977014602 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbdd01f01d0 msgr2=0x7fbdd00c51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:57.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.183+0000 7fbdced9d700 1 --2- 172.21.15.37:0/977014602 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbdd01f01d0 0x7fbdd00c51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.183+0000 7fbdced9d700 1 -- 172.21.15.37:0/977014602 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd015c340 con 0x7fbdd01564a0 2023-07-14T15:58:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.183+0000 7fbdced9d700 1 --2- 172.21.15.37:0/977014602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdd01564a0 0x7fbdd00b2aa0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fbdd00cea10 tx=0x7fbdc8011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.184+0000 7fbdc6ffd700 1 -- 172.21.15.37:0/977014602 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc800e040 con 0x7fbdd01564a0 2023-07-14T15:58:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.184+0000 7fbdc6ffd700 1 -- 172.21.15.37:0/977014602 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc800f040 con 0x7fbdd01564a0 2023-07-14T15:58:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.184+0000 7fbdc6ffd700 1 -- 172.21.15.37:0/977014602 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc800f890 con 0x7fbdd01564a0 2023-07-14T15:58:57.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.184+0000 7fbdd4bff700 1 -- 172.21.15.37:0/977014602 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdd015c620 con 0x7fbdd01564a0 2023-07-14T15:58:57.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.184+0000 7fbdd4bff700 1 -- 172.21.15.37:0/977014602 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdd0156920 con 0x7fbdd01564a0 2023-07-14T15:58:57.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.185+0000 7fbdd4bff700 1 -- 172.21.15.37:0/977014602 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdd004e210 con 0x7fbdd01564a0 2023-07-14T15:58:57.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.186+0000 7fbdc6ffd700 1 -- 172.21.15.37:0/977014602 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fbdc800f9f0 con 0x7fbdd01564a0 2023-07-14T15:58:57.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.187+0000 7fbdc6ffd700 1 --2- 172.21.15.37:0/977014602 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbdb006ae00 0x7fbdb006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:57.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.187+0000 7fbdc6ffd700 1 -- 172.21.15.37:0/977014602 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5324+0+0 (secure 0 0 0) 0x7fbdc8089930 con 0x7fbdd01564a0 2023-07-14T15:58:57.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.187+0000 7fbdce59c700 1 --2- 172.21.15.37:0/977014602 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbdb006ae00 0x7fbdb006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:57.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.188+0000 7fbdce59c700 1 --2- 172.21.15.37:0/977014602 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbdb006ae00 0x7fbdb006d2b0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fbdd00af430 tx=0x7fbdc000a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:57.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.191+0000 7fbdc6ffd700 1 -- 172.21.15.37:0/977014602 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fbdc8054a00 con 0x7fbdd01564a0 2023-07-14T15:58:57.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.398+0000 7fbdd4bff700 1 -- 172.21.15.37:0/977014602 --> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fbdd0071530 con 0x7fbdb006ae00 2023-07-14T15:58:57.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.399+0000 7fbdc6ffd700 1 -- 172.21.15.37:0/977014602 <== mgr.4100 v2:172.21.15.98:6832/3163748069 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbdc0023070 con 0x7fbdb006ae00 2023-07-14T15:58:57.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.401+0000 7fbdd4bff700 1 -- 172.21.15.37:0/977014602 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbdb006ae00 msgr2=0x7fbdb006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:57.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.401+0000 7fbdd4bff700 1 --2- 172.21.15.37:0/977014602 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbdb006ae00 0x7fbdb006d2b0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fbdd00af430 tx=0x7fbdc000a000 comp rx=0 tx=0).stop 2023-07-14T15:58:57.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.401+0000 7fbdd4bff700 1 -- 172.21.15.37:0/977014602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdd01564a0 msgr2=0x7fbdd00b2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:57.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.401+0000 7fbdd4bff700 1 --2- 172.21.15.37:0/977014602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdd01564a0 0x7fbdd00b2aa0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fbdd00cea10 tx=0x7fbdc8011ed0 comp rx=0 tx=0).stop 2023-07-14T15:58:57.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.401+0000 7fbdd4bff700 1 -- 172.21.15.37:0/977014602 shutdown_connections 2023-07-14T15:58:57.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.401+0000 7fbdd4bff700 1 --2- 172.21.15.37:0/977014602 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbdb006ae00 0x7fbdb006d2b0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:57.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.401+0000 7fbdd4bff700 1 --2- 172.21.15.37:0/977014602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdd01564a0 0x7fbdd00b2aa0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:57.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.401+0000 7fbdd4bff700 1 --2- 172.21.15.37:0/977014602 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbdbc003a00 0x7fbdd0156d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:57.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.401+0000 7fbdd4bff700 1 --2- 172.21.15.37:0/977014602 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbdd01f01d0 0x7fbdd00c51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:57.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.401+0000 7fbdd4bff700 1 -- 172.21.15.37:0/977014602 >> 172.21.15.37:0/977014602 conn(0x7fbdd00b0620 msgr2=0x7fbdd00ca2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:57.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.401+0000 7fbdd4bff700 1 -- 172.21.15.37:0/977014602 shutdown_connections 2023-07-14T15:58:57.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.401+0000 7fbdd4bff700 1 -- 172.21.15.37:0/977014602 wait complete. 2023-07-14T15:58:57.388 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 2 to deep-scrub 2023-07-14T15:58:57.403 INFO:tasks.ceph:Scrubbing osd.3 2023-07-14T15:58:57.403 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-07-14T15:58:57.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.625+0000 7f626dfff700 1 Processor -- start 2023-07-14T15:58:57.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.625+0000 7f626dfff700 1 -- start start 2023-07-14T15:58:57.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.626+0000 7f626dfff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f62680cd890 0x7f62680d09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:57.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.626+0000 7f626dfff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62680d1270 con 0x7f62681462d0 2023-07-14T15:58:57.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.626+0000 7f626dfff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62680d1550 con 0x7f62680cf780 2023-07-14T15:58:57.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.626+0000 7f626dfff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62680cdd00 con 0x7f62680cd890 2023-07-14T15:58:57.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.626+0000 7f6266ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f62680cd890 0x7f62680d09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:57.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.626+0000 7f62677fe700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f62681462d0 0x7f62680d2310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57358/0 (socket says 172.21.15.37:57358) 2023-07-14T15:58:57.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.626+0000 7f62677fe700 1 -- 172.21.15.37:0/1967617640 learned_addr learned my addr 172.21.15.37:0/1967617640 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:58:57.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.627+0000 7f6266ffd700 1 -- 172.21.15.37:0/1967617640 >> v1:172.21.15.98:6789/0 conn(0x7f62680cf780 legacy=0x7f62680cfba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:57.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.627+0000 7f6266ffd700 1 -- 172.21.15.37:0/1967617640 >> v1:172.21.15.37:6789/0 conn(0x7f62681462d0 legacy=0x7f62680d2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:57.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.627+0000 7f6266ffd700 1 -- 172.21.15.37:0/1967617640 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62680d1830 con 0x7f62680cd890 2023-07-14T15:58:57.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.627+0000 7f6266ffd700 1 --2- 172.21.15.37:0/1967617640 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62680cd890 0x7f62680d09d0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f625c009840 tx=0x7f625c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a79a95e40d65b904 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:57.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.627+0000 7f62667fc700 1 -- 172.21.15.37:0/1967617640 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c011830 con 0x7f62680cd890 2023-07-14T15:58:57.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.627+0000 7f62667fc700 1 -- 172.21.15.37:0/1967617640 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f625c011990 con 0x7f62680cd890 2023-07-14T15:58:57.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.627+0000 7f62667fc700 1 -- 172.21.15.37:0/1967617640 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c011d20 con 0x7f62680cd890 2023-07-14T15:58:57.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.628+0000 7f626dfff700 1 -- 172.21.15.37:0/1967617640 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62680cd890 msgr2=0x7f62680d09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:57.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.628+0000 7f626dfff700 1 --2- 172.21.15.37:0/1967617640 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62680cd890 0x7f62680d09d0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f625c009840 tx=0x7f625c009b50 comp rx=0 tx=0).stop 2023-07-14T15:58:57.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.628+0000 7f626dfff700 1 -- 172.21.15.37:0/1967617640 shutdown_connections 2023-07-14T15:58:57.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.628+0000 7f626dfff700 1 --2- 172.21.15.37:0/1967617640 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62680cd890 0x7f62680d09d0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:57.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.628+0000 7f626dfff700 1 -- 172.21.15.37:0/1967617640 >> 172.21.15.37:0/1967617640 conn(0x7f626806a4d0 msgr2=0x7f626806a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:57.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.628+0000 7f626dfff700 1 -- 172.21.15.37:0/1967617640 shutdown_connections 2023-07-14T15:58:57.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.628+0000 7f626dfff700 1 -- 172.21.15.37:0/1967617640 wait complete. 2023-07-14T15:58:57.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.630+0000 7f626dfff700 1 Processor -- start 2023-07-14T15:58:57.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.630+0000 7f626dfff700 1 -- start start 2023-07-14T15:58:57.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.631+0000 7f626dfff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f62680cd890 0x7f6268157f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:57.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.631+0000 7f626dfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f62680cf780 0x7f62680b4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:57.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.631+0000 7f626dfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62681462d0 0x7f62680b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:57.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.631+0000 7f626dfff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62680c7900 con 0x7f62681462d0 2023-07-14T15:58:57.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.631+0000 7f626dfff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62680c7be0 con 0x7f62680cf780 2023-07-14T15:58:57.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.631+0000 7f626dfff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62680c7ec0 con 0x7f62680cd890 2023-07-14T15:58:57.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.631+0000 7f6267fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62681462d0 0x7f62680b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:57.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.631+0000 7f6267fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62681462d0 0x7f62680b4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36350/0 (socket says 172.21.15.37:36350) 2023-07-14T15:58:57.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.631+0000 7f6267fff700 1 -- 172.21.15.37:0/682084310 learned_addr learned my addr 172.21.15.37:0/682084310 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:57.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.631+0000 7f62677fe700 1 --2- 172.21.15.37:0/682084310 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f62680cd890 0x7f6268157f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:57.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.631+0000 7f6266ffd700 1 --2- 172.21.15.37:0/682084310 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f62680cf780 0x7f62680b4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:57.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.632+0000 7f6267fff700 1 -- 172.21.15.37:0/682084310 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f62680cd890 msgr2=0x7f6268157f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:57.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.632+0000 7f6267fff700 1 --2- 172.21.15.37:0/682084310 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f62680cd890 0x7f6268157f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:57.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.632+0000 7f6267fff700 1 -- 172.21.15.37:0/682084310 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f62680cf780 msgr2=0x7f62680b4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:57.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.632+0000 7f6267fff700 1 --2- 172.21.15.37:0/682084310 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f62680cf780 0x7f62680b4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:57.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.632+0000 7f6267fff700 1 -- 172.21.15.37:0/682084310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f625c0094a0 con 0x7f62681462d0 2023-07-14T15:58:57.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.632+0000 7f6267fff700 1 --2- 172.21.15.37:0/682084310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62681462d0 0x7f62680b4c70 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f626000cc50 tx=0x7f626000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:57.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.632+0000 7f624ffff700 1 -- 172.21.15.37:0/682084310 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6260003c00 con 0x7f62681462d0 2023-07-14T15:58:57.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.632+0000 7f624ffff700 1 -- 172.21.15.37:0/682084310 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6260003d60 con 0x7f62681462d0 2023-07-14T15:58:57.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.632+0000 7f626dfff700 1 -- 172.21.15.37:0/682084310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62680c81a0 con 0x7f62681462d0 2023-07-14T15:58:57.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.632+0000 7f624ffff700 1 -- 172.21.15.37:0/682084310 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626000aab0 con 0x7f62681462d0 2023-07-14T15:58:57.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.632+0000 7f626dfff700 1 -- 172.21.15.37:0/682084310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62680c89a0 con 0x7f62681462d0 2023-07-14T15:58:57.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.633+0000 7f626dfff700 1 -- 172.21.15.37:0/682084310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f62680d1df0 con 0x7f62681462d0 2023-07-14T15:58:57.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.634+0000 7f624ffff700 1 -- 172.21.15.37:0/682084310 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f626000ac10 con 0x7f62681462d0 2023-07-14T15:58:57.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.635+0000 7f624ffff700 1 --2- 172.21.15.37:0/682084310 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f625406ae00 0x7f625406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:57.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.635+0000 7f624ffff700 1 -- 172.21.15.37:0/682084310 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5324+0+0 (secure 0 0 0) 0x7f6260089350 con 0x7f62681462d0 2023-07-14T15:58:57.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.636+0000 7f624ffff700 1 --2- 172.21.15.37:0/682084310 >> [v2:172.21.15.37:6810/4166694594,v1:172.21.15.37:6812/4166694594] conn(0x7f6254071270 0x7f62540736a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:57.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.636+0000 7f624ffff700 1 -- 172.21.15.37:0/682084310 --> [v2:172.21.15.37:6810/4166694594,v1:172.21.15.37:6812/4166694594] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6254073d70 con 0x7f6254071270 2023-07-14T15:58:57.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.636+0000 7f624ffff700 1 -- 172.21.15.37:0/682084310 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f626008b930 con 0x7f62681462d0 2023-07-14T15:58:57.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.636+0000 7f62677fe700 1 --2- 172.21.15.37:0/682084310 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f625406ae00 0x7f625406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:57.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.636+0000 7f6266ffd700 1 --2- 172.21.15.37:0/682084310 >> [v2:172.21.15.37:6810/4166694594,v1:172.21.15.37:6812/4166694594] conn(0x7f6254071270 0x7f62540736a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:57.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.636+0000 7f6266ffd700 1 --2- 172.21.15.37:0/682084310 >> [v2:172.21.15.37:6810/4166694594,v1:172.21.15.37:6812/4166694594] conn(0x7f6254071270 0x7f62540736a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:57.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.637+0000 7f62677fe700 1 --2- 172.21.15.37:0/682084310 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f625406ae00 0x7f625406d2b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6258005910 tx=0x7f6258009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:57.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.637+0000 7f624ffff700 1 -- 172.21.15.37:0/682084310 <== osd.3 v2:172.21.15.37:6810/4166694594 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f6254073d70 con 0x7f6254071270 2023-07-14T15:58:57.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.653+0000 7f626dfff700 1 -- 172.21.15.37:0/682084310 --> [v2:172.21.15.37:6810/4166694594,v1:172.21.15.37:6812/4166694594] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f62680d1b10 con 0x7f6254071270 2023-07-14T15:58:57.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.653+0000 7f624ffff700 1 -- 172.21.15.37:0/682084310 <== osd.3 v2:172.21.15.37:6810/4166694594 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f625c022040 con 0x7f6254071270 2023-07-14T15:58:57.637 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-14T15:58:57.638 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-14T15:58:57.638 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-14T15:58:57.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.653+0000 7f626dfff700 1 -- 172.21.15.37:0/682084310 >> [v2:172.21.15.37:6810/4166694594,v1:172.21.15.37:6812/4166694594] conn(0x7f6254071270 msgr2=0x7f62540736a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:57.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.653+0000 7f626dfff700 1 --2- 172.21.15.37:0/682084310 >> [v2:172.21.15.37:6810/4166694594,v1:172.21.15.37:6812/4166694594] conn(0x7f6254071270 0x7f62540736a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:57.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.653+0000 7f626dfff700 1 -- 172.21.15.37:0/682084310 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f625406ae00 msgr2=0x7f625406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:57.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.653+0000 7f626dfff700 1 --2- 172.21.15.37:0/682084310 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f625406ae00 0x7f625406d2b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6258005910 tx=0x7f6258009040 comp rx=0 tx=0).stop 2023-07-14T15:58:57.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.654+0000 7f626dfff700 1 -- 172.21.15.37:0/682084310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62681462d0 msgr2=0x7f62680b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:57.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.654+0000 7f626dfff700 1 --2- 172.21.15.37:0/682084310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62681462d0 0x7f62680b4c70 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f626000cc50 tx=0x7f626000cf60 comp rx=0 tx=0).stop 2023-07-14T15:58:57.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.654+0000 7f6267fff700 1 -- 172.21.15.37:0/682084310 reap_dead start 2023-07-14T15:58:57.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.654+0000 7f626dfff700 1 -- 172.21.15.37:0/682084310 shutdown_connections 2023-07-14T15:58:57.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.654+0000 7f626dfff700 1 -- 172.21.15.37:0/682084310 >> 172.21.15.37:0/682084310 conn(0x7f626806a4d0 msgr2=0x7f62681599f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:57.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.654+0000 7f626dfff700 1 -- 172.21.15.37:0/682084310 shutdown_connections 2023-07-14T15:58:57.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.654+0000 7f626dfff700 1 -- 172.21.15.37:0/682084310 wait complete. 2023-07-14T15:58:57.654 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-07-14T15:58:57.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.873+0000 7f2a575ff700 1 Processor -- start 2023-07-14T15:58:57.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.873+0000 7f2a575ff700 1 -- start start 2023-07-14T15:58:57.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.874+0000 7f2a575ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f2a50071f20 0x7f2a500cf250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:57.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.874+0000 7f2a575ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a500b5230 con 0x7f2a500b4280 2023-07-14T15:58:57.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.874+0000 7f2a575ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a500b0c00 con 0x7f2a5015cd90 2023-07-14T15:58:57.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.874+0000 7f2a575ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a500b4d60 con 0x7f2a50071f20 2023-07-14T15:58:57.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.875+0000 7f2a5539b700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2a500b4280 0x7f2a500b4650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57360/0 (socket says 172.21.15.37:57360) 2023-07-14T15:58:57.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.875+0000 7f2a5539b700 1 -- 172.21.15.37:0/4265843195 learned_addr learned my addr 172.21.15.37:0/4265843195 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:58:57.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.875+0000 7f2a55b9c700 1 --2- 172.21.15.37:0/4265843195 >> v2:172.21.15.98:3300/0 conn(0x7f2a50071f20 0x7f2a500cf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:57.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.875+0000 7f2a47fff700 1 -- 172.21.15.37:0/4265843195 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3464150828 0 0) 0x7f2a500b5230 con 0x7f2a500b4280 2023-07-14T15:58:57.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.875+0000 7f2a47fff700 1 -- 172.21.15.37:0/4265843195 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a3c0035b0 con 0x7f2a500b4280 2023-07-14T15:58:57.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.875+0000 7f2a47fff700 1 -- 172.21.15.37:0/4265843195 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2186171449 0 0) 0x7f2a3c0035b0 con 0x7f2a500b4280 2023-07-14T15:58:57.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.875+0000 7f2a47fff700 1 -- 172.21.15.37:0/4265843195 >> v2:172.21.15.98:3300/0 conn(0x7f2a50071f20 msgr2=0x7f2a500cf250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:57.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.875+0000 7f2a47fff700 1 --2- 172.21.15.37:0/4265843195 >> v2:172.21.15.98:3300/0 conn(0x7f2a50071f20 0x7f2a500cf250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:57.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.875+0000 7f2a47fff700 1 -- 172.21.15.37:0/4265843195 >> v1:172.21.15.98:6789/0 conn(0x7f2a5015cd90 legacy=0x7f2a500c63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:57.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.875+0000 7f2a47fff700 1 -- 172.21.15.37:0/4265843195 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a50066260 con 0x7f2a500b4280 2023-07-14T15:58:57.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.875+0000 7f2a47fff700 1 -- 172.21.15.37:0/4265843195 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 48633207 0 0) 0x7f2a4c001670 con 0x7f2a500b4280 2023-07-14T15:58:57.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.876+0000 7f2a47fff700 1 -- 172.21.15.37:0/4265843195 >> v1:172.21.15.37:6789/0 conn(0x7f2a500b4280 legacy=0x7f2a500b4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:57.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.876+0000 7f2a47fff700 1 --2- 172.21.15.37:0/4265843195 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2a3c003a00 0x7f2a3c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:57.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.876+0000 7f2a47fff700 1 --2- 172.21.15.37:0/4265843195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a3c004850 0x7f2a3c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:57.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.876+0000 7f2a47fff700 1 --2- 172.21.15.37:0/4265843195 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a3c005200 0x7f2a3c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:57.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.876+0000 7f2a47fff700 1 -- 172.21.15.37:0/4265843195 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c00c0e0 con 0x7f2a3c004850 2023-07-14T15:58:57.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.876+0000 7f2a47fff700 1 -- 172.21.15.37:0/4265843195 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c00c250 con 0x7f2a3c005200 2023-07-14T15:58:57.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.876+0000 7f2a47fff700 1 -- 172.21.15.37:0/4265843195 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c00c410 con 0x7f2a3c003a00 2023-07-14T15:58:57.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.876+0000 7f2a54b9a700 1 --2- 172.21.15.37:0/4265843195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a3c004850 0x7f2a3c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:57.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.876+0000 7f2a55b9c700 1 --2- 172.21.15.37:0/4265843195 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a3c005200 0x7f2a3c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:57.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.876+0000 7f2a5539b700 1 --2- 172.21.15.37:0/4265843195 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2a3c003a00 0x7f2a3c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:57.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.876+0000 7f2a54b9a700 1 -- 172.21.15.37:0/4265843195 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2a3c003a00 msgr2=0x7f2a3c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:57.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.876+0000 7f2a54b9a700 1 --2- 172.21.15.37:0/4265843195 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2a3c003a00 0x7f2a3c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:57.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.876+0000 7f2a54b9a700 1 -- 172.21.15.37:0/4265843195 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a3c005200 msgr2=0x7f2a3c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:57.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.876+0000 7f2a54b9a700 1 --2- 172.21.15.37:0/4265843195 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a3c005200 0x7f2a3c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:57.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.876+0000 7f2a54b9a700 1 -- 172.21.15.37:0/4265843195 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a3c0035b0 con 0x7f2a3c004850 2023-07-14T15:58:57.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.876+0000 7f2a55b9c700 1 -- 172.21.15.37:0/4265843195 reap_dead start 2023-07-14T15:58:57.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.877+0000 7f2a54b9a700 1 --2- 172.21.15.37:0/4265843195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a3c004850 0x7f2a3c004cc0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f2a5015d180 tx=0x7f2a3c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=323011319ab20396 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:57.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.877+0000 7f2a47fff700 1 -- 172.21.15.37:0/4265843195 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a400052d0 con 0x7f2a3c004850 2023-07-14T15:58:57.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.877+0000 7f2a47fff700 1 -- 172.21.15.37:0/4265843195 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a40005450 con 0x7f2a3c004850 2023-07-14T15:58:57.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.877+0000 7f2a47fff700 1 -- 172.21.15.37:0/4265843195 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a400038c0 con 0x7f2a3c004850 2023-07-14T15:58:57.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.877+0000 7f2a575ff700 1 -- 172.21.15.37:0/4265843195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a3c004850 msgr2=0x7f2a3c004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:57.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.877+0000 7f2a575ff700 1 --2- 172.21.15.37:0/4265843195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a3c004850 0x7f2a3c004cc0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f2a5015d180 tx=0x7f2a3c005880 comp rx=0 tx=0).stop 2023-07-14T15:58:57.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.878+0000 7f2a575ff700 1 -- 172.21.15.37:0/4265843195 shutdown_connections 2023-07-14T15:58:57.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.878+0000 7f2a575ff700 1 --2- 172.21.15.37:0/4265843195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a3c004850 0x7f2a3c004cc0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:57.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.878+0000 7f2a575ff700 1 -- 172.21.15.37:0/4265843195 >> 172.21.15.37:0/4265843195 conn(0x7f2a50071410 msgr2=0x7f2a50071810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:57.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.878+0000 7f2a575ff700 1 -- 172.21.15.37:0/4265843195 shutdown_connections 2023-07-14T15:58:57.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.878+0000 7f2a575ff700 1 -- 172.21.15.37:0/4265843195 wait complete. 2023-07-14T15:58:57.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.880+0000 7f2a575ff700 1 Processor -- start 2023-07-14T15:58:57.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.880+0000 7f2a575ff700 1 -- start start 2023-07-14T15:58:57.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.882+0000 7f2a575ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a3c004850 0x7f2a5015a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:57.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.882+0000 7f2a575ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2a500c99f0 0x7f2a501e4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:57.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.882+0000 7f2a575ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a500cd1e0 0x7f2a500cd660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:57.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.882+0000 7f2a575ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a501e6d40 con 0x7f2a500cd1e0 2023-07-14T15:58:57.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.882+0000 7f2a575ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5015a980 con 0x7f2a3c004850 2023-07-14T15:58:57.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.882+0000 7f2a575ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a500cdba0 con 0x7f2a500c99f0 2023-07-14T15:58:57.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.882+0000 7f2a55b9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a500cd1e0 0x7f2a500cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:57.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.882+0000 7f2a55b9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a500cd1e0 0x7f2a500cd660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36372/0 (socket says 172.21.15.37:36372) 2023-07-14T15:58:57.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.882+0000 7f2a55b9c700 1 -- 172.21.15.37:0/220294312 learned_addr learned my addr 172.21.15.37:0/220294312 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:57.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.882+0000 7f2a54b9a700 1 --2- 172.21.15.37:0/220294312 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2a500c99f0 0x7f2a501e4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:57.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.882+0000 7f2a5539b700 1 --2- 172.21.15.37:0/220294312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a3c004850 0x7f2a5015a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:57.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.882+0000 7f2a55b9c700 1 -- 172.21.15.37:0/220294312 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2a500c99f0 msgr2=0x7f2a501e4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:57.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.882+0000 7f2a55b9c700 1 --2- 172.21.15.37:0/220294312 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2a500c99f0 0x7f2a501e4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:57.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.882+0000 7f2a55b9c700 1 -- 172.21.15.37:0/220294312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a3c004850 msgr2=0x7f2a5015a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:57.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.882+0000 7f2a55b9c700 1 --2- 172.21.15.37:0/220294312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a3c004850 0x7f2a5015a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:57.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.883+0000 7f2a55b9c700 1 -- 172.21.15.37:0/220294312 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a501e6710 con 0x7f2a500cd1e0 2023-07-14T15:58:57.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.883+0000 7f2a5539b700 1 --2- 172.21.15.37:0/220294312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a3c004850 0x7f2a5015a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:58:57.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.883+0000 7f2a55b9c700 1 --2- 172.21.15.37:0/220294312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a500cd1e0 0x7f2a500cd660 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f2a5006ef80 tx=0x7f2a48011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:57.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.883+0000 7f2a45ffb700 1 -- 172.21.15.37:0/220294312 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4800e040 con 0x7f2a500cd1e0 2023-07-14T15:58:57.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.883+0000 7f2a45ffb700 1 -- 172.21.15.37:0/220294312 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4800f040 con 0x7f2a500cd1e0 2023-07-14T15:58:57.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.883+0000 7f2a45ffb700 1 -- 172.21.15.37:0/220294312 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4800fdb0 con 0x7f2a500cd1e0 2023-07-14T15:58:57.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.883+0000 7f2a575ff700 1 -- 172.21.15.37:0/220294312 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a501e4590 con 0x7f2a500cd1e0 2023-07-14T15:58:57.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.883+0000 7f2a575ff700 1 -- 172.21.15.37:0/220294312 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a500c5ad0 con 0x7f2a500cd1e0 2023-07-14T15:58:57.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.884+0000 7f2a575ff700 1 -- 172.21.15.37:0/220294312 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a501e6e80 con 0x7f2a500cd1e0 2023-07-14T15:58:57.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.885+0000 7f2a45ffb700 1 -- 172.21.15.37:0/220294312 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f2a48022460 con 0x7f2a500cd1e0 2023-07-14T15:58:57.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.886+0000 7f2a45ffb700 1 --2- 172.21.15.37:0/220294312 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f2a3406ae00 0x7f2a3406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:57.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.886+0000 7f2a45ffb700 1 -- 172.21.15.37:0/220294312 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5324+0+0 (secure 0 0 0) 0x7f2a48089bd0 con 0x7f2a500cd1e0 2023-07-14T15:58:57.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.886+0000 7f2a5539b700 1 --2- 172.21.15.37:0/220294312 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f2a3406ae00 0x7f2a3406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:57.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.887+0000 7f2a5539b700 1 --2- 172.21.15.37:0/220294312 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f2a3406ae00 0x7f2a3406d2b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c007d10 tx=0x7f2a4c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:57.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:57.890+0000 7f2a45ffb700 1 -- 172.21.15.37:0/220294312 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2a501e6e80 con 0x7f2a500cd1e0 2023-07-14T15:58:58.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.100+0000 7f2a575ff700 1 -- 172.21.15.37:0/220294312 --> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f2a50065f80 con 0x7f2a3406ae00 2023-07-14T15:58:58.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.101+0000 7f2a45ffb700 1 -- 172.21.15.37:0/220294312 <== mgr.4100 v2:172.21.15.98:6832/3163748069 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2a4c001550 con 0x7f2a3406ae00 2023-07-14T15:58:58.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.103+0000 7f2a575ff700 1 -- 172.21.15.37:0/220294312 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f2a3406ae00 msgr2=0x7f2a3406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:58.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.103+0000 7f2a575ff700 1 --2- 172.21.15.37:0/220294312 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f2a3406ae00 0x7f2a3406d2b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c007d10 tx=0x7f2a4c009040 comp rx=0 tx=0).stop 2023-07-14T15:58:58.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.103+0000 7f2a575ff700 1 -- 172.21.15.37:0/220294312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a500cd1e0 msgr2=0x7f2a500cd660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:58.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.103+0000 7f2a575ff700 1 --2- 172.21.15.37:0/220294312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a500cd1e0 0x7f2a500cd660 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f2a5006ef80 tx=0x7f2a48011f80 comp rx=0 tx=0).stop 2023-07-14T15:58:58.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.103+0000 7f2a575ff700 1 -- 172.21.15.37:0/220294312 shutdown_connections 2023-07-14T15:58:58.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.103+0000 7f2a575ff700 1 --2- 172.21.15.37:0/220294312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a3c004850 0x7f2a5015a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:58.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.103+0000 7f2a575ff700 1 --2- 172.21.15.37:0/220294312 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f2a3406ae00 0x7f2a3406d2b0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:58.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.103+0000 7f2a575ff700 1 --2- 172.21.15.37:0/220294312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a500cd1e0 0x7f2a500cd660 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:58.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.103+0000 7f2a575ff700 1 --2- 172.21.15.37:0/220294312 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f2a500c99f0 0x7f2a501e4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:58.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.103+0000 7f2a575ff700 1 -- 172.21.15.37:0/220294312 >> 172.21.15.37:0/220294312 conn(0x7f2a50071410 msgr2=0x7f2a500717e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:58.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.104+0000 7f2a575ff700 1 -- 172.21.15.37:0/220294312 shutdown_connections 2023-07-14T15:58:58.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.104+0000 7f2a575ff700 1 -- 172.21.15.37:0/220294312 wait complete. 2023-07-14T15:58:58.090 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 3 to deep-scrub 2023-07-14T15:58:58.105 INFO:tasks.ceph:Scrubbing osd.4 2023-07-14T15:58:58.106 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-07-14T15:58:58.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.327+0000 7f3da9dff700 1 Processor -- start 2023-07-14T15:58:58.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.327+0000 7f3da9dff700 1 -- start start 2023-07-14T15:58:58.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.328+0000 7f3da9dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3da40cd890 0x7f3da40d09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:58.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.328+0000 7f3da9dff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3da40cf780 0x7f3da40cfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:58.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.328+0000 7f3da9dff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3da40d0140 con 0x7f3da41462d0 2023-07-14T15:58:58.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.328+0000 7f3da9dff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3da40cdd00 con 0x7f3da40cf780 2023-07-14T15:58:58.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.328+0000 7f3da9dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da40d1270 con 0x7f3da40cd890 2023-07-14T15:58:58.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.329+0000 7f3da3fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3da40cf780 0x7f3da40cfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:58.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.329+0000 7f3d9bfff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3da40cd890 0x7f3da40d09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:58.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.329+0000 7f3da3fff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f3da40cf780 0x7f3da40cfc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.37:46842/0 (socket says 172.21.15.37:46842) 2023-07-14T15:58:58.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.329+0000 7f3d9bfff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3da40cd890 0x7f3da40d09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3301/0 says I am v2:172.21.15.37:59796/0 (socket says 172.21.15.37:59796) 2023-07-14T15:58:58.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.329+0000 7f3da37fe700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f3da41462d0 0x7f3da40d2310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.37:53840/0 (socket says 172.21.15.37:53840) 2023-07-14T15:58:58.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.329+0000 7f3da3fff700 1 -- 172.21.15.37:0/1346235012 learned_addr learned my addr 172.21.15.37:0/1346235012 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:58.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.330+0000 7f3da3fff700 1 -- 172.21.15.37:0/1346235012 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3da40cd890 msgr2=0x7f3da40d09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:58.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.330+0000 7f3da3fff700 1 --2- 172.21.15.37:0/1346235012 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3da40cd890 0x7f3da40d09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:58.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.330+0000 7f3da3fff700 1 -- 172.21.15.37:0/1346235012 >> v1:172.21.15.98:6789/0 conn(0x7f3da41462d0 legacy=0x7f3da40d2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:58.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.330+0000 7f3da3fff700 1 -- 172.21.15.37:0/1346235012 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da40d1550 con 0x7f3da40cf780 2023-07-14T15:58:58.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.330+0000 7f3da3fff700 1 --2- 172.21.15.37:0/1346235012 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3da40cf780 0x7f3da40cfc00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c009e50 tx=0x7f3d9c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50a9447deefb9fd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:58.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.330+0000 7f3da2ffd700 1 -- 172.21.15.37:0/1346235012 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c00e070 con 0x7f3da40cf780 2023-07-14T15:58:58.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.330+0000 7f3da2ffd700 1 -- 172.21.15.37:0/1346235012 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9c00b910 con 0x7f3da40cf780 2023-07-14T15:58:58.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.330+0000 7f3da2ffd700 1 -- 172.21.15.37:0/1346235012 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c00bcc0 con 0x7f3da40cf780 2023-07-14T15:58:58.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.331+0000 7f3da9dff700 1 -- 172.21.15.37:0/1346235012 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3da40cf780 msgr2=0x7f3da40cfc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:58.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.331+0000 7f3da9dff700 1 --2- 172.21.15.37:0/1346235012 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3da40cf780 0x7f3da40cfc00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c009e50 tx=0x7f3d9c00b330 comp rx=0 tx=0).stop 2023-07-14T15:58:58.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.331+0000 7f3da9dff700 1 -- 172.21.15.37:0/1346235012 shutdown_connections 2023-07-14T15:58:58.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.331+0000 7f3da9dff700 1 --2- 172.21.15.37:0/1346235012 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3da40cf780 0x7f3da40cfc00 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:58.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.331+0000 7f3da9dff700 1 --2- 172.21.15.37:0/1346235012 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3da40cd890 0x7f3da40d09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:58.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.331+0000 7f3da9dff700 1 -- 172.21.15.37:0/1346235012 >> 172.21.15.37:0/1346235012 conn(0x7f3da406a4d0 msgr2=0x7f3da406a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:58.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.331+0000 7f3da9dff700 1 -- 172.21.15.37:0/1346235012 shutdown_connections 2023-07-14T15:58:58.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.331+0000 7f3da9dff700 1 -- 172.21.15.37:0/1346235012 wait complete. 2023-07-14T15:58:58.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.333+0000 7f3da9dff700 1 Processor -- start 2023-07-14T15:58:58.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.333+0000 7f3da9dff700 1 -- start start 2023-07-14T15:58:58.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.334+0000 7f3da9dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3da40cd890 0x7f3da40b5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:58.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.334+0000 7f3da9dff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3da40cf780 0x7f3da4158880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:58.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.334+0000 7f3da9dff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3da41462d0 0x7f3da40b2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:58.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.334+0000 7f3da9dff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da40caf60 con 0x7f3da41462d0 2023-07-14T15:58:58.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.334+0000 7f3da9dff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da40b3cc0 con 0x7f3da40cf780 2023-07-14T15:58:58.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.334+0000 7f3da9dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da40b3140 con 0x7f3da40cd890 2023-07-14T15:58:58.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.334+0000 7f3da3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3da41462d0 0x7f3da40b2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:58.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.334+0000 7f3da3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3da41462d0 0x7f3da40b2860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36376/0 (socket says 172.21.15.37:36376) 2023-07-14T15:58:58.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.334+0000 7f3da3fff700 1 -- 172.21.15.37:0/2971499018 learned_addr learned my addr 172.21.15.37:0/2971499018 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:58.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.334+0000 7f3d9bfff700 1 --2- 172.21.15.37:0/2971499018 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3da40cf780 0x7f3da4158880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:58.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.334+0000 7f3da37fe700 1 --2- 172.21.15.37:0/2971499018 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3da40cd890 0x7f3da40b5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:58.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.334+0000 7f3da3fff700 1 -- 172.21.15.37:0/2971499018 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3da40cd890 msgr2=0x7f3da40b5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:58.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.334+0000 7f3da3fff700 1 --2- 172.21.15.37:0/2971499018 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f3da40cd890 0x7f3da40b5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:58.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.334+0000 7f3da3fff700 1 -- 172.21.15.37:0/2971499018 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3da40cf780 msgr2=0x7f3da4158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:58.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.334+0000 7f3da3fff700 1 --2- 172.21.15.37:0/2971499018 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3da40cf780 0x7f3da4158880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:58.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.334+0000 7f3da3fff700 1 -- 172.21.15.37:0/2971499018 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d9c009b30 con 0x7f3da41462d0 2023-07-14T15:58:58.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.335+0000 7f3da3fff700 1 --2- 172.21.15.37:0/2971499018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3da41462d0 0x7f3da40b2860 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f3da40b59f0 tx=0x7f3d9c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:58.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.335+0000 7f3da0ff9700 1 -- 172.21.15.37:0/2971499018 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c003ea0 con 0x7f3da41462d0 2023-07-14T15:58:58.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.335+0000 7f3da0ff9700 1 -- 172.21.15.37:0/2971499018 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9c0099b0 con 0x7f3da41462d0 2023-07-14T15:58:58.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.335+0000 7f3da9dff700 1 -- 172.21.15.37:0/2971499018 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3da40b3420 con 0x7f3da41462d0 2023-07-14T15:58:58.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.335+0000 7f3da0ff9700 1 -- 172.21.15.37:0/2971499018 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c01c680 con 0x7f3da41462d0 2023-07-14T15:58:58.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.335+0000 7f3da9dff700 1 -- 172.21.15.37:0/2971499018 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da40b39e0 con 0x7f3da41462d0 2023-07-14T15:58:58.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.336+0000 7f3da9dff700 1 -- 172.21.15.37:0/2971499018 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3da40d1b10 con 0x7f3da41462d0 2023-07-14T15:58:58.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.337+0000 7f3da0ff9700 1 -- 172.21.15.37:0/2971499018 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f3d9c01c7e0 con 0x7f3da41462d0 2023-07-14T15:58:58.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.338+0000 7f3da0ff9700 1 --2- 172.21.15.37:0/2971499018 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f3d8406ae00 0x7f3d8406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:58.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.338+0000 7f3da0ff9700 1 -- 172.21.15.37:0/2971499018 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5324+0+0 (secure 0 0 0) 0x7f3d9c08b940 con 0x7f3da41462d0 2023-07-14T15:58:58.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.338+0000 7f3da0ff9700 1 --2- 172.21.15.37:0/2971499018 >> [v2:172.21.15.98:6800/3529020407,v1:172.21.15.98:6801/3529020407] conn(0x7f3d84071270 0x7f3d840736a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:58.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.338+0000 7f3da0ff9700 1 -- 172.21.15.37:0/2971499018 --> [v2:172.21.15.98:6800/3529020407,v1:172.21.15.98:6801/3529020407] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3d84073d70 con 0x7f3d84071270 2023-07-14T15:58:58.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.338+0000 7f3da0ff9700 1 -- 172.21.15.37:0/2971499018 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d9c08bcb0 con 0x7f3da41462d0 2023-07-14T15:58:58.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.339+0000 7f3da37fe700 1 --2- 172.21.15.37:0/2971499018 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f3d8406ae00 0x7f3d8406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:58.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.339+0000 7f3d9bfff700 1 --2- 172.21.15.37:0/2971499018 >> [v2:172.21.15.98:6800/3529020407,v1:172.21.15.98:6801/3529020407] conn(0x7f3d84071270 0x7f3d840736a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:58.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.339+0000 7f3da37fe700 1 --2- 172.21.15.37:0/2971499018 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f3d8406ae00 0x7f3d8406d2b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3da40b58a0 tx=0x7f3d94007d70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:58.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.340+0000 7f3d9bfff700 1 --2- 172.21.15.37:0/2971499018 >> [v2:172.21.15.98:6800/3529020407,v1:172.21.15.98:6801/3529020407] conn(0x7f3d84071270 0x7f3d840736a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:58.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.340+0000 7f3da0ff9700 1 -- 172.21.15.37:0/2971499018 <== osd.4 v2:172.21.15.98:6800/3529020407 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f3d84073d70 con 0x7f3d84071270 2023-07-14T15:58:58.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.356+0000 7f3da9dff700 1 -- 172.21.15.37:0/2971499018 --> [v2:172.21.15.98:6800/3529020407,v1:172.21.15.98:6801/3529020407] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3da40d1830 con 0x7f3d84071270 2023-07-14T15:58:58.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.356+0000 7f3da0ff9700 1 -- 172.21.15.37:0/2971499018 <== osd.4 v2:172.21.15.98:6800/3529020407 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f3d8c009d50 con 0x7f3d84071270 2023-07-14T15:58:58.340 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-14T15:58:58.341 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-14T15:58:58.341 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-14T15:58:58.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.356+0000 7f3da9dff700 1 -- 172.21.15.37:0/2971499018 >> [v2:172.21.15.98:6800/3529020407,v1:172.21.15.98:6801/3529020407] conn(0x7f3d84071270 msgr2=0x7f3d840736a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:58.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.356+0000 7f3da9dff700 1 --2- 172.21.15.37:0/2971499018 >> [v2:172.21.15.98:6800/3529020407,v1:172.21.15.98:6801/3529020407] conn(0x7f3d84071270 0x7f3d840736a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:58.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.357+0000 7f3da9dff700 1 -- 172.21.15.37:0/2971499018 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f3d8406ae00 msgr2=0x7f3d8406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:58.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.357+0000 7f3da9dff700 1 --2- 172.21.15.37:0/2971499018 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f3d8406ae00 0x7f3d8406d2b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3da40b58a0 tx=0x7f3d94007d70 comp rx=0 tx=0).stop 2023-07-14T15:58:58.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.357+0000 7f3da9dff700 1 -- 172.21.15.37:0/2971499018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3da41462d0 msgr2=0x7f3da40b2860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:58.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.357+0000 7f3da9dff700 1 --2- 172.21.15.37:0/2971499018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3da41462d0 0x7f3da40b2860 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f3da40b59f0 tx=0x7f3d9c004ad0 comp rx=0 tx=0).stop 2023-07-14T15:58:58.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.357+0000 7f3da3fff700 1 -- 172.21.15.37:0/2971499018 reap_dead start 2023-07-14T15:58:58.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.357+0000 7f3da9dff700 1 -- 172.21.15.37:0/2971499018 shutdown_connections 2023-07-14T15:58:58.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.357+0000 7f3da9dff700 1 -- 172.21.15.37:0/2971499018 >> 172.21.15.37:0/2971499018 conn(0x7f3da406a4d0 msgr2=0x7f3da40b83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:58.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.357+0000 7f3da9dff700 1 -- 172.21.15.37:0/2971499018 shutdown_connections 2023-07-14T15:58:58.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.357+0000 7f3da9dff700 1 -- 172.21.15.37:0/2971499018 wait complete. 2023-07-14T15:58:58.357 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-07-14T15:58:58.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.575+0000 7fa0b4bff700 1 Processor -- start 2023-07-14T15:58:58.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.575+0000 7fa0b4bff700 1 -- start start 2023-07-14T15:58:58.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.576+0000 7fa0b4bff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa0b00d15c0 0x7fa0b00cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:58.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.576+0000 7fa0b4bff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fa0b00b0ae0 0x7fa0b00b5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:58.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.576+0000 7fa0b4bff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0b00cdb50 con 0x7fa0b00b8900 2023-07-14T15:58:58.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.576+0000 7fa0b4bff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0b015d030 con 0x7fa0b00d15c0 2023-07-14T15:58:58.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.577+0000 7fa0b4bff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0b00cde30 con 0x7fa0b00b0ae0 2023-07-14T15:58:58.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.577+0000 7fa0ae59c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa0b00b8900 0x7fa0b00d0eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57376/0 (socket says 172.21.15.37:57376) 2023-07-14T15:58:58.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.577+0000 7fa0ae59c700 1 -- 172.21.15.37:0/3459472675 learned_addr learned my addr 172.21.15.37:0/3459472675 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:58:58.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.577+0000 7fa0a7fff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa0b00d15c0 0x7fa0b00cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:58.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.577+0000 7fa0aed9d700 1 --2- 172.21.15.37:0/3459472675 >> v2:172.21.15.98:3300/0 conn(0x7fa0b00b0ae0 0x7fa0b00b5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:58.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.577+0000 7fa0add9b700 1 -- 172.21.15.37:0/3459472675 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3790720807 0 0) 0x7fa0b00cdb50 con 0x7fa0b00b8900 2023-07-14T15:58:58.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.577+0000 7fa0add9b700 1 -- 172.21.15.37:0/3459472675 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa09c0035b0 con 0x7fa0b00b8900 2023-07-14T15:58:58.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.577+0000 7fa0a7fff700 1 -- 172.21.15.37:0/3459472675 >> v2:172.21.15.98:3300/0 conn(0x7fa0b00b0ae0 msgr2=0x7fa0b00b5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:58.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.577+0000 7fa0a7fff700 1 --2- 172.21.15.37:0/3459472675 >> v2:172.21.15.98:3300/0 conn(0x7fa0b00b0ae0 0x7fa0b00b5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:58.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.577+0000 7fa0a7fff700 1 -- 172.21.15.37:0/3459472675 >> v1:172.21.15.37:6789/0 conn(0x7fa0b00b8900 legacy=0x7fa0b00d0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:58.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.577+0000 7fa0a7fff700 1 -- 172.21.15.37:0/3459472675 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b00ce110 con 0x7fa0b00d15c0 2023-07-14T15:58:58.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.578+0000 7fa0a7fff700 1 --2- 172.21.15.37:0/3459472675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0b00d15c0 0x7fa0b00cd570 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fa0b006ce50 tx=0x7fa098009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfddc50011ed57b5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:58.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.578+0000 7fa0add9b700 1 -- 172.21.15.37:0/3459472675 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa098011830 con 0x7fa0b00d15c0 2023-07-14T15:58:58.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.578+0000 7fa0add9b700 1 -- 172.21.15.37:0/3459472675 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa098011990 con 0x7fa0b00d15c0 2023-07-14T15:58:58.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.578+0000 7fa0add9b700 1 -- 172.21.15.37:0/3459472675 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa098011d20 con 0x7fa0b00d15c0 2023-07-14T15:58:58.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.578+0000 7fa0b4bff700 1 -- 172.21.15.37:0/3459472675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0b00d15c0 msgr2=0x7fa0b00cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:58.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.578+0000 7fa0b4bff700 1 --2- 172.21.15.37:0/3459472675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0b00d15c0 0x7fa0b00cd570 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fa0b006ce50 tx=0x7fa098009b20 comp rx=0 tx=0).stop 2023-07-14T15:58:58.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.578+0000 7fa0b4bff700 1 -- 172.21.15.37:0/3459472675 shutdown_connections 2023-07-14T15:58:58.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.578+0000 7fa0b4bff700 1 --2- 172.21.15.37:0/3459472675 >> v2:172.21.15.98:3300/0 conn(0x7fa0b00b0ae0 0x7fa0b00b5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:58.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.578+0000 7fa0b4bff700 1 --2- 172.21.15.37:0/3459472675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0b00d15c0 0x7fa0b00cd570 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:58.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.578+0000 7fa0b4bff700 1 -- 172.21.15.37:0/3459472675 >> 172.21.15.37:0/3459472675 conn(0x7fa0b009c1e0 msgr2=0x7fa0b00d2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:58.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.579+0000 7fa0b4bff700 1 -- 172.21.15.37:0/3459472675 shutdown_connections 2023-07-14T15:58:58.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.579+0000 7fa0b4bff700 1 -- 172.21.15.37:0/3459472675 wait complete. 2023-07-14T15:58:58.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.580+0000 7fa0b4bff700 1 Processor -- start 2023-07-14T15:58:58.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.580+0000 7fa0b4bff700 1 -- start start 2023-07-14T15:58:58.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.581+0000 7fa0b4bff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa0b00b0ae0 0x7fa0b01f3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:58.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.581+0000 7fa0b4bff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0b00b8900 0x7fa0b01f5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:58.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.581+0000 7fa0b4bff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa0b00d15c0 0x7fa0b00b2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:58.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.581+0000 7fa0b4bff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b00b2f40 con 0x7fa0b00b8900 2023-07-14T15:58:58.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.581+0000 7fa0b4bff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b00b2c60 con 0x7fa0b00b0ae0 2023-07-14T15:58:58.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.581+0000 7fa0b4bff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b015e7b0 con 0x7fa0b00d15c0 2023-07-14T15:58:58.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.582+0000 7fa0a7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0b00b8900 0x7fa0b01f5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:58.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.582+0000 7fa0a7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0b00b8900 0x7fa0b01f5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36396/0 (socket says 172.21.15.37:36396) 2023-07-14T15:58:58.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.582+0000 7fa0a7fff700 1 -- 172.21.15.37:0/2471806524 learned_addr learned my addr 172.21.15.37:0/2471806524 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:58.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.582+0000 7fa0ae59c700 1 --2- 172.21.15.37:0/2471806524 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa0b00b0ae0 0x7fa0b01f3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:58.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.582+0000 7fa0aed9d700 1 --2- 172.21.15.37:0/2471806524 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa0b00d15c0 0x7fa0b00b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:58.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.582+0000 7fa0a7fff700 1 -- 172.21.15.37:0/2471806524 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa0b00d15c0 msgr2=0x7fa0b00b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:58.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.582+0000 7fa0a7fff700 1 --2- 172.21.15.37:0/2471806524 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa0b00d15c0 0x7fa0b00b2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:58.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.582+0000 7fa0a7fff700 1 -- 172.21.15.37:0/2471806524 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa0b00b0ae0 msgr2=0x7fa0b01f3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:58.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.582+0000 7fa0a7fff700 1 --2- 172.21.15.37:0/2471806524 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa0b00b0ae0 0x7fa0b01f3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:58.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.582+0000 7fa0a7fff700 1 -- 172.21.15.37:0/2471806524 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0980094a0 con 0x7fa0b00b8900 2023-07-14T15:58:58.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.582+0000 7fa0aed9d700 1 --2- 172.21.15.37:0/2471806524 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa0b00d15c0 0x7fa0b00b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:58:58.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.582+0000 7fa0a7fff700 1 --2- 172.21.15.37:0/2471806524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0b00b8900 0x7fa0b01f5180 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fa098009b60 tx=0x7fa098004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:58.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.583+0000 7fa0a6ffd700 1 -- 172.21.15.37:0/2471806524 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0980036a0 con 0x7fa0b00b8900 2023-07-14T15:58:58.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.583+0000 7fa0a6ffd700 1 -- 172.21.15.37:0/2471806524 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa09801e070 con 0x7fa0b00b8900 2023-07-14T15:58:58.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.583+0000 7fa0a6ffd700 1 -- 172.21.15.37:0/2471806524 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa098003a20 con 0x7fa0b00b8900 2023-07-14T15:58:58.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.583+0000 7fa0b4bff700 1 -- 172.21.15.37:0/2471806524 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0b015ea90 con 0x7fa0b00b8900 2023-07-14T15:58:58.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.583+0000 7fa0b4bff700 1 -- 172.21.15.37:0/2471806524 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0b01f3090 con 0x7fa0b00b8900 2023-07-14T15:58:58.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.584+0000 7fa0b4bff700 1 -- 172.21.15.37:0/2471806524 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0b015e8f0 con 0x7fa0b00b8900 2023-07-14T15:58:58.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.585+0000 7fa0a6ffd700 1 -- 172.21.15.37:0/2471806524 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fa098003b80 con 0x7fa0b00b8900 2023-07-14T15:58:58.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.586+0000 7fa0a6ffd700 1 --2- 172.21.15.37:0/2471806524 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa09006ae00 0x7fa09006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:58.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.586+0000 7fa0a6ffd700 1 -- 172.21.15.37:0/2471806524 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5324+0+0 (secure 0 0 0) 0x7fa09808a1f0 con 0x7fa0b00b8900 2023-07-14T15:58:58.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.586+0000 7fa0ae59c700 1 --2- 172.21.15.37:0/2471806524 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa09006ae00 0x7fa09006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:58.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.587+0000 7fa0ae59c700 1 --2- 172.21.15.37:0/2471806524 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa09006ae00 0x7fa09006d2b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa0a00010e0 tx=0x7fa0a0007c70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:58.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.590+0000 7fa0a6ffd700 1 -- 172.21.15.37:0/2471806524 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa0b015e8f0 con 0x7fa0b00b8900 2023-07-14T15:58:58.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.800+0000 7fa0b4bff700 1 -- 172.21.15.37:0/2471806524 --> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fa0b00ce6d0 con 0x7fa09006ae00 2023-07-14T15:58:58.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.801+0000 7fa0a6ffd700 1 -- 172.21.15.37:0/2471806524 <== mgr.4100 v2:172.21.15.98:6832/3163748069 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa0a0005830 con 0x7fa09006ae00 2023-07-14T15:58:58.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.804+0000 7fa0b4bff700 1 -- 172.21.15.37:0/2471806524 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa09006ae00 msgr2=0x7fa09006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:58.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.804+0000 7fa0b4bff700 1 --2- 172.21.15.37:0/2471806524 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa09006ae00 0x7fa09006d2b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa0a00010e0 tx=0x7fa0a0007c70 comp rx=0 tx=0).stop 2023-07-14T15:58:58.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.804+0000 7fa0b4bff700 1 -- 172.21.15.37:0/2471806524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0b00b8900 msgr2=0x7fa0b01f5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:58.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.804+0000 7fa0b4bff700 1 --2- 172.21.15.37:0/2471806524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0b00b8900 0x7fa0b01f5180 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fa098009b60 tx=0x7fa098004750 comp rx=0 tx=0).stop 2023-07-14T15:58:58.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.804+0000 7fa0b4bff700 1 -- 172.21.15.37:0/2471806524 shutdown_connections 2023-07-14T15:58:58.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.804+0000 7fa0b4bff700 1 --2- 172.21.15.37:0/2471806524 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa0b00b0ae0 0x7fa0b01f3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:58.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.804+0000 7fa0b4bff700 1 --2- 172.21.15.37:0/2471806524 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fa09006ae00 0x7fa09006d2b0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:58.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.804+0000 7fa0b4bff700 1 --2- 172.21.15.37:0/2471806524 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fa0b00d15c0 0x7fa0b00b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:58.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.804+0000 7fa0b4bff700 1 --2- 172.21.15.37:0/2471806524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0b00b8900 0x7fa0b01f5180 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:58.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.804+0000 7fa0b4bff700 1 -- 172.21.15.37:0/2471806524 >> 172.21.15.37:0/2471806524 conn(0x7fa0b009c1e0 msgr2=0x7fa0b00b79b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:58.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.804+0000 7fa0b4bff700 1 -- 172.21.15.37:0/2471806524 shutdown_connections 2023-07-14T15:58:58.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:58.804+0000 7fa0b4bff700 1 -- 172.21.15.37:0/2471806524 wait complete. 2023-07-14T15:58:58.790 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 4 to deep-scrub 2023-07-14T15:58:58.806 INFO:tasks.ceph:Scrubbing osd.5 2023-07-14T15:58:58.806 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-07-14T15:58:58.962 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T15:58:58.967 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T15:58:59.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.031+0000 7f91415ff700 1 Processor -- start 2023-07-14T15:58:59.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.031+0000 7f91415ff700 1 -- start start 2023-07-14T15:58:59.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.032+0000 7f91415ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f913c1462d0 0x7f913c0cd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:59.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.033+0000 7f91415ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f913c0cf780 0x7f913c0cfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:59.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.033+0000 7f91415ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f913c0d0120 con 0x7f913c0d2310 2023-07-14T15:58:59.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.033+0000 7f91415ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f913c0d1270 con 0x7f913c1462d0 2023-07-14T15:58:59.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.033+0000 7f91415ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f913c0d1550 con 0x7f913c0cf780 2023-07-14T15:58:59.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.033+0000 7f9133fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f913c0d2310 0x7f913c0d09d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57386/0 (socket says 172.21.15.37:57386) 2023-07-14T15:58:59.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.033+0000 7f9133fff700 1 -- 172.21.15.37:0/4014492580 learned_addr learned my addr 172.21.15.37:0/4014492580 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:58:59.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.033+0000 7f913affd700 1 --2- 172.21.15.37:0/4014492580 >> v2:172.21.15.98:3300/0 conn(0x7f913c1462d0 0x7f913c0cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:59.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.033+0000 7f913b7fe700 1 --2- 172.21.15.37:0/4014492580 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f913c0cf780 0x7f913c0cfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:59.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.033+0000 7f913a7fc700 1 -- 172.21.15.37:0/4014492580 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3056805618 0 0) 0x7f913c0d0120 con 0x7f913c0d2310 2023-07-14T15:58:59.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.033+0000 7f913a7fc700 1 -- 172.21.15.37:0/4014492580 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91280035b0 con 0x7f913c0d2310 2023-07-14T15:58:59.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.034+0000 7f913b7fe700 1 -- 172.21.15.37:0/4014492580 >> v2:172.21.15.98:3300/0 conn(0x7f913c1462d0 msgr2=0x7f913c0cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:59.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.034+0000 7f913b7fe700 1 --2- 172.21.15.37:0/4014492580 >> v2:172.21.15.98:3300/0 conn(0x7f913c1462d0 0x7f913c0cd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:59.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.034+0000 7f913b7fe700 1 -- 172.21.15.37:0/4014492580 >> v1:172.21.15.37:6789/0 conn(0x7f913c0d2310 legacy=0x7f913c0d09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:59.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.034+0000 7f913b7fe700 1 -- 172.21.15.37:0/4014492580 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f913c0d1830 con 0x7f913c0cf780 2023-07-14T15:58:59.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.034+0000 7f913affd700 1 --2- 172.21.15.37:0/4014492580 >> v2:172.21.15.98:3300/0 conn(0x7f913c1462d0 0x7f913c0cd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:58:59.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.034+0000 7f913b7fe700 1 --2- 172.21.15.37:0/4014492580 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f913c0cf780 0x7f913c0cfbe0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9134009d90 tx=0x7f913400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3aac64b7ad6004ac server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:59.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.034+0000 7f913a7fc700 1 -- 172.21.15.37:0/4014492580 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913400e070 con 0x7f913c0cf780 2023-07-14T15:58:59.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.034+0000 7f913a7fc700 1 -- 172.21.15.37:0/4014492580 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913400bb20 con 0x7f913c0cf780 2023-07-14T15:58:59.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.034+0000 7f913a7fc700 1 -- 172.21.15.37:0/4014492580 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913400be90 con 0x7f913c0cf780 2023-07-14T15:58:59.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.035+0000 7f91415ff700 1 -- 172.21.15.37:0/4014492580 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f913c0cf780 msgr2=0x7f913c0cfbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:59.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.035+0000 7f91415ff700 1 --2- 172.21.15.37:0/4014492580 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f913c0cf780 0x7f913c0cfbe0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9134009d90 tx=0x7f913400b330 comp rx=0 tx=0).stop 2023-07-14T15:58:59.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.035+0000 7f91415ff700 1 -- 172.21.15.37:0/4014492580 shutdown_connections 2023-07-14T15:58:59.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.035+0000 7f91415ff700 1 --2- 172.21.15.37:0/4014492580 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f913c0cf780 0x7f913c0cfbe0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:59.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.035+0000 7f91415ff700 1 --2- 172.21.15.37:0/4014492580 >> v2:172.21.15.98:3300/0 conn(0x7f913c1462d0 0x7f913c0cd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:59.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.035+0000 7f91415ff700 1 -- 172.21.15.37:0/4014492580 >> 172.21.15.37:0/4014492580 conn(0x7f913c06a4d0 msgr2=0x7f913c06a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:59.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.035+0000 7f91415ff700 1 -- 172.21.15.37:0/4014492580 shutdown_connections 2023-07-14T15:58:59.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.035+0000 7f91415ff700 1 -- 172.21.15.37:0/4014492580 wait complete. 2023-07-14T15:58:59.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.038+0000 7f91415ff700 1 Processor -- start 2023-07-14T15:58:59.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.038+0000 7f91415ff700 1 -- start start 2023-07-14T15:58:59.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.040+0000 7f91415ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f913c0cf780 0x7f913c0c23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:59.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.040+0000 7f91415ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f913c0d2310 0x7f913c0b2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:59.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.040+0000 7f91415ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f913c1462d0 0x7f913c0b2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:59.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.040+0000 7f91415ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913c153720 con 0x7f913c0d2310 2023-07-14T15:58:59.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.040+0000 7f91415ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913c0c8540 con 0x7f913c1462d0 2023-07-14T15:58:59.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.040+0000 7f91415ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f913c0c8820 con 0x7f913c0cf780 2023-07-14T15:58:59.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.040+0000 7f9133fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f913c0d2310 0x7f913c0b2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:59.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.040+0000 7f9133fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f913c0d2310 0x7f913c0b2860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36398/0 (socket says 172.21.15.37:36398) 2023-07-14T15:58:59.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.040+0000 7f9133fff700 1 -- 172.21.15.37:0/2873438165 learned_addr learned my addr 172.21.15.37:0/2873438165 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:59.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.040+0000 7f913affd700 1 --2- 172.21.15.37:0/2873438165 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f913c0cf780 0x7f913c0c23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:59.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.040+0000 7f913b7fe700 1 --2- 172.21.15.37:0/2873438165 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f913c1462d0 0x7f913c0b2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:59.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.040+0000 7f9133fff700 1 -- 172.21.15.37:0/2873438165 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f913c0cf780 msgr2=0x7f913c0c23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:59.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.040+0000 7f9133fff700 1 --2- 172.21.15.37:0/2873438165 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f913c0cf780 0x7f913c0c23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:59.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.040+0000 7f9133fff700 1 -- 172.21.15.37:0/2873438165 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f913c1462d0 msgr2=0x7f913c0b2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:59.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.040+0000 7f9133fff700 1 --2- 172.21.15.37:0/2873438165 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f913c1462d0 0x7f913c0b2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:59.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.040+0000 7f9133fff700 1 -- 172.21.15.37:0/2873438165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f912c0094a0 con 0x7f913c0d2310 2023-07-14T15:58:59.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.041+0000 7f9133fff700 1 --2- 172.21.15.37:0/2873438165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f913c0d2310 0x7f913c0b2860 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f912400c4d0 tx=0x7f912400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:59.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.041+0000 7f91337fe700 1 -- 172.21.15.37:0/2873438165 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9124005d70 con 0x7f913c0d2310 2023-07-14T15:58:59.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.041+0000 7f91337fe700 1 -- 172.21.15.37:0/2873438165 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91240070d0 con 0x7f913c0d2310 2023-07-14T15:58:59.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.041+0000 7f91337fe700 1 -- 172.21.15.37:0/2873438165 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9124007440 con 0x7f913c0d2310 2023-07-14T15:58:59.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.041+0000 7f91415ff700 1 -- 172.21.15.37:0/2873438165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9134009a70 con 0x7f913c0d2310 2023-07-14T15:58:59.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.041+0000 7f91415ff700 1 -- 172.21.15.37:0/2873438165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f913c0c8de0 con 0x7f913c0d2310 2023-07-14T15:58:59.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.042+0000 7f91415ff700 1 -- 172.21.15.37:0/2873438165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f913c0d1df0 con 0x7f913c0d2310 2023-07-14T15:58:59.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.043+0000 7f91337fe700 1 -- 172.21.15.37:0/2873438165 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f91240075a0 con 0x7f913c0d2310 2023-07-14T15:58:59.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.044+0000 7f91337fe700 1 --2- 172.21.15.37:0/2873438165 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f911c06ae00 0x7f911c06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:59.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.044+0000 7f91337fe700 1 -- 172.21.15.37:0/2873438165 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5324+0+0 (secure 0 0 0) 0x7f9124088680 con 0x7f913c0d2310 2023-07-14T15:58:59.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.044+0000 7f91337fe700 1 --2- 172.21.15.37:0/2873438165 >> [v2:172.21.15.98:6817/2311501838,v1:172.21.15.98:6819/2311501838] conn(0x7f911c071270 0x7f911c0736a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:59.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.044+0000 7f91337fe700 1 -- 172.21.15.37:0/2873438165 --> [v2:172.21.15.98:6817/2311501838,v1:172.21.15.98:6819/2311501838] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f911c073d70 con 0x7f911c071270 2023-07-14T15:58:59.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.044+0000 7f91337fe700 1 -- 172.21.15.37:0/2873438165 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f912408ac00 con 0x7f913c0d2310 2023-07-14T15:58:59.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.044+0000 7f913affd700 1 --2- 172.21.15.37:0/2873438165 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f911c06ae00 0x7f911c06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:59.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.045+0000 7f913b7fe700 1 --2- 172.21.15.37:0/2873438165 >> [v2:172.21.15.98:6817/2311501838,v1:172.21.15.98:6819/2311501838] conn(0x7f911c071270 0x7f911c0736a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:59.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.045+0000 7f913affd700 1 --2- 172.21.15.37:0/2873438165 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f911c06ae00 0x7f911c06d2b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f913c0b5890 tx=0x7f912c009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:59.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.045+0000 7f913b7fe700 1 --2- 172.21.15.37:0/2873438165 >> [v2:172.21.15.98:6817/2311501838,v1:172.21.15.98:6819/2311501838] conn(0x7f911c071270 0x7f911c0736a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:59.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.046+0000 7f91337fe700 1 -- 172.21.15.37:0/2873438165 <== osd.5 v2:172.21.15.98:6817/2311501838 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f911c073d70 con 0x7f911c071270 2023-07-14T15:58:59.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.062+0000 7f91415ff700 1 -- 172.21.15.37:0/2873438165 --> [v2:172.21.15.98:6817/2311501838,v1:172.21.15.98:6819/2311501838] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f913c0d1b10 con 0x7f911c071270 2023-07-14T15:58:59.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.062+0000 7f91337fe700 1 -- 172.21.15.37:0/2873438165 <== osd.5 v2:172.21.15.98:6817/2311501838 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f9134003a20 con 0x7f911c071270 2023-07-14T15:58:59.047 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-14T15:58:59.048 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-14T15:58:59.048 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-14T15:58:59.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.063+0000 7f91415ff700 1 -- 172.21.15.37:0/2873438165 >> [v2:172.21.15.98:6817/2311501838,v1:172.21.15.98:6819/2311501838] conn(0x7f911c071270 msgr2=0x7f911c0736a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:59.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.063+0000 7f91415ff700 1 --2- 172.21.15.37:0/2873438165 >> [v2:172.21.15.98:6817/2311501838,v1:172.21.15.98:6819/2311501838] conn(0x7f911c071270 0x7f911c0736a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:59.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.063+0000 7f91415ff700 1 -- 172.21.15.37:0/2873438165 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f911c06ae00 msgr2=0x7f911c06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:59.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.063+0000 7f91415ff700 1 --2- 172.21.15.37:0/2873438165 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f911c06ae00 0x7f911c06d2b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f913c0b5890 tx=0x7f912c009210 comp rx=0 tx=0).stop 2023-07-14T15:58:59.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.063+0000 7f91415ff700 1 -- 172.21.15.37:0/2873438165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f913c0d2310 msgr2=0x7f913c0b2860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:59.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.063+0000 7f91415ff700 1 --2- 172.21.15.37:0/2873438165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f913c0d2310 0x7f913c0b2860 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f912400c4d0 tx=0x7f912400c7e0 comp rx=0 tx=0).stop 2023-07-14T15:58:59.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.063+0000 7f913b7fe700 1 -- 172.21.15.37:0/2873438165 reap_dead start 2023-07-14T15:58:59.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.063+0000 7f91415ff700 1 -- 172.21.15.37:0/2873438165 shutdown_connections 2023-07-14T15:58:59.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.063+0000 7f91415ff700 1 -- 172.21.15.37:0/2873438165 >> 172.21.15.37:0/2873438165 conn(0x7f913c06a4d0 msgr2=0x7f913c0b2080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:59.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.063+0000 7f91415ff700 1 -- 172.21.15.37:0/2873438165 shutdown_connections 2023-07-14T15:58:59.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.063+0000 7f91415ff700 1 -- 172.21.15.37:0/2873438165 wait complete. 2023-07-14T15:58:59.065 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-07-14T15:58:59.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.285+0000 7f160cfff700 1 Processor -- start 2023-07-14T15:58:59.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.285+0000 7f160cfff700 1 -- start start 2023-07-14T15:58:59.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.286+0000 7f160cfff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f160815ec90 0x7f16080cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:59.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.286+0000 7f160cfff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f160806d8b0 0x7f16080cba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:59.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.286+0000 7f160cfff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16080718a0 con 0x7f160815dfe0 2023-07-14T15:58:59.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.286+0000 7f160cfff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f160815a8d0 con 0x7f160815ec90 2023-07-14T15:58:59.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.286+0000 7f160cfff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1608070c90 con 0x7f160806d8b0 2023-07-14T15:58:59.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.286+0000 7f160659c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f160815ec90 0x7f16080cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:59.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.286+0000 7f160659c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f160815ec90 0x7f16080cb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36414/0 (socket says 172.21.15.37:36414) 2023-07-14T15:58:59.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.286+0000 7f1606d9d700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f160815dfe0 0x7f160806b120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57388/0 (socket says 172.21.15.37:57388) 2023-07-14T15:58:59.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.286+0000 7f160659c700 1 -- 172.21.15.37:0/1666837177 learned_addr learned my addr 172.21.15.37:0/1666837177 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:59.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.287+0000 7f1605d9b700 1 --2- 172.21.15.37:0/1666837177 >> v2:172.21.15.98:3300/0 conn(0x7f160806d8b0 0x7f16080cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:59.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.287+0000 7f160659c700 1 -- 172.21.15.37:0/1666837177 >> v2:172.21.15.98:3300/0 conn(0x7f160806d8b0 msgr2=0x7f16080cba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:59.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.287+0000 7f160659c700 1 --2- 172.21.15.37:0/1666837177 >> v2:172.21.15.98:3300/0 conn(0x7f160806d8b0 0x7f16080cba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:59.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.287+0000 7f160659c700 1 -- 172.21.15.37:0/1666837177 >> v1:172.21.15.37:6789/0 conn(0x7f160815dfe0 legacy=0x7f160806b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:59.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.287+0000 7f160559a700 1 -- 172.21.15.37:0/1666837177 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1433888537 0 0) 0x7f16080718a0 con 0x7f160815dfe0 2023-07-14T15:58:59.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.287+0000 7f160659c700 1 -- 172.21.15.37:0/1666837177 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1608070f70 con 0x7f160815ec90 2023-07-14T15:58:59.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.287+0000 7f160659c700 1 --2- 172.21.15.37:0/1666837177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f160815ec90 0x7f16080cb4e0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f16080ce940 tx=0x7f15f8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f6950ab18ba8cf4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:59.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.287+0000 7f160559a700 1 -- 172.21.15.37:0/1666837177 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f8011830 con 0x7f160815ec90 2023-07-14T15:58:59.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.288+0000 7f160559a700 1 -- 172.21.15.37:0/1666837177 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f8011990 con 0x7f160815ec90 2023-07-14T15:58:59.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.288+0000 7f160559a700 1 -- 172.21.15.37:0/1666837177 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f8011d20 con 0x7f160815ec90 2023-07-14T15:58:59.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.288+0000 7f160cfff700 1 -- 172.21.15.37:0/1666837177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f160815ec90 msgr2=0x7f16080cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:59.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.288+0000 7f160cfff700 1 --2- 172.21.15.37:0/1666837177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f160815ec90 0x7f16080cb4e0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f16080ce940 tx=0x7f15f8009bd0 comp rx=0 tx=0).stop 2023-07-14T15:58:59.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.288+0000 7f160cfff700 1 -- 172.21.15.37:0/1666837177 shutdown_connections 2023-07-14T15:58:59.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.288+0000 7f160cfff700 1 --2- 172.21.15.37:0/1666837177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f160815ec90 0x7f16080cb4e0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:59.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.288+0000 7f160cfff700 1 --2- 172.21.15.37:0/1666837177 >> v2:172.21.15.98:3300/0 conn(0x7f160806d8b0 0x7f16080cba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:59.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.288+0000 7f160cfff700 1 -- 172.21.15.37:0/1666837177 >> 172.21.15.37:0/1666837177 conn(0x7f16080b0620 msgr2=0x7f16080b0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:59.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.288+0000 7f160cfff700 1 -- 172.21.15.37:0/1666837177 shutdown_connections 2023-07-14T15:58:59.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.288+0000 7f160cfff700 1 -- 172.21.15.37:0/1666837177 wait complete. 2023-07-14T15:58:59.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.290+0000 7f160cfff700 1 Processor -- start 2023-07-14T15:58:59.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.290+0000 7f160cfff700 1 -- start start 2023-07-14T15:58:59.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.291+0000 7f160cfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f160815dfe0 0x7f16081f3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:59.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.291+0000 7f160cfff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f160815ec90 0x7f16080b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:59.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.291+0000 7f160cfff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16081418e0 0x7f16080b42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:59.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.291+0000 7f160cfff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16080c7370 con 0x7f160815dfe0 2023-07-14T15:58:59.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.291+0000 7f160cfff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16080b4820 con 0x7f16081418e0 2023-07-14T15:58:59.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.291+0000 7f160cfff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f160815d560 con 0x7f160815ec90 2023-07-14T15:58:59.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.291+0000 7f160659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f160815dfe0 0x7f16081f3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:59.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.291+0000 7f160659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f160815dfe0 0x7f16081f3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36428/0 (socket says 172.21.15.37:36428) 2023-07-14T15:58:59.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.291+0000 7f160659c700 1 -- 172.21.15.37:0/31525856 learned_addr learned my addr 172.21.15.37:0/31525856 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:59.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.292+0000 7f1605d9b700 1 --2- 172.21.15.37:0/31525856 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f160815ec90 0x7f16080b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:59.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.292+0000 7f1606d9d700 1 --2- 172.21.15.37:0/31525856 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16081418e0 0x7f16080b42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:59.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.292+0000 7f160659c700 1 -- 172.21.15.37:0/31525856 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f160815ec90 msgr2=0x7f16080b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:59.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.292+0000 7f160659c700 1 --2- 172.21.15.37:0/31525856 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f160815ec90 0x7f16080b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:59.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.292+0000 7f160659c700 1 -- 172.21.15.37:0/31525856 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16081418e0 msgr2=0x7f16080b42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:59.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.292+0000 7f160659c700 1 --2- 172.21.15.37:0/31525856 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16081418e0 0x7f16080b42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:59.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.292+0000 7f160659c700 1 -- 172.21.15.37:0/31525856 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f8009550 con 0x7f160815dfe0 2023-07-14T15:58:59.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.292+0000 7f1605d9b700 1 --2- 172.21.15.37:0/31525856 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f160815ec90 0x7f16080b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T15:58:59.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.292+0000 7f160659c700 1 --2- 172.21.15.37:0/31525856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f160815dfe0 0x7f16081f3480 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f15f8009c10 tx=0x7f15f8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:59.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.292+0000 7f15f6ffd700 1 -- 172.21.15.37:0/31525856 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f80036a0 con 0x7f160815dfe0 2023-07-14T15:58:59.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.292+0000 7f15f6ffd700 1 -- 172.21.15.37:0/31525856 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f801e070 con 0x7f160815dfe0 2023-07-14T15:58:59.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.292+0000 7f15f6ffd700 1 -- 172.21.15.37:0/31525856 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f8003a20 con 0x7f160815dfe0 2023-07-14T15:58:59.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.292+0000 7f160cfff700 1 -- 172.21.15.37:0/31525856 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f160815d840 con 0x7f160815dfe0 2023-07-14T15:58:59.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.292+0000 7f160cfff700 1 -- 172.21.15.37:0/31525856 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16080c7000 con 0x7f160815dfe0 2023-07-14T15:58:59.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.294+0000 7f160cfff700 1 -- 172.21.15.37:0/31525856 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f160804e210 con 0x7f160815dfe0 2023-07-14T15:58:59.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.294+0000 7f15f6ffd700 1 -- 172.21.15.37:0/31525856 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f15f8003b80 con 0x7f160815dfe0 2023-07-14T15:58:59.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.295+0000 7f15f6ffd700 1 --2- 172.21.15.37:0/31525856 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f15e806ae30 0x7f15e806d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:59.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.295+0000 7f15f6ffd700 1 -- 172.21.15.37:0/31525856 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5324+0+0 (secure 0 0 0) 0x7f15f808a350 con 0x7f160815dfe0 2023-07-14T15:58:59.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.296+0000 7f1605d9b700 1 --2- 172.21.15.37:0/31525856 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f15e806ae30 0x7f15e806d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:59.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.296+0000 7f1605d9b700 1 --2- 172.21.15.37:0/31525856 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f15e806ae30 0x7f15e806d2e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f160815db30 tx=0x7f15fc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:59.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.299+0000 7f15f6ffd700 1 -- 172.21.15.37:0/31525856 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f15f80555c0 con 0x7f160815dfe0 2023-07-14T15:58:59.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.507+0000 7f160cfff700 1 -- 172.21.15.37:0/31525856 --> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f1608071530 con 0x7f15e806ae30 2023-07-14T15:58:59.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.508+0000 7f15f6ffd700 1 -- 172.21.15.37:0/31525856 <== mgr.4100 v2:172.21.15.98:6832/3163748069 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f15fc004030 con 0x7f15e806ae30 2023-07-14T15:58:59.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.510+0000 7f160cfff700 1 -- 172.21.15.37:0/31525856 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f15e806ae30 msgr2=0x7f15e806d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:59.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.510+0000 7f160cfff700 1 --2- 172.21.15.37:0/31525856 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f15e806ae30 0x7f15e806d2e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f160815db30 tx=0x7f15fc008040 comp rx=0 tx=0).stop 2023-07-14T15:58:59.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.510+0000 7f160cfff700 1 -- 172.21.15.37:0/31525856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f160815dfe0 msgr2=0x7f16081f3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:59.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.510+0000 7f160cfff700 1 --2- 172.21.15.37:0/31525856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f160815dfe0 0x7f16081f3480 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f15f8009c10 tx=0x7f15f8004750 comp rx=0 tx=0).stop 2023-07-14T15:58:59.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.510+0000 7f160cfff700 1 -- 172.21.15.37:0/31525856 shutdown_connections 2023-07-14T15:58:59.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.510+0000 7f160cfff700 1 --2- 172.21.15.37:0/31525856 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16081418e0 0x7f16080b42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:59.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.510+0000 7f160cfff700 1 --2- 172.21.15.37:0/31525856 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f15e806ae30 0x7f15e806d2e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:59.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.510+0000 7f160cfff700 1 --2- 172.21.15.37:0/31525856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f160815dfe0 0x7f16081f3480 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:59.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.510+0000 7f160cfff700 1 --2- 172.21.15.37:0/31525856 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f160815ec90 0x7f16080b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:59.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.510+0000 7f160cfff700 1 -- 172.21.15.37:0/31525856 >> 172.21.15.37:0/31525856 conn(0x7f16080b0620 msgr2=0x7f1608159bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:59.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.510+0000 7f160cfff700 1 -- 172.21.15.37:0/31525856 shutdown_connections 2023-07-14T15:58:59.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.510+0000 7f160cfff700 1 -- 172.21.15.37:0/31525856 wait complete. 2023-07-14T15:58:59.497 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 5 to deep-scrub 2023-07-14T15:58:59.511 INFO:tasks.ceph:Scrubbing osd.6 2023-07-14T15:58:59.512 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-07-14T15:58:59.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.734+0000 7f93361ff700 1 Processor -- start 2023-07-14T15:58:59.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.734+0000 7f93361ff700 1 -- start start 2023-07-14T15:58:59.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.735+0000 7f93361ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f9330154870 0x7f933015b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:59.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.735+0000 7f93361ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f93300ca360 0x7f93300b0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:59.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.735+0000 7f93361ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f933015e000 con 0x7f9330154c40 2023-07-14T15:58:59.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.735+0000 7f93361ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93300719d0 con 0x7f93300ca360 2023-07-14T15:58:59.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.735+0000 7f93361ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f933015e2a0 con 0x7f9330154870 2023-07-14T15:58:59.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.736+0000 7f932f7fe700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f9330154870 0x7f933015b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:59.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.736+0000 7f932effd700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f93300ca360 0x7f93300b0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:59.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.736+0000 7f932ffff700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f9330154c40 0x7f933006caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.37:53842/0 (socket says 172.21.15.37:53842) 2023-07-14T15:58:59.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.736+0000 7f932f7fe700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f9330154870 0x7f933015b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3301/0 says I am v2:172.21.15.37:59850/0 (socket says 172.21.15.37:59850) 2023-07-14T15:58:59.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.736+0000 7f932ffff700 1 -- 172.21.15.37:0/794037633 learned_addr learned my addr 172.21.15.37:0/794037633 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:58:59.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.736+0000 7f932effd700 1 -- 172.21.15.37:0/794037633 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f9330154870 msgr2=0x7f933015b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:59.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.736+0000 7f932effd700 1 --2- 172.21.15.37:0/794037633 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f9330154870 0x7f933015b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:59.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.736+0000 7f932effd700 1 -- 172.21.15.37:0/794037633 >> v1:172.21.15.98:6789/0 conn(0x7f9330154c40 legacy=0x7f933006caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:59.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.736+0000 7f932effd700 1 -- 172.21.15.37:0/794037633 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f933015e580 con 0x7f93300ca360 2023-07-14T15:58:59.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.736+0000 7f932f7fe700 1 --2- 172.21.15.37:0/794037633 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f9330154870 0x7f933015b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T15:58:59.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.736+0000 7f932e7fc700 1 -- 172.21.15.37:0/794037633 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1332838522 0 0) 0x7f933015e000 con 0x7f9330154c40 2023-07-14T15:58:59.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.737+0000 7f932effd700 1 --2- 172.21.15.37:0/794037633 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93300ca360 0x7f93300b0470 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9324009840 tx=0x7f9324009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12a7ee5f53861ae5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:59.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.737+0000 7f932e7fc700 1 -- 172.21.15.37:0/794037633 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9324011830 con 0x7f93300ca360 2023-07-14T15:58:59.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.737+0000 7f932e7fc700 1 -- 172.21.15.37:0/794037633 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9324011990 con 0x7f93300ca360 2023-07-14T15:58:59.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.737+0000 7f932e7fc700 1 -- 172.21.15.37:0/794037633 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9324011d20 con 0x7f93300ca360 2023-07-14T15:58:59.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.737+0000 7f93361ff700 1 -- 172.21.15.37:0/794037633 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93300ca360 msgr2=0x7f93300b0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:59.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.737+0000 7f93361ff700 1 --2- 172.21.15.37:0/794037633 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93300ca360 0x7f93300b0470 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9324009840 tx=0x7f9324009b50 comp rx=0 tx=0).stop 2023-07-14T15:58:59.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.738+0000 7f93361ff700 1 -- 172.21.15.37:0/794037633 shutdown_connections 2023-07-14T15:58:59.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.738+0000 7f93361ff700 1 --2- 172.21.15.37:0/794037633 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f9330154870 0x7f933015b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:59.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.738+0000 7f93361ff700 1 --2- 172.21.15.37:0/794037633 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93300ca360 0x7f93300b0470 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:59.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.738+0000 7f93361ff700 1 -- 172.21.15.37:0/794037633 >> 172.21.15.37:0/794037633 conn(0x7f93300cb470 msgr2=0x7f93300cb870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:59.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.738+0000 7f93361ff700 1 -- 172.21.15.37:0/794037633 shutdown_connections 2023-07-14T15:58:59.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.738+0000 7f93361ff700 1 -- 172.21.15.37:0/794037633 wait complete. 2023-07-14T15:58:59.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.739+0000 7f93361ff700 1 Processor -- start 2023-07-14T15:58:59.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.740+0000 7f93361ff700 1 -- start start 2023-07-14T15:58:59.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.740+0000 7f93361ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9330154870 0x7f93301f2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:59.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.740+0000 7f93361ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9330154c40 0x7f93300ae5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:59.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.740+0000 7f93361ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f93300c2b80 0x7f93300b1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:59.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.740+0000 7f93361ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93300b0000 con 0x7f9330154c40 2023-07-14T15:58:59.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.740+0000 7f93361ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93300aef60 con 0x7f9330154870 2023-07-14T15:58:59.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.741+0000 7f93361ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93300af240 con 0x7f93300c2b80 2023-07-14T15:58:59.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.741+0000 7f932effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9330154c40 0x7f93300ae5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:59.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.741+0000 7f932effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9330154c40 0x7f93300ae5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36438/0 (socket says 172.21.15.37:36438) 2023-07-14T15:58:59.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.741+0000 7f932effd700 1 -- 172.21.15.37:0/1637115318 learned_addr learned my addr 172.21.15.37:0/1637115318 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:59.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.741+0000 7f932f7fe700 1 --2- 172.21.15.37:0/1637115318 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9330154870 0x7f93301f2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:59.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.741+0000 7f932ffff700 1 --2- 172.21.15.37:0/1637115318 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f93300c2b80 0x7f93300b1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:59.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.741+0000 7f932effd700 1 -- 172.21.15.37:0/1637115318 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f93300c2b80 msgr2=0x7f93300b1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:59.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.741+0000 7f932effd700 1 --2- 172.21.15.37:0/1637115318 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f93300c2b80 0x7f93300b1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:59.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.741+0000 7f932effd700 1 -- 172.21.15.37:0/1637115318 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9330154870 msgr2=0x7f93301f2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:59.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.741+0000 7f932effd700 1 --2- 172.21.15.37:0/1637115318 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9330154870 0x7f93301f2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:59.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.741+0000 7f932effd700 1 -- 172.21.15.37:0/1637115318 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93200094a0 con 0x7f9330154c40 2023-07-14T15:58:59.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.742+0000 7f932effd700 1 --2- 172.21.15.37:0/1637115318 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9330154c40 0x7f93300ae5a0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f9324009fd0 tx=0x7f9324004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:59.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.742+0000 7f9317fff700 1 -- 172.21.15.37:0/1637115318 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93240036a0 con 0x7f9330154c40 2023-07-14T15:58:59.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.742+0000 7f9317fff700 1 -- 172.21.15.37:0/1637115318 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f932401f070 con 0x7f9330154c40 2023-07-14T15:58:59.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.742+0000 7f93361ff700 1 -- 172.21.15.37:0/1637115318 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93240094a0 con 0x7f9330154c40 2023-07-14T15:58:59.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.742+0000 7f9317fff700 1 -- 172.21.15.37:0/1637115318 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9324003a60 con 0x7f9330154c40 2023-07-14T15:58:59.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.742+0000 7f93361ff700 1 -- 172.21.15.37:0/1637115318 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93300af800 con 0x7f9330154c40 2023-07-14T15:58:59.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.743+0000 7f93361ff700 1 -- 172.21.15.37:0/1637115318 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f933015eb40 con 0x7f9330154c40 2023-07-14T15:58:59.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.744+0000 7f9317fff700 1 -- 172.21.15.37:0/1637115318 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f9324003bc0 con 0x7f9330154c40 2023-07-14T15:58:59.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.745+0000 7f9317fff700 1 --2- 172.21.15.37:0/1637115318 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f931c06ae00 0x7f931c06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:59.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.745+0000 7f9317fff700 1 -- 172.21.15.37:0/1637115318 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5324+0+0 (secure 0 0 0) 0x7f9324021070 con 0x7f9330154c40 2023-07-14T15:58:59.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.745+0000 7f9317fff700 1 --2- 172.21.15.37:0/1637115318 >> [v2:172.21.15.98:6808/1144224691,v1:172.21.15.98:6809/1144224691] conn(0x7f931c071270 0x7f931c0736a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:59.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.745+0000 7f9317fff700 1 -- 172.21.15.37:0/1637115318 --> [v2:172.21.15.98:6808/1144224691,v1:172.21.15.98:6809/1144224691] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f931c073d70 con 0x7f931c071270 2023-07-14T15:58:59.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.745+0000 7f9317fff700 1 -- 172.21.15.37:0/1637115318 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f932408f2a0 con 0x7f9330154c40 2023-07-14T15:58:59.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.745+0000 7f932f7fe700 1 --2- 172.21.15.37:0/1637115318 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f931c06ae00 0x7f931c06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:59.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.746+0000 7f932ffff700 1 --2- 172.21.15.37:0/1637115318 >> [v2:172.21.15.98:6808/1144224691,v1:172.21.15.98:6809/1144224691] conn(0x7f931c071270 0x7f931c0736a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:59.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.746+0000 7f932ffff700 1 --2- 172.21.15.37:0/1637115318 >> [v2:172.21.15.98:6808/1144224691,v1:172.21.15.98:6809/1144224691] conn(0x7f931c071270 0x7f931c0736a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:59.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.746+0000 7f932f7fe700 1 --2- 172.21.15.37:0/1637115318 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f931c06ae00 0x7f931c06d2b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9320009d70 tx=0x7f9320009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:59.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.747+0000 7f9317fff700 1 -- 172.21.15.37:0/1637115318 <== osd.6 v2:172.21.15.98:6808/1144224691 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f931c073d70 con 0x7f931c071270 2023-07-14T15:58:59.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.762+0000 7f93361ff700 1 -- 172.21.15.37:0/1637115318 --> [v2:172.21.15.98:6808/1144224691,v1:172.21.15.98:6809/1144224691] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f933015e860 con 0x7f931c071270 2023-07-14T15:58:59.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.763+0000 7f9317fff700 1 -- 172.21.15.37:0/1637115318 <== osd.6 v2:172.21.15.98:6808/1144224691 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f93280071c0 con 0x7f931c071270 2023-07-14T15:58:59.747 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-14T15:58:59.747 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-14T15:58:59.747 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-14T15:58:59.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.763+0000 7f93361ff700 1 -- 172.21.15.37:0/1637115318 >> [v2:172.21.15.98:6808/1144224691,v1:172.21.15.98:6809/1144224691] conn(0x7f931c071270 msgr2=0x7f931c0736a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:59.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.763+0000 7f93361ff700 1 --2- 172.21.15.37:0/1637115318 >> [v2:172.21.15.98:6808/1144224691,v1:172.21.15.98:6809/1144224691] conn(0x7f931c071270 0x7f931c0736a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:59.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.763+0000 7f93361ff700 1 -- 172.21.15.37:0/1637115318 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f931c06ae00 msgr2=0x7f931c06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:59.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.763+0000 7f93361ff700 1 --2- 172.21.15.37:0/1637115318 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f931c06ae00 0x7f931c06d2b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9320009d70 tx=0x7f9320009210 comp rx=0 tx=0).stop 2023-07-14T15:58:59.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.763+0000 7f93361ff700 1 -- 172.21.15.37:0/1637115318 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9330154c40 msgr2=0x7f93300ae5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:59.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.763+0000 7f93361ff700 1 --2- 172.21.15.37:0/1637115318 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9330154c40 0x7f93300ae5a0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f9324009fd0 tx=0x7f9324004750 comp rx=0 tx=0).stop 2023-07-14T15:58:59.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.763+0000 7f932ffff700 1 -- 172.21.15.37:0/1637115318 reap_dead start 2023-07-14T15:58:59.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.763+0000 7f93361ff700 1 -- 172.21.15.37:0/1637115318 shutdown_connections 2023-07-14T15:58:59.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.763+0000 7f93361ff700 1 -- 172.21.15.37:0/1637115318 >> 172.21.15.37:0/1637115318 conn(0x7f93300cb470 msgr2=0x7f9330153ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:59.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.764+0000 7f93361ff700 1 -- 172.21.15.37:0/1637115318 shutdown_connections 2023-07-14T15:58:59.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.764+0000 7f93361ff700 1 -- 172.21.15.37:0/1637115318 wait complete. 2023-07-14T15:58:59.764 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-07-14T15:58:59.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.983+0000 7fbe733ff700 1 Processor -- start 2023-07-14T15:58:59.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.983+0000 7fbe733ff700 1 -- start start 2023-07-14T15:58:59.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.984+0000 7fbe733ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbe6c0b22b0 0x7fbe6c0d1c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:59.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.984+0000 7fbe733ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fbe6c0b4900 0x7fbe6c0b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:59.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.984+0000 7fbe733ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe6c0d17c0 con 0x7fbe6c0cd4d0 2023-07-14T15:58:59.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.984+0000 7fbe733ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe6c0d0e90 con 0x7fbe6c0b4900 2023-07-14T15:58:59.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.984+0000 7fbe733ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c0d1170 con 0x7fbe6c0b22b0 2023-07-14T15:58:59.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.984+0000 7fbe7199c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fbe6c0cd4d0 0x7fbe6c0b5cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42964/0 (socket says 172.21.15.37:42964) 2023-07-14T15:58:59.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.984+0000 7fbe7199c700 1 -- 172.21.15.37:0/4116619409 learned_addr learned my addr 172.21.15.37:0/4116619409 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:58:59.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.985+0000 7fbe7119b700 1 --2- 172.21.15.37:0/4116619409 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbe6c0b22b0 0x7fbe6c0d1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:59.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.985+0000 7fbe7099a700 1 --2- 172.21.15.37:0/4116619409 >> v2:172.21.15.98:3300/0 conn(0x7fbe6c0b4900 0x7fbe6c0b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:59.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.985+0000 7fbe63fff700 1 -- 172.21.15.37:0/4116619409 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 899287052 0 0) 0x7fbe6c0d17c0 con 0x7fbe6c0cd4d0 2023-07-14T15:58:59.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.985+0000 7fbe63fff700 1 -- 172.21.15.37:0/4116619409 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe580035b0 con 0x7fbe6c0cd4d0 2023-07-14T15:58:59.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.985+0000 7fbe7099a700 1 -- 172.21.15.37:0/4116619409 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbe6c0b22b0 msgr2=0x7fbe6c0d1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:58:59.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.985+0000 7fbe7099a700 1 --2- 172.21.15.37:0/4116619409 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbe6c0b22b0 0x7fbe6c0d1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:59.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.985+0000 7fbe7099a700 1 -- 172.21.15.37:0/4116619409 >> v1:172.21.15.37:6789/0 conn(0x7fbe6c0cd4d0 legacy=0x7fbe6c0b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:59.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.985+0000 7fbe7099a700 1 -- 172.21.15.37:0/4116619409 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe6c0d1450 con 0x7fbe6c0b4900 2023-07-14T15:58:59.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.985+0000 7fbe7099a700 1 --2- 172.21.15.37:0/4116619409 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe6c0b4900 0x7fbe6c0b4d70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c009840 tx=0x7fbe5c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=555e74d703192950 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:59.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.986+0000 7fbe63fff700 1 -- 172.21.15.37:0/4116619409 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5c011830 con 0x7fbe6c0b4900 2023-07-14T15:58:59.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.986+0000 7fbe63fff700 1 -- 172.21.15.37:0/4116619409 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe5c011990 con 0x7fbe6c0b4900 2023-07-14T15:58:59.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.986+0000 7fbe63fff700 1 -- 172.21.15.37:0/4116619409 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5c011d20 con 0x7fbe6c0b4900 2023-07-14T15:58:59.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.986+0000 7fbe733ff700 1 -- 172.21.15.37:0/4116619409 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe6c0b4900 msgr2=0x7fbe6c0b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:59.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.986+0000 7fbe733ff700 1 --2- 172.21.15.37:0/4116619409 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe6c0b4900 0x7fbe6c0b4d70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c009840 tx=0x7fbe5c009b50 comp rx=0 tx=0).stop 2023-07-14T15:58:59.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.986+0000 7fbe733ff700 1 -- 172.21.15.37:0/4116619409 shutdown_connections 2023-07-14T15:58:59.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.986+0000 7fbe733ff700 1 --2- 172.21.15.37:0/4116619409 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbe6c0b22b0 0x7fbe6c0d1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:59.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.986+0000 7fbe733ff700 1 --2- 172.21.15.37:0/4116619409 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe6c0b4900 0x7fbe6c0b4d70 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:59.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.986+0000 7fbe733ff700 1 -- 172.21.15.37:0/4116619409 >> 172.21.15.37:0/4116619409 conn(0x7fbe6c06b2a0 msgr2=0x7fbe6c0cf900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:58:59.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.986+0000 7fbe733ff700 1 -- 172.21.15.37:0/4116619409 shutdown_connections 2023-07-14T15:58:59.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.986+0000 7fbe733ff700 1 -- 172.21.15.37:0/4116619409 wait complete. 2023-07-14T15:58:59.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.988+0000 7fbe733ff700 1 Processor -- start 2023-07-14T15:58:59.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.988+0000 7fbe733ff700 1 -- start start 2023-07-14T15:58:59.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.989+0000 7fbe733ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe6c0b22b0 0x7fbe6c0c9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:59.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.989+0000 7fbe733ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe6c0b4900 0x7fbe6c15cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:59.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.989+0000 7fbe733ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbe6c0cd4d0 0x7fbe6c155440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:59.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.989+0000 7fbe733ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c15d490 con 0x7fbe6c0b22b0 2023-07-14T15:58:59.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.989+0000 7fbe733ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c15d770 con 0x7fbe6c0b4900 2023-07-14T15:58:59.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.989+0000 7fbe733ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c15da50 con 0x7fbe6c0cd4d0 2023-07-14T15:58:59.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.989+0000 7fbe7119b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe6c0b22b0 0x7fbe6c0c9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:59.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.990+0000 7fbe7119b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe6c0b22b0 0x7fbe6c0c9580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34016/0 (socket says 172.21.15.37:34016) 2023-07-14T15:58:59.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.990+0000 7fbe7119b700 1 -- 172.21.15.37:0/1818767660 learned_addr learned my addr 172.21.15.37:0/1818767660 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:58:59.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.990+0000 7fbe7099a700 1 --2- 172.21.15.37:0/1818767660 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe6c0b4900 0x7fbe6c15cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:59.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.990+0000 7fbe7199c700 1 --2- 172.21.15.37:0/1818767660 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbe6c0cd4d0 0x7fbe6c155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:59.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.990+0000 7fbe7119b700 1 -- 172.21.15.37:0/1818767660 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbe6c0cd4d0 msgr2=0x7fbe6c155440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:59.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.990+0000 7fbe7119b700 1 --2- 172.21.15.37:0/1818767660 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbe6c0cd4d0 0x7fbe6c155440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:59.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.990+0000 7fbe7119b700 1 -- 172.21.15.37:0/1818767660 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe6c0b4900 msgr2=0x7fbe6c15cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:58:59.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.990+0000 7fbe7119b700 1 --2- 172.21.15.37:0/1818767660 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe6c0b4900 0x7fbe6c15cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:58:59.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.990+0000 7fbe7119b700 1 -- 172.21.15.37:0/1818767660 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe5c0094a0 con 0x7fbe6c0b22b0 2023-07-14T15:58:59.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.990+0000 7fbe7119b700 1 --2- 172.21.15.37:0/1818767660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe6c0b22b0 0x7fbe6c0c9580 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fbe6800e9b0 tx=0x7fbe6800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:59.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.990+0000 7fbe61ffb700 1 -- 172.21.15.37:0/1818767660 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe68009710 con 0x7fbe6c0b22b0 2023-07-14T15:58:59.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.990+0000 7fbe61ffb700 1 -- 172.21.15.37:0/1818767660 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe6800c850 con 0x7fbe6c0b22b0 2023-07-14T15:58:59.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.990+0000 7fbe61ffb700 1 -- 172.21.15.37:0/1818767660 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6800cbc0 con 0x7fbe6c0b22b0 2023-07-14T15:58:59.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.990+0000 7fbe733ff700 1 -- 172.21.15.37:0/1818767660 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe6c15dd30 con 0x7fbe6c0b22b0 2023-07-14T15:58:59.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.991+0000 7fbe733ff700 1 -- 172.21.15.37:0/1818767660 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe6c15d1a0 con 0x7fbe6c0b22b0 2023-07-14T15:58:59.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.992+0000 7fbe733ff700 1 -- 172.21.15.37:0/1818767660 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe6c0c7630 con 0x7fbe6c0b22b0 2023-07-14T15:58:59.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.992+0000 7fbe61ffb700 1 -- 172.21.15.37:0/1818767660 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fbe6800cd20 con 0x7fbe6c0b22b0 2023-07-14T15:58:59.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.994+0000 7fbe61ffb700 1 --2- 172.21.15.37:0/1818767660 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbe5006ae00 0x7fbe5006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:58:59.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.994+0000 7fbe61ffb700 1 -- 172.21.15.37:0/1818767660 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5324+0+0 (secure 0 0 0) 0x7fbe68089370 con 0x7fbe6c0b22b0 2023-07-14T15:58:59.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.994+0000 7fbe7099a700 1 --2- 172.21.15.37:0/1818767660 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbe5006ae00 0x7fbe5006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:58:59.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.995+0000 7fbe7099a700 1 --2- 172.21.15.37:0/1818767660 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbe5006ae00 0x7fbe5006d2b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c000c00 tx=0x7fbe5c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:58:59.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:58:59.999+0000 7fbe61ffb700 1 -- 172.21.15.37:0/1818767660 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fbe68054680 con 0x7fbe6c0b22b0 2023-07-14T15:59:00.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.206+0000 7fbe733ff700 1 -- 172.21.15.37:0/1818767660 --> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fbe6c15d8e0 con 0x7fbe5006ae00 2023-07-14T15:59:00.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.207+0000 7fbe61ffb700 1 -- 172.21.15.37:0/1818767660 <== mgr.4100 v2:172.21.15.98:6832/3163748069 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbe6c15d8e0 con 0x7fbe5006ae00 2023-07-14T15:59:00.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.209+0000 7fbe733ff700 1 -- 172.21.15.37:0/1818767660 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbe5006ae00 msgr2=0x7fbe5006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:59:00.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.209+0000 7fbe733ff700 1 --2- 172.21.15.37:0/1818767660 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbe5006ae00 0x7fbe5006d2b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c000c00 tx=0x7fbe5c008030 comp rx=0 tx=0).stop 2023-07-14T15:59:00.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.209+0000 7fbe733ff700 1 -- 172.21.15.37:0/1818767660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe6c0b22b0 msgr2=0x7fbe6c0c9580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:59:00.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.209+0000 7fbe733ff700 1 --2- 172.21.15.37:0/1818767660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe6c0b22b0 0x7fbe6c0c9580 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fbe6800e9b0 tx=0x7fbe6800ecc0 comp rx=0 tx=0).stop 2023-07-14T15:59:00.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.209+0000 7fbe733ff700 1 -- 172.21.15.37:0/1818767660 shutdown_connections 2023-07-14T15:59:00.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.209+0000 7fbe733ff700 1 --2- 172.21.15.37:0/1818767660 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbe5006ae00 0x7fbe5006d2b0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:59:00.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.209+0000 7fbe733ff700 1 --2- 172.21.15.37:0/1818767660 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbe6c0cd4d0 0x7fbe6c155440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:59:00.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.209+0000 7fbe733ff700 1 --2- 172.21.15.37:0/1818767660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe6c0b22b0 0x7fbe6c0c9580 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:59:00.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.209+0000 7fbe733ff700 1 --2- 172.21.15.37:0/1818767660 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe6c0b4900 0x7fbe6c15cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:59:00.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.209+0000 7fbe733ff700 1 -- 172.21.15.37:0/1818767660 >> 172.21.15.37:0/1818767660 conn(0x7fbe6c06b2a0 msgr2=0x7fbe6c0cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:59:00.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.209+0000 7fbe733ff700 1 -- 172.21.15.37:0/1818767660 shutdown_connections 2023-07-14T15:59:00.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.209+0000 7fbe733ff700 1 -- 172.21.15.37:0/1818767660 wait complete. 2023-07-14T15:59:00.196 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 6 to deep-scrub 2023-07-14T15:59:00.211 INFO:tasks.ceph:Scrubbing osd.7 2023-07-14T15:59:00.212 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-07-14T15:59:00.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.432+0000 7fdd0b7ff700 1 Processor -- start 2023-07-14T15:59:00.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.432+0000 7fdd0b7ff700 1 -- start start 2023-07-14T15:59:00.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.433+0000 7fdd0b7ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdd040b1f30 0x7fdd04069e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:59:00.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.433+0000 7fdd0b7ff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdd0415d5c0 0x7fdd040ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:59:00.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.433+0000 7fdd0b7ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd0406e4f0 con 0x7fdd0406a3b0 2023-07-14T15:59:00.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.433+0000 7fdd0b7ff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd0415dbe0 con 0x7fdd0415d5c0 2023-07-14T15:59:00.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.433+0000 7fdd0b7ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0406a820 con 0x7fdd040b1f30 2023-07-14T15:59:00.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.433+0000 7fdd09d9c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdd0415d5c0 0x7fdd040ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:59:00.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.433+0000 7fdd09d9c700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdd0415d5c0 0x7fdd040ce6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34030/0 (socket says 172.21.15.37:34030) 2023-07-14T15:59:00.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.433+0000 7fdd09d9c700 1 -- 172.21.15.37:0/2518605502 learned_addr learned my addr 172.21.15.37:0/2518605502 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:59:00.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.434+0000 7fdd0959b700 1 --2- 172.21.15.37:0/2518605502 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdd040b1f30 0x7fdd04069e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:59:00.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.434+0000 7fdd09d9c700 1 -- 172.21.15.37:0/2518605502 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdd040b1f30 msgr2=0x7fdd04069e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:59:00.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.434+0000 7fdd09d9c700 1 --2- 172.21.15.37:0/2518605502 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdd040b1f30 0x7fdd04069e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:59:00.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.434+0000 7fdd09d9c700 1 -- 172.21.15.37:0/2518605502 >> v1:172.21.15.98:6789/0 conn(0x7fdd0406a3b0 legacy=0x7fdd0415ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:59:00.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.434+0000 7fdd09d9c700 1 -- 172.21.15.37:0/2518605502 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd041603a0 con 0x7fdd0415d5c0 2023-07-14T15:59:00.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.434+0000 7fdd09d9c700 1 --2- 172.21.15.37:0/2518605502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd0415d5c0 0x7fdd040ce6a0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc009eb0 tx=0x7fdcfc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23d7640b1475343e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:59:00.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.434+0000 7fdcfbfff700 1 -- 172.21.15.37:0/2518605502 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc00e070 con 0x7fdd0415d5c0 2023-07-14T15:59:00.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.434+0000 7fdcfbfff700 1 -- 172.21.15.37:0/2518605502 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcfc00b940 con 0x7fdd0415d5c0 2023-07-14T15:59:00.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.434+0000 7fdcfbfff700 1 -- 172.21.15.37:0/2518605502 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc00bcf0 con 0x7fdd0415d5c0 2023-07-14T15:59:00.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.435+0000 7fdd0b7ff700 1 -- 172.21.15.37:0/2518605502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd0415d5c0 msgr2=0x7fdd040ce6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:59:00.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.435+0000 7fdd0b7ff700 1 --2- 172.21.15.37:0/2518605502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd0415d5c0 0x7fdd040ce6a0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc009eb0 tx=0x7fdcfc00b330 comp rx=0 tx=0).stop 2023-07-14T15:59:00.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.435+0000 7fdd0b7ff700 1 -- 172.21.15.37:0/2518605502 shutdown_connections 2023-07-14T15:59:00.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.435+0000 7fdd0b7ff700 1 --2- 172.21.15.37:0/2518605502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd0415d5c0 0x7fdd040ce6a0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:59:00.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.435+0000 7fdd0b7ff700 1 --2- 172.21.15.37:0/2518605502 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdd040b1f30 0x7fdd04069e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:59:00.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.435+0000 7fdd0b7ff700 1 -- 172.21.15.37:0/2518605502 >> 172.21.15.37:0/2518605502 conn(0x7fdd040cc580 msgr2=0x7fdd040cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:59:00.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.435+0000 7fdd0b7ff700 1 -- 172.21.15.37:0/2518605502 shutdown_connections 2023-07-14T15:59:00.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.435+0000 7fdd0b7ff700 1 -- 172.21.15.37:0/2518605502 wait complete. 2023-07-14T15:59:00.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.437+0000 7fdd0b7ff700 1 Processor -- start 2023-07-14T15:59:00.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.437+0000 7fdd0b7ff700 1 -- start start 2023-07-14T15:59:00.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.438+0000 7fdd0b7ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd0406a3b0 0x7fdd04157330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:59:00.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.438+0000 7fdd0b7ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd040b1f30 0x7fdd040afe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:59:00.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.438+0000 7fdd0b7ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdd0415d5c0 0x7fdd040cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:59:00.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.438+0000 7fdd0b7ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd041e5de0 con 0x7fdd040b1f30 2023-07-14T15:59:00.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.438+0000 7fdd0b7ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd041e60c0 con 0x7fdd0406a3b0 2023-07-14T15:59:00.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.438+0000 7fdd0b7ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd040b07e0 con 0x7fdd0415d5c0 2023-07-14T15:59:00.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.438+0000 7fdd08d9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd040b1f30 0x7fdd040afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:59:00.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.438+0000 7fdd08d9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd040b1f30 0x7fdd040afe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34046/0 (socket says 172.21.15.37:34046) 2023-07-14T15:59:00.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.438+0000 7fdd08d9a700 1 -- 172.21.15.37:0/568739971 learned_addr learned my addr 172.21.15.37:0/568739971 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:59:00.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.438+0000 7fdd0959b700 1 --2- 172.21.15.37:0/568739971 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd0406a3b0 0x7fdd04157330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:59:00.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.438+0000 7fdd09d9c700 1 --2- 172.21.15.37:0/568739971 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdd0415d5c0 0x7fdd040cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:59:00.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.438+0000 7fdd08d9a700 1 -- 172.21.15.37:0/568739971 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdd0415d5c0 msgr2=0x7fdd040cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:59:00.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.438+0000 7fdd08d9a700 1 --2- 172.21.15.37:0/568739971 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdd0415d5c0 0x7fdd040cf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:59:00.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.438+0000 7fdd08d9a700 1 -- 172.21.15.37:0/568739971 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd0406a3b0 msgr2=0x7fdd04157330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:59:00.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.438+0000 7fdd08d9a700 1 --2- 172.21.15.37:0/568739971 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdd0406a3b0 0x7fdd04157330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:59:00.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.438+0000 7fdd08d9a700 1 -- 172.21.15.37:0/568739971 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcfc009b30 con 0x7fdd040b1f30 2023-07-14T15:59:00.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.438+0000 7fdd09d9c700 1 --2- 172.21.15.37:0/568739971 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fdd0415d5c0 0x7fdd040cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:59:00.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.439+0000 7fdd08d9a700 1 --2- 172.21.15.37:0/568739971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd040b1f30 0x7fdd040afe70 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fdcf400c510 tx=0x7fdcf400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:59:00.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.439+0000 7fdcf9ffb700 1 -- 172.21.15.37:0/568739971 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf40052d0 con 0x7fdd040b1f30 2023-07-14T15:59:00.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.439+0000 7fdcf9ffb700 1 -- 172.21.15.37:0/568739971 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf4005430 con 0x7fdd040b1f30 2023-07-14T15:59:00.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.439+0000 7fdcf9ffb700 1 -- 172.21.15.37:0/568739971 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf40038c0 con 0x7fdd040b1f30 2023-07-14T15:59:00.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.439+0000 7fdd0b7ff700 1 -- 172.21.15.37:0/568739971 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd040b0ac0 con 0x7fdd040b1f30 2023-07-14T15:59:00.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.439+0000 7fdd0b7ff700 1 -- 172.21.15.37:0/568739971 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd04157870 con 0x7fdd040b1f30 2023-07-14T15:59:00.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.440+0000 7fdd0b7ff700 1 -- 172.21.15.37:0/568739971 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdd04160960 con 0x7fdd040b1f30 2023-07-14T15:59:00.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.441+0000 7fdcf9ffb700 1 -- 172.21.15.37:0/568739971 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fdcf4003a20 con 0x7fdd040b1f30 2023-07-14T15:59:00.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.442+0000 7fdcf9ffb700 1 --2- 172.21.15.37:0/568739971 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fdce806ae00 0x7fdce806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:59:00.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.442+0000 7fdcf9ffb700 1 -- 172.21.15.37:0/568739971 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5324+0+0 (secure 0 0 0) 0x7fdcf4088660 con 0x7fdd040b1f30 2023-07-14T15:59:00.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.442+0000 7fdcf9ffb700 1 --2- 172.21.15.37:0/568739971 >> [v2:172.21.15.98:6816/1144470927,v1:172.21.15.98:6818/1144470927] conn(0x7fdce80712c0 0x7fdce80736f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:59:00.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.442+0000 7fdcf9ffb700 1 -- 172.21.15.37:0/568739971 --> [v2:172.21.15.98:6816/1144470927,v1:172.21.15.98:6818/1144470927] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdce8073dc0 con 0x7fdce80712c0 2023-07-14T15:59:00.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.442+0000 7fdcf9ffb700 1 -- 172.21.15.37:0/568739971 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdcf408ac40 con 0x7fdd040b1f30 2023-07-14T15:59:00.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.443+0000 7fdd0959b700 1 --2- 172.21.15.37:0/568739971 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fdce806ae00 0x7fdce806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:59:00.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.443+0000 7fdd09d9c700 1 --2- 172.21.15.37:0/568739971 >> [v2:172.21.15.98:6816/1144470927,v1:172.21.15.98:6818/1144470927] conn(0x7fdce80712c0 0x7fdce80736f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:59:00.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.443+0000 7fdd0959b700 1 --2- 172.21.15.37:0/568739971 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fdce806ae00 0x7fdce806d2b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fdd00009930 tx=0x7fdd00008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:59:00.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.443+0000 7fdd09d9c700 1 --2- 172.21.15.37:0/568739971 >> [v2:172.21.15.98:6816/1144470927,v1:172.21.15.98:6818/1144470927] conn(0x7fdce80712c0 0x7fdce80736f0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:59:00.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.444+0000 7fdcf9ffb700 1 -- 172.21.15.37:0/568739971 <== osd.7 v2:172.21.15.98:6816/1144470927 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fdce8073dc0 con 0x7fdce80712c0 2023-07-14T15:59:00.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.459+0000 7fdd0b7ff700 1 -- 172.21.15.37:0/568739971 --> [v2:172.21.15.98:6816/1144470927,v1:172.21.15.98:6818/1144470927] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fdd04160680 con 0x7fdce80712c0 2023-07-14T15:59:00.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.460+0000 7fdcf9ffb700 1 -- 172.21.15.37:0/568739971 <== osd.7 v2:172.21.15.98:6816/1144470927 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fdcfc0099b0 con 0x7fdce80712c0 2023-07-14T15:59:00.444 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-14T15:59:00.444 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-14T15:59:00.445 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-14T15:59:00.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.460+0000 7fdd0b7ff700 1 -- 172.21.15.37:0/568739971 >> [v2:172.21.15.98:6816/1144470927,v1:172.21.15.98:6818/1144470927] conn(0x7fdce80712c0 msgr2=0x7fdce80736f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:59:00.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.460+0000 7fdd0b7ff700 1 --2- 172.21.15.37:0/568739971 >> [v2:172.21.15.98:6816/1144470927,v1:172.21.15.98:6818/1144470927] conn(0x7fdce80712c0 0x7fdce80736f0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:59:00.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.460+0000 7fdd0b7ff700 1 -- 172.21.15.37:0/568739971 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fdce806ae00 msgr2=0x7fdce806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:59:00.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.460+0000 7fdd0b7ff700 1 --2- 172.21.15.37:0/568739971 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fdce806ae00 0x7fdce806d2b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fdd00009930 tx=0x7fdd00008040 comp rx=0 tx=0).stop 2023-07-14T15:59:00.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.460+0000 7fdd0b7ff700 1 -- 172.21.15.37:0/568739971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd040b1f30 msgr2=0x7fdd040afe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:59:00.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.460+0000 7fdd0b7ff700 1 --2- 172.21.15.37:0/568739971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd040b1f30 0x7fdd040afe70 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fdcf400c510 tx=0x7fdcf400c8d0 comp rx=0 tx=0).stop 2023-07-14T15:59:00.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.460+0000 7fdd09d9c700 1 -- 172.21.15.37:0/568739971 reap_dead start 2023-07-14T15:59:00.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.460+0000 7fdd0b7ff700 1 -- 172.21.15.37:0/568739971 shutdown_connections 2023-07-14T15:59:00.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.460+0000 7fdd0b7ff700 1 -- 172.21.15.37:0/568739971 >> 172.21.15.37:0/568739971 conn(0x7fdd040cc580 msgr2=0x7fdd0415f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:59:00.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.461+0000 7fdd0b7ff700 1 -- 172.21.15.37:0/568739971 shutdown_connections 2023-07-14T15:59:00.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.461+0000 7fdd0b7ff700 1 -- 172.21.15.37:0/568739971 wait complete. 2023-07-14T15:59:00.462 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-07-14T15:59:00.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.679+0000 7f24139ff700 1 Processor -- start 2023-07-14T15:59:00.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.680+0000 7f24139ff700 1 -- start start 2023-07-14T15:59:00.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.681+0000 7f24139ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f240c0b8900 0x7f240c0cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:59:00.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.681+0000 7f24139ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f240c0b6270 con 0x7f240c0d15c0 2023-07-14T15:59:00.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.681+0000 7f24139ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f240c0cdb50 con 0x7f240c0b5e00 2023-07-14T15:59:00.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.681+0000 7f24139ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f240c15d030 con 0x7f240c0b8900 2023-07-14T15:59:00.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.681+0000 7f2411f9c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f240c0d15c0 0x7f240c0cebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42974/0 (socket says 172.21.15.37:42974) 2023-07-14T15:59:00.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.681+0000 7f2411f9c700 1 -- 172.21.15.37:0/163525471 learned_addr learned my addr 172.21.15.37:0/163525471 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:59:00.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.681+0000 7f241179b700 1 --2- 172.21.15.37:0/163525471 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f240c0b8900 0x7f240c0cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:59:00.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.682+0000 7f2403fff700 1 -- 172.21.15.37:0/163525471 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3679702366 0 0) 0x7f240c0b6270 con 0x7f240c0d15c0 2023-07-14T15:59:00.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.682+0000 7f2403fff700 1 -- 172.21.15.37:0/163525471 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23f80035b0 con 0x7f240c0d15c0 2023-07-14T15:59:00.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.682+0000 7f2403fff700 1 -- 172.21.15.37:0/163525471 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 192184465 0 0) 0x7f240c0cdb50 con 0x7f240c0b5e00 2023-07-14T15:59:00.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.682+0000 7f2403fff700 1 -- 172.21.15.37:0/163525471 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f240c0b6270 con 0x7f240c0b5e00 2023-07-14T15:59:00.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.682+0000 7f241179b700 1 -- 172.21.15.37:0/163525471 >> v1:172.21.15.98:6789/0 conn(0x7f240c0b5e00 legacy=0x7f240c0d0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:59:00.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.682+0000 7f241179b700 1 -- 172.21.15.37:0/163525471 >> v1:172.21.15.37:6789/0 conn(0x7f240c0d15c0 legacy=0x7f240c0cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:59:00.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.682+0000 7f241179b700 1 -- 172.21.15.37:0/163525471 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f240c0cde30 con 0x7f240c0b8900 2023-07-14T15:59:00.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.682+0000 7f241179b700 1 --2- 172.21.15.37:0/163525471 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f240c0b8900 0x7f240c0cd570 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2408009850 tx=0x7f2408009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb9e60894732187b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:59:00.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.682+0000 7f2403fff700 1 -- 172.21.15.37:0/163525471 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2408005e30 con 0x7f240c0b8900 2023-07-14T15:59:00.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.682+0000 7f2403fff700 1 -- 172.21.15.37:0/163525471 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2408006030 con 0x7f240c0b8900 2023-07-14T15:59:00.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.682+0000 7f2403fff700 1 -- 172.21.15.37:0/163525471 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24080063e0 con 0x7f240c0b8900 2023-07-14T15:59:00.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.683+0000 7f24139ff700 1 -- 172.21.15.37:0/163525471 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f240c0b8900 msgr2=0x7f240c0cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:59:00.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.683+0000 7f24139ff700 1 --2- 172.21.15.37:0/163525471 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f240c0b8900 0x7f240c0cd570 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2408009850 tx=0x7f2408009b60 comp rx=0 tx=0).stop 2023-07-14T15:59:00.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.683+0000 7f24139ff700 1 -- 172.21.15.37:0/163525471 shutdown_connections 2023-07-14T15:59:00.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.683+0000 7f24139ff700 1 --2- 172.21.15.37:0/163525471 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f240c0b8900 0x7f240c0cd570 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:59:00.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.683+0000 7f24139ff700 1 -- 172.21.15.37:0/163525471 >> 172.21.15.37:0/163525471 conn(0x7f240c09c1e0 msgr2=0x7f240c0d2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:59:00.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.683+0000 7f24139ff700 1 -- 172.21.15.37:0/163525471 shutdown_connections 2023-07-14T15:59:00.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.683+0000 7f24139ff700 1 -- 172.21.15.37:0/163525471 wait complete. 2023-07-14T15:59:00.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.685+0000 7f24139ff700 1 Processor -- start 2023-07-14T15:59:00.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.685+0000 7f24139ff700 1 -- start start 2023-07-14T15:59:00.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.686+0000 7f24139ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f240c0b5e00 0x7f240c0cd340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:59:00.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.686+0000 7f24139ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f240c0b8900 0x7f240c1523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:59:00.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.686+0000 7f24139ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f240c0d15c0 0x7f240c09e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:59:00.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.686+0000 7f24139ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240c0cb5c0 con 0x7f240c0b5e00 2023-07-14T15:59:00.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.686+0000 7f24139ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240c0cd880 con 0x7f240c0b8900 2023-07-14T15:59:00.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.686+0000 7f24139ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f240c0cafa0 con 0x7f240c0d15c0 2023-07-14T15:59:00.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.686+0000 7f241179b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f240c0b5e00 0x7f240c0cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:59:00.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.686+0000 7f241179b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f240c0b5e00 0x7f240c0cd340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34052/0 (socket says 172.21.15.37:34052) 2023-07-14T15:59:00.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.686+0000 7f241179b700 1 -- 172.21.15.37:0/910582360 learned_addr learned my addr 172.21.15.37:0/910582360 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:59:00.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.686+0000 7f2410f9a700 1 --2- 172.21.15.37:0/910582360 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f240c0b8900 0x7f240c1523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:59:00.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.687+0000 7f2411f9c700 1 --2- 172.21.15.37:0/910582360 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f240c0d15c0 0x7f240c09e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:59:00.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.687+0000 7f241179b700 1 -- 172.21.15.37:0/910582360 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f240c0d15c0 msgr2=0x7f240c09e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:59:00.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.687+0000 7f241179b700 1 --2- 172.21.15.37:0/910582360 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f240c0d15c0 0x7f240c09e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:59:00.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.687+0000 7f241179b700 1 -- 172.21.15.37:0/910582360 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f240c0b8900 msgr2=0x7f240c1523b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:59:00.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.687+0000 7f241179b700 1 --2- 172.21.15.37:0/910582360 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f240c0b8900 0x7f240c1523b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:59:00.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.687+0000 7f241179b700 1 -- 172.21.15.37:0/910582360 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2408009430 con 0x7f240c0b5e00 2023-07-14T15:59:00.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.687+0000 7f2411f9c700 1 --2- 172.21.15.37:0/910582360 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f240c0d15c0 0x7f240c09e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:59:00.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.687+0000 7f241179b700 1 --2- 172.21.15.37:0/910582360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f240c0b5e00 0x7f240c0cd340 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f2408000c00 tx=0x7f2408004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:59:00.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.687+0000 7f2401ffb700 1 -- 172.21.15.37:0/910582360 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2408025430 con 0x7f240c0b5e00 2023-07-14T15:59:00.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.687+0000 7f24139ff700 1 -- 172.21.15.37:0/910582360 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f240c0cb860 con 0x7f240c0b5e00 2023-07-14T15:59:00.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.687+0000 7f2401ffb700 1 -- 172.21.15.37:0/910582360 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2408020070 con 0x7f240c0b5e00 2023-07-14T15:59:00.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.687+0000 7f2401ffb700 1 -- 172.21.15.37:0/910582360 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24080257f0 con 0x7f240c0b5e00 2023-07-14T15:59:00.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.687+0000 7f24139ff700 1 -- 172.21.15.37:0/910582360 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f240c1528f0 con 0x7f240c0b5e00 2023-07-14T15:59:00.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.688+0000 7f24139ff700 1 -- 172.21.15.37:0/910582360 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f240c04e210 con 0x7f240c0b5e00 2023-07-14T15:59:00.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.690+0000 7f2401ffb700 1 -- 172.21.15.37:0/910582360 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f2408022030 con 0x7f240c0b5e00 2023-07-14T15:59:00.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.690+0000 7f2401ffb700 1 --2- 172.21.15.37:0/910582360 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f23f006ae00 0x7f23f006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:59:00.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.691+0000 7f2401ffb700 1 -- 172.21.15.37:0/910582360 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5324+0+0 (secure 0 0 0) 0x7f240808a930 con 0x7f240c0b5e00 2023-07-14T15:59:00.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.691+0000 7f2410f9a700 1 --2- 172.21.15.37:0/910582360 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f23f006ae00 0x7f23f006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:59:00.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.692+0000 7f2410f9a700 1 --2- 172.21.15.37:0/910582360 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f23f006ae00 0x7f23f006d2b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f240c15f870 tx=0x7f23fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:59:00.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.695+0000 7f2401ffb700 1 -- 172.21.15.37:0/910582360 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f2408055b20 con 0x7f240c0b5e00 2023-07-14T15:59:00.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.904+0000 7f24139ff700 1 -- 172.21.15.37:0/910582360 --> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f240c0ce3f0 con 0x7f23f006ae00 2023-07-14T15:59:00.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.905+0000 7f2401ffb700 1 -- 172.21.15.37:0/910582360 <== mgr.4100 v2:172.21.15.98:6832/3163748069 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f23fc0050d0 con 0x7f23f006ae00 2023-07-14T15:59:00.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.907+0000 7f24139ff700 1 -- 172.21.15.37:0/910582360 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f23f006ae00 msgr2=0x7f23f006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:59:00.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.907+0000 7f24139ff700 1 --2- 172.21.15.37:0/910582360 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f23f006ae00 0x7f23f006d2b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f240c15f870 tx=0x7f23fc009040 comp rx=0 tx=0).stop 2023-07-14T15:59:00.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.907+0000 7f24139ff700 1 -- 172.21.15.37:0/910582360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f240c0b5e00 msgr2=0x7f240c0cd340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:59:00.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.907+0000 7f24139ff700 1 --2- 172.21.15.37:0/910582360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f240c0b5e00 0x7f240c0cd340 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f2408000c00 tx=0x7f2408004750 comp rx=0 tx=0).stop 2023-07-14T15:59:00.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.907+0000 7f24139ff700 1 -- 172.21.15.37:0/910582360 shutdown_connections 2023-07-14T15:59:00.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.907+0000 7f24139ff700 1 --2- 172.21.15.37:0/910582360 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f23f006ae00 0x7f23f006d2b0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:59:00.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.908+0000 7f24139ff700 1 --2- 172.21.15.37:0/910582360 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f240c0d15c0 0x7f240c09e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:59:00.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.908+0000 7f24139ff700 1 --2- 172.21.15.37:0/910582360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f240c0b5e00 0x7f240c0cd340 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:59:00.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.908+0000 7f24139ff700 1 --2- 172.21.15.37:0/910582360 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f240c0b8900 0x7f240c1523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:59:00.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.908+0000 7f24139ff700 1 -- 172.21.15.37:0/910582360 >> 172.21.15.37:0/910582360 conn(0x7f240c09c1e0 msgr2=0x7f240c0b77b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:59:00.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.908+0000 7f24139ff700 1 -- 172.21.15.37:0/910582360 shutdown_connections 2023-07-14T15:59:00.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:00.908+0000 7f24139ff700 1 -- 172.21.15.37:0/910582360 wait complete. 2023-07-14T15:59:00.894 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 7 to deep-scrub 2023-07-14T15:59:00.909 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T15:59:01.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.127+0000 7f5c41dff700 1 Processor -- start 2023-07-14T15:59:01.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.127+0000 7f5c41dff700 1 -- start start 2023-07-14T15:59:01.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.129+0000 7f5c41dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5c3c0cffc0 0x7f5c3c0b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:59:01.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.129+0000 7f5c41dff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5c3c160c50 0x7f5c3c0cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:59:01.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.129+0000 7f5c41dff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c3c0cf6f0 con 0x7f5c3c0b8b80 2023-07-14T15:59:01.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.129+0000 7f5c41dff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c3c0d0de0 con 0x7f5c3c160c50 2023-07-14T15:59:01.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.129+0000 7f5c41dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3c1610f0 con 0x7f5c3c0cffc0 2023-07-14T15:59:01.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.129+0000 7f5c3bfff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5c3c160c50 0x7f5c3c0cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:59:01.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.129+0000 7f5c3bfff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5c3c160c50 0x7f5c3c0cf1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34058/0 (socket says 172.21.15.37:34058) 2023-07-14T15:59:01.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.129+0000 7f5c3bfff700 1 -- 172.21.15.37:0/2098370799 learned_addr learned my addr 172.21.15.37:0/2098370799 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:59:01.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.129+0000 7f5c33fff700 1 --2- 172.21.15.37:0/2098370799 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5c3c0cffc0 0x7f5c3c0b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:59:01.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.129+0000 7f5c3bfff700 1 -- 172.21.15.37:0/2098370799 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5c3c0cffc0 msgr2=0x7f5c3c0b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:59:01.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.129+0000 7f5c3bfff700 1 --2- 172.21.15.37:0/2098370799 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5c3c0cffc0 0x7f5c3c0b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:59:01.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.129+0000 7f5c3bfff700 1 -- 172.21.15.37:0/2098370799 >> v1:172.21.15.98:6789/0 conn(0x7f5c3c0b8b80 legacy=0x7f5c3c0cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:59:01.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.129+0000 7f5c3bfff700 1 -- 172.21.15.37:0/2098370799 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c3c0cd590 con 0x7f5c3c160c50 2023-07-14T15:59:01.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.129+0000 7f5c33fff700 1 --2- 172.21.15.37:0/2098370799 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5c3c0cffc0 0x7f5c3c0b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:59:01.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.130+0000 7f5c3bfff700 1 --2- 172.21.15.37:0/2098370799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c3c160c50 0x7f5c3c0cf1b0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f5c34009e50 tx=0x7f5c3400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19dca504e2399ea0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:59:01.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.130+0000 7f5c3affd700 1 -- 172.21.15.37:0/2098370799 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3400e070 con 0x7f5c3c160c50 2023-07-14T15:59:01.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.130+0000 7f5c3affd700 1 -- 172.21.15.37:0/2098370799 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c34003a20 con 0x7f5c3c160c50 2023-07-14T15:59:01.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.130+0000 7f5c3affd700 1 -- 172.21.15.37:0/2098370799 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c34003dd0 con 0x7f5c3c160c50 2023-07-14T15:59:01.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.130+0000 7f5c41dff700 1 -- 172.21.15.37:0/2098370799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c3c160c50 msgr2=0x7f5c3c0cf1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:59:01.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.130+0000 7f5c41dff700 1 --2- 172.21.15.37:0/2098370799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c3c160c50 0x7f5c3c0cf1b0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f5c34009e50 tx=0x7f5c3400b330 comp rx=0 tx=0).stop 2023-07-14T15:59:01.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.131+0000 7f5c41dff700 1 -- 172.21.15.37:0/2098370799 shutdown_connections 2023-07-14T15:59:01.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.131+0000 7f5c41dff700 1 --2- 172.21.15.37:0/2098370799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c3c160c50 0x7f5c3c0cf1b0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:59:01.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.131+0000 7f5c41dff700 1 --2- 172.21.15.37:0/2098370799 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5c3c0cffc0 0x7f5c3c0b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:59:01.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.131+0000 7f5c41dff700 1 -- 172.21.15.37:0/2098370799 >> 172.21.15.37:0/2098370799 conn(0x7f5c3c06b150 msgr2=0x7f5c3c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:59:01.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.131+0000 7f5c41dff700 1 -- 172.21.15.37:0/2098370799 shutdown_connections 2023-07-14T15:59:01.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.131+0000 7f5c41dff700 1 -- 172.21.15.37:0/2098370799 wait complete. 2023-07-14T15:59:01.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.132+0000 7f5c41dff700 1 Processor -- start 2023-07-14T15:59:01.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.133+0000 7f5c41dff700 1 -- start start 2023-07-14T15:59:01.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.134+0000 7f5c41dff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c3c0b8b80 0x7f5c3c0cc870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:59:01.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.134+0000 7f5c41dff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5c3c0cffc0 0x7f5c3c0b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:59:01.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.134+0000 7f5c41dff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c3c160c50 0x7f5c3c0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:59:01.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.134+0000 7f5c41dff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3c0ca710 con 0x7f5c3c160c50 2023-07-14T15:59:01.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.134+0000 7f5c41dff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3c0b2810 con 0x7f5c3c0b8b80 2023-07-14T15:59:01.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.134+0000 7f5c41dff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3c0b2af0 con 0x7f5c3c0cffc0 2023-07-14T15:59:01.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.134+0000 7f5c3bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c3c160c50 0x7f5c3c0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:59:01.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.134+0000 7f5c3bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c3c160c50 0x7f5c3c0b78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34066/0 (socket says 172.21.15.37:34066) 2023-07-14T15:59:01.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.134+0000 7f5c3b7fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c3c0b8b80 0x7f5c3c0cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:59:01.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.134+0000 7f5c3bfff700 1 -- 172.21.15.37:0/706445838 learned_addr learned my addr 172.21.15.37:0/706445838 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:59:01.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.134+0000 7f5c33fff700 1 --2- 172.21.15.37:0/706445838 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5c3c0cffc0 0x7f5c3c0b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:59:01.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.134+0000 7f5c3bfff700 1 -- 172.21.15.37:0/706445838 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5c3c0cffc0 msgr2=0x7f5c3c0b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:59:01.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.134+0000 7f5c3bfff700 1 --2- 172.21.15.37:0/706445838 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5c3c0cffc0 0x7f5c3c0b46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:59:01.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.134+0000 7f5c3bfff700 1 -- 172.21.15.37:0/706445838 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c3c0b8b80 msgr2=0x7f5c3c0cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:59:01.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.134+0000 7f5c3bfff700 1 --2- 172.21.15.37:0/706445838 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c3c0b8b80 0x7f5c3c0cc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:59:01.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.134+0000 7f5c3bfff700 1 -- 172.21.15.37:0/706445838 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c34009b30 con 0x7f5c3c160c50 2023-07-14T15:59:01.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.135+0000 7f5c3bfff700 1 --2- 172.21.15.37:0/706445838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c3c160c50 0x7f5c3c0b78b0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c066a70 tx=0x7f5c34004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:59:01.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.135+0000 7f5c38ff9700 1 -- 172.21.15.37:0/706445838 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c34004440 con 0x7f5c3c160c50 2023-07-14T15:59:01.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.135+0000 7f5c38ff9700 1 -- 172.21.15.37:0/706445838 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c340045c0 con 0x7f5c3c160c50 2023-07-14T15:59:01.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.135+0000 7f5c38ff9700 1 -- 172.21.15.37:0/706445838 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c34004970 con 0x7f5c3c160c50 2023-07-14T15:59:01.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.135+0000 7f5c41dff700 1 -- 172.21.15.37:0/706445838 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c3c0b2dd0 con 0x7f5c3c160c50 2023-07-14T15:59:01.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.135+0000 7f5c41dff700 1 -- 172.21.15.37:0/706445838 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c3c0ccdb0 con 0x7f5c3c160c50 2023-07-14T15:59:01.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.136+0000 7f5c41dff700 1 -- 172.21.15.37:0/706445838 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c3c067840 con 0x7f5c3c160c50 2023-07-14T15:59:01.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.137+0000 7f5c38ff9700 1 -- 172.21.15.37:0/706445838 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f5c34012430 con 0x7f5c3c160c50 2023-07-14T15:59:01.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.138+0000 7f5c38ff9700 1 --2- 172.21.15.37:0/706445838 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f5c1c06ae30 0x7f5c1c06d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:59:01.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.138+0000 7f5c38ff9700 1 -- 172.21.15.37:0/706445838 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5324+0+0 (secure 0 0 0) 0x7f5c3408a830 con 0x7f5c3c160c50 2023-07-14T15:59:01.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.139+0000 7f5c3b7fe700 1 --2- 172.21.15.37:0/706445838 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f5c1c06ae30 0x7f5c1c06d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:59:01.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.139+0000 7f5c3b7fe700 1 --2- 172.21.15.37:0/706445838 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f5c1c06ae30 0x7f5c1c06d2e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c009960 tx=0x7f5c2c0090e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:59:01.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.142+0000 7f5c38ff9700 1 -- 172.21.15.37:0/706445838 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5c34059420 con 0x7f5c3c160c50 2023-07-14T15:59:01.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.348+0000 7f5c41dff700 1 -- 172.21.15.37:0/706445838 --> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5c3c0cdb50 con 0x7f5c1c06ae30 2023-07-14T15:59:01.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.352+0000 7f5c38ff9700 1 -- 172.21.15.37:0/706445838 <== mgr.4100 v2:172.21.15.98:6832/3163748069 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72758 (secure 0 0 0) 0x7f5c2c009e30 con 0x7f5c1c06ae30 2023-07-14T15:59:01.337 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:59:01.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.353+0000 7f5c41dff700 1 -- 172.21.15.37:0/706445838 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f5c1c06ae30 msgr2=0x7f5c1c06d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:59:01.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.353+0000 7f5c41dff700 1 --2- 172.21.15.37:0/706445838 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f5c1c06ae30 0x7f5c1c06d2e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c009960 tx=0x7f5c2c0090e0 comp rx=0 tx=0).stop 2023-07-14T15:59:01.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.354+0000 7f5c41dff700 1 -- 172.21.15.37:0/706445838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c3c160c50 msgr2=0x7f5c3c0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:59:01.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.354+0000 7f5c41dff700 1 --2- 172.21.15.37:0/706445838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c3c160c50 0x7f5c3c0b78b0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c066a70 tx=0x7f5c34004ad0 comp rx=0 tx=0).stop 2023-07-14T15:59:01.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.354+0000 7f5c41dff700 1 -- 172.21.15.37:0/706445838 shutdown_connections 2023-07-14T15:59:01.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.354+0000 7f5c41dff700 1 --2- 172.21.15.37:0/706445838 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c3c0b8b80 0x7f5c3c0cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:59:01.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.354+0000 7f5c41dff700 1 --2- 172.21.15.37:0/706445838 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f5c1c06ae30 0x7f5c1c06d2e0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:59:01.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.354+0000 7f5c41dff700 1 --2- 172.21.15.37:0/706445838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c3c160c50 0x7f5c3c0b78b0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:59:01.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.354+0000 7f5c41dff700 1 --2- 172.21.15.37:0/706445838 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f5c3c0cffc0 0x7f5c3c0b46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:59:01.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.354+0000 7f5c41dff700 1 -- 172.21.15.37:0/706445838 >> 172.21.15.37:0/706445838 conn(0x7f5c3c06b150 msgr2=0x7f5c3c15ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:59:01.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.354+0000 7f5c41dff700 1 -- 172.21.15.37:0/706445838 shutdown_connections 2023-07-14T15:59:01.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:01.354+0000 7f5c41dff700 1 -- 172.21.15.37:0/706445838 wait complete. 2023-07-14T15:59:01.344 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-14T15:59:01.356 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2023-07-14T15:59:00.897170+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":229832,"kb_used_data":6024,"kb_used_omap":0,"kb_used_meta":223744,"kb_avail":754744888,"statfs":{"total":773094113280,"available":772858765312,"internally_reserved":0,"allocated":6168576,"data_stored":3324680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":229113856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.881683"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-07-14T15:58:49.020648+0000","last_change":"2023-07-14T15:56:02.621850+0000","last_active":"2023-07-14T15:58:49.020648+0000","last_peered":"2023-07-14T15:58:49.020648+0000","last_clean":"2023-07-14T15:58:49.020648+0000","last_became_active":"2023-07-14T15:56:02.621471+0000","last_became_peered":"2023-07-14T15:56:02.621471+0000","last_unstale":"2023-07-14T15:58:49.020648+0000","last_undegraded":"2023-07-14T15:58:49.020648+0000","last_fullsized":"2023-07-14T15:58:49.020648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:32:25.879998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":76,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-07-14T15:58:49.022821+0000","last_change":"2023-07-14T15:56:02.621963+0000","last_active":"2023-07-14T15:58:49.022821+0000","last_peered":"2023-07-14T15:58:49.022821+0000","last_clean":"2023-07-14T15:58:49.022821+0000","last_became_active":"2023-07-14T15:56:02.621678+0000","last_became_peered":"2023-07-14T15:56:02.621678+0000","last_unstale":"2023-07-14T15:58:49.022821+0000","last_undegraded":"2023-07-14T15:58:49.022821+0000","last_fullsized":"2023-07-14T15:58:49.022821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:04:23.258253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":68,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-07-14T15:58:49.637836+0000","last_change":"2023-07-14T15:56:01.925110+0000","last_active":"2023-07-14T15:58:49.637836+0000","last_peered":"2023-07-14T15:58:49.637836+0000","last_clean":"2023-07-14T15:58:49.637836+0000","last_became_active":"2023-07-14T15:56:01.924723+0000","last_became_peered":"2023-07-14T15:56:01.924723+0000","last_unstale":"2023-07-14T15:58:49.637836+0000","last_undegraded":"2023-07-14T15:58:49.637836+0000","last_fullsized":"2023-07-14T15:58:49.637836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:48:43.112589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":76,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-07-14T15:58:49.023050+0000","last_change":"2023-07-14T15:56:01.923465+0000","last_active":"2023-07-14T15:58:49.023050+0000","last_peered":"2023-07-14T15:58:49.023050+0000","last_clean":"2023-07-14T15:58:49.023050+0000","last_became_active":"2023-07-14T15:56:01.923160+0000","last_became_peered":"2023-07-14T15:56:01.923160+0000","last_unstale":"2023-07-14T15:58:49.023050+0000","last_undegraded":"2023-07-14T15:58:49.023050+0000","last_fullsized":"2023-07-14T15:58:49.023050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:19:10.375590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":219,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-07-14T15:58:49.637985+0000","last_change":"2023-07-14T15:55:54.040065+0000","last_active":"2023-07-14T15:58:49.637985+0000","last_peered":"2023-07-14T15:58:49.637985+0000","last_clean":"2023-07-14T15:58:49.637985+0000","last_became_active":"2023-07-14T15:55:54.038885+0000","last_became_peered":"2023-07-14T15:55:54.038885+0000","last_unstale":"2023-07-14T15:58:49.637985+0000","last_undegraded":"2023-07-14T15:58:49.637985+0000","last_fullsized":"2023-07-14T15:58:49.637985+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:55:53.025696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:55:53.025696+0000","last_clean_scrub_stamp":"2023-07-14T15:55:53.025696+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":76,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-07-14T15:58:49.021969+0000","last_change":"2023-07-14T15:56:01.920714+0000","last_active":"2023-07-14T15:58:49.021969+0000","last_peered":"2023-07-14T15:58:49.021969+0000","last_clean":"2023-07-14T15:58:49.021969+0000","last_became_active":"2023-07-14T15:56:01.920325+0000","last_became_peered":"2023-07-14T15:56:01.920325+0000","last_unstale":"2023-07-14T15:58:49.021969+0000","last_undegraded":"2023-07-14T15:58:49.021969+0000","last_fullsized":"2023-07-14T15:58:49.021969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:22:23.672347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":76,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-07-14T15:58:49.022152+0000","last_change":"2023-07-14T15:56:01.923631+0000","last_active":"2023-07-14T15:58:49.022152+0000","last_peered":"2023-07-14T15:58:49.022152+0000","last_clean":"2023-07-14T15:58:49.022152+0000","last_became_active":"2023-07-14T15:56:01.922783+0000","last_became_peered":"2023-07-14T15:56:01.922783+0000","last_unstale":"2023-07-14T15:58:49.022152+0000","last_undegraded":"2023-07-14T15:58:49.022152+0000","last_fullsized":"2023-07-14T15:58:49.022152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:07:51.242019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":68,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-07-14T15:58:49.022876+0000","last_change":"2023-07-14T15:56:01.965649+0000","last_active":"2023-07-14T15:58:49.022876+0000","last_peered":"2023-07-14T15:58:49.022876+0000","last_clean":"2023-07-14T15:58:49.022876+0000","last_became_active":"2023-07-14T15:56:01.965344+0000","last_became_peered":"2023-07-14T15:56:01.965344+0000","last_unstale":"2023-07-14T15:58:49.022876+0000","last_undegraded":"2023-07-14T15:58:49.022876+0000","last_fullsized":"2023-07-14T15:58:49.022876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:06:39.002161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":76,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-07-14T15:58:49.021996+0000","last_change":"2023-07-14T15:56:01.966578+0000","last_active":"2023-07-14T15:58:49.021996+0000","last_peered":"2023-07-14T15:58:49.021996+0000","last_clean":"2023-07-14T15:58:49.021996+0000","last_became_active":"2023-07-14T15:56:01.966216+0000","last_became_peered":"2023-07-14T15:56:01.966216+0000","last_unstale":"2023-07-14T15:58:49.021996+0000","last_undegraded":"2023-07-14T15:58:49.021996+0000","last_fullsized":"2023-07-14T15:58:49.021996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:56:00.906542+0000","last_clean_scrub_stamp":"2023-07-14T15:56:00.906542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:09:24.441002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476777,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31656,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340184,"statfs":{"total":96636764160,"available":96604348416,"internally_reserved":0,"allocated":622592,"data_stored":267993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.44800000000000001,"15min":0.45000000000000001},"min":{"1min":0.29799999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.58999999999999997,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.46300000000000002,"15min":0.47299999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.57599999999999996,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.39100000000000001}]},{"osd":1,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.57799999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.52100000000000002,"15min":0.52300000000000002},"min":{"1min":0.38600000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.67500000000000004,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.50800000000000001}]},{"osd":2,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.504,"15min":0.505},"min":{"1min":0.40300000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.66700000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.74199999999999999,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.47499999999999998}]},{"osd":4,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.755,"15min":0.76500000000000001},"min":{"1min":0.503,"5min":0.441,"15min":0.441},"max":{"1min":1.0189999999999999,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.76600000000000001,"15min":0.77400000000000002},"min":{"1min":0.53900000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.88400000000000001,"5min":1.542,"15min":1.542},"last":0.61499999999999999}]},{"osd":5,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.84199999999999997,"15min":0.85599999999999998},"min":{"1min":0.625,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.95299999999999996,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.84599999999999997,"15min":0.85699999999999998},"min":{"1min":0.60899999999999999,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.94599999999999995,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.72699999999999998}]},{"osd":6,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.80800000000000005,"15min":0.81899999999999995},"min":{"1min":0.55900000000000005,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.98799999999999999,"5min":1.52,"15min":1.52},"last":0.753},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.79900000000000004,"15min":0.81200000000000006},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.86099999999999999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.75900000000000001}]},{"osd":7,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.77400000000000002,"15min":0.77700000000000002},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.96499999999999997,"5min":1.232,"15min":1.232},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.84299999999999997,"15min":0.85699999999999998},"min":{"1min":0.55500000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.94899999999999995,"5min":1.478,"15min":1.478},"last":0.58999999999999997}]}]},{"osd":0,"up_from":16,"seq":68719476778,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":622592,"data_stored":267993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42299999999999999,"15min":0.42399999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.67500000000000004,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.48499999999999999,"15min":0.48899999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.61599999999999999,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.46400000000000002}]},{"osd":2,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.499,"15min":0.5},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.50800000000000001,"15min":0.505},"min":{"1min":0.41499999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.504}]},{"osd":3,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47899999999999998,"15min":0.48099999999999998},"min":{"1min":0.38100000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.60699999999999998,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.57299999999999995,"15min":0.57699999999999996},"min":{"1min":0.42399999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76500000000000001,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.42799999999999999}]},{"osd":4,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.99399999999999999,"5min":1.04,"15min":1.04},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.78000000000000003,"15min":0.78900000000000003},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.91000000000000003,"5min":1.331,"15min":1.331},"last":0.53500000000000003}]},{"osd":5,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.60999999999999999,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.119,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.56999999999999995,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0289999999999999,"5min":1.087,"15min":1.087},"last":0.57599999999999996}]},{"osd":6,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.77500000000000002,"15min":0.78100000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0029999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.80100000000000005,"15min":0.80500000000000005},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.056,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.751}]},{"osd":7,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.80100000000000005,"15min":0.80800000000000005},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.99399999999999999,"5min":1.262,"15min":1.262},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.79700000000000004,"15min":0.80100000000000005},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.97799999999999998,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.63400000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542184,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":622592,"data_stored":267993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.621,"15min":0.61699999999999999},"min":{"1min":0.40999999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.82399999999999995,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64700000000000002,"15min":0.64600000000000002},"min":{"1min":0.496,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81599999999999995,"5min":1.266,"15min":1.266},"last":0.66700000000000004}]},{"osd":1,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.69799999999999995,"15min":0.70299999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88700000000000001,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.753,"5min":0.72199999999999998,"15min":0.71699999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.79700000000000004}]},{"osd":2,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.88500000000000001,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.746},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.68600000000000005,"15min":0.69099999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.81299999999999994}]},{"osd":3,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.78200000000000003,"15min":0.80400000000000005},"min":{"1min":0.48099999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.85999999999999999,"5min":3.141,"15min":3.141},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.752,"15min":0.753},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.94999999999999996,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.86599999999999999}]},{"osd":4,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.63,"15min":0.63300000000000001},"min":{"1min":0.432,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.83499999999999996,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.70899999999999996,"15min":0.71199999999999997},"min":{"1min":0.47599999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.92300000000000004,"5min":1.024,"15min":1.024},"last":0.59399999999999997}]},{"osd":5,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.748,"15min":0.751},"min":{"1min":0.51700000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.96999999999999997,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73599999999999999,"15min":0.73999999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.012,"5min":1.091,"15min":1.091},"last":0.434}]},{"osd":7,"last update":"Fri Jul 14 15:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.72499999999999998,"15min":0.72899999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.92500000000000004,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.82399999999999995,"15min":0.82899999999999996},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":0.996,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.68700000000000006}]}]},{"osd":1,"up_from":14,"seq":60129542183,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1216512,"data_stored":858361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.60699999999999998,"15min":0.64200000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.53100000000000003,"5min":4.5519999999999996,"15min":4.5519999999999996},"last":0.499},{"interface":"front","average":{"1min":0.46200000000000002,"5min":1.147,"15min":1.2609999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.70899999999999996,"5min":15.911,"15min":15.911},"last":0.314}]},{"osd":2,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.45700000000000002,"15min":0.46400000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.53300000000000003,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.624},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.67300000000000004,"15min":0.70599999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.57299999999999995,"5min":4.5140000000000002,"15min":4.5140000000000002},"last":0.65400000000000003}]},{"osd":3,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.70199999999999996,"15min":0.73599999999999999},"min":{"1min":0.378,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.65500000000000003,"5min":4.452,"15min":4.452},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.70299999999999996,"15min":0.73899999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.57999999999999996,"5min":4.2279999999999998,"15min":4.2279999999999998},"last":0.72799999999999998}]},{"osd":4,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.88400000000000001,"15min":0.92000000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.81899999999999995,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":0.75},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.92200000000000004,"15min":0.95999999999999996},"min":{"1min":0.52400000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.95699999999999996,"5min":4.9109999999999996,"15min":4.9109999999999996},"last":0.76500000000000001}]},{"osd":5,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.90000000000000002,"15min":0.93300000000000005},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.98999999999999999,"5min":4.1269999999999998,"15min":4.1269999999999998},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.93799999999999994,"15min":0.97399999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.93700000000000006,"5min":4.585,"15min":4.585},"last":0.70999999999999996}]},{"osd":6,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.93300000000000005,"15min":0.97099999999999997},"min":{"1min":0.56899999999999995,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0369999999999999,"5min":4.9880000000000004,"15min":4.9880000000000004},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.92900000000000005,"15min":0.96299999999999997},"min":{"1min":0.58499999999999996,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94599999999999995,"5min":4.1660000000000004,"15min":4.1660000000000004},"last":0.85599999999999998}]},{"osd":7,"last update":"Fri Jul 14 15:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.98199999999999998,"15min":1.0249999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.0429999999999999,"5min":4.9530000000000003,"15min":4.9530000000000003},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.94599999999999995,"15min":0.98099999999999998},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.048,"5min":4.1959999999999997,"15min":4.1959999999999997},"last":0.82199999999999995}]}]},{"osd":2,"up_from":15,"seq":64424509481,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":622592,"data_stored":267993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:58:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.41799999999999998,"15min":0.42999999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.498,"5min":0.62,"15min":0.62},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.46000000000000002,"15min":0.47899999999999998},"min":{"1min":0.30099999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.59399999999999997,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.57899999999999996}]},{"osd":1,"last update":"Fri Jul 14 15:58:54 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.51300000000000001,"15min":0.52700000000000002},"min":{"1min":0.36599999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.58999999999999997,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.45900000000000002,"15min":0.46700000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.56699999999999995,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.49199999999999999}]},{"osd":3,"last update":"Fri Jul 14 15:58:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.57199999999999995,"15min":0.59699999999999998},"min":{"1min":0.45000000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.69399999999999995,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.52200000000000002,"15min":0.53500000000000003},"min":{"1min":0.41099999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.61699999999999999,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.39900000000000002}]},{"osd":4,"last update":"Fri Jul 14 15:58:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72499999999999998,"15min":0.72799999999999998},"min":{"1min":0.55400000000000005,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.95499999999999996,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.438},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.73399999999999999,"15min":0.74399999999999999},"min":{"1min":0.52600000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.93200000000000005,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.51800000000000002}]},{"osd":5,"last update":"Fri Jul 14 15:58:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.76300000000000001,"15min":0.77700000000000002},"min":{"1min":0.56699999999999995,"5min":0.505,"15min":0.505},"max":{"1min":0.97399999999999998,"5min":1.391,"15min":1.391},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.74299999999999999,"15min":0.75700000000000001},"min":{"1min":0.51900000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.94599999999999995,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.55400000000000005}]},{"osd":6,"last update":"Fri Jul 14 15:58:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.77500000000000002,"15min":0.79800000000000004},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.89000000000000001,"5min":1.51,"15min":1.51},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.79800000000000004,"15min":0.82399999999999995},"min":{"1min":0.625,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":0.93300000000000005,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.626}]},{"osd":7,"last update":"Fri Jul 14 15:58:54 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.77200000000000002,"15min":0.79000000000000004},"min":{"1min":0.55900000000000005,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.94699999999999995,"5min":1.288,"15min":1.288},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80600000000000005,"15min":0.82399999999999995},"min":{"1min":0.60299999999999998,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":0.95899999999999996,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.67800000000000005}]}]},{"osd":4,"up_from":15,"seq":64424509480,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":622592,"data_stored":267993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:58:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.66800000000000004,"15min":0.68400000000000005},"min":{"1min":0.48799999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80100000000000005,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65200000000000002,"15min":0.65900000000000003},"min":{"1min":0.46600000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.70499999999999996}]},{"osd":1,"last update":"Fri Jul 14 15:58:54 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66700000000000004,"15min":0.67500000000000004},"min":{"1min":0.505,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.82999999999999996,"5min":0.87,"15min":0.87},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.65100000000000002,"15min":0.66000000000000003},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90700000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.60799999999999998}]},{"osd":2,"last update":"Fri Jul 14 15:58:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.439,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.88200000000000001,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.70599999999999996,"15min":0.72599999999999998},"min":{"1min":0.52800000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.85299999999999998,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.66900000000000004}]},{"osd":3,"last update":"Fri Jul 14 15:58:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68300000000000005,"15min":0.68799999999999994},"min":{"1min":0.47399999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.80500000000000005,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72599999999999998,"15min":0.73399999999999999},"min":{"1min":0.53000000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.81799999999999995,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.58799999999999997}]},{"osd":5,"last update":"Fri Jul 14 15:58:54 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.65800000000000003,"15min":0.66400000000000003},"min":{"1min":0.432,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.84299999999999997,"5min":1.119,"15min":1.119},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.69399999999999995,"15min":0.71199999999999997},"min":{"1min":0.48699999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.82199999999999995,"5min":1.157,"15min":1.157},"last":0.46600000000000003}]},{"osd":6,"last update":"Fri Jul 14 15:58:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69399999999999995,"15min":0.71099999999999997},"min":{"1min":0.49399999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92200000000000004,"5min":1.04,"15min":1.04},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72399999999999998,"15min":0.73799999999999999},"min":{"1min":0.54700000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.86699999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.49399999999999999}]},{"osd":7,"last update":"Fri Jul 14 15:58:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.746,"15min":0.76400000000000001},"min":{"1min":0.53000000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.95499999999999996,"5min":1.202,"15min":1.202},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.77100000000000002,"15min":0.78900000000000003},"min":{"1min":0.57999999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.879,"5min":1.137,"15min":1.137},"last":0.629}]}]},{"osd":5,"up_from":15,"seq":64424509482,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28140,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343700,"statfs":{"total":96636764160,"available":96607948800,"internally_reserved":0,"allocated":1216512,"data_stored":858361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.66400000000000003,"15min":0.67200000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.86099999999999999,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.97799999999999998,"15min":1.038},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.80600000000000005,"5min":8.1500000000000004,"15min":8.1500000000000004},"last":0.57999999999999996}]},{"osd":1,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.67200000000000004,"15min":0.67600000000000005},"min":{"1min":0.51200000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.98799999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.66400000000000003,"15min":0.67000000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.76800000000000002,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.66500000000000004}]},{"osd":2,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.75800000000000001,"15min":0.77100000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.873,"5min":1.085,"15min":1.085},"last":0.755},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.72499999999999998,"15min":0.73699999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.86599999999999999,"5min":1.048,"15min":1.048},"last":0.53700000000000003}]},{"osd":3,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.69299999999999995,"15min":0.70099999999999996},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.82299999999999995,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.80000000000000004,"15min":0.81000000000000005},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":0.91700000000000004,"5min":1.083,"15min":1.083},"last":0.64700000000000002}]},{"osd":4,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68999999999999995,"15min":0.69199999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.65700000000000003,"15min":0.66300000000000003},"min":{"1min":0.441,"5min":0.438,"15min":0.438},"max":{"1min":0.82099999999999995,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.72899999999999998}]},{"osd":6,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.69899999999999995,"15min":0.71299999999999997},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.871,"5min":1.121,"15min":1.121},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.78700000000000003,"15min":0.80100000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.93799999999999994,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.79400000000000004}]},{"osd":7,"last update":"Fri Jul 14 15:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.74399999999999999,"15min":0.751},"min":{"1min":0.58199999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.875,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.628},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.81699999999999995,"15min":0.83099999999999996},"min":{"1min":0.53800000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.94699999999999995,"5min":1.605,"15min":1.605},"last":0.61499999999999999}]}]},{"osd":7,"up_from":15,"seq":64424509481,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":622592,"data_stored":267993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.61799999999999999,"15min":0.61499999999999999},"min":{"1min":0.39300000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0089999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.80400000000000005,"15min":0.82499999999999996},"min":{"1min":0.44400000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0820000000000001,"5min":4.5919999999999996,"15min":4.5919999999999996},"last":0.73899999999999999}]},{"osd":1,"last update":"Fri Jul 14 15:58:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.66300000000000003,"15min":0.66800000000000004},"min":{"1min":0.43099999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.93700000000000006,"5min":1,"15min":1},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.80800000000000005,"15min":0.878},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.81499999999999995,"5min":4.665,"15min":4.665},"last":0.498}]},{"osd":2,"last update":"Fri Jul 14 15:58:54 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.81799999999999995,"15min":0.89400000000000002},"min":{"1min":0.47699999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.80000000000000004,"5min":5.4089999999999998,"15min":5.4089999999999998},"last":0.63},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.747,"15min":0.76900000000000002},"min":{"1min":0.48099999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0760000000000001,"5min":2.165,"15min":2.165},"last":0.79100000000000004}]},{"osd":3,"last update":"Fri Jul 14 15:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.753,"15min":0.76100000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.96199999999999997,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.80600000000000005,"15min":0.82399999999999995},"min":{"1min":0.49299999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.92500000000000004,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":0.70599999999999996}]},{"osd":4,"last update":"Fri Jul 14 15:58:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0409999999999999,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.66000000000000003,"15min":0.66100000000000003},"min":{"1min":0.40600000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0489999999999999,"5min":1.111,"15min":1.111},"last":0.56699999999999995}]},{"osd":5,"last update":"Fri Jul 14 15:58:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.66100000000000003,"15min":0.66300000000000003},"min":{"1min":0.53200000000000003,"5min":0.37,"15min":0.37},"max":{"1min":1.052,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.74199999999999999,"15min":0.748},"min":{"1min":0.56799999999999995,"5min":0.371,"15min":0.371},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.83199999999999996}]},{"osd":6,"last update":"Fri Jul 14 15:58:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.69999999999999996,"15min":0.70599999999999996},"min":{"1min":0.58999999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.97299999999999998,"5min":1.042,"15min":1.042},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75600000000000001,"15min":0.77600000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1319999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.80900000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T15:59:01.360 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-07-14T15:56:00.906542+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=15, tm_min=56, tm_sec=0, tm_wday=4, tm_yday=195, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=15, tm_min=58, tm_sec=54, tm_wday=4, tm_yday=195, tm_isdst=0) 2023-07-14T15:59:01.361 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-07-14T15:56:00.906542+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=15, tm_min=56, tm_sec=0, tm_wday=4, tm_yday=195, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=15, tm_min=58, tm_sec=54, tm_wday=4, tm_yday=195, tm_isdst=0) 2023-07-14T15:59:01.361 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-07-14T15:56:00.906542+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=15, tm_min=56, tm_sec=0, tm_wday=4, tm_yday=195, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=15, tm_min=58, tm_sec=54, tm_wday=4, tm_yday=195, tm_isdst=0) 2023-07-14T15:59:01.362 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-07-14T15:56:00.906542+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=15, tm_min=56, tm_sec=0, tm_wday=4, tm_yday=195, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=15, tm_min=58, tm_sec=54, tm_wday=4, tm_yday=195, tm_isdst=0) 2023-07-14T15:59:01.362 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-07-14T15:55:53.025696+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=15, tm_min=55, tm_sec=53, tm_wday=4, tm_yday=195, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=15, tm_min=58, tm_sec=54, tm_wday=4, tm_yday=195, tm_isdst=0) 2023-07-14T15:59:01.362 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-07-14T15:56:00.906542+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=15, tm_min=56, tm_sec=0, tm_wday=4, tm_yday=195, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=15, tm_min=58, tm_sec=54, tm_wday=4, tm_yday=195, tm_isdst=0) 2023-07-14T15:59:01.362 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-07-14T15:56:00.906542+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=15, tm_min=56, tm_sec=0, tm_wday=4, tm_yday=195, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=15, tm_min=58, tm_sec=54, tm_wday=4, tm_yday=195, tm_isdst=0) 2023-07-14T15:59:01.363 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-07-14T15:56:00.906542+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=15, tm_min=56, tm_sec=0, tm_wday=4, tm_yday=195, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=15, tm_min=58, tm_sec=54, tm_wday=4, tm_yday=195, tm_isdst=0) 2023-07-14T15:59:01.363 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-07-14T15:56:00.906542+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=15, tm_min=56, tm_sec=0, tm_wday=4, tm_yday=195, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=15, tm_min=58, tm_sec=54, tm_wday=4, tm_yday=195, tm_isdst=0) 2023-07-14T15:59:01.363 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-07-14T15:59:21.364 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T15:59:21.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.595+0000 7f9577bff700 1 Processor -- start 2023-07-14T15:59:21.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.596+0000 7f9577bff700 1 -- start start 2023-07-14T15:59:21.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.597+0000 7f9577bff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f95700b8650 0x7f95700d0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:59:21.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.597+0000 7f9577bff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f95700cfda0 0x7f957015cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:59:21.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.597+0000 7f9577bff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95700cd540 con 0x7f95700b24e0 2023-07-14T15:59:21.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.597+0000 7f9577bff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95700d1000 con 0x7f95700b8650 2023-07-14T15:59:21.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.597+0000 7f9577bff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95700d0240 con 0x7f95700cfda0 2023-07-14T15:59:21.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.597+0000 7f957619c700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f95700cfda0 0x7f957015cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:59:21.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.597+0000 7f957599b700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7f95700b8650 0x7f95700d0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:59:21.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.597+0000 7f957519a700 1 --1- >> v1:172.21.15.98:6789/0 conn(0x7f95700b24e0 0x7f95700cf690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.37:56456/0 (socket says 172.21.15.37:56456) 2023-07-14T15:59:21.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.597+0000 7f957519a700 1 -- 172.21.15.37:0/2932854827 learned_addr learned my addr 172.21.15.37:0/2932854827 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:59:21.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.598+0000 7f9574999700 1 -- 172.21.15.37:0/2932854827 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2450552871 0 0) 0x7f95700cd540 con 0x7f95700b24e0 2023-07-14T15:59:21.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.598+0000 7f957619c700 1 -- 172.21.15.37:0/2932854827 >> v2:172.21.15.98:3300/0 conn(0x7f95700b8650 msgr2=0x7f95700d0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T15:59:21.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.598+0000 7f957619c700 1 --2- 172.21.15.37:0/2932854827 >> v2:172.21.15.98:3300/0 conn(0x7f95700b8650 0x7f95700d0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:59:21.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.598+0000 7f957619c700 1 -- 172.21.15.37:0/2932854827 >> v1:172.21.15.98:6789/0 conn(0x7f95700b24e0 legacy=0x7f95700cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:59:21.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.598+0000 7f957619c700 1 -- 172.21.15.37:0/2932854827 --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9570160f70 con 0x7f95700cfda0 2023-07-14T15:59:21.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.598+0000 7f957619c700 1 --2- 172.21.15.37:0/2932854827 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f95700cfda0 0x7f957015cc20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9568009d90 tx=0x7f956800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7cd023e0168808ab server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:59:21.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.599+0000 7f9574999700 1 -- 172.21.15.37:0/2932854827 <== mon.2 v2:172.21.15.98:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956800e070 con 0x7f95700cfda0 2023-07-14T15:59:21.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.599+0000 7f9574999700 1 -- 172.21.15.37:0/2932854827 <== mon.2 v2:172.21.15.98:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f956800bb20 con 0x7f95700cfda0 2023-07-14T15:59:21.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.599+0000 7f9574999700 1 -- 172.21.15.37:0/2932854827 <== mon.2 v2:172.21.15.98:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9568012430 con 0x7f95700cfda0 2023-07-14T15:59:21.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.599+0000 7f9577bff700 1 -- 172.21.15.37:0/2932854827 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f95700cfda0 msgr2=0x7f957015cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:59:21.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.599+0000 7f9577bff700 1 --2- 172.21.15.37:0/2932854827 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f95700cfda0 0x7f957015cc20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9568009d90 tx=0x7f956800b330 comp rx=0 tx=0).stop 2023-07-14T15:59:21.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.599+0000 7f9577bff700 1 -- 172.21.15.37:0/2932854827 shutdown_connections 2023-07-14T15:59:21.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.599+0000 7f9577bff700 1 --2- 172.21.15.37:0/2932854827 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f95700cfda0 0x7f957015cc20 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:59:21.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.599+0000 7f9577bff700 1 --2- 172.21.15.37:0/2932854827 >> v2:172.21.15.98:3300/0 conn(0x7f95700b8650 0x7f95700d0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:59:21.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.599+0000 7f9577bff700 1 -- 172.21.15.37:0/2932854827 >> 172.21.15.37:0/2932854827 conn(0x7f957006c0f0 msgr2=0x7f957006c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:59:21.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.599+0000 7f9577bff700 1 -- 172.21.15.37:0/2932854827 shutdown_connections 2023-07-14T15:59:21.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.599+0000 7f9577bff700 1 -- 172.21.15.37:0/2932854827 wait complete. 2023-07-14T15:59:21.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.601+0000 7f9577bff700 1 Processor -- start 2023-07-14T15:59:21.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.601+0000 7f9577bff700 1 -- start start 2023-07-14T15:59:21.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.602+0000 7f9577bff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95700b24e0 0x7f95701501a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:59:21.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.602+0000 7f9577bff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95700b8650 0x7f957015d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:59:21.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.602+0000 7f9577bff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f95700cfda0 0x7f95700b75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:59:21.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.602+0000 7f9577bff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f957015f2f0 con 0x7f95700b8650 2023-07-14T15:59:21.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.602+0000 7f9577bff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f957015e000 con 0x7f95700b24e0 2023-07-14T15:59:21.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.602+0000 7f9577bff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f957015e250 con 0x7f95700cfda0 2023-07-14T15:59:21.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.603+0000 7f957519a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95700b8650 0x7f957015d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:59:21.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.603+0000 7f957519a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95700b8650 0x7f957015d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38828/0 (socket says 172.21.15.37:38828) 2023-07-14T15:59:21.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.603+0000 7f957519a700 1 -- 172.21.15.37:0/2566103145 learned_addr learned my addr 172.21.15.37:0/2566103145 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:59:21.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.603+0000 7f957599b700 1 --2- 172.21.15.37:0/2566103145 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95700b24e0 0x7f95701501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:59:21.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.603+0000 7f957619c700 1 --2- 172.21.15.37:0/2566103145 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f95700cfda0 0x7f95700b75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:59:21.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.603+0000 7f957519a700 1 -- 172.21.15.37:0/2566103145 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f95700cfda0 msgr2=0x7f95700b75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:59:21.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.603+0000 7f957519a700 1 --2- 172.21.15.37:0/2566103145 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f95700cfda0 0x7f95700b75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:59:21.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.603+0000 7f957519a700 1 -- 172.21.15.37:0/2566103145 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95700b24e0 msgr2=0x7f95701501a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:59:21.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.603+0000 7f957519a700 1 --2- 172.21.15.37:0/2566103145 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95700b24e0 0x7f95701501a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:59:21.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.603+0000 7f957519a700 1 -- 172.21.15.37:0/2566103145 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9568009a70 con 0x7f95700b8650 2023-07-14T15:59:21.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.603+0000 7f957519a700 1 --2- 172.21.15.37:0/2566103145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95700b8650 0x7f957015d670 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f956000c580 tx=0x7f956000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:59:21.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.604+0000 7f95667fc700 1 -- 172.21.15.37:0/2566103145 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9560004c80 con 0x7f95700b8650 2023-07-14T15:59:21.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.604+0000 7f95667fc700 1 -- 172.21.15.37:0/2566103145 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9560004e00 con 0x7f95700b8650 2023-07-14T15:59:21.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.604+0000 7f95667fc700 1 -- 172.21.15.37:0/2566103145 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9560007310 con 0x7f95700b8650 2023-07-14T15:59:21.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.604+0000 7f9577bff700 1 -- 172.21.15.37:0/2566103145 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f957015e530 con 0x7f95700b8650 2023-07-14T15:59:21.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.604+0000 7f9577bff700 1 -- 172.21.15.37:0/2566103145 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f957015eaf0 con 0x7f95700b8650 2023-07-14T15:59:21.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.605+0000 7f9577bff700 1 -- 172.21.15.37:0/2566103145 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9570067840 con 0x7f95700b8650 2023-07-14T15:59:21.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.606+0000 7f95667fc700 1 -- 172.21.15.37:0/2566103145 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f9560007470 con 0x7f95700b8650 2023-07-14T15:59:21.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.607+0000 7f95667fc700 1 --2- 172.21.15.37:0/2566103145 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f955406ae00 0x7f955406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:59:21.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.607+0000 7f95667fc700 1 -- 172.21.15.37:0/2566103145 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5324+0+0 (secure 0 0 0) 0x7f9560088eb0 con 0x7f95700b8650 2023-07-14T15:59:21.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.608+0000 7f957599b700 1 --2- 172.21.15.37:0/2566103145 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f955406ae00 0x7f955406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:59:21.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.608+0000 7f957599b700 1 --2- 172.21.15.37:0/2566103145 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f955406ae00 0x7f955406d2b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f956c009be0 tx=0x7f956c009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:59:21.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.612+0000 7f95667fc700 1 -- 172.21.15.37:0/2566103145 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9560054120 con 0x7f95700b8650 2023-07-14T15:59:21.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.815+0000 7f9577bff700 1 -- 172.21.15.37:0/2566103145 --> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f95700cda70 con 0x7f955406ae00 2023-07-14T15:59:21.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.819+0000 7f95667fc700 1 -- 172.21.15.37:0/2566103145 <== mgr.4100 v2:172.21.15.98:6832/3163748069 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72869 (secure 0 0 0) 0x7f956c011860 con 0x7f955406ae00 2023-07-14T15:59:21.802 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:59:21.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.822+0000 7f9577bff700 1 -- 172.21.15.37:0/2566103145 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f955406ae00 msgr2=0x7f955406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:59:21.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.822+0000 7f9577bff700 1 --2- 172.21.15.37:0/2566103145 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f955406ae00 0x7f955406d2b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f956c009be0 tx=0x7f956c009210 comp rx=0 tx=0).stop 2023-07-14T15:59:21.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.822+0000 7f9577bff700 1 -- 172.21.15.37:0/2566103145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95700b8650 msgr2=0x7f957015d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:59:21.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.822+0000 7f9577bff700 1 --2- 172.21.15.37:0/2566103145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95700b8650 0x7f957015d670 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f956000c580 tx=0x7f956000c890 comp rx=0 tx=0).stop 2023-07-14T15:59:21.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.822+0000 7f9577bff700 1 -- 172.21.15.37:0/2566103145 shutdown_connections 2023-07-14T15:59:21.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.822+0000 7f9577bff700 1 --2- 172.21.15.37:0/2566103145 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f95700b24e0 0x7f95701501a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:59:21.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.822+0000 7f9577bff700 1 --2- 172.21.15.37:0/2566103145 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f955406ae00 0x7f955406d2b0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:59:21.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.822+0000 7f9577bff700 1 --2- 172.21.15.37:0/2566103145 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f95700cfda0 0x7f95700b75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:59:21.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.822+0000 7f9577bff700 1 --2- 172.21.15.37:0/2566103145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95700b8650 0x7f957015d670 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:59:21.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.822+0000 7f9577bff700 1 -- 172.21.15.37:0/2566103145 >> 172.21.15.37:0/2566103145 conn(0x7f957006c0f0 msgr2=0x7f95700b52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:59:21.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.822+0000 7f9577bff700 1 -- 172.21.15.37:0/2566103145 shutdown_connections 2023-07-14T15:59:21.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:21.822+0000 7f9577bff700 1 -- 172.21.15.37:0/2566103145 wait complete. 2023-07-14T15:59:21.807 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-14T15:59:21.823 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2023-07-14T15:59:20.901846+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":229832,"kb_used_data":6024,"kb_used_omap":0,"kb_used_meta":223744,"kb_avail":754744888,"statfs":{"total":773094113280,"available":772858765312,"internally_reserved":0,"allocated":6168576,"data_stored":3324680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":229113856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002752"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":83,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-07-14T15:59:00.285136+0000","last_change":"2023-07-14T15:59:00.285187+0000","last_active":"2023-07-14T15:59:00.285136+0000","last_peered":"2023-07-14T15:59:00.285136+0000","last_clean":"2023-07-14T15:59:00.285136+0000","last_became_active":"2023-07-14T15:56:02.621471+0000","last_became_peered":"2023-07-14T15:56:02.621471+0000","last_unstale":"2023-07-14T15:59:00.285136+0000","last_undegraded":"2023-07-14T15:59:00.285136+0000","last_fullsized":"2023-07-14T15:59:00.285136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:59:00.285043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:59:00.285043+0000","last_clean_scrub_stamp":"2023-07-14T15:59:00.285043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:00:33.384494+0000","scrub_duration":0.001594505,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":85,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-07-14T15:59:14.098119+0000","last_change":"2023-07-14T15:59:14.098170+0000","last_active":"2023-07-14T15:59:14.098119+0000","last_peered":"2023-07-14T15:59:14.098119+0000","last_clean":"2023-07-14T15:59:14.098119+0000","last_became_active":"2023-07-14T15:56:02.621678+0000","last_became_peered":"2023-07-14T15:56:02.621678+0000","last_unstale":"2023-07-14T15:59:14.098119+0000","last_undegraded":"2023-07-14T15:59:14.098119+0000","last_fullsized":"2023-07-14T15:59:14.098119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:59:14.098021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:59:14.098021+0000","last_clean_scrub_stamp":"2023-07-14T15:59:14.098021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:14:23.526916+0000","scrub_duration":0.0021271860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-07-14T15:59:02.688427+0000","last_change":"2023-07-14T15:59:02.688496+0000","last_active":"2023-07-14T15:59:02.688427+0000","last_peered":"2023-07-14T15:59:02.688427+0000","last_clean":"2023-07-14T15:59:02.688427+0000","last_became_active":"2023-07-14T15:56:01.924723+0000","last_became_peered":"2023-07-14T15:56:01.924723+0000","last_unstale":"2023-07-14T15:59:02.688427+0000","last_undegraded":"2023-07-14T15:59:02.688427+0000","last_fullsized":"2023-07-14T15:59:02.688427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:59:02.688322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:59:02.688322+0000","last_clean_scrub_stamp":"2023-07-14T15:59:02.688322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:37:48.996697+0000","scrub_duration":0.00177192,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":85,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-07-14T15:59:03.135406+0000","last_change":"2023-07-14T15:59:03.135459+0000","last_active":"2023-07-14T15:59:03.135406+0000","last_peered":"2023-07-14T15:59:03.135406+0000","last_clean":"2023-07-14T15:59:03.135406+0000","last_became_active":"2023-07-14T15:56:01.923160+0000","last_became_peered":"2023-07-14T15:56:01.923160+0000","last_unstale":"2023-07-14T15:59:03.135406+0000","last_undegraded":"2023-07-14T15:59:03.135406+0000","last_fullsized":"2023-07-14T15:59:03.135406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:59:03.135274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:59:03.135274+0000","last_clean_scrub_stamp":"2023-07-14T15:59:03.135274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:01:44.650503+0000","scrub_duration":0.001679931,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"53'119","reported_seq":229,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-07-14T15:59:01.218318+0000","last_change":"2023-07-14T15:59:01.218394+0000","last_active":"2023-07-14T15:59:01.218318+0000","last_peered":"2023-07-14T15:59:01.218318+0000","last_clean":"2023-07-14T15:59:01.218318+0000","last_became_active":"2023-07-14T15:55:54.038885+0000","last_became_peered":"2023-07-14T15:55:54.038885+0000","last_unstale":"2023-07-14T15:59:01.218318+0000","last_undegraded":"2023-07-14T15:59:01.218318+0000","last_fullsized":"2023-07-14T15:59:01.218318+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'119","last_scrub_stamp":"2023-07-14T15:59:01.218256+0000","last_deep_scrub":"53'119","last_deep_scrub_stamp":"2023-07-14T15:59:01.218256+0000","last_clean_scrub_stamp":"2023-07-14T15:59:01.218256+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:49:29.954141+0000","scrub_duration":0.0074974159999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-07-14T15:58:58.210831+0000","last_change":"2023-07-14T15:58:58.210873+0000","last_active":"2023-07-14T15:58:58.210831+0000","last_peered":"2023-07-14T15:58:58.210831+0000","last_clean":"2023-07-14T15:58:58.210831+0000","last_became_active":"2023-07-14T15:56:01.920325+0000","last_became_peered":"2023-07-14T15:56:01.920325+0000","last_unstale":"2023-07-14T15:58:58.210831+0000","last_undegraded":"2023-07-14T15:58:58.210831+0000","last_fullsized":"2023-07-14T15:58:58.210831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:58:58.210731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:58:58.210731+0000","last_clean_scrub_stamp":"2023-07-14T15:58:58.210731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:38:48.439030+0000","scrub_duration":0.0020770490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-07-14T15:59:04.105488+0000","last_change":"2023-07-14T15:59:04.105544+0000","last_active":"2023-07-14T15:59:04.105488+0000","last_peered":"2023-07-14T15:59:04.105488+0000","last_clean":"2023-07-14T15:59:04.105488+0000","last_became_active":"2023-07-14T15:56:01.922783+0000","last_became_peered":"2023-07-14T15:56:01.922783+0000","last_unstale":"2023-07-14T15:59:04.105488+0000","last_undegraded":"2023-07-14T15:59:04.105488+0000","last_fullsized":"2023-07-14T15:59:04.105488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:59:04.105391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:59:04.105391+0000","last_clean_scrub_stamp":"2023-07-14T15:59:04.105391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:45:00.442906+0000","scrub_duration":0.002044265,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-07-14T15:59:00.983658+0000","last_change":"2023-07-14T15:59:00.983734+0000","last_active":"2023-07-14T15:59:00.983658+0000","last_peered":"2023-07-14T15:59:00.983658+0000","last_clean":"2023-07-14T15:59:00.983658+0000","last_became_active":"2023-07-14T15:56:01.965344+0000","last_became_peered":"2023-07-14T15:56:01.965344+0000","last_unstale":"2023-07-14T15:59:00.983658+0000","last_undegraded":"2023-07-14T15:59:00.983658+0000","last_fullsized":"2023-07-14T15:59:00.983658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:59:00.983547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:59:00.983547+0000","last_clean_scrub_stamp":"2023-07-14T15:59:00.983547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:24:46.019534+0000","scrub_duration":0.0016264160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-07-14T15:59:08.100391+0000","last_change":"2023-07-14T15:59:08.100445+0000","last_active":"2023-07-14T15:59:08.100391+0000","last_peered":"2023-07-14T15:59:08.100391+0000","last_clean":"2023-07-14T15:59:08.100391+0000","last_became_active":"2023-07-14T15:56:01.966216+0000","last_became_peered":"2023-07-14T15:56:01.966216+0000","last_unstale":"2023-07-14T15:59:08.100391+0000","last_undegraded":"2023-07-14T15:59:08.100391+0000","last_fullsized":"2023-07-14T15:59:08.100391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T15:59:08.100281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T15:59:08.100281+0000","last_clean_scrub_stamp":"2023-07-14T15:59:08.100281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:26:20.072729+0000","scrub_duration":0.0016876129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476781,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31656,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340184,"statfs":{"total":96636764160,"available":96604348416,"internally_reserved":0,"allocated":622592,"data_stored":267993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44700000000000001,"15min":0.45000000000000001},"min":{"1min":0.25700000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46100000000000002,"15min":0.47199999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.71799999999999997,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.54700000000000004}]},{"osd":1,"last update":"Fri Jul 14 15:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.35299999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.64400000000000002,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51800000000000002,"15min":0.52200000000000002},"min":{"1min":0.32900000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.69099999999999995,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.51000000000000001}]},{"osd":2,"last update":"Fri Jul 14 15:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.50700000000000001,"15min":0.50600000000000001},"min":{"1min":0.41299999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.70299999999999996,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.63},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57399999999999995,"15min":0.58199999999999996},"min":{"1min":0.41799999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72699999999999998,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.66800000000000004}]},{"osd":4,"last update":"Fri Jul 14 15:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.73699999999999999,"15min":0.75900000000000001},"min":{"1min":0.51800000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.91700000000000004,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.749,"15min":0.76800000000000002},"min":{"1min":0.54700000000000004,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.87,"5min":1.542,"15min":1.542},"last":0.92200000000000004}]},{"osd":5,"last update":"Fri Jul 14 15:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.81000000000000005,"15min":0.84499999999999997},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0740000000000001,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.877},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.82899999999999996,"15min":0.85099999999999998},"min":{"1min":0.64100000000000001,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0449999999999999,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.94499999999999995}]},{"osd":6,"last update":"Fri Jul 14 15:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.79000000000000004,"15min":0.81299999999999994},"min":{"1min":0.54200000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.93600000000000005,"5min":1.52,"15min":1.52},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.78200000000000003,"15min":0.80600000000000005},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.012,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.89400000000000002}]},{"osd":7,"last update":"Fri Jul 14 15:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.77100000000000002,"15min":0.77600000000000002},"min":{"1min":0.621,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0609999999999999,"5min":1.232,"15min":1.232},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.81699999999999995,"15min":0.84899999999999998},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.032,"5min":1.478,"15min":1.478},"last":0.99299999999999999}]}]},{"osd":0,"up_from":16,"seq":68719476782,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":622592,"data_stored":267993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 15:59:03 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.41299999999999998,"15min":0.42099999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.54100000000000004,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.48199999999999998,"15min":0.48799999999999999},"min":{"1min":0.28499999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71099999999999997,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.61199999999999999}]},{"osd":2,"last update":"Fri Jul 14 15:59:03 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.49299999999999999,"15min":0.498},"min":{"1min":0.33200000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.50600000000000001,"15min":0.504},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.503}]},{"osd":3,"last update":"Fri Jul 14 15:59:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.47599999999999998,"15min":0.47999999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.68600000000000005,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.439},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56499999999999995,"15min":0.57499999999999996},"min":{"1min":0.41299999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.70899999999999996,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.53300000000000003}]},{"osd":4,"last update":"Fri Jul 14 15:59:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.72599999999999998,"15min":0.71799999999999997},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":2.4700000000000002,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76800000000000002,"15min":0.78500000000000003},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0669999999999999,"5min":1.331,"15min":1.331},"last":0.85199999999999998}]},{"osd":5,"last update":"Fri Jul 14 15:59:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.76100000000000001,"15min":0.76700000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0620000000000001,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.745,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.048,"5min":1.087,"15min":1.087},"last":1.0269999999999999}]},{"osd":6,"last update":"Fri Jul 14 15:59:03 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.76600000000000001,"15min":0.77800000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0800000000000001,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.79300000000000004,"15min":0.80300000000000005},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.107,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.95299999999999996}]},{"osd":7,"last update":"Fri Jul 14 15:59:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.79300000000000004,"15min":0.80500000000000005},"min":{"1min":0.59699999999999998,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0629999999999999,"5min":1.262,"15min":1.262},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.78400000000000003,"15min":0.79700000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0329999999999999,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.82999999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542188,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":622592,"data_stored":267993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:58:58 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.64200000000000002,"15min":0.624},"min":{"1min":0.48699999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.64400000000000002,"15min":0.64500000000000002},"min":{"1min":0.42699999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.91000000000000003,"5min":1.266,"15min":1.266},"last":0.68700000000000006}]},{"osd":1,"last update":"Fri Jul 14 15:58:58 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.70099999999999996,"15min":0.70399999999999996},"min":{"1min":0.505,"5min":0.433,"15min":0.433},"max":{"1min":0.89400000000000002,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72499999999999998,"15min":0.71799999999999997},"min":{"1min":0.49099999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.93300000000000005,"5min":1,"15min":1},"last":0.83799999999999997}]},{"osd":2,"last update":"Fri Jul 14 15:58:58 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67600000000000005,"15min":0.67900000000000005},"min":{"1min":0.48799999999999999,"5min":0.437,"15min":0.437},"max":{"1min":0.877,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68300000000000005,"15min":0.68999999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.81299999999999994,"5min":0.87,"15min":0.87},"last":0.81399999999999995}]},{"osd":3,"last update":"Fri Jul 14 15:58:58 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.75700000000000001,"15min":0.79500000000000004},"min":{"1min":0.52800000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.94399999999999995,"5min":3.141,"15min":3.141},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.746,"15min":0.751},"min":{"1min":0.54300000000000004,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.878,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.88400000000000001}]},{"osd":4,"last update":"Fri Jul 14 15:58:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.624,"15min":0.63100000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.80700000000000005,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.69499999999999995,"15min":0.70699999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.876,"5min":1.024,"15min":1.024},"last":0.57999999999999996}]},{"osd":5,"last update":"Fri Jul 14 15:58:58 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.74199999999999999,"15min":0.749},"min":{"1min":0.53200000000000003,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94999999999999996,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.72599999999999998,"15min":0.73599999999999999},"min":{"1min":0.434,"5min":0.38,"15min":0.38},"max":{"1min":0.90500000000000003,"5min":1.091,"15min":1.091},"last":0.60099999999999998}]},{"osd":7,"last update":"Fri Jul 14 15:58:58 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.71299999999999997,"15min":0.72499999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.84799999999999998,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.80900000000000005,"15min":0.82399999999999995},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.93100000000000005,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.90400000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542187,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1216512,"data_stored":858361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.55900000000000005,"15min":0.626},"min":{"1min":0.31,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.56799999999999995,"5min":4.5519999999999996,"15min":4.5519999999999996},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.96899999999999997,"15min":1.202},"min":{"1min":0.314,"5min":0.308,"15min":0.308},"max":{"1min":0.54500000000000004,"5min":15.911,"15min":15.911},"last":0.60899999999999999}]},{"osd":2,"last update":"Fri Jul 14 15:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45400000000000001,"15min":0.46300000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.624,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.628,"15min":0.69099999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.65400000000000003,"5min":4.5140000000000002,"15min":4.5140000000000002},"last":0.53600000000000003}]},{"osd":3,"last update":"Fri Jul 14 15:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.65500000000000003,"15min":0.71999999999999997},"min":{"1min":0.36699999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80300000000000005,"5min":4.452,"15min":4.452},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.65500000000000003,"15min":0.72299999999999998},"min":{"1min":0.38400000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72799999999999998,"5min":4.2279999999999998,"15min":4.2279999999999998},"last":0.56999999999999995}]},{"osd":4,"last update":"Fri Jul 14 15:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.83699999999999997,"15min":0.90400000000000003},"min":{"1min":0.51000000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.89100000000000001,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.86699999999999999,"15min":0.94199999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.93700000000000006,"5min":4.9109999999999996,"15min":4.9109999999999996},"last":0.71399999999999997}]},{"osd":5,"last update":"Fri Jul 14 15:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.84599999999999997,"15min":0.91500000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.93600000000000005,"5min":4.1269999999999998,"15min":4.1269999999999998},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.88800000000000001,"15min":0.95699999999999996},"min":{"1min":0.64500000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.89500000000000002,"5min":4.585,"15min":4.585},"last":0.85099999999999998}]},{"osd":6,"last update":"Fri Jul 14 15:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.878,"15min":0.95199999999999996},"min":{"1min":0.56799999999999995,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.90800000000000003,"5min":4.9880000000000004,"15min":4.9880000000000004},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.89000000000000001,"15min":0.94999999999999996},"min":{"1min":0.61199999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.95999999999999996,"5min":4.1660000000000004,"15min":4.1660000000000004},"last":0.96399999999999997}]},{"osd":7,"last update":"Fri Jul 14 15:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.92600000000000005,"15min":1.006},"min":{"1min":0.60299999999999998,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.94499999999999995,"5min":4.9530000000000003,"15min":4.9530000000000003},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.90400000000000003,"15min":0.96699999999999997},"min":{"1min":0.63500000000000001,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.071,"5min":4.1959999999999997,"15min":4.1959999999999997},"last":0.81899999999999995}]}]},{"osd":2,"up_from":15,"seq":64424509485,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":622592,"data_stored":267993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:58:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.41799999999999998,"15min":0.42999999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.498,"5min":0.62,"15min":0.62},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.46000000000000002,"15min":0.47899999999999998},"min":{"1min":0.30099999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.59399999999999997,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.41899999999999998}]},{"osd":1,"last update":"Fri Jul 14 15:58:54 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.51300000000000001,"15min":0.52700000000000002},"min":{"1min":0.36599999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.58999999999999997,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.45900000000000002,"15min":0.46700000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.56699999999999995,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.56399999999999995}]},{"osd":3,"last update":"Fri Jul 14 15:58:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.57199999999999995,"15min":0.59699999999999998},"min":{"1min":0.45000000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.69399999999999995,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.52200000000000002,"15min":0.53500000000000003},"min":{"1min":0.41099999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.61699999999999999,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.51600000000000001}]},{"osd":4,"last update":"Fri Jul 14 15:58:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72499999999999998,"15min":0.72799999999999998},"min":{"1min":0.55400000000000005,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.95499999999999996,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.73399999999999999,"15min":0.74399999999999999},"min":{"1min":0.52600000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.93200000000000005,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.88100000000000001}]},{"osd":5,"last update":"Fri Jul 14 15:58:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.76300000000000001,"15min":0.77700000000000002},"min":{"1min":0.56699999999999995,"5min":0.505,"15min":0.505},"max":{"1min":0.97399999999999998,"5min":1.391,"15min":1.391},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.74299999999999999,"15min":0.75700000000000001},"min":{"1min":0.51900000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.94599999999999995,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.749}]},{"osd":6,"last update":"Fri Jul 14 15:58:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.77500000000000002,"15min":0.79800000000000004},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.89000000000000001,"5min":1.51,"15min":1.51},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.79800000000000004,"15min":0.82399999999999995},"min":{"1min":0.625,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":0.93300000000000005,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.76600000000000001}]},{"osd":7,"last update":"Fri Jul 14 15:58:54 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.77200000000000002,"15min":0.79000000000000004},"min":{"1min":0.55900000000000005,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.94699999999999995,"5min":1.288,"15min":1.288},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80600000000000005,"15min":0.82399999999999995},"min":{"1min":0.60299999999999998,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":0.95899999999999996,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.78600000000000003}]}]},{"osd":4,"up_from":15,"seq":64424509484,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":622592,"data_stored":267993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:58:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.66800000000000004,"15min":0.68400000000000005},"min":{"1min":0.48799999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80100000000000005,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65200000000000002,"15min":0.65900000000000003},"min":{"1min":0.46600000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.69199999999999995}]},{"osd":1,"last update":"Fri Jul 14 15:58:54 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66700000000000004,"15min":0.67500000000000004},"min":{"1min":0.505,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.82999999999999996,"5min":0.87,"15min":0.87},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.65100000000000002,"15min":0.66000000000000003},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90700000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.51000000000000001}]},{"osd":2,"last update":"Fri Jul 14 15:58:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.439,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.88200000000000001,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.70599999999999996,"15min":0.72599999999999998},"min":{"1min":0.52800000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.85299999999999998,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.71699999999999997}]},{"osd":3,"last update":"Fri Jul 14 15:58:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68300000000000005,"15min":0.68799999999999994},"min":{"1min":0.47399999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.80500000000000005,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72599999999999998,"15min":0.73399999999999999},"min":{"1min":0.53000000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.81799999999999995,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.68000000000000005}]},{"osd":5,"last update":"Fri Jul 14 15:58:54 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.65800000000000003,"15min":0.66400000000000003},"min":{"1min":0.432,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.84299999999999997,"5min":1.119,"15min":1.119},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.69399999999999995,"15min":0.71199999999999997},"min":{"1min":0.48699999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.82199999999999995,"5min":1.157,"15min":1.157},"last":0.57499999999999996}]},{"osd":6,"last update":"Fri Jul 14 15:58:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69399999999999995,"15min":0.71099999999999997},"min":{"1min":0.49399999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92200000000000004,"5min":1.04,"15min":1.04},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72399999999999998,"15min":0.73799999999999999},"min":{"1min":0.54700000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.86699999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.65000000000000002}]},{"osd":7,"last update":"Fri Jul 14 15:58:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.746,"15min":0.76400000000000001},"min":{"1min":0.53000000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.95499999999999996,"5min":1.202,"15min":1.202},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.77100000000000002,"15min":0.78900000000000003},"min":{"1min":0.57999999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.879,"5min":1.137,"15min":1.137},"last":0.61899999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509486,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28140,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343700,"statfs":{"total":96636764160,"available":96607948800,"internally_reserved":0,"allocated":1216512,"data_stored":858361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:59:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66200000000000003,"15min":0.67100000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.751},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.89400000000000002,"15min":1.01},"min":{"1min":0.442,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.93700000000000006,"5min":8.1500000000000004,"15min":8.1500000000000004},"last":0.78600000000000003}]},{"osd":1,"last update":"Fri Jul 14 15:59:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.67500000000000004,"15min":0.67700000000000005},"min":{"1min":0.51200000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.94799999999999995,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66200000000000003,"15min":0.66900000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.96699999999999997,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.81699999999999995}]},{"osd":2,"last update":"Fri Jul 14 15:59:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.75,"15min":0.76800000000000002},"min":{"1min":0.47699999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0509999999999999,"5min":1.085,"15min":1.085},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.71199999999999997,"15min":0.73299999999999998},"min":{"1min":0.51400000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.93100000000000005,"5min":1.048,"15min":1.048},"last":0.83699999999999997}]},{"osd":3,"last update":"Fri Jul 14 15:59:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.68600000000000005,"15min":0.69799999999999995},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.94199999999999995,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.79300000000000004,"15min":0.80800000000000005},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0389999999999999,"5min":1.083,"15min":1.083},"last":0.85299999999999998}]},{"osd":4,"last update":"Fri Jul 14 15:59:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69099999999999995,"15min":0.69199999999999995},"min":{"1min":0.46300000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.91300000000000003,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.65300000000000002,"15min":0.66200000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.84699999999999998,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.58099999999999996}]},{"osd":6,"last update":"Fri Jul 14 15:59:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.68999999999999995,"15min":0.70999999999999996},"min":{"1min":0.45200000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.99399999999999999,"5min":1.121,"15min":1.121},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78300000000000003,"15min":0.80000000000000004},"min":{"1min":0.51400000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.70599999999999996}]},{"osd":7,"last update":"Fri Jul 14 15:59:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73899999999999999,"15min":0.749},"min":{"1min":0.54800000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.80700000000000005,"15min":0.82799999999999996},"min":{"1min":0.61199999999999999,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.492,"5min":1.605,"15min":1.605},"last":0.72399999999999998}]}]},{"osd":7,"up_from":15,"seq":64424509485,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":622592,"data_stored":267993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 15:59:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.40799999999999997,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.88600000000000001,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.76200000000000001,"15min":0.81100000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.99199999999999999,"5min":4.5919999999999996,"15min":4.5919999999999996},"last":0.75}]},{"osd":1,"last update":"Fri Jul 14 15:58:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.66300000000000003,"15min":0.66800000000000004},"min":{"1min":0.43099999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.93700000000000006,"5min":1,"15min":1},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.80800000000000005,"15min":0.878},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.81499999999999995,"5min":4.665,"15min":4.665},"last":0.66100000000000003}]},{"osd":2,"last update":"Fri Jul 14 15:58:54 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.81799999999999995,"15min":0.89400000000000002},"min":{"1min":0.47699999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.80000000000000004,"5min":5.4089999999999998,"15min":5.4089999999999998},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.747,"15min":0.76900000000000002},"min":{"1min":0.48099999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0760000000000001,"5min":2.165,"15min":2.165},"last":0.79200000000000004}]},{"osd":3,"last update":"Fri Jul 14 15:59:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.73099999999999998,"15min":0.754},"min":{"1min":0.51400000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.83299999999999996,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.78200000000000003,"15min":0.81599999999999995},"min":{"1min":0.51700000000000002,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.002,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":0.81699999999999995}]},{"osd":4,"last update":"Fri Jul 14 15:58:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0409999999999999,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.66000000000000003,"15min":0.66100000000000003},"min":{"1min":0.40600000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0489999999999999,"5min":1.111,"15min":1.111},"last":0.61299999999999999}]},{"osd":5,"last update":"Fri Jul 14 15:58:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.66100000000000003,"15min":0.66300000000000003},"min":{"1min":0.53200000000000003,"5min":0.37,"15min":0.37},"max":{"1min":1.052,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.74199999999999999,"15min":0.748},"min":{"1min":0.56799999999999995,"5min":0.371,"15min":0.371},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.63900000000000001}]},{"osd":6,"last update":"Fri Jul 14 15:58:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.69999999999999996,"15min":0.70599999999999996},"min":{"1min":0.58999999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.97299999999999998,"5min":1.042,"15min":1.042},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75600000000000001,"15min":0.77600000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1319999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.77100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T15:59:21.829 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-07-14T15:59:22.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.045+0000 7fbb6c7ff700 1 Processor -- start 2023-07-14T15:59:22.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.045+0000 7fbb6c7ff700 1 -- start start 2023-07-14T15:59:22.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.046+0000 7fbb6c7ff700 1 --2- >> v2:172.21.15.98:3300/0 conn(0x7fbb640b1e80 0x7fbb640d2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:59:22.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.046+0000 7fbb6c7ff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb640b1840 con 0x7fbb640b0ac0 2023-07-14T15:59:22.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.046+0000 7fbb6c7ff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb640b2550 con 0x7fbb640cfd50 2023-07-14T15:59:22.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.046+0000 7fbb6c7ff700 1 -- --> v2:172.21.15.98:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb6415ccf0 con 0x7fbb640b1e80 2023-07-14T15:59:22.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.046+0000 7fbb6ad9c700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fbb640b0ac0 0x7fbb640b0f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53070/0 (socket says 172.21.15.37:53070) 2023-07-14T15:59:22.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.046+0000 7fbb6ad9c700 1 -- 172.21.15.37:0/1251926269 learned_addr learned my addr 172.21.15.37:0/1251926269 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:59:22.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.046+0000 7fbb6a59b700 1 --1- 172.21.15.37:0/1251926269 >> v1:172.21.15.98:6789/0 conn(0x7fbb640cfd50 0x7fbb640b2d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.98:6789/0 says I am v1:172.21.15.37:56470/0 (socket says 172.21.15.37:56470) 2023-07-14T15:59:22.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.047+0000 7fbb69d9a700 1 --2- 172.21.15.37:0/1251926269 >> v2:172.21.15.98:3300/0 conn(0x7fbb640b1e80 0x7fbb640d2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:59:22.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.047+0000 7fbb69599700 1 -- 172.21.15.37:0/1251926269 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1419909387 0 0) 0x7fbb640b1840 con 0x7fbb640b0ac0 2023-07-14T15:59:22.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.047+0000 7fbb69599700 1 -- 172.21.15.37:0/1251926269 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb500035b0 con 0x7fbb640b0ac0 2023-07-14T15:59:22.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.047+0000 7fbb69599700 1 -- 172.21.15.37:0/1251926269 <== mon.1 v1:172.21.15.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4294773037 0 0) 0x7fbb640b2550 con 0x7fbb640cfd50 2023-07-14T15:59:22.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.047+0000 7fbb69599700 1 -- 172.21.15.37:0/1251926269 --> v1:172.21.15.98:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb640b1840 con 0x7fbb640cfd50 2023-07-14T15:59:22.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.047+0000 7fbb69d9a700 1 -- 172.21.15.37:0/1251926269 >> v1:172.21.15.98:6789/0 conn(0x7fbb640cfd50 legacy=0x7fbb640b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:59:22.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.047+0000 7fbb69d9a700 1 -- 172.21.15.37:0/1251926269 >> v1:172.21.15.37:6789/0 conn(0x7fbb640b0ac0 legacy=0x7fbb640b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:59:22.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.047+0000 7fbb69d9a700 1 -- 172.21.15.37:0/1251926269 --> v2:172.21.15.98:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb640b2830 con 0x7fbb640b1e80 2023-07-14T15:59:22.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.047+0000 7fbb69d9a700 1 --2- 172.21.15.37:0/1251926269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb640b1e80 0x7fbb640d2880 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbb54009840 tx=0x7fbb54009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44e067eb3e0c982d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:59:22.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.048+0000 7fbb69599700 1 -- 172.21.15.37:0/1251926269 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb54011830 con 0x7fbb640b1e80 2023-07-14T15:59:22.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.048+0000 7fbb69599700 1 -- 172.21.15.37:0/1251926269 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb54011990 con 0x7fbb640b1e80 2023-07-14T15:59:22.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.048+0000 7fbb69599700 1 -- 172.21.15.37:0/1251926269 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb54011d20 con 0x7fbb640b1e80 2023-07-14T15:59:22.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.048+0000 7fbb6c7ff700 1 -- 172.21.15.37:0/1251926269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb640b1e80 msgr2=0x7fbb640d2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:59:22.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.048+0000 7fbb6c7ff700 1 --2- 172.21.15.37:0/1251926269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb640b1e80 0x7fbb640d2880 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbb54009840 tx=0x7fbb54009b50 comp rx=0 tx=0).stop 2023-07-14T15:59:22.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.048+0000 7fbb6c7ff700 1 -- 172.21.15.37:0/1251926269 shutdown_connections 2023-07-14T15:59:22.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.048+0000 7fbb6c7ff700 1 --2- 172.21.15.37:0/1251926269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb640b1e80 0x7fbb640d2880 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:59:22.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.048+0000 7fbb6c7ff700 1 -- 172.21.15.37:0/1251926269 >> 172.21.15.37:0/1251926269 conn(0x7fbb6409c1c0 msgr2=0x7fbb640d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:59:22.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.048+0000 7fbb6c7ff700 1 -- 172.21.15.37:0/1251926269 shutdown_connections 2023-07-14T15:59:22.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.048+0000 7fbb6c7ff700 1 -- 172.21.15.37:0/1251926269 wait complete. 2023-07-14T15:59:22.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.051+0000 7fbb6c7ff700 1 Processor -- start 2023-07-14T15:59:22.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.051+0000 7fbb6c7ff700 1 -- start start 2023-07-14T15:59:22.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.052+0000 7fbb6c7ff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbb640b0ac0 0x7fbb641572d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:59:22.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.052+0000 7fbb6c7ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb640b1e80 0x7fbb640b8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:59:22.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.052+0000 7fbb6c7ff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb640cfd50 0x7fbb640b8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:59:22.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.052+0000 7fbb6c7ff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb640b6300 con 0x7fbb640b1e80 2023-07-14T15:59:22.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.052+0000 7fbb6c7ff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb641586b0 con 0x7fbb640cfd50 2023-07-14T15:59:22.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.052+0000 7fbb6c7ff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb64158990 con 0x7fbb640b0ac0 2023-07-14T15:59:22.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.053+0000 7fbb69d9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb640b1e80 0x7fbb640b8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:59:22.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.053+0000 7fbb69d9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb640b1e80 0x7fbb640b8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38842/0 (socket says 172.21.15.37:38842) 2023-07-14T15:59:22.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.053+0000 7fbb69d9a700 1 -- 172.21.15.37:0/684057092 learned_addr learned my addr 172.21.15.37:0/684057092 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:59:22.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.053+0000 7fbb6a59b700 1 --2- 172.21.15.37:0/684057092 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbb640b0ac0 0x7fbb641572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:59:22.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.053+0000 7fbb6ad9c700 1 --2- 172.21.15.37:0/684057092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb640cfd50 0x7fbb640b8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:59:22.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.053+0000 7fbb69d9a700 1 -- 172.21.15.37:0/684057092 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbb640b0ac0 msgr2=0x7fbb641572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:59:22.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.053+0000 7fbb69d9a700 1 --2- 172.21.15.37:0/684057092 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbb640b0ac0 0x7fbb641572d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:59:22.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.053+0000 7fbb69d9a700 1 -- 172.21.15.37:0/684057092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb640cfd50 msgr2=0x7fbb640b8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:59:22.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.053+0000 7fbb69d9a700 1 --2- 172.21.15.37:0/684057092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb640cfd50 0x7fbb640b8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:59:22.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.053+0000 7fbb69d9a700 1 -- 172.21.15.37:0/684057092 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb540094a0 con 0x7fbb640b1e80 2023-07-14T15:59:22.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.053+0000 7fbb6ad9c700 1 --2- 172.21.15.37:0/684057092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb640cfd50 0x7fbb640b8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T15:59:22.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.053+0000 7fbb69d9a700 1 --2- 172.21.15.37:0/684057092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb640b1e80 0x7fbb640b8050 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fbb540090b0 tx=0x7fbb54004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:59:22.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.054+0000 7fbb5affd700 1 -- 172.21.15.37:0/684057092 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5401a860 con 0x7fbb640b1e80 2023-07-14T15:59:22.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.054+0000 7fbb5affd700 1 -- 172.21.15.37:0/684057092 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb5401a9c0 con 0x7fbb640b1e80 2023-07-14T15:59:22.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.054+0000 7fbb5affd700 1 -- 172.21.15.37:0/684057092 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5401ad30 con 0x7fbb640b1e80 2023-07-14T15:59:22.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.054+0000 7fbb6c7ff700 1 -- 172.21.15.37:0/684057092 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb640d02a0 con 0x7fbb640b1e80 2023-07-14T15:59:22.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.054+0000 7fbb6c7ff700 1 -- 172.21.15.37:0/684057092 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb640b5f90 con 0x7fbb640b1e80 2023-07-14T15:59:22.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.055+0000 7fbb6c7ff700 1 -- 172.21.15.37:0/684057092 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb640b64b0 con 0x7fbb640b1e80 2023-07-14T15:59:22.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.056+0000 7fbb5affd700 1 -- 172.21.15.37:0/684057092 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7fbb54022070 con 0x7fbb640b1e80 2023-07-14T15:59:22.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.056+0000 7fbb5affd700 1 --2- 172.21.15.37:0/684057092 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbb4806ae00 0x7fbb4806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:59:22.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.057+0000 7fbb5affd700 1 -- 172.21.15.37:0/684057092 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5324+0+0 (secure 0 0 0) 0x7fbb54089ff0 con 0x7fbb640b1e80 2023-07-14T15:59:22.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.057+0000 7fbb6a59b700 1 --2- 172.21.15.37:0/684057092 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbb4806ae00 0x7fbb4806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:59:22.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.058+0000 7fbb6a59b700 1 --2- 172.21.15.37:0/684057092 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbb4806ae00 0x7fbb4806d2b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fbb600011e0 tx=0x7fbb60007c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:59:22.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.061+0000 7fbb5affd700 1 -- 172.21.15.37:0/684057092 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fbb640b64b0 con 0x7fbb640b1e80 2023-07-14T15:59:22.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.267+0000 7fbb6c7ff700 1 -- 172.21.15.37:0/684057092 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fbb640d0610 con 0x7fbb640b1e80 2023-07-14T15:59:22.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.272+0000 7fbb5affd700 1 -- 172.21.15.37:0/684057092 <== mon.0 v2:172.21.15.37:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fbb5401ae90 con 0x7fbb640b1e80 2023-07-14T15:59:22.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.272+0000 7fbb5affd700 1 -- 172.21.15.37:0/684057092 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v14)=0 v14) v1 ==== 123+0+0 (secure 0 0 0) 0x7fbb540290c0 con 0x7fbb640b1e80 2023-07-14T15:59:22.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.275+0000 7fbb6c7ff700 1 -- 172.21.15.37:0/684057092 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbb4806ae00 msgr2=0x7fbb4806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:59:22.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.275+0000 7fbb6c7ff700 1 --2- 172.21.15.37:0/684057092 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbb4806ae00 0x7fbb4806d2b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fbb600011e0 tx=0x7fbb60007c00 comp rx=0 tx=0).stop 2023-07-14T15:59:22.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.275+0000 7fbb6c7ff700 1 -- 172.21.15.37:0/684057092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb640b1e80 msgr2=0x7fbb640b8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:59:22.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.275+0000 7fbb6c7ff700 1 --2- 172.21.15.37:0/684057092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb640b1e80 0x7fbb640b8050 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fbb540090b0 tx=0x7fbb54004750 comp rx=0 tx=0).stop 2023-07-14T15:59:22.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.275+0000 7fbb6c7ff700 1 -- 172.21.15.37:0/684057092 shutdown_connections 2023-07-14T15:59:22.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.275+0000 7fbb6c7ff700 1 --2- 172.21.15.37:0/684057092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb640cfd50 0x7fbb640b8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:59:22.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.275+0000 7fbb6c7ff700 1 --2- 172.21.15.37:0/684057092 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7fbb4806ae00 0x7fbb4806d2b0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:59:22.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.275+0000 7fbb6c7ff700 1 --2- 172.21.15.37:0/684057092 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7fbb640b0ac0 0x7fbb641572d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:59:22.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.275+0000 7fbb6c7ff700 1 --2- 172.21.15.37:0/684057092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb640b1e80 0x7fbb640b8050 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:59:22.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.275+0000 7fbb6c7ff700 1 -- 172.21.15.37:0/684057092 >> 172.21.15.37:0/684057092 conn(0x7fbb6409c1c0 msgr2=0x7fbb640b2c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:59:22.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.275+0000 7fbb6c7ff700 1 -- 172.21.15.37:0/684057092 shutdown_connections 2023-07-14T15:59:22.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.275+0000 7fbb6c7ff700 1 -- 172.21.15.37:0/684057092 wait complete. 2023-07-14T15:59:22.275 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-14T15:59:22.276 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T15:59:22.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.496+0000 7f31edbff700 1 Processor -- start 2023-07-14T15:59:22.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.497+0000 7f31edbff700 1 -- start start 2023-07-14T15:59:22.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.498+0000 7f31edbff700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f31e80cffc0 0x7f31e80b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:59:22.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.498+0000 7f31edbff700 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e80d0de0 con 0x7f31e8160c50 2023-07-14T15:59:22.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.498+0000 7f31edbff700 1 -- --> v1:172.21.15.98:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e81610f0 con 0x7f31e80b8b80 2023-07-14T15:59:22.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.498+0000 7f31edbff700 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31e80cd590 con 0x7f31e80cffc0 2023-07-14T15:59:22.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.498+0000 7f31e6ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f31e80cffc0 0x7f31e80b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:59:22.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.498+0000 7f31e7fff700 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f31e8160c50 0x7f31e80d1270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53080/0 (socket says 172.21.15.37:53080) 2023-07-14T15:59:22.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.498+0000 7f31e6ffd700 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f31e80cffc0 0x7f31e80b5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38848/0 (socket says 172.21.15.37:38848) 2023-07-14T15:59:22.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.498+0000 7f31e7fff700 1 -- 172.21.15.37:0/328970895 learned_addr learned my addr 172.21.15.37:0/328970895 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-14T15:59:22.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.499+0000 7f31e6ffd700 1 -- 172.21.15.37:0/328970895 >> v1:172.21.15.98:6789/0 conn(0x7f31e80b8b80 legacy=0x7f31e80cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:59:22.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.499+0000 7f31e6ffd700 1 -- 172.21.15.37:0/328970895 >> v1:172.21.15.37:6789/0 conn(0x7f31e8160c50 legacy=0x7f31e80d1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:59:22.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.499+0000 7f31e6ffd700 1 -- 172.21.15.37:0/328970895 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e80cd870 con 0x7f31e80cffc0 2023-07-14T15:59:22.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.499+0000 7f31e67fc700 1 -- 172.21.15.37:0/328970895 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2428180148 0 0) 0x7f31e80d0de0 con 0x7f31e8160c50 2023-07-14T15:59:22.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.499+0000 7f31e6ffd700 1 --2- 172.21.15.37:0/328970895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31e80cffc0 0x7f31e80b5cf0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f31dc009840 tx=0x7f31dc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5422cb73a02c46c9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:59:22.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.499+0000 7f31e67fc700 1 -- 172.21.15.37:0/328970895 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31dc011830 con 0x7f31e80cffc0 2023-07-14T15:59:22.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.499+0000 7f31e67fc700 1 -- 172.21.15.37:0/328970895 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f31dc011990 con 0x7f31e80cffc0 2023-07-14T15:59:22.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.499+0000 7f31e67fc700 1 -- 172.21.15.37:0/328970895 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31dc011d40 con 0x7f31e80cffc0 2023-07-14T15:59:22.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.500+0000 7f31edbff700 1 -- 172.21.15.37:0/328970895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31e80cffc0 msgr2=0x7f31e80b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:59:22.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.500+0000 7f31edbff700 1 --2- 172.21.15.37:0/328970895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31e80cffc0 0x7f31e80b5cf0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f31dc009840 tx=0x7f31dc009b50 comp rx=0 tx=0).stop 2023-07-14T15:59:22.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.500+0000 7f31edbff700 1 -- 172.21.15.37:0/328970895 shutdown_connections 2023-07-14T15:59:22.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.500+0000 7f31edbff700 1 --2- 172.21.15.37:0/328970895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31e80cffc0 0x7f31e80b5cf0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:59:22.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.500+0000 7f31edbff700 1 -- 172.21.15.37:0/328970895 >> 172.21.15.37:0/328970895 conn(0x7f31e806b150 msgr2=0x7f31e806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:59:22.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.500+0000 7f31edbff700 1 -- 172.21.15.37:0/328970895 shutdown_connections 2023-07-14T15:59:22.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.500+0000 7f31edbff700 1 -- 172.21.15.37:0/328970895 wait complete. 2023-07-14T15:59:22.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.502+0000 7f31edbff700 1 Processor -- start 2023-07-14T15:59:22.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.502+0000 7f31edbff700 1 -- start start 2023-07-14T15:59:22.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.503+0000 7f31edbff700 1 --2- >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f31e80b8b80 0x7f31e81f1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:59:22.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.503+0000 7f31edbff700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31e80cffc0 0x7f31e80b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:59:22.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.503+0000 7f31edbff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31e8160c50 0x7f31e815d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:59:22.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.503+0000 7f31edbff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e80b3a90 con 0x7f31e8160c50 2023-07-14T15:59:22.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.503+0000 7f31edbff700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e81f2140 con 0x7f31e80cffc0 2023-07-14T15:59:22.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.503+0000 7f31edbff700 1 -- --> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e81f2420 con 0x7f31e80b8b80 2023-07-14T15:59:22.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.503+0000 7f31e7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31e8160c50 0x7f31e815d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:59:22.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.503+0000 7f31e7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31e8160c50 0x7f31e815d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38856/0 (socket says 172.21.15.37:38856) 2023-07-14T15:59:22.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.503+0000 7f31e7fff700 1 -- 172.21.15.37:0/3287344214 learned_addr learned my addr 172.21.15.37:0/3287344214 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-14T15:59:22.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.503+0000 7f31e77fe700 1 --2- 172.21.15.37:0/3287344214 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f31e80b8b80 0x7f31e81f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:59:22.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.503+0000 7f31e6ffd700 1 --2- 172.21.15.37:0/3287344214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31e80cffc0 0x7f31e80b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:59:22.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.503+0000 7f31e7fff700 1 -- 172.21.15.37:0/3287344214 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f31e80b8b80 msgr2=0x7f31e81f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:59:22.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.503+0000 7f31e7fff700 1 --2- 172.21.15.37:0/3287344214 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f31e80b8b80 0x7f31e81f1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:59:22.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.504+0000 7f31e7fff700 1 -- 172.21.15.37:0/3287344214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31e80cffc0 msgr2=0x7f31e80b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:59:22.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.504+0000 7f31e7fff700 1 --2- 172.21.15.37:0/3287344214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31e80cffc0 0x7f31e80b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:59:22.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.504+0000 7f31e7fff700 1 -- 172.21.15.37:0/3287344214 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31dc0094a0 con 0x7f31e8160c50 2023-07-14T15:59:22.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.504+0000 7f31e7fff700 1 --2- 172.21.15.37:0/3287344214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31e8160c50 0x7f31e815d900 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f31e000cba0 tx=0x7f31e000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:59:22.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.504+0000 7f31cffff700 1 -- 172.21.15.37:0/3287344214 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e000ab80 con 0x7f31e8160c50 2023-07-14T15:59:22.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.504+0000 7f31cffff700 1 -- 172.21.15.37:0/3287344214 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f31e000ad00 con 0x7f31e8160c50 2023-07-14T15:59:22.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.504+0000 7f31cffff700 1 -- 172.21.15.37:0/3287344214 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e0007330 con 0x7f31e8160c50 2023-07-14T15:59:22.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.504+0000 7f31edbff700 1 -- 172.21.15.37:0/3287344214 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e81f2700 con 0x7f31e8160c50 2023-07-14T15:59:22.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.504+0000 7f31edbff700 1 -- 172.21.15.37:0/3287344214 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e80b5350 con 0x7f31e8160c50 2023-07-14T15:59:22.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.505+0000 7f31edbff700 1 -- 172.21.15.37:0/3287344214 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31e81f2c20 con 0x7f31e8160c50 2023-07-14T15:59:22.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.506+0000 7f31cffff700 1 -- 172.21.15.37:0/3287344214 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 89139+0+0 (secure 0 0 0) 0x7f31e0007490 con 0x7f31e8160c50 2023-07-14T15:59:22.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.508+0000 7f31cffff700 1 --2- 172.21.15.37:0/3287344214 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f31d406ae00 0x7f31d406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T15:59:22.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.508+0000 7f31cffff700 1 -- 172.21.15.37:0/3287344214 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5324+0+0 (secure 0 0 0) 0x7f31e0088fe0 con 0x7f31e8160c50 2023-07-14T15:59:22.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.508+0000 7f31e77fe700 1 --2- 172.21.15.37:0/3287344214 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f31d406ae00 0x7f31d406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T15:59:22.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.509+0000 7f31e77fe700 1 --2- 172.21.15.37:0/3287344214 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f31d406ae00 0x7f31d406d2b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f31d8000f60 tx=0x7f31d8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T15:59:22.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.512+0000 7f31cffff700 1 -- 172.21.15.37:0/3287344214 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f31e81f2c20 con 0x7f31e8160c50 2023-07-14T15:59:22.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.767+0000 7f31edbff700 1 -- 172.21.15.37:0/3287344214 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31e81f2c20 con 0x7f31e8160c50 2023-07-14T15:59:22.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.767+0000 7f31cffff700 1 -- 172.21.15.37:0/3287344214 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f31e81f2c20 con 0x7f31e8160c50 2023-07-14T15:59:22.750 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-14T15:59:22.750 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":28,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5132,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/1552421235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":1552421235},{"type":"v1","addr":"172.21.15.98:6837","nonce":1552421235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5135,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/4269801846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4269801846},{"type":"v1","addr":"172.21.15.37:6833","nonce":4269801846}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5470,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/3115632546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":3115632546},{"type":"v1","addr":"172.21.15.98:6835","nonce":3115632546}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":6087,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/3610383528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":3610383528},{"type":"v1","addr":"172.21.15.37:6835","nonce":3610383528}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[]} 2023-07-14T15:59:22.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.769+0000 7f31edbff700 1 -- 172.21.15.37:0/3287344214 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f31d406ae00 msgr2=0x7f31d406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:59:22.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.770+0000 7f31edbff700 1 --2- 172.21.15.37:0/3287344214 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f31d406ae00 0x7f31d406d2b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f31d8000f60 tx=0x7f31d8009040 comp rx=0 tx=0).stop 2023-07-14T15:59:22.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.770+0000 7f31edbff700 1 -- 172.21.15.37:0/3287344214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31e8160c50 msgr2=0x7f31e815d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T15:59:22.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.770+0000 7f31edbff700 1 --2- 172.21.15.37:0/3287344214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31e8160c50 0x7f31e815d900 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f31e000cba0 tx=0x7f31e000cf60 comp rx=0 tx=0).stop 2023-07-14T15:59:22.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.770+0000 7f31edbff700 1 -- 172.21.15.37:0/3287344214 shutdown_connections 2023-07-14T15:59:22.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.770+0000 7f31edbff700 1 --2- 172.21.15.37:0/3287344214 >> [v2:172.21.15.98:6832/3163748069,v1:172.21.15.98:6833/3163748069] conn(0x7f31d406ae00 0x7f31d406d2b0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:59:22.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.770+0000 7f31edbff700 1 --2- 172.21.15.37:0/3287344214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31e8160c50 0x7f31e815d900 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:59:22.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.770+0000 7f31edbff700 1 --2- 172.21.15.37:0/3287344214 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x7f31e80b8b80 0x7f31e81f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:59:22.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.770+0000 7f31edbff700 1 --2- 172.21.15.37:0/3287344214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31e80cffc0 0x7f31e80b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T15:59:22.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.770+0000 7f31edbff700 1 -- 172.21.15.37:0/3287344214 >> 172.21.15.37:0/3287344214 conn(0x7f31e806b150 msgr2=0x7f31e80b8070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T15:59:22.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.770+0000 7f31edbff700 1 -- 172.21.15.37:0/3287344214 shutdown_connections 2023-07-14T15:59:22.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-14T15:59:22.770+0000 7f31edbff700 1 -- 172.21.15.37:0/3287344214 wait complete. 2023-07-14T15:59:22.755 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 28 2023-07-14T15:59:22.770 DEBUG:tasks.cephfs.filesystem:already dead... 2023-07-14T15:59:22.771 INFO:teuthology.misc:Shutting down mds daemons... 2023-07-14T15:59:22.771 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-14T15:59:22.771 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T15:59:22.784 INFO:tasks.ceph.mds.a:Stopped 2023-07-14T15:59:22.785 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-14T15:59:22.785 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T15:59:22.839 INFO:tasks.ceph.mds.c:Stopped 2023-07-14T15:59:22.839 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-14T15:59:22.840 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T15:59:22.857 INFO:tasks.ceph.mds.b:Stopped 2023-07-14T15:59:22.857 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-14T15:59:22.857 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T15:59:22.912 INFO:tasks.ceph.mds.d:Stopped 2023-07-14T15:59:22.913 INFO:teuthology.misc:Shutting down osd daemons... 2023-07-14T15:59:22.913 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-07-14T15:59:22.914 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T15:59:22.959 INFO:tasks.ceph.osd.0:Stopped 2023-07-14T15:59:22.960 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-07-14T15:59:22.960 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T15:59:23.007 INFO:tasks.ceph.osd.1:Stopped 2023-07-14T15:59:23.008 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-07-14T15:59:23.008 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T15:59:23.053 INFO:tasks.ceph.osd.2:Stopped 2023-07-14T15:59:23.053 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-07-14T15:59:23.054 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T15:59:23.097 INFO:tasks.ceph.osd.3:Stopped 2023-07-14T15:59:23.098 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-07-14T15:59:23.098 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T15:59:23.146 INFO:tasks.ceph.osd.4:Stopped 2023-07-14T15:59:23.147 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-07-14T15:59:23.147 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T15:59:23.192 INFO:tasks.ceph.osd.5:Stopped 2023-07-14T15:59:23.193 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-07-14T15:59:23.193 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T15:59:23.236 INFO:tasks.ceph.osd.6:Stopped 2023-07-14T15:59:23.237 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-07-14T15:59:23.237 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T15:59:23.288 INFO:tasks.ceph.osd.7:Stopped 2023-07-14T15:59:23.289 INFO:teuthology.misc:Shutting down mgr daemons... 2023-07-14T15:59:23.289 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-07-14T15:59:23.289 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T15:59:23.349 INFO:tasks.ceph.mgr.y:Stopped 2023-07-14T15:59:23.349 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-07-14T15:59:23.350 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T15:59:23.413 INFO:tasks.ceph.mgr.x:Stopped 2023-07-14T15:59:23.413 INFO:teuthology.misc:Shutting down mon daemons... 2023-07-14T15:59:23.414 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-07-14T15:59:23.414 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T15:59:23.433 INFO:tasks.ceph.mon.a:Stopped 2023-07-14T15:59:23.434 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-07-14T15:59:23.434 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T15:59:23.452 INFO:tasks.ceph.mon.b:Stopped 2023-07-14T15:59:23.452 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-07-14T15:59:23.452 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T15:59:23.510 INFO:tasks.ceph.mon.c:Stopped 2023-07-14T15:59:23.511 INFO:tasks.ceph:Checking cluster log for badness... 2023-07-14T15:59:23.512 DEBUG:teuthology.orchestra.run.smithi037:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2023-07-14T15:59:23.603 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi037.front.sepia.ceph.com 2023-07-14T15:59:23.604 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-07-14T15:59:23.928 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi037.front.sepia.ceph.com 2023-07-14T15:59:23.929 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-07-14T15:59:24.160 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi037.front.sepia.ceph.com 2023-07-14T15:59:24.160 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-07-14T15:59:24.340 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi037.front.sepia.ceph.com 2023-07-14T15:59:24.341 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-07-14T15:59:24.583 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi098.front.sepia.ceph.com 2023-07-14T15:59:24.584 DEBUG:teuthology.orchestra.run.smithi098:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-07-14T15:59:24.923 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi098.front.sepia.ceph.com 2023-07-14T15:59:24.923 DEBUG:teuthology.orchestra.run.smithi098:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-07-14T15:59:25.106 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi098.front.sepia.ceph.com 2023-07-14T15:59:25.106 DEBUG:teuthology.orchestra.run.smithi098:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-07-14T15:59:25.316 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi098.front.sepia.ceph.com 2023-07-14T15:59:25.317 DEBUG:teuthology.orchestra.run.smithi098:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-07-14T15:59:25.503 INFO:tasks.ceph:Archiving mon data... 2023-07-14T15:59:25.505 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337600/data/mon.a.tgz 2023-07-14T15:59:25.505 DEBUG:teuthology.orchestra.run.smithi037:> mktemp 2023-07-14T15:59:25.553 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.h7OXlCrR6y 2023-07-14T15:59:25.554 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.h7OXlCrR6y 2023-07-14T15:59:25.714 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0666 /tmp/tmp.h7OXlCrR6y 2023-07-14T15:59:25.830 DEBUG:teuthology.orchestra.remote:smithi037:/tmp/tmp.h7OXlCrR6y is 414KB 2023-07-14T15:59:25.927 DEBUG:teuthology.orchestra.run.smithi037:> rm -fr /tmp/tmp.h7OXlCrR6y 2023-07-14T15:59:25.969 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337600/data/mon.b.tgz 2023-07-14T15:59:25.969 DEBUG:teuthology.orchestra.run.smithi098:> mktemp 2023-07-14T15:59:26.013 INFO:teuthology.orchestra.run.smithi098.stdout:/tmp/tmp.7ebTwNBtif 2023-07-14T15:59:26.014 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.7ebTwNBtif 2023-07-14T15:59:26.242 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 0666 /tmp/tmp.7ebTwNBtif 2023-07-14T15:59:26.356 DEBUG:teuthology.orchestra.remote:smithi098:/tmp/tmp.7ebTwNBtif is 559KB 2023-07-14T15:59:26.456 DEBUG:teuthology.orchestra.run.smithi098:> rm -fr /tmp/tmp.7ebTwNBtif 2023-07-14T15:59:26.498 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337600/data/mon.c.tgz 2023-07-14T15:59:26.499 DEBUG:teuthology.orchestra.run.smithi098:> mktemp 2023-07-14T15:59:26.580 INFO:teuthology.orchestra.run.smithi098.stdout:/tmp/tmp.6fMkEOmeWZ 2023-07-14T15:59:26.581 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.6fMkEOmeWZ 2023-07-14T15:59:26.792 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 0666 /tmp/tmp.6fMkEOmeWZ 2023-07-14T15:59:26.905 DEBUG:teuthology.orchestra.remote:smithi098:/tmp/tmp.6fMkEOmeWZ is 559KB 2023-07-14T15:59:27.002 DEBUG:teuthology.orchestra.run.smithi098:> rm -fr /tmp/tmp.6fMkEOmeWZ 2023-07-14T15:59:27.044 INFO:tasks.ceph:Cleaning ceph cluster... 2023-07-14T15:59:27.045 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-07-14T15:59:27.050 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-07-14T15:59:27.151 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-07-14T15:59:27.152 DEBUG:teuthology.orchestra.run.smithi037:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-07-14T15:59:27.157 DEBUG:teuthology.orchestra.run.smithi098:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-07-14T15:59:27.231 INFO:teuthology.orchestra.run.smithi098.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-07-14T15:59:27.241 INFO:teuthology.orchestra.run.smithi037.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-07-14T15:59:27.257 INFO:tasks.ceph:Archiving crash dumps... 2023-07-14T15:59:27.258 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337600/remote/smithi037/crash 2023-07-14T15:59:27.260 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-07-14T15:59:27.328 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337600/remote/smithi098/crash 2023-07-14T15:59:27.332 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-07-14T15:59:27.399 INFO:tasks.ceph:Shutting down logrotate 2023-07-14T15:59:27.400 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T15:59:27.405 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T15:59:27.514 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-07-14T15:59:27.582 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-07-14T15:59:27.649 INFO:tasks.ceph:Compressing logs... 2023-07-14T15:59:27.650 DEBUG:teuthology.orchestra.run.smithi037:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-07-14T15:59:27.656 DEBUG:teuthology.orchestra.run.smithi098:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-07-14T15:59:27.719 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143403.log 2023-07-14T15:59:27.720 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150105.log 2023-07-14T15:59:27.721 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.143403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149286.log 2023-07-14T15:59:27.722 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.143403.log.gz 2023-07-14T15:59:27.722 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.150105.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.150105.log.gz 2023-07-14T15:59:27.723 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148815.log 2023-07-14T15:59:27.723 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.149286.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.149286.log.gz 2023-07-14T15:59:27.724 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140676.log 2023-07-14T15:59:27.725 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-07-14T15:59:27.725 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.137571.log 2023-07-14T15:59:27.725 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.148815.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.148815.log.gz 2023-07-14T15:59:27.726 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149673.log 2023-07-14T15:59:27.726 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.140676.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.140676.log.gz 2023-07-14T15:59:27.726 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145515.log 2023-07-14T15:59:27.727 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.149673.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.149673.log.gz 2023-07-14T15:59:27.728 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140895.log 2023-07-14T15:59:27.728 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130120.log 2023-07-14T15:59:27.729 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.3.137571.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.137571.log.gz 2023-07-14T15:59:27.729 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-07-14T15:59:27.729 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.130120.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.130120.log.gz 2023-07-14T15:59:27.729 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130448.log 2023-07-14T15:59:27.731 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130166.log 2023-07-14T15:59:27.731 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.130448.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.130448.log.gz 2023-07-14T15:59:27.731 INFO:teuthology.orchestra.run.smithi098.stderr: 91.7% -- replaced with /var/log/ceph/ceph.log.gz 2023-07-14T15:59:27.731 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-07-14T15:59:27.732 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.145515.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.145515.log.gz 2023-07-14T15:59:27.732 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140078.log 2023-07-14T15:59:27.733 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.140895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136100.log 2023-07-14T15:59:27.733 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.140895.log.gz 2023-07-14T15:59:27.733 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.140078.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.140078.log.gz 2023-07-14T15:59:27.733 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136146.log 2023-07-14T15:59:27.733 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.136100.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.136100.log.gz 2023-07-14T15:59:27.734 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147904.log 2023-07-14T15:59:27.734 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.136146.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.136146.log.gz 2023-07-14T15:59:27.734 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137168.log 2023-07-14T15:59:27.737 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.130166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130303.log 2023-07-14T15:59:27.738 INFO:teuthology.orchestra.run.smithi098.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.130166.log.gz 2023-07-14T15:59:27.738 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130257.log 2023-07-14T15:59:27.738 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.130303.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.130303.log.gz 2023-07-14T15:59:27.739 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-07-14T15:59:27.739 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.130257.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-07-14T15:59:27.739 INFO:teuthology.orchestra.run.smithi098.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.130257.log.gz 2023-07-14T15:59:27.739 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-07-14T15:59:27.741 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.147904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142299.log 2023-07-14T15:59:27.741 INFO:teuthology.orchestra.run.smithi037.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.147904.log.gz 2023-07-14T15:59:27.741 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.137168.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.137168.log.gz 2023-07-14T15:59:27.741 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150879.log 2023-07-14T15:59:27.741 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.142299.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.142299.log.gz 2023-07-14T15:59:27.742 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136376.log 2023-07-14T15:59:27.742 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.150879.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.150879.log.gz 2023-07-14T15:59:27.742 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147674.log 2023-07-14T15:59:27.742 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.136376.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.136376.log.gz 2023-07-14T15:59:27.742 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141326.log 2023-07-14T15:59:27.743 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.147674.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.147674.log.gz 2023-07-14T15:59:27.743 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144382.log 2023-07-14T15:59:27.743 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.141326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140768.log 2023-07-14T15:59:27.743 INFO:teuthology.orchestra.run.smithi037.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.141326.log.gz 2023-07-14T15:59:27.743 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.144382.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.144382.log.gz 2023-07-14T15:59:27.744 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138191.log 2023-07-14T15:59:27.746 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.138955.log 2023-07-14T15:59:27.747 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130356.log 2023-07-14T15:59:27.747 INFO:teuthology.orchestra.run.smithi098.stderr: 93.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-07-14T15:59:27.747 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.1.138955.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.138955.log.gz 2023-07-14T15:59:27.747 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-07-14T15:59:27.747 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.130356.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.130356.log.gz 2023-07-14T15:59:27.748 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130401.log 2023-07-14T15:59:27.748 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.138357.log 2023-07-14T15:59:27.748 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.130401.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.130401.log.gz 2023-07-14T15:59:27.748 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.1.138357.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.138357.log.gz 2023-07-14T15:59:27.748 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-07-14T15:59:27.750 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.140768.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.140768.log.gz 2023-07-14T15:59:27.750 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142583.log 2023-07-14T15:59:27.750 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.138191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137178.log 2023-07-14T15:59:27.750 INFO:teuthology.orchestra.run.smithi037.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.138191.log.gz 2023-07-14T15:59:27.750 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.142583.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.142583.log.gz 2023-07-14T15:59:27.751 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149152.log 2023-07-14T15:59:27.751 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.137178.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.137178.log.gz 2023-07-14T15:59:27.751 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-07-14T15:59:27.751 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.149152.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.149152.log.gz 2023-07-14T15:59:27.751 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137180.log 2023-07-14T15:59:27.752 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143645.log 2023-07-14T15:59:27.752 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.137180.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.137180.log.gz 2023-07-14T15:59:27.752 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137664.log 2023-07-14T15:59:27.752 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.143645.log: gzip -5 --verbose -- 88.8%/var/log/ceph/ceph-client.admin.146914.log -- replaced with /var/log/ceph/ceph-client.admin.143645.log.gz 2023-07-14T15:59:27.752 INFO:teuthology.orchestra.run.smithi037.stderr: 2023-07-14T15:59:27.753 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.137664.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.137664.log.gz 2023-07-14T15:59:27.753 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146335.log 2023-07-14T15:59:27.754 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-07-14T15:59:27.754 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-07-14T15:59:27.755 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.146914.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.146914.log.gz 2023-07-14T15:59:27.755 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135766.log 2023-07-14T15:59:27.755 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.146335.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.146335.log.gz 2023-07-14T15:59:27.756 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149060.log 2023-07-14T15:59:27.756 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.135766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147536.log 2023-07-14T15:59:27.756 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.135766.log.gz 2023-07-14T15:59:27.756 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.149060.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.149060.log.gz 2023-07-14T15:59:27.756 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-07-14T15:59:27.757 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.147536.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.147536.log.gz 2023-07-14T15:59:27.758 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137170.log 2023-07-14T15:59:27.758 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141033.log 2023-07-14T15:59:27.758 INFO:teuthology.orchestra.run.smithi037.stderr: 85.0% -- replaced with /var/log/ceph/ceph.log.gz 2023-07-14T15:59:27.759 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.137170.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.137170.log.gz 2023-07-14T15:59:27.759 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143357.log 2023-07-14T15:59:27.759 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.141033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138345.log 2023-07-14T15:59:27.760 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.141033.log.gz 2023-07-14T15:59:27.760 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.143357.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.143357.log.gz 2023-07-14T15:59:27.761 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142115.log 2023-07-14T15:59:27.761 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.138345.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.138345.log.gz 2023-07-14T15:59:27.762 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146448.log 2023-07-14T15:59:27.763 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.142115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144220.log 2023-07-14T15:59:27.763 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.142115.log.gz 2023-07-14T15:59:27.764 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.146448.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.146448.log.gz 2023-07-14T15:59:27.764 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150290.log 2023-07-14T15:59:27.765 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-osd.7.log: /var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.136953.log 2023-07-14T15:59:27.765 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.144220.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.144220.log.gz 2023-07-14T15:59:27.766 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147582.log 2023-07-14T15:59:27.766 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.150290.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.150290.log.gz 2023-07-14T15:59:27.766 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143265.log 2023-07-14T15:59:27.767 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.147582.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.147582.log.gz 2023-07-14T15:59:27.767 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149765.log 2023-07-14T15:59:27.768 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.143265.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.143265.log.gz 2023-07-14T15:59:27.769 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147766.log 2023-07-14T15:59:27.770 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.149765.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.149765.log.gz 2023-07-14T15:59:27.770 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151017.log 2023-07-14T15:59:27.771 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.147766.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.147766.log.gz 2023-07-14T15:59:27.771 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145948.log 2023-07-14T15:59:27.772 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.151017.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.151017.log.gz 2023-07-14T15:59:27.773 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144952.log 2023-07-14T15:59:27.773 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.145948.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.145948.log.gz 2023-07-14T15:59:27.773 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149949.log 2023-07-14T15:59:27.774 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.144952.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.144952.log.gz 2023-07-14T15:59:27.775 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145243.log 2023-07-14T15:59:27.776 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.1.136953.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.136953.log.gz 2023-07-14T15:59:27.776 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-07-14T15:59:27.777 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.149949.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.149949.log.gz 2023-07-14T15:59:27.777 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139986.log 2023-07-14T15:59:27.777 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.145243.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.145243.log.gz 2023-07-14T15:59:27.778 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142161.log 2023-07-14T15:59:27.778 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.139986.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.139986.log.gz 2023-07-14T15:59:27.779 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141280.log 2023-07-14T15:59:27.780 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.142161.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.142161.log.gz 2023-07-14T15:59:27.780 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149424.log 2023-07-14T15:59:27.781 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.141280.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.141280.log.gz 2023-07-14T15:59:27.781 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144997.log 2023-07-14T15:59:27.782 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.149424.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.149424.log.gz 2023-07-14T15:59:27.782 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-07-14T15:59:27.783 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.144997.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.144997.log.gz 2023-07-14T15:59:27.783 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135812.log 2023-07-14T15:59:27.785 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135098.log 2023-07-14T15:59:27.786 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.135812.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.135812.log.gz 2023-07-14T15:59:27.787 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140446.log 2023-07-14T15:59:27.788 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.135098.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.135098.log.gz 2023-07-14T15:59:27.788 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149995.log 2023-07-14T15:59:27.789 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.140446.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.140446.log.gz 2023-07-14T15:59:27.789 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136806.log 2023-07-14T15:59:27.791 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130212.log 2023-07-14T15:59:27.791 INFO:teuthology.orchestra.run.smithi098.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-07-14T15:59:27.792 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.149995.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.149995.log.gz 2023-07-14T15:59:27.793 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146962.log 2023-07-14T15:59:27.793 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.136806.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.136806.log.gz 2023-07-14T15:59:27.794 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137388.log 2023-07-14T15:59:27.794 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.146962.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.146962.log.gz 2023-07-14T15:59:27.794 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147250.log 2023-07-14T15:59:27.796 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.137388.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.137388.log.gz 2023-07-14T15:59:27.796 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151360.log 2023-07-14T15:59:27.796 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.147250.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.147250.log.gz 2023-07-14T15:59:27.797 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146040.log 2023-07-14T15:59:27.798 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.151360.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.151360.log.gz 2023-07-14T15:59:27.798 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-07-14T15:59:27.799 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.146040.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.146040.log.gz 2023-07-14T15:59:27.799 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143127.log 2023-07-14T15:59:27.800 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139709.log 2023-07-14T15:59:27.801 INFO:teuthology.orchestra.run.smithi037.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-07-14T15:59:27.801 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.143127.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.143127.log.gz 2023-07-14T15:59:27.802 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150511.log 2023-07-14T15:59:27.802 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.139709.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.139709.log.gz 2023-07-14T15:59:27.803 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145653.log 2023-07-14T15:59:27.804 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.150511.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.150511.log.gz 2023-07-14T15:59:27.804 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137526.log 2023-07-14T15:59:27.805 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.145653.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.145653.log.gz 2023-07-14T15:59:27.806 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.130212.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.130212.log.gz 2023-07-14T15:59:27.807 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137802.log 2023-07-14T15:59:27.807 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.137526.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.137526.log.gz 2023-07-14T15:59:27.807 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.144615.log 2023-07-14T15:59:27.808 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.137802.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.137802.log.gz 2023-07-14T15:59:27.809 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140722.log 2023-07-14T15:59:27.809 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.144615.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.144615.log.gz 2023-07-14T15:59:27.810 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137710.log 2023-07-14T15:59:27.811 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.140722.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.140722.log.gz 2023-07-14T15:59:27.812 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147100.log 2023-07-14T15:59:27.812 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.137710.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.137710.log.gz 2023-07-14T15:59:27.812 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146694.log 2023-07-14T15:59:27.813 INFO:teuthology.orchestra.run.smithi098.stderr: 95.4% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-07-14T15:59:27.815 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.147100.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.147100.log.gz 2023-07-14T15:59:27.815 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146224.log 2023-07-14T15:59:27.816 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.146694.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.146694.log.gz 2023-07-14T15:59:27.816 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150603.log 2023-07-14T15:59:27.817 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.146224.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.146224.log.gz 2023-07-14T15:59:27.818 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144128.log 2023-07-14T15:59:27.818 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.150603.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.150603.log.gz 2023-07-14T15:59:27.818 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135268.log 2023-07-14T15:59:27.820 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.144128.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.144128.log.gz 2023-07-14T15:59:27.820 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150833.log 2023-07-14T15:59:27.820 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.135268.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.135268.log.gz 2023-07-14T15:59:27.822 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140630.log 2023-07-14T15:59:27.822 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.150833.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.150833.log.gz 2023-07-14T15:59:27.823 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143081.log 2023-07-14T15:59:27.824 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.140630.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.140630.log.gz 2023-07-14T15:59:27.825 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137434.log 2023-07-14T15:59:27.825 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.143081.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.143081.log.gz 2023-07-14T15:59:27.825 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141659.log 2023-07-14T15:59:27.826 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.137434.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.137434.log.gz 2023-07-14T15:59:27.826 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137618.log 2023-07-14T15:59:27.826 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.141659.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.141659.log.gz 2023-07-14T15:59:27.827 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145423.log 2023-07-14T15:59:27.827 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.137618.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.137618.log.gz 2023-07-14T15:59:27.828 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-07-14T15:59:27.828 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.145423.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.145423.log.gz 2023-07-14T15:59:27.829 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142767.log 2023-07-14T15:59:27.830 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135314.log 2023-07-14T15:59:27.831 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.142767.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.142767.log.gz 2023-07-14T15:59:27.832 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147812.log 2023-07-14T15:59:27.832 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.135314.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.135314.log.gz 2023-07-14T15:59:27.833 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146132.log 2023-07-14T15:59:27.834 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.147812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146381.log 2023-07-14T15:59:27.835 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.147812.log.gz 2023-07-14T15:59:27.836 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.146132.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.146132.log.gz 2023-07-14T15:59:27.836 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142253.log 2023-07-14T15:59:27.837 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.146381.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.146381.log.gz 2023-07-14T15:59:27.837 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148406.log 2023-07-14T15:59:27.841 INFO:teuthology.orchestra.run.smithi098.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-07-14T15:59:27.847 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.142253.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.142253.log.gz 2023-07-14T15:59:27.847 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145561.log 2023-07-14T15:59:27.847 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.148406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142353.log 2023-07-14T15:59:27.848 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.148406.log.gz 2023-07-14T15:59:27.848 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.145561.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.145561.log.gz 2023-07-14T15:59:27.848 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151222.log 2023-07-14T15:59:27.848 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.142353.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.142353.log.gz 2023-07-14T15:59:27.849 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150971.log 2023-07-14T15:59:27.849 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.151222.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.151222.log.gz 2023-07-14T15:59:27.849 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149106.log 2023-07-14T15:59:27.849 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.150971.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.150971.log.gz 2023-07-14T15:59:27.849 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142813.log 2023-07-14T15:59:27.850 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.149106.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.149106.log.gz 2023-07-14T15:59:27.851 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146086.log 2023-07-14T15:59:27.851 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.142813.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.142813.log.gz 2023-07-14T15:59:27.851 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.139486.log 2023-07-14T15:59:27.852 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.146086.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.146086.log.gz 2023-07-14T15:59:27.852 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140308.log 2023-07-14T15:59:27.853 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.2.139486.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.139486.log.gz 2023-07-14T15:59:27.853 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137756.log 2023-07-14T15:59:27.854 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.140308.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.140308.log.gz 2023-07-14T15:59:27.854 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150557.log 2023-07-14T15:59:27.855 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.137756.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.137756.log.gz 2023-07-14T15:59:27.856 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140400.log 2023-07-14T15:59:27.857 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.150557.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.150557.log.gz 2023-07-14T15:59:27.857 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149811.log 2023-07-14T15:59:27.859 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.140400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136808.log 2023-07-14T15:59:27.859 INFO:teuthology.orchestra.run.smithi037.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.140400.log.gz 2023-07-14T15:59:27.860 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.149811.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.149811.log.gz 2023-07-14T15:59:27.860 INFO:teuthology.orchestra.run.smithi098.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-07-14T15:59:27.861 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137166.log 2023-07-14T15:59:27.861 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.136808.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.136808.log.gz 2023-07-14T15:59:27.862 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141464.log 2023-07-14T15:59:27.863 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.137166.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.137166.log.gz 2023-07-14T15:59:27.863 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145197.log 2023-07-14T15:59:27.865 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.141464.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.141464.log.gz 2023-07-14T15:59:27.865 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.148207.log 2023-07-14T15:59:27.866 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.145197.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.145197.log.gz 2023-07-14T15:59:27.866 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147054.log 2023-07-14T15:59:27.868 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.148207.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.148207.log.gz 2023-07-14T15:59:27.869 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144814.log 2023-07-14T15:59:27.871 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.147054.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.147054.log.gz 2023-07-14T15:59:27.872 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150787.log 2023-07-14T15:59:27.873 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.144814.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.144814.log.gz 2023-07-14T15:59:27.873 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141885.log 2023-07-14T15:59:27.875 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.150787.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.150787.log.gz 2023-07-14T15:59:27.875 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136054.log 2023-07-14T15:59:27.876 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.141885.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.141885.log.gz 2023-07-14T15:59:27.876 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136812.log 2023-07-14T15:59:27.878 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.136054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141977.log 2023-07-14T15:59:27.878 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.136054.log.gz 2023-07-14T15:59:27.879 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.136812.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.136812.log.gz 2023-07-14T15:59:27.879 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.138822.log 2023-07-14T15:59:27.880 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.141977.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.141977.log.gz 2023-07-14T15:59:27.880 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146540.log 2023-07-14T15:59:27.880 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.138822.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.138822.log.gz 2023-07-14T15:59:27.881 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141234.log 2023-07-14T15:59:27.881 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.146540.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.146540.log.gz 2023-07-14T15:59:27.882 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-07-14T15:59:27.883 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.141234.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.141234.log.gz 2023-07-14T15:59:27.883 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151063.log 2023-07-14T15:59:27.885 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138099.log 2023-07-14T15:59:27.886 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.151063.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.151063.log.gz 2023-07-14T15:59:27.886 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143543.log 2023-07-14T15:59:27.887 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.138099.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.138099.log.gz 2023-07-14T15:59:27.888 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136560.log 2023-07-14T15:59:27.889 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.143543.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.143543.log.gz 2023-07-14T15:59:27.890 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149903.log 2023-07-14T15:59:27.891 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.136560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146178.log 2023-07-14T15:59:27.892 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.136560.log.gz 2023-07-14T15:59:27.892 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.149903.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.149903.log.gz 2023-07-14T15:59:27.892 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151155.log 2023-07-14T15:59:27.893 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.146178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148544.log 2023-07-14T15:59:27.894 INFO:teuthology.orchestra.run.smithi037.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.146178.log.gz 2023-07-14T15:59:27.894 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.151155.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.151155.log.gz 2023-07-14T15:59:27.895 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130307.log 2023-07-14T15:59:27.896 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.148544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151314.log 2023-07-14T15:59:27.897 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.148544.log.gz 2023-07-14T15:59:27.898 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.130307.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.130307.log.gz 2023-07-14T15:59:27.898 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149014.log 2023-07-14T15:59:27.899 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.151314.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.151314.log.gz 2023-07-14T15:59:27.899 INFO:teuthology.orchestra.run.smithi037.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-07-14T15:59:27.900 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135205.log 2023-07-14T15:59:27.901 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.149014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135860.log 2023-07-14T15:59:27.901 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.149014.log.gz 2023-07-14T15:59:27.902 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.135205.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.135205.log.gz 2023-07-14T15:59:27.902 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139940.log 2023-07-14T15:59:27.903 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.135860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150198.log 2023-07-14T15:59:27.904 INFO:teuthology.orchestra.run.smithi037.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.135860.log.gz 2023-07-14T15:59:27.904 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.139940.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.139940.log.gz 2023-07-14T15:59:27.905 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143173.log 2023-07-14T15:59:27.906 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.150198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142445.log 2023-07-14T15:59:27.906 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.150198.log.gz 2023-07-14T15:59:27.907 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.143173.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.143173.log.gz 2023-07-14T15:59:27.908 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143449.log 2023-07-14T15:59:27.909 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.142445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146868.log 2023-07-14T15:59:27.909 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.142445.log.gz 2023-07-14T15:59:27.910 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.143449.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.143449.log.gz 2023-07-14T15:59:27.910 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142491.log 2023-07-14T15:59:27.911 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.146868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136192.log 2023-07-14T15:59:27.912 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.146868.log.gz 2023-07-14T15:59:27.912 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.142491.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.142491.log.gz 2023-07-14T15:59:27.913 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149470.log 2023-07-14T15:59:27.914 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.136192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138145.log 2023-07-14T15:59:27.914 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.136192.log.gz 2023-07-14T15:59:27.915 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.149470.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.149470.log.gz 2023-07-14T15:59:27.915 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142023.log 2023-07-14T15:59:27.917 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.138145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147296.log 2023-07-14T15:59:27.918 INFO:teuthology.orchestra.run.smithi037.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.138145.log.gz 2023-07-14T15:59:27.918 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.142023.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.142023.log.gz 2023-07-14T15:59:27.919 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150695.log 2023-07-14T15:59:27.921 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.147296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148452.log 2023-07-14T15:59:27.922 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.147296.log.gz 2023-07-14T15:59:27.922 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.150695.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.150695.log.gz 2023-07-14T15:59:27.922 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142399.log 2023-07-14T15:59:27.923 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.148452.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.108017.log 2023-07-14T15:59:27.924 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.148452.log.gz 2023-07-14T15:59:27.924 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.142399.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.142399.log.gz 2023-07-14T15:59:27.924 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135720.log 2023-07-14T15:59:27.925 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph.tmp-client.admin.108017.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.108017.log.gz 2023-07-14T15:59:27.926 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143311.log 2023-07-14T15:59:27.927 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.135720.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.135720.log.gz 2023-07-14T15:59:27.927 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145335.log 2023-07-14T15:59:27.928 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.143311.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.143311.log.gz 2023-07-14T15:59:27.928 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147196.log 2023-07-14T15:59:27.929 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.145335.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.145335.log.gz 2023-07-14T15:59:27.930 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139802.log 2023-07-14T15:59:27.930 INFO:teuthology.orchestra.run.smithi098.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-07-14T15:59:27.931 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.147196.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.147196.log.gz 2023-07-14T15:59:27.931 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-07-14T15:59:27.932 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.139802.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.139802.log.gz 2023-07-14T15:59:27.933 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144860.log 2023-07-14T15:59:27.934 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146288.log 2023-07-14T15:59:27.935 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.144860.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.144860.log.gz 2023-07-14T15:59:27.935 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135489.log 2023-07-14T15:59:27.936 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-07-14T15:59:27.937 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.146288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151551.log 2023-07-14T15:59:27.937 INFO:teuthology.orchestra.run.smithi037.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.146288.log.gz 2023-07-14T15:59:27.938 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.135489.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.135489.log.gz 2023-07-14T15:59:27.939 INFO:teuthology.orchestra.run.smithi098.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-07-14T15:59:27.940 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145718.log 2023-07-14T15:59:27.941 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.151551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148314.log 2023-07-14T15:59:27.941 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.151551.log.gz 2023-07-14T15:59:27.941 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.145718.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.145718.log.gz 2023-07-14T15:59:27.942 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143739.log 2023-07-14T15:59:27.942 INFO:teuthology.orchestra.run.smithi098.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-07-14T15:59:27.943 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.148314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143591.log 2023-07-14T15:59:27.943 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.148314.log.gz 2023-07-14T15:59:27.944 INFO:teuthology.orchestra.run.smithi037.stderr: 93.4%/var/log/ceph/ceph-client.admin.143739.log: -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-07-14T15:59:27.944 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.143739.log.gz 2023-07-14T15:59:27.944 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140170.log 2023-07-14T15:59:27.946 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.143591.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.143591.log.gz 2023-07-14T15:59:27.946 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137894.log 2023-07-14T15:59:27.947 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.140170.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.140170.log.gzgzip 2023-07-14T15:59:27.947 INFO:teuthology.orchestra.run.smithi037.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.149240.log 2023-07-14T15:59:27.947 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.137894.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.137894.log.gz 2023-07-14T15:59:27.949 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129995.log 2023-07-14T15:59:27.949 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.149240.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.149240.log.gz 2023-07-14T15:59:27.950 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150741.log 2023-07-14T15:59:27.950 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.129995.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.129995.log.gz 2023-07-14T15:59:27.951 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141613.log 2023-07-14T15:59:27.952 INFO:teuthology.orchestra.run.smithi098.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-07-14T15:59:27.953 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.150741.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.150741.log.gz 2023-07-14T15:59:27.953 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149627.log 2023-07-14T15:59:27.953 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.141613.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.141613.log.gz 2023-07-14T15:59:27.954 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147490.log 2023-07-14T15:59:27.954 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.149627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136008.log 2023-07-14T15:59:27.954 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.149627.log.gz 2023-07-14T15:59:27.955 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.147490.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.147490.log.gz 2023-07-14T15:59:27.955 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140262.log 2023-07-14T15:59:27.955 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.136008.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.136008.log.gz 2023-07-14T15:59:27.956 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141418.log 2023-07-14T15:59:27.956 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.140262.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.140262.log.gz 2023-07-14T15:59:27.956 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143852.log 2023-07-14T15:59:27.957 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.141418.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.141418.log.gz 2023-07-14T15:59:27.958 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137940.log 2023-07-14T15:59:27.958 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.143852.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.143852.log.gz 2023-07-14T15:59:27.959 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148498.log 2023-07-14T15:59:27.960 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.137940.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.137940.log.gz 2023-07-14T15:59:27.960 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136238.log 2023-07-14T15:59:27.961 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.148498.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.148498.log.gz 2023-07-14T15:59:27.961 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140941.log 2023-07-14T15:59:27.962 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.136238.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.136238.log.gz 2023-07-14T15:59:27.962 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147444.log 2023-07-14T15:59:27.963 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.140941.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.140941.log.gz 2023-07-14T15:59:27.964 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145105.log 2023-07-14T15:59:27.965 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.147444.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.147444.log.gz 2023-07-14T15:59:27.965 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141079.log 2023-07-14T15:59:27.966 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.145105.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.145105.log.gz 2023-07-14T15:59:27.966 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139755.log 2023-07-14T15:59:27.967 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.141079.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.141079.log.gz 2023-07-14T15:59:27.967 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143691.log 2023-07-14T15:59:27.968 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.139755.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.139755.log.gz 2023-07-14T15:59:27.968 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141372.log 2023-07-14T15:59:27.969 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.143691.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.143691.log.gz 2023-07-14T15:59:27.970 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151452.log 2023-07-14T15:59:27.970 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.141372.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.141372.log.gz 2023-07-14T15:59:27.971 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137572.log 2023-07-14T15:59:27.972 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.151452.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.151452.log.gz 2023-07-14T15:59:27.972 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135404.log 2023-07-14T15:59:27.973 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.137572.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.137572.log.gz 2023-07-14T15:59:27.973 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144768.log 2023-07-14T15:59:27.974 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.135404.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.135404.log.gz 2023-07-14T15:59:27.975 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150152.log 2023-07-14T15:59:27.975 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.144768.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.144768.log.gz 2023-07-14T15:59:27.976 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135674.log 2023-07-14T15:59:27.977 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.150152.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.150152.log.gz 2023-07-14T15:59:27.977 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-07-14T15:59:27.978 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.135674.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.135674.log.gz 2023-07-14T15:59:27.978 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139848.log 2023-07-14T15:59:27.979 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149332.log 2023-07-14T15:59:27.980 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.139848.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.139848.log.gz 2023-07-14T15:59:27.981 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148725.log 2023-07-14T15:59:27.982 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.149332.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.149332.log.gz 2023-07-14T15:59:27.983 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144722.log 2023-07-14T15:59:27.983 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.148725.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.148725.log.gz 2023-07-14T15:59:27.984 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141797.log 2023-07-14T15:59:27.985 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.144722.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.144722.log.gz 2023-07-14T15:59:27.986 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149581.log 2023-07-14T15:59:27.986 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.141797.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.141797.log.gz 2023-07-14T15:59:27.987 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150649.log 2023-07-14T15:59:27.988 INFO:teuthology.orchestra.run.smithi098.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-07-14T15:59:27.988 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.149581.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.149581.log.gz 2023-07-14T15:59:27.989 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150925.log 2023-07-14T15:59:27.990 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.150649.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.150649.log.gz 2023-07-14T15:59:27.990 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142903.log 2023-07-14T15:59:27.991 INFO:teuthology.orchestra.run.smithi098.stderr: 2023-07-14T15:59:27.991 INFO:teuthology.orchestra.run.smithi098.stderr:real 0m0.295s 2023-07-14T15:59:27.991 INFO:teuthology.orchestra.run.smithi098.stderr:user 0m1.230s 2023-07-14T15:59:27.991 INFO:teuthology.orchestra.run.smithi098.stderr:sys 0m0.212s 2023-07-14T15:59:27.992 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.150925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145856.log 2023-07-14T15:59:27.993 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.150925.log.gz 2023-07-14T15:59:27.993 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.142903.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.142903.log.gz 2023-07-14T15:59:27.994 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136606.log 2023-07-14T15:59:27.994 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.145856.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.145856.log.gz 2023-07-14T15:59:27.995 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149857.log 2023-07-14T15:59:27.996 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.136606.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.136606.log.gz 2023-07-14T15:59:27.996 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142629.log 2023-07-14T15:59:27.997 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.149857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135628.log 2023-07-14T15:59:27.998 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.149857.log.gz 2023-07-14T15:59:27.999 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.142629.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.142629.log.gz 2023-07-14T15:59:27.999 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147008.log 2023-07-14T15:59:28.000 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.135628.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.135628.log.gz 2023-07-14T15:59:28.001 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130438.log 2023-07-14T15:59:28.002 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.147008.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.147008.log.gz 2023-07-14T15:59:28.002 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144082.log 2023-07-14T15:59:28.003 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.130438.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.130438.log.gz 2023-07-14T15:59:28.004 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136468.log 2023-07-14T15:59:28.005 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.144082.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.144082.log.gz 2023-07-14T15:59:28.005 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142207.log 2023-07-14T15:59:28.006 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.136468.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.136468.log.gz 2023-07-14T15:59:28.007 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147352.log 2023-07-14T15:59:28.008 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.142207.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.142207.log.gz 2023-07-14T15:59:28.008 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147628.log 2023-07-14T15:59:28.009 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.147352.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.147352.log.gz 2023-07-14T15:59:28.010 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141751.log 2023-07-14T15:59:28.011 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.147628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136813.log 2023-07-14T15:59:28.012 INFO:teuthology.orchestra.run.smithi037.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.147628.log.gz 2023-07-14T15:59:28.012 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.141751.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.141751.log.gz 2023-07-14T15:59:28.013 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145469.log 2023-07-14T15:59:28.014 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.136813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141705.log 2023-07-14T15:59:28.014 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.136813.log.gz 2023-07-14T15:59:28.015 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.145469.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.145469.log.gz 2023-07-14T15:59:28.015 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150244.log 2023-07-14T15:59:28.016 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.141705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150041.log 2023-07-14T15:59:28.017 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.141705.log.gz 2023-07-14T15:59:28.018 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.150244.log: 93.2% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-07-14T15:59:28.018 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.150244.log.gz 2023-07-14T15:59:28.019 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142069.log 2023-07-14T15:59:28.019 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.150041.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.150041.log.gz 2023-07-14T15:59:28.020 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135535.log 2023-07-14T15:59:28.021 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.142069.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.142069.log.gz 2023-07-14T15:59:28.021 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148590.log 2023-07-14T15:59:28.022 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.135535.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.135535.log.gz 2023-07-14T15:59:28.022 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149719.log 2023-07-14T15:59:28.023 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.148590.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.148590.log.gz 2023-07-14T15:59:28.024 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143495.log 2023-07-14T15:59:28.025 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.149719.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.149719.log.gz 2023-07-14T15:59:28.026 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144266.log 2023-07-14T15:59:28.026 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.143495.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.143495.log.gz 2023-07-14T15:59:28.027 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141567.log 2023-07-14T15:59:28.027 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.144266.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.144266.log.gz 2023-07-14T15:59:28.028 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145810.log 2023-07-14T15:59:28.028 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.141567.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.141567.log.gz 2023-07-14T15:59:28.029 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148922.log 2023-07-14T15:59:28.030 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.145810.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.145810.log.gz 2023-07-14T15:59:28.030 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151597.log 2023-07-14T15:59:28.031 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.148922.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.148922.log.gz 2023-07-14T15:59:28.032 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137986.log 2023-07-14T15:59:28.032 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.151597.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.151597.log.gz 2023-07-14T15:59:28.033 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145607.log 2023-07-14T15:59:28.034 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.137986.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.137986.log.gz 2023-07-14T15:59:28.034 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138045.log 2023-07-14T15:59:28.035 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.145607.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.145607.log.gz 2023-07-14T15:59:28.036 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143219.log 2023-07-14T15:59:28.037 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.138045.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.138045.log.gz 2023-07-14T15:59:28.038 INFO:teuthology.orchestra.run.smithi037.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-07-14T15:59:28.038 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147148.log 2023-07-14T15:59:28.038 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.143219.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.143219.log.gz 2023-07-14T15:59:28.039 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136799.log 2023-07-14T15:59:28.040 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.147148.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.147148.log.gz 2023-07-14T15:59:28.040 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151109.log 2023-07-14T15:59:28.041 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.136799.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.136799.log.gz 2023-07-14T15:59:28.041 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139055.log 2023-07-14T15:59:28.041 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.151109.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.151109.log.gz 2023-07-14T15:59:28.042 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151406.log 2023-07-14T15:59:28.042 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.139055.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.139055.log.gz 2023-07-14T15:59:28.043 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135582.log 2023-07-14T15:59:28.044 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.151406.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.151406.log.gz 2023-07-14T15:59:28.045 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148636.log 2023-07-14T15:59:28.046 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.135582.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.135582.log.gz 2023-07-14T15:59:28.046 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149378.log 2023-07-14T15:59:28.048 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.148636.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.148636.log.gz 2023-07-14T15:59:28.048 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140216.log 2023-07-14T15:59:28.049 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.149378.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.149378.log.gz 2023-07-14T15:59:28.049 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140538.log 2023-07-14T15:59:28.052 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.140216.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.140216.log.gz 2023-07-14T15:59:28.052 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140987.log 2023-07-14T15:59:28.052 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.140538.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.140538.log.gz 2023-07-14T15:59:28.053 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136811.log 2023-07-14T15:59:28.053 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.140987.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.140987.log.gz 2023-07-14T15:59:28.053 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148360.log 2023-07-14T15:59:28.054 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.136811.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.136811.log.gz 2023-07-14T15:59:28.054 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144312.log 2023-07-14T15:59:28.054 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.148360.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.148360.log.gz 2023-07-14T15:59:28.055 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137181.log 2023-07-14T15:59:28.055 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.144312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141931.log 2023-07-14T15:59:28.056 INFO:teuthology.orchestra.run.smithi037.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.144312.log.gz 2023-07-14T15:59:28.056 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.137181.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.137181.log.gz 2023-07-14T15:59:28.057 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149535.log 2023-07-14T15:59:28.057 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.141931.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.141931.log.gz 2023-07-14T15:59:28.058 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140492.log 2023-07-14T15:59:28.058 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.149535.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.149535.log.gz 2023-07-14T15:59:28.059 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142987.log 2023-07-14T15:59:28.060 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.140492.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.140492.log.gz 2023-07-14T15:59:28.060 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145151.log 2023-07-14T15:59:28.061 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.142987.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.142987.log.gz 2023-07-14T15:59:28.061 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143990.log 2023-07-14T15:59:28.062 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.145151.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.145151.log.gz 2023-07-14T15:59:28.063 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140032.log 2023-07-14T15:59:28.063 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.143990.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.143990.log.gz 2023-07-14T15:59:28.064 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145764.log 2023-07-14T15:59:28.064 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.140032.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.140032.log.gz 2023-07-14T15:59:28.065 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147858.log 2023-07-14T15:59:28.066 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.145764.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.145764.log.gz 2023-07-14T15:59:28.066 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140124.log 2023-07-14T15:59:28.067 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.147858.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.147858.log.gz 2023-07-14T15:59:28.067 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146784.log 2023-07-14T15:59:28.068 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.140124.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.140124.log.gz 2023-07-14T15:59:28.069 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142537.log 2023-07-14T15:59:28.069 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.146784.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.146784.log.gz 2023-07-14T15:59:28.070 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151507.log 2023-07-14T15:59:28.071 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.142537.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.142537.log.gz 2023-07-14T15:59:28.071 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136284.log 2023-07-14T15:59:28.072 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.151507.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.151507.log.gz 2023-07-14T15:59:28.072 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140584.log 2023-07-14T15:59:28.073 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.136284.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.136284.log.gz 2023-07-14T15:59:28.073 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141125.log 2023-07-14T15:59:28.074 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.140584.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.140584.log.gz 2023-07-14T15:59:28.075 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143944.log 2023-07-14T15:59:28.075 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.141125.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.141125.log.gz 2023-07-14T15:59:28.076 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145994.log 2023-07-14T15:59:28.077 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.143944.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.143944.log.gz 2023-07-14T15:59:28.077 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147974.log 2023-07-14T15:59:28.078 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.145994.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.145994.log.gz 2023-07-14T15:59:28.078 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143898.log 2023-07-14T15:59:28.079 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.147974.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.147974.log.gz 2023-07-14T15:59:28.080 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143033.log 2023-07-14T15:59:28.080 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.143898.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.143898.log.gz 2023-07-14T15:59:28.081 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-07-14T15:59:28.081 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.143033.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.143033.log.gz 2023-07-14T15:59:28.082 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151268.log 2023-07-14T15:59:28.083 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136330.log 2023-07-14T15:59:28.084 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.151268.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.151268.log.gz 2023-07-14T15:59:28.085 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144906.log 2023-07-14T15:59:28.085 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.136330.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.136330.log.gz 2023-07-14T15:59:28.086 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136514.log 2023-07-14T15:59:28.087 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.144906.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.144906.log.gz 2023-07-14T15:59:28.087 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144036.log 2023-07-14T15:59:28.088 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.136514.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.136514.log.gz 2023-07-14T15:59:28.088 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136803.log 2023-07-14T15:59:28.089 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.144036.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.144036.log.gz 2023-07-14T15:59:28.090 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142675.log 2023-07-14T15:59:28.091 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.136803.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.136803.log.gz 2023-07-14T15:59:28.091 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148968.log 2023-07-14T15:59:28.092 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.142675.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.142675.log.gz 2023-07-14T15:59:28.093 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143785.log 2023-07-14T15:59:28.093 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.148968.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.148968.log.gz 2023-07-14T15:59:28.094 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144174.log 2023-07-14T15:59:28.095 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.143785.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.143785.log.gz 2023-07-14T15:59:28.095 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135954.log 2023-07-14T15:59:28.096 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.144174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145289.log 2023-07-14T15:59:28.096 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.144174.log.gz 2023-07-14T15:59:28.097 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.135954.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.135954.log.gz 2023-07-14T15:59:28.098 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139894.log 2023-07-14T15:59:28.098 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.145289.log: 87.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.145289.log.gz 2023-07-14T15:59:28.099 INFO:teuthology.orchestra.run.smithi037.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.145902.log 2023-07-14T15:59:28.100 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.139894.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.139894.log.gz 2023-07-14T15:59:28.100 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146586.log 2023-07-14T15:59:28.101 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.145902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147720.log 2023-07-14T15:59:28.101 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.145902.log.gz 2023-07-14T15:59:28.102 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.146586.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.146586.log.gz 2023-07-14T15:59:28.102 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140354.log 2023-07-14T15:59:28.103 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.147720.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-07-14T15:59:28.103 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.147720.log.gz 2023-07-14T15:59:28.104 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.140354.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.140354.log.gz 2023-07-14T15:59:28.105 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135908.log 2023-07-14T15:59:28.105 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146494.log 2023-07-14T15:59:28.107 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.135908.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.135908.log.gz 2023-07-14T15:59:28.107 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137172.log 2023-07-14T15:59:28.108 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.146494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137848.log 2023-07-14T15:59:28.109 INFO:teuthology.orchestra.run.smithi037.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.146494.log.gz 2023-07-14T15:59:28.109 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.137172.log: 93.2% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-07-14T15:59:28.110 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.137172.log.gz 2023-07-14T15:59:28.110 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137480.log 2023-07-14T15:59:28.111 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.137848.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.137848.log.gz 2023-07-14T15:59:28.111 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137177.log 2023-07-14T15:59:28.112 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.137480.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.137480.log.gz 2023-07-14T15:59:28.112 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147398.log 2023-07-14T15:59:28.113 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.137177.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.137177.log.gz 2023-07-14T15:59:28.114 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142721.log 2023-07-14T15:59:28.114 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.147398.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.147398.log.gz 2023-07-14T15:59:28.115 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136422.log 2023-07-14T15:59:28.116 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.142721.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.142721.log.gz 2023-07-14T15:59:28.116 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136796.log 2023-07-14T15:59:28.117 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.136422.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.136422.log.gz 2023-07-14T15:59:28.118 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.136796.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.136796.log.gz 2023-07-14T15:59:28.176 INFO:teuthology.orchestra.run.smithi037.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-07-14T15:59:28.338 INFO:teuthology.orchestra.run.smithi037.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-07-14T15:59:28.341 INFO:teuthology.orchestra.run.smithi037.stderr: 2023-07-14T15:59:28.341 INFO:teuthology.orchestra.run.smithi037.stderr:real 0m0.650s 2023-07-14T15:59:28.342 INFO:teuthology.orchestra.run.smithi037.stderr:user 0m1.120s 2023-07-14T15:59:28.342 INFO:teuthology.orchestra.run.smithi037.stderr:sys 0m0.852s 2023-07-14T15:59:28.343 INFO:tasks.ceph:Archiving logs... 2023-07-14T15:59:28.343 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337600/remote/smithi037/log 2023-07-14T15:59:28.344 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-14T15:59:28.782 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337600/remote/smithi098/log 2023-07-14T15:59:28.783 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-14T15:59:28.991 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-07-14T15:59:29.011 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-07-14T15:59:29.011 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-14T15:59:29.016 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-14T15:59:33.047 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-07-14T15:59:33.059 INFO:teuthology.task.clock:Checking final clock skew... 2023-07-14T15:59:33.060 DEBUG:teuthology.orchestra.run.smithi037:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-14T15:59:33.066 DEBUG:teuthology.orchestra.run.smithi098:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-14T15:59:33.107 INFO:teuthology.orchestra.run.smithi037.stderr:bash: ntpq: command not found 2023-07-14T15:59:33.113 INFO:teuthology.orchestra.run.smithi098.stderr:bash: ntpq: command not found 2023-07-14T15:59:33.115 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-14T15:59:33.116 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2023-07-14T15:59:33.116 INFO:teuthology.orchestra.run.smithi037.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 56 -460us[ -473us] +/- 90ms 2023-07-14T15:59:33.116 INFO:teuthology.orchestra.run.smithi037.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 54 -255us[ -255us] +/- 87ms 2023-07-14T15:59:33.116 INFO:teuthology.orchestra.run.smithi037.stdout:^* hv03.front.sepia.ceph.com 3 6 377 55 +561us[ +548us] +/- 74ms 2023-07-14T15:59:33.116 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T15:59:33.122 INFO:teuthology.orchestra.run.smithi098.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-14T15:59:33.122 INFO:teuthology.orchestra.run.smithi098.stdout:=============================================================================== 2023-07-14T15:59:33.122 INFO:teuthology.orchestra.run.smithi098.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 54 -425us[ -425us] +/- 90ms 2023-07-14T15:59:33.122 INFO:teuthology.orchestra.run.smithi098.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 55 -231us[ -231us] +/- 87ms 2023-07-14T15:59:33.123 INFO:teuthology.orchestra.run.smithi098.stdout:^* hv03.front.sepia.ceph.com 3 6 377 55 +574us[ +580us] +/- 74ms 2023-07-14T15:59:33.123 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T15:59:33.124 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-07-14T15:59:33.137 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-07-14T15:59:33.138 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-07-14T15:59:33.162 DEBUG:teuthology.orchestra.run.smithi037:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-07-14T15:59:33.345 DEBUG:teuthology.orchestra.run.smithi098:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-07-14T15:59:33.517 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-14T15:59:33.593 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T15:59:33.594 DEBUG:teuthology.orchestra.run.smithi098:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-14T15:59:33.668 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T15:59:33.670 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-07-14T15:59:33.688 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-07-14T15:59:33.717 INFO:teuthology.task.internal:Duration was 1271.369961 seconds 2023-07-14T15:59:33.718 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-07-14T15:59:33.745 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-07-14T15:59:33.745 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-14T15:59:33.750 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-14T15:59:33.866 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-14T15:59:33.866 INFO:teuthology.orchestra.run.smithi098.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-14T15:59:34.289 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-07-14T15:59:34.289 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi037.front.sepia.ceph.com 2023-07-14T15:59:34.289 DEBUG:teuthology.orchestra.run.smithi037:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-14T15:59:34.350 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi098.front.sepia.ceph.com 2023-07-14T15:59:34.350 DEBUG:teuthology.orchestra.run.smithi098:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-14T15:59:34.410 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-07-14T15:59:34.411 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-14T15:59:34.416 DEBUG:teuthology.orchestra.run.smithi098:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-14T15:59:34.501 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-07-14T15:59:34.501 DEBUG:teuthology.orchestra.run.smithi037:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-14T15:59:34.506 DEBUG:teuthology.orchestra.run.smithi098:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-14T15:59:34.657 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-07-14T15:59:34.668 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-07-14T15:59:34.669 DEBUG:teuthology.orchestra.run.smithi037:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-14T15:59:34.738 DEBUG:teuthology.orchestra.run.smithi098:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-14T15:59:34.807 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-07-14T15:59:34.818 DEBUG:teuthology.orchestra.run.smithi037:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-14T15:59:34.823 DEBUG:teuthology.orchestra.run.smithi098:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-14T15:59:34.886 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = core 2023-07-14T15:59:34.889 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern = core 2023-07-14T15:59:34.925 DEBUG:teuthology.orchestra.run.smithi037:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-14T15:59:34.966 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T15:59:34.967 DEBUG:teuthology.orchestra.run.smithi098:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-14T15:59:35.008 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T15:59:35.009 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-07-14T15:59:35.023 INFO:teuthology.task.internal:Transferring archived files... 2023-07-14T15:59:35.024 DEBUG:teuthology.misc:Transferring archived files from smithi037:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337600/remote/smithi037 2023-07-14T15:59:35.024 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-14T15:59:35.104 DEBUG:teuthology.misc:Transferring archived files from smithi098:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337600/remote/smithi098 2023-07-14T15:59:35.104 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-14T15:59:35.180 INFO:teuthology.task.internal:Removing archive directory... 2023-07-14T15:59:35.181 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-14T15:59:35.185 DEBUG:teuthology.orchestra.run.smithi098:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-14T15:59:35.227 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-07-14T15:59:35.251 INFO:teuthology.task.internal:Not uploading archives. 2023-07-14T15:59:35.252 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-07-14T15:59:35.318 INFO:teuthology.task.internal:Tidying up after the test... 2023-07-14T15:59:35.319 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-14T15:59:35.327 DEBUG:teuthology.orchestra.run.smithi098:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-14T15:59:35.366 INFO:teuthology.orchestra.run.smithi037.stdout: 524835 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 14 15:59 /home/ubuntu/cephtest 2023-07-14T15:59:35.372 INFO:teuthology.orchestra.run.smithi098.stdout: 524293 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 14 15:59 /home/ubuntu/cephtest 2023-07-14T15:59:35.375 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-07-14T15:59:35.401 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-07-14T15:59:35.481 INFO:teuthology.nuke:Checking targets against current locks 2023-07-14T15:59:35.516 DEBUG:teuthology.nuke:shortname: smithi037 2023-07-14T15:59:35.517 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-14T15:59:35.551 DEBUG:teuthology.nuke:shortname: smithi098 2023-07-14T15:59:35.551 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-14T15:59:35.555 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337600', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 15:19:14.480878', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-14T15:59:35.585 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi098.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337600', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 15:19:14.482805', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-14T15:59:35.620 INFO:teuthology.orchestra.console:Power off smithi037 2023-07-14T15:59:35.622 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T15:59:35.651 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T15:59:35.680 INFO:teuthology.orchestra.console:Power off smithi098 2023-07-14T15:59:35.682 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T15:59:35.711 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T15:59:39.697 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T15:59:39.741 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T15:59:43.809 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T15:59:43.856 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T15:59:47.928 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T15:59:47.970 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T15:59:48.141 INFO:teuthology.orchestra.console:Power off for smithi037 completed 2023-07-14T15:59:48.183 INFO:teuthology.orchestra.console:Power off for smithi098 completed 2023-07-14T15:59:48.289 INFO:teuthology.run:Summary data: client.0-kernel-sha1: a440c79eee0258ae07e4988d8690fe6187b8b7a3 client.1-kernel-sha1: a440c79eee0258ae07e4988d8690fe6187b8b7a3 description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/snapshot}} duration: 1271.3699612617493 failure_reason: 'Test failure: test_clean_stale_subvolume_snapshot_metadata (tasks.cephfs.test_volumes.TestSubvolumeSnapshots)' flavor: default owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=9ddd87be2c2c4d2b86d64f7e6f423287 status: fail success: false 2023-07-14T15:59:48.289 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T15:59:48.394 INFO:teuthology.run:FAIL